You are on page 1of 6

Research News

and Comment
Why We Need a Structured Abstract
in Education Research
by Frederick Mosteller, Bill Nave, and Edward J. Miech

Background: Approximately 1,100 education conclusions) and several additional items that is a vast body of information that can prove
journals collectively publish more than 20,000 apply to some articles but not to others (i.e., difficult to access, sort out, or comprehend.
education research articles each year. Under setting, population, intervention, data collec- The challenge is also partly due to the
sheer size and diversity of the education
current practice, no systematic way exists to tion and analysis, and findings).
community. The United States has more
move the research findings from these stud- than 3.6 million teachers in elementary and
Research Design: Analytic essay.
ies into the hands of the millions of education secondary education, more than 100,000
practitioners and policymakers in the United Conclusions: The structured abstract is a vi- principals, and about 15,000 school dis-
States who might use them. able and useful innovation to help practition- tricts, each with its own set of district ad-
ers and policymakers systematically access,
ministrators, school board members, and
Purpose: To help disseminate education re- concerned citizens. The parents and fam-
assess, and communicate education studies
search findings, we propose that education ily members of the 60 million students in
and research findings. Relative to current elementary and secondary education rep-
journals consider adopting a structured ab-
practice, the structured abstract provides a resent another constituency, as do the pol-
stract, a structural innovation that focuses on
more robust vehicle for disseminating re- icymakers and legislators in the 50 states
the format of the article itself. The structured (along with the District of Columbia) and
search through traditional routes as well as
abstract would replace the paragraph-style at the federal level. Postsecondary educa-
through new channels made possible by
narrative summary—typically either an APA- tion represents another 1 million faculty
emerging technologies. members, along with an enrollment of 15
style abstract or “editor’s introduction”—
million undergraduates and 1.8 million
now present at the beginning of many articles.
graduate students.
Intervention: A structured abstract is a formal indings from educational research Education research often does not reach
and compact summary of an article’s main fea-
tures and findings. As does a table or figure, it
has a predictable structure that compresses
F may be our greatest resource for
supporting and improving educa-
tional practice. The latent value of educa-
people who might use it in educational
practice for many other important reasons
in addition to size and sprawl. Almost any
educator can attest to the large perceived
tional research to practice, however, can
information into a small space and can be read
be realized only if these research studies gaps that separate the worlds of education
independent of the main body of the article. research, practice, administration, and pol-
and findings actually reach individuals and
The structured abstract is longer and more icymaking from one another. These gulfs
groups who can use them. Research find-
among the different education communi-
detailed than the standard paragraph-style ings are not self-disseminating, and one
ties tend to be deep and wide, presenting
narrative summary. On the printed page, the cannot assume that important research
genuine barriers to the possibility of edu-
studies and findings automatically make
structured abstract appears between the cation research systematically influencing
their way into the world of education prac-
title and the main body of the article. It in- education practice, and vice-versa.
tice of their own accord. How to move re-
cludes basic items applying to all articles (i.e., search findings into the field in an effective Accessing Research Findings
background, purpose, research design, and and meaningful way has long been a com- Reported in Education Journal
plex, challenging question in education. Articles
The Research News and Comment section This challenge is partly due to the However, this problem of extending the
publishes commentary and analyses on sprawling nature of education research. reach of research studies and findings into
trends, policies, utilization, and contro-
versies in educational research. Like the
Education research has traditionally en- the realm of educational practice also has
articles and reviews in the Features and compassed a wide variety of researchers, technical dimensions. The technical inno-
Book Review sections of ER, this material agendas, institutions, subject areas, con- vation we propose here focuses on a major
does not necessarily reflect the views of texts, and forums for publication. The field component of this issue: how to help mil-
AERA nor is it endorsed by the organization.
is broad and decentralized, and the result lions of people in education connect with

JANUARY/FEBRUARY 2004 29
the tens of thousands of articles of educa- ent manner (e.g., where the institutional a format that efficiently compresses it, and
tion research that might prove useful to affiliation is listed, the style for the refer- a ready-made vehicle to share and commu-
them in practice. Education journals con- ences section), but this set of elements is nicate the findings with others who might
stitute one important forum for dissem- fairly consistent across articles and across use them in practice.
inating research findings because they journals. The structured abstract occupies, both
provide stable institutional vehicles for au- These elements each provide partial clues literally and figuratively, the strategic mid-
thors to publish new and original research about the full journal article but do not— dle ground between the title and main body
on a broad array of educational issues. At either individually or collectively—convey of the article. The title of an article hints at
present, more than 1,100 education jour- the detailed, specific information necessary what the article is about but offers so little
nals collectively publish more than 20,000 to interpret and understand the findings information that it usually is an unreliable
education research articles each year.1 and conclusions of the article. The reader marker: Readers cannot judge an article by
Today, consumers of education re- can locate and extract that information only its title. The main body of the article, on
search can access findings of education by scanning the body of the article to iden- the other hand, provides the specific de-
studies under a fairly narrow set of cir- tify its key features, which the reader must tails necessary for a critical appraisal of a
cumstances. These conditions include ac- then consider jointly when evaluating the study and its findings but requires the
cess to a hard copy of the journal article published results. The time required to reader to work through pages of text to lo-
through a personal or institutional sub- “size up” an article by finding and evaluat- cate the crucial information.
scription or through a library, on-line ac- ing its salient information depends on the The structured abstract, at one to two
cess to the full text of an article through a skill and experience of the reader and the pages long, provides a formal and compact
journal’s Web site or a via a database ser- extent to which the article itself is well or- summary of an article’s main features and
vice, and receipt of a copy of the article ganized, well written, and thorough. findings. This concise summary provides a
from someone else who has access to the Thus, the task of an individual reader wealth of specific details about an individ-
hard copy or digital version. who seeks out the research findings of an ual article and thus serves as an informa-
Furthermore, in addition to access, in- tion tool that allows readers to consider
education research article is often not an
dividuals must have the time and motiva- and sort through large pools of articles
easy one. Nevertheless, the search is much
when searching for studies of potential in-
tion to sort through the various education more difficult when conducted on a com-
terest. The structured abstract likewise
journals to find and evaluate articles of puter. Most online and database searches
serves as a useful vehicle for sharing and
potential value to themselves and their for education studies or research findings
communicating education research, in that
colleagues. This threefold requirement of yield only the barest reference information,
the compact format is well suited for
access, time, and motivation creates a for- typically providing bibliographic details
reaching the attention of busy people. It is
midable bottleneck on the flow of infor- and a brief, very general overview. A critical also a good fit with ongoing trends in
mation and findings to people in education appraisal of a study’s findings is daunting— emerging technology, as the structured
who might use those findings to inform if not impossible—when specific infor- abstract is the right size for being read in
practice or policy. mation is not available about the study’s e-mail messages received via computers
background, purpose, setting, participants, and portable handheld devices.
Current Basic Format for Journal
intervention, research design, data collec- Finally, the structured abstract offers
Articles
tion and analysis, or conclusions. It comes a balanced way for journals to provide
Education journal articles, like education re- as cold comfort to many a busy person in
search in general, address a broad, varied set detailed information about education stud-
education that this detailed information is ies and findings online while still main-
of issues in education. Each education jour- sitting on the shelves of local libraries in the
nal makes its own editorial decisions and taining control over access to intellec-
form of microfiche or bound journals. tual content. With the structured abstract
policies, resulting in published articles that
cover an astonishing variety of topics with a The Need for a Structured freely available online, people conducting
large assortment of research strategies. Be- Abstract in Education Research computer-generated searches have access
neath all of this variation, though, resides a The traditional way of disseminating edu- to an intermediate level of information
familiar and predictable format for journal cation research is unfortunate in our opin- about a study’s key features and findings.
articles that the field of education shares ion because so many valuable education This detailed information can help some-
with the other social sciences. This basic studies and findings get lost in the shuffle. one looking at a large number of articles
format always includes a title, a listing of au- We believe that the structured abstract, an assess the scope of research that has been
thor(s) and institutional affiliation(s), and innovation that focuses on the format of conducted on a particular topic and the
the body of the article, often divided into the article itself, can help overcome many general direction of the findings. People
sections focusing on introduction, meth- of these status quo impediments to dis- conducting computer searches will also be
ods, analysis, findings, and conclusions. It seminating education research findings. A able to use the structured abstract as an in-
also almost always includes a reference sec- structured abstract would systematically formation tool to determine which articles
tion; a short, paragraph-style narrative offer individuals greater access to detailed they need to access and read as full-text
summary; and an acknowledgments sec- information about research findings re- documents, likely leading to a greater over-
tion. Individual education journals may ported in education journal articles, a bet- all demand for journal articles of education
format each element in a slightly differ- ter way to assess this information through research. Web sites of individual journals

30 EDUCATIONAL RESEARCHER
can make these structured abstracts avail- features and findings of a study, yet the ab- role in their implementation, in that indi-
able; in addition, education information stract would still fit on a single page. vidual journals will decide whether to adopt
services that already exist, such as the fed- The structured abstract is both similar to structured abstracts and in what form. To
erally funded Educational Resources Infor- and different from the paragraph-style nar- assist individual journals in this decision,
mation Center (ERIC) system, could make rative summary found in current practice. we suggest that they give serious considera-
the structured abstracts from hundreds of They are similar in that the basic contents tion to the way in which education practi-
journals collectively available online. of the structured abstract are essentially the tioners and policymakers currently access,
same as the elements of journal abstracts assess, and disseminate information about
The Structured Abstract in recommended by the Publication Manual education studies and findings reported in
Education Research: An Example of the American Psychological Association, journal articles and to how a structured
Figure 1 (see p. 32) presents a comparison the reference text that many in education abstract could help improve that process.
of the actual abstract (formatted accord- research and publishing consider authori- When a journal does decide to adopt a
ing to the guidelines of the American tative on matters of style (APA, 2001). structured abstract on a trial or permanent
Psychological Association [APA]) for an The APA guidelines recommend that au- basis, we recommend that the journal also
original study on class size that appeared thors prepare a “brief, comprehensive sum- consider an evaluation plan to assess the ef-
in a top-tier education research journal in mary of the contents of the article” that is fects of the structured abstract in practice.
1990 and a structured abstract for the “accurate, self-contained, concise and spe- An important limitation of the structured
same article. Readers can see and evaluate cific.” The guidelines then suggest what abstract is that its format, while designed to
for themselves from this example how a should be included in an abstract for four facilitate access to education research, could
389-word structured abstract compares kinds of articles: an empirical study, a re- nevertheless be misused to distort, oversim-
with a 150-word narrative introduction in view or theoretical article, a methodologi- plify, or overgeneralize research findings.
providing the necessary information for cal article, and a case study. The elements Careful, ongoing evaluation of the design
quickly accessing and assessing the study’s proposed for each of these abstract types and implementation of the structured ab-
main features and findings. are consistent with the nine basic elements stract in education can help in identifying
described here for a structured abstract. these limitations in practice and in develop-
The Structured Abstract in
APA-style abstracts and structured ab- ing effective safeguards and strategies to ad-
Education Research: Basic Design
stracts differ, however, in that a structured dress them. These evaluations can likewise
A fundamental principle behind the struc- help individual journals understand the im-
abstract would be hamstrung by a 120-
tured abstract is that it is a serious part of pact of the structured abstract on their read-
word limit, whereas a paragraph-style nar-
the article itself and is edited with the ership and inform the decision making
rative summary would not necessarily be
same attention and rigor as the rest of the of other education journals contemplating
article. A structured abstract is similar improved by doubling or tripling its length
and having a three-paragraph abstract in- whether to adopt the structured abstract.
to a table or figure in that it has a pre-
stead of a one-paragraph summary at the The use of the structured abstract in
dictable structure, it compresses a great
beginning of an article. The APA guide- medicine provides a relevant example from
deal of information into a relatively small
lines dictate a word limit of 120 words and another field of inquiry. In 1987, a call for
space, and it is self-sufficient insofar as it
imply that abstracts should be in para- a structured abstract in medical journals
is complete and able to be read and un-
graph style, and in this case the strictness appeared in the journal Annals of Internal
derstood independent of the main body
of the word limit seems to impose some Medicine, and Annals adopted the struc-
of the article.
Education journals would be expected to discipline on the somewhat loose and tured abstract format itself 6 months later
have slightly different versions of the struc- open format of the paragraph. The struc- (Ad Hoc Working Group for Critical Ap-
tured abstract that all convey essentially the tured abstract, on the other hand, allows praisal of the Medical Literature, 1987).
same information, just as journals have dif- for greater length but within a highly struc- The number of medical journals that vol-
ferent styles for conveying the same biblio- tured format, providing a detailed and untarily adopted the structured abstract
graphic information in the reference section. user-friendly framework to organize and grew exponentially, and within 5 years
The structured abstract is characterized by display this additional information. The most of the leading medical journals in the
two sets of elements: four basic elements that result is a longer and more robust abstract United States and throughout the world
apply to all articles (i.e., background, pur- wherein greater length does not compro- had adopted some form of a structured ab-
pose, research design, and conclusions) and mise clarity or concision but instead allows stract. Within 3 years of the original call
five additional elements that apply to some the abstract to convey substantially more for a structured abstract, the U.S. National
articles but not others (i.e., setting, popula- key information to the reader in a stand- Library of Medicine included the full texts
tion, intervention, data collection and alone format that can be understood inde- of structured abstracts in the federally
analysis, and findings). A template for a pendently of the main article. funded MEDLINE database that is ac-
structured abstract that shows all nine ele- cessible and searchable by the public. Ed-
ments is displayed in Figure 2 (see p. 33). Conclusions itorially, the adoption of the structured
As a general rule of thumb, we recom- The technical innovation of the structured abstract has been reported as “straight-
mend that structured abstracts be between abstract has enormous potential to extend forward”: “After a brief settling-in pe-
200 and 400 words in length. This pro- the reach of educational research. Educa- riod, editorial revisions have been no
vides sufficient space for details about key tion journals, naturally, will play the crucial more extensive than for material in the

JANUARY/FEBRUARY 2004 31
Original APA-style abstract:
A large-scale experiment is described in which kindergarten students and teachers were randomly
assigned to small and large classes within each participating school. Students remained in these
classes for 2 years. At the end of each grade they were measured in reading and mathematics by
standardized and curriculum-based tests. The results are definitive; (a) a significant benefit accrues
to students in reduced-size classes in both subject areas and (b) there is evidence that minority
students in particular benefit from the smaller class environment, especially when curriculum-
based tests are used as the learning criteria. A longitudinal analysis of a portion of the sample
indicated that students in small classes outperform their peers in kindergarten classes of regular
size and also gain more in reading outcomes during the second year. The question of why these
effects are realized remains largely unanswered, but in light of these findings, is particularly
important to pursue. (Finn & Achilles, 1990).2

Structured abstract:
Background: Class size reduction continues to attract attention as a school reform measure. Prior
research on the effects of class size has been inconclusive, leading to ongoing controversy and
debate about the magnitude, if any, of a “class-size effect” on learning outcomes for children.

Purpose: To assess the effects of a statewide experiment where class size was substantially
reduced in kindergarten and first-grade classes.

Setting: 76 public elementary schools drawn from inner-city, urban, suburban, and rural locations
in Tennessee. A total of 328 kindergarten classes and 347 first-grade classes participated in the
study.

Subjects: 6,570 students enrolled in kindergarten in the 1985–1986 school year.


Intervention: Students were randomly assigned by project staff to one of three class types: small
(13–17 pupils), regular (22–25 pupils), or regular with a teacher aide (22–25 pupils). Students
assigned to small classes stayed in small classes for kindergarten and first grade.

Research Design: Randomized-controlled field trial.

Data Collection and Analysis: The Stanford Achievement Tests in reading and mathematics were
administered in the spring of each school year, and a set of Tennessee curriculum-referenced tests
were administered at the beginning of first grade. Means on each outcome measure were calculated
for each class, then separately for White and minority students in each classroom. Two analyses
were conducted using multivariate analysis of variance: a cross-sectional analysis of the entire
first-grade sample and a longitudinal analysis of a subset of pupils (n = 2291) who were in the
study for both kindergarten and first grade and had complete SAT achievement test data.

Findings: Significant benefits of class size reduction were seen across all academic measures. The
cross-sectional analysis of first graders yielded an overall difference of about one fourth of a
standard deviation among students in small classes vs. regular classes. Minority students benefited
in particular, averaging a difference of a third of a standard deviation over their regular class
counterparts on five of the six academic measures. In the longitudinal analysis, students in small
classes had a highly statistically significant advantage in reading and mathematics over regular
classes in both kindergarten and first grade.

Conclusions: This study demonstrates that small classes have an advantage over larger classes in
reading and mathematics in the early primary grades. The analysis also strongly suggests that small
classes especially benefit the academic performance of minority students.

FIGURE 1. Comparison of actual paragraph-style narrative summary and proposed structured abstract for an
original study that appeared in the Fall 1990 American Educational Research Journal.

rest of the articles, alleviating an early con- relatively short period indicates that the needed insights through close analysis of
cern that the preparation of structured ab- structured abstract is practically useful and its implementation in a new field.
stracts would require a substantial increase also fulfills a genuine need in medical re- The structured abstract is an innovative
in editorial resources” (Haynes, Mulrow, search. However, there has been very little and viable information tool that can help
Huth, Altman, & Gardner, 1990, p. 70). formal evaluation of the effects of the struc- busy people in education access, assess, and
The extent to which the structured ab- tured abstract in medicine, and this is an disseminate education studies and research
stract has permeated medical journals in a area in which education could provide findings. In England, the structured abstract

32 EDUCATIONAL RESEARCHER
Background/Context: Description of prior research on the subject and/or its intellectual context
and/or its policy context.

Purpose/Objective/Research Question/Focus of Study: Description of what the research focused on


and/or why.

Setting: Specific description of where the research took place.

Population/Participants/Subjects: Description of the participants in the study: who (or what), how
many, key features.

Intervention/Program/Practice: Specific description of the intervention, including what it was,


how it was administered, and its duration.

Research Design: Description of the research design (e.g., qualitative case study, quasi-
experiment, secondary analysis, analytic essay, randomized-controlled field trial).

Data Collection and Analysis: Description of plan for collecting and analyzing data, including
description of data.

Findings/Results: Description of main findings with specific details.

Conclusions/Recommendations: Description of conclusions and recommendations of author(s)


based on findings and overall study.

FIGURE 2. Proposed template for a structured abstract for education research journal articles.

is already used by several journals that more formal structured abstract replace the prehensive, there are at least a few education-
publish research in the social sciences, in- paragraph-style narrative summary and that related journals and articles that ERIC does not
cluding the British Journal of Educational structured abstracts eventually become part cover; thus, these figures are conservative.
2 Copyright 1990 by the American Educa-
Psychology, the British Journal of Psychiatry, of the basic format of every journal article.
tional Research Association; reproduced with
and the British Journal of Clinical Psychol- The structured abstract is uniquely posi-
permission from the publisher.
ogy. British psychologist James Hartley’s tioned to help research studies and find-
recent research on the use of structured ab- ings reach people in education who can REFERENCES
stracts in social science journals has shown use them by providing a needed bridge be- Ad Hoc Working Group for Critical Appraisal of
that structured abstracts are easier to read, tween those with and without easy access the Medical Literature. (1987). A proposal for
more informative, and clearer than their to journal articles, between hard copy and more informative abstracts of clinical articles.
traditional counterparts (Hartley, 1997, digital modes of distribution, and, most Annals of Internal Medicine, 106, 598–604.
1999; Hartley & Sydes, 1997). important, between the worlds of educa- American Psychological Association. (2001).
Education over time has already devel- tion research and practice. Publication manual of the American Psycho-
oped a predictable format for journal ar- logical Association (5th ed.). Washington, DC:
NOTES Author.
ticles. As mentioned earlier, this format
The writing of this article was supported by a Finn, J. D., & Achilles, C. M. (1990). Answers
consists of three basic elements for each
grant from the Andrew W. Mellon Founda- and questions about class size. American Ed-
article: title, listing of author(s) and insti- ucational Research Journal, 27, 557–577.
tion to the American Academy of Arts and Sci-
tutional affiliation(s), and the body of the ences. We are grateful to Robert Boruch, Brian Hartley, J. (1997). Is it appropriate to use
article. It also includes three additional ele- Haynes, and James Hartley for sharing with us structured abstracts in social science jour-
ments common to most articles: a reference their insights about the use of structured ab- nals? Learned Publishing, 10, 313–317.
section; a short, paragraph-style narrative stracts in other disciplines. We also thank the Hartley, J. (1999). Applying ergonomics to
summary; and an acknowledgments sec- journal editors and the four anonymous review- Applied Ergonomics: Using structured ab-
tion. In addition, general consensus has ers for suggestions that resulted in substantive stracts. Applied Ergonomics, 30, 535–541.
developed over preferred formats for tables changes and improvements to this article. Hartley, J., & Sydes, M. (1997). Are structured
and figures, where authors use a predictable 1 The Source Journal Index database for abstracts easier to read than traditional ones?
structure to compress detailed information ERIC, the federally funded Education Re- Journal of Research in Reading, 20, 122–136.
into a small space, allowing this informa- sources Information Center, listed 1,177 jour- Haynes, R. B., Mulrow, C. D., Huth, E. J.,
nals as of September 2003. More than 20,000 Altman, D. G., & Gardner, M. J. (1990).
tion to be understood independent of the
individual articles were indexed annually in More informative abstracts revisited. Annals
main body of the article. ERIC from 1995 through 2000; in subsequent of Internal Medicine, 113, 69–76.
As part of this gradual development of years, close to 20,000 individual articles have
practical and efficient structures in edu- been published annually, but these articles are AUTHORS
cation research to communicate key in- not yet fully indexed because this process takes FREDERICK MOSTELLER is Roger I. Lee Pro-
formation to readers, we propose that a several years to complete. While ERIC is com- fessor of Mathematical Statistics, Emeritus, at

JANUARY/FEBRUARY 2004 33
the Graduate School of Arts and Sciences, BILL NAVE is a senior researcher at TERC, CT 06515; edmiech@cs.com. His research in-
School of Public Health, and Medical School of 2067 Massachusetts Avenue, Cambridge, MA terests include the use of digital technology to
Harvard University, Department of Statistics, 02140; bill_nave@terc.edu. His research inter- focus on student work and to show how stu-
Science Center, 6th Floor, Room 604, Cam- ests include technology integration in schools dents learn over time.
bridge, MA 02138; mostell@fas.harvard.edu. as well as professional development and men-
He helped found the Harvard Department of Manuscript received January 13, 2003
toring for math and science teachers.
Statistics and has addressed research issues in Revisions received March 7, July 7, and
education, public policy, medicine, and health EDWARD J. MIECH is an independent re- September 18, 2003
policy throughout his career. searcher at 29 West Rock Avenue, New Haven, Accepted October 1, 2003

34 EDUCATIONAL RESEARCHER

You might also like