The DOI matches its Crossref record.
Evidence matters: randomized trials in education research
Abstract
Opinions about education programs and practices are offered frequently --by children, parents, teachers, and policymakers. Credible studies of the impact of programs on the performance of children are far less frequent. Researchers use a variety of tools to determine their impact and efficacy, including sample surveys, narrative studies, and exploratory research. However, randomized field trials, which are commonly used in other disciplines, are rarely employed to measure the impact of education practice. Evidence Matters explores the history and current status of research in education and encourages the more frequent use of such trials. Judith Gueron (Manpower Demonstration Research Corporation), discusses the challenges involved in randomized trials and offers practical advice drawn experience. Robert Boruch (Wharton School, University of Pennsylvania), Dorothy de Moya (Campbell Collaboration Secretariat), and Brooke Snyder (University of Pennsylvania) explore the use of randomized field trials in education and other fields. David Cohen, Stephen Raudenbush, and Deborah Loewenberg Ball (all from the University of Michigan) review the history of progress in education over the past forty years and urge increased research on coherent instruction regimes. Maris Vinovskis (University of Michigan) examines the history and role of the U.S. Department of Education in developing rigorous evaluation of federal programs, and suggests a new National Center for Evaluation and Development. Thomas Cook and Monique Renee Payne (both from Northwestern University) take on the claim that randomized field trials are inappropriate in the U.S. education system. Gary Burtless (Brookings Institution) explores the political and professional factors that influence randomized field trials in economic programs, examining possible explanations for their lack of frequent use in education. Carol Weiss (Harvard University) provides a brief history of community studies in the United States and suggests a variety of alternatives to randomization. It is difficult to gauge the impact of various approaches in education. But the authors give a variety of concrete examples to illustrate the feasibility of randomized trials, and the circumstances under which they are appropriate. By offering a variety of suggestions to improve the methods used to evaluate education programs, the contributors to this volume seek to improve education in the United States. Frederick Mosteller is Roger I. Lee Professor in Mathematical Statistics, emeritus, in the department of statistics at Harvard University. Robert Boruch is the University Trustee Chair Professor the graduate school of education and statistics department at the Wharton School, University of Pennsylvania
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Desimone, L. M. (2009) · Educational Researcher · doi:10.3102/0013189x08331140 · Cited by 4,862
Handbook of Critical and Indigenous Methodologies
Denzin, N., Lincoln, Y., & Smith, L. (2008) · doi:10.4135/9781483385686 · Cited by 1,637
Wicked Problems: Implications for Public Policy and Management
Head, B. W., & Alford, J. (2015) · Administration & Society · doi:10.1177/0095399713481601 · Cited by 1,514
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338
Seidel, T., & Shavelson, R. J. (2007) · Review of Educational Research · doi:10.3102/0034654307310317 · Cited by 1,259
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247
Evidence-Based Education Policies: Transforming Educational Practice and Research
Slavin, R. E. (2002) · Educational Researcher · doi:10.3102/0013189x031007015 · Cited by 1,104
Research in Special Education: Scientific Methods and Evidence-Based Practices
Odom, S. L., Brantlinger, E., Gersten, R., Horner, R. H., Thompson, B., & Harris, K. R. (2005) · Exceptional Children · doi:10.1177/001440290507100201 · Cited by 970
Registries for Evaluating Patient Outcomes: A User’s Guide
(2020) · doi:10.23970/ahrqepcregistries4 · Cited by 960
How Should Research Contribute to Instructional Improvement? The Case of Lesson Study
Lewis, C., Perry, R., & Murata, A. (2006) · Educational Researcher · doi:10.3102/0013189x035003003 · Cited by 898
Intraclass Correlation Values for Planning Group-Randomized Trials in Education
Hedges, L. V., & Hedberg, E. C. (2007) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373707299706 · Cited by 847
Learning identity: the joint emergence of social identification and academic learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5179 · Cited by 829
Comprehensive School Reform and Achievement: A Meta-Analysis
Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S. (2003) · Review of Educational Research · doi:10.3102/00346543073002125 · Cited by 795
Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015) · Prevention Science · doi:10.1007/s11121-015-0555-x · Cited by 627
Evidence-Based Crime Prevention
Welsh, B. C., & Farrington, D. P. (2007) · Preventing Crime · doi:10.1007/978-0-387-69169-5_1 · Cited by 596
Proposing a core set of instructional practices and tools for teachers of science
Windschitl, M., Thompson, J., Braaten, M., & Stroupe, D. (2012) · Science Education · doi:10.1002/sce.21027 · Cited by 593
Slavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560
Reconsidering evidence-based policy: Key issues and challenges
Head, B. W. (2010) · Policy and Society · doi:10.1016/j.polsoc.2010.03.001 · Cited by 527
Kratochwill, T. R., & Levin, J. R. (2010) · Psychological Methods · doi:10.1037/a0017736 · Cited by 494
Toward More “Evidence‐Informed” Policy Making?
Head, B. W. (2016) · Public Administration Review · doi:10.1111/puar.12475 · Cited by 453
Desimone, L. M., & Le Floch, K. C. (2004) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737026001001 · Cited by 421
Scientific Culture and Educational Research
Feuer, M. J., Towne, L., & Shavelson, R. J. (2005) · Standards und Standardisierungen in der Erziehungswissenschaft · doi:10.1007/978-3-322-80769-4_3 · Cited by 411
Toward a Theory of Teacher Education for Social Justice
Cochran-Smith, M. (2010) · Second International Handbook of Educational Change · doi:10.1007/978-90-481-2660-6_27 · Cited by 391
Using Experiments to Estimate the Effects of Education on Voter Turnout
Sondheimer, R. M., & Green, D. P. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00425.x · Cited by 339
Disciplining qualitative research
Denzin, N. K., Lincoln, Y. S., & Giardina, M. D. (2006) · International Journal of Qualitative Studies in Education · doi:10.1080/09518390600975990 · Cited by 289
Lather, P. (2004) · Qualitative Inquiry · doi:10.1177/1077800403256154 · Cited by 282
Wittwer, J., & Renkl, A. (2008) · Educational Psychologist · doi:10.1080/00461520701756420 · Cited by 277
Evaluating the Quality of Evidence from Correlational Research for Evidence-Based Practice
Thompson, B., Diamond, K. E., McWilliam, R., Snyder, P., & Snyder, S. W. (2005) · Exceptional Children · doi:10.1177/001440290507100204 · Cited by 273
The Uses of Evidence for Educational Policymaking: Global Contexts and International Trends
Wiseman, A. W. (2010) · Review of Research in Education · doi:10.3102/0091732x09350472 · Cited by 269
Theme Issue: The Role of Design in Educational Research
Kelly, A. E. (2003) · Educational Researcher · doi:10.3102/0013189x032001003 · Cited by 264
Cook, T. D. (2002) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737024003175 · Cited by 257
Using Science as Evidence in Public Policy
(2012) · National Academies Press eBooks · doi:10.17226/13460 · Cited by 254
Zheng, L., Niu, J., Zhong, L., & Gyasi, J. F. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.2015693 · Cited by 183
Agasisti, T., & Bowers, A. J. (2017) · Handbook of Contemporary Education Economics · doi:10.4337/9781785369070.00014 · Cited by 83
Maynard, R. A. (2006) · Journal of Policy Analysis and Management · doi:10.1002/pam.20169 · Cited by 47
Braga, A. A., MacDonald, J. M., & McCabe, J. (2022) · Criminology · doi:10.1111/1745-9125.12293 · Cited by 40
Moore, L., Graham, A., & Diamond, I. (2003) · British Educational Research Journal · doi:10.1080/0141192032000133712 · Cited by 32
(2008) · CU Scholar (University of Colorado Boulder) · Cited by 19
Förderung selbstregulierten Lernens im schulischen Kontext
Spörer, N., & Glaser, C. (2010) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000014 · Cited by 12
Metadata
- Venue
- Choice Reviews Online
- Publisher
- American Library Association
- Published
- 2003-02-01
- Volume
- 40
- Issue
- 06
- Pages
- 40-3545-40-3545
- ISSN
- 0009-4978 (ISSN-L)
- 1523-8253
- OpenAlex
- W598559129
- Cited by
- 372
- References
- 0
- Type
- book review
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.