Comprehensive School Reform and Achievement: A Meta-Analysis
The DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Abstract
This meta-analysis reviews research on the achievement effects of comprehensive school reform (CSR) and summarizes the specific effects of 29 widely implemented models. There are limitations on the overall quantity and quality of the research base, but the overall effects of CSR appear promising. The combined quantity, quality, and statistical significance of evidence from three models, in particular, set them apart. Whether evaluations are conducted by developers or by third-party evaluators and whether evaluators use one-group pre-post designs or control groups are important factors for understanding differences in CSR effects. Schools that implemented CSR models for 5 years or more showed particularly strong effects, and the benefits were consistent across schools of varying poverty levels. A long-term commitment to research-proven educational reform is needed to establish a strong marketplace of scientifically based CSR models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,708
(1979) · Medical Entomology and Zoology · Cited by 11,252
(2000) · Cited by 9,198
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Spillane, J. P. (2003) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737025004343 · Cited by 4,286
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Education and Treatment of Children
Hickman, J. A., Wheatley, J. K., & Sheridan, K. D. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese0816 · Cited by 3,223
(2010) · Encyclopedia of Curriculum Studies · doi:10.4135/9781412958806.n175 · Cited by 2,556
School/Family/Community Partnerships: Caring for the Children We Share
Epstein, J. L. (2010) · Phi Delta Kappan · doi:10.1177/003172171009200326 · Cited by 2,219
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033 · cited 1×
“SPS, provided by Lipsey and Wilson (2001). This macro modifies the output that would result from a regular weighted least squares multiple regression and provides the correct standard errors, confidence intervals, and significance tests for meta-analysis.”
MethodEffective Schools for the Urban Poor
Edmonds, R. R. (1979) · Educational leadership · Cited by 1,912
Advances in Clinical Child Psychology
(1979) · Springer eBooks · doi:10.1007/978-1-4613-9802-8 · Cited by 1,904
Campbell, D. T. (1969) · American Psychologist · doi:10.1037/h0027982 · Cited by 1,885
The Handbook of Research Synthesis.
Light, R. J., Cooper, H., & Hedges, L. V. (1994) · Journal of the American Statistical Association · doi:10.2307/2291021 · Cited by 1,868
Birch, J. B., & Tukey, J. W. (1978) · Journal of the American Statistical Association · doi:10.2307/2286300 · Cited by 1,440
The International Handbook of School Effectiveness Research
Reynolds, D., & Teddlie, C. (2002) · Routledge eBooks · doi:10.4324/9780203454404 · Cited by 1,004
The International Handbook of School Effectiveness Research
Unnever, J. D. (2001) · Economics of Education Review · doi:10.1016/s0272-7757(01)00009-7 · Cited by 831
Federal Programs Supporting Educational Change
Berman, P. S., & McLaughlin, M. W. (1975) · Cited by 722
Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.2307/1174711 · Cited by 698
Smith, M. S., & O'Day, J. (1990) · Journal of Education Policy · doi:10.1080/02680939008549074 · Cited by 591
Educating Poor Minority Children
Comer, J. P. (1988) · Scientific American · doi:10.1038/scientificamerican1188-42 · Cited by 546
Federal Programs Supporting Educational Change, Vol. VIII: Implementing and Sustaining Innovations.
Berman, P. S., & McLaughlin, M. W. (1978) · Cited by 491
Horace's school: redesigning the American high school
(1992) · Choice Reviews Online · doi:10.5860/choice.30-2216 · Cited by 481
(1994) · Cited by 463
Evidence matters: randomized trials in education research
(2003) · Choice Reviews Online · doi:10.5860/choice.40-3545 · Cited by 372
Commitment and Control: Alternative Strategies for the Organizational Design of Schools
Rowan, B. (1990) · Review of Research in Education · doi:10.2307/1167356 · Cited by 336
Datnow, A., & Castellano, M. (2000) · American Educational Research Journal · doi:10.2307/1163489 · Cited by 331
Stoffle, C. J. (2000) · Cited by 271
Working Together for Reliable School Reform
Datnow, A., & Stringfield, S. (2000) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2000.9671386 · Cited by 246
Comer's School Development Program in Chicago: A Theory-Based Evaluation
Cook, T. D., Murphy, R. F., & Hunt, H. D. (2000) · American Educational Research Journal · doi:10.2307/1163533 · Cited by 220
Becker, W. C., & Gersten, R. M. (1982) · American Educational Research Journal · doi:10.2307/1162369 · Cited by 197
Success for All: Longitudinal Effects of a Restructuring Program for Inner-City Elementary Schools
Madden, N. A., Slavin, R. E., Karweit, N. L., Dolan, L. J., & Wasik, B. A. (1993) · American Educational Research Journal · doi:10.3102/00028312030001123 · Cited by 195
School-Based Management as School Reform: Taking Stock
Murphy, J., & Beck, L. G. (1995) · Medical Entomology and Zoology · Cited by 184
Northwest Regional Educational Laboratory.
Gall, M. D. (1971) · Cited by 183
The Long-Term Effects and Cost-Effectiveness of Success for All
Borman, G. D., & Hewes, G. M. (2002) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737024004243 · Cited by 182
Self-citationSuccess for All: A Summary of Research
Slavin, R. E., Madden, N. A., Dolan, L. J., Wasik, B. A., Ross, S., Smith, L., & Dianda, M. (1996) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0101_6 · Cited by 174
Toward Reform of Program Evaluation: Aims, Methods, and Institutional Arrangements.
Cain, P. S., & Cronbach, L. J. (1982) · Contemporary Sociology · doi:10.2307/2068404 · Cited by 170
Comer's School Development Program in Prince George's County, Maryland: A Theory-Based Evaluation
Cook, T. D., Habib, F.-N., Phillips, M., Settersten, R. A., Shagle, S. C., & Değirmencioğlu, S. M. (1999) · American Educational Research Journal · doi:10.3102/00028312036003543 · Cited by 163
(2001) · Routledge eBooks · doi:10.4324/9781410600905 · Cited by 159
Statistics and Ethics in Surgery and Anesthesia
Gilbert, J., McPeek, B., & Mosteller, F. C. (1977) · Science · doi:10.1126/science.333585 · Cited by 152
Toward reform of program evaluation: Aims, methods, and institutional arrangements
Weiss, C. H. (1981) · Evaluation and Program Planning · doi:10.1016/0149-7189(81)90038-0 · Cited by 152
One million children: success for all
(2001) · Choice Reviews Online · doi:10.5860/choice.39-0454 · Cited by 150
Title I and Student Achievement: A Meta-Analysis of Federal Evaluation Results
Borman, G. D., & D’Agostino, J. V. (1996) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737018004309 · Cited by 134
Self-citationSlavin, R. E., & Madden, N. A. (2015) · Routledge eBooks · doi:10.4324/9780203874844.ch27 · Cited by 128
Muncey, D. E., & McQuillan, P. J. (1996) · Cited by 123
Designs for learning: ICT and knowledge in the classroom
Sutherland, R. (2004) · Computers & Education · doi:10.1016/j.compedu.2003.12.017 · Cited by 122
Restructuring Schooling: Learning from Ongoing Efforts.
Murphy, J. F., & Hallinger, P. (1993) · Medical Entomology and Zoology · Cited by 121
Prospects: Final Report on Student Outcomes.
McClure, P., Puma, M. J., Karweit, N. L., Price, C. S., Ricciuti, A. E., Thompson, W. F., & Vaden-Kiernan, M. (1997) · The Journal of Negro Education · doi:10.2307/2967172 · Cited by 121
Muncey, D. E. (1996) · Yale University Press eBooks · doi:10.12987/9780300159332 · Cited by 120
Bodilly, S. J. (1998) · Cited by 106
'Whenever and Wherever We Choose' The Replication of 'Success for All'
Slavin, R. E., Madden, N. A., Dolan, L. J., Wasik, B. A., Ross, S. M., & Smith, L. J. (1993) · Phi Delta Kappan · Cited by 95
Thomas, O., & Hirsch, E. D. (1998) · American Mathematical Monthly · doi:10.2307/2589737 · Cited by 94
Datnow, A., Borman, G. D., & Stringfield, S. (2000) · The Elementary School Journal · doi:10.1086/499663 · Cited by 89
Self-citationOn the significance of effects and the effects of significance.
Cooper, H. M. (1981) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.41.5.1013 · Cited by 88
Nunnery, J. A. (1998) · Education and Urban Society · doi:10.1177/0013124598030003002 · Cited by 85
Objecting to the objections to using random assignment in educational research
Cook, T. D., & Payne, M. R. (2001) · Cited by 83
Fitz‐Gibbon, C. T., & Morris, L. L. (1996) · Evaluation Practice · doi:10.1016/s0886-1633(96)90024-0 · Cited by 76
'Whenever and Wherever We Choose' The Replication of 'Success for All'
Slavin, R. E., Madden, N. A., Dolan, L. J., et al. (1993) · Phi Delta Kappan · Cited by 73
DeVries, R., Reese-Learned, H., & Morgan, P. (1991) · Early Childhood Research Quarterly · doi:10.1016/0885-2006(91)90031-f · Cited by 70
Carlson, C. D., & Francis, D. J. (2002) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0702_3 · Cited by 67
Long term effects of a systems-oriented school prevention program.
Cauce, A. M., Comer, J. P., & Schwartz, D. A. (1987) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1987.tb03519.x · Cited by 65
Lessons From New American Schools Development Corporation's Demonstration Phase
Bodilly, S. J., Purnell, S. W., Ramsey, K. A., & Keith, S. J. (1996) · Cited by 62
McPartland, J. C., Balfanz, R. W., Jordan, W. J., & Legters, N. E. (1998) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0304_4 · Cited by 60
Reallocating Resources: How to Boost Student Achievement Without Asking for More
Odden, A. R., & Archibald, S. (2000) · Medical Entomology and Zoology · Cited by 59
Title I Schoolwide Programs: A Synthesis of Findings From Recent Evaluation
Wong, K. K., & Meyer, S. J. (1998) · Educational Evaluation and Policy Analysis · doi:10.2307/1164377 · Cited by 57
A Multifaceted Study of Change in Seven Inner-City Schools
Gersten, R. M., Carnine, D. W., Zoref, L., & Cronin, D. P. (1986) · The Elementary School Journal · doi:10.1086/461448 · Cited by 56
Adaptive Instruction and Classroom Time
Wang, M. C., & Walberg, H. J. (1983) · American Educational Research Journal · doi:10.3102/00028312020004601 · Cited by 56
Experiments for Educational Evaluation and Improvement
Borman, G. D. (2002) · Peabody Journal of Education · doi:10.1207/s15327930pje7704_2 · Cited by 55
Self-citationTitle I: Compensatory Education at the Crossroads
Borman, G. D., Stringfield, S. C., & Slavin, R. E. (2001) · Routledge eBooks · doi:10.4324/9781410600158 · Cited by 53
Self-citationSlavin, R. E. (2001) · The American school board journal · Cited by 45
The School Development Program: A Model for School Improvement
Haynes, N. M., Comer, J. P., & Hamilton-Lee, M. (1988) · The Journal of Negro Education · doi:10.2307/2295272 · Cited by 45
Two- and Three-Year Achievement Results From the Memphis Restructuring Initiative
Ross, S. M., Sanders, W. L., Wright, S. P., Stringfield, S., Wang, L. W., & Alberg, M. (2001) · School Effectiveness and School Improvement · doi:10.1076/sesi.12.3.323.3451 · Cited by 39
Kaufman, P., Bradby, D., & Teitelbaum, P. (2000) · Cited by 39
Effective Mathematics Instruction the Importance of Curriculum
Crawford, D. B., & Snider, V. E. (2000) · Education and Treatment of Children · Cited by 38
Iver, M. A. M., & Kemper, E. (2002) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0702_5 · Cited by 36
Ross, S. M., Smith, L. J., & Casey, J. P. (1997) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0201_4 · Cited by 35
School Development Program Effects: Linking Implementation to Outcomes
Haynes, N. M., Emmons, C. L., & Woodruff, D. W. (1998) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0301_6 · Cited by 34
Success for Some: An Evaluation of a Success for All Program
Jones, E. M., Gottfredson, G. D., & Gottfredson, D. C. (1997) · Evaluation Review · doi:10.1177/0193841x9702100601 · Cited by 33
Success for All Does Not Produce Success for Students
Pogrow, S. (2000) · Phi Delta Kappan · doi:10.1177/003172170008200114 · Cited by 31
Title I: The Evolving Research Base
Borman, G. D. (2000) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2000.9671378 · Cited by 29
Self-citationWhat Is an Exemplary Program, and Why Should Anyone Care? A Reaction to Slavin & Klein
Pogrow, S. (1998) · Educational Researcher · doi:10.2307/1176057 · Cited by 29
Better by Design? A Consumer's Guide to Schoolwide Reform.
Traub, J. (1999) · Cited by 26
An Assessment of Two Methods for Remediating Reading Deficiencies.
Richardson, E. (1978) · Reading improvement · Cited by 26
The Longitudinal Achievement of Chapter 1 Students: Preliminary Evidence From the Prospects Study
Borman, G. D., D’Agostino, J. V., Wong, K. K., et al. (1998) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0304_5 · Cited by 25
Self-citationNunnery, J. A. (1997) · Cited by 23
Roots & Wings: Effects of Whole-School Reform on Student Achievement
Slavin, R. E., & Madden, N. A. (2000) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2000.9671383 · Cited by 22
The Effects of Summer School: Questions Answered, Questions Raised
Borman, G. D. (2000) · Monographs of the Society for Research in Child Development · doi:10.1111/1540-5834.00069 · Cited by 22
Self-citationWhat Do We Know: Widely Implemented School Improvement Programs.
Wang, M. C., Haertel, G. D., & Walberg, H. J. (1997) · Cited by 21
Comparisons of Beginning Literacy Programs: Alternative Paths to the Same Learning Outcome
Traweek, D., & Berninger, V. W. (1997) · Learning Disability Quarterly · doi:10.2307/1511221 · Cited by 21
Effects of Curriculum Alignment Versus Direct Instruction on Urban Children
Brent, G., & DiObilda, N. A. (1993) · The Journal of Educational Research · doi:10.1080/00220671.1993.9941226 · Cited by 20
Effectiveness of the DISTAR Reading I Program in Developing First Graders’ Language Skills
Sexton, C. (1989) · The Journal of Educational Research · doi:10.1080/00220671.1989.10885908 · Cited by 20
Stringfield, S. (2000) · School Effectiveness and School Improvement · doi:10.1076/0924-3453(200006)11:2;1-q;ft259 · Cited by 16
Implementing Research-Based Reading Programs in the Fort Worth Independent School District
O'Brien, D. M., & Ware, A. M. (2002) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0702_4 · Cited by 15
Rejoinder: Yes, Control Groups Are Essential in Program Evaluation: A Response to Pogrow
Slavin, R. E. (1999) · Educational Researcher · doi:10.2307/1177256 · Cited by 15
Ashworth, D. R. (1999) · Reading improvement · Cited by 14
Federal Policy Options for Improving the Education of Low Income Students
Rotberg, I. C., & Harvey, J. F. (1993) · Cited by 12
Effects of a Follow Through Program on School Achievement
Schweinhart, L. J., & Wallgren, C. R. (1993) · Journal of Research in Childhood Education · doi:10.1080/02568549309594854 · Cited by 11
Borman, G. D., Stringfield, S. C., & Slavin, R. E. (2001) · Routledge eBooks · doi:10.4324/9781410600158-9 · Cited by 10
Self-citationRoss, S. M., Wang, L. W., Alberg, M., Sanders, W. L., Wright, S. P., & Stringfield, S. (2001) · Cited by 8
A Synthesis and Critique of Four Recent Reviews of Whole-School Reform in the United States.
Stringfield, S. (2000) · School Effectiveness and School Improvement · Cited by 8
Retention and Transfer from a Morphemically Based Direct Instruction Spelling Program in Junior High
Hissl, K. D., Robinson, J. W., & Rankin, R. J. (1983) · The Journal of Educational Research · doi:10.1080/00220671.1983.10885466 · Cited by 8
Language Instruction, Background, and Development of Disadvantaged Kindergarten Children.
Sassenrath, J. M., & Maddux, R. E. (1974) · Cited by 6
Improving Critical Thinking Skills Using Paideia Seminars in a Seventh-Grade Literature Curriculum
Tarkington, S. (1988) · doi:10.22371/05.1988.012 · Cited by 6
Long-term academic effects of direct instruction follow through
Meyer, L. A. (1983) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 5
Rotberg, I. C., & Harvey, J. J. (1993) · Cited by 4
An Investigation of Paideia Program Effects on Students' Critical Thinking Skills.
MacPhail‐Wilcox, B. (1990) · Educational Considerations · Cited by 3
Cited by
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581
School Climate: a Review of the Construct, Measurement, and Impact on Student Outcomes
Wang, M.-T., & Degol, J. L. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9319-1 · Cited by 1,461
Kraft, M. A., Blazar, D., & Hogan, D. (2018) · Review of Educational Research · doi:10.3102/0034654318759268 · Cited by 1,202
Rumberger, R. W., & Palardy, G. J. (2005) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146810510700905 · Cited by 663
Motivation Interventions in Education: A Meta-Analytic Review
Lazowski, R. A., & Hulleman, C. S. (2016) · Review of Educational Research · doi:10.3102/0034654315617832 · Cited by 607
Metadata
- Authors
- Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S.
- Venue
- Review of Educational Research
- Published
- 2003-06
- Volume
- 73
- Issue
- 2
- Pages
- 125-230
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2166264800
- Cited by
- 795
- References
- 110
- FWCI
- 8.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.