A Meta-Analysis of Interventions for Struggling Readers in Grades 4–12: 1980–2011
Open accessAbstract
This meta-analysis synthesizes the literature on interventions for struggling readers in Grades 4 through 12 published between 1980 and 2011. It updates Scammacca et al.'s analysis of studies published between 1980 and 2004. The combined corpus of 82 study-wise effect sizes was meta-analyzed to determine (a) the overall effectiveness of reading interventions studied over the past 30 years, (b) how the magnitude of the effect varies based on student, intervention, and research design characteristics, and (c) what differences in effectiveness exist between more recent interventions and older ones. The analysis yielded a mean effect of 0.49, considerably smaller than the 0.95 mean effect reported in 2007. The mean effect for standardized measures was 0.21, also much smaller than the 0.42 mean effect reported in 2007. The mean effects for reading comprehension measures were similarly diminished. Results indicated that the mean effects for the 1980-2004 and 2005-2011 groups of studies were different to a statistically significant degree. The decline in effect sizes over time is attributed at least in part to increased use of standardized measures, more rigorous and complex research designs, differences in participant characteristics, and improvements in the school's "business-as-usual" instruction that often serves as the comparison condition in intervention studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Intervention studies on reading comprehension yield a mean effect of 0.45.
“Intervention studies on reading comprehension yield a mean effect of 0.45 (Scammacca, Roberts, Vaughn, & Stuebing, 2015).”
From Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension (2018) · cites this paper as Scammacca, Roberts, Vaughn, & Stuebing, 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · see citing works
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419 · see citing works
Ameliorating Children’s Reading-Comprehension Difficulties: A Randomized Controlled Trial
Clarke, P. J., Snowling, M. J., Truelove, E., & Hulme, C. (2010) · Psychological Science · doi:10.1177/0956797610375449 · Cited by 390 · see citing works
Cheung, M. W.-L. (2008) · Psychological Methods · doi:10.1037/a0013163 · Cited by 175 · see citing works
Wanzek, J., Vaughn, S., Wexler, J., Swanson, E. A., Edmonds, M., & Kim, A.-H. (2006) · Journal of Learning Disabilities · doi:10.1177/00222194060390060501 · Cited by 138 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 64
- Abbott SP Berninger VW 1999 It's never too late to remediate: Teaching word recognition to students with reading disabilities in grades 4–7 Annals of Dyslexia 49 223 250
- Alfassi M 1998 Reading for meaning: The efficacy of reciprocal teaching in fostering reading comprehension in high school students in remedial reading classes American Educational Research Journal 35 309 332
- Anders PL Bos CS Filip D 1984 The effect of semantic feature analysis on the reading comprehension of learning-disabled students Niles JS Harris LA Changing perspectives on reading/language processing and instruction 162 166 Rochester, NY National Reading Conference
- Berkeley S Mastropieri MA Scruggs TE 2011 Reading comprehension strategy instruction and attribution retraining for secondary students with learning and other mild disabilities Journal of Learning Disabilities 44 18 32 10.1177/0022219410371677 21335506 · DOI
- Bhat P Griffin CC Sindelar PT 2003 Phonological awareness instruction for middle school students with learning disabilities Learning Disability Quarterly 26 73 87
- Bhattacharya A Ehri LC 2004 Graphosyllabic analysis helps adolescent struggling readers read and spell words Journal of Learning Disabilities 37 331 348 15493405
- Biggs MC Homan SP Dedrick R Minick V Rasinski T 2008 Using an interactive singing software program: A comparative study of struggling middle school readers Reading Psychology 29 195 213 10.1080/02702710802073438 · DOI
- Block C Parris SR Reed KL Whiteley CS Cleveland MD 2009 Instructional approaches that significantly increase reading comprehension Journal of Educational Psychology 101 262 281 10.1037/a0014319 · DOI
- Bloom HS Hill CJ Black AR Lipsey MW 2008 Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions Journal of Educational Effectiveness 1 289 328 10.1080/1934574080240072 · DOI
- Bos CS Anders PL 1990 Effects of interactive vocabulary instruction on the vocabulary learning and reading comprehension of junior-high learning disabled students Learning Disability Quarterly 13 31 42
- Bos CS Anders PL Filip D Jaffe LE 1989 The effects of an interactive instructional strategy for enhancing reading comprehension and content area learning for students with learning disabilities Journal of Learning Disabilities 22 384 390 2738473
- Boyle JR 1996 The effects of a cognitive mapping strategy on the literal and inferential comprehension of students with mild disabilities Learning Disabilities Quarterly 19 86 98
- Burns MK Hodgson J Parker DC Fremont K 2011 Comparison of the effectiveness and efficiency of text previewing and preteaching keywords as small-group reading comprehension strategies with middle-school students Literacy Research and Instruction 50 241 252 10.1080/19388071.2010.519097 · DOI
- Calhoon M 2005 Effects of a peer-mediated phonological skill and reading comprehension program on reading skill acquisition for middle school students with reading disabilities Journal of Learning Disabilities 38 424 433 10.1177/00222194050380050501 16329443 · DOI
- Calhoon M Sandow A Hunter CV 2010 Reorganizing the instructional reading components: Could there be a better way to design remedial reading programs to maximize middle school students with reading disabilities’ response to treatment? Annals of Dyslexia 60 57 85 10.1007/s11881-009-0033-x 20087694 · DOI
- Cantrell S Alamsi J Carter J Rintamaa M Madden A 2010 The impact of a strategy-based intervention on the comprehension and strategy use of struggling adolescent readers Journal of Educational Psychology 102 257 280 10.1037/a0018212 · DOI
- Chan KS 1991 Promoting strategy instruction generalization through self-instructional training in students with reading disabilities Journal of Learning Disabilities 24 427 290 1895011
- Conte R Humphreys R 1989 Repeated readings using audiotaped material enhances oral reading in children with reading difficulties Journal of Communication Disorders 22 65 79 2715381
- Darch C Gersten R 1986 Direct setting activities in reading comprehension: A comparison of two approaches Learning Disability Quarterly 9 235 243
- DiCecco VM Gleason MM 2002 Using graphic organizers to attain relational knowledge from expository texts Journal of Learning Disabilities 35 306 320 15493240
- Diliberto JA Beattie JR Flowers CP Algozzine RF 2009 Effects of teaching syllable skills instruction on reading achievement in struggling middle school readers Literacy Research and Instruction 48 14 27 10.1080/19388070802226253 · DOI
- Edmonds MS Vaughn S Wexler J Reutebuch CK Cable A Tackett KK 2009 A synthesis of reading interventions and effects on reading outcomes for older struggling readers Review of Educational Research 79 262 300 10.3102/0034654308325998 20072704 PMC2804990 · DOI · Paper page
- Faggella-Luby M Wardwell M 2011 RTI in a middle school: Findings and practical implications of a tier 2 reading comprehension study Learning Disability Quarterly 34 35 49
- Flynn LJ Zheng X Swanson H 2012 Instructing struggling older readers: A selective meta-analysis of intervention research Learning Disabilities Research & Practice 27 21 32 10.1111/j.1540-5826.2011.00347.x · DOI · Paper page
- Gajria M Salvia J 1992 The effects of summarization instruction on text comprehension of students with learning disabilities Exceptional Children 58 508 516 1592077
- Given BK Wasserman JD Chari SA Beattie K Eden GF 2008 A randomized, controlled study of computer-based intervention in middle school struggling readers Brain and Language 106 83 97 10.1016/j.bandl.2007.12.001 18657684 · DOI
- Graves AW Duesbery L Pyle NB Brandon RR McIntosh AS 2011 Two studies of tier II literacy development: Throwing sixth graders a lifeline Elementary School Journal 111 641 661 10.1086/659036 · DOI
- Guthrie JT McRae A Coddington CS Klauda S Wigfield A Barbosa P 2009 Impacts of comprehensive reading instruction on diverse outcomes of low- and high-achieving readers Journal of Learning Disabilities 42 195 214 10.1177/0022219408331039 19264929 · DOI
- Harris M Schumaker J Deshler D 2011 The effects of strategic morphological analysis instruction on the vocabulary performance of secondary students with and without disabilities Learning Disability Quarterly 34 17 33
- Hasselbring TS Goin LI 2004 Literacy instruction for older struggling readings: What is the role of technology? Reading and Writing Quarterly 20 123 144
- Homan SP Klesius JP Hite C 1993 Effects of repeated readings and nonrepetitive strategies on students’ fluency and comprehension Journal of Educational Research 87 94 99
- Jitendra AK Hoppes MK Xin YP 2000 Enhancing main idea comprehension for students with learning problems: The role of a summarization strategy and self-monitoring instruction Journal of Special Education 34 127 139
- Johnson G Gersten R Carnine D 1987 Effects of Instructional design variables on vocabulary acquisition of learning disabilities students: A study of computer-assisted instruction Journal of Learning Disabilities 20 206 213 3553400
- Kim A Vaughn S Klingner JK Woodruff AL Reutebuch C Kouzekanani K 2006 Improving the reading comprehension of middle school students with disabilities through computer-assisted collaborative strategic reading Remedial and Special Education 27 235 249 doi:10.1177/07419325 060270040401 · DOI
- Kim JS Samson JF Fitzgerald R Hartry A 2010 4 6 A randomized experiment of a mixed-methods literacy intervention for struggling readers in grades Effects on word reading efficiency, reading comprehension and vocabulary, and oral reading fluency Reading and Writing 23 1109 1129 10.1007/s11145-009-9198-2 · DOI
- Klingner JK Vaughn S 1996 Reciprocal teaching of reading comprehension strategies for students with learning disabilities who use English as a second language Elementary School Journal 96 275 293
- Lang L Torgesen J Vogel W Chanter C Lefsky E Petscher Y 2009 Exploring the relative effectiveness of reading interventions for high school students Journal of Research on Educational Effectiveness 2 149 175 10.1080/19345740802641535 · DOI
- Lovett MW Lacerenza L De Palma M Frijters JC 2012 Evaluating the efficacy of remediation for struggling readers in high school Journal of Learning Disabilities 45 151 169 10.1177/0022219410371678 22183192 · DOI
- Macaruso P Rodman A 2009 Benefits of computer-assisted instruction for struggling readers in middle school European Journal of Special Needs Education 24 103 113 10.1080/08856250802596774 · DOI
- Manset-Williamson G Nelson JM 2005 Balanced, strategic reading instruction for upper-elementary and middle school students with reading disabilities: A comparative study of two approaches Learning Disability Quarterly 28 59 74 10.2307/4126973 · DOI
- Mastropieri MA Scruggs TE Levin JR Gaffney J McLoone B 1985 Mnemonic vocabulary instruction for learning disabled students Learning Disability Quarterly 8 57 63
- Mastropieri MA Scruggs T Mohler L Beranek M Spencer V Boon RT Talbott E 2001 Can middle school students with serious reading difficulties help each other and learn anything? Journal of Learning Disabilities 16 18 27
- McCallum R Krohn KR Skinner CH Hilton-Prillhart A Hopkins M Waller S Polite F 2011 Improving reading comprehension of at-risk high-school students: The ART of Reading program Psychology in the Schools 48 78 86 10.1002/pits.20541 · DOI
- McLoone BB Scruggs TE Mastropieri MA Zucker SF 1986 Memory strategy instruction and training with learning disabled adolescents Learning Disabilities Research 2 45 52 3973507
- Meyer BF Wijekumar KK Lin Y 2011 Individualizing a web-based structure strategy intervention for fifth graders' comprehension of nonfiction Journal of Educational Psychology 103 140 168 10.1037/a0021606 · DOI
- Moore PJ Scevak JJ 1995 The effects of strategy training on high school students’ learning from science texts European Journal of Psychology of Education 10 401 410
- Penney CG 2002 Teaching decoding skills to poor readers in high school Journal of Literacy Research 34 99 118
- Rasinski T Samuels S Hiebert E Petscher Y Feller K 2011 The relationship between a silent reading fluency instructional protocol on students’ reading comprehension and achievement in an urban school setting Reading Psychology 32 75 97 10.1080/02702710903346873 PMC4557890 26347186 · DOI
- Shippen ME Houchins DE Steventon C Sartor D 2005 A comparison of two direct instruction reading programs for urban middle school students Remedial and Special Education 26 175 182 doi:10.1177/07419325050 260030501 · DOI
- Snider VE 1989 Reading comprehension performance of adolescents with learning disabilities Learning Disability Quarterly 12 87 96
- Spencer S Manis F 2010 The effects of a fluency intervention program on fluency and comprehension outcomes of middle-school students with severe reading deficits Learning Disabilities Research & Practice 25 76 86 10.1111/j.1540-5826.2010.00305.x · DOI
- Thames DG Reeves C Kazelskis R York K Boling C Newell K Wang Y 2008 Reading comprehension: Effects of individualized, integrated language arts as a reading approach with struggling readers Reading Psychology 29 86 115 10.1080/02702710701853625 · DOI
- Therrien WJ Wickstrom K Jones K 2006 Effect of a combined repeated reading and question generation intervention on reading achievement Learning Disabilities Research & Practice 21 89 97 10.1111/j.1540-5826.2006.00209.x · DOI
- Vadasy PF Sanders EA 2008 Benefits of repeated reading intervention for low-achieving fourth- and fifth-grade students Remedial and Special Education 29 235 249 10.1177/0741932507312013 · DOI
- Vaughn S Cirino P Wanzek J Wexler J Fletcher J Denton C Francis D 2010 Response to intervention for middle school students with reading difficulties: effects of a primary and secondary intervention School Psychology Review 39 3 21 21479079 PMC3072689
- Vaughn S Klingner JK Swanson EA Boardman AG Roberts G Mohammed SS Stillman-Spisak SJ 2011 Efficacy of collaborative strategic reading with middle school students American Educational Research Journal 48 938 964 10.3102/0002831211410305 · DOI
- Vaughn S Wanzek J Wexler J Barth A Cirino P Fletcher J Francis D 2010 The relative effects of group size on reading progress of older students with reading difficulties Reading and Writing 23 931 956 10.1007/s11145-009-9183-9 21072131 PMC2975110 · DOI
- Vaughn S Wexler J Roberts G Barth AA Cirino PT Romain MA Denton CA 2011 Effects of individualized and standardized interventions on middle school students with reading disabilities Exceptional Children 77 391 407 23125463 PMC3485696
- Veit DT Scruggs TE Mastropieri MA 1986 Extended mnemonic instruction with learning disabled students Journal of Educational Psychology 78 300 308
- Wanzek J Vaughn S Roberts G Fletcher JM 2011 Efficacy of a reading intervention for middle school students with reading disabilities Exceptional Children 78 73 87 22485052 PMC3324302
- Wanzek J Vaughn S Scammacca N Metz K Murray C Roberts G Danielson L 2013 Extensive reading interventions for students with reading difficulties after Grade 3 Review of Educational Research 83 163 195
- Wexler J Vaughn S Roberts G Denton CA 2010 The efficacy of repeated reading and wide reading practice for high school students with severe reading disabilities Learning Disabilities Research & Practice 25 2 10 10.1111/j.1540-5826.2009.00296.x 21076693 PMC2980335 · DOI
- Wilder AA Williams JP 2001 Students with severe learning disabilities can learn higher order comprehension skills Journal of Educational Psychology 93 268 278
- Williams JP Brown LG Silverstein AK deCani JS 1994 An instructional program in comprehension of narrative themes for adolescents with learning disabilities Learning Disabilities Quarterly 17 205 221
Cited by
Sorted by citations
Delgado, P., Vargas, C., Ackerman, R., & Salmerón, L. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.09.003 · Cited by 664 · see citing works
Dietrichson, J., Bøg, M., Filges, T., & Klint Jørgensen, A.-M. (2017) · Review of Educational Research · doi:10.3102/0034654316687036 · Cited by 288 · see citing works
Dietrichson, J., Filges, T., Seerup, J. K., Klokker, R. H., Viinholt, B. C. A., Bøg, M., & Eiberg, M. (2021) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1152 · Cited by 54 · see citing works
Roberts, G. J., Cho, E., Garwood, J. D., Goble, G. H., Robertson, T., & Hodges, A. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09485-1 · Cited by 47 · see citing works
Self-citationAustin, C. R., Wanzek, J., Scammacca, N. K., Vaughn, S., Gesel, S. A., Donegan, R. E., & Engelmann, M. L. (2019) · Exceptional Children · doi:10.1177/0014402918796164 · Cited by 25 · see citing works
Self-citationData-Based Decision Making for Struggling Readers in the Secondary Grades
Filderman, M. J., Austin, C. R., & Toste, J. R. (2019) · Intervention in School and Clinic · doi:10.1177/1053451219832991 · Cited by 15 · see citing works
Merke, S., Ganushchak, L., & van Steensel, R. (2024) · Educational Research Review · doi:10.1016/j.edurev.2023.100572 · Cited by 15 · see citing works
- Authors
- Scammacca, N. K., Roberts, G., Vaughn, S., & Stuebing, K. K.
- Affiliations
- The University of Texas at Austin (US)
- University of Houston (US)
- Venue
- Journal of Learning Disabilities
- Publisher
- SAGE Publications
- Published
- 2013-10-03
- Volume
- 48
- Issue
- 4
- Pages
- 369-390
- ISSN
- 0022-2194 (ISSN-L)
- 1538-4780
- PMC
- PMC3975734
- OpenAlex
- W2140545426
- Cited by
- 372
- References
- 6
- Citations by year
- 2026: 14 · 2025: 28 · 2024: 23 · 2023: 36 · 2022: 31 · 2021: 45 · 2020: 22 · 2019: 65 · 2018: 40 · 2017: 26 · 2016: 21 · 2015: 11 · 2014: 5 · 2013: 3
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Learning Disabilities (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P50HD052117)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Keywords
- struggling readers, reading intervention, reading disorders, intervention effectiveness, effect size, reading comprehension, school education, middle and high school students, research design
- MeSH terms
- Adolescent, Child, Dyslexia, Education, Special, Humans, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review