Comments on Slavin : Synthesizing Causal Inferences
Abstract
When causal inferences are to be synthesized across multiple studies, efforts to establish the magnitude of a causal effect should be balanced by an effort to evaluate the generalizability of the effect. The evaluation of generalizability depends on two factors that are given little attention in current syntheses: construct validity and external validity. The author concludes with six concrete suggestions for ways that future syntheses could be improved to make them more relevant for educational policy makers.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Christ reported that the number of data points, quality of data, and method used to estimate growth each influenced the reliability, validity, and precision of estimated growth, with 14 weeks of intervention required for reliable and valid estimates of slope.
“Finally, and most recently, Christ [89] reported that the number of data points, quality of data, and method used to estimate growth each influenced the reliability, validity, and precision of estimated growth” (p.15) with 14 weeks of intervention required for reliable and valid estimates of slope.”
From Curriculum-Based Measurement: A Brief History of Nearly Everything from the 1970s to the Present (2013) · cites this paper as [89]
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085 · see citing works
(2002) · Cited by 13,211 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 11,252 · see citing works
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,091 · see citing works
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858 · see citing works
Standards for Educational and Psychological Testing.
Jiménez-García, E. (2017) · Revista Española de Pedagogía · doi:10.22550/2174-0909.3051 · Cited by 2,227 · see citing works
Scientific Research in Education
National Research Council (2002) · National Academies Press eBooks · doi:10.17226/10236 · Cited by 1,750 · see citing works
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661 · see citing works
Evidence-Based Education Policies: Transforming Educational Practice and Research
Slavin, R. E. (2002) · Educational Researcher · doi:10.3102/0013189x031007015 · Cited by 1,107 · see citing works
Designing Evaluations of Educational and Social Programs.
Hendrickson, L., & Cronbach, L. J. (1983) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2068975 · Cited by 1,035 · see citing works
An argument-based approach to validity.
Kane, M. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.3.527 · Cited by 995 · see citing works
Allen, L. (2001) · Cited by 983 · see citing works
Causal Explanation, Qualitative Research, and Scientific Inquiry in Education
Maxwell, J. A. (2004) · Educational Researcher · doi:10.3102/0013189x033002003 · Cited by 781 · see citing works
Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.3102/0013189x015009005 · Cited by 699 · see citing works
Slavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560 · see citing works
Argument-Based Approach to Validity
Kane, M. T. (2022) · The SAGE Encyclopedia of Research Design · doi:10.4135/9781071812082.n28 · Cited by 557 · see citing works
Shepard, L. A. (1993) · Review of Research in Education · doi:10.2307/1167347 · Cited by 480 · see citing works
Tennessee's Class Size Study: Findings, Implications, Misconceptions
Finn, J. D., & Achilles, C. M. (1999) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737021002097 · Cited by 480 · see citing works
On the Science of Education Design Studies
Shavelson, R. J., Phillips, D. C., Towne, L., & Feuer, M. J. (2003) · Educational Researcher · doi:10.3102/0013189x032001025 · Cited by 448 · see citing works
Howe, K. R. (2004) · Qualitative Inquiry · doi:10.1177/1077800403259491 · Cited by 267 · see citing works
Contestation and Change in National Policy on “Scientifically Based” Education Research
EISENHART, M. A., & Towne, L. (2003) · Educational Researcher · doi:10.3102/0013189x032007031 · Cited by 230 · see citing works
Five perspectives on the validity argument.
Cronbach, L. J. (1988) · Cited by 202 · see citing works
Chapter 9: Evaluating Test Validity
Shepard, L. A. (1993) · Review of Research in Education · doi:10.3102/0091732x019001405 · Cited by 195 · see citing works
Learning from Attempts to Improve Schooling: The Contribution of Methodological Diversity
Raudenbush, S. W. (2005) · Educational Researcher · doi:10.3102/0013189x034005025 · Cited by 169 · see citing works
Schoenfeld, A. H. (2006) · Educational Researcher · doi:10.3102/0013189x035002013 · Cited by 135 · see citing works
Test Design with Cognition in Mind
Gorin, J. S. (2006) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.2006.00076.x · Cited by 133 · see citing works
Education Research Can and Must Address “What Works” Questions
Slavin, R. E. (2004) · Educational Researcher · doi:10.3102/0013189x033001027 · Cited by 129 · see citing works
The Effect of Admissions Test Preparation: Evidence from NELS:88
Briggs, D. C. (2001) · CHANCE · doi:10.1080/09332480.2001.10542245 · Cited by 110 · see citing works
Self-citationConfrey, J. (2006) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737028003195 · Cited by 42 · see citing works
Equality and Merit: A Merit-Based Argument for Equity Policies in Higher Education
Simpson, E., & Wendling, K. (2005) · Educational Theory · doi:10.1111/j.1741-5446.2005.00002.x · Cited by 41 · see citing works
Evaluating SAT Coaching: Gains, Effects and Self-Selection
Briggs, D. C. (2013) · doi:10.4324/9780203463932-25 · Cited by 17 · see citing works
Self-citationStoil, M. J., & Hill, G. A. (1996) · Springer eBooks · doi:10.1007/978-1-4613-0417-3_12 · Cited by 16 · see citing works
Overcoming the Challenges: A Response to Alan H. Schoenfeld’s “What Doesn’t Work”
Herman, R., Boruch, R. F., Powell, R., et al. (2006) · Educational Researcher · doi:10.3102/0013189x035002022 · Cited by 9 · see citing works
Skill performance comparability of two algebra programs on an eighth-grade population
Peters, K. G. (1992) · Lincoln (University of Nebraska) · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Experimental and Quasi-Experimental Studies of Inquiry-Based Science Teaching: A Meta-Analysis
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012) · Review of Educational Research · doi:10.3102/0034654312457206 · Cited by 1,021 · see citing works
Self-citationCurriculum-Based Measurement: A Brief History of Nearly Everything from the 1970s to the Present
Tindal, G. (2013) · ISRN Education · doi:10.1155/2013/958530 · Cited by 59 · see citing works
ManyClasses 2: The effects of prequestions on media interactions and learning.
Motz, B. A., Chinni, A., de Leeuw, J. R., Jankowski, H. E., Aggarwal, A., Amato, M., Berlin, K., Britten, K., Brown, A., Cerchiaro, M. L., et al. (2026) · Journal of Educational Psychology · doi:10.1037/edu0000978 · Cited by 1 · see citing works
- Authors
- Briggs, D. C.
- Affiliations
- University of Colorado Boulder (US)
- Corresponding author
- Briggs, Derek C.
- ORCID
- Briggs, Derek C.
- Venue
- Educational Researcher
- Published
- 2008-01
- Volume
- 37
- Issue
- 1
- Pages
- 15-22
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W2002592390
- Cited by
- 45
- References
- 34
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 1 · 2022: 1 · 2021: 3 · 2018: 3 · 2017: 2 · 2016: 2 · 2015: 3 · 2014: 3 · 2013: 5 · 2012: 6
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Researcher (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- causal inference, meta-analysis, generalizability, construct validity, education policy, evidence synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
