Publication Bias in Special Education Meta-Analyses
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Publication bias involves the disproportionate representation of studies with large and significant effects in the published research. Among other problems, publication bias results in inflated omnibus effect sizes in meta-analyses, giving the impression that interventions have stronger effects than they actually do. Although evidence suggests that publication bias exists in other fields, research has not examined the issue in special education. In this study, we examined the inclusion of gray literature, testing for publication bias, the extent to which publication bias exists, the relation of including gray literature to the presence of publication bias, and differences in effect size magnitude for gray literature and published studies among 109 meta-analyses published in special education journals. We found the following: (a) 42% of meta-analyses included gray literature, (b) 33% examined publication bias, (c) meta-analyses not including gray literature were more likely to reflect publication bias, and (d) published studies had larger effect sizes than gray literature. We discuss implications and recommendations for research and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Hattie, J. (2008) · doi:10.4324/9780203887332 · Cited by 3,051
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · cited 1×
“…but are not limited to, rank correlation test (Begg & Mazumdar, 1994), Egger’s regression (Egger, Smith, Schneider, & Minder, 1997), the trim-and-fill method (Duval & Tweetie, 2000), and the fail-safe N (Orwin, 1983; Rosenthal, 1979; see Song et al., 2010, for a complete list of procedures).”
MethodGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · cited 1×
“Research has shown that reliance on electronic databases is likely to result in missed studies (Greenhalgh & Peacock, 2005).”
BackgroundPublication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542 · cited 5×
“…review studies with small effects or null findings (Neuliep & Crandall, 1993; Shadish et al., 2016), other studies have shown that the larger problem lies with authors choosing not to submit their research with small or null findings for publication (Franco et al., 2014; Olson et al., 2002).”
BackgroundInfluentialDwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group (2013) · PLoS ONE · doi:10.1371/journal.pone.0066844 · Cited by 1,127
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · cited 2×
“The finding that 33% of meta-analyses in special education may contain meaningful publication bias (see Ferguson & Heene, 2012, for a discussion of why the true rate of publication bias may be higher) suggests that many effect sizes reported in meta-analyses, as related to the effectiveness of…”
BackgroundPublication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Grey Literature in Meta-Analyses
Conn, V. S., Valentine, J. C., Cooper, H. M., & Rantz, M. J. (2003) · Nursing Research · doi:10.1097/00006199-200307000-00008 · Cited by 400 · cited 1×
“Thus, gray literature can contribute rigorous evidence, and many experts recommend including it in reviews and metaanalyses (e.g., Conn et al., 2003; Rothestein & Hopewell, 2009).”
Background
Cited by
Special education teacher attrition and retention: A review of the literature
Billingsley, B., & Bettini, E. (2019) · Review of Educational Research · doi:10.3102/0034654319862495 · Cited by 503
Lee, A., & Gage, N. A. (2020) · Psychology in the Schools · doi:10.1002/pits.22336 · Cited by 163
Self-citationResults reporting in single case experiments and single case meta-analysis
Vannest, K. J., Peltier, C., & Haas, A. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.04.029 · Cited by 51
Metadata
- Authors
- Gage, N. A., Cook, B. G., & Reichow, B.
- Venue
- Exceptional Children
- Publisher
- SAGE Publications
- Published
- 2017-07
- Volume
- 83
- Issue
- 4
- Pages
- 428-445
- ISSN
- 0014-4029 (ISSN-L)
- 2163-5560
- OpenAlex
- W2742749787
- Cited by
- 119
- References
- 13
- FWCI
- 8.18
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Publication Bias in Special Education Meta-Analyses. https://app.cochat.ai/papers/10.1177/0014402917691016
- The paper
- Gage, N. A., Cook, B. G., & Reichow, B. (2017). Publication Bias in Special Education Meta-Analyses. Exceptional Children. https://doi.org/10.1177/0014402917691016
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.