A Likelihood-Based Sensitivity Analysis for Publication Bias in Meta-Analysis
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Summary: A common conjecture in the study of publication bias is that studies reporting a significant result are more likely to be selected for review than studies whose results are inconclusive. We envisage a population of studies following the standard random-effects model of meta-analysis, and a selection probability given by a function of the study's ‘t-statistic’. In practice it is difficult to estimate this function, and hence difficult to estimate its associated bias correction. The paper suggests the more modest aim of a sensitivity analysis in which the treatment effect is estimated by maximum likelihood constrained by given values of the marginal probability of selection. This gives a graphical summary of how the inference from a meta-analysis changes as we allow for increasing selection (as the marginal selection probability decreases from 1), with an associated diagnostic plot comparing the observed treatment effects with their fitted values implied by the corresponding selection model. The approach is motivated by a medical example in which the highly significant result of a published meta-analysis was subsequently overturned by the results of a large-scale clinical trial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
A comparison of methods to detect publication bias in meta‐analysis
Macaskill, P., Walter, S. D., & Irwig, L. (2001) · Statistics in Medicine · doi:10.1002/sim.698 · Cited by 1,286 · cited 1×
“For example Begg and Mazumdar (1994) and Macaskill et al. (2001) used the selection model a.y/= exp{−βΦγ.”
MethodEgger, M., & Smith, G. D. (1995) · BMJ · doi:10.1136/bmj.310.6982.752 · Cited by 508
Meta-analysis, funnel plots and sensitivity analysis
Copas, J. (2000) · Biostatistics · doi:10.1093/biostatistics/1.3.247 · Cited by 503 · cited 11×
“5 illustrates the application of Copas and Shi (2000a) to these data.”
BackgroundMethodResultInfluentialSelf-citationMultiple-bias modelling for analysis of observational data
Greenland, S. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2004.00349.x · Cited by 497
Modelling publication bias in meta-analysis: a review
Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R. (2000) · Statistical Methods in Medical Research · doi:10.1177/096228020000900503 · Cited by 288
Jackson, D., Bowden, J., & Baker, R. (2010) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2009.09.017 · Cited by 226 · cited 2×
“This is known to lead to substantial underestimation of uncertainty, with poorer coverage properties than likelihood methods which include τ as an unknown parameter in its own right (Hardy and Thompson, 1996; Jackson et al., 2010).”
BackgroundResult
Cited by
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847196 · Cited by 588
McShane, B. B., Böckenholt, U., & Hansen, K. T. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616662243 · Cited by 398
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2015) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 252
Verde, P. E., & Ohmann, C. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1122 · Cited by 123
“Useful literature relating to this topic includes the following: Sutton et al. (2000), Rothstein et al. (2005) and the recent work of Copas (2013).”
BackgroundInfluential
Metadata
- Authors
- Copas, J. B.
- Venue
- Journal of the Royal Statistical Society Series C: Applied Statistics
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-10-22
- Volume
- 62
- Issue
- 1
- Pages
- 47-66
- ISSN
- 0035-9254 (ISSN-L)
- 1467-9876
- OpenAlex
- W1608599240
- Cited by
- 41
- References
- 7
- FWCI
- 4.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Likelihood-Based Sensitivity Analysis for Publication Bias in Meta-Analysis. https://app.cochat.ai/papers/10.1111/j.1467-9876.2012.01049.x
- The paper
- Copas, J. B. (2013). A Likelihood-Based Sensitivity Analysis for Publication Bias in Meta-Analysis. Journal of the Royal Statistical Society Series C: Applied Statistics. https://doi.org/10.1111/j.1467-9876.2012.01049.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.