A robust P‐value for treatment effect in meta‐analysis with publication bias
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Publication bias is a major and intractable problem in meta‐analysis. There have been several attempts in the literature to adapt methods to allow for such bias, but these are only possible if we are prepared to make strong assumptions about the underlying selection mechanism. We discuss the assumption that the probability that a paper is published may depend in some unspecified way on the P‐value being claimed by that study. We suggest a new robust P‐value for the overall treatment effect, which turns out to be closely related to the correlation of the associated radial plot. Properties of the method are discussed and illustrated in two examples. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Meta-analysis, funnel plots and sensitivity analysis
Copas, J. (2000) · Biostatistics · doi:10.1093/biostatistics/1.3.247 · Cited by 503
Self-citationHedges, L. V., & Vevea, J. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch9 · Cited by 123
Cited by
Bowden, J., Davey Smith, G., & Burgess, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv080 · Cited by 9,816
“Other methods for giving valid inferences in the context of a meta-analysis and small-study bias have been discussed in the literature.(14,15) The methods described in this paper therefore provide a sensitivity analysis to assess robustness of the conclusions of a Mendelian randomization investigation to potential bia…”
MethodBowden, J., Spiller, W., Del Greco M, F., Sheehan, N., Thompson, J., Minelli, C., & Davey Smith, G. (2018) · International Journal of Epidemiology · doi:10.1093/ije/dyy101 · Cited by 880
Bowden, J., Tierney, J. F., Copas, A. J., & Burdett, S. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-41 · Cited by 553
Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Moreno, S. G., Sutton, A. J., Ades, A., Stanley, T. D., Abrams, K. R., Peters, J. L., & Cooper, N. J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-2 · Cited by 373
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rucker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. (2011) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 286
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2015) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 252
Moreno, S. G., Sutton, A. J., Turner, E. H., Abrams, K. R., Cooper, N. J., Palmer, T. M., & Ades, A. E. (2009) · BMJ · doi:10.1136/bmj.b2981 · Cited by 184
“An adjusted pooled estimate of effect is obtained by predicting, from the regression line, the pooled effect size for an ideal study of infinite size (hence with zero standard error), which would be located at the top of a funnel plot; since it is hypothesised that there would be no bias in studies of that size. This…”
MethodDetecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
“At roughly the same time, in a related approach which was derived from radial plots, Copas and Malley (2008) developed robust P-values adjusting for smallstudy effects.”
MethodSystematic review: self‐management support interventions for irritable bowel syndrome
Dorn, S. D. (2010) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2010.04374.x · Cited by 29
Metadata
- Authors
- Copas, J. B., & Malley, P. F.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2008-04-03
- Volume
- 27
- Issue
- 21
- Pages
- 4267-4278
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2142922919
- Cited by
- 37
- References
- 3
- FWCI
- 4.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.