The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Detecting and adjusting for small‐study effects in meta‐analysis
Abstract
Publication bias and related types of small‐study effects threaten the validity of systematic reviews. The existence of small‐study effects has been demonstrated in empirical studies. Small‐study effects are graphically diagnosed by inspection of the funnel plot. Though observed funnel plot asymmetry cannot be easily linked to a specific reason, tests based on funnel plot asymmetry have been proposed. Beyond a vast range of funnel plot tests, there exist several methods for adjusting treatment effect estimates for these biases. In this article, we consider the trim‐and‐fill method, the Copas selection model, and more recent regression‐based approaches. The methods are exemplified using a meta‐analysis from the literature and compared in a simulation study, based on binary response data. They are also applied to a large set of meta‐analyses. Some fundamental differences between the approaches are discussed. An assumption common to the trim‐and‐fill method and the Copas selection model is that the small‐study effect is caused by selection. The trim‐and‐fill method corresponds to an unknown implicit model generated by the symmetry assumption, whereas the Copas selection model is a parametric statistical model. However, it requires a sensitivity analysis. Regression‐based approaches are easier to implement and not based on a specific selection model. Both simulations and applications suggest that in the presence of strong selection both the trim‐and‐fill method and the Copas selection model may not fully eliminate bias, while regression‐based approaches seem to be a promising alternative.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We checked the model for possible small-study effects by visually examining a funnel plot (20), supplemented by Egger's regression-based test for funnel plot asymmetry (21).”
From Referral of patients to psychiatric emergency departments by police: A systematic review and meta-analysis (2025) · cites this paper as [20]
In the citing paper
“Previous summary work on liver enzymes and inter-hepatic fat, in people with non-alcoholic fatty liver disease, has shown that an aggregate exercise program energy expenditure of around 10,000 kcal is required to elicit improvement [37], and this may take several weeks to achieve.”
From The Effect of Exercise Training on Blood Lipids: A Systematic Review and Meta-analysis (2025) · cites this paper as [37]
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 3×
“Therefore, our aim was (i) to extend the established random effects model (DerSimonian and Laird, 1986) by a parameter that represents small-study effects in a natural way and (ii) to use a shrinkage procedure to improve the properties of parameter estimation (Rücker, 2010; Rücker et al.”
MethodCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · cited 1×
“Broadly, tests fall into two classes: (i) non-parametric tests using rank-correlation methods, going back to Begg and Mazumdar (1994) and (ii) regression tests, represented by a test proposed by Egger et al. (1997a).”
MethodMcCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Measurement in Medicine: The Analysis of Method Comparison Studies
Altman, D. G., & Bland, J. M. (1983) · The Statistician · doi:10.2307/2987937 · Cited by 4,300 · cited 2×
“Figure 5 (top left panel) shows a scatterplot of b̂0 against b̂limðr2 ¼ 0:9006Þ: Bland–Altman plots (not shown; Altman and Bland, 1983) give no hints of systematic trends in the difference.”
BackgroundFunnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · cited 1×
“This is a scatter plot showing the treatment effect (usually on the x-axis) depending on the precision of the study, preferably represented by the standard error on a reverse scale (Sterne and Egger, 2001).”
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“The first form of this effect that was acknowledged was publication bias (Sterling, 1959; Simes, 1986; Begg and Berlin, 1988; Berlin et al., 1989; Rust et al., 1990; Sterling et al., 1995; Dickersin, 1990; Easterbrook et al., 1991; Sutton et al., 2000a).”
BackgroundHow should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026 · cited 1×
“If study-level covariates are available that describe the baseline risk of patients and may explain heterogeneity, they can be included in a meta-regression model (Sharp and Thompson, 2000; Thompson and Higgins, 2002).”
Background
Research works printed but not linked: 2
- Rücker G.(2010). Small‐study effects and heterogeneity in meta‐analysis. Ph.D. Thesis.http://www.freidok.uni‐freiburg.de/volltexte/7486/
- 10.1002/1097-0258(20001215)19:23<3251::AID-SIM625>3.0.CO;2-2 · doi:10.1002/1097-0258(20001215)19:23<3251::aid-sim625>3.0.co;2-2
Cited by
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827
“Different methods exist 22 ; in this paper, we report the more established trim-and-fill method 24 and the method of adjusting by regression.”
Self-citationA new improved graphical and quantitative method for detecting bias in meta-analysis
Furuya-Kanamori, L., Barendregt, J. J., & Doi, S. A. R. (2018) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000141 · Cited by 1,160
A meta-analysis of procedures to change implicit measures
Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., & Nosek, B. A. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000160 · Cited by 700
The impact of study size on meta-analyses: examination of underpowered studies in Cochrane reviews
Turner, R. M., Bird, S. M., & Higgins, J. P. T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059202 · Cited by 672
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847196 · Cited by 588
Metadata
- Authors
- Rücker, G., Carpenter, J. R., & Schwarzer, G.
- Affiliations
- University of Freiburg (DE)
- Corresponding author
- Rücker, Gerta
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2011-01-14
- Volume
- 53
- Issue
- 2
- Pages
- 351-368
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W2069224123
- Cited by
- 132
- References
- 76
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 9 · 2023: 8 · 2022: 16 · 2021: 9 · 2020: 10 · 2019: 13 · 2018: 5 · 2017: 5 · 2016: 5 · 2015: 3 · 2014: 8 · 2013: 7 · 2012: 6
- FWCI
- 7.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrical Journal (publishedVersion)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (submittedVersion)
- Funders
- Deutsche Forschungsgemeinschaft
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- small-study effects, publication bias, funnel plot asymmetry, selection bias, binary response data, meta-analysis bias
- MeSH terms
- Algorithms, Clinical Trials as Topic, Computer Simulation, Humans, Regression Analysis, Research Design, Time Factors, Meta-Analysis as Topic, Reproducibility of Results, Models, Statistical, Bias, Randomized Controlled Trials as Topic, Publication Bias, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Detecting and adjusting for small‐study effects in meta‐analysis. https://app.cochat.ai/papers/10.1002/bimj.201000151
- The paper
- Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011). Detecting and adjusting for small‐study effects in meta‐analysis. Biometrical Journal. https://doi.org/10.1002/bimj.201000151
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.