Forest plots in reports of systematic reviews: a cross-sectional study reviewing current practice
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Forest plots are graphical displays of findings of systematic reviews and meta-analyses. Little is known about the style and content of these plots and whether published plots maximize the graphic's potential for information exchange. METHODS: We examine the number, style and content of forest plots presented in a previously studied cross-sectional sample of 300 systematic reviews. We studied all forest plots in non-Cochrane reviews and a sample of forest plots in Cochrane reviews. RESULTS: The database contained 129 Cochrane reviews and 171 non-Cochrane reviews. All the Cochrane reviews had forest plots (2197 in total), and a random sample of 500 of these plots were included. In total, 28 of the non-Cochrane reviews had forest plots (139 in total), all of which were included. Plots in Cochrane reviews were standardized but often contained little data (80% had three or fewer studies; 10% had no studies) and always presented studies in alphabetical order. Non-Cochrane plots depicted a larger number of studies (60% had four or more studies) and 59% ordered studies by a potentially meaningful characteristic, but important information was often missing. Of the 28 reviews that had a forest plots with at least 10 studies, 3 (11%) had funnel plots. CONCLUSIONS: Forest plots in Cochrane reviews were highly standardized but some of the standards do not optimize information exchange, and many of the plots had too little data to be useful. Forest plots in non-Cochrane reviews often omitted key elements but had more data and were often more thoughtfully constructed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similar to tabulation, ordering the studies in the forest plot based on study characteristics (such as by size of the effect estimate, year of publication, study weight, or overall risk of bias) rather than alphabetically (as is often done) can reveal patterns in the data.101”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [101]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationBias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
The visual display of quantitative information
(1985) · General Pharmacology: The Vascular System · doi:10.1016/0306-3623(85)90230-7 · Cited by 5,070
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Modern Epidemiology 3rd edition
Rothman, K. J., Lash, T. L., & Greenland, S. (1986) · Cited by 3,096
(1984) · PubMed · Cited by 2,436
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Self-citation
Research works printed but not linked: 1
- Ottawa Panel Members, 2004, Physical Therapy, 84, 934
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Self-citationNeyeloff, J. L., Fuchs, S. C., & Moreira, L. B. (2012) · BMC Research Notes · doi:10.1186/1756-0500-5-52 · Cited by 727
“A recently published paper by Schriger et al [11] reviewed over 300 systematic reviews and highlighted important aspects of producing forest plots, which were considered in developing this approach.”
BackgroundAdverse Outcomes of Polypharmacy in Older People: Systematic Review of Reviews
Davies, L. E., Spiers, G., Kingston, A., Todd, A., Adamson, J., & Hanratty, B. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.10.022 · Cited by 544
“Forest plots were ordered by effect size to highlight the strength of associations and aid the detection of heterogeneity.(35) Outcomes were reported dependent on analytical technique.”
MethodSynthesizing and presenting findings using other methods
McKenzie, J. E., & Brennan, S. E. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch12 · Cited by 423
Systematic reviews and meta-analyses of randomized trials: principles and pitfalls
da Costa, B. R., & Jüni, P. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu424 · Cited by 247
Metadata
- Authors
- Schriger, D. L., Altman, D. G., Vetter, J. A., Heafner, T., & Moher, D.
- Affiliations
- University of California, Los Angeles (US)
- Corresponding author
- Schriger, D. L.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-01-21
- Volume
- 39
- Issue
- 2
- Pages
- 421-429
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2143965974
- Semantic Scholar
- b89f2adc8d4c451bc30070692d6241f991df6604
- Cited by
- 87
- References
- 24
- Citations by year
- 2026: 1 · 2025: 9 · 2024: 7 · 2023: 5 · 2022: 11 · 2021: 3 · 2020: 11 · 2019: 7 · 2018: 1 · 2017: 6 · 2016: 4 · 2015: 4 · 2014: 8 · 2013: 4 · 2012: 3
- FWCI
- 0.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- University of Ottawa
- Cancer Research UK
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- forest plots, systematic reviews, meta-analysis, funnel plot, information sharing
- MeSH terms
- Cross-Sectional Studies, Data Display, Data Interpretation, Statistical, Humans, Review Literature as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.