Interpreting meta-analysis in systematic reviews
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A meta-analysis is a statistical method used to estimate an average, or common effect, over several studies. With therapeutic interventions (whether drug or non-drug) the meta-analysis is usually based on randomised controlled trials. In this reader’s guide we use the systematic review by Bravata et al 1 of the effects of pedometers to increase physical activity to illustrate these concepts. A good systematic review should have done a thorough search for all studies, appraised their quality, and selected the better studies for answering the question. We won’t go over the appraisal here but will focus on reading the combined results. Reading a meta-analyses can be broken down into 4 basic steps2: 1. What is the summary measure? 2. What does the Forest Plot show? 3. What does the pooled effect (average effect) mean? 4. Was it valid to combine studies? First read the horizontal scale of the Forest plot to check which measure of effect has been used, and which side is “good” and “bad” for the treatment. The effect in each study can be summarised in different ways. For binary outcomes (2 × 2 table), the main options are relative risk (RR), odds ratios (OR), or risk differences (RD). For meta-analysis, usually relative measures (RR and OR) are preferred as they are more likely to remain similar from study to study (see the discussion on heterogeneity below). For continuous outcomes, the options are the difference in means or standardised means between the interventions tested. In the pedometer review, the outcome of interest is the mean difference in the number of steps (post-intervention steps per day − …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using Pedometers to Increase Physical Activity and Improve Health: A Systematic Review
Bravata, D. M., Smith-Spangler, C., Sundaram, V., Gienger, A. L., Lin, N., Lewis, R., Stave, C. D., Olkin, I., & Sirard, J. R. (2007) · JAMA · doi:10.1001/jama.298.19.2296 · Cited by 2,064 · cited 1×
“In this guide to interpreting meta-analyses, we use a systematic review by Bravata and colleagues (1) on the effects of pedometers to increase physical activity to illustrate these concepts.”
MethodTalbot, L. A., Gaines, J. M., Huynh, T. N., & Metter, E. J. (2003) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2003.51113.x · Cited by 315
de Blok, B. M. J., de Greef, M. H. G., ten Hacken, N. H. T., Sprenger, S. R., Postema, K., & Wempe, J. B. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2005.02.005 · Cited by 231
Cited by
The relationship between nurse staffing and quality of care in nursing homes: A systematic review
Spilsbury, K., Hewitt, C., Stirk, L., & Bowman, C. (2011) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.02.014 · Cited by 360
Golder, S., Loke, Y. K., & Bland, M. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001026 · Cited by 269
Forest plots in reports of systematic reviews: a cross-sectional study reviewing current practice
Schriger, D. L., Altman, D. G., Vetter, J. A., Heafner, T., & Moher, D. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp370 · Cited by 87
Intimate partner violence and child attachment: A systematic review and meta-analysis
Noonan, C. B., & Pilkington, P. D. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104765 · Cited by 83
Health states for schizophrenia and bipolar disorder within the Global Burden of Disease 2010 Study
Ferrari, A. J., Saha, S., McGrath, J. J., Norman, R., Baxter, A. J., Vos, T., & Whiteford, H. A. (2012) · Population Health Metrics · doi:10.1186/1478-7954-10-16 · Cited by 1
“This was to explicitly address heterogeneity in pooled proportions [27].”
Background
Metadata
- Authors
- Perera, R., & Heneghan, C.
- Venue
- Evidence-Based Medicine
- Publisher
- BMJ
- Published
- 2008-06-01
- Volume
- 13
- Issue
- 3
- Pages
- 67-69
- ISSN
- 1356-5524 (ISSN-L)
- OpenAlex
- W1985553160
- Cited by
- 49
- References
- 3
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.