How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Systematic reviews are characterized by a methodical and replicable methodology and presentation. They involve a comprehensive search to locate all relevant published and unpublished work on a subject; a systematic integration of search results; and a critique of the extent, nature, and quality of evidence in relation to a particular research question. The best reviews synthesize studies to draw broad theoretical conclusions about what a literature means, linking theory to evidence and evidence to theory. This guide describes how to plan, conduct, organize, and present a systematic review of quantitative (meta-analysis) or qualitative (narrative review, meta-synthesis) information. We outline core standards and principles and describe commonly encountered problems. Although this guide targets psychological scientists, its high level of abstraction makes it potentially relevant to any subject area or discipline. We argue that systematic reviews are a key methodology for clarifying whether and how research findings replicate and for explaining possible inconsistencies, and we call for researchers to conduct systematic reviews to help elucidate whether there is a replication crisis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Following Siddaway et al, data extraction was piloted and completed by one author (SM), with 15% of the output randomly cross-checked by a second author (YS, MK and JM-M).28”
From Target mechanisms of mindfulness-based programmes and practices: a scoping review (2024) · cites this paper as [28]
In the citing paper
“As gamification of mathematics is a relatively recent research field, all relevant sources from the databases were considered, including conference papers and book chapters, to capture early empirical evidence and minimize publication bias (Siddaway et al., 2019).”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Siddaway et al., 2019
In the citing paper
“Studies that reported statistically significant results or clinically relevant results were published more often and can lead to publication bias [43].”
From Patient Engagement with Conversational Agents in Health Applications 2016–2022: A Systematic Review and Meta-Analysis (2024) · cites this paper as [43]
In the citing paper
“Suggestions from Siddaway et al. 28 were also considered for reporting this research.”
From Factors associated with gender and sex differences in anxiety prevalence and comorbidity: A systematic review (2022) · cites this paper as [28]
In the citing paper
“This approach allows researchers to produce more comprehensive and reliable conclusions by integrating diverse findings from previous studies, thereby providing insights for further research and practical applications.”
From Incorporating peer feedback in academic writing: a systematic review of benefits and challenges (2024) · cites this paper as Siddaway et al., 2019
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
The need to belong: Desire for interpersonal attachments as a fundamental human motivation.
Baumeister, R. F., & Leary, M. R. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.117.3.497 · Cited by 23,245
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Self-citation(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Self-citationEnhancing transparency in reporting the synthesis of qualitative research: ENTREQ
Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-181 · Cited by 3,569 · cited 1×
“As we discussed earlier, the method section may also need to discuss and explain borderline cases that readers might have expected to have been included, or which were included despite partially breaching the inclusion and exclusion criteria (e.g., see Trickey et al. 2012).”
Method
Research works printed but not linked: 11
- APA Publ. Commun. Board Work. Group J. Artic. Rep. Stand., 2008, Am. Psychol., 63, 848
- 10.1037/0033-2909.117.3.497 · doi:10.1037/0033-2909.117.3.497 · Paper page
- Bem DJ, 1995, Bull, 118, 172
- Chalmers I, 2007, Treating Individuals: From Randomised Trials to Personalised Medicine, 37
- Cochrane Collab., 2003, Glossary
- Fleiss JL, 2009, The Handbook of Research Synthesis and Meta-Analysis, 237
- Garside R, 2014, Innovation, 27, 67
- 10.1037/0033-2909.88.2.359 · DOI · Paper page
- Higgins JPT, 2011, Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0
- Matt GE, 1994, The Handbook of Research Synthesis, 503
- Open Sci. Collab., 2015, Science, 349, 943
Cited by
Krath, J., Schürmann, L., & von Korflesch, H. F. O. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106963 · Cited by 943
Lattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843
“Following the systematic narrative framework for literature reviews [39], the results of included studies were synthesized and presented without reference to the statistical significance of the findings.”
Mertens, S., Herberz, M., Hahnel, U. J. J., & Brosch, T. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2107346118 · Cited by 738
Associations between nature exposure and health: a review of the evidence
Jimenez, M. P., DeVille, N. V., Elliott, E. G., Schiff, J. E., Wilt, G. E., Hart, J. E., & James, P. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18094790 · Cited by 726
“A narrative review synthesizes the results of quantitative studies that employ diverse methodologies and/or theoretical frameworks without a focus on the statistical significance of the studies’ results [12,13].”
BackgroundO'Dea, R. E., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Gurevitch, J., Page, M. J., Stewart, G., Moher, D., et al. (2021) · Biological Reviews · doi:10.1111/brv.12721 · Cited by 697
Metadata
- Authors
- Siddaway, A. P., Wood, A. M., & Hedges, L. V.
- Affiliations
- University of Stirling (GB)
- London School of Economics and Political Science (GB)
- Northwestern University (US)
- Venue
- Annual Review of Psychology
- Publisher
- Annual Reviews
- Published
- 2019-01-04
- Volume
- 70
- Issue
- 1
- Pages
- 747-770
- ISSN
- 0066-4308 (ISSN-L)
- 1545-2085
- OpenAlex
- W2885869279
- Cited by
- 2,550
- References
- 45
- Citations by year
- 2026: 371 · 2025: 481 · 2024: 492 · 2023: 408 · 2022: 350 · 2021: 270 · 2020: 146 · 2019: 31
- FWCI
- 22.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annual Review of Psychology (publishedVersion)
- PubMed (publishedVersion)
- London School of Economics and Political Science Research Online (London School of Economics and Political Science) (acceptedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- systematic reviews, meta-analysis, meta-synthesis, literature searching, evidence synthesis, research quality assessment, replication, replication crisis, reporting guidelines
- MeSH terms
- Systematic Reviews as Topic, Humans, Review Literature as Topic, Meta-Analysis as Topic, Guidelines as Topic, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. https://app.cochat.ai/papers/10.1146/annurev-psych-010418-102803
- The paper
- Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019). How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annual Review of Psychology. https://doi.org/10.1146/annurev-psych-010418-102803
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.