How to Write a Systematic Review
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Background The role of evidence-based medicine in sports medicine and orthopaedic surgery is rapidly growing. Systematic reviews and meta-analyses are also proliferating in the medical literature. Purpose To provide the outline necessary for a practitioner to properly understand and/or conduct a systematic review for publication in a sports medicine journal. Study design Review. Methods The steps of a successful systematic review include the following: identification of an unanswered answerable question; explicit definitions of the investigation's participant(s), intervention(s), comparison(s), and outcome(s); utilization of PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines and PROSPERO registration; thorough systematic data extraction; and appropriate grading of the evidence and strength of the recommendations. Results An outline to understand and conduct a systematic review is provided, and the difference between meta-analyses and systematic reviews is described. The steps necessary to perform a systematic review are fully explained, including the study purpose, search methodology, data extraction, reporting of results, identification of bias, and reporting of the study's main findings. Conclusion Systematic reviews or meta-analyses critically appraise and formally synthesize the best existing evidence to provide a statement of conclusion that answers specific clinical questions. Readers and reviewers, however, must recognize that the qu…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This systematic review was conducted and reported in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines (27–29).”
From Mindfulness-Based Interventions for the Treatment of Substance and Behavioral Addictions: A Systematic Review (2018) · cites this paper as [29]
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755 · cited 1×
“Evaluation of systematic review methodological quality via AMSTAR (assessment of multiple systematic reviews) has recently been introduced to improve the conduct and reporting of systematic reviews.(23) The Cochrane Collaboration has recently introduced the MECIR (Methodological Expectations of Cochrane Intervention R…”
MethodThe nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433 · cited 1×
“Thus, on February 22, 2011, PROSPERO, the online, free, prospective international systematic review register, was launched for any and all health care–related research.(2,33) Nonpublication of finished systematic reviews, just as with clinical trials (publication bias), is a problem that may lead to overestimates of t…”
BackgroundINTRODUCING LEVELS OF EVIDENCE TO THE JOURNAL
Wright, J. G., Swiontkowski, M. F., & Heckman, J. D. (2003) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/00004623-200301000-00001 · Cited by 1,284
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
How to write a systematic review
Wright, R. W., Brand, R. A., Dunn, W., & Spindler, K. P. (2007) · Clinical Orthopaedics and Related Research · doi:10.1097/blo.0b013e31802c9098 · Cited by 606 · cited 1×
“It is recommended to seek the assistance of a biostatistician who is experienced in meta-analyses early in the timeline of the investigation.(37) Additionally, it is important to understand, identify, and directly report the difference between statistical significance and clinical relevance within the individual TABLE…”
BackgroundPROSPERO: an international prospective register of systematic reviews
Wright, K. E. (2014) · Cited by 568
Ebell, M. H., Siwek, J., Weiss, B. D., Woolf, S. H., Susman, J., Ewigman, B., & Bowman, M. (2004) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.17.1.59 · Cited by 561
Autologous Chondrocyte Implantation: A Systematic Review
Harris, J. D., Siston, R. A., Pan, X., & Flanigan, D. C. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.j.00049 · Cited by 409
Self-citationIntroducing levels of evidence to the journal
Wright, J., Swiontkowski, M., & Heckman, J. (2011) · Orthopedic Trauma Directions · doi:10.1055/s-0030-1267124 · Cited by 364
Harris, J. D., Siston, R. A., Brophy, R. H., Lattermann, C., Carey, J. L., & Flanigan, D. C. (2011) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2011.02.010 · Cited by 284
Self-citationGreco, N. J., Anderson, A. F., Mann, B. J., Cole, B. J., Farr, J., Nissen, C. W., & Irrgang, J. J. (2010) · The American Journal of Sports Medicine · doi:10.1177/0363546509354163 · Cited by 257
Meta-Analyses in Orthopaedic Surgery: A Systematic Review of Their Methodologies
Bhandari, M., Morrow, F., Kulkarni, A. V., & Tornetta, P. (2001) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/00004623-200101000-00003 · Cited by 188
Identifying Clinical Trials in the Medical Literature with Electronic Databases
Suarez-Almazor, M. E., Belseck, E., Homik, J., Dorgan, M., & Ramos-Remus, C. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00067-2 · Cited by 180
Treatment of Chondral Defects in the Athlete's Knee
Harris, J. D., Brophy, R. H., Siston, R. A., & Flanigan, D. C. (2010) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2009.12.030 · Cited by 172
Self-citationHarris, J. D., Cavo, M. J., Brophy, R. H., Siston, R. A., & Flanigan, D. C. (2010) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2010.08.007 · Cited by 125
Self-citationSystematic reviews of test accuracy should search a range of databases to identify primary studies
Whiting, P. F., Westwood, M. E., Burke, M., Sterne, J. A. C., & Glanville, J. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.05.013 · Cited by 116
Reading and Reviewing the Orthopaedic Literature: A Systematic, Evidence-based Medicine Approach
Spindler, K. P., Kuhn, J. E., Dunn, W., Matthews, C. E., Harrell, F. E., & Dittus, R. S. (2005) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/00124635-200507000-00002 · Cited by 112
Simunovic, N., Sprague, S., & Bhandari, M. (2009) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.h.01576 · Cited by 100 · cited 1×
“The quality and strength of recommendations in a review are only as strong as the quality of studies that are analyzed.(1,5,22,24) Even randomized trials with high-level evidence are not without limitations.”
BackgroundTwenty Years of Meta-Analyses in Orthopaedic Surgery: Has Quality Kept Up with Quantity?
Dijkman, B. G., Abouali, J. A., Kooistra, B. W., Conter, H. J., Poolman, R. W., Kulkarni, A. V., Tornetta, P., & Bhandari, M. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.i.00251 · Cited by 84
An international survey indicated that unpublished systematic reviews exist
Tricco, A. C., Pham, B., Brehaut, J., Tetroe, J., Cappelli, M., Hopewell, S., Lavis, J. N., Berlin, J. A., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.014 · Cited by 64
Slobogean, G. P., Verma, A., Giustini, D., Slobogean, B. L., & Mulpuri, K. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.013 · Cited by 62 · cited 2×
“Nevertheless, in reference to sports medicine/orthopaedic surgery meta-analyses, recall rates (defined as the proportion of primary studies analyzed within orthopaedic meta-analyses that are indexed in either MEDLINE or Embase) of 90% and 81% for MEDLINE and Embase were obtained individually for all primary studies in…”
BackgroundQuatman, C. E., Quatman‐Yates, C. C., Schmitt, L. C., & Paterno, M. V. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.k.00275 · Cited by 47
Self-citationThe Use of Continuous Passive Motion Following Knee Cartilage Defect Surgery: A Systematic Review
Fazalare, J., Griesser, M. J., Siston, R. A., & Flanigan, D. C. (2010) · Orthopedics · doi:10.3928/01477447-20101021-16 · Cited by 46
Self-citationTubach, F., Giraudeau, B., & Ravaud, P. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.012 · Cited by 32
Meta-Analyses in Joint Arthroplasty: A Review of Quantity, Quality, and Impact
Sharma, R., Vannabouathong, C., Bains, S., Marshall, A., MacDonald, S. J., Parvizi, J., & Bhandari, M. (2011) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.j.01289 · Cited by 29
Harms, M. (2009) · Physiotherapy · doi:10.1016/j.physio.2009.10.001 · Cited by 23
Meta-Analyses and Systematic Reviews: New Guidelines for JBJS
Wright, J. G., Swiontkowski, M. F., & Tolo, V. T. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.9417edit · Cited by 17
Mann, B. J., Gosens, T., & Lyman, S. (2012) · The American Journal of Sports Medicine · doi:10.1177/0363546512457346 · Cited by 10 · cited 1×
“Therefore, although the difference is statistically significant, the difference is not clinically large enough to be perceived by the patient as different.(18) These differences are key in the ability to report whether patients have improved (treatment response/responders), whether that improvement is ‘‘back to normal…”
Background
Research works printed but not linked: 4
- Ebell MH, 2004, Am Fam Physician, 69, 548
- Hopewell S, 2007, Cochrane Database Syst Rev, MR000001
- University of Oxford, CEBM. Systematic review critical appraisal sheet. Available at: http://www.cebm.net/index.aspx?o=1913. Accessed January 20, 2013.
- University of Oxford, CEBM. OCEBM levels of evidence system. Available at: http://www.cebm.net/index.aspx?o=5653. Accessed December 20, 2012.
Cited by
Herold, F., Wiegel, P., Scholkmann, F., & Müller, N. (2018) · Journal of Clinical Medicine · doi:10.3390/jcm7120466 · Cited by 482
Meheux, C. J., McCulloch, P. C., Lintner, D. M., Varner, K. E., & Harris, J. D. (2016) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2015.08.005 · Cited by 445
Self-citationEtapas na Condução de uma Revisão Sistemática
Donato, H., & Donato, M. (2019) · Acta Médica Portuguesa · doi:10.20344/amp.11923 · Cited by 372
Herold, F., Törpel, A., Schega, L., & Müller, N. G. (2019) · European Review of Aging and Physical Activity · doi:10.1186/s11556-019-0217-2 · Cited by 349
Familiari, F., Cinque, M. E., Chahla, J. A., Godin, J. A., Olesen, M. L., Moatshe, G., & LaPrade, R. F. (2017) · The American Journal of Sports Medicine · doi:10.1177/0363546517732531 · Cited by 276
Metadata
- Authors
- Harris, J. D., Quatman, C. E., Manring, M. M., Siston, R. A., & Flanigan, D. C.
- Affiliations
- Houston Methodist (US)
- The Ohio State University (US)
- Corresponding author
- Harris, Joshua D.
- Venue
- The American Journal of Sports Medicine
- Publisher
- SAGE Publications
- Published
- 2013-08-07
- Volume
- 42
- Issue
- 11
- Pages
- 2761-2768
- ISSN
- 0363-5465 (ISSN-L)
- 1552-3365
- OpenAlex
- W2044392066
- Cited by
- 606
- References
- 33
- Citations by year
- 2026: 36 · 2025: 60 · 2024: 93 · 2023: 80 · 2022: 74 · 2021: 65 · 2020: 60 · 2019: 42 · 2018: 24 · 2017: 34 · 2016: 20 · 2015: 12 · 2014: 3 · 2013: 2
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The American Journal of Sports Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- systematic review methodology, meta-analysis, PRISMA guidelines, PROSPERO registration, evidence-based medicine, sports medicine, orthopedic surgery, study bias, strength of recommendation, level of evidence, data extraction, literature search strategies
- MeSH terms
- Humans, Orthopedics, Publishing, Review Literature as Topic, Sports Medicine, Meta-Analysis as Topic, Evidence-Based Medicine, Medical Writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.