The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Using Existing Systematic Reviews in Complex Systematic Reviews
Abstract
Systematic reviewers increasingly must decide whether and how to incorporate existing systematic reviews into complex systematic reviews that are commissioned to support clinical guideline development or for other health policy uses. To date, however, this issue has been largely unexamined. Reviewers seeking to incorporate existing reviews into new reviews face a set of important questions: Can this practice adhere to systematic review principles? Will it save time? When should it be avoided? Will it produce valid results and be acceptable to users? Drawing from their collective experience, the authors outline a series of steps that can help reviewers reach reasoned decisions about the incorporation of existing systematic reviews and enumerate potential hazards to consider in doing so. They highlight issues surrounding the main steps reviewers must undertake, including locating existing reviews; assessing their relevance to the new review; assessing the quality of relevant reviews; determining how to incorporate high-quality, relevant existing systematic reviews; and clearly reporting the methods used and the results from this process. Further specification of methods, including the development of reporting standards for this approach, is needed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Ironically, this obviates the time/cost benefits of conducting rapid meta-reviews in the first place (Caird et al., 2015;Whitlock et al., 2008).”
From Identifying the characteristics of effective teacher professional development: a critical review (2021) · cites this paper as Whitlock et al., 2008
In the citing paper
“Another consideration is a Grades of Recommendation, Assessment, Development and Evaluation-like assessment for the overall body of information included in the evidence summary as an important feature for knowledge users' interpretation of the global evidence base [20].”
From Evidence summaries: the evolution of a rapid review approach (2012) · cites this paper as [20]
In the citing paper
“As shown below, the Cochrane Collaboration methodology [11] and available methodological guidelines for overviews of reviews [12,13] were rigorously applied throughout this study.”
From Effects of Home Telemonitoring Interventions on Patients With Chronic Heart Failure: An Overview of Systematic Reviews (2015) · cites this paper as [13]
Citations
Cites
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
Guidelines for the Use of Antiretroviral Agents in HIV-Infected Adults and Adolescents
(1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-128-12_part_2-199806151-00003 · Cited by 5,209
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147 · cited 1×
“Recent studies suggest that even when existing reviews report similar methods and results, conflicts of interest related to the funding source can affect the conclusions (42, 43).”
ResultCurrent methods of the U.S. Preventive Services Task Force
Harris, R. P., Helfand, M., Woolf, S. H., Lohr, K. N., Mulrow, C. D., Teutsch, S. M., & Atkins, D. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(01)00261-6 · Cited by 1,731
Chou, R., & Huffman, L. H. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-7-200710020-00007 · Cited by 1,045
Self-citationSystems to rate the strength of scientific evidence.
West, S. L., King, V., Carey, T. S., Lohr, K. N., Mckoy, N. A., Sutton, S. F., & Lux, L. J. (2002) · PubMed · Cited by 923
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Research works printed but not linked: 3
- Gøtzsche PC, 2007, JAMA, 298, 430
- Jadad AR, 1997, CMAJ, 156, 1411
- Hopayian K, 1999, Br J Gen Pract, 49, 57
Cited by
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
“Another consideration is a Grades of Recommendation, Assessment, Development and Evaluation-like assessment for the overall body of information included in the evidence summary as an important feature for knowledge users’ interpretation of the global evidence base [20].”
BackgroundThe impact of mHealth interventions: systematic review of systematic reviews
Marcolino, M. S., Oliveira, J. A. Q., D'Agostino, M., Ribeiro, A. L., Alkmim, M. B. M., & Novillo-Ortiz, D. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8873 · Cited by 1,163
Blanpied, P. R., Gross, A. R., Elliott, J. M., Devaney, L. L., Clewley, D., Walton, D. M., Sparks, C., & Robertson, E. K. (2017) · Journal of Orthopaedic & Sports Physical Therapy · doi:10.2519/jospt.2017.0302 · Cited by 979
Chou, R., Deyo, R., Friedly, J., Skelly, A., Weimer, M., Fu, R., Dana, T., Kraegel, P., Griffin, J., & Grusing, S. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2458 · Cited by 864
Self-citationChou, R., Deyo, R., Friedly, J., Skelly, A., Hashimoto, R., Weimer, M., Fu, R., Dana, T., Kraegel, P., Griffin, J., et al. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2459 · Cited by 855
“We included higher-quality, recent systematic reviews that were most relevant to the review scope (125), supplemented with additional primary trials.”
Self-citation
Metadata
- Authors
- Whitlock, E. P., Lin, J. S., Chou, R., Shekelle, P., & Robinson, K. A.
- Affiliations
- RAND Corporation (US)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2008-05-20
- Volume
- 148
- Issue
- 10
- Pages
- 776-782
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2002461314
- Cited by
- 144
- References
- 36
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 3 · 2023: 4 · 2022: 4 · 2021: 3 · 2020: 6 · 2019: 6 · 2018: 14 · 2017: 8 · 2016: 16 · 2015: 10 · 2014: 11 · 2013: 17 · 2012: 12
- FWCI
- 2.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- clinical guideline development, review quality assessment, reporting guidelines, methodological validity, health policy evidence
- MeSH terms
- Research, Research Design, Review Literature as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Existing Systematic Reviews in Complex Systematic Reviews. https://app.cochat.ai/papers/10.7326/0003-4819-148-10-200805200-00010
- The paper
- Whitlock, E. P., Lin, J. S., Chou, R., Shekelle, P., & Robinson, K. A. (2008). Using Existing Systematic Reviews in Complex Systematic Reviews. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-148-10-200805200-00010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.