A descriptive analysis of overviews of reviews published between 2000 and 2011.
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Overviews of systematic reviews compile data from multiple systematic reviews (SRs) and are a new method of evidence synthesis. OBJECTIVES: To describe the methodological approaches in overviews of interventions. DESIGN: Descriptive study. METHODS: We searched 4 databases from 2000 to July 2011; we handsearched Evidence-based Child Health: A Cochrane Review Journal. We defined an overview as a study that: stated a clear objective; examined an intervention; used explicit methods to identify SRs; collected and synthesized outcome data from the SRs; and intended to include only SRs. We did not restrict inclusion by population characteristics (e.g., adult or children only). Two researchers independently screened studies and applied eligibility criteria. One researcher extracted data with verification by a second. We conducted a descriptive analysis. RESULTS: From 2,245 citations, 75 overviews were included. The number of overviews increased from 1 in 2000 to 14 in 2010. The interventions were pharmacological (n = 20, 26.7%), non-pharmacological (n = 26, 34.7%), or both (n = 29, 38.7%). Inclusion criteria were clearly stated in 65 overviews. Thirty-three (44%) overviews searched at least 2 databases. The majority reported the years and databases searched (n = 46, 61%), and provided key words (n = 58, 77%). Thirty-nine (52%) overviews included Cochrane SRs only. Two reviewers independently screened and completed full text review in 29 overviews (39%). Methods of data extraction were reported in 45 (60%). Information on quality of individual studies was extracted from the original SRs in 27 (36%) overviews. Quality assessment of the SRs was performed in 28 (37%) overviews; at least 9 different tools were used. Quality of the body of evidence was assessed in 13 (17%) overviews. Most overviews provided a narrative or descriptive analysis of the included SRs. One overview conducted indirect analyses and the other conducted mixed treatment comparisons. Publication bias was discussed in 18 (24%) overviews. CONCLUSIONS: This study shows considerable variation in the methods used for overviews. There is a need for methodological rigor and consistency in overviews, as well as empirical evidence to support the methods employed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There remains no standardized method to evaluate the certainty of evidence in overviews of reviews (15,22), so a summary percentage scores were calculated to demonstrate the quality of evidence contributing to each conclusion.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
3 retracted
Ventre, K., & Randolph, A. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000181.pub3 · Cited by 312
RetractedSurfactant therapy for bronchiolitis in critically ill infants
Ventre, K. M., Haroon, M., & Davison, C. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005150.pub2 · Cited by 72
RetractedImmunoglobulin treatment for respiratory syncytial virus infection
Fuller, H. L., & Mar, C. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004883.pub2 · Cited by 54
RetractedLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 2×
“In Appendix S1, we list the mandatory standards developed by The Cochrane Collaboration [13] and discuss their applicability to overviews, and we present the PRISMA reporting guidelines for SRs and meta-analyses [15] and their applicability to overviews.”
BackgroundMethodDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681 · cited 1×
“[20] Few overviews in our sample described the quality of evidence, likely because this process has been implemented more recently.”
BackgroundMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · cited 1×
“[14,15] Similar guidelines need to be established and followed for overviews.”
BackgroundDevelopment of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
(2008) · Cited by 3,790
Norderyd, O. M., Koch, G., Papias, A., Köhler, A. A., Helkimo, A. N., Brahm, C., Lindmark, U., Lindfors, N., Mattsson, A., Rolander, B., et al. (2015) · PubMed · Cited by 3,584
Cited by
Items 201–248 of 248
(2021) · Archives des maladies professionnelles et de médecine du travail/Archives des maladies professionnelles et de l'environnement · doi:10.1016/j.admp.2021.08.005
Det er plass til både grønt og kjøtt
Lundekvam, E., Thorkildsen, T., Sødring, M. S., & Henriksen, K. S. (2020) · Norsk tidsskrift for ernæring · doi:10.18261/ntfe.18.3.4
Lunny, C., Thirugnanasampanthar, S. S., Kanji, S., Ferri, N., Pieper, D., Whitelaw, S., Tasnim, S., Reid, E. K., Zhang, J. H., Kalkat, B., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1143357/v3
Nian, T., Xue, S., Zhou, J. W., Fen Fen, E., Yan, L. Y., Hu, Y., Xin, J. T., Chen, Y. K., Cai, S. Z., Lu, C., et al. (2023) · Preprints.org · doi:10.20944/preprints202306.2082.v1
Mwanthi, M. M., Wafula, C. M., & Mbugua, J. (2023) · Higher Education Studies · doi:10.5539/hes.v13n3p117
Mora, G. O. (2023) · Revista de la Facultad de Medicina · doi:10.15446/revfacmed.v71n3.107048
Mwanthi, M. M., Wafula, C. M., & Mbugua, J. (2023) · Journal of Entrepreneurship & Project Management · doi:10.53819/81018102t2207
Mwanthi, M. M., Wafula, C. M., & Mbugua, J. (2023) · Journal of Entrepreneurship & Project Management · doi:10.53819/81018102t2208
Uso do ácido fólico para prevenção de defeitos do tubo neural: uma overview de revisões
Muniz, N. F. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.17.2023.tde-20102023-165305
Déry, J., Ouellet, B., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2023) · Figshare · doi:10.6084/m9.figshare.23714122
Reporting Overviews of Reviews: PRIORitizing a Reporting Guideline
Hartling, L., & Moher, D. (2024) · Perspectives on Integrative Medicine · doi:10.56986/pim.2024.06.001
“Overviews of reviews (also referred to herein as overviews) have emerged as a form of evidence synthesis over the past 20-25 years with one of the first overviews published in 2000 [3].”
BackgroundSelf-citationAccioly, C. C. M., Guimarães, J. D. S., Brasileiro, A. J. A. D. L., Tanaca, B. C., GomesGomes, M. C. S. E., Martins, R. R. D. A., Arcanjo, F. L., & Neto, M. G. (2024) · Current Treatment Options in Rheumatology · doi:10.1007/s40674-024-00220-8
“It eliminates the need for readers to independently analyze information from multiple systematic studies, thereby streamlining the process of evidence-based decision-making [41].”
Perception on integrated energy services’ design and management among residents in China
Xu, X., Zainordin, N. S., Sharaai, A. H., & Rahim, N. N. R. N. A. (2024) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1432/1/012009
“Descriptive analysis was conducted to summarize the data collected for this study [21].”
Pickard, A., Alving‐Jessep, E., Delivett, C. P., Jenkins, R. H., Pullar, L., Farrow, C. V., & Blissett, J. M. (2025) · Nutrition Reviews · doi:10.1093/nutrit/nuaf092 · Cited by 1
Lawaju, P., Devkota, N., & Panthi, H. (2025) · International Research Journal of MMC · doi:10.3126/irjmmc.v6i4.85547
“This approach ensured methodological coherence, strengthened internal validity, and supported the generalizability of findings across similar contexts (Dolma, 2010; Nikander et al., 2014; Ishtiaq, 2019; Hartling et al., 2012).”
Effectiveness of mouth rinses on caries prevention and arrest: an umbrella review
Seremidi, K., Davidopoulou, S., Kaklamanos, E. G., Rahiotis, C., Gizani, S., Koromantzos, P. A., Bobetsis, Y. A., Karakostas, P., Giota, C., Papadimitriou, K., et al. (2025) · Evidence-Based Dentistry · doi:10.1038/s41432-025-01188-7
Bauer, B. S. (2024) · St Andrews Research Repository (St Andrews Research Repository) · doi:10.17630/sta/1196
Kwok, J., Hall, H. A., Murray, A. L., & Auyeung, B. (2020) · Figshare · doi:10.6084/m9.figshare.12910503
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918927
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · Figshare · doi:10.6084/m9.figshare.14926906
Déry, J., Ouellet, B., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2023) · Figshare · doi:10.6084/m9.figshare.23714113
Kwok, J., Hall, H. A., Murray, A. L., & Auyeung, B. (2020) · Figshare · doi:10.6084/m9.figshare.12910497
Kwok, J., Hall, H. A., Murray, A. L., & Auyeung, B. (2020) · Figshare · doi:10.6084/m9.figshare.12910500
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918930
Büchter, R. B., Weise, A., & Pieper, D. (2021) · Figshare · doi:10.6084/m9.figshare.16944440
Kwok, J., Hall, H. A., Murray, A. L., & Auyeung, B. (2020) · Figshare · doi:10.6084/m9.figshare.12910506
Büchter, R. B., Weise, A., & Pieper, D. (2021) · Figshare · doi:10.6084/m9.figshare.16944449
Déry, J., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2021) · Figshare · doi:10.6084/m9.figshare.16674926
Büchter, R. B., Weise, A., & Pieper, D. (2021) · Figshare · doi:10.6084/m9.figshare.16944452
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918939
Bougioukas, K. I. (2024) · Octopus · doi:10.57874/e7mr-3m04
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918945
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918942
Büchter, R. B., Weise, A., & Pieper, D. (2021) · Figshare · doi:10.6084/m9.figshare.16944458
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918933
Déry, J., Ouellet, B., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2023) · Figshare · doi:10.6084/m9.figshare.23714119
Transparency in the Pharmaceutical Supply Chain - An Analysis Based on Selected Studies
Fischer, J. (2024) · doi:10.25593/open-fau-896 · Cited by 1
Déry, J., Ouellet, B., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2023) · Figshare · doi:10.6084/m9.figshare.23714125
Conneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · Figshare · doi:10.6084/m9.figshare.19918936
Déry, J., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2021) · Figshare · doi:10.6084/m9.figshare.16674920
Déry, J., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2021) · Figshare · doi:10.6084/m9.figshare.16674923
Büchter, R. B., Weise, A., & Pieper, D. (2021) · Figshare · doi:10.6084/m9.figshare.16944455
Evidence syntheses: choosing an approach
Giroux, C. M., Mak, S., Ataman, R., & Thomas, A. (2023) · Wiley eBooks · doi:10.1002/9781394391646.ch8
Exploring rapid evidence synthesis methods for policy: a case study of healthcare regionalisation
Quigley, J. M. (2026) · Enlighten: Theses (The University of Glasgow) · doi:10.5525/gla.thesis.85938
Yende, S. J. (2026) · Journal of Education and Learning Technology · doi:10.38159/jelt.2026787
La didattica esperienziale come strategia inclusiva
Arduini, G. (2020) · Archivio Istituzionale della Ricerca - Università degli Studi di Cassino · doi:10.7346/sipes-01-2020-13 · Cited by 7
Acta Bioclínica Volúmen 13, N° 25: Enero - Junio 2023
- (2023) · Acta Bioclínica
Metadata
- Authors
- Hartling, L., Chisholm, A., Thomson, D., & Dryden, D. M.
- Affiliations
- University of Alberta (CA)
- Corresponding author
- Hartling, Lisa
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-11-15
- Volume
- 7
- Issue
- 11
- Pages
- e49667
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3499476
- OpenAlex
- W2003178123
- Cited by
- 241
- References
- 28
- Citations by year
- 2026: 7 · 2025: 13 · 2024: 20 · 2023: 28 · 2022: 30 · 2021: 30 · 2020: 21 · 2019: 12 · 2018: 12 · 2017: 19 · 2016: 26 · 2015: 5 · 2014: 14 · 2013: 4
- FWCI
- 8.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- overviews of systematic reviews, methodological quality, evidence synthesis, systematic reviews, search strategy reporting, publication bias, network meta-analysis, indirect analysis, child health interventions, pharmacological interventions, non-pharmacological treatment, narrative synthesis, evidence quality assessment
- MeSH terms
- Child, Child Welfare, Humans, Publications, Review Literature as Topic, Evidence-Based Medicine, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

