Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Munn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164
“These include integrative reviews, scoping reviews [47], evidence maps [48], realist syntheses [49], rapid reviews [50], umbrella reviews (systematic reviews of reviews) [51], mixed methods reviews [52], concept analyses [53] and others.”
BackgroundSelf-citationDinu, M., Pagliai, G., Casini, A., & Sofi, F. (2018) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2017.58 · Cited by 1,016
Coffee consumption and health: umbrella review of meta-analyses of multiple health outcomes
Poole, R., Kennedy, O. J., Roderick, P., Fallowfield, J. A., Hayes, P. C., & Parkes, J. (2017) · BMJ · doi:10.1136/bmj.j5024 · Cited by 835
“11 We conducted a review of coffee consumption and multiple health outcomes by systematically searching for meta-analyses in which coffee consumption was all or part of the exposure of interest or where coffee consumption had been part of a subgroup analysis.”
BackgroundSocial media use and its impact on adolescent mental health: An umbrella review of the evidence.
Valkenburg, P. M., Meier, A., & Beyens, I. (2022) · Current opinion in psychology · doi:10.1016/j.copsyc.2021.08.017 · Cited by 767
Systematic Reviews in Educational Research: Methodology, Perspectives and Application
Newman, M., & Gough, D. (2020) · Systematic Reviews in Educational Research · doi:10.1007/978-3-658-27602-7_1 · Cited by 591
(2020) · doi:10.4178/epih.e2020038 · Cited by 741
“In this umbrella review, we followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and the recommendations by the Joanna Briggs Institute (JBI) Umbrella Review Methodology Working Group [21,30].”
BackgroundMethodInfluentialHossain, M. M., Sultana, A., & Purohit, N. (2020) · doi:10.31234/osf.io/dz5v2 · Cited by 741
Cupp, M. A., Cariolou, M., Tzoulaki, I., Aune, D., Evangelou, E., & Berlanga-Taylor, A. J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01817-1 · Cited by 697
Wallace, T. C., Bailey, R. L., Blumberg, J. B., Burton-Freeman, B., Chen, C.-Y. O., Crowe-White, K. M., Drewnowski, A., Hooshmand, S., Johnson, E., Lewis, R., et al. (2020) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2019.1632258 · Cited by 638
“Literature search and selection criteria We followed standardized procedures for performing an umbrella review as previously described by Aromataris et al. (2015).”
MethodAdverse Outcomes of Polypharmacy in Older People: Systematic Review of Reviews
Davies, L. E., Spiers, G., Kingston, A., Todd, A., Adamson, J., & Hanratty, B. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.10.022 · Cited by 544
“This was a comprehensive review, produced using established methods.(18,19,22,77) The use of data from observational studies allowed us to explore the adverse outcomes of polypharmacy in “real world” scenarios, and over longer time scales than is possible in randomized controlled trials.”
MethodFerguson, T., Olds, T., Curtis, R., Blake, H., Crozier, A. J., Dankiw, K., Dumuid, D., Kasai, D., O'Connor, E., Virgara, R., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00111-x · Cited by 605
The updated Joanna Briggs Institute Model of Evidence-Based Healthcare
Jordan, Z., Lockwood, C., Munn, Z., & Aromataris, E. (2019) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000155 · Cited by 489
Self-citationWhat causes psychosis? An umbrella review of risk and protective factors
Radua, J., Ramella‐Cravaro, V., Ioannidis, J. P. A., Reichenberg, A., Phiphopthatsanee, N., Amir, T., Yenn Thoo, H., Oliver, D., Davies, C., Morgan, C., et al. (2018) · World Psychiatry · doi:10.1002/wps.20490 · Cited by 553
Neuenschwander, M., Ballon, A., Weber, K. S., Norat, T., Aune, D., Schwingshackl, L., & Schlesinger, S. (2019) · BMJ · doi:10.1136/bmj.l2368 · Cited by 511
Dietary fiber and health outcomes: an umbrella review of systematic reviews and meta-analyses
Veronese, N., Solmi, M., Caruso, M. G., Giannelli, G., Osella, A. R., Evangelou, E., Maggi, S., Fontana, L., Stubbs, B., & Tzoulaki, I. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqx082 · Cited by 536
Hossain, M. M., Khan, N., Sultana, A., Ma, P., McKyer, E. L. J., Ahmed, H. U., & Purohit, N. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112922 · Cited by 504
Dadi, A. F., Miller, E. R., Bisetegn, T. A., & Mwanri, L. (2020) · BMC Public Health · doi:10.1186/s12889-020-8293-9 · Cited by 421
“As with other reviews, a systematic review of reviews, follows a systematic approach in searching the literature, appraisal, quality assessment, synthesis and reporting of the compiled results [37, 40, 41].”
Leichsenring, F., Steinert, C., Rabung, S., & Ioannidis, J. P. A. (2022) · World Psychiatry · doi:10.1002/wps.20941 · Cited by 485
Missed nursing care: An overview of reviews
Chaboyer, W., Harbeck, E., Lee, B., & Grealish, L. (2021) · The Kaohsiung Journal of Medical Sciences · doi:10.1002/kjm2.12308 · Cited by 381
“Therefore, we used Johanna Briggs critical appraisal checklist for systematic reviews and research syntheses.(19) It T A B L E 1 (C o nt in u d”
BackgroundMethodCorrea, V. C., Lugo-Agudelo, L. H., Aguirre-Acevedo, D. C., Contreras, J. A. P., Borrero, A. M. P., Patiño-Lugo, D. F., & Valencia, D. A. C. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-00588-8 · Cited by 407
Kim, M. S., Kim, W. J., Khera, A. V., Kim, J. Y., Yon, D. K., Lee, S. W., Shin, J. I., & Won, H.-H. (2021) · European Heart Journal · doi:10.1093/eurheartj/ehab454 · Cited by 378
“Other CVDs may be the consequence of atherosclerosis and hypertension, as these entities possibly represent a pathophysiological basis and are thus major risk factors for CVD.55,57–60 Several MR studies have reported that BMI has no causal effect on stroke,61–63 and stroke was the least affected entity in our analysis.”
InfluentialAlderwick, H., Hutchings, A., Briggs, A., & Mays, N. (2021) · BMC Public Health · doi:10.1186/s12889-021-10630-1 · Cited by 386
“Unlike most umbrella reviews [52], which review systematic reviews only, we reviewed systematic and other reviews (such as scoping reviews) of relevant literature.”
BackgroundBellicha, A., van Baak, M. A., Battista, F., Beaulieu, K., Blundell, J. E., Busetto, L., Carraça, E. V., Dicker, D., Encantado, J., Ermolao, A., et al. (2021) · Obesity Reviews · doi:10.1111/obr.13256 · Cited by 375
“15 Given the amount of evidence published on the effects of exercise on body weight, body composition and specific fat depots such as visceral adipose tissue, an overview of reviews on these topics appears timely.”
Grgic, J., Grgic, I., Pickering, C., Schoenfeld, B. J., Bishop, D. J., & Pedisic, Z. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-100278 · Cited by 375
Social media use and well-being: What we know and what we need to know
Valkenburg, P. M. (2022) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.12.006 · Cited by 373
Risk Factors for Postpartum Depression: An Umbrella Review
Hutchens, B. F., & Kearney, J. (2020) · Journal of Midwifery & Women's Health · doi:10.1111/jmwh.13067 · Cited by 372
Dale, L. P., Vanderloo, L., Moore, S., & Faulkner, G. (2019) · Mental Health and Physical Activity · doi:10.1016/j.mhpa.2018.12.001 · Cited by 366
Schlesinger, S., Neuenschwander, M., Barbaresko, J., Lang, A., Maalmi, H., Rathmann, W., Roden, M., & Herder, C. (2022) · Diabetologia · doi:10.1007/s00125-021-05592-3 · Cited by 327
“In this context, umbrella reviews are helpful tools because they provide a broad overview of the existing evidence by focusing on published systematic reviews with meta-analyses on a specific topic and enable evaluation of the certainty of evidence and the risk of bias of the published meta-analyses [16].”
BackgroundThe prevalence of mental health problems in sub-Saharan adolescents: A systematic review
Jörns-Presentati, A., Napp, A.-K., Dessauvagie, A. S., Stein, D. J., Jonker, D., Breet, E., Charles, W., Swart, R. L., Lahti, M., Suliman, S., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251689 · Cited by 317
“A scoring system with a 10-point scale was used [20].”
MethodRisk and protective factors for mental disorders beyond genetics: an evidence‐based atlas
Arango, C., Dragioti, E., Solmi, M., Cortese, S., Domschke, K., Murray, R. M., Jones, P. B., Uher, R., Carvalho, A. F., Reichenberg, A., et al. (2021) · World Psychiatry · doi:10.1002/wps.20894 · Cited by 319
“Gulf war veterans Depressive disorders 11 (16,826) 2.”
BackgroundPereira, V. C., Silva, S. N., Carvalho, V. K. S., Zanghelini, F., & Barreto, J. O. M. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00815-4 · Cited by 294
“With the growth in the publication of systematic reviews, the strategy of grouping data from reviews in a single study has become a useful means for providing ample evidence to decisionmakers in the healthcare field [31].”
BackgroundO’Donoghue, G., Kennedy, A., Puggina, A., Aleksovska, K., Buck, C., Burns, C., Cardon, G., Carlin, A., Ciarapica, D., Colotto, M., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0190737 · Cited by 310
“The wide picture obtainable from the conduct of an umbrella review is ideal to highlight whether the evidence base around a topic is consistent or contradictory, and to explore the reasons for the findings [15].”
Dietary sugar consumption and health: umbrella review
Huang, Y., Chen, Z., Chen, B., Li, J., Yuan, X., Li, J., Wang, W., Dai, T., Chen, H., Wang, Y., et al. (2023) · BMJ · doi:10.1136/bmj-2022-071609 · Cited by 348
Serious Games and Gamification in Healthcare: A Meta-Review
Damaševičius, R., Maskeliūnas, R., & Blažauskas, T. (2023) · Information · doi:10.3390/info14020105 · Cited by 277
Xia, L., Zhao, R., Wan, Q., Wu, Y., Zhou, Y., Wang, Y., Cui, Y., Shen, X., & Wu, X. (2020) · Cancer Medicine · doi:10.1002/cam4.3428 · Cited by 321
Hunt, H., Pollock, A., Campbell, P., Estcourt, L., & Brunton, G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0695-8 · Cited by 314
“reviewed protocol formed around a clearly pre-specified research question with detailed inclusion and exclusion criteria, search strategies and methods for data extraction and appraisal, followed by clear and replicable methods for synthesis and summary of included data [6].”
BackgroundMethodInfluentialPrehabilitation in adult patients undergoing surgery: an umbrella review of systematic reviews
McIsaac, D. I., Gill, M., Boland, L., Hutton, B., Branje, K., Shaw, J., Grudzinski, A. L., Barone, N., Gillis, C., Akhtar, S., et al. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.11.014 · Cited by 312
Influenza vaccination in healthcare workers: A comprehensive critical appraisal of the literature
Dini, G., Toletone, A., Sticchi, L., Orsi, A., Bragazzi, N. L., & Durando, P. (2018) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2017.1348442 · Cited by 293
“The current investigation was conceived and designed as an umbrella review 67,68 and carried out in accordance with the “Preferred Reporting Items for Systematic Reviews and Meta-analyses” (PRISMA) guidelines.”
What factors affect patients’ ability to access healthcare? An overview of systematic reviews
Dawkins, B., Renwick, C., Ensor, T., Shinkins, B., Jayne, D., & Meads, D. (2021) · Tropical Medicine & International Health · doi:10.1111/tmi.13651 · Cited by 257
Assessment of nursing students' competence in clinical practice: A systematic review of reviews
Immonen, K., Oikarainen, A., Tomietto, M., Kääriäinen, M., Tuomikoski, A.-M., Kaučič, B. M., Filej, B., Riklikiene, O., Flores Vizcaya-Moreno, M., Perez-Cañaveras, R. M., et al. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.103414 · Cited by 234
“The eight reviews that met inclusion criteria were assessed for methodological quality by two researchers (KI, AO) independently using the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses (Aromataris et al., 2015).”
MethodTomato and lycopene and multiple health outcomes: Umbrella review
Li, N., Wu, X., Zhuang, W., Xia, L., Chen, Y., Wu, C., Rao, Z., Du, L., Zhao, R., Yi, M., et al. (2021) · Food Chemistry · doi:10.1016/j.foodchem.2020.128396 · Cited by 265
Systematic reviews of clinical practice guidelines: a methodological guide
Johnston, A., Kelly, S. E., Hsieh, S.-C., Skidmore, B., & Wells, G. A. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.11.030 · Cited by 273
Rugulies, R., Aust, B., Greiner, B. A., Arensman, E., Kawakami, N., LaMontagne, A. D., & Madsen, I. E. H. (2023) · The Lancet · doi:10.1016/s0140-6736(23)00869-3 · Cited by 217
The impact of tumor board on cancer care: evidence from an umbrella review
Specchia, M. L., Frisicale, E. M., Carini, E., Di Pilla, A., Cappa, D., Barbara, A., Ricciardi, W., & Damiani, G. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4930-3 · Cited by 248
Small-sided games: An umbrella review of systematic reviews and meta-analyses
Clemente, F. M., Afonso, J., & Sarmento, H. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247067 · Cited by 205
“consistency or not of evidence around SSGs [14].”
BackgroundJayedi, A., Soltani, S., Abdolshahi, A., & Shab-Bidar, S. (2020) · British Journal of Nutrition · doi:10.1017/s0007114520002330 · Cited by 246
Kaimara, P., Oikonomou, A., & Deliyannis, I. (2022) · Virtual Reality · doi:10.1007/s10055-021-00563-w · Cited by 222
Khraisha, Q., Put, S., Kappenberg, J., Warraitch, A., & Hadfield, K. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1715 · Cited by 269
“What is already known • Systematic reviews are crucial, but often slow, and the potential of Large Language Models (LLMs) such as Generative Pre-Trained Transformer (GPT)-4 for their automation has not been fully assessed against human performance.”
Khraisha, Q., Put, S., Kappenberg, J., Warraitch, A., & Hadfield, K. (2023) · arXiv · doi:10.48550/arxiv.2310.17526 · Cited by 268
“What is already known • Systematic reviews are crucial, but often slow, and the potential of Large Language Models (LLMs) such as Generative Pre-Trained Transformer (GPT)-4 for their automation has not been fully assessed against human performance.”
Successfully implementing a national electronic health record: a rapid umbrella review
Fennelly, O., Cunningham, C., Grogan, L., Cronin, H., O’Shea, C., Roche, M., Lawlor, F., & O’Hare, N. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104281 · Cited by 214
A Global Assessment of Eye Health and Quality of Life: A Systematic Review of Systematic Reviews
Assi, L., Chamseddine, F., Ibrahim, P., Sabbagh, H., Rosman, L., Congdon, N., Evans, J., Ramke, J., Kuper, H., Burton, M. J., et al. (2021) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2021.0146 · Cited by 234
Low-Grade Inflammation and Ultra-Processed Foods Consumption: A Review
Tristan Asensi, M., Napoletano, A., Sofi, F., & Dinu, M. (2023) · Nutrients · doi:10.3390/nu15061546 · Cited by 257
“understand the strength of the evidence and the extent of potential biases [29].”
BackgroundMarx, W., Veronese, N., Kelly, J. T., Smith, L., Hockey, M., Collins, S., Trakman, G. L., Hoare, E., Teasdale, S. B., Wade, A., et al. (2021) · Advances in Nutrition · doi:10.1093/advances/nmab037 · Cited by 242
“In line with prior umbrella reviews (41, 47), and as summarized elsewhere (48, 49), the results of this umbrella review were classified as Convincing, Highly suggestive, Suggestive, Weak, or No evidence, as defined using the following criteria.”
ResultArtificial Intelligence in the Tourism Industry: An Overview of Reviews
García-Madurga, M.-Á., & Grilló-Méndez, A.-J. (2023) · Administrative Sciences · doi:10.3390/admsci13080172 · Cited by 166
Bougioukas, K. I., Liakos, A., Tsapas, A., Ntzani, E., & Haidich, A.-B. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.002 · Cited by 251
Timpel, P., Oswald, S., Schwarz, P. E. H., & Harst, L. (2020) · Journal of Medical Internet Research · doi:10.2196/16791 · Cited by 243
“Owing to the increasing number of available reviews and meta-analysis as well as the potential of addressing three prevalent chronic conditions with multiple digital interventions, the analysis was conducted as an umbrella review [28,29].”
BackgroundMethodCooper, R. E., Saunders, K. R. K., Greenburgh, A., Shah, P., Appleton, R., Machin, K., Jeynes, T., Barnett, P., Allan, S. M., Griffiths, J., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03260-y · Cited by 181
“…Unit, agreed with policy makers in England to conduct an umbrella review of peer support to provide clinicians, policy makers and researchers with an overall assessment on the evidence available, comparing results between reviews, while taking the quality of these reviews into account [25, 26].”
BackgroundFactors influencing contraception choice and use globally: a synthesis of systematic reviews
D’Souza, P., Bailey, J. V., Stephenson, J., & Oliver, S. (2022) · The European Journal of Contraception & Reproductive Health Care · doi:10.1080/13625187.2022.2096215 · Cited by 181
“methods considering the review’s purpose [12].”
Treskova-Schwarzbach, M., Haas, L., Reda, S., Pilic, A., Borodova, A., Karimi, K., Koch, J., Nygren, T., Scholz, S., Schönfeld, V., et al. (2021) · BMC Medicine · doi:10.1186/s12916-021-02058-6 · Cited by 218
Sleep duration and health outcomes: an umbrella review
Li, J., Cao, D., Huang, Y., Chen, Z., Wang, R., Dong, Q., Wei, Q., & Liu, L. (2022) · Sleep and Breathing · doi:10.1007/s11325-021-02458-1 · Cited by 203
“An umbrella review is one of the highest levels of evidence synthesis and is gaining traction in multidisciplinary areas [23, 24].”
BackgroundMenopausal hormone therapy and women’s health: An umbrella review
Zhang, G.-Q., Chen, J.-L., Luo, Y., Mathur, M. B., Anagnostis, P., Nurmatov, U., Talibov, M., Zhang, J., Hawrylowicz, C. M., Lumsden, M. A., et al. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003731 · Cited by 208
“It systematically integrates evidence from multiple systematic reviews to present a comprehensive view of the evidence landscape, readily providing guideline developers and decision-makers with the currently available highest level of evidence relevant to the question posed [21,22].”
BackgroundOussalah, A., Levy, J., Berthezène, C., Alpers, D. H., & Guéant, J.-L. (2020) · Clinical Nutrition · doi:10.1016/j.clnu.2020.02.037 · Cited by 193
Silver diamine fluoride for managing carious lesions: an umbrella review
Seifo, N., Cassie, H., Radford, J. R., & Innes, N. P. T. (2019) · BMC Oral Health · doi:10.1186/s12903-019-0830-5 · Cited by 217
Dietary Fiber Intake and Type 2 Diabetes Mellitus: An Umbrella Review of Meta-analyses
McRae, M. P. (2018) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2017.11.002 · Cited by 206
Aust, B., Møller, J. L., Nordentoft, M., Frydendall, K. B., Bengtsen, E., Jensen, A. B., Garde, A. H., Kompier, M. A. J., Semmer, N. K., Rugulies, R., et al. (2023) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.4097 · Cited by 229
“Compared to reviews of primary studies, overviews of reviews, also termed “umbrella reviews” or “meta-reviews”, enable researchers examining the field from “higher up” and potentially identify patterns that can be difficult to detect in reviews of primary studies (10–12).”
BackgroundCillekens, B., Lang, M., van Mechelen, W., Verhagen, E., Huysmans, M. A., Holtermann, A., van der Beek, A. J., & Coenen, P. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102587 · Cited by 182
Research Trends, Challenges, and Emerging Topics in Digital Forensics: A Review of Reviews
Casino, F., Dasaklis, T. K., Spathoulas, G. P., Anagnostopoulos, M., Ghosal, A., Borocz, I., Solanas, A., Conti, M., & Patsakis, C. (2022) · IEEE Access · doi:10.1109/access.2022.3154059 · Cited by 165
“Other descriptions include the terms (‘‘review of reviews,’’ ‘‘systematic review of reviews,’’ ‘‘review of systematic reviews,’’ ‘‘overviews of reviews,’’ ‘‘summary of systematic reviews,’’ ‘‘summary of reviews,’’ and ‘‘synthesis of reviews’’) [19].”
Applicability of augmented reality in orthopedic surgery – A systematic review
Jud, L., Fotouhi, J., Andronic, O., Aichmair, A., Osgood, G., Navab, N., & Farshad, M. (2020) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-3110-2 · Cited by 198
Fuller, J. T., Hartland, M. C., Maloney, L. T., & Davison, K. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098285 · Cited by 199
Hossain, M. M., Nesa, F., Das, J., Aggad, R., Tasnim, S., Bairwa, M., Ma, P., & Ramirez, G. (2022) · Psychiatry Research · doi:10.1016/j.psychres.2022.114814 · Cited by 177
Hult, M., Terkamo‐Moisio, A., Kaakinen, P., Karki, S., Nurmeksela, A., Palonen, M., Peltonen, L., & Häggman‐Laitila, A. (2023) · Nursing Open · doi:10.1002/nop2.1876 · Cited by 224
“Our review followed the protocol proposed in the Preferred Reporting Items for Systematic Reviews and Meta- Analysis (PRISMA) statement (Page et al., 2021), along with instructions for umbrella reviews (Aromataris et al., 2015) and conducting reviews of systematic reviews (Smith et al., 2011).”
MethodMcRae, M. P. (2017) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2017.05.005 · Cited by 183
Zhang, X., Chen, X., Xu, Y., Yang, J., Du, L., Li, K., & Zhou, Y. (2021) · Nutrition & Metabolism · doi:10.1186/s12986-020-00527-y · Cited by 195
Li, D., Lu, Y., Yuan, S., Cai, X., He, Y., Chen, J., Wu, Q., He, D., Fang, A., Bo, Y., et al. (2022) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqac074 · Cited by 178
“overview of evidence from systematic review with or without meta-analysis (20).”
Wendrich-van Dael, A., Bunn, F., Lynch, J., Pivodic, L., Van den Block, L., & Goodman, C. (2020) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2020.103576 · Cited by 192
The Role of Social Determinants of Health in Cardiovascular Diseases: An Umbrella Review
Teshale, A. B., Htun, H. L., Owen, A., Gasevic, D., Phyo, A. Z. Z., Fancourt, D., Ryan, J., Steptoe, A., & Freak‐Poli, R. (2023) · Journal of the American Heart Association · doi:10.1161/jaha.123.029765 · Cited by 163
“Web of Science 27 (27) 12 (Australia, Finland,”
Intraoperative interventions for preventing surgical site infection: an overview of Cochrane Reviews
Liu, Z., Dumville, J. C., Norman, G., Westby, M. J., Blazeby, J. M., McFarlane, E., Welton, N. J., O’Connor, L., Cawthorne, J., George, R., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012653.pub2 · Cited by 215
Anstey, K. J., Ee, N., Eramudugolla, R., Jagger, C., & Peters, R. (2019) · Journal of Alzheimer’s Disease · doi:10.3233/jad-190181 · Cited by 187
“A systematic review of reviews was con77 ducted [9], and pre-registered in PROSPERO 78 CRD42017053920.”
BackgroundBonaccorsi, G., Manzi, F., Del Riccio, M., Setola, N., Naldi, E., Milani, C., Giorgetti, D., Dellisanti, C., & Lorini, C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176127 · Cited by 161
O'Brien, C. J., van Zundert, A. A. J., & Barach, P. R. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102641 · Cited by 211
“4 • Since 2017, at least ten doctors have been violently killed in the Philippines with doctors being subject to bounties and targeted because of perceived political af fi liations.”
BackgroundLunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0617-1 · Cited by 184
“5 Define the objectives using PICO elements (or equivalent) to develop an answerable question Baker 2014 [29]; Becker 2008 [1]; Cooper 2012 [32]; Hartling 2012 [35]; JBI 2015 [40, 41]; Li 2012 [44]; Ryan 2009 [53, 54]; Smith 2011 [57]; Robinson 2015 [48–52]; Thomson 2010 [58] CMIMG Comparing Multiple Interventions Met…”
BackgroundMethodInfluentialWoldie, M., Feyissa, G. T., Admasu, B., Hassen, K., Mitchell, K., Mayhew, S., McKee, M., & Balabanova, D. (2018) · Health Policy and Planning · doi:10.1093/heapol/czy094 · Cited by 171
“The Joanna Briggs Institute (JBI) critical appraisal assessment checklist for systematic reviews (Aromataris et al., 2015) was used to critically appraise the methodological quality of the retrieved systematic reviews.”
MethodButow, P., Laidsaar-Powell, R., Konings, S., Lim, C. Y. S., & Koczwara, B. (2020) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00828-z · Cited by 167
Identifying risk factors for COPD and adult-onset asthma: an umbrella review
Holtjer, J. C. S., Bloemsma, L. D., Beijers, R. J. H. C. G., Cornelissen, M. E. B., Hilvering, B., Houweling, L., Vermeulen, R. C. H., Downward, G. S., & der Zee, A. H. M. (2023) · European Respiratory Review · doi:10.1183/16000617.0009-2023 · Cited by 195
Health outcomes of smoking during pregnancy and the postpartum period: an umbrella review
Avşar, T. S., McLeod, H., & Jackson, L. (2021) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-021-03729-1 · Cited by 178
Gastaldon, C., Solmi, M., Correll, C. U., Barbui, C., & Schoretsanitis, G. (2022) · The British Journal of Psychiatry · doi:10.1192/bjp.2021.222 · Cited by 150
Dietary Factors and Risks of Cardiovascular Diseases: An Umbrella Review
Chareonrungrueangchai, K., Wongkawinwoot, K., Anothaisintawee, T., & Reutrakul, S. (2020) · Nutrients · doi:10.3390/nu12041088 · Cited by 153
“An umbrella review is tertiary research that provides a comprehensive overview of evidence from SRMAs [13].”
BackgroundRed and processed meat consumption and cancer outcomes: Umbrella review
Huang, Y. C., Cao, D., Chen, Z., Chen, B., Li, J., Guo, J., Dong, Q. G., Liu, L., & Wei, Q. (2021) · Food Chemistry · doi:10.1016/j.foodchem.2021.129697 · Cited by 190
Nyadanu, S. D., Dunne, J., Tessema, G. A., Mullins, B., Kumi-Boateng, B., Lee Bell, M., Duko, B., & Pereira, G. (2022) · Environmental Pollution · doi:10.1016/j.envpol.2022.119465 · Cited by 162
Mair, J. L., Salamanca-Sanabria, A., Augsburger, M., Frese, B. F., Abend, S., Jakob, R., Kowatsch, T., & Haug, S. (2023) · Annals of Behavioral Medicine · doi:10.1093/abm/kaad041 · Cited by 140
“An umbrella review, also referred to as an “overview of reviews” or “review of reviews”, is a synthesis of existing systematic reviews that summarizes the highest level of evidence available, allowing decision makers to gain a clear understanding of a broad topic area [20].”
BackgroundHealth system strengthening in fragile and conflict-affected states: A review of systematic reviews
Bogale, B., Scambler, S., Khairuddin, A. N. M., & Gallagher, J. E. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305234 · Cited by 182
“They also independently assessed methodological quality of the selected literature for inclusion in the synthesis using the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [33].”
MethodPatient and Family Preferences About Place of End-of-Life Care and Death: An Umbrella Review
Pinto, S. M. O., Lopes, S., de Sousa, A. B., Delalibera, M., & Gomes, B. (2024) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2024.01.014 · Cited by 187
Sortwell, A., Trimble, K., Ferraz, R., Geelan, D. R., Hine, G., Ramirez-Campillo, R., Carter-Thuiller, B., Gkintoni, E., & Xuan, Q. (2024) · Sustainability · doi:10.3390/su16177826 · Cited by 70
Climate Change, Weather, Housing Precarity, and Homelessness: A Systematic Review of Reviews
Bezgrebelna, M., McKenzie, K. J., Wells, S. L., Ravindran, A. V., Kral, M. J., Christensen, J., Stergiopoulos, V., Gaetz, S., & Kidd, S. A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18115812 · Cited by 227
Matwiejczyk, L., Mehta, K., Scott, J., Tonkin, E., & Coveney, J. (2018) · Nutrients · doi:10.3390/nu10030293 · Cited by 178
“…2014), Table S3: Characteristics of included systematic reviews (using JBI Data Extraction Form for Systematic Reviews and Research Syntheses, Aromataris et al., 2015, The Johanna Briggs Institute 2014), Table S4: Summary of the evidence from selected reviews using the JBI data extraction…”
BackgroundMethodInfluentialDinu, M., Pagliai, G., Angelino, D., Rosi, A., Dall'Asta, M., Bresciani, L., Ferraris, C., Guglielmetti, M., Godos, J., Del Bo', C., et al. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa006 · Cited by 164
Sleep Health Promotion Interventions and Their Effectiveness: An Umbrella Review
Albakri, U., Drotos, E., & Meertens, R. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18115533 · Cited by 175
“Methodological quality was assessed using the JBI Critical Evaluation Controller for Systematic Reviews, which consists of 10 items, awarded 0 or 1 [26].”
MethodWhat do we know about pedagogical models in physical education so far? An umbrella review
Fernández‐Río, J., & Gallego, D. I. (2022) · Physical Education and Sport Pedagogy · doi:10.1080/17408989.2022.2039615 · Cited by 192
“Umbrella reviews (Ioannidis 2017) are considered one of the next generation of systematic reviews, because they can provide a broader picture of fi ndings that can help inform guidelines (Aromataris et al. 2015).”
BackgroundAndreucci-Annunziata, P., Riedemann, A., Cortés, S., Mellado, A., del Río, M. T., & Vega-Muñoz, A. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1141686 · Cited by 195
“The following sections were excluded because, as a review of reviews or umbrella review (Aromataris et al., 2015), the data from each study to satisfy their criteria were not considered pertinent within the narrative synthesis of the present review, or were not available, or were presented only in a general way after…”
Background
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.