Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 301–400 of 1,014
Substance use among young people in sub-Saharan Africa: a systematic review and meta-analysis
Ebrahim, J., Adams, J., & Demant, D. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1328318 · Cited by 85
McRae, M. P. (2018) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2017.12.001 · Cited by 72
Ramírez-Ossa, D. M., Escobar-Correa, N., Bustamante, M. A. R., & Agudelo‐Suárez, A. A. (2020) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2020.101402 · Cited by 68
ACCURACY OF INTRAORAL SCANNERS VERSUS TRADITIONAL IMPRESSIONS: A RAPID UMBRELLA REVIEW
Afrashtehfar, K. I., ALNAKEB, N. A., & Assery, M. K. A. (2022) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2022.101719 · Cited by 75
Bariatric surgery and health outcomes: An umbrella analysis
Liao, J., Yin, Y., Zhong, J., Chen, Y., Chen, Y., Wen, Y., & Cai, Z. (2022) · Frontiers in Endocrinology · doi:10.3389/fendo.2022.1016613 · Cited by 72
“Frontiers in Endocrinology 03 picture of the findings for particular questions (16).”
BackgroundClinical Effectiveness of Dry Needling in Patients with Musculoskeletal Pain—An Umbrella Review
Chys, M., Meulemeester, K. D., Greef, I. D., Murillo, C., Kindt, W., Kouzouz, Y., Lescroart, B., & Cagnie, B. J. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12031205 · Cited by 79
“This UR used robust methodological approaches based on the most recent published evidence, as described by the Joanna Briggs Institute and including the use of AMSTAR and PRISMA tools [13,14,18].”
BackgroundMethodInfluentialCurnow, E., Rutherford, M., Maciver, D., Johnston, L., Prior, S., Boilson, M., Shah, P. J., Jenkins, N. D., & Meff, T. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288275 · Cited by 78
Beato, M., de Keijzer, K. L., Muñoz‐López, A., González, J. R., Pozzo, M., Alkner, B. A., Iacono, A. D., Vicens‐Bordas, J., Coratella, G., Maroto‐Izquierdo, S., et al. (2024) · Sports Medicine · doi:10.1007/s40279-023-01979-x · Cited by 71
“Finally, this type of review allows for an analysis of possible or existing bias in the literature that can negatively affect the validity and applicability of the scientific evidence [35].”
BackgroundWalzer, S., Armbruster, C., Mahler, S., Farin‐Glattacker, E., & Kunze, C. (2025) · Journal of Medical Internet Research · doi:10.2196/64616 · Cited by 73
“This design allows us to provide a comprehensive overview of the current landscape of DNTs to support nursing care across settings and interventions [21].”
InfluentialResistance training variables for optimization of muscle hypertrophy: an umbrella review.
Bernárdez-Vázquez, R., Raya-González, J., Castillo, D., & Beato, M. (2022) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2022.949021 · Cited by 67
Castelnuovo, G., Giusti, E. M., Manzoni, G. M., Saviola, D., Gabrielli, S., Lacerenza, M. R., Pietrabissa, G., Cattivelli, R., Spatola, C. A. M., Rossi, A. A., et al. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.00310 · Cited by 70
“The methodological quality of included studies was then assessed using the Critical Appraisal Checklist for Systematic Reviews (Table 1) (36).”
MethodAssociation Between Folate and Health Outcomes: An Umbrella Review of Meta-Analyses
Bo, Y., Zhu, Y., Tao, Y., Li, X., Zhai, D., Bu, Y., Wan, Z., Wang, L., Wang, Y., & Yu, Z. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.550753 · Cited by 70
“Other than the reasons mentioned above, the associations between folate and cancers may also be explained by two further mechanisms: (1) folate deficiency may induce complete transformation of deoxyuridylate monophosphate to deoxythymidylate monophosphate, which induces misincorporation of uracil into DNA and leads to…”
BackgroundMethodSeeking a deeper understanding of ‘distributed health literacy’: A systematic review
Muscat, D. M., Gessler, D., Ayre, J., Norgaard, O., Heuck, I. R., Haar, S., & Maindal, H. T. (2022) · Health Expectations · doi:10.1111/hex.13450 · Cited by 69
Hamre, H. J., Glockmann, A., von Ammon, K., Riley, D. S., & Kiene, H. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02313-2 · Cited by 89
Fernández‐de‐las‐Peñas, C., Florêncio, L. L., De-la-Llave-Rincón, A. I., Ortega‐Santiago, R., Cigarán‐Méndez, M., Fuensalida‐Novo, S., Plaza‐Manzano, G., Arendt‐Nielsen, L., Valera‐Calero, J. A., & Navarro‐Santana, M. J. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12206624 · Cited by 70
“Overviews of systematic reviews, or umbrella reviews, bring together the evidence from systematic reviews on a similar topic and represent one of the highest levels of evidence [8].”
BackgroundCardiovascular health and cancer risk associated with plant based diets: An umbrella review
Capodici, A., Mocciaro, G., Gori, D., Landry, M. J., Masini, A., Sanmarchi, F., Fiore, M., Coa, A. A., Castagna, G., Gardner, C. D., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300711 · Cited by 70
Adu, M. D., Malabu, U. H., Callander, E. J., Malau-Aduli, A. E., & Malau-Aduli, B. S. (2018) · JMIR mHealth and uHealth · doi:10.2196/10115 · Cited by 59
“The quality was evaluated using Joanna Briggs Institute’s pre-designed standardized critical appraisal tools [41].”
MethodBlood Sugar Regulation for Cardiovascular Health Promotion and Disease Prevention
Schwarz, P. E. H., Timpel, P., Harst, L., Greaves, C. J., Ali, M. K., Lambert, J., Weber, M. B., Almedawar, M. M., & Morawietz, H. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.07.081 · Cited by 60
Haghani, M. (2023) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2023.100956 · Cited by 67
Ashor, A. W., Brown, R., Keenan, P. D., Willis, N. D., Siervo, M., & Mathers, J. C. (2019) · Nutrition Research · doi:10.1016/j.nutres.2018.08.005 · Cited by 66
Rasmussen, B. M., Andersen, P. T., Waldorff, F. B., & Berg‐Beckhoff, G. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104469 · Cited by 71
Nationwide trends and features of human salmonellosis outbreaks in China
Wang, Z., Zhou, H., Liu, Y., Huang, C., Chen, J., Siddique, A., Yin, R., Jia, C., Li, Y., Zhao, G., et al. (2024) · Emerging Microbes & Infections · doi:10.1080/22221751.2024.2372364 · Cited by 70
“Each study was scored based on the checklist, and only those achieving a high-quality score with a low risk of bias (total score = 10) were included in the meta-analysis [29].”
Abate, B. B., Sendekie, A. K., Faris, A. M., Abebe, G. K., Azmeraw, M., Alamaw, A. W., Zemariam, A. B., Kitaw, T. A., Kassaw, A., Wodaynew, T., et al. (2024) · Neuropsychobiology · doi:10.1159/000542392 · Cited by 75
“This umbrella review was done following the methodology of umbrella review of existing SRM studies [29].”
Impact of organized activities on mental health in children and adolescents: An umbrella review
Boelens, M., Smit, M. S., Raat, H., Bramer, W. M., & Jansen, W. (2022) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2021.101687 · Cited by 65
Armaou, M., Araviaki, E., & Musikanski, L. (2019) · International Journal of Community Well-Being · doi:10.1007/s42413-019-00055-5 · Cited by 69
Resposta a necessidades em saúde mental de estudantes universitários: uma revisão rápida
Gaiotto, E. M. G., Trapé, C. A., Campos, C. M. S., Fujimori, E., Carrer, F. C. D. A., Nichiata, L. Y. I., Cordeiro, L., de Bortoli, M. C., Yonekura, T., Toma, T. S., et al. (2021) · Revista de Saúde Pública · doi:10.11606/s1518-8787.2021055003363 · Cited by 81
Impact of digital services on healthcare and social welfare: An umbrella review
Härkönen, H., Lakoma, S., Verho, A., Torkki, P. M., Leskelä, R., Pennanen, P., Laukka, E., & Jansson, M. M. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104692 · Cited by 81
Kreijkes, P., & Greatorex, J. (2024) · Review of Education · doi:10.1002/rev3.3465 · Cited by 73
COVID-19 Vaccine Hesitancy: Umbrella Review of Systematic Reviews and Meta-Analysis
Alrahbeni, T. M. A., Satapathy, P., Itumalla, R., Marzo, R. R., Al‐Mugheed, K., Khatib, M. N., Gaidhane, S., Zahiruddin, Q. S., Rabaan, A. A., AlRasheed, H. A., et al. (2024) · JMIR Public Health and Surveillance · doi:10.2196/54769 · Cited by 71
“The method for conducting this umbrella review was based on the framework set forth by the Joanna Briggs Institute [18].”
Oxidative stress biomarkers in pregnancy: a systematic review
Ibrahim, A., Khoo, M. I., Ismail, E. H. E., Hussain, N. H. N., Zin, A. A. M., Noordin, L., Abdullah, S., Mahdy, Z. A., & Lah, N. A. Z. N. (2024) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-024-01259-x · Cited by 76
Zhang, Y., Feijoo‐Garcia, M. A., Gu, Y., Popescu, V. S., Beneš, B., & Magana, A. J. (2024) · Information · doi:10.3390/info15090515 · Cited by 74
“An umbrella review is a review of meta-analyses and systematic reviews, meaning it only includes the highest degree of evidence [21].”
BackgroundAhmadov, T., Karimov, A., Durst, S., Saarela, M., Gerstlberger, W. D., Wahl, M. F., & Kärkkäinen, T. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2024.2414429 · Cited by 73
“This study employed a two-phase systematic literature review, as it ensures both breadth and depth in the exploration of the research area, offering a comprehensive understanding (Aromataris et al., 2015; Belbasis et al., 2022).”
Campbell, J. M., Stephenson, M., Bateman, E. H., Peters, M. D. J., Keefe, D. M. K., & Bowen, J. M. (2016) · The Pharmacogenomics Journal · doi:10.1038/tpj.2016.58 · Cited by 68
Farazi, M., Jayedi, A., & Shab‐Bidar, S. (2021) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2021.1943646 · Cited by 66
Vitamin C Intake and Cancers: An Umbrella Review
Chen, Z., Huang, Y. C., Cao, D., Qiu, S., Chen, B., Li, J., Bao, Y., Wei, Q., Han, P., & Liu, L. (2022) · Frontiers in Nutrition · doi:10.3389/fnut.2021.812394 · Cited by 242
“Umbrella Review Method We comprehensively searched and evaluated published evidence on the association between VC intake and multiple cancer outcomes from a large number of systematic reviews and metaanalyses (8, 9).”
MethodAnderson, M., van Kessel, R., Wood, E., Stokes, A., Fistein, J., Porter, I. H., Mossialos, E. A., & Valderas, J. M. (2024) · Quality of Life Research · doi:10.1007/s11136-024-03728-7 · Cited by 71
“Joanna Briggs Institute (JBI) guidelines for umbrella reviews were followed in the design and execution of the research, [23] and the PRISMA guidelines for reporting purposes [24].”
MethodA meta-review of qualitative research on adult cancer survivors: current strengths and evidence gaps
Laidsaar‐Powell, R., Konings, S., Rankin, N. M., Koczwara, B., Kemp, E., Mazariego, C. G., & Butow, P. N. (2019) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00803-8 · Cited by 66
Effects of fermented feed supplementation on pig growth performance: A meta-analysis
Xu, B., Li, Z., Wang, C., Fu, J., Zhang, Y., Wang, Y., & Lu, Z. (2019) · Animal Feed Science and Technology · doi:10.1016/j.anifeedsci.2019.114315 · Cited by 63
Exploring the intellectual cores of the blockchain–Internet of Things (BIoT)
Tsang, Y. P., Wu, C. H., Ip, W. H., & Shiau, W.-L. (2021) · Journal of Enterprise Information Management · doi:10.1108/jeim-10-2020-0395 · Cited by 60
de Keijzer, K. L., González, J. R., & Beato, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264375 · Cited by 65
“Umbrella reviews also allow for a greater analysis of bias in the literature which may implicitly affect the validity of the scientific evidence and misguide application [34].”
BackgroundMethodInfluentialAssessment of Industry 4.0 for Modern Manufacturing Ecosystem: A Systematic Survey of Surveys
Konstantinidis, F. K., Myrillas, N., Mouroutsos, S. G., Koulouriotis, D. E., & Gasteratos, A. C. (2022) · Machines · doi:10.3390/machines10090746 · Cited by 69
Ambient fine particulate matter and pregnancy outcomes: An umbrella review
Song, S., Gao, Z., Zhang, X., Zhao, X., Chang, H., Zhang, J., Yu, Z., Huang, C., & Zhang, H. (2023) · Environmental Research · doi:10.1016/j.envres.2023.116652 · Cited by 67
Learning About AI: A Systematic Review of Reviews on AI Literacy
Zhang, S., Ganapathy Prasad, P., & Schroeder, N. L. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251342081 · Cited by 62
“…of data such as context and dataset information, targeted participants, research focus, AI literacy de fi nition, age or developmental AI literacy de fi nition, implications for research and practice, future directions, and study quality (adapted from an existing metric, Aromataris et al., 2015).”
Gessler, M., & Siemer, C. (2020) · International Journal for Research in Vocational Education and Training · doi:10.13152/ijrvet.7.1.5 · Cited by 72
Darzi, A., Repp, A. B., Spencer, F. A., Morsi, R. Z., Charide, R., Etxeandia‐Ikobaltzeta, I., Bauer, K. A., Burnett, A., Cushman, M., Dentali, F., et al. (2020) · Blood Advances · doi:10.1182/bloodadvances.2020002482 · Cited by 62
“We did not perform a quantitative synthesis of the RAMs, as the main aim of an overview of reviews is to provide a summary of existing research synthesis and not resynthesizing evidence.(16) Results Figure 1 illustrates the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram.”
MethodBjørnarå, H. B., Westergren, T., Sejersted, E., Torstveit, M. K., Hansen, B. H., Berntsen, S., & Bere, E. T. (2021) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2021.101425 · Cited by 70
“The review was guided by Aromataris et al. (2015), and the JBI’s proposed methods (Aromataris et al., 2020), and adhere to the PRISMA reporting guidelines (Moher et al., 2009).”
BackgroundMethodInfluentialSciacchitano, S., Capalbo, C., Napoli, C., Anibaldi, P., Salvati, V., Vitis, C. D., Mancini, R., Coluzzi, F., & Rocco, M. (2022) · Frontiers in Endocrinology · doi:10.3389/fendo.2022.850328 · Cited by 64
A meta‐review of the impact of compression therapy on venous leg ulcer healing
Patton, D., Avşar, P., Sayeh, A., Budri, A., O’Connor, T., Walsh, S., Nugent, L., Harkin, D. W., O'Brien, N., Cayce, J. M., et al. (2022) · International Wound Journal · doi:10.1111/iwj.13891 · Cited by 62
“Meta-reviews aggregate the summarised results of systematic reviews and help to inform policy and practice decision-making.(12) Similar to systematic reviews, metareviews include selecting systematic reviews, quality appraisal of the reviews, providing results, giving an overview of results for practice, and research-…”
BackgroundMicrobiology and postmortem interval: a systematic review
Moitas, B., Caldas, I. M., & Sampaio‐Maia, B. (2023) · Forensic Science Medicine and Pathology · doi:10.1007/s12024-023-00733-z · Cited by 62
“The risk of bias was analyzed using the Joanna Briggs Institute protocol [19].”
MethodNichol, B., McCready, J. L., Erfani, G., Comparcini, D., Simonetti, V., Cicolini, G., Mikkonen, K., Yamakawa, M., & Tomietto, M. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104730 · Cited by 87
Mjaess, G., Chebel, R., Karam, A., Moussa, I., Prétot, D., Tayeh, G. A., Sarkis, J., Semaan, A., Peltier, A., Aoun, F. Y., et al. (2021) · Acta Oncologica · doi:10.1080/0284186x.2021.1886323 · Cited by 62
“Systematic review of existing reviews, also known as ‘umbrella review’, is currently being used to compile, compare and contrast published reviews and to consider an overall assessment of the highest levels of evidence for a given subject [12].”
MethodThe New Frontier of Esports and Gaming: A Scoping Meta-Review of Health Impacts and Research Agenda
Kelly, S. J., & Leung, J. (2021) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2021.640362 · Cited by 66
“Reviews were selected to synthesize the highest levels of evidence in the field (Aromataris et al., 2015) in order to facilitate an assessment of the quality of the evidence base and a summary and comparison of the reviews’ findings (Smith et al.”
MethodBeyond effective approaches: A rapid review response to designing professional learning
Cirkony, C., Rickinson, M., Walsh, L., Gleeson, J., Salisbury, M., Cutler, B., Berry, A. K., & Smith, K. (2021) · Professional Development in Education · doi:10.1080/19415257.2021.1973075 · Cited by 66
“For quality assessment, we used the Joanna Briggs Institute Critical Appraisal Tool for systematic reviews, based on it being an accessible tool with well-established validity and reliability for evaluating systematic reviews that used a variety of methods (Aromataris et al .”
MethodUltrasound Imaging for the Diagnosis and Evaluation of Sarcopenia: An Umbrella Review
Wang, J., Wu, W., Chang, K. C., Chen, L.-R., Chi, S.-Y., Kara, M., & Özçakar, L. (2021) · Life · doi:10.3390/life12010009 · Cited by 68
“An umbrella review incorporates data from systematic reviews and meta-analyses, providing the highest level of evidence for clinical practice [27].”
MethodCentredness in health care: A systematic overview of reviews
Feldthusen, C., Forsgren, E., Wallström, S., Andersson, V., Löfqvist, N., Sawatzky, R. G., Öhlén, J., & Ung, E. J. (2022) · Health Expectations · doi:10.1111/hex.13461 · Cited by 61
“2 | MATERIALS AND METHODS We decided to undertake a systematic overview of reviews of the field of centredness in health care, which entails synthesizing evidence from a collection of reviews.(15,16) Due to a large number of systematic reviews, we limited our overview to a 2‐year period.”
MethodAn Umbrella Review of Body Image Concerns, Disordered Eating, and Eating Disorders in Elite Athletes
Fatt, S. J., George, E. S., Hay, P., JEACOCKE, N. A., Gotkiewicz, E., & Mitchison, D. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13144171 · Cited by 70
“Accordingly, an umbrella review (also called a review of reviews) can provide a rigorous summary of evidence for a specific research question by synthesising consistencies and contradictions across relevant systematic reviews and meta-analyses [24].”
BackgroundMethodBell, L., Gardner, C., Tian, E. J., Cochet-Broch, M. O., Poelman, A. A. M., Cox, D. N., Nicklaus, S., Matvienko‐Sikar, K., Daniels, L., Kumar, S., et al. (2020) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqaa384 · Cited by 64
“In addition, factors that may also influence children’s vegetable liking, such as child sensory sensitivities and child temperament, were out of the scope of this review due to our focus on modifiable factors at the group level, with outcomes and subsequent messages relevant to public health policies and guidelines (5…”
BackgroundMethodInfluentialAbate, B. B., Sendekie, A. K., Tadesse, A. W., Engdaw, T., Mengesha, A., Zemariam, A. B., Alamaw, A. W., Abebe, G., & Azmeraw, M. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1391312 · Cited by 60
“This umbrella review systematically synthesized eligible systematic review and meta-analysis (SRM) reports following established umbrella review methodology (19).”
MethodMarano, L., Fusario, D., Savelli, V., Marrelli, D., & Roviello, F. (2021) · Updates in Surgery · doi:10.1007/s13304-021-01059-7 · Cited by 60
Firouzabadi, F. D., Shab‐Bidar, S., & Jayedi, A. (2022) · Pharmacological Research · doi:10.1016/j.phrs.2022.106100 · Cited by 67
The built environment and cardiovascular disease: an umbrella review and meta-meta-analysis
Liu, M., Meijer, P., Lam, T. M., Timmermans, E. J., Grobbee, D. E., Beulens, J. W. J., Vaartjes, I. C. H., & Lakerveld, J. (2023) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwad241 · Cited by 64
Acne and the cutaneous microbiome: A systematic review of mechanisms and implications for treatments
Podwójniak, A., Tan, I. J., Sauer, J., Neubauer, Z. J. K., Rothenberg, H., Ghani, H., Parikh, A. K., & COHEN, B. A. (2024) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.20332 · Cited by 73
Nagendrababu, V., Duncan, H. F., Whitworth, J. M., Nekoofar, M. H., Pulikkotil, S. J., Veettil, S. K., & Dummer, P. M. H. (2019) · International Endodontic Journal · doi:10.1111/iej.13215 · Cited by 60
Pang, C., & Humphris, G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.640866 · Cited by 59
“Quality Assessment The Joanna Briggs Institute (JBI) critical appraisal checklist for analytical cross-sectional studies was modified and applied to the cross-sectional, longitudinal, and RCT studies included in the present review (Aromataris et al., 2015; Lim and Humphris, 2020).”
MethodMarkozannes, G., Aretouli, E., Rintou, E., Dragioti, E., Damigos, D., Ntzani, E., Evangelou, E., & Tsilidis, K. K. (2017) · BMC Psychology · doi:10.1186/s40359-017-0200-5 · Cited by 57
“Our study was conducted in accordance with guidelines for conducting and reporting umbrella reviews [21, 22].”
MethodMusic is an effective intervention for the management of pain: An umbrella review
Saavedra, J. S. M., Vergara-Méndez, L. D., & Talero‐Gutiérrez, C. (2018) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2018.06.003 · Cited by 64
Injury prevention of hamstring injuries through exercise interventions
González, J. R., Castillo, D., & Clemente, F. M. (2021) · The Journal of Sports Medicine and Physical Fitness · doi:10.23736/s0022-4707.21.11670-6 · Cited by 61
Wolff, A. C., Dresselhuis, A., Hejazi, S., Dixon, D., Gibson, D., Howard, A. F., Liva, S., Astle, B., Kirkham, S. R., Noonan, V. K., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01725-2 · Cited by 63
“Systematic review JBI Systematic Review Appraisal Tool [36]”
MethodLi, C., Islam, N., Gutiérrez, J. P., Barreto, S. E. G., Prado, A. C., Moolenaar, R. L., Lacey, B., & Richter, P. (2023) · BMJ Global Health · doi:10.1136/bmjgh-2023-012581 · Cited by 71
“While mechanisms for the increased risk of COVID-19 mortality in individuals with diabetes, hypertension and obesity remain elusive, findings provide further motivation to support research on the underlying pathophysiology.”
BackgroundBroadhurst, D., Cooke, M. L., Sriram, D., & Gray, B. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237572 · Cited by 68
Cancer and occupational exposure to pesticides: an umbrella review
Burns, C. J., & Juberg, D. R. (2021) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-020-01638-y · Cited by 59
The role of religion and spirituality in cancer care: An umbrella review of the literature
Kelly, E. P., Paredes, A. Z., Tsilimigras, D. I., Hyer, J. M., & Pawlik, T. M. (2020) · Surgical Oncology · doi:10.1016/j.suronc.2020.05.004 · Cited by 66
Pyrgidis, N., Mykoniatis, I., Haidich, A., Tirta, M., Talimtzi, P., Kalyvianakis, D., Ouranidis, A., & Hatzichristou, D. G. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.735708 · Cited by 67
Sandoval-Ramírez, B. A., Catalán, Ú., Llauradó, E., Valls, R. M., Salamanca-Gonzalez, P., Rubió, L., Yuste, S., & Solà, R. (2021) · Nutrition Reviews · doi:10.1093/nutrit/nuab086 · Cited by 63
Health Effects of Electronic Cigarettes: An Umbrella Review and Methodological Considerations
Travis, N., Knoll, M., Cadham, C. J., Cook, S., Warner, K. E., Fleischer, N. L., Douglas, C. E., Sánchez‐Romero, L. M., Mistry, R., Meza, R., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159054 · Cited by 62
“The peer-reviewed umbrella review protocol was developed a priori in adherence with the guidelines for umbrella reviews [9] and registered with PROSPERO (Registration Number: CRD42021237878).”
MethodYang, J., Lin, L., Gao, Y., Wang, W., & Yuan, L. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.973012 · Cited by 62
Fazel, S., Burghart, M., Wolf, A., Whiting, D., & Yu, R. (2023) · Trauma Violence & Abuse · doi:10.1177/15248380231195880 · Cited by 63
“An umbrella review is a synthesis of existing systematic reviews and allows the findings of reviews to be compared and contrasted, allowing for a more comprehensive analysis of the current evidence than any individual review on a specific topic (Aromataris et al., 2015).”
BackgroundKinshella, M.-L., Omar, S., Scherbinsky, K., Vidler, M., Magee, L., von Dadelszen, P., Moore, S., Elango, R., & The PRECISE Conceptual Framework Working Group (2021) · Nutrients · doi:10.3390/nu13020472 · Cited by 49
Chambergo‐Michilot, D., Diaz-Barrera, M. E., & Benites-Zapata, V. A. (2021) · Revista Peruana de Medicina Experimental y Salud Pública · doi:10.17843/rpmesp.2021.381.6501 · Cited by 82
“Esta superposición de estudios, dependiendo de sus resultados, podría sobreestimar o infraestimar los resultados (17).”
BackgroundColeman, P. C., Hanson, P., van Rens, T., & Oyebode, O. O. (2022) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2022.101717 · Cited by 68
“complex topics, is that they only consider for inclusion the highest level of academic evidence, namely other systematic reviews and meta-analyses (Aromataris et al., 2015).”
BackgroundImpact of Rehabilitation on Fatigue in Post-COVID-19 Patients: A Systematic Review and Meta-Analysis
Alessandro de, S. I. R. E., Moggio, L., Marotta, N., Agostini, F., Tasselli, A., Ferrante, V. D., Curci, C., Calafiore, D., Ferraro, F., Bernetti, A., et al. (2022) · Applied Sciences · doi:10.3390/app12178593 · Cited by 57
Hill, E. R., O’Connor, L. E., Wang, Y., Clark, C. M., McGowan, B. S., Forman, M. R., & Campbell, W. W. (2022) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2022.2123778 · Cited by 59
“The objective of this umbrella (Aromataris et al. 2015) systematic review is to apply the Bradford Hill Causality Criteria (Hill 1965) to infer the potential for causal relations between intakes of red and processed meat and CVD or T2DM using systematic reviews and meta-analyses of both…”
MethodHealthcare resilience: a meta-narrative systematic review and synthesis of reviews
Tan, M. Z. Y., Prager, G., Mcclelland, A., & Dark, P. M. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-072136 · Cited by 67
“Using an inductive approach, three-tiered coding of the text was conducted around the three foci of definition, measures and concepts 33 (online supplemental appendix 1).”
Zhang, Y., Koene, M., Chen, C., Wagenaar, C., & Reijneveld, S. A. (2024) · Preventive Medicine · doi:10.1016/j.ypmed.2024.107856 · Cited by 63
Effect of Statin on Cancer Incidence: An Umbrella Systematic Review and Meta-Analysis
Jeong, G. H., Lee, K. H., Kim, J. Y., Eisenhut, M., Kronbichler, A., van der Vliet, H. J., Hong, S. H., Shin, J. I., & Gamerith, G. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8060819 · Cited by 58
“reported that the types of studies should be matched in systematic reviews, and meta-analyses to be considered for its primary objective [75].”
Sánchez-Gálvez, J., Martínez-Isasi, S., Gómez-Salgado, J., Rumbo-Prieto, J. M., Sobrido-Prieto, M., Sánchez-Hernández, M., García-Martínez, M., & Fernández-García, D. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1331753 · Cited by 57
Guo, N., Zhu, Y., Tian, D., Zhao, Y., Zhang, C., Mu, C., Han, C., Zhu, R., & Liu, X. (2022) · BMC Medicine · doi:10.1186/s12916-022-02381-6 · Cited by 60
“An umbrella review, providing a systematic calculation and appraisal of meta-analyses, has been widely applied to evaluate the association between modifiable factors and disease susceptibility including dementia [5], multiple sclerosis [6], and various cancers [7, 8], thereby improving the accuracy and strength of res…”
BackgroundTravica, N., Lotfaliany, M., Marriott, A., Safavynia, S. A., Lane, M. M., Gray, L. J., Veronese, N., Berk, M., Skvarc, D., Aslam, H., et al. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12041610 · Cited by 59
“Moreover, such an umbrella review allows the findings of previous meta-analyses to be comprehensively compared and contrasted [24].”
BackgroundBai, X.-L., Li, Y., Feng, Z.-F., Cao, F., Wang, D.-D., Ma, J., Yang, D., Li, D.-R., Fang, Q., Wang, Y., et al. (2025) · British Journal of Sports Medicine · doi:10.1136/bjsports-2024-109392 · Cited by 60
Buljac‐Samardžić, M., Doorn, C. M. D.-V., & Maynard, M. T. (2021) · Journal of Patient Safety · doi:10.1097/pts.0000000000000816 · Cited by 65
Lim, E., & Humphris, G. (2020) · Cancer Reports · doi:10.1002/cnr2.1235 · Cited by 47
“A modified version of the Joanna Briggs quality assessment tool for analytical cross-sectional studies was applied to the cross-sectional, longitudinal, validation, and RCT studies used in this meta-analysis.(27,28) The 6-item tool was manually applied to all 31 studies included in this review.”
MethodCacciamani, G. E., Sholklapper, T. N., Dell’Oglio, P., Rocco, B. M. C., Annino, F., Antonelli, A., Amenta, M., Borghesi, M., Bove, P., Bozzini, G., et al. (2022) · European Urology Focus · doi:10.1016/j.euf.2022.01.018 · Cited by 58
Chmielowska, M., Zisman‐Ilani, Y., Saunders, R., & Pilling, S. (2023) · International Journal of Social Psychiatry · doi:10.1177/00207640221140291 · Cited by 57
“Systematic and scoping review articles were included if they were published between 2010 and 2021 (Aromataris et al., 2015) and consisted of studies in which interventions were carried out by a wide range of healthcare professionals (e.g. psychiatrists, general practitioners, psychologists, nurses,…”
BackgroundMethodInfluentialFear of cancer recurrence and mental health: A comprehensive meta‐analysis
Podina, I. R., Todea, D., & Fodor, L. A. (2023) · Psycho-Oncology · doi:10.1002/pon.6205 · Cited by 57
Impact of Microplastics on Pregnancy and Fetal Development: A Systematic Review
Sharma, R. K., Kumari, U., & Kumar, S. (2024) · Cureus · doi:10.7759/cureus.60712 · Cited by 81
“The quality of all selected studies was assessed using the Joanna Briggs Institute's (JBI) Critical Appraisal Checklists for Studies [24].”
MethodHansen, T., Nes, R. B., Hynek, K. A., Nilsen, T. S., Reneflot, A., Stene‐Larsen, K., Tornes, R. A., & Bidonde, J. (2024) · BMC Public Health · doi:10.1186/s12889-024-19396-8 · Cited by 63
“In addition to the detailed findings, we provide tables with overall conclusions from the findings of the SRs using the “stop-light model” suggested by Aromataris et al. [48].”
MethodLiu, X., Peveri, G., Bosetti, C., Bagnardi, V., Specchia, C., Gallus, S., & Lugo, A. (2019) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2019.07.019 · Cited by 54
Cardiovascular Toxicity of Targeted Therapies for Cancer: An Overview of Systematic Reviews
van Leeuwen, M. T., Luu, S., Gurney, H., Brown, M. R., Pearson, S., Webber, K., Hunt, L., Hong, S., Delaney, G. P., & Vajdic, C. M. (2020) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkaa076 · Cited by 57
“Overviews of systematic reviews (also called umbrella reviews) collate information from multiple systematic reviews to provide a comprehensive synthesis of evidence (4,5).”
BackgroundMethodInfluentialLi, W., Huang, Z., Tan, B., Chen, G., Li, X., Xiong, K., Zhu, R., Li, R., Li, S., Ye, H., et al. (2021) · Journal of Orthopaedic Translation · doi:10.1016/j.jot.2021.09.005 · Cited by 54
“The quality of all selected studies was assessed using the Joanna Briggs Institute Critical Appraisal Checklist [12] (JBI CAC).”
An umbrella review of effectiveness and efficacy trials for app-based health interventions
Chong, S. O., Pedron, S., Abdelmalak, N., Laxy, M., & Stephan, A.-J. (2023) · npj Digit. Medicine · doi:10.1038/s41746-023-00981-x · Cited by 41
“For protocol development, we consulted guidance documents 78 including those published by Cochrane 71 and JBI 80 .”
Method
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.