Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 501–600 of 1,014
Thyroid sequelae of COVID-19: a systematic review of reviews
Trimboli, P., Camponovo, C., Scappaticcio, L., Bellastella, G., Piccardo, A., & Rotondi, M. (2021) · Reviews in Endocrine and Metabolic Disorders · doi:10.1007/s11154-021-09653-1 · Cited by 49
Martín-Delgado, J., Guilabert, M., & Mira, J. J. (2021) · Patient · doi:10.1007/s40271-021-00526-y · Cited by 49
“The Joanna Briggs Institute [15] protocol has been followed, and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses—Extension for Scoping Reviews (PRISMA-ScR) checklist was used [16].”
MethodA Review of Entrustable Professional Activities in Pharmacy Education
Abeyaratne, C., & Galbraith, K. J. (2021) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe8872 · Cited by 48
Impact of Exercise Training Interventions on Flow-Mediated Dilation in Adults: An Umbrella Review
Shivgulam, M. E., Liu, H., Schwartz, B. D., Langley, J. E., Bray, N. W., Kimmerly, D. S., & O’Brien, M. W. (2023) · Sports Medicine · doi:10.1007/s40279-023-01837-w · Cited by 42
Strnadová, I., Danker, J., Dowse, L., & Tso, M. (2023) · International Journal of Inclusive Education · doi:10.1080/13603116.2023.2221239 · Cited by 49
“…include clear research questions, detailed inclusion criteria, a structured search process to identify and select reviews, a critical appraisal method of the included reviews, a data extraction tool, and a summary and presentation of the fi ndings (Aromataris et al. 2015; Kelly and Gri ffi th 2020).”
InfluentialScarlett, H., Moirangthem, S., & van der Waerden, J. E. B. (2023) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-023-02261-1 · Cited by 45
“To summarise and present the main findings for the relationship between PMI and CD, results were first analysed using a narrative synthesis conducted in accordance with the Cochrane guidance for narrative syntheses [37] and Joanna Briggs’ guidelines [38].”
Puljak, L., Bała, M. M., Mathes, T., Peričić, T. P., Wegewitz, U. E., Faggion, C. M., Matthias, K., Storman, D., Zając, J., Rombey, T., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.08.021 · Cited by 42
Valenzuela, P. L., Brunner, R., Castillo‐García, A., Friesenbichler, B., Casartelli, N. C., Morales, J. S., Maffiuletti, N. A., Bizzini, M., & Niedermann, K. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101354 · Cited by 42
Iqbal, S., & Ali, I. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07540 · Cited by 45
Empowerment for people living with dementia: An integrative literature review
van Corven, C. T. M., Bielderman, A., Wijnen, M., Leontjevas, R., Lucassen, P. L., Graff, M. J. L., & Gerritsen, D. L. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104098 · Cited by 42
Dada, S., Tunçalp, Ö., Portela, A. G., Barreix, M., & Gilmore, B. (2021) · Journal of Global Health · doi:10.7189/jogh.11.04076 · Cited by 44
van Niekerk, M., Walker, J., Hobbs, H., Magill, N., Toynbee, M., Steward, B., Harriss, E., & Sharpe, M. (2022) · Journal of the Academy of Consultation-Liaison Psychiatry · doi:10.1016/j.jaclp.2022.04.004 · Cited by 35
“9,10 As a systematic review of systematic reviews, an umbrella review represents one of the highest levels of evidence synthesis available.”
BackgroundSchool-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review
Samad, N., Bearne, L., Noor, F. M., Akter, F., & Parmar, D. (2024) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-024-01668-6 · Cited by 41
“This tool does not mention cut-off points for categorising the quality of systematic reviews [21], hence, we applied these cut-off points: high quality ( ≥ 8 “Yes”), moderate quality (5–7 “Yes”), and low quality ( ≤ 4 “Yes”) (Supplementary file 4).”
MethodBarriers and Facilitators to Participation in Health Screening: an Umbrella Review Across Conditions
Bonniec, A. L., Sun, S., Andrin, A., Dima, A. L., & Letrilliart, L. (2022) · Prevention Science · doi:10.1007/s11121-022-01388-y · Cited by 43
The Experiences of Motherhood in Female Surgeons: A Scoping Review
Mavedatnia, D., Ardestani, S. K., Zahabi, S., Neocleous, P., Madou, E., Dzioba, A., Strychowsky, J. E., & Graham, M. E. (2022) · Annals of Surgery · doi:10.1097/sla.0000000000005730 · Cited by 41
Prostate Cancer Early Detection in the European Union and UK
Leenen, R. C. A., Venderbos, L. D. F., Helleman, J., Rivas, J. G., Vynckier, P., Annemans, L., Chloupková, R., Májek, O., Briers, E., Vasilyeva, V., et al. (2024) · European Urology · doi:10.1016/j.eururo.2024.07.019 · Cited by 44
Das, H., Janakiram, C., Kumar, V., & Karuveettil, V. (2025) · Evidence-Based Dentistry · doi:10.1038/s41432-024-01101-8 · Cited by 52
Han, J., Ren, Y., Zhang, P., Fang, C., Yang, L., Zhou, S., & Ji, Z. (2025) · BMC Gastroenterology · doi:10.1186/s12876-025-03788-0 · Cited by 43
“This meta-analysis and systematic review followed the JBI Manual for Evidence Synthesis guidelines for comprehensive reporting and analysis [23].”
Mannocci, A., Saulle, R., Villari, P., & Torre, G. L. (2018) · Journal of Public Health · doi:10.1007/s10389-018-0932-6 · Cited by 41
Tewari, N., Goel, S., Mathur, V. P., O’Connell, A. C., Johnson, R. M., Rahul, M., Sultan, F., Goswami, M., Srivastav, S., & Ritwik, P. (2022) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12963 · Cited by 46
Zhu, P., Chen, C., Liu, X., Gu, W., & Shang, X. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-022-07032-3 · Cited by 42
Sadoyu, S., Tanni, K. A., Punrum, N., Paengtrai, S., Kategaew, W., Promchit, N., Lai, N. M., Thakkinstian, A., Ngorsuraches, S., Bangpan, M., et al. (2022) · PLOS ONE · doi:10.1371/journal.pone.0269009 · Cited by 40
“—a methodology working group formed by the JBI (formerly named the URs Working Group)—published the guidance on how to conduct and report an UR [6], the methodology for the certainty assessment was not provided.”
BackgroundMethodInfluentialEffects of Exercise and Physical Activity Levels on Childhood Cancer: An Umbrella Review
Rapti, C., Dinas, P. C., Chryssanthopοulos, C., Mila, A., & Philippou, Α. (2023) · Healthcare · doi:10.3390/healthcare11060820 · Cited by 46
“Such an umbrella review would offer a rapid review of the available evidence, compare results of systematic reviews, demonstrate consistency or contradiction of findings, but also provide both quantitative and qualitative types of evidence [12].”
BackgroundThe gut microbiome dysbiosis and regulation by fecal microbiota transplantation: umbrella review
Zhang, X., Luo, X., Liang, T. G., Yue, P., Li, M., Liu, K., Zhu, D., Huang, C., Shi, Q., Yang, L., et al. (2023) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1286429 · Cited by 45
Psychosocial factors associated with quality of life in cancer survivors: umbrella review
Voskanyan, V., Marzorati, C., Sala, D., Grasso, R., Pietrobon, R. S., van der Heide, I., Engelaar, M., Bos, N., Caraceni, A. T., Couespel, N., et al. (2024) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-024-05749-8 · Cited by 45
Understanding the Relationships Between Physical Activity and Climate Change: An Umbrella Review
Silva, M. F., Leão, A. L. F., O’Connor, Á., Hallal, P. C., Ding, D., Hinckson, E. A., Benmarhnia, T., & Reis, R. S. (2024) · Journal of Physical Activity and Health · doi:10.1123/jpah.2024-0284 · Cited by 40
Risk Factors for Falls in Community-Dwelling Older Adults: An Umbrella Review
Saunders, S., D’Amore, C., Hao, Q., El-Moneim, N. A., Richardson, J. A., Kuspinar, A., & Beauchamp, M. (2025) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2025.105765 · Cited by 44
Cultural competency education for healthcare professionals: an umbrella review
Lee, Y., Sung, S., & Fan, X. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08008-7 · Cited by 45
Chu, K.-Y., Huang, C., & Ouyang, W. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1611-4 · Cited by 42
Ciapponi, A. (2018) · Evidencia actualizacion en la práctica ambulatoria · doi:10.51987/evidencia.v21i1.6834 · Cited by 68
Sun, H. J., Gong, T., Xia, Y., Wen, Z.-Y., Zhao, L., Zhao, Y., & Wu, Q. (2020) · Clinical Nutrition · doi:10.1016/j.clnu.2020.11.032 · Cited by 45
Acceptability of Computerized Cognitive Behavioral Therapy for Adults: Umbrella Review
Treanor, C., Kouvonen, A. M., Lallukka, T. M., & Donnelly, M. (2021) · JMIR Mental Health · doi:10.2196/23091 · Cited by 44
Travis, N., Knoll, M., Cook, S., Oh, H., Cadham, C. J., Sánchez‐Romero, L. M., & Levy, D. T. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20031908 · Cited by 50
“Methods Our review protocol was developed a priori in adherence with the guidelines for umbrella reviews [10], and registered with PROSPERO (Registration Number: CRD42021237878).”
MethodGlobal COVID-19 vaccine acceptance level and its determinants: an umbrella review
Abate, B. B., Tilahun, B. D., & Yayeh, B. M. (2024) · BMC Public Health · doi:10.1186/s12889-023-17497-4 · Cited by 43
“This umbrella review was done following the methodology of umbrella review of existing Systematic Review and Meta-analysis (SRM) studies [25].”
MethodTherapeutic benefits of glutamine: An umbrella review of meta-analyses
McRae, M. P. (2017) · Biomedical Reports · doi:10.3892/br.2017.885 · Cited by 39
Grabovac, I., Veronese, N., Štefanac, S., Haider, S., Jackson, S. E., Koyanagi, A., Meilinger, M., Stubbs, B., Firth, J., Soysal, P., et al. (2019) · Clinical Infectious Diseases · doi:10.1093/cid/ciz539 · Cited by 39
“An umbrella review was carried out following standardized procedures [11, 12].”
MethodAn overview of systematic reviews on predictors of smoking cessation among young people
Kundu, A., Sultana, N., Felsky, D., Moraes, T. J., Selby, P. L., & Chaiton, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299728 · Cited by 41
Ye, A., Maiti, A., Schmidt, M. W., & Pedersen, S. (2024) · Future Internet · doi:10.3390/fi16050167 · Cited by 45
Dementia in Eastern Mediterranean countries: A systematic review
Yaghmour, S. M., Bartlett, R. L., & Brannelly, T. (2018) · Dementia · doi:10.1177/1471301217753776 · Cited by 39
“Twenty-seven studies were assessed to be of ‘good quality’, and six were ‘average’ (Aromataris et al., 2015; CASP, 2017a, 2017b, 2017c; JBI, 2016; Lockwood, Munn, & Porritt 2015; Pluye et al., 2011).”
BackgroundLovett, A., Kwon, H. R., Kidia, K. K., Machando, D., Crooks, M., Fricchione, G. L., Thornicroft, G., & Jack, H. E. (2019) · International Journal of Mental Health Systems · doi:10.1186/s13033-019-0273-z · Cited by 47
Unhapipatpong, C., Shantavasinkul, P. C., Kasemsup, V., Siriyotha, S., Warodomwichit, D., Maneesuwannarat, S., Vathesatogkit, P., Sritara, P., & Thakkinstian, A. (2021) · Nutrients · doi:10.3390/nu13051549 · Cited by 42
“We conducted a review of multiple systematic reviews (SR) and meta-analyses (MAs) in compliance with standardized procedures [10,11].”
MethodMedication Errors in Intensive Care Units: An Umbrella Review of Control Measures
Dionisi, S., Giannetta, N., Liquori, G., Leo, A. D., D’Inzeo, V., Orsi, G. B., Muzio, M. D., Napoli, C., & Simone, E. D. (2022) · Healthcare · doi:10.3390/healthcare10071221 · Cited by 45
“For each systematic review included, the quality of the methodology was assessed autonomously and independently by two reviewers using the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [23,24].”
BackgroundMethodInfluentialIncidence of cardiac complications following COVID-19 infection: An umbrella meta-analysis study
Jafari‐Oori, M., Moradian, S. T., Ebadi, A., Jafari, M., & Dehi, M. (2022) · Heart & Lung · doi:10.1016/j.hrtlng.2022.01.001 · Cited by 42
“32 However, as the number of individual review studies increases, clinical practitioners may find it difficult to keep track of information.(33) Additionally, different incidence rates were reported for each cardiac complication in every individual review study.”
Chen, M., Schievano, A., Bosco, S., Montero‐Castaño, A., Tamburini, G., Pérez‐Soba, M., & Makowski, D. (2023) · Environmental Research Letters · doi:10.1088/1748-9326/acb833 · Cited by 38
“Decrease of air pollutant emissions Aridity [14]; Crop type [24, 25]; Baseline emission [14]; EEFs product [14, 18, 19, 25]; N fertiliser rate [22, 25]; Soil N content [25]; Soil organic carbon content [25]; Soil pH [14, 25]; Soil texture [14]; Soil type [19]; Type of land use [14, 19]; Type of fertiliser [14, 19]; De…”
Mason‐Jones, A. J., Freeman, M., Lorenc, T., Rawal, T., Bassi, S., & Arora, M. (2023) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2023.05.035 · Cited by 48
“The overview of systematic reviews can provide insight that is missing from individual reviews to help provide decision makers and researchers with a clearer understanding of the topic [14].”
BackgroundDevkota, R., Cummings, G. G., Hunter, K. F., Maxwell, C. J., Shrestha, S., Dennett, L., & Hoben, M. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02346-7 · Cited by 44
“…for systematic reviews and research synthesis for systematic reviews, meta-analysis, scoping reviews, integrative reviews, and narrative reviews [77], (b) the Quality Assessment Tool for Quantitative Studies (QATQS) for randomized controlled trial (RCT), controlled trial (CT), pre-post [78,…”
Brubacher, L. J., Peach, L., Chen, T. T.-W., Longboat, S., Dodd, W., Elliott, S. J., Patterson, K., & Neufeld, H. T. (2024) · PLOS Global Public Health · doi:10.1371/journal.pgph.0002995 · Cited by 40
“Given the broad conceptual scope, as well as the expansive literatures at the climate-health nexus, a systematic umbrella review (’review of reviews’) was chosen as the appropriate knowledge synthesis methodology [17,18].”
BackgroundMethodOkesanya, O. J., Ahmed, M. M., Ogaya, J. B., Amisu, B. O., Ukoaka, B. M., Adigun, O. A., Manirambona, E., Adebusuyi, O., Othman, Z. K., Oluwakemi, O. G., et al. (2025) · Tropical Medicine and Health · doi:10.1186/s41182-025-00728-2 · Cited by 38
Trotta, A., Gallucci, C., Rania, F., Strano, E., & Tipaldi, R. (2025) · Research in International Business and Finance · doi:10.1016/j.ribaf.2025.103188 · Cited by 45
Baron, R., Taye, M., der Vaart, I. B.-V., Ujčič-Voortman, J. K., Szajewska, H., Seidell, J. C., & Verhoeff, A. P. (2019) · Journal of Developmental Origins of Health and Disease · doi:10.1017/s2040174419000722 · Cited by 40
Impact of regionalisation and case-volume on neonatal and perinatal mortality: an umbrella review
Walther, F., Küster, D., Bieber, A., Rüdiger, M., Malzahn, J., Schmitt, J. M., & Deckert, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037135 · Cited by 38
Özdoğar, A. T., & Kalron, A. (2021) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2021.103275 · Cited by 38
Bayih, W. A., Birhane, B. M., Belay, D. M., Ayalew, M. Y., Yitbarek, G. Y., Workie, H. M., Tassew, M. A., Kebede, S. D., Alemu, A. Y., Gedefaw, G. A., et al. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e08128 · Cited by 38
Xu, K., Peng, R., Zou, Y., Jiang, X., Sun, Q., & Song, C. (2022) · International Journal of Food Sciences and Nutrition · doi:10.1080/09637486.2022.2048359 · Cited by 40
Klein, P., Fairweather‐Schmidt, A. K., & Lawn, S. (2022) · Systematic Reviews · doi:10.1186/s13643-022-01960-1 · Cited by 41
“to appraise the methodological rigor of the systematic review paper that was included in this present integrative review [52, 53].”
BackgroundLenart‐Bugla, M., Łuc, M., Pawłowski, M., Szcześniak, D. M., Seifert, I., Wiegelmann, H., Gerhardus, A., Wolf‐Ostermann, K., Rouwette, E. A. J. A., Ikram, M. A., et al. (2022) · Brain Sciences · doi:10.3390/brainsci12091214 · Cited by 41
“Critical appraisal of the methodological quality of SRs and MAs is required when conducting a systematic review of reviews [25].”
BackgroundSalmonellosis outbreak archive in China: data collection and assembly
Wang, Z., Huang, C., Liu, Y., Chen, J., Yin, R., Jia, C., Kang, X., Zhou, X., Liao, S., Jin, X., et al. (2024) · Scientific Data · doi:10.1038/s41597-024-03085-7 · Cited by 39
“The quality assessment and risk of bias of included outbreak studies were evaluated using the Joanna Briggs Institute checklist for reporting prevalence data, with appropriate modifications 31 .”
MethodComputer-aided anatomy recognition in intrathoracic and -abdominal surgery: a systematic review
den Boer, R. B., de Jongh, C., Huijbers, W. T. E., Jaspers, T. J. M., Pluim, J. P. W., van Hillegersberg, R., van Eijnatten, M. A. J. M., & Ruurda, J. P. H. (2022) · Surgical Endoscopy · doi:10.1007/s00464-022-09421-5 · Cited by 37
“The methodological quality was assessed by the Joanna Briggs Institute (JBI) critical appraisal checklist, modified for machine learning research [15].”
MethodLeonard, H., Montgomery, A. K., Wolff, B., Strumpher, E., Masi, A., Woolfenden, S. R., Williams, K. J., Eapen, V., Finlay‐jones, A. L., Whitehouse, A., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.926681 · Cited by 43
Déry, J., Ouellet, B., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02284-4 · Cited by 40
Risio, L. D., Pettorruso, M., Collevecchio, R., Collacchi, B., Boffa, M., Santorelli, M., Clerici, M., Martinotti, G., Zoratto, F., & Borgi, M. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.10.112 · Cited by 42
Jaber, M. A., Hassan, M., Ingafou, M., & El-Ameen, A. M. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13010267 · Cited by 37
“Studies that met the inclusion criteria were assessed using The Joanna Briggs Institute Critical Appraisal tools for JBI Systematic Reviews [32].”
MethodMazumder, H., Rimu, F. H., Shimul, M. M. H., Das, J., Gain, E. P., Liaw, W. R., & Hossain, M. M. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.169792 · Cited by 39
Fuentes-Aspe, R., Gutiérrez-Arias, R. E., González-Seguel, F., Marzuca-Nassr, G. N., Torres‐Castro, R., Najum, J., & Serón, P. (2024) · Journal of Intensive Care · doi:10.1186/s40560-024-00744-0 · Cited by 38
“Guidelines set forth by the JBI Collaboration [12, 13] and the PRIOR statement [14] were followed.”
MethodMiranda, A. R., Barral, P. E., Scotta, A. V., Cortez, M. V., & Soria, E. A. (2025) · Global Epidemiology · doi:10.1016/j.gloepi.2025.100192 · Cited by 46
“This overview of reviews was conducted in accordance with the PRIOR (Preferred Reporting Items for Overviews of Reviews) guidelines (Supplementary Materials 1) and the recommendations of the Joanna Briggs Institute (JBI) Umbrella Review Methodology Working Group [22,23].”
Breast cancer characteristics in low- and middle-income countries: An umbrella review
Tolentino-Rodriguez, L., Chkeir, M., Pofagi, V., Konga, I. A., Toniolo, J., Erazo, D., Preux, P., Blanquet, V., Vergonjeanne, M., & Parenté, A. (2025) · Cancer Epidemiology · doi:10.1016/j.canep.2025.102797 · Cited by 41
Grol-Prokopczyk, H., Huang, R., Yu, C., Chen, Y., Kaur, S., Limani, M., Lin, T.-H., Zajacova, A., Zimmer, Z., Cowan, P., et al. (2025) · Pain · doi:10.1097/j.pain.0000000000003676 · Cited by 41
Kiptulon, E. K., Elmadani, M., Szőllősi, A., Zrínyi, M., & Siket, A. U. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13365-6 · Cited by 43
“Nine of the included reviews in this umbrella review [46, 53, 56, 59, 60, 62–65] highlighted the power of work environment in nurses’ retention and turnover.”
InfluentialStern, C., Munn, Z., Porritt, K., Lockwood, C., Peters, M. D. J., Bellman, S., Stephenson, M., & Jordan, Z. (2018) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12314 · Cited by 35
From Elements to Structures: An Agenda for Organisational Gamification
Khan, A., Boroomand, F., Webster, J., & Minocher, X. (2020) · European Journal of Information Systems · doi:10.1080/0960085x.2020.1780963 · Cited by 38
“Although umbrella reviews provide important advantages such as summarizing research teams’ views of the evidence in an area (Aromataris et al., 2015), the review articles making up the umbrella review do not represent independent observations (Kitsiou et al., 2015) and need to be interpreted at a…”
BackgroundMethodEye health and quality of life: an umbrella review protocol
Assi, L., Rosman, L. M., Chamseddine, F., Ibrahim, P., Sabbagh, H., Congdon, N. G., Evans, J. R., Ramke, J., Kuper, H., Burton, M. J., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037648 · Cited by 41
Xu, B., Fu, J., Qiao, Y., Cao, J., Deehan, E. C., Li, Z., Jin, M., Wang, X., & Wang, Y. (2020) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqaa435 · Cited by 41
Interventions to optimise nutrition in older people in hospitals and long‐term care: Umbrella review
Brunner, S., Mayer, H., Qin, H., Breidert, M., Dietrich, M., & Müller‐Staub, M. (2021) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.13015 · Cited by 43
“We followed the action- guiding procedure and criteria of the Joanna Briggs Institute [21].”
BackgroundMethodInfluentialChoi, G. J., Kim, Y., Koo, Y. H., Oh, H., & Kang, H. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11121273 · Cited by 37
Qin, X., Chen, J., Jia, G., & Yang, Z. (2023) · Advances in Nutrition · doi:10.1016/j.advnut.2023.02.004 · Cited by 39
Eltaybani, S., Kawase, K., Kato, R., Inagaki, A., Li, C., Shinohara, M., Igarashi, A., Sakka, M., Sumikawa, Y., Fukui, C., et al. (2023) · Geriatric Nursing · doi:10.1016/j.gerinurse.2023.03.018 · Cited by 37
Body Mass Index and Cancer Risk: An Umbrella Review of Meta-Analyses of Observational Studies
Chen, J., Ke, K., Liu, Z., Peng, Z., Yang, L., Wang, L., Zhou, J., & Dong, Q. G. (2023) · Nutrition and Cancer · doi:10.1080/01635581.2023.2180824 · Cited by 40
“The umbrella review was designed and conducted in strict accordance with the guidelines developed by the working group of Joanna Briggs Institute (12).”
MethodRole of breastfeeding on maternal and childhood cancers: An umbrella review of meta-analyses
Fan, D., Xia, Q., Lin, D., Ma, Y., Rao, J., Liu, L., Tang, H., Xu, T., Li, P., Chen, G., et al. (2023) · Journal of Global Health · doi:10.7189/jogh.13.04067 · Cited by 42
An umbrella review on the association between factors of oral health and cognitive dysfunction
Lin, C., Chen, T., Verhoeff, M. C., Lobbezoo, F., Trulsson, M., & Fuh, J. (2023) · Ageing Research Reviews · doi:10.1016/j.arr.2023.102128 · Cited by 38
A Systematic Umbrella Review of the Effects of Teledentistry on Costs and Oral-Health Outcomes
Scheerman, J. F. M., Qari, A. H., Varenne, B., Bijwaard, H., Swinckels, L., Giraudeau, N., van Meijel, B., & Mariño, R. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21040407 · Cited by 43
“This umbrella review is consistent with the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines [11] and the umbrella review methodology described by Arosmatis and colleagues [12].”
BackgroundMethodDigital Wellness Programs in the Workplace: Meta-Review
Amirabdolahian, S., Paré, G., & Tams, S. (2025) · Journal of Medical Internet Research · doi:10.2196/70982 · Cited by 39
Malik, R. F., Buljac‐Samardžić, M., Akdemir, N., Hilders, C. G. J. M., & Scheele, F. (2020) · BMJ Open Quality · doi:10.1136/bmjoq-2019-000826 · Cited by 39
Veronese, N., Demurtas, J., Thompson, T., Solmi, M., Pesolillo, G., Celotto, S., Barnini, T., Stubbs, B., Maggi, S., Pilotto, A., et al. (2020) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.14310 · Cited by 39
O’Reilly, A., Tibbs, M., Booth, A., Doyle, E., McKeague, B., & Moore, J. (2020) · Irish Journal of Psychological Medicine · doi:10.1017/ipm.2020.106 · Cited by 45
“The remaining papers were examined using the appropriate Joanna Briggs critical appraisal checklist Rapid review of youth mental health during a pandemic 3 (Aromataris et al. 2015).”
MethodGhassab‐Abdollahi, N., Mobasseri, K., Ahmadabad, A. D., Nadrian, H., & Mirghafourvand, M. (2021) · Phytotherapy Research · doi:10.1002/ptr.7126 · Cited by 38
“An SR of “systematic reviews,” also called umbrella review, as a new approach can help to achieve this goal (Aromataris et al., 2015; Shea et al., 2009; Smith, Devane, Begley, & Clarke, 2011).”
BackgroundTrott, M., Smith, L., Veronese, N., Pizzol, D., Barnett, Y., Gorely, T., & Pardhan, S. (2021) · Eye · doi:10.1038/s41433-021-01684-x · Cited by 46
Dhanis, J., Keidan, N., Blake, D., Rundle, S., Strijker, D., van Ham, M., Pijnenborg, J. M. A., & Smits, A. (2022) · Cancers · doi:10.3390/cancers14143448 · Cited by 39
“The Joanna Briggs Institute Critical Appraisal Checklist for Case Reports was used to assess bias in case reports [24].”
MethodSpicy Food and Chili Peppers and Multiple Health Outcomes: Umbrella Review
Ao, Z., Huang, Z., & Liu, H. (2022) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.202200167 · Cited by 36
Duong, K. N. C., Le, L. M., Veettil, S. K., Saidoung, P., Wannaadisai, W., Nelson, R. E., Friedrichs, M., Jones, B. E., Pavia, A. T., Jones, M., et al. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1206988 · Cited by 37
Umbrella review and meta-analysis of antiplatelet therapy for peripheral artery disease
Ambler, G. K., Waldron, C.-A., Contractor, U. B., Hinchliffe, R. J., & Twine, C. P. (2020) · Journal of British Surgery · doi:10.1002/bjs.11384 · Cited by 35
“The best way to assimilate such a large amount of data is using umbrella review methodology.(14) This is because while individual outcomes and/or antiplatelet agents have been meta-analysed extensively in the past, there has never been a critical comparison of all available outcomes.”
BackgroundImam, A., Obiesie, S., Aluvaala, J., Maina, M., Gathara, D., & English, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-064050 · Cited by 38
The Effects of Pregnancy: A Systematic Review of Adolescent Pregnancy in Ghana, Liberia, and Nigeria
Lambonmung, A., Acheampong, C. A., & Langkulsen, U. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20010605 · Cited by 44
“The tool is a checklist made up of a set of eleven questions [17].”
MethodGinseng and health outcomes: an umbrella review
Li, Z., Wang, Y., Xu, Q., Ma, J., Li, X., Tian, Y., Wen, Y., & Chen, T. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1069268 · Cited by 43
“In recent years, umbrella review has been a novel approach evaluating the methodological quality and evidence of systematic reviews and meta-analyses (Aromataris et al., 2015).”
BackgroundHamasaki, H. (2023) · Medicines · doi:10.3390/medicines10090053 · Cited by 43
Lee, M. F., Bolton, K., Madsen, J., & Burke, K. J. (2023) · Journal of Reproductive and Infant Psychology · doi:10.1080/02646838.2023.2252453 · Cited by 35
“All three reviewers conducted data extraction according to Aromataris et al. (2015), presented in Table 1, including author, year, country, MMAT quality score, research aims, research design, data collection, participant characteristics, body image measurement, postpartum period definition,…”
Risk Factors for Breast Cancer-Related Lymphedema: An Umbrella Review
Shen, A., Qiang, W., Zhang, L., Bian, J., Zhu, F., Zhang, Z., & Lü, Q. (2023) · Annals of Surgical Oncology · doi:10.1245/s10434-023-14277-7 · Cited by 35
Hailu, H., Skouteris, H., Rodriguez, A. C. I., Galvin, E., & Hill, B. (2024) · Obesity Reviews · doi:10.1111/obr.13710 · Cited by 35
“32 The JBI checklist contains 11 criteria, which were assessed as yes, no, and cannot tell.”
BackgroundBusili, A., Kumar, K., Kudrna, L., & Busaily, I. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e28782 · Cited by 37
“The risk of bias assessment in this umbrella review utilized the Joanna Briggs Institute (JBI) checklist for the critical appraisal of systematic reviews and research syntheses [48].”
MethodWang, D., Benito, P. J., Rubio‐Arias, J. Á., Ramos‐Campo, D. J., & Rojo‐Tirado, M. Á. (2024) · Obesity Reviews · doi:10.1111/obr.13783 · Cited by 41
“17 All phases of the umbrella review were conducted in duplicate.”
Risk factors for adverse health in military and law enforcement personnel; an umbrella review
Stegerhoek, P. M., Kooijman, K., Ziesemer, K. A., IJzerman, H., Kuijer, P., & Verhagen, E. A. L. M. (2024) · BMC Public Health · doi:10.1186/s12889-024-20553-2 · Cited by 38
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.