Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 801–900 of 1,014
Romano, K., Shah, A., Schumacher, A., Zasowski, C., Zhang, T., Bradley-Ridout, G., Merriman, K., Parkinson, J., Szatmári, P., Campisi, S. C., et al. (2023) · Gut Microbiome · doi:10.1017/gmb.2023.16 · Cited by 27
“The umbrella review was conducted using the Joanna Briggs Institute Umbrella Review guidelines and reported following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (Aromataris et al., 2015).”
MethodRegmi, S., Kedia, S., Ahuja, N. A., Lee, G., Entwistle, C., & Dillon, P. (2023) · Trauma Violence & Abuse · doi:10.1177/15248380231205821 · Cited by 25
“Using the JBI Critical Appraisal Checklist for Analytical Cross-sectional Studies (Aromataris et al., 2015), we assessed the risk of bias among the included studies.”
MethodJanus kinase inhibitors in atopic dermatitis: an umbrella review of meta-analyses
He, Q., Xie, X., Chen, Q., Li, W., Song, Z., Wang, X., Ma, X., Zeng, J., & Guo, J. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2024.1342810 · Cited by 32
Emkani, M., Yazdi, M., Zarei, E., Klockner, K., Alimohammadlou, M., & Kamalinia, M. (2024) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2024.104479 · Cited by 25
Domnich, A., Manini, I., Calabrò, G. E., de Waure, C., & Montomoli, E. (2019) · Vaccines · doi:10.3390/vaccines7040215 · Cited by 26
“Furthermore, umbrella reviews are seen as a ready means of enabling relevant stakeholders to gain a clear understanding of a broad topic area [26].”
BackgroundInterventions to ensure medication safety in acute care: an umbrella review
Khalil, H., Kynoch, K., & Hines, S. J. (2020) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000232 · Cited by 30
“This umbrella review was conducted according to the JBI methods for systematic reviews of umbrella reviews.(41,42)”
BackgroundMethodSelf-citationJakobsen, M. U., Bysted, A., Mejborn, H., Stockmarr, A., & Trolle, E. (2021) · Nutrients · doi:10.3390/nu13103303 · Cited by 24
“We conducted the overview in accordance with methodological guidance for conduct of overviews of systematic reviews [11,14].”
MethodPaterson, C. C., Davis, D. L., Roche, M. A., Bissett, B., Roberts, C., Turner, M. R., Baldock, E., & Mitchell, I. (2022) · Journal of Medical Virology · doi:10.1002/jmv.28086 · Cited by 25
Li, X., Huang, D., Liu, F., Li, X., Lv, J.-L., Wu, Q., & Zhao, Y. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11247289 · Cited by 24
“The umbrella review gives a structured quantitative method of the evidence from multiple systematic reviews and meta-analyses on the same topic and can grade the evidence based on specific criteria, such as the strength and precision of associations and assessment of biases [27].”
MethodUmbrella reviews: a useful study design in need of standardisation
Shi, X., & Wallach, J. D. (2022) · BMJ · doi:10.1136/bmj.o1740 · Cited by 25
Shen, Y., Liu, D., Li, S., He, Y., Tan, F., Sun, X., Li, D., Xia, X., & Hao, Q. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.811746 · Cited by 23
Fournier, V., Duprez, C., Grynberg, D., Antoine, P., & Lamore, K. (2023) · Cancer Medicine · doi:10.1002/cam4.6695 · Cited by 24
“35 These interventions had a positive effect on binge drinking (one study) and working memory (one study) (14).”
BackgroundLiu, F.-H., Guo, J.-K., Xing, W.-Y., Bai, X., Chang, Y.-J., Zhao, L., Yang, M., Yang, Y., Li, W., Jia, X., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03423-x · Cited by 28
“According to the established criteria applied in previously published URs [13, 28–30] and based on our calculation, significant associations ( P 0.05) between ABO and Rh blood groups and health outcomes were divided into 4 levels of evidence strength (convincing [Class I], highly suggestive…”
MethodInfluentialErkin, Ö., & Kocaçal, E. (2024) · BMC Complementary Medicine and Therapies · doi:10.1186/s12906-024-04663-3 · Cited by 23
“The quality of the included studies was assessed using the Joanna Briggs Institute-Meta-analysis 2), a tool developed by the Joanna Briggs Institute (JBI) to assess the quality of experimental and quasi-experimental research [15, 16].”
MethodCampos, C. A. V., García-Pérez, S., Figuerola, J., la Puente, J. M., Polo, I., Rodríguez‐Fonseca, B., Fernández-Álvarez, S., Fraile, V. G., Martín‐Rey, M., Lacasaña, M., et al. (2025) · One Health · doi:10.1016/j.onehlt.2025.100984 · Cited by 26
Onni, A. T., Balakrishna, R., Perillo, M., Amato, M., Arjmand, E. J., Thomassen, L. M., Lorenzini, A., & Fadnes, L. T. (2025) · Advances in Nutrition · doi:10.1016/j.advnut.2025.100393 · Cited by 24
“To summarize the evidence from meta-analyses and systematic reviews regarding the consumption of various food groups, we assessed their association with all-cause mortality using an umbrella review framework [15].”
Patient perception of physician attire: a systematic review update
Kim, J., Ba, Y., Kim, J.-Y., & Youn, B.-Y. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-100824 · Cited by 23
Little, M. T., Butchart, A., Massetti, G. M., Hermosilla, S., Wittesaele, C., Pearson, I., Jochim, J., Swingler, S., Schupp, C., Böhret, I., et al. (2025) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(25)00214-7 · Cited by 28
“37 Consequently, findings are limited to the breath and quality of existing reviews, which might not reflect the quality of the primary studies.”
Holloman, T. K., Lee, W. C., London, J., Halkiyo, A. B., Jew, G. B., & Watford, B. A. (2024) · Collaborative Network for Engineering and Computing Diversity Conference (CoNECD) · doi:10.18260/1-2--29508 · Cited by 23
Mersha, A. G., Bovill, M., Eftekhari, P., Erku, D., & Gould, G. S. (2021) · Drug and Alcohol Review · doi:10.1111/dar.13290 · Cited by 23
Trott, M., Smith, L., Xiao, T., Veronese, N., Koyanagi, A., Jacob, L., Sánchez, G. F. L., Barnett, Y., & Pardhan, S. (2021) · Wiener klinische Wochenschrift · doi:10.1007/s00508-021-01893-0 · Cited by 25
Mesh-fixation technique for inguinal hernia repair: umbrella review
Techapongsatorn, S., Tansawet, A., Pattanaprateep, O., Attia, J., McKay, G. J., & Thakkinstian, A. (2022) · BJS Open · doi:10.1093/bjsopen/zrac084 · Cited by 29
Caviedes‐Bucheli, J., Muñoz‐Alvear, H. D., Lopez‐Moncayo, L. F., Narvaez‐Hidalgo, A., Zambrano‐Guerrero, L., Orduña, J. F. G., Portigliatti, R., Gomez‐Sosa, J. F., & Muñoz, H. R. (2022) · International Endodontic Journal · doi:10.1111/iej.13799 · Cited by 23
Wang, Y., Lu, J., Wen, N., Nie, G., Peng, D., Xiong, X., Cheng, N., & Li, B. (2022) · Nutrition & Metabolism · doi:10.1186/s12986-022-00677-1 · Cited by 24
“Methods Study design Umbrella review is a summary of existing systematic review and meta-analysis, which aims to summarize the evidence from multiple studies around a research topic [15, 16].”
MethodPatient engagement in perioperative settings: A mixed method systematic review
Cooper, Z., Cleary, S., Stelmach, W., & Zheng, Z. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16709 · Cited by 24
“Five JBI tools used to assess the quality of studies based on research design: randomised control tri - als, quasi-experimental studies, cross-sectional analytical studies, and qualitative studies (Aromataris et al., 2015).”
MethodBrubacher, L. J., Chen, T. T.-W., Longboat, S., Dodd, W., Peach, L., Elliott, S. J., Patterson, K., & Neufeld, H. T. (2024) · Systematic Reviews · doi:10.1186/s13643-023-02423-x · Cited by 28
“…in the International Prospective Register of Systematic Reviews (Registration #: CRD42023417060) and developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA-P) guidelines, as well as methodological recommendations for umbrella reviews [31].”
BackgroundMethodWoodall, W. J., Chang, E. H., Toy, S., Lee, D. R., Sherman, J. H., Liu, M., Chen, P., Youner, E., Cooke, J., Lancaster, A., et al. (2024) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000767 · Cited by 26
Zhang, Z., Tian, L., Liu, J., Jiang, H., & Wang, P. (2024) · Asia-Pacific Journal of Oncology Nursing · doi:10.1016/j.apjon.2024.100386 · Cited by 23
“Evidence items 2 – 9 describe oral mucosa assessment, including identifying the assessment tools, site, time, frequency, and content.”
BackgroundKuitunen, I., & Räsänen, K. (2024) · Neonatology · doi:10.1159/000537903 · Cited by 23
“Joanna Briggs Institute ’ s Manual for evidence synthesis and recommendations for umbrella reviews were utilized while conducting this umbrella review [14].”
Mancin, S., Sguanci, M. E., Andreoli, D., Piredda, M., & Marinis, M. G. D. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104859 · Cited by 24
Rangel-Rincón, L. J., Vivares‐Builes, A. M., Botero, J. E., & Agudelo‐Suárez, A. A. (2017) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2017.10.011 · Cited by 26
Kelly, M. M., & Griffith, P. B. (2019) · Journal of the American Association of Nurse Practitioners · doi:10.1097/jxx.0000000000000248 · Cited by 24
“The JBI Checklist includes 11 criteria with the following options: yes criteria were met, no criteria were not met, or meeting the criteria was unclear or not applicable (Aromataris et al., 2015).”
BackgroundTan, L., Nakanishi, E., & Lee, M. (2021) · Environment International · doi:10.1016/j.envint.2021.106956 · Cited by 27
Safe staffing in maternity services: A commissioned rapid scoping review for NHS EnglandPreprint
Edwards, D. J., Gillen, E., Hounsome, J. C., Marshall, J. E., Hadley, J., Bennett, C. L., Csontos, J. K., Davies, I., Davies, N., Dunn, C., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-8293649/v1 · Cited by 26
Educating nursing students for sustainable future rural health-care services: An umbrella review
Rusaanes, V., Eide, H., Brembo, E. A., Gladhus, L., Oswald, B. M., & Heyn, L. G. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104688 · Cited by 22
Moreno, E. M., Montero, A., & Crespo, J. M. A. (2024) · Anales de Psicología · doi:10.6018/analesps.488251 · Cited by 23
O'Brien, M. W., Shivgulam, M. E., Domínguez, A. H., Liu, H., Waghorn, J., Courish, M. K., & Tovar-Díaz, J. (2024) · Sports Medicine · doi:10.1007/s40279-024-02099-w · Cited by 25
“An umbrella review is defined as a review of reviews that summarizes, compares, and contrasts all results relevant to a specific review question [13].”
Molla‐Esparza, C., Gómez‐Núñez, M. I., & García, F. J. G. (2025) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2024.100433 · Cited by 25
Jahromi, A. S., Jokar, M., Abdous, A., Rabiee, M. H., Biglo, F. H. B., & Rahmanian, V. (2025) · International Health · doi:10.1093/inthealth/ihaf002 · Cited by 22
Adolescents' Health Information–Seeking Behavior: A Scoping Review
Saraipour, F., Panahi, S., Nemati‐Anaraki, L., & Shahraki-Mohammadi, A. (2025) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2025.05.030 · Cited by 23
A step-by-step guide for conducting an umbrella review
Abdellatif, M., Dadam, M. N., Vu, N. T., Nam, N. H., Nguyen, Q. H., Taoube, Z., Tran, P., & Huy, N. T. (2025) · Tropical Medicine and Health · doi:10.1186/s41182-025-00764-y · Cited by 26
Health equity in the wake of disasters and extreme weather: evidence from an umbrella review
Stimpson, J. P., Rashed, A. L., Pandya, J., Baudot, E. C., Whitfill, J., & Ortega, A. N. (2025) · Health Affairs Scholar · doi:10.1093/haschl/qxaf207 · Cited by 48
“10 Therefore, the objective of this umbrella review is to synthesize evidence on physical health, mental health, and health care access/utilization outcomes associated with natural disasters and climate-related extreme weather events among socially and economically marginalized populations.”
Jensen, M. P., Ziff, O. J., Banerjee, G., Ambler, G., & Werring, D. J. (2019) · European Stroke Journal · doi:10.1177/2396987319827211 · Cited by 24
“To include potentially relevant trial data that have assessed SSRIs versus control (placebo or no treatment) irrespective of population studied or the outcome assessed we also performed a post hoc umbrella review of published meta-analyses.(13) The review was reported according to the Preferred Reporting Items for Sys…”
Teaching and Learning to Program: Umbrella Review of Introductory Programming in Higher Education
Sobral, S. R. (2021) · Mathematics · doi:10.3390/math9151737 · Cited by 23
Cost of illness in multiple sclerosis by disease characteristics – A review of reviews
Schriefer, D., Haase, R., Neß, N.-H., & Ziemssen, T. (2021) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2022.1987218 · Cited by 22
“We adhered to previously described recommendations and standardized procedures in this domain to structure and report our review findings [62,64,66,67].”
MethodComplications Associated with Rhinoplasty: An Umbrella Review of Meta-analyses
Wu, B., Chen, S., Sun, K., & Xu, X. (2021) · Aesthetic Plastic Surgery · doi:10.1007/s00266-021-02612-w · Cited by 23
Cho, K., Park, S., Koyanagi, A., Jacob, L., Yon, D. K., Lee, S. W., Kim, M. S., Kim, S. U., Kim, B. K., Shin, J. I., et al. (2022) · Obesity Reviews · doi:10.1111/obr.13464 · Cited by 22
“Umbrella reviews aggregate all existing meta-analyses and present the high level overview on a topic.(12) We carried out an umbrellareview of meta-analyses to evaluate the effectiveness of pharmaco-”
BackgroundLiu, S., Huang, P.-D., Xu, J., Li, Q., Xie, J., Wu, W.-Z., Wang, C., & Yang, X.-B. (2022) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-022-04005-1 · Cited by 23
“We followed the guidelines (Aromataris et al. 2015) to conduct this umbrella review.”
MethodGastrointestinal Microbiome and Multiple Health Outcomes: Umbrella Review
Chang, C., Yuan, X., Zhang, X., Chen, X., & Li, K. (2022) · Nutrients · doi:10.3390/nu14183726 · Cited by 24
“The umbrella review was carried out as previously published in the relevant literature [19,20].”
BackgroundRibeiro, L. G., Antunes, L. S., Küchler, É. C., Baratto‐Filho, F., Kirschneck, C., Guimarães, L. S., & Antunes, L. A. A. (2023) · Clinical Oral Investigations · doi:10.1007/s00784-022-04837-8 · Cited by 22
“Overviews of systematic reviews use explicit and systematic methods to search for and identify multiple systematic reviews on related research questions in the same topic area for the purpose of extracting and analysing results across important outcomes [39].”
BackgroundEvidence-based umbrella review of non-invasive brain stimulation in anxiety disorders
Sá, K. N., Baptista, R. F., Shirahige, L., Razza, L. B., Nogueira, M. G., Coura, M. H. F., dos Santos, L. A., Tanaka, C., Baptista, A. F., Monte-Silva, K. K., et al. (2023) · The European Journal of Psychiatry · doi:10.1016/j.ejpsy.2023.01.001 · Cited by 23
Pilates and multiple health outcomes: An umbrella review
Xu, M., Tian, C., Wang, Y., Liang, S., Wang, Y., Li, X., & Yang, K. (2023) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2023.03.011 · Cited by 22
Andreopoulou, G., Busselli, G., Street, T., Bulley, C., Safari, R., van der Linden, M. L., & Burridge, J. H. (2023) · Artificial Organs · doi:10.1111/aor.14563 · Cited by 22
Bansal, N., Ang, S., & Chen, L. (2023) · British Journal of Pain · doi:10.1177/20494637231204549 · Cited by 22
“29 32 Therefore, this um-brella review aimed to investigate the prevalence of CPSP and PPOU as evidenced by systematic reviews to inform future clinical or research agendas for optimising post-surgical pain management and opioid use.”
BackgroundJin, G., Shi, H., Du, J. C., Guo, H., Yuan, G., Yang, H., Zhu, Z., Zhang, J., Zhang, K., Zhang, X., et al. (2023) · AIDS Patient Care and STDs · doi:10.1089/apc.2023.0158 · Cited by 23
“16,17 Given the importance of PrEP care to the AIDS high-risk groups, this overview of systematic reviews was designed with a significant emphasis on comprehending the present status of the PrEP care cascade and barriers or facilitators associated with the implementation of PrEP among diverse…”
Diagnostic accuracy of interleukin-6 in multiple diseases: An umbrella review of meta-analyses
Han, Z., Li, J., Yi, X., Zhang, T., Liao, D., You, J. E., & Ai, J. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e27769 · Cited by 24
“An umbrella review entails the systematic integration of current systematic reviews with the objective of providing a comprehensive and thorough picture of the given topic [25,26].”
BackgroundChai, S., Niu, Y., Liu, F., Wu, S., Yang, Z., & Sun, F. (2024) · Journal of Diabetes Research · doi:10.1155/2024/8145388 · Cited by 23
Tiani, K. A., Arenaz, C. M., Spill, M. K., Foster, M., Davis, J. S., Bailey, R. L., Field, M. S., Stover, P. J., & MacFarlane, A. J. (2024) · Advances in Nutrition · doi:10.1016/j.advnut.2024.100308 · Cited by 22
“The methodological direction on summarizing systematic reviews was taken from Aromataris et al. [22] of the Joanna Briggs Institute.”
Jayaraman, J., Nagendrababu, V., Pulikkotil, S. J., & Innes, N. (2018) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12414 · Cited by 23
Chen, W., Li, Y., Guo, L., Zhang, C., & Tang, S. (2021) · Sleep And Breathing · doi:10.1007/s11325-021-02384-2 · Cited by 22
Is pulpotomy a promising modality in treating permanent teeth? An umbrella review
Lin, G. S. S., Yew, Y. Q., Lee, H. Y., Ting Ting, L. O. W., Pillai, M. P. M., Laer, T. S., & Wafa, S. W. W. S. S. T. (2021) · Odontology · doi:10.1007/s10266-021-00661-w · Cited by 29
Global assessment of characteristics of multiple sclerosis registries; A systematic review
Ezabadi, S. G., Sahraian, M. A., Maroufi, H., Shahrbaf, M. A., & Eskandarieh, S. (2022) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2022.103928 · Cited by 22
Fausto, D. Y., Leitão, A. E., Silveira, J., Martins, J. B. B., Dominski, F. H., & Guimarães, A. C. A. (2023) · Menopause · doi:10.1097/gme.0000000000002105 · Cited by 21
Vasiliu, O. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1393337 · Cited by 21
Potter, A., Munsch, C., Watson, E., Hopkins, E., Kitromili, S., O'Neill, I. C., Larbie, J., Niittymaki, E., Ramsay, C., Burke, J., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/66157 · Cited by 25
“The systematic review and research syntheses checklist has been used to self-appraise the process on completion (Multimedia Appendix 1) [27].”
Gasparetto, M., Narula, P., Wong, C., Ashton, J. J., Kammermeier, J., Pierik, M. J., Kopylov, U., & Arebi, N. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2024.12.007 · Cited by 26
The State of Evidence in Digital Hate Research: An Umbrella Review
Matthes, J., Koban, K., Bührer, S., Kirchmair, T., Weiß, P., Khaleghipour, M., Saumer, M., & Meerson, R. (2025) · Communication Research · doi:10.1177/00936502251365724 · Cited by 22
“As such, umbrella reviews do not aim at repeating insights of single reviews (Aromataris et al., 2015; Papatheodorou, 2019).”
Rohilla, L., Kaur, S., Duggal, M., Malhi, P., Bharti, B., & Dayal, D. (2021) · The Science of Diabetes Self-Management and Care · doi:10.1177/26350106211031809 · Cited by 22
Castro, R., Alves, M. R., de Oliveira, C. C. M., Romero, C., Perazzo, H., Simjanoski, M., Kapciznki, F., Balanzá‐Martínez, V., & Boni, R. B. D. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2021.735624 · Cited by 23
“, the systematic review of systematic reviews) (26).”
BackgroundCoenzyme Q10 Supplementation in Reducing Inflammation: An Umbrella Review
McRae, M. P. (2022) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2022.07.001 · Cited by 22
Sartori, L. R. M., Pereira, D. H., Baker, S. R., & Corrêa, M. B. (2022) · Journal of Family Violence · doi:10.1007/s10896-022-00470-x · Cited by 21
“, 2020), and systematic review studies (Aromataris et al., 2015).”
Dafny, H. A., Champion, S., Gebremichael, L. G., Pearson, V., Hendriks, J., Clark, R. A., de Plaza, M. A. P., Gulyani, A., Hines, S. J., & Beleigoli, A. M. R. (2023) · European Heart Journal - Quality of Care and Clinical Outcomes · doi:10.1093/ehjqcco/qcad005 · Cited by 25
Bain, L. E., Akondeng, C., Njamnshi, W. Y., Mandi, H. E., Amu, H., & NJAMNSHI, A. K. (2022) · PubMed Central · doi:10.11604/pamj.2022.43.152.36861 · Cited by 28
“qualitative [47] and mixed methods [48,49] studies were used.”
MethodHughes, K. M., Ford, H., Thangaratinam, S., Brennecke, S. P., Mol, B. W., & Wang, R. (2023) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17443 · Cited by 22
Katayama, Y., Yanai, R., Itaya, T., Nagamine, Y., Tanigawa, K., & Miyawaki, Y. (2023) · Clinical Rheumatology · doi:10.1007/s10067-023-06608-6 · Cited by 21
“Umbrella reviews have attracted scientific attention in recent years, and can provide a broader picture of many risk factors [4].”
BackgroundFazio, N. D., Delogu, G., Morena, D., Cipolloni, L., Scopetti, M., Mazzilli, S., Frati, P., & Fineschi, V. (2023) · Diagnostics · doi:10.3390/diagnostics13101722 · Cited by 21
“However, further studies are necessary to analyze the behavior of blood collections at the ocular level, due to the different concentrations of oxygen and thromboplastin and the consequent different local-regional hemoglobin metabolism [103].”
BackgroundNonoperative Management of Lateral Epicondyle Tendinopathy: An Umbrella Review
Kinney, W. R., & Anderson, B. (2023) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2023.04.004 · Cited by 21
Talebi, S., Mohammadi, H., Zeraattalab-Motlagh, S., Arab, A., Mohammadian, M. K., Ghoreishy, S. M., Fard, M. A. T., Khosroshahi, R. A., & Djafarian, K. (2023) · Nutrition Reviews · doi:10.1093/nutrit/nuad078 · Cited by 22
Blockchain-Based Applications for Smart Grids: An Umbrella Review
Zhao, W., Qi, Q., Zhou, J., & Luo, X. (2023) · Energies · doi:10.3390/en16176147 · Cited by 22
Fang, C. E. H., Bokre, D., & Wong, S. H. (2023) · Neurology · doi:10.1212/wnl.0000000000207642 · Cited by 23
“10,13,14 To reduce errors, we used a data extraction form.”
BackgroundMethodFactors Associated With Healthcare Clinician Stress and Resilience: A Scoping Review
Usset, T. J., Stratton, R., Knapp, S. K., Schwartzman, G. H., Yadav, S. K., Schaefer, B., Harris, J., & Fitchett, G. A. (2024) · Journal of Healthcare Management · doi:10.1097/jhm-d-23-00020 · Cited by 24
“Further, because of the extent of the existing literature on clinician stress and well-being, we chose to conduct a scoping review of current literature reviews—that is, an umbrella review (Aromataris et al., 2015).”
BackgroundZemariam, A. B., Abebe, G. K., Kassa, M. A., Alamaw, A. W., Woldesenbet, R., Abate, B. B., Tilahun, B. D., Wondie, W. T., Shimelash, R. A., & Fentanew, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299384 · Cited by 21
“The researchers conducted a thorough review of systematic reviews and meta-analyses on immunization coverage and its predictors among children aged 12–23 months in Ethiopia, following a systematic and comprehensive approach of umbrella review [20].”
BackgroundGrand, T. S., Ren, S., Hall, J. A., Åström, D. O., Régnier, S. A., & Thokala, P. (2024) · PharmacoEconomics · doi:10.1007/s40273-024-01370-2 · Cited by 21
“Umbrella reviews aim to synthesise systematic reviews, with or without meta-analyses, and have been described as a natural option to handle increases in systematic reviews to provide a summary of broad topic areas [19].”
BackgroundMethodInfluentialEffective community engagement in one health research in Sub-Saharan Africa: a systematic review
Sangong, S., Saah, F. I., & Bain, L. E. (2025) · One Health Outlook · doi:10.1186/s42522-024-00126-4 · Cited by 27
“The critical assessment catalogues for qualitative [17] and mixed studies were used [3, 34].”
Kampling, H., Brendel, L. K., & Mittag, O. (2019) · Neuropsychology Review · doi:10.1007/s11065-019-09409-4 · Cited by 21
Abed, H., Burke, M. C., Scambler, S., & Scott, S. E. (2019) · Gerodontology · doi:10.1111/ger.12456 · Cited by 21
The systematic review: Plurality of approaches and methodologies
Sobrido, M., & Prieto, J. M. R. (2018) · Enfermería Clínica (English Edition) · doi:10.1016/j.enfcle.2018.08.004 · Cited by 27
Solitano, V., Vuyyuru, S. K., Yuan, Y., Singh, S., Narula, N., Ma, C., Hanžel, J., Hutton, M., Koughnett, J. A. V., Rieder, F., et al. (2024) · International Journal of Colorectal Disease · doi:10.1007/s00384-024-04714-8 · Cited by 20
“…overview of systematic reviews, we followed the Cochrane collaboration guidelines “Chapter V, Overviews of reviews” [10], the Joanna Briggs Institute manual for umbrella reviews [11], and the recommendations outlined in the Preferred Reporting Items for Overviews of Reviews (PRIOR) [12] (Table S1).”
MethodSleep disturbances in adults with chronic kidney disease: an umbrella review
Chu, G., Matricciani, L., Russo, S. B., Viecelli, A. K., Jesudason, S., Bennett, P. N., & Fernandez, R. S. (2025) · Journal of Nephrology · doi:10.1007/s40620-025-02214-8 · Cited by 20
“The methodological quality of systematic reviews was independently evaluated by three reviewers (GC, LM and RF) using the JBI critical appraisal checklist for systematic reviews [26].”
Self-citationAn umbrella review of efficacy of digital health interventions for workers
Iwakura, M., Ozeki, C., Jung, S., Yamazaki, T., Miki, T., Nohara, M., & Nomura, K. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01578-2 · Cited by 20
“Finally, the con fi dence in the cumulative evidence was summarized in a fi gure, with a red, yellow, and green color-coding system to aid visual interpretation 193 .”
Carral, J. M. C., Vázquez, O. C., Ledesma, S. N., & Pruimboom, L. (2025) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2025.102020 · Cited by 21
He, Y., Liu, Y., May, B. H., Zhang, A. L., Zhang, H., Lu, C., Yang, L., Guo, X., & Xue, C. C. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018494 · Cited by 20
“sEArch strAtEgy To identify systematic reviews and/or meta-analyses of acupuncture and related therapies for cancer pain, we will search PubMed (1966 to present), Embase (1974 to present) and CINAHL (1982 to present), JBI Database of Systematic Reviews and Implementation Reports (2003 to present), the Cochrane Databas…”
BackgroundMethodInfluentialChugh, A., Patnana, A. K., Kumar, P., Chugh, V. K., Khera, D., & Singh, S. (2020) · Journal of Oral Biology and Craniofacial Research · doi:10.1016/j.jobcr.2020.07.011 · Cited by 26
Psychological resilience during COVID-19: a meta-review protocol
Seaborn, K., Chignell, M., & Gwizdka, J. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051417 · Cited by 21
Necho, M., Zenebe, Y., Tiruneh, C., Ayano, G., & Yimam, B. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.814360 · Cited by 20
A meta-review of psychological resilience during COVID-19
Seaborn, K., Henderson, K., Gwizdka, J., & Chignell, M. (2022) · npj Mental Health Research · doi:10.1038/s44184-022-00005-8 · Cited by 20
“We followed the Preferred Reporting Items for Systematic review and Meta-Analysis (PRISMA) guidelines 40 with modi fi cations for meta-reviews based on Aromataris et al. 13 .”
InfluentialKhosroshahi, R. A., Zeraattalab-Motlagh, S., Sarsangi, P., Nielsen, S. M., & Mohammadi, H. (2023) · British Journal Of Nutrition · doi:10.1017/s0007114523000910 · Cited by 24
“For this purpose, overviews of SRMA (also called ‘ umbrella reviews ’ ) are useful, as they summarise the evidence from published SRMA on a particular topic (19,20) .”
BackgroundAdekpedjou, R., Léon, P., Dewidar, O., Al‐Zubaidi, A. A. A., Jbilou, J., Kaczorowski, J. A., Muscedere, J., Hirdes, J. P., Heckman, G. A., Girard, M., et al. (2023) · Campbell Systematic Reviews · doi:10.1002/cl2.1323 · Cited by 25
“We report this review according to the Joanna Briggs Institute's guidance for the conduct and reporting of an umbrella review (Aromataris et al., 2015).”
MethodSantagostino, A. M., Cannizzaro, D., Soekeland, F., Mancin, S., & Mazzoleni, B. (2023) · World Neurosurgery · doi:10.1016/j.wneu.2023.06.047 · Cited by 20
Zheng, Y., Zhang, L., Ma, S., Wu, B., Chen, P., Xu, Y., Tan, W., Li, H., Wu, Q., & Zheng, J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02372-5 · Cited by 20
“…by synthesizing the evidence of published system reviews and selecting reviews based on pre-determined criteria without an in-depth study of the quality of individual major studies included in the original system review [13]; thus, it is defined as “an overview of existing system review” [14].”
Background
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.