Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 201–300 of 1,014
What we already know about the effects of exercise in patients with fibromyalgia: An umbrella review
Andrade, A., Dominski, F. H., & Sieczkowska, S. M. (2020) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2020.02.003 · Cited by 95
Huang, K., Kumar, M., Cheng, S., Urcuyo, A. E., & Macharia, P. M. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08673-0 · Cited by 115
“This paper is an umbrella review [49] purporting to summarize three inter-related areas of digital health literature to inform the development of adolescent centered integrated SRH services.”
BackgroundInfluentialZhang, Y., Koene, M., Reijneveld, S. A., Tuinstra, J., Broekhuis, M., van der Spek, S., & Wagenaar, C. (2022) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-022-01399-6 · Cited by 98
“Quality assessment The quality of the included review papers was assessed according to the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [30].”
MethodCzosnek, L., Lederman, O., Cormie, P., Zopf, E., Stubbs, B., & Rosenbaum, S. (2019) · Mental Health and Physical Activity · doi:10.1016/j.mhpa.2018.11.001 · Cited by 94
Interventions for reducing loneliness: An umbrella review of intervention studies
Veronese, N., Galvano, D., D’Antiga, F., Vecchiato, C., Furegon, E., Allocco, R., Smith, L., Gelmini, G., Gareri, P., Solmi, M., et al. (2021) · Health & Social Care in the Community · doi:10.1111/hsc.13248 · Cited by 87
Sharka, R. M., Abed, H., & Hector, M. (2019) · Gerodontology · doi:10.1111/ger.12399 · Cited by 103
Umbrella reviews: a methodological guide
Fernandez, R. S., Sharifnia, A. M., & Khalil, H. (2025) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvaf012 · Cited by 103
Self-citationGianfredi, V., Dinu, M., Nucci, D., Eussen, S. J. P. M., Amerio, A., Schram, M. T., Schaper, N. C., & Odone, A. (2022) · Nutrition Reviews · doi:10.1093/nutrit/nuac058 · Cited by 99
“15 It was designed to answer the following question: “What is the strength and validity of the existing evidence assessing the association between dietary patterns and depression among adults (from both observational research and RCTs)?”.”
BackgroundChildren’s Participation in Child Welfare: A Systematic Review of Systematic Reviews
McCafferty, P., & García, E. M. (2023) · The British Journal of Social Work · doi:10.1093/bjsw/bcad167 · Cited by 91
Caffieri, A., Gómez‐Gómez, I., Barquero‐Jimenez, C., de-Juan-Iglesias, P., Margherita, G., & Motrico, E. (2023) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.14740 · Cited by 104
“27 The first nine items of the checklist ap-praised Each item allows four response options: yes, no, unclear, not applicable.”
BackgroundSan-Juan-Rodriguez, A., Newman, T. V., Hernandez, I., Swart, E. C. S., Klein‐Fedyshin, M., Shrank, W. H., & Parekh, N. (2018) · Preventive Medicine · doi:10.1016/j.ypmed.2018.08.029 · Cited by 93
Lesinski, M., Herz, M., Schmelcher, A., & Granacher, U. (2020) · Sports Medicine · doi:10.1007/s40279-020-01327-3 · Cited by 100
Torre, G. L., Vitello, T., Cocchiara, R. A., & Rocca, C. D. (2023) · Public Health · doi:10.1016/j.puhe.2023.03.009 · Cited by 90
Gao, C., Guo, J., Gong, T.-T., Lv, J.-L., Li, X.-Y., Liu, F.-H., Zhang, M., Shan, Y.-T., Zhao, Y.-H., & Wu, Q.-J. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.813943 · Cited by 88
“We strictly followed standardized guidelines to perform an umbrella review, which is the systematic collection and evaluation of multiple systematic reviews and meta-analyses conducted on a specific research topic (5).”
MethodTherapeutic Benefits of l-Arginine: An Umbrella Review of Meta-analyses
McRae, M. P. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.06.002 · Cited by 88
“An umbrella review provides a summary of existing research syntheses and an assessment of whether authors addressing similar review questions independently observe similar results and arrive at similar conclusions.(6)”
ResultLi, N., Wu, X., Zhuang, W., Xia, L., Chen, Y., Zhao, R., Yi, M., Wan, Q., Du, L., & Zhou, Y. (2020) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.201900751 · Cited by 80
Revealing the hotspots of educational gamification: An umbrella review
Metwally, A. H. S., Nacke, L. E., Chang, M., Wang, Y., & Yousef, A. M. F. (2021) · International Journal of Educational Research · doi:10.1016/j.ijer.2021.101832 · Cited by 88
Kastora, S. L., Patel, M., Carter, B., Delibegović, M., & Myint, P. K. (2022) · Endocrinology Diabetes & Metabolism · doi:10.1002/edm2.338 · Cited by 99
Person‐centred care in primary care: What works for whom, how and in what circumstances?
Ahmed, A., van den Muijsenbergh, M. E. T. C., & Vrijhoef, H. J. (2022) · Health & Social Care in the Community · doi:10.1111/hsc.13913 · Cited by 114
“2.3.1 | Peer- reviewed literature Systematic reviews and meta- analyses were included to provide an extensive body of broad and high- quality evidence (Aromataris et al., 2015).”
BackgroundInfluentialLi, L., Asemota, I., Liu, B., Gómez, J., Lin, L., Arif, A. W., Siddiqi, T. J., & Usman, M. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02029-9 · Cited by 95
Schmid, M., Brianza, E., Mok, S. Y., & Petko, D. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105024 · Cited by 87
“…also called meta-meta-analysis, meta-synthesis, overview, overview of reviews, second-order meta-analysis, summary of systematic reviews, synthesis of reviews, tertiary review, or umbrella reviews; Aromataris et al., 2015, p. 133; Newman & Gough, 2020, p. 17; Polanin et al., 2017, p. 173).”
Holm, A., Viftrup, A., Karlsson, V., Nikolajsen, L., & Dreyer, P. (2020) · Journal of Advanced Nursing · doi:10.1111/jan.14524 · Cited by 87
Fu, L., Zhang, G., Qian, S., Zhang, Q., & Tan, M. (2022) · Frontiers in Nutrition · doi:10.3389/fnut.2022.972399 · Cited by 93
Feng, H., Luo, Z., Wu, Z., & Li, X. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06434-7 · Cited by 98
Beese, S., Postma, J. M., & Graves, J. M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192417006 · Cited by 98
“A systematic review of reviews serves as an accepted and valuable method to gain a clear understanding of the specific aspects of a broad topic area [27].”
MethodMentis, A. A., Dardiotis, E., Efthymiou, V., & Chrousos, G. P. (2021) · BMC Medicine · doi:10.1186/s12916-020-01873-7 · Cited by 103
“, being the meta equivalent of umbrella reviews, following their description in [2]).”
BackgroundInfluentialTeacher digital competence development in higher education: Overview of systematic reviews
Peters, M., Elasri-Ejjaberi, A., Martínez, M. J., & Fàbregues, S. (2022) · Australasian Journal of Educational Technology · doi:10.14742/ajet.7543 · Cited by 97
“Using guidelines by Aromataris et al. (2015), the following aspects of each publication were extracted: publication metadata (i.e., publication year and type), review purpose, type of review, setting and context, number of databases used, date range of included studies, number and types of studies…”
BackgroundMethodInfluentialRobinson, E., Roberts, C., Vainik, U., & Jones, A. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.10.009 · Cited by 73
Mostafaei, H., Mori, K., Hajebrahimi, S., Abufaraj, M. M., Karakiewicz, P. I., & Shariat, S. F. (2021) · British Journal of Urology · doi:10.1111/bju.15313 · Cited by 91
McCullock, S. P., & Scrivano, R. M. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102242 · Cited by 88
Risk factors for running-related injuries: An umbrella systematic review
Correia, C. K., Machado, J. M., Dominski, F. H., de Castro, M. P., Fontana, H. D. B., & Ruschel, C. (2024) · Journal of sport and health science/Journal of Sport and Health Science · doi:10.1016/j.jshs.2024.04.011 · Cited by 95
Zhang, X., Yang, J., Chen, X., Du, L., Li, K., & Zhou, Y. (2020) · Medicine · doi:10.1097/md.0000000000020983 · Cited by 94
“An umbrella review is the review of existing systematic reviews and/or meta-analyses, which can provide important information that can be used by decision makers in healthcare to systematically understand a topic area.([23]) We conducted an umbrella review to evaluate the impact of enhanced recovery after surgery (ERA…”
BackgroundUmbrella reviews (systematic review of reviews)
Faulkner, G., Fagan, M. J., & Lee, J. S. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1934888 · Cited by 86
Løvhaug, A. L., Granheim, S. I., Djojosoeparto, S. K., Harrington, J. M., Kamphuis, C. B. M., Poelman, M. P., Roos, G., Sawyer, A. D. M., Stronks, K., Torheim, L. E., et al. (2022) · BMC Public Health · doi:10.1186/s12889-022-12827-4 · Cited by 93
“Methods Umbrella reviews integrate the findings of multiple systematic reviews and allow rapid review of the evidence base in relation to a topic [20, 21].”
BackgroundDysphagia in Alzheimer’s disease: a systematic review
Mira, A., Gonçalves, R., & Rodrigues, I. T. (2022) · Dementia & Neuropsychologia · doi:10.1590/1980-5764-dn-2021-0073 · Cited by 83
Posttraumatic stress disorder (PTSD) prevalence: an umbrella review
Schincariol, A., Orrù, G., Otgaar, H., Sartori, G., & Scarpazza, C. (2024) · Psychological Medicine · doi:10.1017/s0033291724002319 · Cited by 95
“The studies included in the different meta-analyses were generally found to have high levels of heterogeneity ranging from 59.2% (Aromataris et al., 2015) to 92.64% (Cénat et al., 2021); the only exception was the study by Badenes-Ribera et al. (2021) on the proportion of PTSD diagnoses following…”
InfluentialNursing handovers and patient safety: Findings from an umbrella review
Bressan, V., Mio, M., & Palese, A. (2019) · Journal of Advanced Nursing · doi:10.1111/jan.14288 · Cited by 88
Seifu, C. N., Fahey, P. P., Hailemariam, T. G., Frost, S. A., & Atlantis, E. E. (2021) · Public Health Nutrition · doi:10.1017/s1368980021000823 · Cited by 88
“Quality assessment We used the JBI critical appraisal checklist for systematic reviews and research syntheses(27) (Appendix S2) to assess the quality of included systematic reviews.”
MethodBastoni, S., Wrede, C., Silva, M. C. D., Sanderman, R., Gaggioli, A., Braakman‐Jansen, A., & van Gemert‐Pijnen, J. E. W. C. (2021) · JMIR Aging · doi:10.2196/30841 · Cited by 87
Dastamooz, S., Bahmani, D. S., Farahani, M. H. D., Wong, S. H., Yam, J. C. S., Tham, C. C. Y., & Sit, C. H. P. (2023) · EClinicalMedicine · doi:10.1016/j.eclinm.2023.102137 · Cited by 90
Jakobsen, K., Mikalsen, M., & Lilleng, G. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102397 · Cited by 93
Prasittisopin, L., Tuvayanond, W., Kang, T. H. ‐., & Kaewunruen, S. (2025) · Resources · doi:10.3390/resources14020021 · Cited by 98
“A systematic review paper of review publications, referred to as an umbrella review, is a type of systematic review that summarizes and evaluates existing systematic reviews and meta-analyses on a certain research area [32].”
Campbell, J. M., Bateman, E. H., Stephenson, M., Bowen, J. M., Keefe, D. M. K., & Peters, M. D. J. (2016) · Cancer Chemotherapy and Pharmacology · doi:10.1007/s00280-016-3043-5 · Cited by 89
“Data were extracted from included systematic reviews using the standardized data extraction tool from JBIURARI (Supplementary material 3 [9]).”
BackgroundMethodInfluentialHossain, M. M., Sultana, A., & Purohit, N. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3561265 · Cited by 133
Rydzewska, E., Dunn, K., & Cooper, S.-A. (2021) · The British Journal of Psychiatry · doi:10.1192/bjp.2020.167 · Cited by 81
Psychopathy and dangerousness: An umbrella review and meta-analysis
Gillespie, S. M., Jones, A., & Garofalo, C. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102240 · Cited by 86
Prevalence and Risk Factors for Antenatal Depression in Ethiopia: Systematic Review
Getinet, W., Amare, T., Boru, B., Shumet, S., Takele, W. W., & Azale, T. (2018) · Depression Research and Treatment · doi:10.1155/2018/3649269 · Cited by 80
“potentials of each systematic review were assessed by using a checklist adjusted from Joanna Briggs Institute (JBI) Critical Appraisal for Study Papers [45].”
MethodEkram, A. S., Woods, R. L., Britt, C. J., Espinoza, S. E., Ernst, M. E., & Ryan, J. L. (2021) · The Journal of Frailty & Aging · doi:10.14283/jfa.2021.20 · Cited by 82
Balante, J., van den Broek, D., & White, K. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.103930 · Cited by 83
Fadilah, N. I. M., Isa, I. L. M., Zaman, W. S. W. K., Tabata, Y., & Fauzi, M. B. (2022) · Polymers · doi:10.3390/polym14030476 · Cited by 84
“The review was accompanied by a methodological approach using the critical evaluation for systematic reviews [38].”
MethodUse of Dietary Fibers in Reducing the Risk of Several Cancer Types: An Umbrella Review
Hu, J., Wang, J., Li, Y., Xue, K., & Kan, J. (2023) · Nutrients · doi:10.3390/nu15112545 · Cited by 86
“The purpose of the umbrella evaluation was to provide a comprehensive assessment of existing meta-analyses for a specific question instead of repeating the search for original articles for meta-analysis [14].”
Neighbourhood community life and health: A systematic review of reviews
Pérez, E. J., Braën, C., Boyer, G., Mercille, G., Rehany, É., Deslauriers, V., Bilodeau, A., & Potvin, L. (2019) · Health & Place · doi:10.1016/j.healthplace.2019.102238 · Cited by 87
Egli-Gany, D., Aftab, W., Hawkes, S., Abu-Raddad, L. J., Buse, K., Rabbani, F., Low, N. N., & Onarheim, K. H. (2021) · Eastern Mediterranean Health Journal · doi:10.26719/emhj.20.101 · Cited by 94
“Methods Design We conducted a review of systematic reviews following guidance from the Joanna Briggs Institute methodology group (19).”
MethodAndronic, O., Weiss, O., Shoman, H., Kriechling, P., & Khanduja, V. (2020) · International Orthopaedics · doi:10.1007/s00264-020-04790-9 · Cited by 78
Are older adults insufficiently included in clinical trials?—An umbrella review
Florisson, S., Aagesen, E. K., Bertelsen, A. S., Nielsen, L. P., & Rosholm, J. (2020) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.13536 · Cited by 88
Chutiyami, M., Bello, U. M., Salihu, D., Ndwiga, D. W., Kolo, M. A., Maharaj, R., Naidoo, K., Devar, L., Pratitha, P., & Kannan, P. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104211 · Cited by 83
Mohamed, S., Chipeta, M. G., Kamninga, T. M., Nthakomwa, L., Chifungo, C., Mzembe, T., Vellemu, R., Chikwapulo, V., Peterson, M., Abdullahi, L., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02361-8 · Cited by 90
“A systematic review like this one aims to focus more broadly on an outcome, such as unintended adolescent pregnancy, and identify potentially effective interventions [4].”
BackgroundCircular Economy: A Review of Review Articles
Hossain, M., Park, S., Suchek, N., & Pansera, M. (2024) · Business Strategy and the Environment · doi:10.1002/bse.3867 · Cited by 77
Mental Health Outcomes of Unaccompanied Refugee Minors: a Rapid Review of Recent Research
Bamford, J., Fletcher, M., & Leavey, G. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01262-8 · Cited by 83
“We assessed risk of bias via the Joanna Briggs critical appraisal checklist, commonly used in rapid reviews [22].”
MethodAljuraiban, G. S., Gibson, R., Chan, D. S. M., Horn, L. V., & Chan, Q. M. (2023) · Advances in Nutrition · doi:10.1016/j.advnut.2023.09.011 · Cited by 85
“2023 Oct 10;81(11):1462-1489. doi: 10.1093/nutrit/nuad013.”
BackgroundInfluentialThe impact of teacher socio-emotional competence on student engagement: a meta-analysis
Gebre, Z. A., Demissie, M. M., & Yimer, B. M. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1526371 · Cited by 88
Summary of the evidence on the safety, efficacy, and effectiveness of human papillomavirus vaccines
Villa, A., Patton, L. L., Giuliano, A. R., Estrich, C. G., Pahlke, S. C., O’Brien, K. K., Lipman, R. D., & Araujo, M. W. B. (2020) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2019.10.010 · Cited by 84
Momsen, A. H., Høtoft, D., Ørtenblad, L., Lauszus, F. F., Krogh, R. A., Lynggaard, V., Christiansen, J. J., Maindal, H. T., & Nielsen, C. V. (2021) · Endocrinology Diabetes & Metabolism · doi:10.1002/edm2.230 · Cited by 85
Changing trends in clinical research literature on PubMed database from 1991 to 2020
Zhao, X., Jiang, H., Yin, J., Liu, H., Zhu, R., Mei, S., & Zhu, C. (2022) · European journal of medical research · doi:10.1186/s40001-022-00717-9 · Cited by 82
Systematic review of surveillance systems for AMR in Africa
Okolie, O. J., Igwe, U., Ismail, S. U., Uzairue, L. I., & Adukwu, E. C. (2022) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkac342 · Cited by 80
The efficacy of melatonin and melatonin agonists in insomnia – An umbrella review
Low, T. L., Choo, F. N., & Tan, S. M. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.10.022 · Cited by 74
Happe, J., Bühnová, B., Koziolek, A., & Wagner, I. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10379-x · Cited by 75
Fenta, M. D., Ogundijo, O. A., Warsame, A. A. A., & Belay, A. G. (2023) · BMC Infectious Diseases · doi:10.1186/s12879-023-08502-7 · Cited by 86
“Appraisal Tool was used to assess the quality of the qualitative studies included in this review [14] (see additional file 1).”
MethodResilience and mental health among perinatal women: a systematic review
Hajure, M., Alemu, S. S., Abdu, Z., Mulatu, G., Alemayehu, Y., Dule, A., Hussen, M. A., Wedajo, L. F., & Gezimu, W. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1373083 · Cited by 83
Future perspectives on nonmedical prescribing
Stewart, D. C., Jebara, T., Cunningham, S., Awaisu, A., Pallivalapila, A., & MacLure, K. (2017) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098617693546 · Cited by 75
A systematic review of guidelines for managing rheumatoid arthritis
Mian, A., Ibrahim, F., & Scott, D. L. (2019) · BMC Rheumatology · doi:10.1186/s41927-019-0090-7 · Cited by 75
Prevention and Care for Incontinence-Associated Dermatitis Among Older Adults: A Systematic Review
Banharak, S., Panpanit, L., Subindee, S., Narongsanoi, P., Sanun-aur, P., Kulwong, W., Songtin, P., & Khemphimai, W. (2021) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s329672 · Cited by 74
Alon, N., Macrynikola, N., Jester, D. J., Keshavan, M. S., Reynolds, C. F., Saxena, S., Thomas, M. L., Torous, J. B., & Jeste, D. V. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.115854 · Cited by 80
Bruch, J. D., Khazen, M., Mahmić-Kaknjo, M., Légaré, F., & Ellen, M. (2024) · Patient Education and Counseling · doi:10.1016/j.pec.2024.108408 · Cited by 83
The Potential Role of Dyslipidemia in COVID-19 Severity: an Umbrella Review of Systematic Reviews
Choi, G. J., Kim, H. M., & Kang, H. (2020) · Journal of Lipid and Atherosclerosis · doi:10.12997/jla.2020.9.3.435 · Cited by 78
Prevalence of Intimate Partner Violence in Pregnancy: An Umbrella Review
Román-Gálvez, R. M., Martín-Peláez, S., Martínez-Galiano, J. M., Khan, K. S., & Bueno-Cavanillas, A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18020707 · Cited by 63
“This umbrella review was written according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement for systematic reviews and meta-analyses [19] and the Aromataris’ guidelines for performing umbrella reviews [20].”
MethodRevisión sistemática: el más alto nivel de evidencia
Ávila, J. M. J., González, A. M. B., Salazar, M. O. G., Amado, F. R., Medina-Vicent, N. A., del Toro, A. V., & Reyna, M. V. S. (2021) · Orthotips AMOT · doi:10.35366/102220 · Cited by 73
Benefits of Participation in Clinical Trials: An Umbrella Review
Bouzalmate-Hajjaj, A., Massó Guijarro, P., Khan, K. S., Bueno‐Cavanillas, A., & Ibáñez, N. C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192215368 · Cited by 73
Risk factors for hepatocellular carcinoma: an umbrella review of systematic review and meta-analysis
Wang, J., Qiu, K., Zhou, S., Gan, Y., Jiang, K., Wang, D., & Wang, H. (2025) · Annals of Medicine · doi:10.1080/07853890.2025.2455539 · Cited by 80
Healthcare Simulation Standards of Best Practice®: The Debriefing Process
Decker, S., Sapp, A., Bibin, L., Chidume, T. L., Crawford, S. B., Fayyaz, J., Johnson, B. K., & Pitman, J. S. (2025) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2025.101775 · Cited by 73
Cross-sector Service Provision in Health and Social Care: An Umbrella Review
(2016) · International Journal of Integrated Care · doi:10.5334/ijic.2460 · Cited by 66
“The current review aligns with the parameters outlined by the Joanna Briggs Institute [11,12] for conducting Umbrella Reviews, more so than the parameters outlined by the Cochrane Collaboration for an Overview of Reviews in that we aim to incorporate all types of syntheses (systematic reviews, meta-analyses, narrative…”
MethodBarbaresko, J., Lellmann, A. W., Schmidt, A., Lehmann, A., Amini, A. M., Egert, S., Schlesinger, S., & Nöthlings, U. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa053 · Cited by 67
“Methods The present umbrella review was conducted and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist (18), and proposed methodology of conducting and reporting umbrella reviews (16).”
BackgroundMethodPerera, C., Bakrania, S., Ipince, A., Nesbitt‐Ahmed, Z., Obasola, O. I., Richardson, D., de Scheur, J. V., & Yu, R. (2022) · Campbell Systematic Reviews · doi:10.1002/cl2.1240 · Cited by 92
“4.3.4.1 | Assessment of risk of bias in included studies The methodological quality of the included systematic reviews was assessed by employing the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Syntheses (Aromataris et al., 2015).”
BackgroundMethodInfluentialChange fatigue in nursing: An integrative review
Beaulieu, L., Seneviratne, C., & Nowell, L. S. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15546 · Cited by 85
Prill, R., Królikowska, A., de Girolamo, L., Becker, R., & Karlsson, J. (2023) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-023-07442-8 · Cited by 75
“Alternatively, the JBI Critical Appraisal Checklist for Systematic Reviews and ROBIS tool are recommended for assessing the risk of bias of a systematic review [6, 51].”
MethodNyadanu, S. D., Dunne, J., Tessema, G. A., Mullins, B. J., Kumi-Boateng, B., Bell, M. L., Duko, B., & Pereira, G. F. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.170236 · Cited by 74
Prasse, D., Webb, M., Deschênes, M., Parent, S., Aeschlimann, F., Goda, Y., Yamada, M., & Raynault, A. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09772-z · Cited by 82
“Finally, the methodological quality of the remaining 35 articles was assessed, by applying quality criteria based on the critical appraisal checklist for systematic reviews by Aromataris et al. (2015).”
Tea intake and cardiovascular disease: an umbrella review
Keller, A., & Wallace, T. C. (2021) · Annals of Medicine · doi:10.1080/07853890.2021.1933164 · Cited by 78
Non-pharmacological interventions for autistic children: An umbrella review
Trembath, D. L., Varcin, K. J., Waddington, H. L., Sulek, R., Bent, C. A., Ashburner, J. K., Eapen, V., Goodall, E., Hudry, K., Roberts, J., et al. (2022) · Autism · doi:10.1177/13623613221119368 · Cited by 76
“An umbrella review, also known as a review of reviews, provides a synthesis and appraisal of evidence across a broader topic area than can usually be achieved through an individual systematic review and thus is particularly helpful for the development of evidencebased policy (Aromataris et al., 2015).”
BackgroundTeam-based learning in health professions education: an umbrella review
Alizadeh, M., Masoumi, R., Mafinejad, M. K., Parmelee, D. X., Khalaf, R. J., & Norouzi, A. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06147-x · Cited by 79
“This umbrella review was conducted according to the JBI methodology [22] and was reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analy-ses (PRISMA) guidelines [23].”
MethodMannocci, A., D’Egidio, V., Backhaus, I., Federici, A., Sinopoli, A., Varela, A. R., Villari, P., & Torre, G. L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17103528 · Cited by 82
“The preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement and the guidelines developed by Aromataris and colleagues were followed to perform this umbrella review [9].”
MethodAssociation between cardiovascular diseases and apical periodontitis: an umbrella review
Jakovljević, A., Duncan, H. F., Nagendrababu, V., Jaćimović, J., Milašin, J., & Dummer, P. M. H. (2020) · International Endodontic Journal · doi:10.1111/iej.13364 · Cited by 81
Veronese, N., Demurtas, J., Celotto, S., Caruso, M. G., Maggi, S., Bolzetta, F., Firth, J., Smith, L., Schofield, P., Koyanagi, A., et al. (2018) · Clinical Nutrition · doi:10.1016/j.clnu.2018.05.019 · Cited by 73
Coffee drinking and cancer risk: an umbrella review of meta-analyses of observational studies
Zhao, L.-G., Li, Z.-Y., Feng, G.-S., Ji, X.-W., Tan, Y.-T., Li, H.-L., Gunter, M. J., & Xiang, Y.-B. (2020) · BMC Cancer · doi:10.1186/s12885-020-6561-9 · Cited by 69
“Umbrella reviews offer the possibility to understand the strength of evidence and the extent of potential biases for the associations between coffee and cancer incidence [14].”
BackgroundRamezanzade, S., Yates, J. M., Tuminelli, F. J., Keyhan, S. O., Yousefi, P., & López‐López, J. (2021) · Maxillofacial Plastic and Reconstructive Surgery · doi:10.1186/s40902-020-00286-z · Cited by 70
Vital pulp therapy in carious pulp–exposed permanent teeth: an umbrella review
Leong, D. J. X., & Yap, A. U. (2021) · Clinical Oral Investigations · doi:10.1007/s00784-021-03960-2 · Cited by 70
“An umbrella review is an overview of existing systematic reviews [15, 16].”
BackgroundMoggio, L., Alessandro de, S. I. R. E., Marotta, N., Demeco, A., & Ammendolia, A. (2021) · Disability and Rehabilitation · doi:10.1080/09638288.2021.1946175 · Cited by 70
Poveda‐Moral, S., Falcó‐Pegueroles, A., Ballesteros, M., & Bosch-Alcaraz, A. (2021) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12530 · Cited by 80
Barrett, S., Muir, C., Burns, S., Adjei, N. K., Forman, J., Hackett, S., Hirve, R., Kaner, E., Lynch, R., Taylor-Robinson, D. C., et al. (2023) · Trauma Violence & Abuse · doi:10.1177/15248380231153867 · Cited by 79
“The methodological quality of each study included was assessed according to the criteria outlined in the Joanna Brigg’s Institute Critical Appraisal Checklist for Systematic Reviews and Research Syntheses tool (Aromataris et al., 2015).”
MethodThe effectiveness of interventions addressing loneliness in older persons: An umbrella review
Jarvis, M.-A., Padmanabhanunni, A., Balakrishna, Y., & Chipps, J. (2020) · International Journal of Africa Nursing Sciences · doi:10.1016/j.ijans.2019.100177 · Cited by 68
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.