Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 101–200 of 1,014
Fornari Laurindo, L., Aparecido Dias, J., Cressoni Araújo, A., Torres Pomini, K., Machado Galhardi, C., Rucco Penteado Detregiachi, C., Santos de Argollo Haber, L., Donizeti Roque, D., Dib Bechara, M., Vialogo Marques de Castro, M., et al. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1305933 · Cited by 144
Nguyen, P., Le, L. K.-D., Nguyen, D., Gao, L., Dunstan, D. W., & Moodie, M. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-01009-3 · Cited by 135
Leichsenring, F., Abbass, A. A., Heim, N., Keefe, J. R., Kisely, S. R., Luyten, P., Rabung, S., & Steinert, C. (2023) · World Psychiatry · doi:10.1002/wps.21104 · Cited by 171
Introduction to Umbrella Reviews as a Useful Evidence-Based Practice
Choi, G. J., & Kang, H. (2023) · Journal of Lipid and Atherosclerosis · doi:10.12997/jla.2023.12.1.3 · Cited by 164
Effects of Plyometric Training on Physical Performance: An Umbrella Review
Kons, R. L., Orssatto, L. B. R., Dias, J. A., Pauw, K. D., MEEUSEN, R. R., Trajano, G. S., Pupo, J. D., & Detanico, D. (2023) · Sports Medicine - Open · doi:10.1186/s40798-022-00550-8 · Cited by 156
“To summarize the current knowledge on the topic and to identify possible methodological limitations in published meta-analyses, an umbrella review might be conducted [25], as this kind of review is considered on the highest level of the evidence pyramid [26].”
BackgroundMethodThe relationship between job stress and patient safety culture among nurses: a systematic review
Zabin, L. M., Zaitoun, R. S. A., Sweity, E. M., & de Tantillo, L. (2023) · BMC Nursing · doi:10.1186/s12912-023-01198-9 · Cited by 153
“Risk of bias assessment This study used the JBI Critical Appraisal Checklist for Systematic Reviews to assess the methodological quality of a study and to address the possibility of bias [26].”
MethodOlusanya, B. O., Smythe, T., Ogbo, F. A., Nair, M. K. C., Scher, M. S., & Davis, A. C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1122009 · Cited by 153
Getie, ፟., Ayenew, T., Amlak, B. T., Gedfew, M., Edmealem, A., & Kebede, W. M. (2025) · BMC Nursing · doi:10.1186/s12912-025-03266-8 · Cited by 180
Health Benefits of Dietary Whole Grains: An Umbrella Review of Meta-analyses
McRae, M. P. (2017) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.08.008 · Cited by 140
Symeonides, C., Aromataris, E., Mulders, Y. R., Dizon, J. M. R., Stern, C., Barker, T. H., Whitehorn, A., Pollock, D., Marin, T. S., & Dunlop, S. A. (2024) · Annals of Global Health · doi:10.5334/aogh.4459 · Cited by 165
Self-citationCantrell, M. A., Franklin, A. E., Leighton, K., & Carlson, A. (2017) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2017.08.004 · Cited by 156
Fernandez, R. S., Sikhosana, N., Green, H., Halcomb, E., Middleton, R., Alananzeh, I. M., Trakis, S., & Moxham, L. J. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-054528 · Cited by 156
Self-citationReflective Practice in Healthcare Education: An Umbrella Review
Fragkos, K. C. (2016) · Education Sciences · doi:10.3390/educsci6030027 · Cited by 156
“The current review methodology is informed by the guidelines of The Joanna Briggs Institute [10].”
MethodBarriers to older adults seeking sexual health advice and treatment: A scoping review
Ezhova, I., Savidge, L., Bonnett, C., Cassidy, J., Okwuokei, A., & Dickinson, T. (2020) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2020.103566 · Cited by 148
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139
“…how to present the RoB assessments for SRs 1.3.1 Display assessments in table(s) (e.g. overall rating in summary of findings table, and another table with RoB items for each SR) Aromataris 2015 [39, 59]; Becker [4]; Chen 2014 [46]; Hartling 2012 [53]; Smith 2011 [77] 1.3.2 Display assessments…”
InfluentialSocial Determinants of Health and Suicide-Related Outcomes: A Review of Meta-Analyses
Na, P. J., Shin, J., Kwak, H. R., Lee, J., Jester, D. J., Bandara, P., Kim, J. Y., Moutier, C. Y., Pietrzak, R. H., Oquendo, M. A., et al. (2025) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2024.4241 · Cited by 148
Ballard, M., & Montgomery, P. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1229 · Cited by 136
“Some guidelines (Aromataris et al., 2014; Aromataris et al., 2015; Becker and Oxman, 2011; Ryan et al., 2009) indicate that overview findings should not be re-synthesized, and should be presented in tables or figures.”
BackgroundResultInfluentialPrevalence of mental disorders among people who are homeless: An umbrella review
Hossain, M. M., Sultana, A., Tasnim, S., Fan, Q., Ma, P., McKyer, E. L. J., & Purohit, N. (2020) · International Journal of Social Psychiatry · doi:10.1177/0020764020924689 · Cited by 147
Sarcopenia and health-related outcomes: an umbrella review of observational studies
the Special Interest Groups in Systematic Reviews and Meta-analyses for healthy ageing Sarcopenia and Frailty and resilience in older persons of the European Geriatric Medicine Society (EuGMS), Veronese, N., Demurtas, J., Soysal, P., Smith, L., Torbahn, G., Schoene, D., Schwingshackl, L., Sieber, C. C., Bauer, J. M., et al. (2019) · European Geriatric Medicine · doi:10.1007/s41999-019-00233-w · Cited by 141
Selecting and implementing overview methods: implications from five exemplar overviews
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0534-3 · Cited by 134
“These include the QUality Of Reporting Of Meta-analyses (QUOROM) statement [31], Methodological Expectations of Cochrane Intervention Reviews guidance (MECIR) [32] and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, as well as the growing body of guidance specific to overviews […”
MethodWolfenden, L., Barnes, C., Lane, C., McCrabb, S., Brown, H., Gerritsen, S., Barquera, S., Véjar-Rentería, L. S., Munguía, A., & Yoong, S. L. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-01046-y · Cited by 142
“Unlike conventional systematic reviews, which synthesise the findings of individual primary studies, overviews of systematic reviews (also known as ‘umbrella’ reviews) can help to overcome these challenges by assessing and consolidating the findings of systematic reviews and meta-analyses [27].”
BackgroundMethodInfluentialAn Overview of Reviews on Interprofessional Collaboration in Primary Care: Effectiveness
Carron, T., Rawlinson, C., Arditi, C., Cohidon, C., Hong, Q. N., Pluye, P., Gilles, I., & Peytremann‐Bridevaux, I. (2021) · International Journal of Integrated Care · doi:10.5334/ijic.5588 · Cited by 150
“Overviews aim to integrate information from multiple systematic reviews to offer a comprehensive synthesis regarding a specific topic and consider a broader scope than individual systematic reviews [14, 15, 16].”
BackgroundThe effectiveness of case management for cancer patients: an umbrella review
Wang, N., Chen, J., Chen, W., Shi, Z., Yang, H., Liu, P., Wei, X., Dong, X., Wang, C., Mao, L., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08610-1 · Cited by 149
“In this study, we confirmed that the quality of the original reviews were mostly high as assessed by the JBI Critical Appraisal Checklist [15].”
MethodInfluentialModigh, A., Sampaio, F., Moberg, L., & Fredriksson, M. (2021) · Health Policy · doi:10.1016/j.healthpol.2021.07.008 · Cited by 140
Captieux, M., Pearce, G., Parke, H. L., Epiphaniou, E., Wild, S., Taylor, S. J. C., & Pinnock, H. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-024262 · Cited by 132
Balki, E., Hayes, N., & Holland, C. (2022) · JMIR Aging · doi:10.2196/40125 · Cited by 132
Factors influencing diabetes self-management in adults: an umbrella review of systematic reviews
Alexandre, K., Campbell, J., Bugnon, M., Henry, C., Schaub, C., Serex, M., Elmers, J., Desrichard, O., & Peytremann‐Bridevaux, I. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00020 · Cited by 147
Structural stigma and its impact on healthcare for borderline personality disorder: a scoping review
Klein, P., Fairweather‐Schmidt, A. K., & Lawn, S. (2022) · International Journal of Mental Health Systems · doi:10.1186/s13033-022-00558-3 · Cited by 146
“The JBI Checklist for Systematic Reviews and Research Syntheses tool [99] was used to appraise methodological rigor of the reviews; the AGREE II: advancing guideline development, reporting, and evaluation in health care tool [100] was used to appraise the Clinical Practice Guidelines for the management of BPD (referre…”
MethodSamadbeik, M., Staib, A. N., Boyle, J., Khanna, S., Bosley, E., Bodnar, D., Lind, J., Austin, J. A., Tanner, S., Meshkat, Y., et al. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10725-6 · Cited by 131
“Qualitative research synthesis was used, following the guidelines for conducting an umbrella review [46].”
MethodBirken, S. A., Haines, E. R., Hwang, S., Chambers, D. A., Bunger, A. C., & Nilsen, P. (2020) · Implementation Science · doi:10.1186/s13012-020-01040-9 · Cited by 122
“reviews to leverage existing reviews to develop new knowledge, it is possible that our review of reviews [51, 52] was not entirely comprehensive, and we did not independently review methodological quality.”
BackgroundPeriodontal disease and quality of life: Umbrella review of systematic reviews
Wong, L. B., Yap, A. U., & Allen, P. (2020) · Journal of Periodontal Research · doi:10.1111/jre.12805 · Cited by 142
Morris, N. B., Jay, O., Flouris, A. D., Casanueva, A., Gao, C., Foster, J., Havenith, G., & Nybo, L. (2020) · Environmental Health · doi:10.1186/s12940-020-00641-7 · Cited by 110
Jayedi, A., & Shab-Bidar, S. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa029 · Cited by 124
Dragioti, E., Radua, J., Solmi, M., Arango, C., Oliver, D., Cortese, S., Jones, P. B., Il Shin, J., Correll, C. U., & Fusar-Poli, P. (2022) · Molecular Psychiatry · doi:10.1038/s41380-022-01586-8 · Cited by 112
“As umbrella reviews can robustly rank the credibility of the evidence [23], controlling at the same time for several biases [19–22], they are considered at the top of the hierarchy to evaluate epidemiological evidence [18, 24].”
BackgroundResilience of small and medium-sized enterprises in times of crisis: an umbrella review
Koporčić, N., Kukkamalla, P. K., Marković, S., & Maran, T. K. (2025) · Review of Managerial Science · doi:10.1007/s11846-025-00883-0 · Cited by 157
“Addressing this issue requires a comprehensive synthesis of existing knowledge, which can be achieved by following the umbrella review methodology (Aromataris et al. 2015; Moro et al. 2023).”
InfluentialA systematic overview of systematic reviews evaluating medication adherence interventions
Anderson, L. J., Nuckols, T. K., Coles, C., Le, M. M., Schnipper, J. L., Shane, R., Jackevicius, C., Lee, J., Pevnick, J. M., Members of the PHARM-DC Group, et al. (2020) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxz284 · Cited by 122
Yi, M., Wu, X., Zhuang, W., Xia, L., Chen, Y., Zhao, R., Wan, Q., Du, L., & Zhou, Y. (2019) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.201900389 · Cited by 116
Abiramalatha, T., Ramaswamy, V. V., Bandyopadhyay, T., Somanath, S. H., Shaik, N. B., Pullattayil, A. K., & Weiner, G. M. (2022) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2021.6619 · Cited by 122
A hidden pandemic? An umbrella review of global evidence on mental health in the time of COVID-19
Bower, M., Smout, S., Donohoe‐Bales, A., O’Dean, S., Teesson, L., Boyle, J., Lim, D., Nguyen, A., Calear, A. L., Batterham, P. J., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1107560 · Cited by 127
“This umbrella review was registered a priori with PROSPERO (ID: CRD42020223778) and followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and British Medical Journal umbrella review methodological guidelines (14, 15).”
MethodBrunner, R., Friesenbichler, B., Casartelli, N. C., Bizzini, M., Maffiuletti, N. A., & Niedermann, K. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098944 · Cited by 140
Hossain, M. M., Purohit, N., Sultana, A., Ma, P., McKyer, E. L. J., & Ahmed, H. U. (2020) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2020.102041 · Cited by 115
Kasturiratna, K. T. A. S., Hartanto, A., Chen, C. H. Y., Tong, E. M. W., & Majeed, N. M. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02011-6 · Cited by 119
Staffing levels and nursing‐sensitive patient outcomes: Umbrella review and qualitative study
Blume, K. S., Dietermann, K., Kirchner‐Heklau, U., Winter, V., Fleischer, S., Kreidl, L. M., Meyer, G., & Schreyögg, J. (2021) · Health Services Research · doi:10.1111/1475-6773.13647 · Cited by 101
“8 We systematically rated the methodological quality of the included literature reviews and extracted information on each literature review's scope.”
Zhang, Y.-R., Xu, W. M., Zhang, W., Wang, H.-F., Ou, Y., Qu, Y., Shen, X., Chen, S.-D., Wu, K., Zhao, Q., et al. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.07.008 · Cited by 130
Balakrishna, R., Bjørnerud, T., Bemanian, M., Aune, D., & Fadnes, L. T. (2022) · Advances in Nutrition · doi:10.1093/advances/nmac077 · Cited by 123
Getie, A., Ayalneh, M., & Bimerew, M. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06599-5 · Cited by 117
Minimal clinically important difference in Alzheimer's disease: Rapid review
Muir, R. T., Hill, M. D., Black, S. E., & Smith, E. E. (2024) · Alzheimer s & Dementia · doi:10.1002/alz.13770 · Cited by 125
Allen, M. S., & Walter, E. E. (2019) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2019.01.314 · Cited by 116
Veronese, N., Demurtas, J., Pesolillo, G., Celotto, S., Barnini, T., Calusi, G., Caruso, M. G., Notarnicola, M., Reddavide, R., Stubbs, B., et al. (2019) · European Journal of Nutrition · doi:10.1007/s00394-019-01905-w · Cited by 125
Kudrati, S. Z., Hayashi, K., & Taggart, T. (2021) · AIDS and Behavior · doi:10.1007/s10461-021-03287-9 · Cited by 116
Prothero, L., Barley, E., Galloway, J., Georgopoulou, S., & Sturt, J. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2018.03.008 · Cited by 115
“A systematic review of reviews can explain inconsistencies between studies and provide a clearer understanding of the effects of interventions (Smith et al., 2011; Aromataris et al., 2015).”
Wu, T., Zou, Y., Xu, K. D., Jiang, X. R., Zhou, M., Zhang, S. B., & Song, C. (2023) · Public Health · doi:10.1016/j.puhe.2022.11.021 · Cited by 119
Berberine and health outcomes: An umbrella review
Li, Z., Yang, W., Xu, Q., Ma, J., Li, X., Yan, J., Tian, Y., Wen, Y., & Chen, T. (2023) · Phytotherapy Research · doi:10.1002/ptr.7806 · Cited by 119
“In recent years, umbrella reviews have become a valid method to assess the quality of published metaanalyses and summarize the clinical evidence reported in a given domain (Aromataris et al., 2015; Ioannidis, 2009).”
MethodBreast Cancer Primary Prevention and Diet: An Umbrella Review
Buja, A., Pierbon, M., Lago, L., Grotto, G., & Baldo, V. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17134731 · Cited by 138
Imam, A., Obiesie, S., Gathara, D., Aluvaala, J., Maina, M., & English, M. (2023) · Human Resources for Health · doi:10.1186/s12960-023-00807-7 · Cited by 122
“Methods Research design This systematic review was conducted and reported using the PRISMA guidance [28].”
MethodTomayko, E. J., Tovar, A., Fitzgerald, N., Howe, C. L., Hingle, M. D., Murphy, M. P., Muzaffar, H., Going, S. B., & Hubbs‐Tait, L. (2021) · Nutrients · doi:10.3390/nu13093227 · Cited by 126
Gajić, T., Petrović, M. D., Pešić, A. M., Conić, M., & Gligorijević, N. (2024) · Sustainability · doi:10.3390/su16177279 · Cited by 134
“The implementation of modern technology can optimize operations, enhance guest experiences, and improve sustainability [32].”
BackgroundKamau, S., Koskenranta, M., Kuivila, H., Oikarainen, A., Tomietto, M., Juntunen, J., Tuomikoski, A., & Mikkonen, K. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104377 · Cited by 112
“agreed together using the joanna briggs institute critical appraisal tool for systematic reviews and research syntheses (Aromataris et al., 2015).”
BackgroundMethodInfluentialOudbier, S. J., Souget-Ruff, S. P., Chen, B. S. J., Ziesemer, K. A., Meij, H. J., & Smets, E. M. A. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-075833 · Cited by 128
“36 A low-quality article is defined when less than five questions within the assessment have been answered with ‘Yes’.”
BackgroundCabañero-Garcia, E., Martínez-Lacoba, R., García, I. P., & Amo-Saus, E. (2025) · International Journal for Equity in Health · doi:10.1186/s12939-025-02429-y · Cited by 124
“This systematic review followed the principles established by the PRISMA statement of systematic reviews and meta-analyses [32].”
Management of eating disorders for people with higher weight: clinical practice guideline
Ralph, A. F., Brennan, L., Byrne, S., Caldwell, B., Farmer, J., Hart, L. M., Heruc, G. A., Maguire, S., Piya, M. K., Quin, J., et al. (2022) · Journal of Eating Disorders · doi:10.1186/s40337-022-00622-w · Cited by 107
“The quality of systematic reviews and meta-analyses was critically appraised using the JBI critical appraisal checklist for systematic reviews and research syntheses [116].”
MethodAuthor guidelines for conducting systematic reviews and meta‐analyses
Prill, R., Karlsson, J., Ayeni, O. R., & Becker, R. (2021) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-021-06631-7 · Cited by 115
“Scoping reviews [5] or umbrella reviews [6] might be useful, while narrative reviews which do not follow the general guidelines are less useful as they reflect the subjective perspective of an author or authorship group.”
BackgroundSocio-Economic Inequalities in Lung Cancer Outcomes: An Overview of Systematic Reviews
Redondo‐Sánchez, D., Petrova, D., Rodríguez‐Barranco, M., Fernández‐Navarro, P., Jiménez‐Moleón, J. J., & Sánchez, M. (2022) · Cancers · doi:10.3390/cancers14020398 · Cited by 112
Strategies and tactics to reduce the impact of healthcare on climate change: systematic review
Braithwaite, J., Smith, C. L., Leask, E., Wijekulasuriya, S., Brooke-Cowden, K., Fisher, G., Patel, R., Pagano, L., Rahimi‐Ardabili, H., Spanos, S., et al. (2024) · BMJ · doi:10.1136/bmj-2024-081284 · Cited by 121
Remote mental health care interventions during the COVID-19 pandemic: An umbrella review
Witteveen, A. B., Young, S. Y., Cuijpers, P. J., Ayuso‐Mateos, J. L., Barbui, C., Bertolini, F., Cabello, M., Cadorin, C., Downes, N., Franzoi, D., et al. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104226 · Cited by 110
“Although specific inclusion criteria for the aims on health care access and delivery were defined in the protocol, these criteria may not have stipulated clear enough which systematic review types would have been excluded a priori (Aromataris et al., 2015).”
BackgroundPsychosocial experiences of breast cancer survivors: a meta-review
King, R., Stafford, L., Butow, P. N., Giunta, S., & Laidsaar‐Powell, R. (2023) · Journal of Cancer Survivorship · doi:10.1007/s11764-023-01336-x · Cited by 111
Richardson, R., Connell, T., Foster, M., Blamires, J., Keshoor, S., Moir, C., & Zeng, I. S. (2024) · Journal of Youth and Adolescence · doi:10.1007/s10964-024-01969-w · Cited by 105
“The quality assessment of each review used the Joanna Briggs Institute (JBI) “ Critical Appraisal Checklist for Systematic Reviews and Research Synthesis (Aromataris et al., 2015).”
MethodLa revisión sistemática: pluralidad de enfoques y metodologías
Sobrido, M., & Prieto, J. M. R. (2018) · Enfermería Clínica · doi:10.1016/j.enfcli.2018.08.008 · Cited by 122
Efficacy and safety of osteopathic manipulative treatment: an overview of systematic reviews
Bagagiolo, D., Rosa, D., & Borrelli, F. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-053468 · Cited by 127
Pollock, A., Campbell, P., Deery, R., Fleming, M. P., Rankin, J., Sloan, G., & Cheyne, H. (2017) · Journal of Advanced Nursing · doi:10.1111/jan.13253 · Cited by 117
“2012) and including the essential elements for overviews of reviews including non-quantitative data (Aromataris et al. 2015).”
BackgroundMethodCompassionate collaborative care: an integrative review of quality indicators in end-of-life care
Pfaff, K., & Markaki, A. (2017) · BMC Palliative Care · doi:10.1186/s12904-017-0246-4 · Cited by 91
“We believed this was necessary for users to be able to interpret the usefulness and transferability of the review findings to practice and policy [29].”
BackgroundMartínez-Calderón, J., Flores-Cortés, M., Morales‐Asencio, J. M., & Luque-Suárez, A. (2020) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000838 · Cited by 113
Lee, K. H., Seong, H. J., Kim, G., Jeong, G. H., Kim, J. Y., Park, H., Jung, E., Kronbichler, A., Eisenhut, M., Stubbs, B., et al. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa055 · Cited by 109
“An umbrella review is a type of meta-analysis designed to provide a conclusive summary of reports highlighting the level of evidence (44).”
BackgroundDeep Machine Learning for Oral Cancer: From Precise Diagnosis to Precision Medicine
Alabi, R. O., Almangush, A., Elmusrati, M. S., & Mäkitie, A. A. (2022) · Frontiers in Oral Health · doi:10.3389/froh.2021.794248 · Cited by 113
“FIGURE 1 | A simplified illustration of a deep learning algorithm architecture with an input data ([9], figure modified).”
BackgroundKishita, N., Backhouse, T., & Mioshi, E. (2020) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/0891988719856690 · Cited by 103
“Details of the included reviews were synthesized following the recent guidelines for conducting an overview of systematic reviews.(16) Assessment of Methodological Quality of Included Reviews Two authors (N.”
BackgroundMethodNature’s Role in Outdoor Therapies: An Umbrella Review
Harper, N. J., Fernee, C. R., & Gabrielsen, L. E. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18105117 · Cited by 110
“An umbrella review [22] was chosen to provide an overview of the guiding theoretical frameworks drawn upon in the outdoor therapy literature through an overall examination of the body of systematic and analytic reviews.”
MethodResultLindekilde, N., Rutters, F., Henriksen, J. E., Lasgaard, M., Schram, M. T., Rubin, K. H., Kivimäki, M., Nefs, G., & Pouwer, F. (2021) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2021.108855 · Cited by 106
“tematic reviews, by systematically collecting and evaluating existing summary information [18,19].”
BackgroundRapid reviews and the methodological rigor of evidence synthesis: a JBI position statement
Tricco, A. C., Khalil, H., Holly, C. M., Feyissa, G. T., Godfrey, C., Evans, C., Sawchuck, D., Sudhakar, M., Asahngwa, C., Stannard, D., et al. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00371 · Cited by 113
Self-citationSmith, L., Luchini, C., Demurtas, J., Soysal, P., Stubbs, B., Hamer, M., Nottegar, A., Lawlor, R. T., Lopez-Sanchez, G. F., Firth, J., et al. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2019.02.003 · Cited by 97
Eslahi, A. V., Badri, M., Khorshidi, A., Majidiani, H., Hooshmand, E., Hosseini, H., Taghipour, A., Foroutan, M., Pestehchian, N., Firoozeh, F., et al. (2020) · BMC Infectious Diseases · doi:10.1186/s12879-020-4759-8 · Cited by 101
Intersectoral and multisectoral approaches to health policy: an umbrella review protocol
Amri, M. M., Chatur, A., & O'Campo, P. J. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00826-1 · Cited by 110
“More specifically, an umbrella review summarizes across research syntheses; it does not resummarize existing reviews [23].”
BackgroundOtero-Ketterer, E., Peñacoba, C., Pinheiro, C. F., Valera‐Calero, J. A., & Ortega‐Santiago, R. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191610145 · Cited by 109
“We followed the Umbrella Review Methodology Working Group [16] and considered the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) recommendations [17] (Supplementary Table S1: PRISMA checklist).”
MethodA systematic meta-review of systematic reviews on attention deficit hyperactivity disorder
Chaulagain, A., Lyhmann, I., Halmøy, A., Widding‐Havneraas, T., Nyttingnes, O., Bjelland, I., & Mykletun, A. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2451 · Cited by 111
Database combinations to retrieve systematic reviews in overviews of reviews: a methodological study
Goossen, K., Hess, S., Lunny, C., & Pieper, D. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00983-3 · Cited by 85
Brain, J., Greene, L., Tang, E. Y. H., Louise, J., Salter, A. B., Beach, S., Turnbull, D. A., Siervo, M., Stephan, B. C. M., & Tully, P. J. (2023) · Frontiers in Epidemiology · doi:10.3389/fepid.2023.1095236 · Cited by 103
Majidinia, S., Shirazi, A. S., Boruziniat, A., & Riahi, N. (2024) · Journal of lasers in medical sciences · doi:10.34172/jlms.2024.41 · Cited by 99
Okuhara, T., Furukawa, E., Okada, H., Yokota, R., & Kiuchi, T. (2025) · Patient Education and Counseling · doi:10.1016/j.pec.2025.108656 · Cited by 99
Bariatric surgery and mental health outcomes: an umbrella review
Law, S., Dong, S., Zhou, F., Zheng, D., Wang, C., & Dong, Z. (2023) · Frontiers in Endocrinology · doi:10.3389/fendo.2023.1283621 · Cited by 113
Wassenaar, T. M., Williamson, W., Johansen-Berg, H., Dawes, H., Roberts, N., Foster, C., & Sexton, C. E. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-00959-y · Cited by 97
“While a systematic review of reviews allows for an evaluation of the field and provide recommendations for future research and policy [71], it does not allow for a detailed discussion of primary studies.”
BackgroundFish consumption and multiple health outcomes: Umbrella review
Li, N., Wu, X., Zhuang, W., Xia, L., Chen, Y., Wu, C., Rao, Z., Du, L., Zhao, R., Yi, M., et al. (2020) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2020.02.033 · Cited by 113
Diabetes comorbidities in low- and middle-income countries: An umbrella review
Lam, A. A., Lepe, A., Wild, S. H., & Jackson, C. (2021) · Journal of Global Health · doi:10.7189/jogh.11.04040 · Cited by 104
Yin, J.-L., Yang, J., Song, X., Qin, X., Chang, Y.-J., Chen, X., Liu, F.-H., Li, Y.-Z., Xu, H.-L., Wei, Y., et al. (2024) · Cardiovascular Diabetology · doi:10.1186/s12933-024-02241-y · Cited by 107
“For each association from eligible meta-analysis, we extracted the data from the original studies and recalculated the adjusted summary effect sizes and corresponding 95% CIs using random effects models [20, 26].”
BackgroundMethodEndodontic Treatment in Single and Multiple Visits: An Overview of Systematic Reviews
Moreira, M. S., Neres-Santiago, A. S., Tedesco, T. K., dos Santos, M., & Morimoto, S. (2017) · Journal of Endodontics · doi:10.1016/j.joen.2017.01.021 · Cited by 117
Teachers’ role in digitalizing education: an umbrella review
Wohlfart, O., & Wagner, I. (2023) · Educational technology research and development · doi:10.1007/s11423-022-10166-0 · Cited by 96
“Next, the methodological quality of the remaining 34 articles was assessed with an appraisal checklist based on the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses (Aromataris et al., 2015; Moher et al., 2009) as well as Gessler and Siemer (2020).”
BackgroundMethodResultInfluentialPapola, D., Ostuzzi, G., Gastaldon, C., Morgano, G. P., Dragioti, E., Carvalho, A. F., Fusar‐Poli, P., Correll, C. U., Solmi, M., & Barbui, C. (2019) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13066 · Cited by 98
“been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, thereby providing decision-makers in health care with the evidence they need (8).”
BackgroundMethodApplication of Virtual and Augmented Reality Technology in Hip Surgery: Systematic Review
Sun, P., Zhao, Y., Men, J., Ma, Z.-R., Jiang, H.-Z., Liu, C., & Feng, W. (2022) · Journal of Medical Internet Research · doi:10.2196/37599 · Cited by 107
“The quality of all the studies including real patients was then assessed using the Joanna Briggs Institute Critical Appraisal Checklist [14].”
McCready, J. L., Nichol, B., Steen, M., Unsworth, J., Comparcini, D., & Tomietto, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280439 · Cited by 102
“Accordingly, the inclusion and exclusion criteria focused on the research aim and questions of this umbrella review [17].”
BackgroundMethodInfluentialMancin, S., Sguanci, M. E., Andreoli, D., Soekeland, F., Anastasi, G., Piredda, M., & Marinis, M. G. D. (2023) · MethodsX · doi:10.1016/j.mex.2023.102532 · Cited by 107
“This research design draws upon the methodology proposed by Aromataris et al. [23] and further integrates the methodology by Smith et al. [15] to encompass systematic reviews not included in the identified guidelines.”
MethodAmeyaw, E. K., Amoah, P. A., & Ezezika, O. C. (2024) · Journal of Medical Internet Research · doi:10.2196/49510 · Cited by 112
“Each of the authors (EKA, PAA, and OE) independently assessed the quality of the reviews using the critical appraisal instrument for systematic reviews and research synthesis by the Joanna Briggs Institute (Multimedia Appendix 3 [38]).”
MethodOvercoming challenges in nursing disaster preparedness and response: an umbrella review
Thobaity, A. A. (2024) · BMC Nursing · doi:10.1186/s12912-024-02226-y · Cited by 96
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.