Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 601–700 of 1,014
Shrestha, T., Chi, C. V. Y., Cassarino, M., Foley, S., & Blasi, Z. D. (2025) · Environment International · doi:10.1016/j.envint.2024.109217 · Cited by 40
Kristoffersen, E., Hjort, S. L., Thomassen, L. M., Arjmand, E. J., Perillo, M., Balakrishna, R., Onni, A. T., Sletten, I. S. K., Lorenzini, A., & Fadnes, L. T. (2025) · Nutrients · doi:10.3390/nu17040662 · Cited by 39
“Umbrella reviews summarize systematic reviews and meta-analyses, providing condensed information on a research-dense topic and the highest quality of evidence currently available within a research topic [12].”
Bilican, S., Irfan, M., Cox, A., Salaets, H., Sabbe, M. B., & Schoenmakers, B. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-096267 · Cited by 35
English, R., Peer, N., Honikman, S., Tugendhaft, A., & Hofman, K. J. (2017) · Global Health Action · doi:10.1080/16549716.2017.1340396 · Cited by 39
“Umbrella reviews summarise and present findings of existing SRs and MAs,[18] and are promoted by the Joanna Briggs Institute (JBI).[19,20] The methodology is similar to that proposed by the Cochrane Collaboration for synthesising results from multiple SRs.”
MethodUsing the Methodology of Systematic Review of Reviews for Evidence-Based Medicine
Hasanpoor, E., Hallajzadeh, J., Siraneh, Y., Hasanzadeh, E., & Haghgoshayie, E. (1970) · Ethiopian Journal of Health Sciences · doi:10.4314/ejhs.v29i6.15 · Cited by 36
“A meta-review’s most important feature is that this type of evidence synthesis only assumes for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses (13, 15, 23).”
BackgroundInfluentialLocal, non-systemic, and minimally invasive therapies for calcinosis cutis: a systematic review
Nowaczyk, J., Zawistowski, M., & Fiedor, P. S. (2021) · Archives of Dermatological Research · doi:10.1007/s00403-021-02264-5 · Cited by 35
Nie, X., Liu, X., Wang, C., Wu, Z., Sun, Z., Su, J., Yan, R., Peng, Y., Yang, Y., Wang, C., et al. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-04600-7 · Cited by 37
“Methods This review was conducted according to the rules for conducting umbrella reviews and published approach [16, 17], and was reported in accordance with the Systematic Reviews and Meta-analysis (PRISMA 2020) statement [18] and Meta-analysis of Observational Studies in Epidemiology (MOOSE) guidelines [19].”
MethodHossain, M. M., Sultana, A., Ma, P., Fan, Q., Sharma, R., Purohit, N., & Sharmin, D. F. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4r3mh · Cited by 38
Systematic Reviews in Educational Research: Methodology, Perspectives and Application
(2020) · doi:10.1007/978-3-658-27602-7 · Cited by 467
“For example, care is required when assessing the way in which the source systematic reviews identified and selected data for inclusion, assessed study quality and to assess the overlap between the individual reviews (Aromataris et al. 2015).”
BackgroundGoel, S., Shabil, M., Kaur, J., Chauhan, A., & Rinkoo, A. V. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-080274 · Cited by 37
“20 The purpose of this umbrella review is to evaluate the impact of ENDS on health and its efficacy and safety in tobacco cessation.”
BackgroundIncidence of lymphedema related to various cancers
Letellier, M.-È., Ibrahim, M., Towers, A., & Chaput, G. (2024) · Medical Oncology · doi:10.1007/s12032-024-02441-2 · Cited by 36
“Of the 13 JBI critical tools available, checklists for case controls [21], prevalence studies [22], randomized controlled trials [23], and systemic reviews [24] were utilized to assess these 68 studies.”
MethodHuff, N. R., Dunderdale, L., Kellogg, A. J., & Isbell, L. M. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102504 · Cited by 36
Rouyard, T., Yoda, E., Akksilp, K., Dieterich, A. V., Sarin, K. C., Dabak, S. V., & Müller, A. M. (2025) · The Lancet Public Health · doi:10.1016/s2468-2667(25)00038-6 · Cited by 35
Self‐reported prognostic factors in adults reporting neck or low back pain: An umbrella review
Mansell, G., Wynne‐Jones, G., Hill, J. C., Stynes, S. M., & van der Windt, D. (2021) · European Journal of Pain · doi:10.1002/ejp.1782 · Cited by 34
“As the number of published umbrella reviews has increased, guidance on their conduct and reporting has also been developed (Aromataris et al., 2015; Smith et al., 2011).”
BackgroundLim, S., Park, S., Koyanagi, A., Yang, J. W., Jacob, L., Yon, D. K., Lee, S. W., Kim, M. S., Shin, J. I., & Smith, L. (2022) · Pharmacological Research · doi:10.1016/j.phrs.2021.106052 · Cited by 35
Review of Microgels for Enhanced Oil Recovery: Properties and Cases of Application
Rozhkova, Y. A., Burin, D. A., Galkin, S., & Yang, H. (2022) · Gels · doi:10.3390/gels8020112 · Cited by 36
Li, Y.-Z., Yang, Z., Gong, T., Liu, Y., Liu, F.-H., Wen, Z.-Y., Li, X., Gao, C., Luan, M., Zhao, Y., et al. (2022) · Food & Function · doi:10.1039/d1fo03094a · Cited by 35
Economic change and population health: lessons learnt from an umbrella review on the Great Recession
Backhaus, I., Hoven, H., Tecco, C. D., Iavicoli, S., Conte, A., & Dragano, N. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060710 · Cited by 35
Risk factors for gastric cancer: A comprehensive analysis of observational studies
Hui, Y., Tu, C., Liu, D., Zhang, H., & Gong, X. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2022.892468 · Cited by 40
“Therefore, the aim of this comprehensive analysis is to provide a comprehensive overview and assess the strength, credibility, and classification of the existing epidemiological evidence examining the association between non-genetic factors and GC risk (9).”
LIN, G. S. S., CHAN, D. Z. K., LEE, H. Y., LOW, T. T., LAER, T. S., PILLAI, M. P. M., YEW, Y. Q., & WAFA, S. W. W. S. S. T. (2022) · Journal of Evidence-Based Dental Practice · doi:10.1016/j.jebdp.2022.101723 · Cited by 33
Pathomwichaiwat, T., Jinatongthai, P., Prommasut, N., Ampornwong, K., Rattanavipanon, W., Nathisuwan, S., & Thakkinstian, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288997 · Cited by 211
Okella, H., Tonooka, K. H., & Okello, E. (2023) · Pathogens · doi:10.3390/pathogens12091178 · Cited by 38
“Data were then extracted using the guidance for conducting systematic scoping reviews [35,36].”
MethodEquity in prenatal healthcare services globally: an umbrella review
Ladak, Z., Grewal, N., Kim, M. O., Small, S. L., Leber, A., Hemani, M., Sun, Q., Hamza, D. M., Laur, C. V., Ivers, N. M., et al. (2024) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-024-06388-0 · Cited by 45
“An umbrella review (also termed “overview of reviews” or “review of reviews”) consolidates the content captured in systematic reviews and meta-analyses [24–28].”
BackgroundHealth Outcomes Associated with Olive Oil Intake: An Umbrella Review of Meta-Analyses
Chiavarini, M., Rosignoli, P., Giacchetta, I., & Fabiani, R. (2024) · Foods · doi:10.3390/foods13162619 · Cited by 36
“Instead, in this review, we used the umbrella review methodology (i.e., the syntheses of existing systematic reviews with meta-analyses) [27–29] to capture the full spectrum of outcomes associated with olive oil intake and to systematically assess the quality and strength of the evidence across all…”
MethodLiu, Y., Zhao, G., Guo, J., Qu, H., Kong, L., & Yue, W. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.09.074 · Cited by 37
Tewari, N., Devi, P., Sampath, S., Mathur, V. P., Tsilingaridis, G., Wikström, A., Rahul, M., & Bansal, K. (2024) · Dental Traumatology · doi:10.1111/edt.13028 · Cited by 35
Digital Devices Use and Sleep in Adolescents: An Umbrella Review
Fiore, M., Arena, D., Crisafi, V., Grieco, V., Palella, M., Timperanza, C., Conti, A., Cuffari, G., & Ferrante, M. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22101517 · Cited by 39
“We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement [21] and a methodological guidance [22] to perform this umbrella review.”
Inoue, M., & Tsugane, S. (2019) · Current Nutrition Reports · doi:10.1007/s13668-019-0274-1 · Cited by 33
Siqueira, T. C., Dominski, F. H., & Andrade, A. (2019) · Haemophilia · doi:10.1111/hae.13868 · Cited by 35
Low-calorie sweeteners and human health: a rapid review of systematic reviews
Andrade, L., Lee, K. M., Sylvetsky, A. C., & Kirkpatrick, S. I. (2020) · Nutrition Reviews · doi:10.1093/nutrit/nuaa123 · Cited by 33
Carrera, F. J. R., Ques, Á. A. M., & Clavería, A. (2021) · Primary care diabetes · doi:10.1016/j.pcd.2021.07.004 · Cited by 37
Analysis of Gender-Based Inequality in Cardiovascular Health: An Umbrella Review
Bosomworth, J., & Khan, Z. U. (2023) · Cureus · doi:10.7759/cureus.43482 · Cited by 34
Occupational Therapy in Fatigue Management in Multiple Sclerosis: An Umbrella Review
Salomè, A., D’Elia, T. S., Franchini, G., Santilli, V., & Paolucci, T. (2019) · Multiple Sclerosis International · doi:10.1155/2019/2027947 · Cited by 34
“Information obtained from all reviews included publication and search date, objectives, characteristics of included studies and study subjects, intervention, findings/patient outcomes in the review, and limitations [24].”
BackgroundAbraha, I., Bonacini, I., Montedori, A., Renzo, G. C. D., Angelozzi, P., Micheli, M., Germani, A., Carloni, D., Scaccetti, A., Palmieri, G., et al. (2019) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12344 · Cited by 35
“Rounds of the consultationwere performed as necessary and at the final stage outcomes were rated as: critical (score 7-9), important but not critical (score 4-6), or low importance (1-3).”
BackgroundStearns, J. A., Avedzi, H. M., Yim, D., Spence, J. C., Labbaf, F., Lamboglia, C. G., Ko, F., Farmer, C., Lytvyak, E., Kennedy, M., et al. (2023) · Public health reviews · doi:10.3389/phrs.2023.1605474 · Cited by 33
“The review was guided by the Joanna Briggs Institute (JBI) methodology for conducting umbrella reviews [31], and other umbrella review [32, 33] and systematic review recommendations [34].”
MethodMontreuil, M., Camden, C., Genest, C., Gilbert, E., Laberge‐Perrault, E., Piché, G., Rassy, J., Bogossian, A., Gendron‐Cloutier, L., & Barbo, G. (2023) · Journal of Child Health Care · doi:10.1177/13674935231165554 · Cited by 34
“Reviews that didn ’ t meet at least fi ve out of 10 criteria from the JBI ’ s critical appraisal checklist for systematic reviews were also excluded at this stage (Aromataris et al., 2015).”
Pain assessment tools for use in infants: a meta-review
Arabiat, D. H., Mörelius, E., Hoti, K., & Hughes, J. (2023) · BMC Pediatrics · doi:10.1186/s12887-023-04099-7 · Cited by 34
“Meta-reviews, also known as systematic reviews of systematic reviews, provide a rigorous approach for synthesizing evidence from available systematic reviews and summarizing knowledge into one accessible document [12].”
BackgroundMethodThe Benefits of Cochlear Implantation for Adults: A Systematic Umbrella Review
Tang, D., Tran, Y., Lo, C., Lee, J. N., Turner, J., McAlpine, D., McMahon, C. M., & Gopinath, B. (2024) · Ear and Hearing · doi:10.1097/aud.0000000000001473 · Cited by 33
“This decision aligns with traditional umbrella reviews which only assess data from systematic reviews (Aromataris et al. 2015).”
BackgroundMertkan, Ş., & Gümüş, S. (2024) · Educational Management Administration & Leadership · doi:10.1177/17411432241291197 · Cited by 35
“…frameworks used in umbrella reviews concentrate either on synthesising the fi ndings on a particular topic to assess whether the results of existing systematic reviews provide a consistent or contradictory evidence base (Aromataris et al., 2015) or on methodological aspects (Hallinger, 2014).”
Gaveikaite, V., Grundstrom, C., Winter, S., Chouvarda, I., Maglaveras, N., & Priori, R. (2019) · Respiratory Medicine · doi:10.1016/j.rmed.2019.09.005 · Cited by 36
Low-Bacterial Diet in Cancer Patients: A Systematic Review
Matteucci, S., Pasquale, G. D., Pastore, M., Morenghi, E., Pipitone, V., Soekeland, F., Caccialanza, R., Mazzoleni, B., & Mancin, S. (2023) · Nutrients · doi:10.3390/nu15143171 · Cited by 34
Liu, H., Shivgulam, M. E., Schwartz, B. D., Kimmerly, D. S., & O'Brien, M. W. (2023) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00249.2023 · Cited by 33
Wu, J., Liu, Z., Shen, D., Luo, Z., Xiao, Z., Liu, Y., & Huang, H. (2022) · Nursing Open · doi:10.1002/nop2.1317 · Cited by 31
“Systematic reviews considered eligible for inclusion were appraised for their methodological quality using the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Synthesis (Aromataris et al., 2015).”
MethodEvidence-Based Dietary Practices to Improve Osteoarthritis Symptoms: An Umbrella Review
Buck, A. N., Vincent, H. K., Newman, C. B., Batsis, J. A., Abbate, L. M., Huffman, K. F., Bodley, J., Vos, N. D., Callahan, L. F., & Shultz, S. P. (2023) · Nutrients · doi:10.3390/nu15133050 · Cited by 34
“The ability to evaluate a large body of information provides a comprehensive summary highlighting the current evidence base [61].”
BackgroundVecchia, M., Sacchi, P., Marvulli, L. N., Ragazzoni, L., Muzzi, A., Polo, L., Bruno, R., & Salio, F. (2025) · Healthcare · doi:10.3390/healthcare13010082 · Cited by 37
“Given the heterogeneity of the studies included in this review, bias was assessed qualitatively using Joanna Briggs Institute’s critical appraisal checklists [10].”
Associations Between Stroke Localization and Delirium: A Systematic Review and Meta-Analysis
Rhee, J. Y., Colman, M., Mendu, M., Shah, S. J., Fox, M., Rost, N. S., & Kimchi, E. Y. (2021) · Journal of Stroke and Cerebrovascular Diseases · doi:10.1016/j.jstrokecerebrovasdis.2021.106270 · Cited by 36
Stephenson, M., Lisy, K., Stern, C., Feyer, A.-M., Fisher, L., & Aromataris, E. (2018) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000151 · Cited by 35
Self-citationDance movement therapy with older people with a psychiatric condition: A systematic review
Jiménez, J., Bräuninger, I., & Meekums, B. (2018) · The Arts in Psychotherapy · doi:10.1016/j.aip.2018.11.008 · Cited by 33
A typology of systematic reviews for synthesising evidence on health care
MacEntee, M. I. (2019) · Gerodontology · doi:10.1111/ger.12439 · Cited by 32
Effectiveness of stepped care for mental health disorders: An umbrella review of meta-analyses
Jeitani, A., Fahey, P. P., Gascoigne, M., Darnal, A., & Lim, D. (2024) · Personalized Medicine in Psychiatry · doi:10.1016/j.pmip.2024.100140 · Cited by 30
An umbrella review on the use of antipsychotics in anxiety disorders: A registered report protocol
Garakani, A., Freire, R. C. R., Buono, F. D., Thom, R. P., Larkin, K., Funaro, M. C., Salehi, M., & Pérez-Rodríguez, M. M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0269772 · Cited by 31
“The umbrella review protocol is informed by the framework described by the Joanna Briggs Institute [27].”
MethodTranexamic acid in total hip arthroplasty: An umbrella review on efficacy and safety
Ghorbani, M., Sadrian, S. H., Ghaderpanah, R., Neitzke, C. C., Chalmers, B. P., Esmaeilian, S., Rahmanipour, E., & Parsa, A. (2024) · Journal of Orthopaedics · doi:10.1016/j.jor.2024.03.010 · Cited by 30
Bourke, E., Rawstorn, J. C., Maddison, R., & Blakely, T. A. (2024) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2024.102866 · Cited by 37
“The quality of systematic reviews was assessed separately for reviews of RCTs (Assessment of Multiple Systematic Review 2 (AMSTAR 2) (Beverley et al., 2017) and cohort studies (JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses) (Aromataris et al., 2015).”
MethodSmit, A. K., Gokoolparsadh, A., McWhirter, R., Newett, L., Milch, V., Hermes, A., McInerney-Leo, A. M., & Newson, A. J. (2024) · Genetics in Medicine · doi:10.1016/j.gim.2024.101270 · Cited by 30
Effects of physical exercise in reducing caregivers burden: a systematic review
Cardoso, C., Landeiro, M. J. L., & Martins, T. V. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1474913 · Cited by 34
A Systematic Review of Intracranial Aneurysms in the Pregnant Patient ― A Clinical Conundrum
Nussbaum, E. S., Goddard, J. K., & Davis, A. R. (2020) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2020.08.048 · Cited by 33
Can we prevent poststroke cognitive impairment? An umbrella review of risk factors and treatments
Obaid, M. S., Douiri, A., Flach, C., Prasad, V., & Marshall, I. J. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037982 · Cited by 32
Jayawardena, R., Swarnamali, H., Ranasinghe, P. D., & Misra, A. (2021) · Diabetes & Metabolic Syndrome Clinical Research & Reviews · doi:10.1016/j.dsx.2021.02.032 · Cited by 34
Harrison, M., Gardiner, C., Taylor, B. H., Ejegi‐Memeh, S., & Darlison, L. (2021) · Palliative Medicine · doi:10.1177/02692163211007379 · Cited by 30
Bunn, M., Gonzalez, N., Falek, I., Weine, S. M., & Acri, M. C. (2021) · Intervention · doi:10.4103/intv.intv_47_20 · Cited by 41
“We followed Aromataris et al. (2015) guidelines for an umbrella review which include the following steps: (a) a priori research questions; (b) detailed inclusion criteria including intervention, population, context and outcomes of interest; (c) identifying relevant studies; (d) selecting eligible…”
MethodAn evidence-based framework for determining the optimal amount of intervention for autistic children
Trembath, D., Waddington, H. L., Sulek, R., Varcin, K., Bent, C. A., Ashburner, J. K., Eapen, V., Goodall, E., Hudry, K., Silove, N., et al. (2021) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(21)00285-6 · Cited by 30
Yaghmour, S. M. (2021) · Nursing Open · doi:10.1002/nop2.1106 · Cited by 36
“Regarding the systematic reviews that were included, the JBI checklist (Aromataris et al., 2015) found six articles were of high quality, while two were good.”
MethodPatton, D., Latimer, S. L., Avşar, P., Walker, R., Moore, Z. E. H., Gillespie, B. M., O’Connor, T., Nugent, L., Budri, A., Brien, N. O., et al. (2021) · Australian Critical Care · doi:10.1016/j.aucc.2021.10.003 · Cited by 32
Bellon, F., Beti‐Abad, A., Pastells‐Peiró, R., Casado‐Ramírez, E., Moreno‐Casbas, T., Gea‐Sánchez, M., & Abad‐Corpa, E. (2022) · Journal of Clinical Nursing · doi:10.1111/jocn.16251 · Cited by 33
Soysal, P., Veronese, N., Ippoliti, S., Pizzol, D., Carrie, A. M., Stefanescu, S., Sánchez, G. F. L., Barnett, Y., Butler, L. T., Koyanagi, A., et al. (2023) · Aging Clinical and Experimental Research · doi:10.1007/s40520-022-02336-0 · Cited by 33
Andrews, V., Zammit, G., & O’Leary, F. (2023) · Nutrition Reviews · doi:10.1093/nutrit/nuad013 · Cited by 33
“29 Piloting was conducted by reviewers at each stage of the study selection, data extraction, and quality assessment.”
MethodKhoujah, D., Naples, J. G., Silva, L. O. J. E., Edlow, J. A., Gerberi, D., Carpenter, C. R., & Bellolio, F. (2023) · Academic Emergency Medicine · doi:10.1111/acem.14739 · Cited by 33
Vila-Fariñas, A., Pérez‐Ríos, M., Montes, A., Ruano‐Raviña, A., Forray, A., Rey‐Brandariz, J., Candal‐Pedreira, C., Fernández, E., Acción, B. C., & Varela‐Lema, L. (2023) · Addictive Behaviors · doi:10.1016/j.addbeh.2023.107854 · Cited by 32
Amare, T., & Getinet, W. (2019) · Journal of Mental Health · doi:10.1080/09638237.2019.1677871 · Cited by 34
“The abilities of each of the finding reports in systematic review were assessed by using a checklist adjusted from Joanna Briggs Institute (JBI) Critical Appraisal for Study Papers (Aromataris et al., 2015).”
MethodHill, N. R., Sandler, B. C., Bergrath, E., Milenković, D., Ashaye, A. O., Farooqui, U., & Cohen, A. T. (2020) · Clinical and Applied Thrombosis/Hemostasis · doi:10.1177/1076029619898764 · Cited by 30
“Therefore, in this study, we have conducted a comprehensive evidence review that includes both a summary of RWE alongside an umbrella review, a standardized and systematic collection of data from systematic reviews or NMAs which summarizes the breadth of the literature for a given topic and brings together a summary o…”
MethodSteinert, C., Heim, N., & Leichsenring, F. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.736776 · Cited by 29
Carnovale, C., Battini, V., Santoro, C., Riccio, M. P., Carucci, S., Nobile, M., Formisano, P., Bravaccio, C., Zuddas, A., Clementi, E., et al. (2023) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2023.04.018 · Cited by 30
Efficacy and safety of hepatitis B vaccine: an umbrella review of meta-analyses
Qiu, J., Zhang, S., Feng, Y., Su, X., Cai, J., Chen, S., Liu, J., Huang, S., Huang, H., Zhu, S., et al. (2023) · Expert Review of Vaccines · doi:10.1080/14760584.2023.2289566 · Cited by 32
“Umbrella reviews can provide summaries of evidence from multiple systematic reviews covering different populations, research questions, or time periods [21].”
Pressure injury prevention measures: overview of systematic reviews
Pott, F. S., Méier, M. J., Stocco, J. G. D., Petz, F. D. F. C., Roehrs, H., & Ziegelmann, P. K. (2023) · Revista da Escola de Enfermagem da USP · doi:10.1590/1980-220x-reeusp-2023-0039en · Cited by 39
Public participation in healthcare students' education: An umbrella review
Nowell, L. S., Keogh, B., Laios, E., McKendrick-Calder, L. A., Molitor, W. L., & Wilbur, K. (2024) · Health Expectations · doi:10.1111/hex.13974 · Cited by 29
Stunden, A., Ginige, J. A., O’Reilly, R., Sanagavarapu, P., Heaton, L., & Jefferies, D. (2024) · Nurse Education in Practice · doi:10.1016/j.nepr.2024.103908 · Cited by 34
Mantovani, E., Martini, A., Dinoto, A., Zucchella, C., Ferrari, S., Mariotto, S., Tinazzi, M., & Tamburin, S. (2024) · npj Parkinson s Disease · doi:10.1038/s41531-024-00823-x · Cited by 30
“The retrieved SRs and MAs were grouped according to the population of interest at review level (i.e., patients with PD) and the type of biomarkers (i.e., neuroimaging, neurophysiological, bio fl uids, genetics).”
MethodInfluentialEffectiveness of Irrigation Protocols in Endodontic Therapy: An Umbrella Review
Orozco-Gallego, M. J., Pineda‐Vélez, E., Rojas‐Gutiérrez, W. J., Rodríguez, M. L. R., & Agudelo‐Suárez, A. A. (2025) · Dentistry Journal · doi:10.3390/dj13060273 · Cited by 29
“For study purposes, an umbrella review was conducted following the methodology recommended by the Joanna Briggs Institute (Adelaide, Australia), using a protocol for systematic reviews applied for a comprehensive overview of SR and meta-analysis (SR–MA) research [23].”
Brady, M., Ali, M., VandenBerg, K., Williams, L. J., Williams, L. R., Abo, M., Becker, F., Bowen, A., Brandenburg, C., Breitenstein, C., et al. (2019) · Aphasiology · doi:10.1080/02687038.2019.1643003 · Cited by 33
“We will extract information on the methodological quality of each primary research dataset included in RELEASE (Aromataris et al., 2015).”
MethodHoshijima, H., Wajima, Z., Nagasaka, H., & Shiga, T. (2019) · Medicine · doi:10.1097/md.0000000000017712 · Cited by 29
“Meta-analysis of meta-analyses (umbrella review) was conducted according to the practical guidance published by Aromataris et al[18] and Fusar-Poli et al[19] For reanalysis of each metaanalysis from the original cohort studies, we followed the reporting guidelines for Meta-analyses Of Observational Studies in Epidemio…”
MethodInfluentialPlatelet-rich plasma for sports-related muscle, tendon and ligament injuries: an umbrella review.
Cruciani, M., Franchini, M., Mengoli, C., Marano, G., Pati, I., Masiello, F., Profili, S., Veropalumbo, E., Pupella, S., Vaglio, S., et al. (2019) · Blood transfusion · doi:10.2450/2019.0274-19 · Cited by 37
Factors influencing inpatients perception of psychiatric hospitals: A meta-review of the literature
Modini, M., Burton, A. L., & Abbott, M. J. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.10.020 · Cited by 30
Stress and Anxiety Levels in Couples who Undergo Fertility Treatment: a Review of Systematic Reviews
Paraskevi, L., Sarantaki, A., & Gourounti, K. (2021) · Materia Socio Medica · doi:10.5455/msm.2021.33.60-64 · Cited by 29
“By creating an umbrella review, we are able to summarize the findings of the available systematic reviews (8), which provide a wide scope on the psychological effects of infertility on the couples and on their pregnancy outcomes (9-12).”
BackgroundQin, Y., & Chaimongkol, N. (2021) · Journal of Transcultural Nursing · doi:10.1177/10436596211023968 · Cited by 29
“We conducted a systematic review to provide a comprehensive, unbiased synthesis of relevant studies (Aromataris et al., 2015) on simulation with SPs related to this article’s purpose and objectives.”
MethodAndrade, A., Siqueira, T. C., D’Oliveira, A., & Dominski, F. H. (2021) · Journal of Aging and Physical Activity · doi:10.1123/japa.2021-0033 · Cited by 33
O’Malley, N., Clifford, A. M., Conneely, M., Casey, B., & Coote, S. B. (2021) · BMC Neurology · doi:10.1186/s12883-021-02402-6 · Cited by 32
“Search strategy The authors developed a comprehensive search strategy to identify all pertinent research syntheses, both published and unpublished [40].”
BackgroundComponents for providing person-centred palliative healthcare: An umbrella review
Kmetec, S., Fekonja, Z., Kolarič, J. Č., Reljić, N. M., McCormack, B. G., Sigurðardóttir, Á. K., & Lorber, M. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104111 · Cited by 41
Emile, S. H., Sakr, A. H., Shalaby, M., & Elfeki, H. A. (2022) · World Journal of Surgery · doi:10.1007/s00268-022-06446-8 · Cited by 35
“The reporting guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [12] and Umbrella review approach [11] were followed when reporting this umbrella systematic review.”
BackgroundMethodRattanavipanon, W., Chaiyasothi, T., Puchsaka, P., Mungkornkaew, R., Nathisuwan, S., Veettil, S. K., & Chaiyakunapruk, N. (2022) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.15279 · Cited by 30
“As a rapidly growing body of evidence with a variety of populations, characteristics of interventions and outcomes that overwhelm the policy maker, umbrella reviews have a crucial role in summarizing a broad research question with varied characteristics.(9) An umbrella review is a review of SRMAs, summarizing informat…”
BackgroundBhatia, D., Mishra, S., Kirubarajan, A., Yanful, B., Allin, S. M., & Ruggiero, E. D. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-052041 · Cited by 30
Nicolls, M., Truelove, V., & Stefanidis, K. B. (2022) · Accident Analysis & Prevention · doi:10.1016/j.aap.2022.106774 · Cited by 30
Cuevas-González, D., Garćıa-Vázquez, J. P., Bravo-Zanoguera, M. E., Avitia, R. L., Reyna, M. A., Zermeño-Campos, N. A., & González-Ramírez, M. L. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191911941 · Cited by 32
“This scoping review was conducted in accordance with the JBI methodology for scoping reviews [22], and in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) [23].”
MethodThe attributes of coopetitive relationships: What do we know and not know about them?
Klimas, P., Sachpazidu-Wójcicka, K., & Stańczyk, S. (2023) · European Management Journal · doi:10.1016/j.emj.2023.02.005 · Cited by 33
The Systematic Review-lution: A Manifesto to Promote Rigour and Inclusivity in Research Synthesis
Rogers, K., & Seaborn, K. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3582733 · Cited by 29
“ture has featured tertiary research [4, 23, 74] and even occasional examples of “quarternary” research [58].”
BackgroundLi, L., Tan, J., Liu, L., Li, J., Chen, G., Chen, M., Xie, J., Song, Q., Huang, X., & Xie, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-031951 · Cited by 37
What Can We Expect from an Umbrella Review?
Gianfredi, V., Nucci, D., Amerio, A., Signorelli, C., Odone, A., & Dinu, M. (2021) · Advances in Nutrition · doi:10.1093/advances/nmab150 · Cited by 29
Prowse, S. R., Brazzelli, M. G., & Treweek, S. P. (2024) · European Journal of Public Health · doi:10.1093/eurpub/ckae073 · Cited by 28
Salins, N. S., Dhyani, V. S., Mathew, M., Prasad, A., Rao, A. P., Damani, A., Rao, K. S., Nair, S., Shanbhag, V., Rao, S., et al. (2024) · Intensive Care Medicine · doi:10.1007/s00134-024-07565-7 · Cited by 33
“The quality of each systematic review included in the synthesis was evaluated using an 11-item JBI critical appraisal checklist [32] provided as supplementary File 8.”
MethodInfluentialWu, M., Song, W., Wang, X., Teng, L., Li, J., Zhang, J., Li, X., Yu, D., Jia, H., Wang, B., et al. (2025) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-025-01566-3 · Cited by 31
“This is consistent with the umbrella review method [15, 16, 20].”
Protogerou, C., McHugh, R. K., & Johnson, B. T. (2020) · Health Psychology Review · doi:10.1080/17437199.2019.1707104 · Cited by 30
“Meta-reviews aim to provide a comprehensive but condensed evidence summary of a body of reviews, without merely repeating the methodology undertaken by the reviews (Aromataris et al., 2015).”
BackgroundMethodInfluential
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.