Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 401–500 of 1,014
Efficacy of spiritual interventions in palliative care: An umbrella review of systematic reviews
Austin, P., Lee, W., Keall, R. M., & Lovell, M. R. (2024) · Palliative Medicine · doi:10.1177/02692163241287650 · Cited by 62
“The methodology of this review was informed by the Joanna Briggs Institute’s methodological guidance for conducting umbrella reviews 11 and was reported according to the Preferred Reporting Items for Overviews of Reviews (PRIOR) statement.”
Gunnlaugsdóttir, T., Jónasdóttir, R. J., Björnsdóttir, K., & Klinke, M. E. (2024) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2024.100251 · Cited by 69
“A higher score indicated higher certainty in the body of evidence (Aromataris et al., 2015).”
Motherhood and medicine: systematic review of the experiences of mothers who are doctors
Hoffman, R., Mullan, J., Nguyen, M., & Bonney, A. D. (2020) · The Medical Journal of Australia · doi:10.5694/mja2.50747 · Cited by 54
Garden-based interventions and early childhood health: an umbrella review
Skelton, K. R., Lowe, C. L., Zaltz, D. A., & Benjamin‐Neelon, S. E. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-01023-5 · Cited by 59
Momsen, A. H., Ørtenblad, L., & Maribo, T. (2022) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2021.101529 · Cited by 64
Impact of Artificial Intelligence–Based Technology on Nurse Management: A Systematic Review
Gonzalez-Garcia, A., Pérez-González, S., Benavides, C., Pinto-Carral, A., Quiroga-Sánchez, E., & Marqués-Sánchez, P. (2024) · Journal of Nursing Management · doi:10.1155/2024/3537964 · Cited by 53
Moorthy, D., Merrill, R. D., Namaste, S. M. L., & Iannotti, L. L. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa070 · Cited by 60
“We conducted a meta-review of reviews, considered one of the higher-order methods of study designs for synthesizing results on intervention efficacy (115, 116).”
MethodKositamongkol, C., Kanchanasurakit, S., Auttamalang, C., Inchai, N., Kabkaew, T., Kitpark, S., Chaiyakunapruk, N., Duangjai, A., Saokaew, S., & Phisalprapa, P. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.786596 · Cited by 55
“Data Extraction and Quality Assessment In the umbrella review, we extracted information from the included systematic reviews and meta-analyses following the Joanna Briggs Institute data extraction guide (Aromataris et al., 2015).”
MethodWhat influences the implementation of kangaroo mother care? An umbrella review
Cai, Q., Chen, D.-Q., Wang, H., Zhang, Y., Yang, R., Xu, W., & Xu, X. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-05163-3 · Cited by 62
“Study design This review was conducted according to the rules for conducting umbrella reviews and published approach [32, 34], and was reported following the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA 2020) statement [35].”
BackgroundMethodEthical Decision Making in Disaster and Emergency Management: A Systematic Review of the Literature
Cuthbertson, J. L., & Penney, G. (2023) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x23006325 · Cited by 59
The relationship between thyroid and human-associated microbiota: A systematic review of reviews
Virili, C., Stramazzo, I., Bagaglini, M. F., Carretti, A. L., Capriello, S., Romanelli, F., Trimboli, P., & Centanni, M. (2023) · Reviews in Endocrine and Metabolic Disorders · doi:10.1007/s11154-023-09839-9 · Cited by 57
“The present systematic review was performed following the methodology proposed by Aromataris et al. [11].”
MethodSantos, E. J. F., Duarte, C. C. M., Marques, A., Cardoso, D., Apóstolo, J., da Silva, J. A. P., & Barbieri‐Figueiredo, M. D. C. (2019) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-d-18-00020 · Cited by 60
Glossary for systematic reviews and meta‐analyses
Nagendrababu, V., Dilokthornsakul, P., Jinatongthai, P., Veettil, S. K., Pulikkotil, S. J., Duncan, H. F., & Dummer, P. M. H. (2020) · International Endodontic Journal · doi:10.1111/iej.13217 · Cited by 47
“This form of review is a summary syntheses of the evidence that exists (Aromataris et al. 2015).”
BackgroundCalcium Signaling Mediates Cell Death and Crosstalk with Autophagy in Kidney Disease
Ning, B., Guo, C., Kong, A., Li, K., Xie, Y., Shi, H., & Gu, J. (2021) · Cells · doi:10.3390/cells10113204 · Cited by 55
“, such as by number of databases sourced and searched, number of studies, type and country of origin of the studies included in each review, and method of synthesis/analysis employed to synthesize the evidence [8].”
MethodEffects of sodium bicarbonate supplementation on exercise performance: an umbrella review
Grgić, J., Grgic, I., Coso, J. D., Schoenfeld, B. J., & Pedišić, Ž. (2021) · Journal of the International Society of Sports Nutrition · doi:10.1186/s12970-021-00469-7 · Cited by 56
“Given the increased popularity of meta-analyses, researchers have recently started to perform umbrella reviews, which endeavor to synthesize and critically evaluate information from all meta-analyses performed on a given topic [21, 22].”
BackgroundMitigating the impact of air pollution on dementia and brain health: Setting the policy agenda
Castellani, B. C., Bartington, S., Wistow, J., Heckels, N., Ellison, A., van Tongeren, M., Arnold, S. R., Barbrook-Johnson, P., Bicket, M., Pope, F. D., et al. (2022) · Environmental Research · doi:10.1016/j.envres.2022.114362 · Cited by 57
Prevalence of Chronic Pain After Spinal Surgery: A Systematic Review and Meta-Analysis
Alshammari, H. S., Alshammari, A. S., Alshammari, S. A., & Ahamed, S. S. (2023) · Cureus · doi:10.7759/cureus.41841 · Cited by 76
“Inclusion and exclusion criteria We included research articles written in English that (1) were published in peer-reviewed journals; (2) investigated the prevalence of pain that persisted for more than six months after spinal surgery; (3) had a reported cross-sectional, cohort, or longitudinal design; (4) had a define…”
BackgroundDomínguez, A. M. C., Salazar, D. D. J. R., stefanolo, J. P., Serrano, M. C. C., Quiroga, I. C. C., & Peña, J. R. Z. (2024) · Probiotics and Antimicrobial Proteins · doi:10.1007/s12602-024-10353-w · Cited by 59
Safety of biological therapies in ulcerative colitis: An umbrella review of meta-analyses
Bonovas, S., Pantavou, K. G., Evripidou, D., Bastiampillai, A. J., Nikolopoulos, G. K., Peyrin‐Biroulet, L., & Danese, S. (2018) · Best Practice & Research Clinical Gastroenterology · doi:10.1016/j.bpg.2018.05.005 · Cited by 61
Predictors of functional outcome in musculoskeletal healthcare: An umbrella review
Burgess, R., Mansell, G., Bishop, A., Lewis, M., & Hill, J. C. (2019) · European Journal of Pain · doi:10.1002/ejp.1483 · Cited by 53
“It was also limited to search dates within the last 5 years although this has shown to be appropriate in this type of review (Aromataris et al., 2015).”
BackgroundMethodInfluentialConneely, M., Leahy, S., Dore, L., Trépel, D., Robinson, K., Jordan, F., & Galvin, R. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-03007-5 · Cited by 57
Fastner, A., Hauß, A., & Kottner, J. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104495 · Cited by 51
Kirvalidze, M., Abbadi, A., Dahlberg, L., Sacco, L., Morin, L., & Calderón‐Larrañaga, A. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-068646 · Cited by 55
Kim, B., & Royle, M. L. (2024) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.14022 · Cited by 56
A Scoping Review on the Prevalence of Hashimoto’s Thyroiditis and the Possible Associated Factors
Vargas‐Uricoechea, H., Castellanos-Pinedo, A., Urrego-Noguera, K., Fernández, M. V. P., Meza-Cabrera, I. A., & Vargas-Sierra, H. D. (2025) · Medical Sciences · doi:10.3390/medsci13020043 · Cited by 59
“The variability found in the prevalence of HT has also been demonstrated in multiple AIDs and could be explained by a constellation of factors [14], among which the following stand out:”
InfluentialA review protocol on research partnerships: a Coordinated Multicenter Team approach
Hoekstra, F., Mrklas, K., Sibley, K. M., Nguyen, T., Vis‐Dunbar, M., Neilson, C. J., Crockett, L. K., Gainforth, H. L., & Graham, I. D. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0879-2 · Cited by 54
Biffi, A., Cantarutti, A., Rea, F., Locatelli, A., Zanini, R., & Corrao, G. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.02.023 · Cited by 53
Vardanjani, A. E., Golitaleb, M., Abdi, K., Kia, M. K., Moayedi, S., Torres, M., & Nayeri, N. D. (2021) · Journal of Emergency Nursing · doi:10.1016/j.jen.2021.04.007 · Cited by 51
Hajishafiee, M., Kapellas, K., Listl, S., Pattamatta, M., Gkekas, A., & Moynihan, P. J. (2023) · BMC Public Health · doi:10.1186/s12889-023-15884-5 · Cited by 55
“One reviewer extracted relevant data using a modified version of the JBI data extraction form [25] and a second reviewer checked data.”
MethodExperiences of Students with Learning Disabilities in Higher Education: A Scoping Review
Kuriakose, A., & Amaresha, A. C. (2023) · Indian Journal of Psychological Medicine · doi:10.1177/02537176231200912 · Cited by 54
Masini, A., Dallolio, L., Sanmarchi, F., Lovecchio, F., Falato, M., Longobucco, Y., Lanari, M., & Sacchetti, R. (2024) · Healthcare · doi:10.3390/healthcare12040449 · Cited by 57
“Umbrella reviews synthesize the evidence from existing systematic reviews and meta-analyses, providing a more reliable and exhaustive overview of the literature [21].”
BackgroundWan, Q., Li, N., Du, L., Zhao, R., Yi, M., Xu, Q., & Zhou, Y. (2019) · Food Science & Nutrition · doi:10.1002/fsn3.1117 · Cited by 52
“An umbrella review is a review of existing systematic reviews and/or meta-analyses (Aromataris et al., 2015).”
BackgroundMethodExergames for motor rehabilitation in older adults: an umbrella review
Reis, E. S., Postolache, G. B., Teixeira, L., Arriaga, P., Lima, M. L., & Postolache, O. A. (2019) · Physical Therapy Reviews · doi:10.1080/10833196.2019.1639012 · Cited by 51
Laser therapy for recurrent aphthous stomatitis: an overview
dos Santos, J. A., Normando, A. G. C., de Toledo, I. P., Melo, G., Canto, G. D. L., Santos‐Silva, A. R., & Guerra, E. N. S. (2019) · Clinical Oral Investigations · doi:10.1007/s00784-019-03144-z · Cited by 50
Santos, A. S., Oliveira, A. J. F., Barbosa, M. C. L., & Nogueira, J. L. (2020) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2020.109809 · Cited by 54
Jayedi, A., Soltani, S., Jenkins, D. J. A., Sievenpiper, J. L., & Shab‐Bidar, S. (2020) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2020.1854168 · Cited by 52
Fitzgerald, P. B., George, M. S., & PRIDMORE, S. A. (2021) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674211043047 · Cited by 52
“The final method used in the synthesis of research evidence is that of the umbrella review (Aromataris et al., 2015).”
MethodDisalvo, D., Agar, M. R., Caplan, G. A., Murtagh, F. E., Luckett, T., Heneka, N., Hickman, L., Kinchin, I., Trethewie, S., Sheehan, C., et al. (2021) · Palliative Medicine · doi:10.1177/02692163211024451 · Cited by 51
“, guidance.(15) Outcomes of interest were: improved clinical health outcomes for people with palliative care needs and/or their carers at home, such as: enhanced quality of life; a reduction in unnecessary hospitalisation or emergency department admissions; and lower hospitalisation costs.”
BackgroundMethodAsfar, T., Jebai, R., Li, W., Oluwole, O. J., Ferdous, T., Gautam, P., Schmidt, M., Noar, S. M., Lindblom, E. N., Eissenberg, T., et al. (2022) · Tobacco Control · doi:10.1136/tc-2022-057495 · Cited by 57
Impact of COVID-19 on the mental health of children and young people: an umbrella review
Bevilacqua, L., Fox‐Smith, L., Lewins, A., Jetha, P., Sideri, A., Barton, G., Meiser‐Stedman, R., & Beazley, P. I. (2023) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2022-220259 · Cited by 56
“15 A recent umbrella review on this topic has been recently published.”
BackgroundBerthelsen, C. B., Møller, N., & Bunkenborg, G. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16913 · Cited by 49
Analysing health system capacity and preparedness for climate change
Braithwaite, J., Leask, E., Smith, C. L., Dammery, G., Brooke-Cowden, K., Carrigan, A., McQuillan, E., Ehrenfeld, L., Coiera, E. W., Westbrook, J. I., et al. (2024) · Nature Climate Change · doi:10.1038/s41558-024-01994-4 · Cited by 52
“…four quality appraisal tools were applied, depending on publication type: (1) mixed-methods appraisal tool 188 , (2) scale for the assessment of narrative review articles 189 and (3) Joanna Briggs Institute critical appraisal checklist for systematic reviews and research synthesis 190,191 .”
Abate, B. B., Sendekie, A. K., Alamaw, A. W., Tegegne, K. M., Kitaw, T. A., Azmeraw, M., Kassaw, A., Yilak, G., Zemariam, A. B., & Tilahun, B. D. (2025) · AJOG Global Reports · doi:10.1016/j.xagr.2025.100441 · Cited by 54
Simulation as a Tool for Clinical Remediation: An Integrative Review
Camp, S., & Legge, T. (2017) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2017.11.003 · Cited by 49
Condon, C. N., Lam, W. T., Mosley, C., & Gough, S. (2020) · Advances in Simulation · doi:10.1186/s41077-020-00151-z · Cited by 52
Family carer needs in advanced disease: systematic review of reviews
Marco, D. J. T., Thomas, K., Ivynian, S. E., Wilding, H., Parker, D., Tieman, J., & Hudson, P. (2022) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2021-003299 · Cited by 49
Naseralallah, L. M. A., Stewart, D. C., Ali, R. S. A., & Paudyal, V. (2022) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2022.2147921 · Cited by 49
“) using a Joanna Briggs Institute (JBI) Reviewers’ Manual informed data extraction form [22].”
MethodUnhapipatpong, C., Polruang, N., Shantavasinkul, P. C., Julanon, N., Numthavaj, P., & Thakkinstian, A. (2023) · The American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2023.03.006 · Cited by 41
Purgato, M., Cadorin, C., Prina, E., Ferreira, M. C., Piccolo, L. D., Gerber, M., Jordans, M. J. D., Ostuzzi, G., Richards, J. A., Rudi, D., et al. (2023) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2023.04.017 · Cited by 50
Blomstrand, P., Tesan, D., Nylander, E. M., & Ramstrand, N. (2023) · European Review of Aging and Physical Activity · doi:10.1186/s11556-023-00325-4 · Cited by 51
Effectiveness of Individual-Based Strategies to Reduce Nurse Burnout: An Umbrella Review
Hsu, H., Lee, H., Hung, H., Chen, Y., Yen, M., Chiang, H., Chow, L., Fetzer, S. J., & Mu, P. (2024) · Journal of Nursing Management · doi:10.1155/2024/8544725 · Cited by 51
“Te methodology’s quality was evaluated using the JBI SUMARI’s systematic review instruments, consisting of the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses (JBI CACSRRS) [24].”
McGovern, R., Balogun-Katung, A., Artis, B., Bareham, B. K., Spencer, L. P., Alderson, H., Brown, E., Brown, J., Lingam, R., McArdle, P., et al. (2024) · Journal of Prevention · doi:10.1007/s10935-024-00785-z · Cited by 51
“This approach to the synthesis is in line with the aims of this systematic review of reviews, resulting in a high-level summary of the evidence (Aromataris et al., 2015).”
ResultCanales, G. D. L. T., Câmara‐Souza, M. B., Ernberg, M. M., Al‐Moraissi, E. A., Grigoriadis, A., Poluha, R. L., Christidis, M., Jasim, H., Lövgren, A., & Christidis, N. (2024) · Drugs · doi:10.1007/s40265-024-02048-x · Cited by 48
“The UR was conducted according to the methodology published by Aromataris et al. [37], which includes the methodological development, conduct, and reporting of an UR.”
MethodBencheva, V., Mann, N., Rombey, T., Pieper, D., & Schmiedl, S. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02698-8 · Cited by 52
“The quality of the included reviews was rated using the JBI critical appraisal tool [22].”
Shin, Y., Park, E. J., & Lee, A. (2025) · Journal of Medical Internet Research · doi:10.2196/66442 · Cited by 52
“The review was conducted and reported using systematic review methodologies from the Joanna Briggs Institute [42].”
Veronese, N., Honvo, G., Bruyère, O., Rizzoli, R., Barbagallo, M., Maggi, S., Smith, L., Sabico, S., Al‐Daghri, N. M., Cooper, C. C., et al. (2022) · Aging Clinical and Experimental Research · doi:10.1007/s40520-022-02289-4 · Cited by 52
“This study was conducted following the recommendations of the Joanna Briggs Institute (JBI) Collaboration for conducting umbrella reviews [13] and those reported in the Cochrane Handbook for Systematic Literature Reviews to carry out the screening and selection of studies [14].”
Mohammed, H., Pham-Tran, D. D., Yeoh, Z. Y. M., Wang, B., McMillan, M., Andraweera, P. H., & Marshall, H. S. (2023) · Vaccines · doi:10.3390/vaccines11020224 · Cited by 47
“The Joanna Briggs Institute (JBI) tools [16] were used to assess risk of bias of the included studies (Supplementary Material S2).”
BackgroundMethodA literature review of comfort in the paediatric critical care patient
Bosch-Alcaraz, A., Falcó‐Pegueroles, A., & Jordán, I. (2018) · Journal of Clinical Nursing · doi:10.1111/jocn.14345 · Cited by 47
Liu, F.-H., Liu, C., Gong, T., Gao, S., Sun, H. J., Jiang, Y., Zhang, J., Zhang, M., Gao, C., Li, X., et al. (2021) · Frontiers in Nutrition · doi:10.3389/fnut.2021.647122 · Cited by 49
Iron intake and multiple health outcomes: Umbrella review
Huang, Y. C., Cao, D., Chen, Z., Chen, B., Li, J. H., Wang, R., Guo, J., Dong, Q. G., Liu, C., Wei, Q., et al. (2021) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2021.1982861 · Cited by 52
Red/processed meat consumption and non-cancer-related outcomes in humans: umbrella review
Zhang, X., Liang, S., Chen, X., Yang, J., Zhou, Y., Du, L., & Li, K. (2022) · British Journal Of Nutrition · doi:10.1017/s0007114522003415 · Cited by 47
“Umbrella review is a useful tool to help us systematically understand the knowledge of specific topics, which can provide a comprehensive overview of evidence of existing systematic reviews and meta-analyses about a topic area(12,13).”
MethodJenstad, L. M., Howe, T., Breau, G., Abel, J., Colozzo, P., Halas, G., Mason, G., Rieger, C. L., Simon, L., & Strachan, S. M. (2023) · Patient Education and Counseling · doi:10.1016/j.pec.2023.108040 · Cited by 48
Kitaw, T. A., Abate, B. B., Tilahun, B. D., Yilak, G., Rede, M. B., Getie, ፟., & Haile, R. N. (2024) · BMC Public Health · doi:10.1186/s12889-024-20300-7 · Cited by 53
“This umbrella protocol was designed in accordance with preferred methods of reviewing available Systematic Review and Meta-analysis (SRM) studies [18].”
MethodStabilini, C., Cavallaro, G., Bocchi, P., Campanelli, G., Carlucci, M., Ceci, F., Crovella, F., Cuccurullo, D., Fei, L., Gianetta, E., et al. (2018) · International Journal of Surgery · doi:10.1016/j.ijsu.2018.04.052 · Cited by 47
“Regarding point 3, considering that literature on a bdominal wall surgery is one of the broadest fields in general surgery, and this peculiarity has prompted multitudes of high-level studies and protocols[13], we decided to adopt the methodology of the Umbrella Re view[14] with the aim to define the best outcome measu…”
MethodDick, S., Whelan, E., Davoren, M. P., Dockray, S., Heavin, C., Linehan, C., & Byrne, M. (2019) · BMC Public Health · doi:10.1186/s12889-019-7583-6 · Cited by 53
Pharmacological Treatment for Obesity in Adults: An Umbrella Review
Khalil, H., Ellwood, L., Lord, H., & Fernandez, R. (2020) · Annals of Pharmacotherapy · doi:10.1177/1060028019898912 · Cited by 44
“Selected reviews were critically appraised by 2 independent reviewers (HL, HK) using the standardized JBI Critical Khalil et al 693 Appraisal Checklist for Systematic Reviews.16 The following quality thresholds were used: low quality (0% to 33% of criteria met), medium quality (34% to 66% of the criteria met), and hig…”
MethodSelf-citationWu, Q., Feng, J., & Pan, C. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.03.062 · Cited by 55
Bougioukas, K. I., Vounzoulaki, E., Mantsiou, C. D., Papanastasiou, G. D., Savvides, E. D., Ntzani, E. E., & Haidich, A.-B. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.019 · Cited by 46
Filippo, L. D., Vincenzi, S., Pennella, D., & Maselli, F. (2022) · Healthcare · doi:10.3390/healthcare10061095 · Cited by 46
“generated by the SRs relating to a given topic [14].”
BackgroundPrevalence of depression in SARS-CoV-2 infected patients: An umbrella review of meta-analyses
Mazza, M. G., Palladini, M., Villa, G., Agnoletto, E., Harrington, Y. A., Vai, B., & Benedetti, F. (2022) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2022.12.002 · Cited by 48
“On the other hand, when considering JBI Checklist for Systematic Reviews and Research Syntheses, six meta-analyses met all 11 criteria for quality assessment, and all the included meta-analyses were classified as high quality, satisfying at least eight items (Table 1, eTable 6).”
MethodAn Overview of Reviews: Organizational Change Management Architecture
Ros, A. D., Vainieri, M., & Bellè, N. (2023) · Journal of Change Management · doi:10.1080/14697017.2023.2197451 · Cited by 53
Barbalho, S. M., Méndez‐Sánchez, N., & Laurindo, L. F. (2023) · Biochemical Pharmacology · doi:10.1016/j.bcp.2023.115871 · Cited by 46
Prevalence of mental disorders in South Asia: A systematic review of reviews
Vidyasagaran, A. L., McDaid, D., Faisal, M. R., Nasir, M. Z. M., Muliyala, K. P., Thekkumkara, S. N., Wright, J. M., Huque, R., Benkalkar, S., & Siddiqi, N. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.72 · Cited by 49
“We followed the Joanna Briggs Institute (JBI) method for conducting the review (Aromataris et al., 2015) and the PRISMA guidelines for reporting (Page et al., 2021; Supplementary Appendix 1).”
MethodZhang, M., Fan, C. G., Ma, L., Wang, H., Zu, Z., Lin-xi, Y., Chen, F., Wei, W., & Li, X. (2024) · General Psychiatry · doi:10.1136/gpsych-2023-101355 · Cited by 49
“24 Additionally, umbrella reviews represent the pinnacle of evidence-based research, 25 occupying the summit of the evidence hierarchy.”
BackgroundAssociation of tooth loss and nutritional status in adults: an overview of systematic reviews
Kaurani, P., Kakodkar, P. V., Bhowmick, A., Samra, R. K., & Bansal, V. (2024) · BMC Oral Health · doi:10.1186/s12903-024-04602-1 · Cited by 54
“This available wealth of reviews necessitates the synthesizing and evaluating all the available evidence in the form of an overview to enable a clearer understanding of the association [29, 30].”
BackgroundSadeq, A., Guraya, S. S., Fahey, B. A., Clarke, E., Bensaaud, A., Doyle, F., Kearney, G. P., Gough, F., Harbinson, M., Guraya, S. Y., et al. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1522411 · Cited by 54
Liverpool, S., Donagh, C. M., Feather, J., Uzondu, C., Howarth, M. L., Bannerman, F., Kaehne, A., Foster, C., & Mateus, C. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-025-02722-9 · Cited by 53
“While assessing primary study overlap can help quantify redundancy and avoid overrep-resentation of findings, our primary aim was to synthesise overarching conclusions rather than conduct a meta-analysis [45, 46].”
InfluentialQin, X., Jia, G., Zhou, X., & Yang, Z. (2022) · Advances in Nutrition · doi:10.1093/advances/nmac087 · Cited by 51
Liu, F., Song, S., Ye, X., Huang, S., He, J., Wang, G., & Hu, X. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1021104 · Cited by 48
“Nine systematic reviews (2 with a meta-analysis) (29, 30) focused on respiratory diseases (13, 15, 50–56), 5 (2 with a meta-analysis) (39, 40) on age-related oral changes (39– 43), 6 (3 with a meta-analysis) (28, 36, 38) mainly on malnutrition and 3 (none with a meta-analysis) on frailty (29, 57, 58).”
BackgroundMethodNichol, B., McCready, J. L., Steen, M., Unsworth, J., Simonetti, V., & Tomietto, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282525 · Cited by 46
“Quality appraisal for the included reviews were conducted by BN using The Joanna Brigg’s Institute (JBI) critical appraisal tool for systematic reviews and research syntheses [34], which examines reviews for trustworthiness and quality of findings using eleven distinct aspects.”
MethodCoetzer, J. A., Loukili, I., Goedhart, N. S., Ket, J. C. F., Schuitmaker‐Warnaar, T. J., Zuiderent‐Jerak, T., & Dedding, C. W. M. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.116895 · Cited by 50
Iasiello, M. P., van Agteren, J. E., Ali, K., Fassnacht, D. B., Kyrios, M., Kashdan, T. B., & Kolovos, E. (2024) · International Journal of Wellbeing · doi:10.5502/ijw.v14i2.3621 · Cited by 48
Żak, A. M., & Pękala, K. A. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2406540 · Cited by 45
“This makes umbrella reviews an additional aid to health-care decision makers (Aromataris et al., 2015; Cant et al., 2022).”
Campbell, J. M., Bateman, E. H., Peters, M. D. J., Bowen, J. M., Keefe, D. M. K., & Stephenson, M. (2016) · Pharmacogenomics · doi:10.2217/pgs.15.180 · Cited by 48
Koch, J., Amos, J. G., Beattie, E., Lautenschlager, N. T., Doyle, C., Anstey, K. J., & Mortby, M. E. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104187 · Cited by 55
Return to sport post-knee arthroplasty: an umbrella review for consensus guidelines
Lester, D., Barber, C., Sowers, C. B., Cyrus, J. W. W., Vap, A. R., Golladay, G. J., & Patel, N. K. (2022) · Bone & Joint Open · doi:10.1302/2633-1462.33.bjo-2021-0187.r2 · Cited by 44
Landmann, E. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122889 · Cited by 51
Designing and Learning With Pedagogical Agents: An Umbrella Review
Schroeder, N. L., Davis, R. O., & Yang, E. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241288476 · Cited by 50
“They enable researchers to compare and contrast the results from various syntheses to try and draw synthesized conclusions (Aromataris et al., 2015).”
InfluentialTelerehabilitation and Its Impact Following Stroke: An Umbrella Review of Systematic Reviews
Alwadai, B., Lazem, H., Almoajil, H., Hall, A., Mansoubi, M., & Dawes, H. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm14010050 · Cited by 52
McManus, S., Pendergast, D., & Kanasa, H. (2025) · Sustainability · doi:10.3390/su17020459 · Cited by 48
Edwards, D. J., Williams, J., Carrier, J., & Davies, J. L. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00241 · Cited by 47
Shao, S.-C., Kuo, L.-T., Chien, R.-N., Hung, M.-J., & Lai, E. C.-C. (2020) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2020-001956 · Cited by 43
McDowall, A., & Kiseleva, M. (2024) · Neurodiversity · doi:10.1177/27546330241291769 · Cited by 43
“We conducted critical appraisal using the JBI Checklist For Systematic Reviews and Research Syntheses (Aromataris et al., 2015).”
Return to Sports After Total Hip Arthroplasty: An Umbrella Review for Consensus Guidelines
Sowers, C. B., Carrero, A. C., Cyrus, J. W. W., Ross, J. A., Golladay, G. J., & Patel, N. K. (2021) · The American Journal of Sports Medicine · doi:10.1177/03635465211045698 · Cited by 43
“The checklist consists of 11 questions specifically directed at assessing systematic reviews for use in an umbrella review.(2) We used a binary scoring system by which a study received a score of zero unless it clearly addressed the question at hand, with the comprehensive assessment questions and scoring methodology…”
MethodUmbrella review of the efficacy of perioperative immunonutrition in visceral surgery
Slim, K., Badon, F., Vacheron, C., Occéan, B., Dziri, C., & Chambrier, C. (2022) · Clinical Nutrition ESPEN · doi:10.1016/j.clnesp.2022.02.015 · Cited by 43
Towards Nuts and Bolts of Conducting Literature Review: A Typology of Literature Review
Taherdoost, H. (2023) · Electronics · doi:10.3390/electronics12040800 · Cited by 56
Innovative models of healthcare delivery: an umbrella review of reviews
Roberts, N., Carrigan, A., Clay‐Williams, R., Hibbert, P. D., Mahmoud, Z., Pomare, C., Pulido, D. F., Meulenbroeks, I., Knaggs, G. T., Austin, E. E., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066270 · Cited by 50
Digital Health Interventions to Improve Mental Health in Patients With Cancer: Umbrella Review
Zhong, C., Luo, X., Tan, M., Chi, J., Guo, B., Tang, J., Guo, Z., Deng, S., Zhang, Y., & Wu, Y. (2025) · Journal of Medical Internet Research · doi:10.2196/69621 · Cited by 47
“…multiple systematic reviews and meta-analyses was systematically collected and assessed, and it could provide an overall picture of the digital health care area on mental health management for patients with cancer and highlight whether the evidence base is consistent or contradictory [36-38].”
Kovalainen, T., Pramila‐Savukoski, S., Kuivila, H., Juntunen, J., Jarva, E., Rasi, M., & Mikkonen, K. (2025) · Nurse Education Today · doi:10.1016/j.nedt.2025.106600 · Cited by 48
Liu, X., Shi, Y., Willis, K. F., Wu, C.-J. J., & Johnson, M. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016857 · Cited by 46
“The number of systematic reviews or meta-analyses that reported the outcome, total sample (from included publications) and information of health education interventions is also presented in tables 2 and 3.(24) A final ‘summary of evidence’ was developed to present the intervention, included study synthesis, and indica…”
Background
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.