Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 901–1,000 of 1,014
Zhang, X., Li, R., Deng, J., Chen, X., Zhou, Q., Qi, Y., Zhang, Y., & Fan, J. (2023) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2023.111586 · Cited by 22
Outcomes and instruments used in social prescribing: a modified umbrella review
Ashe, M. C., dos Santos, Í. K., Alfares, H., Chudyk, A. M., & Esfandiari, E. (2024) · Health Promotion and Chronic Disease Prevention in Canada · doi:10.24095/hpcdp.44.6.02 · Cited by 21
Lee, S., Oh, J. W., Park, K. M., Ahn, J. Y., Lee, E. M., & Lee, E. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-65713-x · Cited by 23
User-centered personalized gamification: an umbrella review
Phosanarack, M., Avril, E., Lepreux, S., Wallard, L., & Kolski, C. (2025) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-024-09423-z · Cited by 20
“The umbrella review has been conducted to compare the results found in the existing literature reviews following the methodology of Aromataris et al. (2015).”
InfluentialUnhapipatpong, C., Julanon, N., Shantavasinkul, P. C., Polruang, N., Numthavaj, P., & Thakkinstian, A. (2025) · Nutrition Reviews · doi:10.1093/nutrit/nuaf012 · Cited by 20
“12,13 The study protocol was registered in PROSPERO, an international database for prospectively registered systematic reviews in health and social care (CRD42023415577).”
Lazarides, M. K., Christaina, E., Antoniou, G. A., Argyriou, C., Trypsianis, G., & Georgiadis, G. S. (2021) · The Journal of Vascular Access · doi:10.1177/11297298211005290 · Cited by 20
Xu, D., Fu, L., Pan, D., Chu, Y., Feng, M., Lü, Y., Yang, C., Wang, Y., Xia, J., & Sun, G. (2022) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2022.2117783 · Cited by 20
“…is a one synthesis method developed to collect evidence from existing systematic reviews and meta-analyses on a given topic, which aims to offer new insights for decision makers in assessment of risk factors or efficacy of interventions on many diseases (Aromataris et al. 2015; Ioannidis 2009).”
MethodNoordman, J., Meurs, M., Poortvliet, R., Rusman, T., Orrego, C., Ballester, M., Ninov, L., de Guzmán, E. N., Alonso‐Coello, P., Groene, O., et al. (2023) · Chronic Illness · doi:10.1177/17423953231153337 · Cited by 21
Hossain, M. M., Sultana, A., Fan, Q., Ma, P., & Purohit, N. (2020) · doi:10.31124/advance.11492703.v1 · Cited by 20
Experiences of working from home: umbrella review
Hall, C. E., Brooks, S. K., Mills, F., Greenberg, N., & Weston, D. (2024) · Journal of Occupational Health · doi:10.1093/joccuh/uiad013 · Cited by 19
“…strategy, and detailed how many papers are used within the synthesis of results) as this allows for comparison and contrast of high-level evidence 10 ; (2) focus on a population of adult desk-based homeworking individuals; and (3) detail personal factors associated with WFH, or related…”
ResultRavi, S., Meyerowitz-Katz, G., Yung, C., Ayre, J., McCaffery, K., Maberly, G., & Bonner, C. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12496-0 · Cited by 19
“Assessment of the methodological quality was completed by two reviewers (SR and GMK) independently on all selected articles included in the systematic review using the Joanna Briggs Institute’s (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Synthesis [16].”
Requirements for nurses’ competencies in home care: An integrative review – a mixed-method approach
Ranta, L., & Kaunonen, M. (2024) · Nordic journal of nursing research · doi:10.1177/20571585241270286 · Cited by 19
“31 A checklist was used for systematic reviews syntheses, 32 for qualitative studies 33 and for analytical cross-sectional studies.”
Jylhä, V., Ristolainen, H., Kekoni, T., & Kinnunen, U. (2024) · Sosiaalilääketieteellinen Aikakauslehti · doi:10.23990/sa.141780 · Cited by 29
Love, S., & Nicolls, M. (2025) · Journal of Safety Research · doi:10.1016/j.jsr.2025.06.014 · Cited by 22
Factors influencing nurses' turnover: An umbrella review
Chang, S.-Y., Sunaryo, E. Y. A. B., Kristamuliana, K., Lee, H.-F., & Chen, C. (2025) · Nursing Outlook · doi:10.1016/j.outlook.2025.102464 · Cited by 19
Umbrella Reviews: Concepts, Methodological Frameworks, and Step‐by‐Step Implementation
Liu, C., Zhou, D., Xu, W., Pan, H., Wang, X., Peng, J., Ji, X., Huang, J. H., & Zhu, Z. (2025) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70092 · Cited by 24
Demissie, D. B., Kaura, D. K., & Gebhardt, G. (2025) · Frontiers in Reproductive Health · doi:10.3389/frph.2025.1721550 · Cited by 19
de Guzmán, E. N., García, L. M., González‐González, A. I., Heijmans, M., Huaringa-Marcelo, J., Immonen, K., Ninov, L., Orrego, C., Bracchiglione, J., Salas-Gama, K., et al. (2020) · F1000Research · doi:10.12688/f1000research.22125.1 · Cited by 19
Cui, N., Yan, X., Zhang, Y., Chen, D., Zhang, H., Zheng, Q., & Jin, J. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.806945 · Cited by 22
Nursing minimum data sets: Findings from an umbrella review
Freguia, F., Danielis, M., Moreale, R., & Palese, A. (2022) · Health Informatics Journal · doi:10.1177/14604582221099826 · Cited by 19
“As reported by Aromataris &Munn (2015) on behalf of the Joanna Briggs Institute,(24) umbrella reviews are reviews aimed at incorporating all types of syntheses of research evidence, including systematic reviews in their various forms, with the intent to summarise all secondary studies available in a field.(25) Literat…”
MethodWang, Q., Yuan, H., Chen, Z., Wang, J., Xue, H., & Zhang, X. (2022) · Clinical Nursing Research · doi:10.1177/10547738221104216 · Cited by 20
“The quality of each study was independently assessed using the Joanna Briggs Institute (JBI) critical appraisal tool (Aromataris et al., 2015).”
MethodMeasurable outcomes of consumer engagement in health research: A scoping review
DeBortoli, E., Soyer, H. P., Milne, D., Dissanayaka, N. N., GARTNER, C. E., Holt, J., Rae, K. M., Robison, L. E., Wallingford, C. K., & McInerney-Leo, A. M. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.994547 · Cited by 23
Tewari, N., Mathur, V. P., Goel, S., Rahul, M., Srivastav, S., Sultan, F., Haldar, P., & Ritwik, P. (2023) · Evidence-Based Dentistry · doi:10.1038/s41432-023-00849-9 · Cited by 23
“Aromataris et al.12 emphasized that the umbrella reviews must include the final evidence-based summary of the outcomes.”
BackgroundAdams, E. J., Morris, L., Marshall, G., Coffey, F., Miller, P. D., & Blake, H. (2023) · BMC Emergency Medicine · doi:10.1186/s12873-023-00798-7 · Cited by 24
“One such strategy is to undertake an umbrella review to summarise the review level evidence on the topic [12].”
BackgroundLaurindo, L. F., Sosin, A. F., Lamas, C. B., Goulart, R. D. Á., Haber, J. F. D. S., Detregiachi, C. R. P., & Barbalho, S. M. (2023) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-023-02792-z · Cited by 19
“After subjecting the studies to a rigorous quality assessment using the JBI Checklist Critical Appraisal Tool for Systematic Reviews’ Quality, it was determined that none of the included studies exhibited a discernible risk of bias related to the research (see Supplementary Files for detailed assessments).”
Salem, A., Trabelsi, K., Jahrami, H., Al-Rasheed, M. M., Boukhris, O. F., Puce, L., Bragazzi, N. L., Ammar, A., Glenn, J. M., & Chtourou, H. (2024) · Journal of the American Nutrition Association · doi:10.1080/27697061.2023.2297899 · Cited by 24
Antipsychotic agents in anxiety disorders: An umbrella review
Garakani, A., Buono, F. D., Salehi, M., Funaro, M. C., Klimowicz, A., Sharma, H., Faria, C. G. F., Larkin, K., & Freire, R. C. R. (2024) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13669 · Cited by 20
Houzé, B., El-Khatib, H., & Arbour, C. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2018.08.002 · Cited by 19
Tan, J., Li, L., Huang, X., Yang, C., Liang, X., Zhao, Y., Xie, J., Chen, R., Wang, D., & Xie, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038450 · Cited by 22
Addressing Preterm Birth History With Clinical Practice Recommendations Across the Life Course
Kelly, M. M., Tobias, J., & Griffith, P. B. (2021) · Journal of Pediatric Health Care · doi:10.1016/j.pedhc.2020.12.008 · Cited by 19
The impact of simulation debriefing process on learning outcomes: An umbrella review
Decker, S., Sapp, A., Bibin, L., Brown, M. R., Chidume, T. L., Crawford, S. B., Fayyaz, J., Johnson, B. K., & Pitman, J. S. (2025) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2025.101715 · Cited by 21
Factors Associated With Digital Addiction: Umbrella Review
Han, Y., Qiu, J., Shi, C., Huang, S., Huang, H., Wang, X., Zhu, S., Lu, D., Lu, P., & Zeng, F. (2025) · JMIR Mental Health · doi:10.2196/66950 · Cited by 21
“Unlike traditional meta-analyses, umbrella reviews assess the methodological quality and risk of bias across various studies, enhancing the ability to detect inconsistencies and differences in findings [12].”
The impacts of extreme weather events on health services and systems: A systematic review of reviews
Valente, M., Prete, C. D., Facci, G., Musso, F., Cenati, S., Calligaro, S., Ragazzoni, L., & Barone‐Adesi, F. (2025) · Public Health · doi:10.1016/j.puhe.2025.106049 · Cited by 24
An umbrella review of meta-analyses on diagnostic accuracy of C-reactive protein
Yang, Q., Li, M., Cao, X. Q., Lü, Y., Tian, C., Sun, M., Lai, H., Tian, J., Li, J., & Ge, L. (2022) · International Journal of Surgery · doi:10.1016/j.ijsu.2022.106788 · Cited by 19
Chen, J., Chen, S., Luo, H., Wu, W., & Wang, S. (2023) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2023.116734 · Cited by 18
Workplace hazing in nursing: An integrative literature review
Kristensen, A. K., Kristensen, M. L., & Mikkelsen, E. G. (2023) · Health Sciences Review · doi:10.1016/j.hsr.2023.100120 · Cited by 18
Kermansaravi, M., Vitiello, A., Valizadeh, R., Shahmiri, S. S., & Musella, M. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000629 · Cited by 20
“This umbrella review was performed according to the guidelines stipulated by the Joanna Briggs Institute [27] .”
MethodWhy do mothers mix milk feed their infants? Results from a systematic review
Monge-Montero, C., van der Merwe, L. F., Tagliamonte, S., Agostoni, C. V., & Vitaglione, P. (2023) · Nutrition Reviews · doi:10.1093/nutrit/nuad134 · Cited by 20
“21 This tool consists of a checklist by which systematic reviewers are guided in determining whether or not the published review article should be included in their review.”
MethodResultImproving Eating Habits at the Office: An Umbrella Review of Nutritional Interventions
Hyży, A., Jaworski, M., Cieślak, I., Gotlib, J., & Pańczyk, M. (2023) · Nutrients · doi:10.3390/nu15245072 · Cited by 18
“This review was prepared in line with the Joanna Briggs Institute (JBI) methodology for umbrella reviews [23] and the preferred reporting items for systematic reviews and meta-analyses (PRISMA) reporting standard [24].”
MethodNicmanis, M., Chur‐Hansen, A., & Oxlad, M. (2023) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvad133 · Cited by 20
What do we know about sex education of people with intellectual disabilities? An umbrella review
Pérez‐Curiel, P., Sánchez, E. V., Morán, L., & Gómez, L. E. (2024) · British Journal of Learning Disabilities · doi:10.1111/bld.12577 · Cited by 18
The effect of mHealth on childhood vaccination in Africa: A systematic review and meta-analysis
Gilano, G., Sako, S., Molla, B., Dekker, A. L. A. J., & Fijten, R. (2024) · PLoS ONE · doi:10.1371/journal.pone.0294442 · Cited by 19
“The Joanna Briggs Institute [JBI] critical appraisal checklist was used to check the qualities of articles by informing eligibility criteria [38].”
MethodOwusu‐Addo, E., Bennor, D. M., Orkin, A. M., Chan, A., Welch, V. A., Treweek, S. P., Green, H., Feldman, P., Ghersi, D., & Brijnath, B. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-084889 · Cited by 20
Preventing ischemic heart disease in women: a systematic review of global directives and policies
Wang, L. Y.-T., Chiang, G. S. H., Wee, C. F., Chan, S. W. K., Lau, J. X. X., & Taeihagh, A. (2024) · npj Women s Health · doi:10.1038/s44294-024-00040-0 · Cited by 24
Mitigating the Nocebo Effect in Biosimilar Use and Switching: A Systematic Review
Car, E., Vandenplas, Y., Lacosta, T. B., Simoens, S., Huys, I., Vulto, A. G., & Barbier, L. (2024) · Pharmaceutical Medicine · doi:10.1007/s40290-024-00541-y · Cited by 18
“…was assessed by two independent reviewers (EC and TB) using the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [54], the Scale for the Assessment of Narrative Review Articles (SANRA) [55], and the Mixed Methods Appraisal Tool (MMAT) [56].”
Mapping socioeconomic factors driving antimicrobial resistance in humans: An umbrella review
Ljungqvist, G. V., van Kessel, R., Mossialos, E. A., Saint, V., Schmidt, J., Mafi, A., Shutt, A., Chatterjee, A., Charani, E., & Anderson, M. (2025) · One Health · doi:10.1016/j.onehlt.2025.100986 · Cited by 19
Kim, S., Mortera, M. H., Hu, X., Krishnan, S., Hoffecker, L., Herrold, A. A., Terhorst, L. A., King, L. A., Machtinger, J., Zumsteg, J. M., et al. (2019) · Brain Injury · doi:10.1080/02699052.2019.1565896 · Cited by 18
Mannocci, A., Backhaus, I., D’Egidio, V., Federici, A., Villari, P., & Torre, G. L. (2019) · Health Policy · doi:10.1016/j.healthpol.2019.02.009 · Cited by 22
An Umbrella Review of Text Message Programs for Adults With Type 2 Diabetes
Whittemore, R., Siverly, L., Wischik, D. L., & Whitehouse, C. R. (2020) · The Science of Diabetes Self-Management and Care · doi:10.1177/0145721720965464 · Cited by 18
“Four reviewers in teams of 2 (LS and RW, and CRW and DLW) independently evaluated the methodological quality of the selected systematic reviews utilizing the AMSTAR-2 quality assessment guideline, a 16-item critical appraisal tool for systematic reviews.(18,19) Items include an a priori protocol following the PICO fra…”
MethodMatvienko‐Sikar, K., Redsell, S. A., & Flannery, C. (2021) · Journal of Reproductive and Infant Psychology · doi:10.1080/02646838.2021.1976400 · Cited by 18
“This is useful when reviews, potentially demonstrating heterogeneity, already exist (Aromataris et al., 2015).”
BackgroundInfluentialUmbrella review of nursing interventions NIC for the treatment and prevention of suicidal behavior
Sufrate‐Sorzano, T., Pérez, J. M., Juárez‐Vela, R., Garrote‐Cámara, M. E., de Viñaspre‐Hernández, R. R., Molina‐Luque, F., & Santolalla‐Arnedo, I. (2023) · International Journal of Nursing Knowledge · doi:10.1111/2047-3095.12392 · Cited by 21
“An umbrella review is a systematic review that synthesizes the highest level of evidence and contributes to a global and complete vision to respond to the objectivespursued,providinganassessmentofthequalityoftheexist-ing evidence (Aromataris et al., 2015; Biondi-Zoccai, 2016).”
Turon, H., Bezzina, A., Lamont, H., Barnes, C., Lum, M., Hodder, R. K., Leung, G. K. W., Peeters, A., Wolfenden, L., & Yoong, S. (2024) · Journal of Occupational Health · doi:10.1093/joccuh/uiae044 · Cited by 19
Borazjani, R., Khorram, R., Ghorbani, M., Mohammadi, M., Nerys-Figueroa, J., Kachooei, A. R., Parsa, A., & Parvizi, J. (2025) · The Journal of Arthroplasty · doi:10.1016/j.arth.2025.06.032 · Cited by 19
Han, M., Chesney, E., Ng, V., Bright, J. K., Sagar, Y. K., Baker, E., Meaney, M. J., & Law, E. C. N. (2025) · BMJ Mental Health · doi:10.1136/bmjment-2025-301613 · Cited by 19
Rocha-Ávila, L.-R., Núñez-Baila, M.-Á., & González‐López, J. R. (2025) · Healthcare · doi:10.3390/healthcare13172150 · Cited by 22
Sescu, D., Dahiya, D., Scaramuzzo, L., Ćorluka, S., Muthu, S., Cho, S. K.-W., Buser, Z., Yoon, S. T., & Demetriades, A. K. (2025) · British Journal of Anaesthesia · doi:10.1016/j.bja.2025.08.037 · Cited by 17
Pyrgidis, N., Mykoniatis, I., Haidich, A., Tirta, M., Talimtzi, P., Kalyvianakis, D., Ouranidis, A., & Hatzichristou, D. G. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047396 · Cited by 19
Melariri, H., Els, T., Oyedele, O., Suttle, T. K., Bermosky, K. T., Freitas, A. D., Murtaza, A., Moosajee, M., & Melariri, P. E. (2023) · EClinicalMedicine · doi:10.1016/j.eclinm.2023.101964 · Cited by 17
Bekele, T. H., Trijsburg, L. E., Brouwer, I. D., de Vries, J. H. M., Covic, N. M., Kennedy, G., Alemayehu, D., & Feskens, E. J. M. (2023) · Advances in Nutrition · doi:10.1016/j.advnut.2023.05.005 · Cited by 18
“An umbrella review methodology was chosen as these are used to understand broad topic areas with several outcomes [19].”
MethodGarrocho‐Rangel, A., Rosales-Berber, M. Á., Ballesteros-Torres, A., Hernández-Rubio, Z., Flores-Velázquez, J., Yáñez-González, E., Ruiz‐Rodríguez, S., & Pozos‐Guillén, A. (2023) · International Journal of Pediatric Otorhinolaryngology · doi:10.1016/j.ijporl.2023.111633 · Cited by 18
Prenatal exposure to ambient air pollutants and congenital heart defects: An umbrella review
Michel, S., Atmakuri, A., & Ehrenstein, O. S. V. (2023) · Environment International · doi:10.1016/j.envint.2023.108076 · Cited by 19
Association between Apical Periodontitis and Chronic Diseases: An Umbrella Review.
Pinto, K. P., Conceição, G. S. A., Ferreira, C. M. A., Sassone, L. M., Fidalgo, T. K. D. S., & Silva, E. J. N. L. (2023) · PubMed Central · doi:10.22037/iej.v18i3.42560 · Cited by 45
Iktidar, M. A., Ara, R., Roy, S., Ahmed, M., Chowdhury, S., Eva, F. N., Trisha, S. M., & Sharif, A. B. (2023) · Medicine · doi:10.1097/md.0000000000034364 · Cited by 19
“[24] The following information will be extracted: study setup; study people; participant demographics and base-line characteristics; study methodology; selection procedure and completion rates; findings and assessment times; markers of acceptability to users; data for assessing the risk of bias,…”
BackgroundRivera, B. D., Nurse, C., Shah, V., Roldan, C., Jumbo, A. E., Faysel, M. A., Levine, S. R., Kaufman, D. R., & Afable, A. (2023) · BMC Public Health · doi:10.1186/s12889-023-17255-6 · Cited by 17
“Critical appraisal of all included research was assessed using the ten criteria established for summarizing systematic reviews by Aromataris et al. [41].”
BackgroundMethodGenotype-phenotype associations in microtia: a systematic review
Wahdini, S. I., Idamatussilmi, F., Pramanasari, R., Prawoto, A. N., Wungu, C. D. K., Putri, I. L., & Gunadi, G. (2024) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-024-03142-9 · Cited by 20
“The Joanna Briggs Institute (JBI) critical assessment methods were used to assess the methodological quality of the research in this systematic review [10].”
MethodUnderstanding the Dynamics of Inflammatory Cytokines in Endodontic Diagnosis: A Systematic Review
Barbero-Navarro, I., Irigoyen‐Camacho, M. E., Zepeda‐Zepeda, M. A., Perez, D. R., Castaño-Seiquer, A. L., & Sofian-Pauliuc, I. (2024) · Diagnostics · doi:10.3390/diagnostics14111099 · Cited by 17
“It evaluates the quality of several types of studies, such as cohort studies or systematic reviews [31].”
BackgroundAbate, B. B., Kumsa, H., Kibret, G. A., Wodaynew, T., Habtie, T. E., Mezen, M. K., Munie, M. A., Temesgen, D., Tilahun, B. D., Faris, A. M., et al. (2024) · Neuroepidemiology · doi:10.1159/000539803 · Cited by 17
“This umbrella review was done following the methodology of umbrella review of existing SRM studies [28].”
Kahat, D. H., Nouraee, C. M., Smith, J. S., Santiago, C. C., Floyd, E. R., Zbýň, Š., Abbasguliyev, H., Kajabi, A. W., & Ellermann, J. (2024) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671241248457 · Cited by 17
“3,38 After a comprehensive evaluation, all 19 studies were determined to meet the selection criteria.”
Alves, S., Magalhães, C. P., Fernandes, A. M. P. D. S., Palmero, M. J. F., & Fernandes, H. (2024) · Healthcare · doi:10.3390/healthcare12171786 · Cited by 22
“The JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [26] was also used to evaluate systematic reviews (Supplementary Material Table S3).”
MethodBerthelsen, C. B., & Hansen, C. A. (2024) · Journal of Clinical Nursing · doi:10.1111/jocn.17494 · Cited by 19
Umbrella review of systematic reviews of peer support in substance use settings
Mahon, D. (2025) · Mental Health and Social Inclusion · doi:10.1108/mhsi-01-2025-0002 · Cited by 17
Shukla, S., Smith, R. J., Burik, A., Browne, D. T., & Kil, H. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102568 · Cited by 18
Keogh, J. A. J., Keng, I., Dhillon, D., Bourgeault‐Gagnon, Y., Simunovic, N., & Ayeni, O. R. (2025) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2025.13075 · Cited by 19
Tan, R., Chen, Y., Yang, D., Long, X., Ma, H., & Yang, C. H. (2025) · BMC Anesthesiology · doi:10.1186/s12871-025-03089-9 · Cited by 21
“Given the different populations, geographic regions, and methodologies used in the included studies, we used random-effects models for this study, which allow for true effects to differ across different studies when compared with fixed effects models [16–18].”
Cheng, B., Ma, J., Yang, Y., Shao, T., Zhao, B., & Zeng, L. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.670170 · Cited by 17
“We rigorously conducted this umbrella meta-analysis following prior guidelines (Aromataris et al., 2015) (Supplementary Appendix File A1).”
MethodIn Vitro Evaluation of Biomaterials for Vocal Fold Injection: A Systematic Review
Ng, W.-C., Baki, M. M., Fauzi, M. B., Lokanathan, Y., & Azman, M. B. (2021) · Polymers · doi:10.3390/polym13162619 · Cited by 17
“The review was conducted in a methodological approach using the critical appraisal instrument for systematic reviews [35].”
MethodSouadka, A., Essangri, H., Majbar, M. A., Benkabbou, A., Boutayeb, S., You, B., Gléhen, O., Mohsine, R. M., & Bakrin, N. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.809773 · Cited by 17
Walsh, J., Dwumfour, C., Cave, J. A. K., & Griffiths, F. E. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01610-z · Cited by 19
“By avoiding the repetition of searches, screening of individual papers, and the resynthesizing of existing studies it provides an overall picture of the current state of the art that can be used as a broad base to build from [18].”
BackgroundMethodInfluentialInterventions improving well‐being of adult cancer patients’ caregivers: A systematic review
Sak‐Dankosky, N., Sherwood, P. R., Vehviläinen-Julkunen, K. M., & Kvist, T. A. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15320 · Cited by 19
Evidence in decision-making in the context of COVID-19 in Latin America
Stanford, V., Gresh, L., Toledo, J., Méndez, J., Aldighieri, S., & Revéiz, L. (2022) · The Lancet Regional Health - Americas · doi:10.1016/j.lana.2022.100322 · Cited by 18
Jung, C., Rezar, R., Wischmann, P., Masyuk, M., Datz, C., Bruno, R. R., Kelm, M., & Wernly, B. (2022) · International Journal of Cardiology · doi:10.1016/j.ijcard.2022.08.052 · Cited by 19
Measures of cognitive reserve: An umbrella review
Pinto, J. O., Peixoto, B., Dores, A. R., & Barbosa, F. (2023) · The Clinical Neuropsychologist · doi:10.1080/13854046.2023.2200978 · Cited by 20
Techapongsatorn, S., Tansawet, A., Kasetsermwiriya, W., Pattanaprateep, O., & Thakkinstian, A. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031742 · Cited by 20
Umbrella Review of School Age Health Outcomes of Preterm Birth Survivors
Kelly, M. M., & Griffith, P. B. (2020) · Journal of Pediatric Health Care · doi:10.1016/j.pedhc.2020.05.007 · Cited by 17
Hossain, M. M., Khan, N., Sultana, A., Ma, P., McKyer, E. L. J., Ahmed, H. U., & Purohit, N. (2020) · doi:10.31124/advance.11497014 · Cited by 17
Impact of social media on cognitive development of children and young adults: a systematic review
Naik, V. S., Mathias, E. G., Krishnan, P., & Jagannath, V. (2025) · BMC Pediatrics · doi:10.1186/s12887-025-06041-5 · Cited by 16
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
Effective Solutions for Caregivers of Older Adults: A Review of Systematic Reviews
McHugh, M., Munsterman, E., Cho, H., & Naylor, M. D. (2025) · Journal of Applied Gerontology · doi:10.1177/07334648241312999 · Cited by 22
Ponce, L. J., Wu, T., Sim, D. J., Chow, J. Y., Wee, L. E., Chia, P. Y., Lye, D. C., Leo, Y., & Lim, J. T. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103350 · Cited by 16
Sticher, J. S., Csermak, K., Otsyula, N., Turkson, M., Aubrun, E., & Oshagbemi, O. A. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-101029 · Cited by 16
Silva, L. O. J. E., Khoujah, D., Naples, J. G., Edlow, J. A., Gerberi, D., Carpenter, C. R., & Bellolio, F. (2022) · Academic Emergency Medicine · doi:10.1111/acem.14583 · Cited by 18
Smirni, D., Smirni, P., Lavanco, G., & Caci, B. (2023) · Children · doi:10.3390/children10030467 · Cited by 22
“From the remaining 65 studies, only 13 were further systematically classified and subjected to descriptive analysis after evaluating their ratings on the JBI Critical Appraisal Checklist for Systematic Reviews.”
MethodChang, Z., Xu, J., Qin, Y., Zheng, Q., Zhao, L., Wang, Y., & Zhang, Y. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282143 · Cited by 17
“The presentation of results will follow a simple visual ’traffic light’ indicator, where green indicates that the intervention is beneficial, orange indicates that there is no difference in the comparison of the surveys, and red indicates that the results indicate that the intervention is harmful or less effective tha…”
BackgroundForensic microbiology and geographical location: a systematic review
Moitas, B., Caldas, I. M., & Sampaio‐Maia, B. (2023) · Australian Journal of Forensic Sciences · doi:10.1080/00450618.2023.2191993 · Cited by 16
“For risk of bias analysis in the individual studies, the Joanna Briggs InstituteFaculty of Health and Medical Sciences at the University of Adelaide protocol was followed 20 .”
MethodDoes CGA Improve Health Outcomes in the Community? An Umbrella Review
Ambagtsheer, R. C., Thompson, M. Q., Tucker, G., Schultz, T., Beilby, J., & Visvanathan, R. (2023) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2023.03.018 · Cited by 18
Tonbul, G., Topallı, D., & Çağıltay, N. E. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105121 · Cited by 18
Stereotactic Radiation Therapy of Single Brain Metastases: A Literature Review of Dosimetric Studies
Chambrelant, I., Jarnet, D., Bou-Gharios, J., Fèvre, C. L., Kuntz, L., Antoni, D., Jenny, C., & Noël, G. (2023) · Cancers · doi:10.3390/cancers15153937 · Cited by 16
“view, we used two evaluation tools: the Joanna Briggs Institutional Check list [18] tool.”
MethodGenetics, epigenetics, and neurobiology of childhood-onset depression: an umbrella review
Singh, M. K., Gorelik, A. J., Stave, C. D., & Gotlib, I. H. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02347-x · Cited by 18
“Two authors (MS and AG) extracted data for the complete set of included systematic reviews using a shared template [45].”
A Comparison of Clinical Outcomes of Robot-Assisted and Conventional Laparoscopic Surgery
Chabot, S., Calleja‐Agius, J., & Horeman, T. (2024) · Surgical Techniques Development · doi:10.3390/std13010003 · Cited by 22
Yang, J., Gao, Y., Wang, W., Wang, J., Wang, Y., & Yuan, L. (2024) · Journal of Clinical Nursing · doi:10.1111/jocn.17060 · Cited by 17
Hidalgo‐Robles, Á., Paleg, G., & Livingstone, R. (2024) · Healthcare · doi:10.3390/healthcare12040493 · Cited by 22
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.