Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
AIMS: With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. METHODS: Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. RESULTS: This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to help assess risk of bias in systematic reviews and meta-analyses was also developed and tested. Relevant details to extract from included reviews and how to best present the findings of both quantitative and qualitative systematic reviews in a reader friendly format are provided. CONCLUSIONS: Umbrella reviews provide a ready means for decision makers in healthcare to gain a clear understanding of a broad topic area. The umbrella review methodology described here is the first to consider reviews that report other than quantitative evidence derived from randomized controlled trials. The methodology includes an easy to use and informative summary of evidence table to readily provide decision makers with the available, highest level of evidence relevant to the question posed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because of the overlap in some of the component studies included in the various meta-analyses captured in this umbrella review, a meta-analysis of the results of the meta-analyses was not appropriate, given that it would count results from some component studies several times, violating meta-analysis principles.33 Rather, a narrative synthesis was used, 34”
From Effectiveness of wearable activity trackers to increase physical activity and improve health: a systematic review of systematic reviews and meta-analyses. (2022) · cites this paper as [34]
In the citing paper
“Overviews of reviews summarize existing evidence from systematic reviews without further analyses and are therefore a rapid means to inform guidelines.15”
In the citing paper
“The quality of the included studies was assessed using the Joanna Briggs Institute (JBI) checklist [20], with two authors independently evaluating each study.”
From Impact of social media on cognitive development of children and young adults: a systematic review (2025) · cites this paper as [20]
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
In the citing paper
“The included reviews were appraised using the standard JBI critical appraisal tool by two independent reviewers (NS and FN). Seventy per cent of these were checked by another researcher (LB or DP).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [21]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Conduct of an umbrella review may also offer a means for a rapid review of the evidence to address a broad and high-quality evidence base in relation to a topic.(5) Umbrella reviews are conducted to provide an overall examination of the body of information that is available for a given topic, and to compare and contra…”
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · cited 2×
“Alongside the presentation of quantitative data, the number of reviews that inform the outcome, number of participants (from included reviews) and statistical heterogeneity should also be reported.(4) An example of the table of findings for an umbrella review titled ‘ Effectiveness of non-pharmacological strategies to…”
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“One recent estimate suggests that 11 systematic reviews are published every day.(1) With the increased number of systematic reviews available, a logical and appropriate next step has been the conduct of reviews of existing systematic reviews, allowing the findings of separate reviews to be compared and contrasted, the…”
Developing the Review Question and Inclusion Criteria
Stern, C., Jordan, Z., & McArthur, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000445689.67800.86 · Cited by 629 · cited 4×
“The inclusion criteria indicate the basis on which available reviews will be considered for inclusion into the umbrella review.(9) These criteria provide a guide for the reader to clearly understand what is proposed by the umbrella review authors and, more importantly, a guide for the reviewers themselves to base deci…”
InfluentialThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 2×
“As a result, many syntheses published today are of original qualitative research.(7) Similarly, we may find that umbrella reviews inevitably ask questions that direct the reviewer predominantly to existing qualitative reviews.”
Self-citation
Cited by
Items 701–800 of 1,014
Tíscar-González, V., Gea‐Sánchez, M., Blanco‐Blanco, J., Pastells‐Peiró, R., de Ríos-Briz, N., & Moreno‐Casbas, T. (2020) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2020.103740 · Cited by 28
Fruit consumption and multiple health outcomes: An umbrella review
Sun, L., Liang, X., Wang, Y., Zhu, S., Ou, Q., Xu, H., Li, F., Tan, X., Lai, Z., Pu, L., et al. (2021) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2021.09.023 · Cited by 30
Featherstone, C., Sharpe, R. A., Axford, N., Asthana, S., & Husk, K. (2021) · Health & Social Care in the Community · doi:10.1111/hsc.13635 · Cited by 33
Mechanical thromb ectomy for acute ischemic stroke: systematic review and meta-analysis
Oliveira, A. J. F., Viana, S. M. N., & Santos, A. S. (2022) · Einstein (São Paulo) · doi:10.31744/einstein_journal/2022rw6642 · Cited by 31
“This report followed the principles of the Preferred Reporting Items for Systematic Reviews and MetaAnalysis (PRISMA) consensus.(26-28)”
MethodSocietal economic burden of multiple sclerosis and cost-effectiveness of disease-modifying therapies
Simoens, S. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.1015256 · Cited by 28
“This methodology is particularly suited to synthesize the state of the art of the evidence and to provide an overview of different facets of a research question (3).”
MethodGianfredi, V., Ferrara, P., Dinu, M., Nardi, M., & Nucci, D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214787 · Cited by 31
“We planned, conducted, and reported this umbrella review of observational studies and randomized clinical trials in concordance with the methods recommended by the Cochrane Collaboration [14] (the Preferred Reporting Items for Systematic Reviews and Meta-Analyses PRISMA guidelines) [15] and documented the process and…”
MethodNicol, J. U., Iwu, C. J., Hendricks, L., Nyasulu, P. S., & Young, T. (2022) · Pan African Medical Journal · doi:10.11604/pamj.2022.43.168.32983 · Cited by 28
XR and mental wellbeing: state of the art and future research directions for the Metaverse
Taylor, A., Dieck, M. C. T., Jung, T. H., Cho, J., & Kwon, O. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1360260 · Cited by 28
Rammant, E., Wilder, L. V., Hemelrijck, M. V., Pauwels, N., Decaestecker, K., Praet, C. V., Bultijnck, R., Ost, P., Vaerenbergh, T. V., Verhaeghe, S. T. L., et al. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02544-z · Cited by 28
Sauer, C., Haussmann, A., & Weissflog, G. (2024) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2024.100810 · Cited by 27
Smit, C. C. H., Lambert, M., Rogers, K. D., Djordjevic, S. P., van Oijen, A. M., Keighley, C., Taxis, K., Robertson, H. A., & Pont, L. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms242417204 · Cited by 27
“An umbrella review aims not to repeat searches, assess study eligibility, risk of bias assessment, or perform a meta-analysis from the included systematic reviews, but to provide an overall picture of the findings for a particular phenomenon [33].”
BackgroundMethodInfluentialTham, S. S., & Solomon, P. (2024) · Psychiatric Services · doi:10.1176/appi.ps.20230452 · Cited by 30
Cho, E., Lee, J. Y., Yang, M., Jang, J., Cho, J., & Kim, M. J. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104866 · Cited by 28
Curcumin and multiple health outcomes: critical umbrella review of intervention meta-analyses
Xu, Q., Lian, H., Zhou, R., Gu, Z., Wu, J., Wu, Y., & Li, Z. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1601204 · Cited by 211
An update on health literacy dimensions: An umbrella review
Smith, C. W., Behan, S., Belton, S., Nicholl, C., Murray, M., & Goss, H. R. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321227 · Cited by 29
Mental Health Outcomes in Transgender and Nonbinary People: An Umbrella Review
Hainey, K., Connolly, D. J., Thomson, R., Smalley, N. W., Campbell, D., Wells, V., Connelly, P. J., Delles, C., Mitchell, K. R., & Katikireddi, S. V. (2025) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2025.1850 · Cited by 27
Artificial intelligence in K-12 education: An umbrella review
Huang, R., Yin, Y., Zhou, N., & Lang, F. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100519 · Cited by 36
Brunström, M., Eliasson, M., Nilsson, P. M., & Carlberg, B. (2016) · Journal of Hypertension · doi:10.1097/hjh.0000000000001183 · Cited by 27
“Guidelines on overviews of reviews have focused on combining reviews of different treatments for the same condition, the same treatment for different conditions, or the same treatment for the same condition but with different outcomes [6,29].”
BackgroundEffectiveness of nursing educational interventions in managing post-surgical pain. Systematic review
Reaza-Alarcón, A., & Rodríguez‐Martin, B. (2019) · Investigación y Educación en Enfermería · doi:10.17533/udea.iee.v37n2e10 · Cited by 27
“(18) The study evaluated with the Joanna Briggs Institute Checklist for Systematic Reviews(11) reached a Antonio Reaza- Alarcón • Beatriz Rodríguez-Martín Invest Educ Enferm.”
BackgroundMethodInfluentialBiomarkers associated with idiopathic frozen shoulder: a systematic review
Andronic, O., Ernstbrunner, L., Jüngel, A., Wieser, K., & Bouaicha, S. (2019) · Connective Tissue Research · doi:10.1080/03008207.2019.1648445 · Cited by 27
“The quality of all the studies were then assessed using the Joanna Briggs Institute Critical Appraisal Checklist.27 A scoring systemwas then implemented per study such as studies that answered yes to a question from the checklist scored 2, not clear scored 1 and no scored 0.”
MethodDettori, J. R., Skelly, A. C., & Brodt, E. (2020) · Global Spine Journal · doi:10.1177/2192568220917926 · Cited by 27
“Several instruments have been designed to assess the quality of SRs based on established methodological processes for such reviews.(2-7) One popular instrument, the AMSTAR (A MeaSurement Tool to Assess systematic Reviews), was first developed and published in 2007 to evaluate SRs of randomized controlled trials.”
MethodGu, Y., Ma, H., Shujaat, S., Orhan, K., Coucke, W., Amoli, M. S., Bila, M., Politis, C., & Jacobs, R. (2021) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2021.03.055 · Cited by 27
Bel, L., Mathieu, N., Ducrest, V., & Bizzini, M. (2021) · International Journal of Sports Physical Therapy · doi:10.26603/001c.29860 · Cited by 27
Liao, Z., Fang, Z., Gou, S., Luo, Y., Liu, Y., He, Z., Li, X., Peng, Y., Fu, Z., Li, D., et al. (2022) · BMC Medicine · doi:10.1186/s12916-021-02229-5 · Cited by 30
“Umbrella reviews can assess the strength and validity of the evidence in the published SRoMAs and evaluate the potential for risk of bias [33].”
BackgroundIsaacs, A. N., Brooks, H. L., Lawn, S., Mohammadi, L., Vicary, E., & Sutton, K. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.06.018 · Cited by 28
Effectiveness of periodontal treatment to improve glycemic control: an umbrella review
Domenico, G. L. D., Minoli, M., Discepoli, N., Ambrosi, A., & Sanctis, M. D. (2022) · Acta Diabetologica · doi:10.1007/s00592-022-01991-z · Cited by 29
“The present UR was registered in the PROSPERO (International Prospective Register of Systematic Reviews) with Identification Number CRD42021222279 and reported in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analysis Extension (PRISMA) guidelines [24], and Joanna Briggs Institute metho…”
MethodHtet, K. Z., Lindrose, A. R., O’Connell, S. S., Marsh, J., & KISSINGER, P. J. (2023) · International Journal of STD & AIDS · doi:10.1177/09564624221149770 · Cited by 27
Challenges to Systems of Long-Term Care: Mapping of the Central Concepts from an Umbrella Review
Barreira, L. F., Paiva, A., Araújo, B., & Campos, M. J. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20031698 · Cited by 30
Research integrity in randomized clinical trials: A scoping umbrella review
Núñez‐Núñez, M., Maes‐Carballo, M., Mignini, L. E., CHIEN, P. F. W., Khalaf, Y., Fawzy, M. M., Zamora, J., Khan, K. S., & Bueno‐Cavanillas, A. (2023) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.14762 · Cited by 28
“Within the health and life sciences fields, medical science was the field with the most significant number of retractions (34), followed by biological sciences (17).”
BackgroundGuccione, L., Fullerton, S., Gough, K., Hyatt, A., Tew, M., Aranda, S. K., & Francis, J. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1040589 · Cited by 28
Shi, W., Green, H., Sikhosana, N., & Fernandez, R. S. (2023) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000807 · Cited by 31
“22”
BackgroundSelf-citationTousignant‐Laflamme, Y., Houle, C., Longtin, C., Gérard, T., Lagueux, É., Perreault, K., Beaudry, H., Tétreault, P., Blanchette, M., & Décary, S. (2023) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2023.102825 · Cited by 31
McGrath, R. L., Shephard, S., Parnell, T., Verdon, S. E., & Pope, R. (2023) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2023.2284823 · Cited by 28
“While systematic mapping reviews share similarities with both umbrella reviews and scoping reviews, umbrella reviews only include systematic reviews and meta-analyses and scoping reviews typically include primary research (Aromataris et al., 2015; Paolo and Joaquim, 2018; Pham et al., 2014).”
Emile, S. H., Horesh, N., Garoufalia, Z., Gefen, R., Ray‐Offor, E., & Wexner, S. D. (2023) · Surgery · doi:10.1016/j.surg.2023.10.005 · Cited by 27
Islam, M. S., Islam, M. S., Khan, T., Akhter, R., Rahman, S. M., Ara, H., Thurasamy, R., & Hoque, I. (2023) · Environmental Challenges · doi:10.1016/j.envc.2023.100820 · Cited by 29
Chakranon, P., Lai, Y. K., Tang, Y. W., Choudhary, P., Khunti, K., & Lee, S. W. H. (2019) · Diabetic Medicine · doi:10.1111/dme.14156 · Cited by 30
Batson, A., Newnam, S., & Koppel, S. (2022) · Safety Science · doi:10.1016/j.ssci.2022.105676 · Cited by 27
Houzé, B., El-Khatib, H., & Arbour, C. (2017) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.06.035 · Cited by 29
Alshammari, L., O’Halloran, P. D., McSorley, O., Doherty, J., & Noble, H. R. (2023) · Journal of Tissue Viability · doi:10.1016/j.jtv.2023.06.001 · Cited by 26
Cruciani, M., White, P. L., Barnes, R. A., Loeffler, J., Donnelly, J. P., Rogers, T. R., Heinz, W., Warris, A., Morton, C. O., Lengerová, M., et al. (2023) · Journal of Fungi · doi:10.3390/jof9100967 · Cited by 27
“Umbrella reviews collate several SRs on the same topic and consider the inclusion of the highest level of evidence available, such as SRs and meta-analyses [28–30].”
BackgroundIntersectionality in nursing research: A systematic review
Siira, E., Lindén, K., Wallström, S., & Björkman, I. (2023) · Nursing Open · doi:10.1002/nop2.2021 · Cited by 20
Maghraby, H., Elsuity, M. A., Adel, N., Magdi, Y., Abdelbadie, A. S., Rashwan, M., Ahmed, O. Y., Elmahdy, M., Khan, K. S., & Fawzy, M. M. (2024) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17796 · Cited by 27
“25,31 We reported our findings according to recommended guidelines.”
BackgroundFontaine, G., Poitras, M.-È., Sasseville, M., Pomey, M., Ouellet, J., Brahim, L. O., Wasserman, S., Bergeron, F., & Lambert, S. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02512-5 · Cited by 28
“An umbrella review of systematic and scoping reviews will be conducted following the guidelines of the Joanna Briggs Institute (JBI) [35, 36].”
BackgroundMethodRogers, K., Hirzle, T., Karaosmanoglu, S., Palomino, P. T., Durmanova, E., Isotani, S., & Nacke, L. E. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3685266 · Cited by 26
Education for sustainability and physical education: a systematic scoping review
Royet, T., Vors, O., Cece, V., & Lentillon‐Kaestner, V. (2024) · Sport Education and Society · doi:10.1080/13573322.2024.2440886 · Cited by 27
Farshad, S., & Fortin, C. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100809 · Cited by 32
Koivu, A. M., Hunter, P., Näsänen-Gilmore, P. K., Muthiani, Y., Isojärvi, J., Pörtfors, P., Ashorn, U., & Ashorn, P. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01463-y · Cited by 27
Orso, M., Polistena, B., Granato, S., Novelli, G., Virgilio, R. D., Torre, D. L., D’Angela, D., & Spandonaro, F. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264403 · Cited by 26
Regenerative Endodontics Success Factors and their Overall Effectiveness: An Umbrella Review.
Rojas‐Gutiérrez, W. J., Pineda‐Vélez, E., & Agudelo‐Suárez, A. A. (2022) · Iranian endodontic Journal/Iranian endodontic journal. · doi:10.22037/iej.v17i3.32703 · Cited by 26
Rapisarda, A., Battistelli, M., Izzo, A., D’Ercole, M., D’Alessandris, Q. G., Polli, F. M., Santi, S., Martinelli, R., & Montano, N. (2023) · Brain Sciences · doi:10.3390/brainsci13040530 · Cited by 26
“The most typical feature of this type of evidence synthesis is that only studies with the highest level of evidence (systematic reviews, eta-a alyses) can be considered for inclusion [5].”
BackgroundMental health outcomes in health care providers during the COVID-19 pandemic: an umbrella review
Majid, U., Hussain, S. A. S., Zahid, A., Haider, M. H., & Arora, R. (2023) · Health Promotion International · doi:10.1093/heapro/daad025 · Cited by 27
Farrukh, S., Habib, S., Rafaqat, A., Sarfraz, A., Sarfraz, Z., & Tariq, H. (2023) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2023.105068 · Cited by 29
Orso, M., Migliore, A., Polistena, B., Russo, E., Gatto, F., Monterubbianesi, M., D’Angela, D., Spandonaro, F., & Pane, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287774 · Cited by 26
“In particular: for research question 1 (epidemiology), we found a recently published system- atic review and meta-analysis that was judged to be of good quality, using the JBI Critical Appraisal Checklist for Systematic Reviews and Research Synthesis [15], and therefore we decided to present its results; for research…”
MethodInfluentialTimmermans, L., Golder, E., Decat, P., Foulon, V., Hecke, A. V., & Schoenmakers, B. (2023) · Health Policy · doi:10.1016/j.healthpol.2023.104880 · Cited by 34
Hernández, N. K. R., Carrero-Barragán, T. Y., Ardila, A., Salazar, J. D. R., Lozada-Martínez, I., Velez-Jaramillo, E., Ortega-Delgado, D. A., Fiorillo-Moreno, O., & Quiroz, E. N. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1222972 · Cited by 23
Winners do what they fear: exercise and peripheral arterial disease—an umbrella review
Peñín‐Grandes, S., López‐Ortiz, S., Maroto‐Izquierdo, S., Menéndez, H., Pinto-Fraga, J., Martín-Hernández, J., Lista, S., Lucía, A., & Santos‐Lozano, A. (2023) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwad261 · Cited by 26
Abayneh, M., Zeynudin, A., Tamrat, R., Tadesse, M., & Gizaw, A. T. (2023) · One Health Outlook · doi:10.1186/s42522-023-00088-z · Cited by 26
“The quality assessment and enrollment of each article were made by two independently critical appraisers based on the Joanna Briggs Institute (JBI) critical appraisal tools [17] and the Cochrane Handbook for Systematic Reviews [18].”
MethodMetabolic changes with intermittent fasting
Lange, M. G., Coffey, A. A., Coleman, P. C., Barber, T. M., van Rens, T., Oyebode, O. O., Abbott, S., & Hanson, P. (2024) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.13253 · Cited by 29
Pu, D., Wu, Y., Xu, D., Shi, G., Chen, H., Feng, D., Zhang, M., & Li, J. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1269922 · Cited by 27
Gross, J. L., & Koffman, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299933 · Cited by 27
Rouleau, G., Gagnon, M., Côté, J., Payne-Gagnon, J., Hudson, É., Bouix‐Picasso, J., & Dubois, C. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018441 · Cited by 29
“Aromataris et al 50 suggest to present overall effect estimates, numerical data and overall synthetised qualitative findings extracted from each review in a tabular presentation of findings.”
MethodPerformance of Harmonic devices in surgical oncology: an umbrella review of the evidence
Cheng, H., Clymer, J. W., Sadeghirad, B., Ferko, N. C., Cameron, C. G., & Amaral, J. F. (2018) · World Journal of Surgical Oncology · doi:10.1186/s12957-017-1298-x · Cited by 31
“This allows the comparison of findings of numerous SRs and their methodological quality, to help clinicians and healthcare providers make more accurate informed decisions [18].”
BackgroundGlucosamine sulphate: an umbrella review of health outcomes
Veronese, N., Demurtas, J., Smith, L., Reginster, J., Bruyère, O., Beaudart, C., Honvo, G., Maggi, S., & on behalf on the European Geriatric Medicine Society Special Interest Groups in Systematic Reviews and Meta-Analyses and Arthritis (2020) · Therapeutic Advances in Musculoskeletal Disease · doi:10.1177/1759720x20975927 · Cited by 29
“The Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) 28 recommendations and specific guidelines regarding how to conduct an umbrella review 29 were followed for the reporting of this study.”
MethodSedentary behaviour research in adults: A scoping review of systematic reviews and meta-analyses
Memon, A. R., Stanton, R., To, Q. G., Schöeppe, S., Urooj, A., Alley, S., Hayman, M., & Vandelanotte, C. (2021) · Journal of Sports Sciences · doi:10.1080/02640414.2021.1928382 · Cited by 27
“Scoping reviews tend to have a broad scope and breadth of the literature, compared to umbrella reviews which provide an overall picture of findings for particular research questions or phenomena (Aromataris et al., 2015; Schultz et al., 2018).”
BackgroundKisely, S., Zirnsak, T., Corderoy, A., Ryan, C. J., & Brophy, L. (2024) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674241246436 · Cited by 25
“…data extraction technique; a description of any overlap in meta-analyses of the same outcomes; estimations of common effect sizes where applicable; and assessments of study quality and heterogeneity (Aromataris et al., 2015; Fusar-Poli and Radua, 2018; Hunt et al., 2018; Pollock et al., 2019).”
MethodInterventions of choice for the prevention and treatment of suicidal behaviours: An umbrella review
Sufrate‐Sorzano, T., Santolalla‐Arnedo, I., Garrote‐Cámara, M. E., Nalda, B. A., Cotelo‐Sáenz, R., Pastells‐Peiró, R., Bellon, F., Blanco‐Blanco, J., Juárez‐Vela, R., & Molina‐Luque, F. (2023) · Nursing Open · doi:10.1002/nop2.1820 · Cited by 28
“Therefore, conducting an umbrella review provides an assessment of the quality of the existing evidence and contributes to the creation of an overview (Aromataris et al., 2015; BiondiZoccai, 2016).”
BackgroundLiu, B., Chen, K., Chen, X., Wang, J., Shu, G., Ping, Z., & Zhang, S. (2023) · Phytomedicine · doi:10.1016/j.phymed.2023.155151 · Cited by 29
Demystifying early childhood computational thinking: An umbrella review to upgrade the field
Yang, W., Su, J., & Li, H. (2024) · Future in Educational Research · doi:10.1002/fer3.38 · Cited by 28
Nocturia and frailty in older adults: a scoping review
Komleva, Y., Gollasch, M., & König, M. (2024) · BMC Geriatrics · doi:10.1186/s12877-024-05049-3 · Cited by 25
“We extracted information on the type of study, the year of publication, the first authors’ disciplinary affiliations, sample characteristics, research design, whether frailty, nocturia, LUTS, and sleep were dealt with and the main outcome message [22].”
MethodHospital design for inpatient psychiatry: A realistic umbrella review
Bodryzlova, Y., Lemieux, A. J., Dufour, M., Côté, A. V., Lalancette, S., & Crocker, A. G. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2024.07.045 · Cited by 27
Motevalli, M. S. (2025) · International Journal of Clinical Practice · doi:10.1155/ijcp/9929300 · Cited by 29
“…tool, developed by the Joanna Briggs Institute, has been developed to evaluate methodological development, conduct, and reporting of umbrella reviews [39], helping researchers identify reliable sources of evidence and facilitating more informed decision-making in clinical practice and policy.”
Sustainable Stormwater Management and Bioretention: An Overview of Reviews of the Last 10 Years
Bonciarelli, L., Orlandi, F., Muscas, D., & Fornaciari, M. (2025) · Land · doi:10.3390/land14040736 · Cited by 29
Impact of Exercise Training in Patients with Diabetic Peripheral Neuropathy: An Umbrella Review
Gracia‐Sánchez, A., López‐Pineda, A., Nouni-García, R., Zúnica‐García, S., Chicharro‐Luna, E., & Gil-Guillén, V. F. (2025) · Sports Medicine - Open · doi:10.1186/s40798-025-00863-4 · Cited by 28
Zgambo, M., Anyango, E., Arabiat, D. H., Ngune, I., Mörelius, E., Zhang, M., & Whitehead, L. (2025) · JMIR Pediatrics and Parenting · doi:10.2196/70745 · Cited by 25
“The systematic review was conducted following the Joanna Briggs Institute (JBI) methodology for systematic reviews [30].”
Orthostatic hypotension and health outcomes: an umbrella review of observational studies
The Special Interest Groups in Systematic Reviews and Meta-analyses for Healthy Ageing, A. C. M. O. T. E. S. O. G. M. (., Soysal, P., Veronese, N., Smith, L., Torbahn, G., Jackson, S. E., Yang, L., Ungar, A., Rivasi, G., Rafanelli, M., et al. (2019) · European Geriatric Medicine · doi:10.1007/s41999-019-00239-4 · Cited by 25
Wiggin, D. A., Timmons, S., Rukundo, A., & Walsh, K. A. (2021) · Aging & Mental Health · doi:10.1080/13607863.2021.1922601 · Cited by 25
“The conduct of this overview of reviews (defined in Pollock, Fernandes, Becker, Pieper, & Hartling (2020) as using systematic methods to present and appraise the quality of evidence from systematic reviews with similar research questions in the same topic area) followed guidance published by the Joanna Briggs institut…”
MethodChen, Y., Chang, M., Chow, L., & Ma, W. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182111500 · Cited by 25
“In this study, the umbrella review method [17] was used as the study design.”
MethodPatterns of polysomnography parameters in 27 neuropsychiatric diseases: an umbrella review
Zhang, Y., Ren, R., Yang, L., Zhang, H., Shi, Y., Vitiello, M. V., Sanford, L. D., & Tang, X. (2022) · Psychological Medicine · doi:10.1017/s0033291722001581 · Cited by 26
Marincowitz, C., Preston, L., Cantrell, A. J., Tonkins, M., Sabir, L., & Mason, S. M. (2022) · Age and Ageing · doi:10.1093/ageing/afac257 · Cited by 28
“As there are no specific quality assessment tools for quality appraisal of qualitative reviews, we used the Joanna Briggs Institute Critical Appraisal Tool for Systematic Reviews [21].”
MethodMindfulness and Chronic Musculoskeletal Pain: An Umbrella Review
Cardle, P., Kumar, S., Leach, M., McEvoy, M. P., & Veziari, Y. (2023) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s392375 · Cited by 26
State of the art of the literature on definitions of self-criticism: a meta-review
Zaccari, V., Mancini, F., & Rogier, G. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1239696 · Cited by 33
Effectiveness of interventions to prevent medication errors: an umbrella systematic review protocol
Hines, S. J., Kynoch, K., & Khalil, H. (2018) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2017-003481 · Cited by 33
“Assessment of methodological quality Selected systematic reviews will be critically appraised by two independent reviewers for methodological quality in the review using the standardized critical appraisal instruments from the Joanna Briggs Institute for systematic reviews.(36) Any SYSTEMATIC REVIEW PROTOCOL S.”
MethodSelf-citationAn Umbrella Review of Systematic Reviews on Trauma Informed Approaches
Mahon, D. (2024) · Community Mental Health Journal · doi:10.1007/s10597-024-01317-z · Cited by 26
“Thus, The Joanne Briggs Institute Critical Appraisal Checklist for Systematic Reviews and Research Syntheses (Aromataris et al., 2020) was used to assess the quality of the included systematic reviews.”
Yi, Y. J., Matin, N. H., Brannan, D., Johnson, M. W., & Nguyen, A. (2024) · HERD Health Environments Research & Design Journal · doi:10.1177/19375867241271434 · Cited by 29
Dashti, M., Londono, J., Ghasemi, S., Zare, N., Samman, M., Ashi, H. M., Amirzade-Iranaq, M. H., Khosraviani, F., Sabeti, M. A., & Khurshid, Z. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2371 · Cited by 30
A Systematic Review of Trauma Informed Care in Substance Use Settings
Mahon, D. (2024) · Community Mental Health Journal · doi:10.1007/s10597-024-01395-z · Cited by 29
“Data were extracted using an adapted version of the Joanne Briggs Institute Data Extraction Form for Systematic Reviews and Research Syntheses (Aromataris et al., 2015).”
The Benefits of Hearing Aids for Adults: A Systematic Umbrella Review
Tang, D., Tran, Y., Bennett, R. J., Lo, C., Lee, J. N., Turner, J., & Gopinath, B. (2025) · Ear and Hearing · doi:10.1097/aud.0000000000001620 · Cited by 25
“This decision aligns with traditional umbrella reviews which only assess data from systematic reviews (Aromataris et al. 2015).”
Xu, H., Gong, T., Song, X., Chen, Q., Bao, Q., Yao, W., Xie, M.-M., Li, C., Grzegorzek, M., Shi, Y., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/53567 · Cited by 25
“Therefore, the methodological quality of the included articles was rated using only the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [19].”
Health impacts of electronic nicotine delivery systems: an umbrella review of systematic reviews
Kaur, J., Goel, S., Shabil, M., Rana, R. K., Rinkoo, A. V., Chauhan, A., & Gupta, S. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-100168 · Cited by 28
“25 In the recent past, three umbrella reviews reported health outcomes.”
Buja, A., Francesconi, P., Bellini, I., Barletta, V., Girardi, G., Braga, M., Cosentino, M., Marvulli, M., Baldo, V., & Damiani, G. (2020) · Primary Health Care Research & Development · doi:10.1017/s1463423620000080 · Cited by 26
“For example, some studies may have been included in multiple analyses, making their findings more influential because they were counted more than once (Aromataris et al., 2015).”
Mohammed, S. H., Habtewold, T. D., Arero, A. G., & Esmaillzadeh, A. (2020) · BMC Pediatrics · doi:10.1186/s12887-020-02301-8 · Cited by 27
Déry, J., de Guise, É., Bussières, È.-L., & Lamontagne, M. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01810-6 · Cited by 26
Hall, L., King, N. V., Graham, C. D., Green, S. M. C., Barber, A., Neal, R. D., Foy, R., Clark, J., Lloyd, K. E., & Smith, S. G. (2021) · Journal of Cancer Survivorship · doi:10.1007/s11764-021-01114-7 · Cited by 24
Umbrella reviews: A new tool to synthesize scientific evidence in surgery
Slim, K., & Marquillier, T. (2021) · Journal of Visceral Surgery · doi:10.1016/j.jviscsurg.2021.10.001 · Cited by 24
Lee, K. J., & Choi, K. (2022) · Exposure and Health · doi:10.1007/s12403-022-00475-3 · Cited by 26
“), an umbrella review can provide conclusions based on the best balanced evaluation of the existing knowledges on a specific topic (Aromataris et al. 2015; Smith et al. 2011).”
BackgroundRole of iron biomarkers and iron intakes in lung cancer risk: A systematic review and meta-analysis
Wang, Q., Cui, Q., Gao, J., & Xing, R. (2022) · Journal of Trace Elements in Medicine and Biology · doi:10.1016/j.jtemb.2022.127060 · Cited by 24
Associated factors and treatment options for sleep bruxism in children: an umbrella review
Scarpini, S., Adriana de Oliveira, L. I. R. A., Gimenez, T., Raggio, D. P., Chambrone, L., de Souza, R. C., Floriano, I., Morimoto, S., & Tedesco, T. K. (2023) · Brazilian Oral Research · doi:10.1590/1807-3107bor-2023.vol37.0006 · Cited by 24
Chew, H. S. J., Heng, F. K. X., Tien, S. A., Thian, J. Y., Chou, H. S., Loong, S. S. E., Ang, W. H. D., Chew, N., & Lo, K. K.-H. (2023) · Nutrients · doi:10.3390/nu15102331 · Cited by 24
“Due to the various methodological limitations in the existing relevant umbrella reviews, we conducted an umbrella review to consolidate the vast amount of evidence from existing SRMAs on the effects of plant-based diets on anthropometric and cardiometabolic markers, while considering the magnitude, precision, and pote…”
Backgroundde Guzmán, E. N., Bracchiglione, J., Ballester, M., Groene, O., Heijmans, M., García, L. M., Noordman, J., Orrego, C., Rocha, C. A., Suñol, R., et al. (2023) · Archives of Public Health · doi:10.1186/s13690-023-01153-9 · Cited by 27
“Assessment of methodological quality We applied the 11-item Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [24].”
MethodSchulze, M. B., Haardt, J., Amini, A. M., Kalotai, N., Lehmann, A. C., Schmidt, A., Buyken, A. E., Egert, S., Ellinger, S., Kroke, A., et al. (2023) · European Journal of Nutrition · doi:10.1007/s00394-023-03234-5 · Cited by 26
Metadata
- Authors
- Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.
- Affiliations
- Queen's University (CA)
- University of Wollongong (AU)
- Rutgers, The State University of New Jersey (US)
- Monash University (AU)
- Chiang Mai University (TH)
- Corresponding author
- Aromataris, Edoardo
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2015-09
- Volume
- 13
- Issue
- 3
- Pages
- 132-140
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2364450135
- Cited by
- 2,587
- References
- 20
- Citations by year
- 2026: 434 · 2025: 414 · 2024: 452 · 2023: 385 · 2022: 313 · 2021: 235 · 2020: 159 · 2019: 90 · 2018: 62 · 2017: 31 · 2016: 9
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- umbrella review, systematic reviews, meta-analysis, methodological recommendations, critical appraisal tools, risk of bias, search strategies, inclusion criteria, evidence synthesis, healthcare decision-making
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Review Literature as Topic, Meta-Analysis as Topic, Bias, Guidelines as Topic, Evidence-Based Medicine, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.