The development of software to support multiple systematic review types: the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI)

Munn, Zachary; Aromataris, Edoardo; Tufanaru, Catalin; Stern, Cindy; Porritt, Kylie; Farrow, James; Lockwood, Craig; Stephenson, Matthew; Moola, Sandeep; Lizarondo, Lucylynn; McArthur, Alexandra; Peters, Micah; Pearson, Alan; Jordan, Zoe

doi:10.1097/xeb.0000000000000152

Cited by 977Meta-analysis and systematic reviewsSoftware Engineering Techniques and PracticesClinical practice guidelines implementation

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

The development of software to support multiple systematic review types: the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI)

Munn, Zachary, Aromataris, Edoardo, Tufanaru, Catalin, Stern, Cindy, Porritt, Kylie, Farrow, James, Lockwood, Craig, Stephenson, Matthew, Moola, Sandeep, Lizarondo, Lucylynn, McArthur, Alexandra, Peters, Micah, Pearson, Alan, Jordan, Zoe·2019·International Journal of Evidence-Based Healthcare

DOI 10.1097/xeb.0000000000000152

Open this paper in CoChat — free account

Abstract

AIM: Systematic reviews play an important role in ensuring trustworthy recommendations in healthcare. However, systematic reviews can be laborious to undertake and as such software has been developed to assist in the conduct and reporting of systematic reviews. The Joanna Briggs Institute and its collaborating centres consist of thousands of researchers, academics and clinicians across the globe conducting systematic reviews of various types. To support them in their work, modern software and online tools are required. Our aim was to develop a software program to support systematic reviewers across the globe. METHODS: A working party was formed with extensive consultation with members of the Joanna Briggs Collaboration focusing on ideal features of a software program to support systematic reviews. The new systematic review software was built using an agile methodology and designed to be a modern web application. RESULTS: The new systematic review software, the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI), was successfully developed through an iterative process of development, feedback, testing and review. The software is now available (https://www.jbisumari.org/) and supports the entire systematic review process for different types of systematic reviews. CONCLUSIONS: An agile software development approach combined with wide consultation and user testing can facilitate systematic review software design and development. This new software can support systematic reviews and guideline developers to create systematic reviews for a diverse range of questions.

Integrity signals

Registry

Crossref · 10.1097/xeb.0000000000000152

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Empirical studies of agile software development: A systematic review
Dybå, T., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.01.006 · Cited by 2,668
Qualitative research synthesis: methodological guidance for systematic reviewers utilizing meta-aggregation
Lockwood, C., Munn, Z., & Porritt, K. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000062 · Cited by 2,456
Self-citation
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
What kind of systematic review should I conduct? A proposed typology and guidance for systematic reviewers in the medical and health sciences
Munn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164
Self-citation
Establishing confidence in the output of qualitative research synthesis: the ConQual approach.
Munn, Z., Porritt, K., Lockwood, C., Aromataris, E., & Pearson, A. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-108 · Cited by 803
Self-citation
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012545 · Cited by 737
The Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598
Self-citation
The JBI model of evidence-based healthcare
Pearson, A., Wiechula, R., Court, A., & Lockwood, C. (2005) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2005.00026.x · Cited by 451
Self-citation
Living systematic reviews: 2. Combining human and machine effort
Thomas, J., Noel-Storr, A., Marshall, I., Wallace, B., McDonald, S., Mavergames, C., Glasziou, P., Shemilt, I., Synnot, A., Turner, T., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.011 · Cited by 355
Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations
Woolf, S. H., Schünemann, H. J., Eccles, M., Grimshaw, J., & Shekelle, P. (2012) · Implementation Science · doi:10.1186/1748-5908-7-61 · Cited by 236
Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR)
On behalf of the founding members of the ICASR group, Beller, E., Clark, J., Tsafnat, G., Adams, C., Diehl, H., Lund, H., Ouzzani, M., Thayer, K., Thomas, J., et al. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0740-7 · Cited by 191
Translational Science and Evidence-Based Healthcare: A Clarification and Reconceptualization of How Knowledge Is Generated and Used in Healthcare
Pearson, A., Jordan, Z., & Munn, Z. (2012) · Nursing Research and Practice · doi:10.1155/2012/792519 · Cited by 167
Self-citation
What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments
Harker, J., & Kleijnen, J. (2012) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2012.00290.x · Cited by 137

Flagged first, then by citations

Sorted by citations

Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Self-citation
Methodological quality of case series studies: an introduction to the JBI critical appraisal tool
Munn, Z., Barker, T. H., Moola, S., Tufanaru, C., Stern, C., McArthur, A., Stephenson, M., & Aromataris, E. (2019) · JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-d-19-00099 · Cited by 1,581
Self-citation
Best practice guidance and reporting items for the development of scoping review protocols
Peters, M. D. J., Godfrey, C., McInerney, P., Khalil, H., Larsen, P., Marnie, C., Pollock, D., Tricco, A. C., & Munn, Z. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00242 · Cited by 1,444
Self-citation
Undertaking a scoping review: A practical guide for nursing and midwifery students, clinicians, researchers, and academics
Pollock, D., Davies, E. L., Peters, M. D. J., Tricco, A. C., Alexander, L., McInerney, P., Godfrey, C. M., Khalil, H., & Munn, Z. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14743 · Cited by 769
“…frameworks), co-authors for the study selection and extraction process, software to support the process (such as SUMARI and/or reference management software) (Munn et al., 2019), an academic librarian to assist with preparing the search strategy, and sufficient time (Peters, Godfrey, et al., 2020).”
MethodInfluentialSelf-citation
Conducting proportional meta-analysis in different types of systematic reviews: a guide for synthesisers of evidence
Barker, T. H., Migliavaca, C. B., Stein, C., Colpani, V., Falavigna, M., Aromataris, E., & Munn, Z. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01381-z · Cited by 738
Self-citation
Understanding Eco-anxiety: A Systematic Scoping Review of Current Literature and Identified Knowledge Gaps
Coffey, Y., Bhullar, N., Durkin, J., Islam, M. S., & Usher, K. (2021) · The Journal of Climate Change and Health · doi:10.1016/j.joclim.2021.100047 · Cited by 541
Engaging children and young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers
Liverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408
How are systematic reviews of prevalence conducted? A methodological study
on behalf of the Prevalence Estimates Reviews – Systematic Review Methodology Group (PERSyst), Borges Migliavaca, C., Stein, C., Colpani, V., Barker, T. H., Munn, Z., & Falavigna, M. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00975-3 · Cited by 359
Self-citation
Conducting high quality scoping reviews-challenges and solutions
Khalil, H., Peters, M. D., Tricco, A. C., Pollock, D., Alexander, L., McInerney, P., Godfrey, C. M., & Munn, Z. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.009 · Cited by 305
Self-citation
Clinical characteristics and outcomes of pregnant women with COVID‐19 and comparison with control patients: A systematic review and meta‐analysis
Jafari, M., Pormohammad, A., Neshin, S. A. S., Ghorbani, S., Bose, D., Alimohammadi, S., Basirjafari, S., Mohammadi, M., Rasmussen-Ivey, C. R., Razizadeh, M. H., et al. (2021) · Reviews in Medical Virology · doi:10.1002/rmv.2208 · Cited by 286
Assessing the risk of bias of quantitative analytical studies: introducing the vision for critical appraisal within JBI systematic reviews
Munn, Z., Stone, J., Aromataris, E., Klugar, M., Sears, K., Leonardi‐Bee, J., & Barker, T. H. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00224 · Cited by 296
Self-citation
Research screener: A machine learning tool to semi-automate abstract screening for systematic reviews
Chai, K. E. K., Lines, R. L. J., Gucciardi, D. F., & Ng, L. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01635-3 · Cited by 190
Socioeconomic status and health behavior in children and adolescents: a systematic literature review
Gautam, N., Dessie, G., Rahman, M. M., & Khanam, R. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1228632 · Cited by 216
Prenatal exposure to ambient air pollution and adverse birth outcomes: An umbrella review of 36 systematic reviews and meta-analyses
Nyadanu, S. D., Dunne, J., Tessema, G. A., Mullins, B. J., Kumi-Boateng, B., Bell, M. L., Duko, B., & Pereira, G. F. (2022) · Environmental Pollution · doi:10.1016/j.envpol.2022.119465 · Cited by 166
Hyperinflammatory Response in COVID-19: A Systematic Review
Silva, M. J. A., Ribeiro, L. R., Gouveia, M. I. M., Marcelino, B. D. R., dos Santos, C. S., Lima, K. V. B., & Lima, L. N. G. C. (2023) · Viruses · doi:10.3390/v15020553 · Cited by 174
Methodological quality, guidance, and tools in scoping reviews: a scoping review protocol
Pollock, D., Tricco, A. C., Peters, M. D. J., Mclnerney, P. A., Khalil, H., Godfrey, C. M., Alexander, L. A., & Munn, Z. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00570 · Cited by 154
Self-citation
Anxiety and depression among healthcare workers during the COVID-19 pandemic: a systematic umbrella review of the global evidence
Fernandez, R. S., Sikhosana, N., Green, H., Halcomb, E., Middleton, R., Alananzeh, I. M., Trakis, S., & Moxham, L. J. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-054528 · Cited by 136
JBI series paper 2: tailored evidence synthesis approaches are required to answer diverse questions: a pragmatic evidence synthesis toolkit from JBI
Aromataris, E., Stern, C., Lockwood, C. S., Barker, T. H., Klugar, M., Jadotte, Y. T., Evans, C., Ross‐White, A., Lizarondo, L. M., Stephenson, M., et al. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.04.006 · Cited by 133
Self-citation
Indigenous Resilience in Australia: A Scoping Review Using a Reflective Decolonizing Collective Dialogue
Usher, K. J., Jackson, D. W., Walker, R., Durkin, J., Smallwood, R., Robinson, M., Sampson, U. N., Adams, I., Porter, C., & Marriott, R. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.630601 · Cited by 109
Effectiveness of nurse-led interventions versus usual care to manage hypertension and lifestyle behaviour: a systematic review and meta-analysis
Bulto, L. N., Roseleur, J., Noonan, S., de Plaza, M. A. P., Champion, S., Dafny, H. A., Pearson, V., Nesbitt, K., Gebremichael, L. G., Beleigoli, A. M. R., et al. (2023) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvad040 · Cited by 125
Post-licensure zoster vaccine effectiveness against herpes zoster and postherpetic neuralgia in older adults: a systematic review and meta-analysis
Mbinta, J. F., Nguyen, B. P., Awuni, P. M. A., Paynter, J., & Simpson, C. R. (2022) · The Lancet Healthy Longevity · doi:10.1016/s2666-7568(22)00039-3 · Cited by 93
Global Prevalence of Childhood Exposure to Physical Violence within Domestic and Family Relationships in the General Population: A Systematic Review and Proportional Meta-Analysis
Whitten, T., Tzoumakis, S., Green, M. J., & Dean, K. (2023) · Trauma Violence & Abuse · doi:10.1177/15248380231179133 · Cited by 97
Prevalence of Pathogenic Variants in Cardiomyopathy-Associated Genes in Acute Myocarditis
Monda, E., Bakalakos, A., Cannie, D., O’Mahony, C., Syrris, P., Kaski, J. P., Limongelli, G., & Elliott, P. M. (2024) · JACC: Heart Failure · doi:10.1016/j.jchf.2024.02.012 · Cited by 86
Reviewing the experiences of maternal guilt–the “motherhood myth” influence
Constantinou, G., Varela, S., & Buckby, B. (2021) · Health Care for Women International · doi:10.1080/07399332.2020.1835917 · Cited by 82
Social media, rituals, and long-distance family relationship maintenance: A mixed-methods systematic review
Abel, S., Machin, T. M., & Brownlow, C. (2020) · New Media & Society · doi:10.1177/1461444820958717 · Cited by 96
Achievement of learning outcomes in non‐traditional (online) versus traditional (face‐to‐face) anatomy teaching in medical schools: A mixed method systematic review
Abualadas, H. M., & Xu, L. (2022) · Clinical Anatomy · doi:10.1002/ca.23942 · Cited by 71
Timing of neonatal mortality and severe morbidity during the postnatal period: a systematic review
Dol, J., Hughes, B., Bonet, M., Dorey, R., Dorling, J. S., Grant, A. K., Langlois, É. V., Monaghan, J., Ollivier, R., Parker, R. M. N., et al. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00479 · Cited by 69
Impact of nurse staffing on patient and nurse workforce outcomes in acute care settings in low- and middle-income countries: a systematic review
Assaye, A. M., Wiechula, R., Schultz, T., & Feo, R. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00426 · Cited by 65
Experiences of living with leprosy: A systematic review and qualitative evidence synthesis
Rahman, N. A., Rajaratnam, V., Burchell, G. L., Peters, R. M. H., & Zweekhorst, M. B. M. (2022) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0010761 · Cited by 77
Prevalence of Mental Disorders in Uganda: a Systematic Review and Meta-Analysis
Opio, J. N., Munn, Z., & Aromataris, E. (2021) · Psychiatric Quarterly · doi:10.1007/s11126-021-09941-8 · Cited by 71
Self-citation
Digital interventions for healthy ageing and cognitive health in older adults: a systematic review of mixed method studies and meta-analysis
Tsai, Y. I., Beh, J., Ganderton, C. L., & Pranata, A. (2024) · BMC Geriatrics · doi:10.1186/s12877-023-04617-3 · Cited by 62
Poor treatment outcome and its predictors among drug-resistant tuberculosis patients in Ethiopia: A systematic review and meta-analysis
Alemu, A., Bitew, Z. W., & Worku, T. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.05.087 · Cited by 63
Determinants of Food Choice in Athletes: A Systematic Scoping Review
Pelly, F. E., Thurecht, R., & Slater, G. (2022) · Sports Medicine - Open · doi:10.1186/s40798-022-00461-8 · Cited by 53
Artificial Intelligence in Health Education and Practice: A Systematic Review of Health Students’ and Academics’ Knowledge, Perceptions and Experiences
Shishehgar, S., Murray‐Parahi, P., Alsharaydeh, E., Mills, S., & Liu, X. (2025) · International Nursing Review · doi:10.1111/inr.70045 · Cited by 81
PRISMA 2020: a reporting guideline for the next generation of systematic reviews
Brennan, S. E., & Munn, Z. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00112 · Cited by 52
Self-citation
Economic Burden of Mosquito-Borne Diseases in Low- and Middle-Income Countries: Protocol for a Systematic Review
Chilakam, N., Lakshminarayanan, V., Keremutt, S., Rajendran, A., Thunga, G., Poojari, P. G., Rashid, M., Mukherjee, N., Bhattacharya, P., & John, D. (2023) · JMIR Research Protocols · doi:10.2196/50985 · Cited by 50
Depression and anxiety prevalence in people with cystic fibrosis and their caregivers: a systematic review and meta-analysis
Lord, L., McKernon, D., Grzeskowiak, L. E., Kirsa, S. W., & Ilomäki, J. (2022) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-022-02307-w · Cited by 49
What is the role of interoception in the symptom experience of people with a chronic condition? A systematic review
Locatelli, G., MATUS, A. M., James, R., Salmoirago‐Blotcher, E., Ausili, D., Vellone, E., & Riegel, B. J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105142 · Cited by 58
The Association between Resilience and Psychological Distress during the COVID-19 Pandemic: A Systematic Review and Meta-Analysis
Jeamjitvibool, T., Duangchan, C., Mousa, A., & Mahikul, W. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214854 · Cited by 48
Prevalence and predictors of teenage pregnancy in Pakistan: a trend analysis from Pakistan Demographic and Health Survey datasets from 1990 to 2018
Alı̀, A., Khaliq, A., Lokeesan, L., Meherali, S. M., & Lassi, Z. S. (2021) · International Health · doi:10.1093/inthealth/ihab025 · Cited by 46
Automation tools to support undertaking scoping reviews
Khalil, H., Pollock, D., McInerney, P., Evans, C., Moraes, E. B., Godfrey, C. M., Alexander, L., Tricco, A., Peters, M. D. J., Pieper, D., et al. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1731 · Cited by 43
Self-citation
The integration of care ethics and nursing workload: A qualitative systematic review
Waterfield, D., & Barnason, S. A. (2022) · Journal of Nursing Management · doi:10.1111/jonm.13723 · Cited by 51
Utilising Digital Health Technology to Support Patient-Healthcare Provider Communication in Fragility Fracture Recovery: Systematic Review and Meta-Analysis
Yadav, L., Haldar, A., Jasper, U. S., Taylor, A., Visvanathan, R., Chehade, M. J., & Gill, T. K. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16204047 · Cited by 42
Barriers and facilitators of physical activity participation in adults living with type 1 diabetes: a systematic scoping review
Brennan, M. C., Brown, J. A., Ntoumanis, N., & Leslie, G. D. (2020) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2020-0461 · Cited by 41
Interactive technology use and child development: A systematic review
Arabiat, D. H., Jabery, M. A. F. A., Robinson, S., Whitehead, L., & Mörelius, E. (2022) · Child Care Health and Development · doi:10.1111/cch.13082 · Cited by 41
The neurobiological effects of mind–body exercise: a systematic review and meta-analysis of neuroimaging studies
Han, Y. M. Y., Chan, M. M. Y., Choi, C. X. T., Law, M. C. H., Ahorsu, D. K., & Tsang, H. W. H. (2023) · Scientific Reports · doi:10.1038/s41598-023-37309-4 · Cited by 55
Esophageal perforation in eosinophilic esophagitis: A systematic review on clinical presentation, management and outcomes
Arias‐González, L., Rey‐Iborra, E., Ruiz-Ponce, M., Mendieta, E. J. L., Arias, Á., & Lucendo, A. J. (2019) · Digestive and Liver Disease · doi:10.1016/j.dld.2019.10.019 · Cited by 40
Bladder cancer and human papillomavirus association: a systematic review and meta-analysis
Khatami, A., Salavatiha, Z., & Razizadeh, M. H. (2022) · Infectious Agents and Cancer · doi:10.1186/s13027-022-00415-5 · Cited by 40
Retention strategies and barriers for millennial nurses: a scoping review
McClain, A. R., Palokas, M. J., Christian, R., & Arnold, A. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00577 · Cited by 44
Implementing GRADE in systematic reviews that adhere to JBI methodological conduct
Stern, C., Munn, Z., Barker, T. H., Porritt, K. A., Stone, J., Pap, R., Khalil, H., & Aromataris, E. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00543 · Cited by 41
Self-citation
The Functional Resonance Analysis Method as a health care research methodology: a scoping review
McGill, A., Smith, D., McCloskey, R. M., Morris, P., Goudreau, A., & Veitch, B. J. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00099 · Cited by 35
Fathers’ experiences of depression during the perinatal period: a qualitative systematic review
Davenport, C. J., Lambie, J., Owen, C., & Swami, V. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00365 · Cited by 36
The mental health of migrants living in limbo: A mixed-methods systematic review with meta-analysis
Côté‐Olijnyk, M., Perry, J. C., Paré, M.-È., & Kronick, R. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.115931 · Cited by 35
Presenteeism among nurses: An integrative review
Gerlach, M., Hahn, S., Rossier, C., Geese, F., Hamers, J. P. H., & Backhaus, R. (2024) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2024.100261 · Cited by 35
Motor Developmental Outcomes in Children Exposed to Maternal Diabetes during Pregnancy: A Systematic Review and Meta-Analysis
Arabiat, D. H., Jabery, M. A. F. A., Kemp, V., Jenkins, M. A., Whitehead, L., & Adams, G. G. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041699 · Cited by 34
Latin American Consensus on the Management of Sepsis in Children: Sociedad Latinoamericana de Cuidados Intensivos Pediátricos [Latin American Pediatric Intensive Care Society] (SLACIP) Task Force: Executive Summary
Fernández‐Sarmiento, J., de Souza, D. C., Martínez, A. S., Nieto, V., López‐Herce, J., Lanziotti, V. S., Lopez, M. D. P. A., de Carvalho, W. B., de Oliveira, C. F., Jaramillo-Bustamante, J. C., et al. (2021) · Journal of Intensive Care Medicine · doi:10.1177/08850666211054444 · Cited by 34
A systematic review and meta-analysis of questionnaires to screen for pain sensitisation and neuropathic like pain in inflammatory arthritis
Rutter‐Locher, Z., Arumalla, N., Norton, S., Taams, L. S., Kirkham, B. W., & Bannister, K. (2023) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2023.152207 · Cited by 33
Spiritual aspects of the family caregivers’ experiences when caring for a community‐dwelling adult with severe mental illness: A systematic review of qualitative evidence
Casaleiro, T., Caldeira, S., Cardoso, D., & Apóstolo, J. (2022) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12816 · Cited by 37
Reducing Literature Screening Workload With Machine Learning: A Systematic Review of Tools and Their Performance
Burgard, T., & Bittermann, A. (2023) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000509 · Cited by 29
Characteristics and processes of the dedicated education unit practice education model for undergraduate nursing students: a scoping review
Marcellus, L., Jantzen, D., Humble, R., Sawchuck, D., & Gordon, C. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00462 · Cited by 32
Experience of clinical nurses engaged in caring for patients with COVID ‐19: A qualitative systematic review and meta‐synthesis
Luo, Y., Feng, X., Wang, D., Qiao, X., Xiao, X., Jia, S., Zheng, M., & Reinhardt, J. D. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16613 · Cited by 38
Epstein Barr Virus Reactivation during COVID-19 Hospitalization Significantly Increased Mortality/Death in SARS-CoV-2(+)/EBV(+) than SARS-CoV-2(+)/EBV(−) Patients: A Comparative Meta-Analysis
Manoharan, S., & Ying, L. Y. (2023) · International Journal of Clinical Practice · doi:10.1155/2023/1068000 · Cited by 32
Understanding the experience of diagnostic overshadowing associated with severe mental illness from the consumer and health professional perspective: a qualitative systematic review protocol
Molloy, R., Munro, I., & Pope, N. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00244 · Cited by 30
The effect of family planning counselling on postpartum modern contraceptive uptake in sub-Saharan Africa: a systematic review
Mruts, K. B., Tessema, G. A., Gebremedhin, A. T., Scott, J. A., & Pereira, G. F. (2022) · Public Health · doi:10.1016/j.puhe.2022.02.017 · Cited by 31
A systematic review of the effects of probiotic administration in inflammatory arthritis
Lowe, J. R., Briggs, A. M., Whittle, S., & Stephenson, M. (2020) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2020.101207 · Cited by 31
Self-citation
Concentrations of antiseizure medications in breast milk of lactating women with epilepsy: A systematic review with qualitative synthesis
Shawahna, R., & Zaid, L. (2022) · Seizure · doi:10.1016/j.seizure.2022.03.017 · Cited by 31
Sensor technologies to detect out-of-hospital cardiac arrest: A systematic review of diagnostic test performance
Hutton, J., Lingawi, S., Puyat, J. H., Kuo, C., Shadgan, B., Christenson, J. M., & Grunau, B. E. (2022) · Resuscitation Plus · doi:10.1016/j.resplu.2022.100277 · Cited by 32
Information and Support Needs of Parents With Premature Infants: An Integrative Review
Davis-Strauss, S. L., Johnson, E., & Lubbe, W. (2020) · Journal of Early Intervention · doi:10.1177/1053815120957734 · Cited by 29
Photodynamic therapy for squamous cell carcinoma of the head and neck: narrative review focusing on photosensitizers
Ibarra, A., Cecatto, R. B., Motta, L. J., Franco, A. L. D. S., da Silva, D. D. F. T., Nunes, F. D., Hamblin, M. R., & Rodrigues, M. F. S. D. (2021) · Lasers in Medical Science · doi:10.1007/s10103-021-03462-3 · Cited by 33
A scoping review of digital technology applications in palliative care
Tan, Y., Liang, X., Wei, M., Xing, H., Wang, Y., & Gao, Y. (2024) · BMC Palliative Care · doi:10.1186/s12904-024-01626-w · Cited by 36
Safety of cassava and cassava-based products: a systematic review
Forkum, A. T., Wung, E. A., Kelese, M. T., Ndum, C. M., Lontum, A., Kamga, E., Nsaikila, M. N., & Okwen, P. (2025) · Frontiers in Sustainable Food Systems · doi:10.3389/fsufs.2025.1497609 · Cited by 37
Intestinal parasites co-infection among tuberculosis patients in Ethiopia: a systematic review and meta-analysis
Alemu, A., Bitew, Z. W., & Worku, T. (2020) · BMC Infectious Diseases · doi:10.1186/s12879-020-05237-7 · Cited by 28
Effectiveness of non-pharmacological interventions to treat orthostatic hypotension in elderly people and people with a neurological condition: a systematic review
Logan, A., Freeman, J. A., Pooler, J., Kent, B., Gunn, H., Billings, S., Cork, E., & Marsden, J. F. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-18-00005 · Cited by 28
Implementation strategies to increase human papillomavirus vaccination uptake for adolescent girls in sub-Saharan Africa: A scoping review protocol
Lubeya, M. K., Mwanahamuntu, M., Chibwesha, C. J., Mukosha, M., Monde, M. W., & Kawonga, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267617 · Cited by 28
Regional prevalence of hypertension among people diagnosed with diabetes in Africa, a systematic review and meta-analysis
Hinneh, T. K., Akyirem, S., Bossman, I. F., Lambongang, V., Ofori-Aning, P., Ogungbe, O., & Commodore-Mensah, Y. Y. (2023) · PLOS Global Public Health · doi:10.1371/journal.pgph.0001931 · Cited by 26
Adolescent maternal health services utilization and associated barriers in Sub-Saharan Africa: A comprehensive systematic review and meta-analysis before and during the sustainable development goals
Tolossa, T., Gold, L. H., Dheresa, M., Turi, E., Yeshitila, Y. G., & Abimanyi-Ochom, J. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e35629 · Cited by 33
Social Interaction and Physical Activity Among Rural Older Adults: A Scoping Review
Schmidt, L., Johnson, S., Genoe, M. R., Jeffery, B., & Crawford, J. E. (2021) · Journal of Aging and Physical Activity · doi:10.1123/japa.2021-0046 · Cited by 29
JBI series paper 4: the role of collaborative evidence networks in promoting and supporting evidence-based health care globally: reflections from 25 years across 38 countries
Pilla, B., Jordan, Z., Christian, R., Kynoch, K., McInerney, P. A., Cooper, K., Wu, Y., Porritt, K. A., Lockwood, C. S., & Munn, Z. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.04.009 · Cited by 26
Self-citation
Experiences and perceptions of family members of emergency first responders with post-traumatic stress disorder: a qualitative systematic review
May, K., Hooff, M. V., Doherty, M., & Iannos, M. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00433 · Cited by 31
Colorectal cancer survivors’ experiences of return-to-work: A meta-synthesis of qualitative studies
Zhao, J., Que, W., Tang, J., Li, J., Su, X., & Guo, Y. (2023) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2023.102284 · Cited by 26
Midwives’ interventions for reducing fear of childbirth in pregnant women: a scoping review
do Souto, S. P. A., da Silva, R. C. G., Prata, A. P., Guerra, M. J., Couto, C., & de Albuquerque, R. S. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00382 · Cited by 28
Pain assessment tools for use in infants: a meta-review
Arabiat, D. H., Mörelius, E., Hoti, K., & Hughes, J. (2023) · BMC Pediatrics · doi:10.1186/s12887-023-04099-7 · Cited by 24
Interactions between bacteria in the human nasopharynx: a scoping review
Yu, K., Tenaglia, V. P., Chua, E. G., Haines, R. R., Bahal, G. N., Nicol, M. P., & Bahal, R. K. (2025) · The Lancet Microbe · doi:10.1016/j.lanmic.2024.101062 · Cited by 26
Effectiveness of discharge education strategies versus usual care on clinical outcomes in acute coronary syndrome patients: a systematic review
Kourbelis, C., Marin, T. S., Foote, J. W., Brown, A. D. H., Daniel, M., Coffee, N. T., Newman, P., Beks, H., Ganesan, A. N., Versace, V. L., et al. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00042 · Cited by 24
Qualitative research in suicidology: a systematic review of the literature of low-and middle-income countries
Kabir, H., Wayland, S., & Maple, M. J. (2023) · BMC Public Health · doi:10.1186/s12889-023-15767-9 · Cited by 26
The effectiveness of robotic-assisted upper limb rehabilitation to improve upper limb function in patients with cervical spinal cord injuries: a systematic literature review
Ho, J. S.-W., Ko, K. S. Y., Law, S. W., & Man, G. C. W. (2023) · Frontiers in Neurology · doi:10.3389/fneur.2023.1126755 · Cited by 24
Drug Coated Balloons for Dysfunctional Haemodialysis Venous Access: A Patient Level Meta-Analysis of Randomised Controlled Trials
Fong, K. Y., Zhao, J. J., Tan, E., Syn, N. L. X., Sultana, R., Zhuang, K. D., Chua, J. M. E., Ming, E., Patel, A., Irani, F. G., et al. (2021) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2021.06.006 · Cited by 24
Incorporation of artificial intelligence into nursing research: A scoping review
Yasin, Y. M., Al‐Hamad, A., Metersky, K., & Kehyayan, V. (2025) · International Nursing Review · doi:10.1111/inr.13013 · Cited by 21
Ethical and Quality of Care-Related Challenges of Digital Health Twins in Older Care Settings: Protocol for a Scoping Review
Jabin, M. S. R., Yaroson, E. V., Ilodibe, A., & Eldabi, T. (2023) · JMIR Research Protocols · doi:10.2196/51153 · Cited by 23
Effectiveness and family experiences of interventions promoting partnerships between families and pediatric and neonatal intensive care units: a mixed methods systematic review
Barnes, S., MacDonald, I., Rahmaty, Z., de Goumoëns, V., Grandjean, C., Jaques, C., & Ramelet, A. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00034 · Cited by 24
Data sharing practices of health researchers in Africa: a scoping review protocol
Obiora, O. L., Olivier, B., Shead, D. A., & Withers, A. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00502 · Cited by 23
The residual nitrate and nitrite levels in meat products in Iran: A systematic review, meta-analysis and health risk assessment
Nader, M., Hosseininezhad, B., Berizi, E., Mazloomi, S. M., Hosseinzadeh, S., Zare, M., Derakhshan, Z., Conti, G. O., & Ferrante, M. (2021) · Environmental Research · doi:10.1016/j.envres.2021.112180 · Cited by 23
Systematic review with meta‐analysis: outcomes of pregnancy in patients with autoimmune hepatitis
Si, T., Huang, Z., Hegarty, R., Ma, Y., & Heneghan, M. A. (2022) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.16924 · Cited by 22
Practical guide to undertaking scoping reviews for pharmacy clinicians, researchers and policymakers
Khalil, H., McInerney, P. A., Pollock, D., Alexander, L., Munn, Z., Tricco, A. C., Godfrey, C. M., & Peters, M. D. J. (2021) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/jcpt.13558 · Cited by 25
Self-citation
Nonpharmacological interventions for agitation in the adult intensive care unit: A systematic review
Adams, A. M. N., Chamberlain, D. J., Grønkjær, M., Thorup, C. B., & Conroy, T. (2022) · Australian Critical Care · doi:10.1016/j.aucc.2022.02.005 · Cited by 24
Comparison of mifepristone plus misoprostol with misoprostol alone for first trimester medical abortion: A systematic review and meta-analysis
Shimels, T., Getnet, M., Shafie, M., & Belay, L. (2023) · Frontiers in Global Women s Health · doi:10.3389/fgwh.2023.1112392 · Cited by 23
Bereavement care guidelines used in health care facilities immediately following perinatal loss: a scoping review
Roberts, L. R., Nick, J. M., Sarpy, N. L., Peters, J., & Tamares, S. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00149 · Cited by 27
Misuse and diversion of stimulant medications prescribed for the treatment of ADHD: a systematic review
Forrest, J., Chen, W. T., & Jagadheesan, K. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1612785 · Cited by 22
Reliability, validity, and responsiveness of multidimensional pain assessment tools used in postoperative adult patients: a systematic review of measurement properties
Lapkin, S., Ellwood, L., Diwan, A. D., & Fernandez, R. S. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00407 · Cited by 24
Experiences of children growing up with a parent who has military-related post-traumatic stress disorder: a qualitative systematic review
Cramm, H. A., Godfrey, C. M., Murphy, S., McKeown, S., & Dekel, R. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00229 · Cited by 24

Software to support the systematic review process: the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI-SUMARI)
Munn, Z. (2016) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2016-002421 · Cited by 71
Self-citation
First International Symposium on Empirical Software Engineering and Measurement Applying Systematic Reviews to Diverse Study Types: An Experience Report
Dybå, T. (2008)
Applying Systematic Reviews to Diverse Study Types: An Experience Report
Dyba, T., Dingsoyr, T., & Hanssen, G. K. (2007) · First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) · doi:10.1109/esem.2007.59 · Cited by 391
Tools to support systematic reviews in software engineering: a feature analysis
Marshall, C., Brereton, P., & Kitchenham, B. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601270 · Cited by 56
System for the Unified Management, Assessment, and Review of Information (SUMARI)
Piper, C. (2019) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2019.790 · Cited by 100

Authors: Munn, Z., Aromataris, E., Tufanaru, C., Stern, C., Porritt, K., Farrow, J., Lockwood, C., Stephenson, M., Moola, S., Lizarondo, L., McArthur, A., Peters, M., Pearson, A., & Jordan, Z.
Affiliations: The University of Adelaide (AU)
Corresponding author: Munn, Zachary
ORCID: Munn, Zachary
Aromataris, Edoardo
Stern, Cindy
Porritt, Kylie
Lockwood, Craig
Stephenson, Matthew
Moola, Sandeep
Lizarondo, Lucylynn
Peters, Micah
Jordan, Zoe
Venue: International Journal of Evidence-Based Healthcare
Publisher: Ovid Technologies (Wolters Kluwer Health)
Published: 2019-03
Volume: 17
Issue: 1
Pages: 36-43
ISSN: 1744-1595 (ISSN-L)
1744-1609
DOI: 10.1097/xeb.0000000000000152
OpenAlex: W2892590175
Cited by: 977
References: 17
Citations by year: 2026: 142 · 2025: 197 · 2024: 190 · 2023: 141 · 2022: 132 · 2021: 112 · 2020: 53 · 2019: 7
FWCI: 8.59
Type: journal article
Language: en
Open access: closed
Locations: International Journal of Evidence-Based Healthcare (publishedVersion)
PubMed (publishedVersion)
Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords: systematic review software, Joanna Briggs Institute, web application, agile software development, user testing, software design, guideline development, health care recommendations
MeSH terms: Systematic Reviews as Topic, Software

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The development of software to support multiple systematic review types: the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI)

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Citations

Cites

Cited by

Related

Metadata

Record

About these checks