The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
The development of software to support multiple systematic review types: the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI)
Abstract
AIM: Systematic reviews play an important role in ensuring trustworthy recommendations in healthcare. However, systematic reviews can be laborious to undertake and as such software has been developed to assist in the conduct and reporting of systematic reviews. The Joanna Briggs Institute and its collaborating centres consist of thousands of researchers, academics and clinicians across the globe conducting systematic reviews of various types. To support them in their work, modern software and online tools are required. Our aim was to develop a software program to support systematic reviewers across the globe. METHODS: A working party was formed with extensive consultation with members of the Joanna Briggs Collaboration focusing on ideal features of a software program to support systematic reviews. The new systematic review software was built using an agile methodology and designed to be a modern web application. RESULTS: The new systematic review software, the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI), was successfully developed through an iterative process of development, feedback, testing and review. The software is now available (https://www.jbisumari.org/) and supports the entire systematic review process for different types of systematic reviews. CONCLUSIONS: An agile software development approach combined with wide consultation and user testing can facilitate systematic review software design and development. This new software can support systematic reviews and guideline developers to create systematic reviews for a diverse range of questions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Empirical studies of agile software development: A systematic review
Dybå, T., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.01.006 · Cited by 2,668
Lockwood, C., Munn, Z., & Porritt, K. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000062 · Cited by 2,456
Self-citationEvidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
Munn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164
Self-citationEstablishing confidence in the output of qualitative research synthesis: the ConQual approach.
Munn, Z., Porritt, K., Lockwood, C., Aromataris, E., & Pearson, A. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-108 · Cited by 803
Self-citationExpediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012545 · Cited by 737
Cited by
Sorted by citations
Items 901–977 of 977
Matsunaka, E., Ooshige, N., Ueki, S., & Morokuma, S. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00002
Easpaig, B. N. G., Murta, J. C. D., Wang, T., Bressington, D. T., & Hogan, R. G. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1765379
Museum-based creative arts interventions for people living with dementia: A scoping review
Hu, Y., Zhang, A., Luo, X., & Huang, G. (2026) · Journal of Health Psychology · doi:10.1177/13591053261428347
Karuveettil, V., Ramanarayanan, V., Green, H., Fernandez, R., Sanjeevan, V., & Janakiram, C. (2026) · BMC Public Health · doi:10.1186/s12889-026-27561-4 · Cited by 1
Nkansah, E. O., Boateng, D., Owusu‐Antwi, R., Baffour, P., & Dassah, E. T. (2026) · doi:10.2196/preprints.98706
Alese, O. M., Tijani, A. A., Gardner, K., & Owolabi, J. O. (2026) · Discover Education · doi:10.1007/s44217-026-01536-4
Moretto, F., Esposito, T., Rocca, E., Scotti, L., Bassi, E., Gardois, P., Molin, A. D., Francesco, M., Grillenzoni, L., Crimi, C., et al. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00320
Darshan, B., Thiviyakumar, T., Halliday, S. M., Sears, K., Thavorn, K., & Woo, K. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00314
Dehsorkhi, B. G., Afif, K., & Doyon, M. (2026) · Systematic Reviews · doi:10.1186/s13643-026-03156-3
A Scoping Review of Preclinical Paradigms for Clinically Tested Medications in Alcohol Use Disorder
Nieto, S. J., Donato, S., Baskerville, W., McManus, K. R., Lopez, M. F., Becker, H. C., & Ray, L. A. (2026) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.70287
Physiotherapy management of adults with breathing pattern disorders: a scoping review
Stewart, A., Ellis, R., & Mooney, S. (2026) · Physical Therapy Reviews · doi:10.1080/10833196.2026.2668305
Bindu, M. A., SPOORTHI, K. R., Jith, A., Saraswathy, G. R., Janakiram, C., & John, D. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00243
dos Santos, L. C., Nichiata, L. Y. I., de Matos, D. G., de Moura, L. F. R., Pagano, V., Domingos, T. D. S., Oliveira, N. R., & Martins, M. S. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00418
Uemoto, P. C. S., Saut, A. M., de Moraes, É. B., de Mello, L. R. G., de Oliveira, J. S. R., de Paula, A. G., da Silva, E. L., & Martins, M. S. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00311
Teplitzky, X., Gostilo, D., Tsilingaridis, G., Hamza, B., Petrova, L., & Pulikkotil, S. J. (2026) · Frontiers in Oral Health · doi:10.3389/froh.2026.1791208
Peixoto, T., Queirós, C., & Peixoto, N. M. D. S. M. (2016) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00501
Cannizzaro, D., Saguatti, I., Caleffi, D., Rovesti, S., & Ferri, P. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00371
Chatziioannou, S. S., Papasideri, V., Kolias, P., Xydias, E. M., & Tsakos, E. (2026) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2026.115190
He, X., Yu, Q., Peng, J., Yang, P., & Yang, B. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-112342
Lin, A. M., Hillock, N. T., Turnidge, J. D., Eliott, J., & Spurrier, N. (2026) · Systematic Reviews · doi:10.1186/s13643-026-03177-y
Krishnakumar, M., Folestad, A., Lakshmanan, V., Nandakumar, A., Sathyapalan, D. T., Karuveettil, V., Janakiram, C., & Gutjahr, G. (2016) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00321
Iwata, H., Terasawa, E., Maehara, K., Okayama, H., Kozaki, Y., Budu, H. I., & Lin, M.-F. (2016) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00360
Singh‐Peterson, L., King, J., Bruce, T., Darracott, R., Karatela, S., Russ, E., & Mullens, A. B. (2026) · Wellbeing Space and Society · doi:10.1016/j.wss.2026.100424
Thapa, S., Maraseni, T., Apan, A., & Banerjee, B. (2026) · Environmental Research Climate · doi:10.1088/2752-5295/ae7b75
Seril, J. S. (2026) · Advances in Engineering and Information Sciences · doi:10.54610/aeis.v2i1.217
Yong, N. B., Lontum, A., Eni, A. T., Gwanvoma, F., Wung, E. A., Gemuh, V. A., Ngwa, G. R. N., & Okwen, P. (2026) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000614
MARY, L., Akuma, I., Adhikari, P., Manimegalai, A. P., Das, R., Udayakumara, K., Patil, N. J., & Bathran, C. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00519
Caggianelli, G., Iorfida, M., Petrelli, F., Fiorda, M., Ricci, M., Pettinari, S., Marfella, F., Accettone, R., Vanzi, V., Rocco, G., et al. (2026) · Nursing Reports · doi:10.3390/nursrep16060206
ElshikhIdris, M. A. M., Ali, A. S. H., Mahmoud, S. Y., Aziz, Y. M. S., Ali, I., Farah, S., & Altayeb, W. F. M. (2026) · Cureus · doi:10.7759/cureus.111334 · Cited by 1
Zhang, S., Christian, R., Gordy, X. Z., Zhang, L., & Erinne, O. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00445
Low‐Value Blood Culture Use in Adult Emergency Department Patients: A Scoping Review
Weber, A., Galappaththie, U., Moxon, J. V., & Gangathimmaiah, V. (2026) · Emergency Medicine Australasia · doi:10.1111/1742-6723.70299
Chatziioannou, S. S., Sergentanis, T. Ν., Papasideri, V., Eleftheriades, M. I., & Kalampokas, T. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00475
Yarandi, R. B., Nejad, F. N., Biglarian, A., Roshanfekr, P., & Behboudi‐Gandevani, S. (2026) · Women s Health · doi:10.1177/17455057261465474
Sineshaw, E. A., Mekonnen, S. A., Dagnaw, G. G., Gessese, A. T., & Dejene, H. (2026) · BMC Infectious Diseases · doi:10.1186/s12879-026-13942-y
Schouten, J. C., Bramer, W. M., Scholten-Peeters, G. G. M., Huygen, F. J. P. M., & Tiemensma, J. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-26-00010
Setthathanapokin, P. C., Whaikid, P., & Piaseu, N. (2026) · Nutrients · doi:10.3390/nu18142258
Neurophysiological measures of exercise-induced fatigue in athletes: a scoping review protocol
Agarao, K. A., Gomez, I. N., Espino, R. V., Mesa, E. D. D., Ramos, R. K., & Rotap, K. V. E. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-26-00035
Arabiat, D. H., Dar-Odeh, N. S., Abu-Hammad, O. A., Odeh, R., Arabeyyat, Z., Jr., Jabery, M. A. F. A., Sabbah, E. A., & Whitehead, L. (2026) · doi:10.2196/preprints.106745
Areri, H. A., Mengistu, Y. T., & Gary, R. (2026) · Health Services Insights · doi:10.1177/11786329261468554
The Musculoskeletal Consequences of Mouth Breathing in Adults: A Systematic Review
Campbell, R. G., Zadro, J. R., Campion, N. J., Chan, C. L., Mackey, M., Osie, G., Png, L. H., Douglas, R. G., Mosito, K., Reilly, E. K., et al. (2026) · The Laryngoscope · doi:10.1002/lary.70755
Jabin, M. S. R., bi, N. A., Thomas, S., Ashfaq, A., & Nilsson, E. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1861018
Maya-Martínez, A. D., Cauli, O., Giménez‐Espert, M. D. C., & Buigues, C. (2026) · Diseases · doi:10.3390/diseases14070263
McCord, H., Bruce, C., Norris, N., Rothfus, M. A., Goldchtaub, L., Seamone, A., Perrin, J., & Campbell-Yeo, M. L. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-26-00033
Scerbo, F., Caggianelli, G., Ciucciarelli, S., Cangelosi, G., Vanzi, V., & Mazzotta, R. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-26-00065
Roles and Outcomes of Advanced Practice Nurses in Thailand: A Systematic Review
Whaikid, P., & Piaseu, N. (2026) · Healthcare · doi:10.3390/healthcare14152300
Siaw, S. D. (2026) · African Journal Of Applied Research · doi:10.26437/0repgc39
Pérez-Garzón, M., Robayo-Amórtegui, H., Fernández‐Sarmiento, J., Botero‐Rosas, D. A., & Barrera-Bueno, M. (2026) · Respiratory Medicine · doi:10.1016/j.rmed.2026.109081
Koto, Y., Tanaka, M., Ueki, S., & Niinomi, K. (2026) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2026.100650
Best practices in clinical skills assessment methods: A scoping review
Metersky, K., Lin, T., Lam, T., Al‐Hamad, A., & Romaniuk, D. (2026) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2026.07.024
Aborisade, A., Ali, A. M., Okolo, C. C., Gbaja-Biamila, T. A., Akinsolu, F. T., Salako, A., Adewole, I. E., Olagunju, M. T., Abodunrin, O. R., Eleje, G. U., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0342631
Kalumbi, L. R., Lebelo, K., Masekameni, M. D., Utembe, W., & Brouwer, D. (2026) · Environmental Health Insights · doi:10.1177/11786302261430546
Balachandran, P., Janakiram, C., Bhan, A., Thankappan, K. R., Kumar, N., & Menon, J. C. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-117248
Wang, H., Moloney, C., Stirling, A., Morgan, S., & Delaney, L. (2026) · Journal of Emergency Nursing · doi:10.1016/j.jen.2026.07.007
Canty, A. M., Keedle, H., Hennessy, A., & Makris, A. (2026) · Women s Reproductive Health · doi:10.1080/23293691.2026.2718148
Valkonen, J., Joki, A., Koivumäki, T., Katainen, A., & Lallukka, T. M. (2026) · Systematic Reviews · doi:10.1186/s13643-026-03321-8
Niu, T., Liu, H., Pang, P., Luo, Y. T., & Liu, T. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1880052 · Cited by 1
Santiago, I. B., Nóbrega, I. L. P., Távora, D. G. F., Pitombeira, M. S., & Rodrigues, C. E. M. (2026) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2026.153081
Ferraz, L., Xavier, M. R., Gameiro, M., Vieira, R., Cardoso, A. F., Cardoso, D., Paradela, L., Dinis, D., Coutinho, E., Maia, A. C., et al. (2026) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2026.100684
Monolithic Zirconia Crowns: Advantages and Disadvantages in Fixed Prosthodontics
Javadpour, M., Hosseinkhani, M., & Safamanesh, A. (2025) · Biomedical Research Bulletin · doi:10.34172/biomedrb.9091
Scars, scripts and service: rituals of belonging
Colton, T. M. S., Lobsinger, S., & Cox, D. W. (2026) · Journal of Hospitality and Tourism Horizons · doi:10.1108/jhth-01-2026-0004
Adibsereshki, N., Nejad, F. N., Jafari, P., Basakha, M., & Yarandi, R. B. (2026) · F1000Research · doi:10.12688/f1000research.187813.1
Mohebi, A., Pathirana, M. M., Arstall, M. A., & Andraweera, P. H. (2026) · Women & Health · doi:10.1080/03630242.2026.2737970
He, X., Xu, X., Yang, P., Xie, C., & Yang, B. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1817553
Larsen, C. M., Rasmussen, J. K., Larsen, P., Jørgensen, A., Pasgaard, T. U., Grandt, V., Holsgaard‐Larsen, A., Skovgaard, T., Lexell, J. E., & Christiansen, L. B. (2026) · Disability and Rehabilitation · doi:10.1080/09638288.2026.2734783
The hope of children and families in the context of cancer: a scoping review
Garófalo, C. D. D. C. E., Silveira, A. O., Tavares, D., Seganfredo, H. C., Wernet, M., & Charepe, Z. B. (2026) · Frontiers in Pediatrics · doi:10.3389/fped.2026.1958432
Integrovaná tematická výuka v kontextu praxe založené na důkazech
Barancová, K., Fasnerová, M., Kantor, J., Svobodová, Z., Balušková, K., Křivánková, K., Vrbová, T., & Klugar, M. (2026) · doi:10.5507/pdf.26.24467887
Liu, H., Liu, W., Zeng, Y., Guo, W., Chen, S., Zou, L., Ding, Y., & Ye, G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1962809
Bai, J. J., Mandoh, M., Chen, J., & Allman-Farinelli, M. A. (2026) · Patient Education and Counseling · doi:10.1016/j.pec.2026.110347
Feng, L., Zhang, L., He, W., Yuan, Y., Gao, H., Ren, Y., & Wang, X. (2026) · Open Life Sciences · doi:10.1515/biol-2025-1360
Comparison of combined HIV prevention interventions for prisoners: a network meta-analysis
Silva, M. J. A., Marinho, R. L., Sardinha, D. M., Silva, C. S., Brasil, T. P., de Sousa, P. R. C., Oliveira, N. D. S., dos Anjos, T. A. F., Batista, D. R. L., Farias, I. S. D. C., et al. (2026) · AIDS Care · doi:10.1080/09540121.2026.2748795
X-SLR: A Hexagonal Architecture Framework for Reporting Systematic Literature Reviews
Aguirre, M., Ayala-Tipan, C., Andrade-Cabrera, A., Martínez-Mosquera, D., Recalde, L., & Suntaxi, G. (2026) · Information · doi:10.3390/info17101043
Zhengjing, L., Wei, Y., & Wang, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-10954287/v1
Experiences of LGBTQ+ Older Adults in Healthcare: A Qualitative Systematic Review
Ward, P., Mandville-Anstey, S. A., Hickey, M., & Meade, A. (2026) · Journal of Ageing and Longevity · doi:10.3390/jal6040068
Roba, H. S., Biddle, S., Kalra, A., & Kolbe-Alexander, T. L. (2026) · Australian and New Zealand Journal of Public Health · doi:10.1016/j.anzjph.2026.100606
Continuità educativa e curricolo vivente nel primo ciclo
Natalizio, G., Manzetti, L., Armellini, C., Tahirbegolli, B., Laski, V., & Fernandes, G. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.20335415
He, X., Xu, X., Huang, H., Peng, J., Yang, B., & Huang, J. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1964572
Sharma, V., Seth, A., Singhal, A., Mahajon, B., Ghildiyal, S., & Deogade, M. S. (2026) · Journal of Drug Research in Ayurvedic Sciences · doi:10.4103/jdras.jdras_311_25
Metadata
- Authors
- Munn, Z., Aromataris, E., Tufanaru, C., Stern, C., Porritt, K., Farrow, J., Lockwood, C., Stephenson, M., Moola, S., Lizarondo, L., McArthur, A., Peters, M., Pearson, A., & Jordan, Z.
- Affiliations
- The University of Adelaide (AU)
- Corresponding author
- Munn, Zachary
- ORCID
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2019-03
- Volume
- 17
- Issue
- 1
- Pages
- 36-43
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2892590175
- Cited by
- 977
- References
- 17
- Citations by year
- 2026: 142 · 2025: 197 · 2024: 190 · 2023: 141 · 2022: 132 · 2021: 112 · 2020: 53 · 2019: 7
- FWCI
- 8.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Evidence-Based Healthcare (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- systematic review software, Joanna Briggs Institute, web application, agile software development, user testing, software design, guideline development, health care recommendations
- MeSH terms
- Systematic Reviews as Topic, Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review