The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Methodological quality of case series studies: an introduction to the JBI critical appraisal tool
Abstract
INTRODUCTION: Systematic reviews provide a rigorous synthesis of the best available evidence regarding a certain question. Where high-quality evidence is lacking, systematic reviewers may choose to rely on case series studies to provide information in relation to their question. However, to date there has been limited guidance on how to incorporate case series studies within systematic reviews assessing the effectiveness of an intervention, particularly with reference to assessing the methodological quality or risk of bias of these studies. METHODS: An international working group was formed to review the methodological literature regarding case series as a form of evidence for inclusion in systematic reviews. The group then developed a critical appraisal tool based on the epidemiological literature relating to bias within these studies. This was then piloted, reviewed, and approved by JBI's international Scientific Committee. RESULTS: The JBI critical appraisal tool for case series studies includes 10 questions addressing the internal validity and risk of bias of case series designs, particularly confounding, selection, and information bias, in addition to the importance of clear reporting. CONCLUSION: In certain situations, case series designs may represent the best available evidence to inform clinical practice. The JBI critical appraisal tool for case series offers systematic reviewers an approved method to assess the methodological quality of these studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We consider to use the ROB II tool 22 for RCTs and the ROBINS-I tool 23 for quasiexperimental and controlled cohort studies. Uncontrolled cohort studies were assessed using a tool, developed by our team, to assess the risk of bias in series of subjects exposed to an intervention (see Supplementary Appendix 3). Case series were evaluated using the Joanna Briggs Institute checklist 24.”
From Efectividad del tratamiento de la sífilis gestacional en el último trimestre sobre la incidencia de sífilis congénita: revisión sistemática y metanálisis (2025) · cites this paper as [24]
Citations
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Methodological quality and synthesis of case series and case reports
Murad, M. H., Sultan, S., Haffar, S., & Bazerbachi, F. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2017-110853 · Cited by 2,242
Munn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164
Self-citationMunn, Z., Aromataris, E., Tufanaru, C., Stern, C., Porritt, K., Farrow, J., Lockwood, C., Stephenson, M., Moola, S., Lizarondo, L., et al. (2019) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000152 · Cited by 977
Self-citationJBI's Systematic Reviews: Study Selection and Critical Appraisal
Porritt, K., Gomersall, J., & Lockwood, C. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000450430.97383.64 · Cited by 644
The Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598
Self-citationIn Defense of Case Reports and Case Series
Vandenbroucke, J. P. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-4-200102200-00017 · Cited by 562
Munn, Z., Tufănaru, C., & Aromataris, E. (2014) · AJN American Journal of Nursing · doi:10.1097/01.naj.0000451683.66447.89 · Cited by 543
Self-citationThe updated Joanna Briggs Institute Model of Evidence-Based Healthcare
Jordan, Z., Lockwood, C. S., Munn, Z., & Aromataris, E. (2018) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000155 · Cited by 491
Self-citationDistinguishing Case Series From Cohort Studies
Dekkers, O. M., Egger, M., Altman, D. G., & Vandenbroucke, J. P. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-1-201201030-00006 · Cited by 313
Hannes, K., & Lockwood, C. S. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2011.05636.x · Cited by 287
Bero, L. A., Chartres, N., Diong, J. H. L., Fabbri, A., Ghersi, D., Lam, J., Lau, A., McDonald, S., Mintzes, B. J., Sutton, P., et al. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0915-2 · Cited by 283
A principal component analysis is conducted for a case series quality appraisal checklist
Guo, B., Moga, C., Harstall, C., & Schopflocher, D. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.07.010 · Cited by 173
Clinical “case series”: a concept analysis
Abu-Zidan, F. M., Abbas, A., & Hefny, A. F. (2013) · African Health Sciences · doi:10.4314/ahs.v12i4.25 · Cited by 143
Critical appraisal of nonrandomized studies—A review of recommended and commonly used tools
Quigley, J. M., Thompson, J. C., Halfpenny, N. J. A., & Scott, D. A. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12889 · Cited by 143
Three-minute critical appraisal of a case series article
Chan, K. T. K., & Bhandari, M. (2011) · Indian Journal of Orthopaedics · doi:10.4103/0019-5413.77126 · Cited by 92
Seo, H.-J., Kim, S. Y., Lee, Y. J., Jang, B.-H., Park, J.-E., Sheen, S.-S., & Hahn, S. K. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.09.013 · Cited by 74
How to Read a Case Report (or Teaching Case of the Month)
Pierson, D. J. (2009) · Respiratory Care · doi:10.4187/respcare.09541372 · Cited by 74
Hartling, L., Bond, K., Santaguida, P. L., Viswanathan, M., & Dryden, D. M. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.010 · Cited by 69
Influence of tooth location on coronally advanced flap procedures for root coverage
Zucchelli, G., Tavelli, L., Ravidà, A., Stefanini, M., Suárez, F., & Wang, H. (2018) · Journal of Periodontology · doi:10.1002/jper.18-0201 · Cited by 57
Case series and descriptive cohort studies in neurosurgery: the confusion and solution
Esene, I. N., Ngu, J. N., Elzoghby, M., Solaroğlu, İ., Sikod, A. M., Kotb, A., Dechambenoit, G., & Husseiny, H. E. (2014) · Child s Nervous System · doi:10.1007/s00381-014-2460-1 · Cited by 46
Kuperus, J. S., Waalwijk, J. F., Regan, E. A., van der Horst-Bruinsma, I. E., Öner, F. C., de Jong, P. A., & Verlaan, J. (2018) · Lara D. Veeken · doi:10.1093/rheumatology/key211 · Cited by 41
Averis, A. K., & Pearson, A. (2003) · JBI Reports · doi:10.1046/j.1479-6988.2003.00003.x · Cited by 29
Bazerbachi, F., Haffar, S., Hussain, M. T., Vargas, E. J., Watt, K. D. S., Murad, M. H., Chari, S. T., & Dayyeh, B. K. A. (2017) · Pancreatology · doi:10.1016/j.pan.2017.08.012 · Cited by 28
Harris, E. S., Meiselman, H. J., Moriarty, P. M., METZGER, A. L., & Malkovský, M. (2018) · Journal of Scleroderma and Related Disorders · doi:10.1177/2397198318758606 · Cited by 27
Peinemann, F., & Kleijnen, J. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007540 · Cited by 22
Eardley-Harris, N., Munn, Z., Cundy, P. J., & Gieroba, T. J. (2015) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2015-2338 · Cited by 20
Self-citationLife satisfaction and positive and negative feelings of workers: a systematic review protocol
Castro, V. C. D., Hernandes, J. C., Mendonça, M. E., & Porto, C. C. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0903-6 · Cited by 12
Implications for Practice: should recommendations be recommended in systematic reviews?
Munn, Z. (2015) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/01938924-201513070-00001 · Cited by 4
Self-citationRavat, S., Olivier, B., Gillion, N., & Lewis, F. (2018) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2017-003402 · Cited by 2
Cited by
Sorted by citations
dos Santos, D. M. C., Tix, T., Shouval, R., Gafter-Gvili, A., Alberge, J.-B., Cliff, E. R. S., Theurich, S., von Bergwelt-Baildon, M., Ghobrial, I., Subklewe, M., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03084-6 · Cited by 266
Frequency of Neurologic Manifestations in COVID-19
Misra, S., Kolappa, K., Prasad, M., Radhakrishnan, D. M., Thakur, K. T., Solomon, T., Michael, B. D., Winkler, A. S., Beghi, E., Guekht, A. B., et al. (2021) · Neurology · doi:10.1212/wnl.0000000000012930 · Cited by 255
Alharbi, A., Nurfianti, A., Mullen, R., McClure, J., & Miller, W. H. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06080-z · Cited by 317
Jena, A., Mishra, S., Deepak, P., Kumar, P. M., Sharma, A., Patel, Y. I., Kennedy, N. A., Kim, A. H. J., Sharma, V., & Sebastian, S. (2021) · Autoimmunity Reviews · doi:10.1016/j.autrev.2021.102927 · Cited by 191
Afzal, M., Siddiqi, N., Ahmad, S. B., Afsheen, N., Aslam, F., Ali, A., Ayesha, R., Bryant, M., Holt, R. I. G., Khalid, H., et al. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.769309 · Cited by 170
Metadata
- Authors
- Munn, Z., Barker, T. H., Moola, S., Tufanaru, C., Stern, C., McArthur, A., Stephenson, M., & Aromataris, E.
- Affiliations
- The University of Adelaide (AU)
- Corresponding author
- Barker, Timothy Hugh
- ORCID
- Venue
- JBI Database of Systematic Reviews and Implementation Reports
- Published
- 2019-09-23
- Volume
- Publish Ahead of Print
- Issue
- 10
- Pages
- 2127-2133
- ISSN
- 2202-4433 (ISSN-L)
- OpenAlex
- W2974663997
- Cited by
- 1,581
- References
- 31
- Citations by year
- 2026: 404 · 2025: 392 · 2024: 317 · 2023: 230 · 2022: 142 · 2021: 83 · 2020: 13
- FWCI
- 39.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The JBI Database of Systematic Reviews and Implementation Reports (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- methodological quality, risk of bias, critical appraisal tools, internal validity, confounding, selection bias, information bias, reporting quality, evidence synthesis, systematic reviews
- MeSH terms
- Systematic Reviews as Topic, Research Design, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review