The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
The revised JBI critical appraisal tool for the assessment of risk of bias for quasi-experimental studies
Abstract
Systematic reviews of effectiveness offer a rigorous synthesis of the best evidence available regarding the effects of interventions or treatments. Randomized controlled trials are considered the optimal study design for evaluating the effectiveness of interventions and are the ideal study design for inclusion in a systematic review of effectiveness. In the absence of randomized controlled trials, quasi-experimental studies may be relied on to provide information on treatment or intervention effectiveness. However, such studies are subject to unique considerations regarding their internal validity and, consequently, the assessment of the risk of bias of these studies needs to consider these features of design and conduct. The JBI Effectiveness Methodology Group has recently commenced updating the suite of JBI critical appraisal tools for quantitative study designs to align with the latest advancements in risk of bias assessment. This paper presents the revised critical appraisal tool for risk of bias assessment of quasi-experimental studies; offers practical guidance for its use; provides examples for interpreting the results of risk of bias assessment; and discusses major changes from the previous version, along with the justifications for those changes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“they determined that the JBI Checklist for Quasi–Experimental (QE) Studies and the JBI Critical Appraisal Tool for Assessing Risk of Bias for RCTs would be employed to evaluate article quality [7].”
From Exploring the impact of academic coaching interventions on student outcomes in graduate healthcare and medical education: a systematic scoping review. (2025) · cites this paper as [7]
In the citing paper
“Due to the heterogeneity of the included studies, two JBI tools were employed: two of the articles were assessed using the JBI tool for randomized controlled trials [8], while the remaining nine studies were evaluated with the JBI tool for quasi–experimental studies [7].”
From Exploring the impact of academic coaching interventions on student outcomes in graduate healthcare and medical education: a systematic scoping review. (2025) · cites this paper as [7]
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262 · cited 1×
“12 A secondary aim was to better support reviewers as they grapple with the methodological requirements of GRADE.”
Background(2002) · Cited by 13,211
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477 · cited 1×
“13 The complete methodology implemented for this revision, along with the reasons for all decisions made, have been documented in separate publications.”
MethodBarker, T. H., Stone, J. C., Sears, K., Klugar, M., Tufanaru, C., Leonardi-Bee, J., Aromataris, E., & Munn, Z. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00430 · Cited by 1,225 · cited 2×
“Inalignment with the major changes outlined in previous publications, 10,14 the questions in this revised tool are presented based on the construct of validity to which they relate.”
MethodSelf-citationMunn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164
Self-citationJBI's Systematic Reviews: Study Selection and Critical Appraisal
Porritt, K., Gomersall, J., & Lockwood, C. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000450430.97383.64 · Cited by 644 · cited 2×
“6 Additionally, appraisers should only assess outcomes that are pertinent to their systematic review question.”
BackgroundThe Systematic Review: An Overview
Aromataris, E., & Pearson, A. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000444496.24228.2c · Cited by 598 · cited 1×
“Similarly, questions 8 and 9 should be evaluated separately for each outcome, while also considering each result that has contributed data to that particular outcome (eg, length of hospital stay and patient satisfaction at time points 1 and 2).”
BackgroundSelf-citationBarker, T. H., Stone, J. C., Sears, K., Klugar, M., Leonardi-Bee, J., Tufanaru, C., Aromataris, E., & Munn, Z. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00125 · Cited by 471 · cited 6×
“10 This paper presents the revised critical appraisal tool for quasi-experimental studies; offers practical guidance for its use; provides examples for interpreting the results of risk of bias assessment; and discusses major changes from the previous version, along with the justifications for those…”
BackgroundMethodInfluentialSelf-citationUnderstanding randomised controlled trials
Akobeng, A. K. (2005) · Archives of Disease in Childhood · doi:10.1136/adc.2004.058222 · Cited by 458 · cited 2×
“3 However, there may be situations where meeting the requirements of an RCT is not feasible.”
Background
Cited by
Barker, T. H., Hasanoff, S., Aromataris, E., Stone, J. C., Leonardi-Bee, J., Sears, K., Klugar, M., Tufanaru, C., Moola, S., Liu, X.-L., et al. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00523 · Cited by 218
Self-citationThe revised JBI critical appraisal tool for the assessment of risk of bias for cohort studies
Barker, T. H., Hasanoff, S., Aromataris, E., Stone, J. C., Leonardi-Bee, J., Sears, K., Habibi, N., Klugar, M., Tufanaru, C., Moola, S., et al. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00103 · Cited by 210
Self-citationEl Arab, R. A., Alshakihs, A. H., Alabdulwahab, S. H., Almubarak, Y. S., Alkhalifah, S. S., Abdrbo, A., Hassanein, S., & Sagbakken, M. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1666005 · Cited by 113
Pietraszewski, P., Terbalyan, A., Roczniok, R., Maszczyk, A., Ornowski, K., Manilewska, D., Kuliś, S., Zając, A., & Gołaś, A. (2025) · Applied Sciences · doi:10.3390/app15137254 · Cited by 119
Application of digital-intelligent technologies in physical education: a systematic review
Zhong, Q., Jiang, J., Bai, W., Yin, Z., Liao, Z., & Zhong, X. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1626603 · Cited by 97
Metadata
- Authors
- Barker, T. H., Habibi, N., Aromataris, E., Stone, J. C., Leonardi-Bee, J., Sears, K., Hasanoff, S., Klugar, M., Tufanaru, C., Moola, S., & Munn, Z.
- Affiliations
- The University of Adelaide (AU)
- The Nottingham Centre for Evidence-Based Healthcare: A JBI Centre of Excellence, School of Medicine, The University of Nottingham, Nottingham, UK
- Queen's University (CA)
- Institute of Health Information and Statistics (CZ)
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University
- Sanofi (India) (IN)
- Corresponding author
- Habibi, Nahal
- ORCID
- Venue
- JBI Evidence Synthesis
- Published
- 2024-01-30
- Volume
- 22
- Issue
- 3
- Pages
- 378-388
- ISSN
- 2689-8381 (ISSN-L)
- OpenAlex
- W4391354425
- Cited by
- 843
- References
- 17
- Citations by year
- 2026: 441 · 2025: 333 · 2024: 68
- FWCI
- 235.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JBI Evidence Synthesis (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- risk of bias assessment, quasi-experimental design, critical appraisal tools, internal validity, intervention effectiveness
- MeSH terms
- Humans, Research Design, Bias, Randomized Controlled Trials as Topic, Risk Assessment, Non-Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The revised JBI critical appraisal tool for the assessment of risk of bias for quasi-experimental studies. https://app.cochat.ai/papers/10.11124/jbies-23-00268
- The paper
- Barker, T. H., Habibi, N., Aromataris, E., Stone, J. C., Leonardi-Bee, J., Sears, K., Hasanoff, S., Klugar, M., Tufanaru, C., Moola, S., & Munn, Z. (2024). The revised JBI critical appraisal tool for the assessment of risk of bias for quasi-experimental studies. JBI Evidence Synthesis. https://doi.org/10.11124/jbies-23-00268
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.