The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Development of ROBUST-RCT: Risk Of Bias instrument for Use in SysTematic reviews-for Randomised Controlled Trials
Open accessAbstract
Recent innovations in evidence based medicine methods, in particular instruments assessing risk of bias in randomised trials, have focused on methodological rigour at the expense of simplicity and practicability. Such a focus could lead to challenges in application and loss of reliability of instruments. To deal with these shortcomings, the Risk Of Bias instrument for Use in SysTematic reviews-for Randomised Controlled Trials (ROBUST-RCT) was created—a rigorously developed, simply structured, and user friendly instrument for assessing risk of bias of randomised controlled trials included in systematic reviews. This paper describes the development of ROBUST-RCT and provides associated documents and a manual of instructions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, the risk of bias for each included RCT was independently assessed by two researchers (QW and LQ) using the Risk of Bias Instrument for Use in Systematic Reviews—for Randomized Controlled Trials (ROBUST-RCT)45.”
From A quantitative analysis of global AI medical studies: gaps in randomized controlled trials (2026) · cites this paper as [45]
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationGRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Self-citationMinozzi, S., Cinquini, M., Gianola, S., Gonzalez-Lorenzo, M., & Banzi, R. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.06.015 · Cited by 471
Jørgensen, L., Paludan-Müller, A. S., Laursen, D. R. T., Savović, J., Boutron, I., Sterne, J. A. C., Higgins, J. P. T., & Hróbjartsson, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0259-8 · Cited by 396
Savović, J., Weeks, L., Sterne, J. A., Turner, L., Altman, D. G., Moher, D., & Higgins, J. P. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-37 · Cited by 340
The art of quality assessment of RCTs included in systematic reviews
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Boers, M., & A van den Brandt, P. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00360-7 · Cited by 245
Akl, E. A., Sun, X., Busse, J. W., Johnston, B. C., Briel, M., Mulla, S., You, J. J., Bassler, D., Lamontagne, F., Vera, C., et al. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.015 · Cited by 179
Self-citationCrocker, T. F., Lam, N., Jordão, M., Brundle, C., Prescott, M., Forster, A., Ensor, J., Gladman, J., & Clegg, A. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.06.015 · Cited by 174
Research works printed but not linked: 1
- Guyatt GH Rennie D Meade MO . Users’ guide to the medical literature: a manual for evidence-based clinical practice. McGraw-Hill Education, 2015.
Cited by
Guyatt, G., Wang, Y., Eachempati, P., Iorio, A., Murad, M., Hultcrantz, M., Chu, D. K., Flórez, I., Hemkens, L., Agoritsas, T., et al. (2025) · British medical journal · doi:10.1136/bmj-2024-083864 · Cited by 75
“12 Although each of these instruments has limitations, the most important is that some include items that in Core GRADE are classified as indirectness and imprecision rather than risk of bias, possibly leading to double counting their impact on the GRADE assessment of the certainty of evidence.”
Self-citationLai, N. M., Lim, Y. S., Thein, W. M., Bhargava, P., Thomas, P., & Ong, Q. C. (2026) · JMIR Medical Education · doi:10.2196/88933 · Cited by 13
“Detailed guidance, including suggested rules and a decision table of the tool, is freely available in the additional material of the paper by Wang et al [29].”
PRO EDI—A Tool to Help Systematic Reviewers Make Equity, Diversity, and Inclusion Assessments
Treweek, S. P., Devane, D., Welch, V. A., Petkovic, J., Tugwell, P., Saif‐Ur‐Rahman, K., Pizarro, A., Ciapponi, A., Volmink, J., Gkertso, I., et al. (2026) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70083 · Cited by 11
Li, Q., Zhou, Q., Fan, J., Feng, X., Lai, H., Chen, Y., Ye, Z., Song, F., Liu, J., Chen, D., et al. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.103799 · Cited by 10
“19 Discrepancies were resolved through discussion or adjudication by a third-party adjudication (YLC and LZ).”
Hu, M., Koh, P. S., Soh, X. C., Hartanto, A., & Majeed, N. M. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-02961-x · Cited by 11
“Researchers may also consider alternative risk of bias (RoB) or quality assessment (QA) instruments such as RoB, RoB 2, ROBINS-I, and ROBUST-RCT (Hig-gins et al., 2011; Sterne et al., 2016; Sterne et al., 2019; Wang et al., 2025).”
Metadata
- Authors
- Wang, Y., Keitz, S., Briel, M., Glasziou, P., Brignardello-Petersen, R., Siemieniuk, R. A. C., Zeraatkar, D., Akl, E. A., Armijo-Olivo, S., Bassler, D., Gamble, C., Gluud, L. L., Hutton, J. L., Letelier, L. M., Ravaud, P., Schulz, K. F., Torgerson, D. J., & Guyatt, G. H.
- Affiliations
- Beijing University of Chinese Medicine (CN)
- Lahey Hospital and Medical Center (US)
- University of Basel (CH)
- Bond University (AU)
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, L8S 4L8, Canada
- McMaster University (CA)
- University of Alberta (CA)
- University of Zurich (CH)
- University of Liverpool (GB)
- Hvidovre Hospital (DK)
- University of Warwick (GB)
- Department of Internal Medicine, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
- Inserm (FR)
- University of North Carolina at Chapel Hill (US)
- University of York (GB)
- Corresponding author
- Wang, Ying
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2025-03-25
- Volume
- 388
- Pages
- e081199
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W4408875896
- Cited by
- 60
- References
- 19
- Citations by year
- 2026: 44 · 2025: 16
- FWCI
- 11.93
- Type
- journal article
- Language
- en
- Open access
- green
- www.scopus.com
- Licence
- other-oa
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- Bond University Research Portal (Bond University) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- risk of bias assessment, randomized controlled trials, systematic reviews, instrument development, methodological quality, reliability statistics, ease of use
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development of ROBUST-RCT: Risk Of Bias instrument for Use in SysTematic reviews-for Randomised Controlled Trials. https://app.cochat.ai/papers/10.1136/bmj-2024-081199
- The paper
- Wang, Y., Keitz, S., Briel, M., Glasziou, P., Brignardello-Petersen, R., Siemieniuk, R. A. C., Zeraatkar, D., Akl, E. A., Armijo-Olivo, S., Bassler, D., Gamble, C., Gluud, L. L., Hutton, J. L., Letelier, L. M., Ravaud, P., Schulz, K. F., Torgerson, D. J., & Guyatt, G. H. (2025). Development of ROBUST-RCT: Risk Of Bias instrument for Use in SysTematic reviews-for Randomised Controlled Trials. BMJ. https://doi.org/10.1136/bmj-2024-081199
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.