Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklists
The DOI matches its Crossref record; 61 of the 67 references it cites were found in a registry or an index.
Abstract
Assessing the quality of randomized controlled trials (RCTs) is important and relatively new. Quality gives us an estimate of the likelihood that the results are a valid estimate of the truth. We present an annotated bibliography of scales and checklists developed to assess quality. Twenty-five scales and nine checklists have been developed to assess quality. The checklists are most useful in providing investigators with guidelines as to what information should be included in reporting RCTs. The scales give readers a quantitative index of the likelihood that the reported methodology and results are free of bias. There are several shortcomings with these scales. Future scale development is likely to be most beneficial if questions common to all trials are assessed, if the scale is easy to use, and if it is developed with sufficient rigor.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Quality is not well defined, but has been shown to encompass constructs beyond those that may bias the findings, including, for example, imprecision, reporting completeness, ethics, and applicability.”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [78]
In the citing paper
“Existing tools typically take the form of composite scales and domain-based tools.”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [78]
In the citing paper
“There are a great many scales available [192]”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [192]
Citations
Cites
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Measuring Health: A Guide to Rating Scales and Questionnaires
McDowell, I., & Newell, C. (1987) · Cited by 4,207
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930
Rules of Evidence and Clinical Recommendations on the Use of Antithrombotic Agents
Sackett, D. L. (1989) · Chest · doi:10.1378/chest.95.2_supplement.2s · Cited by 1,368
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Statistics with Confidence: Confidence Intervals and Statistical Guidelines.
Jolliffe, F. R., Gardner, M. J., & Altman, D. G. (1990) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982808 · Cited by 1,319
Clinical trials: A practical approach
Daly, M. J. (1984) · Trends in Pharmacological Sciences · doi:10.1016/0165-6147(84)90515-7 · Cited by 1,053
Clinical Trials: Design, Conduct and Analysis
Meinert, C. L. (1986) · DigitalGeorgetown (Georgetown University Library) · doi:10.1093/acprof:oso/9780195035681.001.0001 · Cited by 756
Nurmohamed, M. T., Buller, H. R., Dekker, E., Hommes, D. W., Rosendaal, F. R., Briet, E., Rosendaal, F. R., & Vandenbroucke, J. P. (1992) · The Lancet · doi:10.1016/0140-6736(92)93223-a · Cited by 668
Statistical Problems in the Reporting of Clinical Trials
Pocock, S. J., Hughes, M. D., & Lee, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198708133170706 · Cited by 662
Research works printed but not linked: 4
- Poynard, 1988, Evaluation de la qualite methodologique des essais therapeutiques randomises, La Presse Medicale, 17, 315
- Spitzer, 1990, Links between passive smoking and disease: a best evidence synthesis, Clin Invest Med, 13, 17
- Weintraub, 1982, How to critically assess clinical drug trials, Drug Ther, 12, 131
- Simon, 1985, Methodological guidelines for reports of clinical trials, Cancer Treat Rep, 69, 1
Cited by
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationAssessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
“In a recent search of the literature, 25 scales designed to assess the quality of primary trials were identified, but only one had been developed following established methodological procedures (8).”
BackgroundSelf-citation
Metadata
- Authors
- Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S.
- Affiliations
- University of Ottawa (CA)
- University of Oxford (GB)
- Brigham and Women's Hospital (US)
- Corresponding author
- Moher, David
- Venue
- Controlled Clinical Trials
- Publisher
- Elsevier BV
- Published
- 1995-02
- Volume
- 16
- Issue
- 1
- Pages
- 62-73
- ISSN
- 0197-2456 (ISSN-L)
- OpenAlex
- W2031385454
- Cited by
- 1,308
- References
- 67
- Citations by year
- 2026: 9 · 2025: 9 · 2024: 13 · 2023: 21 · 2022: 14 · 2021: 22 · 2020: 31 · 2019: 30 · 2018: 22 · 2017: 25 · 2016: 43 · 2015: 40 · 2014: 45 · 2013: 61 · 2012: 66
- FWCI
- 44.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Controlled Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- quality assessment, randomized controlled trials, quality assessment scale, quality checklist, reporting guidelines, bias assessment, clinical trial design, scale development
- MeSH terms
- Humans, Quality Assurance, Health Care, Reproducibility of Results, Bias, Randomized Controlled Trials as Topic, Guidelines as Topic, Total Quality Management
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklists. https://app.cochat.ai/papers/10.1016/0197-2456(94)00031-w
- The paper
- Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995). Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklists. Controlled Clinical Trials. https://doi.org/10.1016/0197-2456(94)00031-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.