Methods of Randomized Controlled Clinical Trials in Health Services Research
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The randomized controlled clinical trial is an increasingly used method in health services research. Analysis of methodology is needed to accelerate practical implementation of trial results, select trials for meta-analysis, and improve trial quality in health services research. The objectives of this study are to explore the methodology of health services research trials, create and validate a streamlined quality evaluation tool, and identify frequent quality defects and confounding effects on quality. The authors developed a quality questionnaire that contained 20 evaluation criteria for health services research trials. One hundred one trials from the Columbia Registry of Controlled Clinical Trials were evaluated using the new quality tool. The overall agreement between independent reviewers, Cohen's kappa, was 0.94 (+/- 0.01). Of a possible score of 100, the trials received an average score of 54.8 (+/- 12.5). Five evaluation criteria indicated significant quality deficiencies (sample size, description of case selection, data on possible adverse effects, analysis of secondary effect variables, and retrospective analysis). The quality of study characteristics was significantly weaker than the quality of reporting characteristics (P < 0.001). The total average scores of Medline-indexed journals were better than the non-Medline-indexed journals (P < 0.001). There was a positive correlation between the overall quality and year of publication (R = 0.21, P < 0.05). The authors conclude that the new quality evaluation tool leads to replicable results and there is an urgent need to improve several study characteristics of clinical trials. In comparison to drug trials, site selection, randomization, and blinding often require different approaches in health services research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Invited commentary: a critical look at some popular meta-analytic methods
Greenland, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117248 · Cited by 511
Hershey, C. O., Goldberg, H. I., & Cohen, D. I. (1988) · Medical Care · doi:10.1097/00005650-198801000-00010 · Cited by 46
Cited by
Managing Clinical Knowledge for Health Care Improvement
Balas, E. A., & Boren, S. A. (2000) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637943 · Cited by 1,479
“Based on a large sample of randomized controlled clinical trials of organizational interventions, a study analyzed the various methods of such trials and identified the special require ments of applying randomized trials in health services research [23].”
Self-citationScales to Assess the Quality of Randomized Controlled Trials: A Systematic Review
Olivo, S. A., Macedo, L. G., Gadotti, I. C., Fuentes, J., Stanton, T., & Magee, D. J. (2008) · Physical Therapy · doi:10.2522/ptj.20070147 · Cited by 829
Factors that limit the quality, number and progress of randomised controlled trials
Prescott, Counsell, Gillespie, Grant, Russell, Kiauka, Colthart, Ross, Shepherd, & Russell (1999) · Health Technology Assessment · doi:10.3310/hta3200 · Cited by 390
Improving Preventive Care by Prompting Physicians
Balas, E. A. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.3.301 · Cited by 385
Self-citationTechniques to Improve Physicians' Use of Diagnostic Tests: A New Conceptual Framework
Solomon, D. H., Hashimoto, H., Daltroy, L., & Liang, M. H. (1998) · JAMA · doi:10.1001/jama.280.23.2020 · Cited by 321
Metadata
- Authors
- BALAS, E. A., AUSTIN, S. M., EWIGMAN, B. G., BROWN, G. D., & MITCHELL, J. A.
- Venue
- MEDICAL CARE
- Published
- 1995-07
- Volume
- 33
- Issue
- 7
- Pages
- 687-699
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W1965462468
- Cited by
- 55
- References
- 3
- FWCI
- 7.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methods of Randomized Controlled Clinical Trials in Health Services Research. https://app.cochat.ai/papers/10.1097/00005650-199507000-00005
- The paper
- BALAS, E. A., AUSTIN, S. M., EWIGMAN, B. G., BROWN, G. D., & MITCHELL, J. A. (1995). Methods of Randomized Controlled Clinical Trials in Health Services Research. MEDICAL CARE. https://doi.org/10.1097/00005650-199507000-00005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.