A score system for evaluating random control clinical trials of prophylaxis of abdominal surgical wound infection
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
We devised 33 rules for the evaluation of random control trials (RCT) and used them to assess 56 RCTs listed in Index Medicus during 1980–82 on antibiotic prophylaxis of surgical wound infection. We asked 15 questions about design and conduct, 10 about analysis and 8 about presentation. Out of a maximum score of 100 only 16 papers scored over 70, the highest being 89 and the lowest 34. Defects in presentation were not common, and 17 papers scored over 90 per cent. Defects in analysis included the incorrect use of statistical tests and ignoring the Type II error in ‘negative’ trials; only 13 papers scored over 70 per cent. Defects in design and conduct included transgressions of ethical principles, inappropriate regimens, ill-defined end points and biased randomization or assessment; only 20 papers scored over 70 per cent. We conclude that there is room for improvement in the performance of RCT and that the application of the 33 rules would be helpful not only to researchers but also to editors and referees of scientific journals, and to their readers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Cited by
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., Bouter, L. M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00131-0 · Cited by 2,379
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Short term benefits for laparoscopic colorectal resection
Schwenk, W., Haase, O., Neudecker, J. J., & Müller, J. M. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003145.pub2 · Cited by 931
Scales to Assess the Quality of Randomized Controlled Trials: A Systematic Review
Olivo, S. A., Macedo, L. G., Gadotti, I. C., Fuentes, J., Stanton, T., & Magee, D. J. (2008) · Physical Therapy · doi:10.2522/ptj.20070147 · Cited by 829
Indirect comparisons of competing interventions
Glenny, A., Altman, D., Song, F., Sakarovitch, C., Deeks, J., D'Amico, R., Bradburn, M., & Eastwood, A. (2005) · Health Technology Assessment · doi:10.3310/hta9260 · Cited by 677
Goodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 654
Steroid controversy in sepsis and septic shock: A meta-analysis
Lefering, R., & Neugebauer, E. A. M. (1995) · Critical Care Medicine · doi:10.1097/00003246-199507000-00021 · Cited by 485
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478
“We identified specific quality measures previously demonstrated or hypothesized to be associated with estimates of treatment effect by reviewing published studies of quality measures and quality assessment scales.(3-5,7,16-33) These studies were compiled from a MEDLINE search for quality and randomized controlled tria…”
MethodAssessing the Quality of Randomized Controlled Trials:Current Issues and Future Directions
Moher, D., Jadad, A. R., & Tugwell, P. (1996) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300009570 · Cited by 436
“Twenty-four of the 25 scale used "accepted criteria" to select the items for inclusion (2;5;7;10;12;15;16;18;19;23;24;28;31;32;33;39;40;44;45;48;49;53).”
BackgroundSystematic review of outpatient services for chronic pain control.
McQuay, Moore, Eccleston, Morley, & Williams (1997) · Health Technology Assessment · doi:10.3310/hta1060 · Cited by 424
A systematic review of the content of critical appraisal tools
Katrak, P., Bialocerkowski, A. E., Massy-Westropp, N., Kumar, V. S., & Grimmer, K. A. (2004) · BMC Medical Research Methodology · doi:10.1186/1471-2288-4-22 · Cited by 391
A review of critical appraisal tools show they lack rigor: Alternative tool structure is proposed
Crowe, M., & Sheppard, L. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.008 · Cited by 261
“Evans & Pollock, 1985 [57] True experimental No Yes C e e No Chalmers et al.”
BackgroundInfluentialAdjustment of meta-analyses on the basis of quality scores should be abandoned
Herbison, P., Hay-Smith, J., & Gillespie, W. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.008 · Cited by 207
Haag, G., Diener, H.-C., May, A., Meyer, C., Morck, H., Straube, A., Wessely, P., & Evers, S. (2011) · The Journal of Headache and Pain · doi:10.1007/s10194-010-0266-4 · Cited by 78
“Study quality: Study quality was rated on a 4-point scale (from A to D) on the basis of the method of Evans and Pollock [25] and of a specially developed study quality score (Table 1), the evaluation categories of which had been a priori defined.”
MethodColle, F., Rannou, F., Revel, M., Fermanian, J., & Poiraudeau, S. (2002) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/apmr.2002.35657 · Cited by 68
Metadata
- Authors
- Evans, M., & Pollock, A. V.
- Venue
- Journal of British Surgery
- Publisher
- Oxford University Press (OUP)
- Published
- 1985-04-01
- Volume
- 72
- Issue
- 4
- Pages
- 256-260
- ISSN
- 0007-1323 (ISSN-L)
- 1365-2168
- OpenAlex
- W2001722603
- Cited by
- 85
- References
- 1
- FWCI
- 4.45
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.