The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Methods in health services research: Interpreting the evidence: choosing between randomised and non-randomised studies
Open accessAbstract
This is the first of four articles Evaluations of healthcare interventions can either randomise subjects to comparison groups, or not. In both designs there are potential threats to validity, which can be external (the extent to which they are generalisable to all potential recipients) or internal (whether differences in observed effects can be attributed to differences in the intervention). Randomisation should ensure that comparison groups of sufficient size differ only in their exposure to the intervention concerned. However, some investigators have argued that randomised controlled trials (RCTs) tend to exclude, consciously or otherwise, some types of patient to whom results will subsequently be applied Furthermore, in unblinded trials the outcome of treatment may be influenced by practitioners' and patients' preferences for one or other intervention. Though non-randomised studies are less selective in terms of recruitment, they are subject to selection bias in allocation if treatment is related to initial prognosis. #### Summary points Treatment effects obtained from randomised and non-randomised studies may differ, but one method does not give a consistently greater effect than the other Treatment effects measured in each type of study best approximate when the exclusion criteria are the same and where potential prognostic factors are well understood and controlled for in the non-randomised studies Subjects excluded from randomised controlled trials tend to have a worse prognosis than those included, and this limits generalisability Subjects participating in randomised controlled trials evaluating treatment of existing conditions tend to be less affluent, educated, and healthy than those who do not; the opposite is true for trials of preventive interventions View this table: Threats to validity of evaluative research and possible solutions These issues have led to extensive debate, although empirical evidence is limited. This paper is a brief summary of a more detailed review1 of the impact of these potential threats. The review focused …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Self-citationKunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770
Fallowfield, L. J., Hall, A., Maguire, G. P., & Baum, M. (1990) · BMJ · doi:10.1136/bmj.301.6752.575 · Cited by 750
Unstable disability and the fluctuations of frailty
CAMPBELL, A. J., & BUCHNER, D. M. (1997) · Age and Ageing · doi:10.1093/ageing/26.4.315 · Cited by 587
The Exclusion of the Elderly and Women From Clinical Trials in Acute Myocardial Infarction
Gurwitz, J. H. (1992) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1992.03490110055029 · Cited by 532
A policy framework for commissioning cancer services
Whitehouse, M. (1995) · BMJ · doi:10.1136/bmj.310.6992.1425 · Cited by 506
Cholesterol lowering and mortality: the importance of considering initial level of risk.
Smith, G. D., Song, F., & Sheldon, T. A. (1993) · BMJ · doi:10.1136/bmj.306.6889.1367 · Cited by 423
An evidence based approach to individualising treatment
Glasziou, P. P., & Irwig, L. M. (1995) · BMJ · doi:10.1136/bmj.311.7016.1356 · Cited by 391
Age and Clinical Decision Making in Oncology Patients
Yellen, S. B., Cella, D. F., & Leslie, W. T. (1994) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/86.23.1766 · Cited by 354
Choosing between randomised and non-randomised studies: a systematic review.
Britton, McKee, Black, McPherson, Sanderson, & Bain (1998) · Health Technology Assessment · doi:10.3310/hta2130 · Cited by 308
Nicolaides, K., Brizot, M., Patel, F., & Snijders, R. (1994) · The Lancet · doi:10.1016/s0140-6736(94)91769-8 · Cited by 271
Jones, R. H., Kesler, K., Phillips, H. R., Mark, D. B., Smith, P. K., Nelson, C. L., Newman, M. F., Reves, J. G., Anderson, R. W., & Califf, R. M. (1996) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/s0022-5223(96)70378-1 · Cited by 271
Cancer Treatment and Age: Patient Perspectives
Newcomb, P. A., & Carbone, P. P. (1993) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/85.19.1580 · Cited by 254
Recruitment experience in clinical trials: Literature summary and annotated bibliography
Hunninghake, D. B., Darby, C. A., & Probstfield, J. L. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90004-3 · Cited by 251
Quality of Life in Chronic Diseases: Perceptions of Elderly Patients
Pearlman, R. A., & Uhlmann, R. F. (1988) · Journal of Gerontology · doi:10.1093/geronj/43.2.m25 · Cited by 243
Developing improved observational methods for evaluating therapeutic effectiveness
Horwitz, R. I., Viscoli, C. M., Clemens, J. D., & Sadock, R. T. (1990) · The American Journal of Medicine · doi:10.1016/0002-9343(90)90182-d · Cited by 204
Comparison of mastectomy with tamoxifen for treating elderly patients with operable breast cancer.
Robertson, J. F. R., Todd, J. H., Ellis, I. O., Elston, C. W., & Blamey, R. W. (1988) · BMJ · doi:10.1136/bmj.297.6647.511 · Cited by 153
Patient Preferences in Randomised Trials: Threat or Opportunity?
Torgerson, D. J., Klaber-Moffett, J., & Russell, I. T. (1996) · Journal of Health Services Research & Policy · doi:10.1177/135581969600100403 · Cited by 140
Age as a Risk Factor for Inadequate Treatment
Wetle, T. T. (1987) · JAMA · doi:10.1001/jama.1987.03400040114035 · Cited by 138
Patient compliance and the conduct and interpretation of therapeutic trials
Haynes, R. B., & Dantes, R. B. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90021-3 · Cited by 138
Yusuf, S., Held, P., Teo, K. K., & Toretsky, E. R. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090114 · Cited by 128
Age is not a limiting factor for radical radiotherapy in pelvic malignancies
Pignon, T., Horiot, J.-C., Bolla, M., Poppel, H. V., Bartelink, H. G. M. M., Roelofsen, F., Pène, F., Gérard, A., Einhorn, N., Nguyen, T., et al. (1997) · Radiotherapy and Oncology · doi:10.1016/s0167-8140(96)01861-0 · Cited by 121
Surgical care in octogenarians
Bufalari, A., Ferri, M., Cao, P., Cirocchi, R., Bisacci, R., & Moggi, L. (1996) · British journal of surgery · doi:10.1002/bjs.1800831239 · Cited by 119
The impact of age, treatment, and symptoms on the physical and mental health of cancer patients
Given, C. W., Given, B. A., & Stommel, M. (1994) · Cancer · Cited by 114
Are Randomized Controlled Trials Controlled? Patient Preferences and Unblind Trials
McPherson, K., Britton, A. R., & Wennberg, J. E. (1997) · Journal of the Royal Society of Medicine · doi:10.1177/014107689709001205 · Cited by 99
Self-citationMcKay, J. R., Alterman, A. I., McLellan, A. T., Snider, E. C., & al, E. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.1.70 · Cited by 85
Does it matter where you live? Treatment variation for breast cancer in Yorkshire
on behalf of the Yorkshire Breast Cancer Group, Sainsbury, R., Rider, L., Smith, A., & MacAdam, A. (1995) · British Journal of Cancer · doi:10.1038/bjc.1995.246 · Cited by 84
McPherson, K. (1994) · Journal of Epidemiology & Community Health · doi:10.1136/jech.48.1.6 · Cited by 76
Self-citationOral Etoposide and Carboplatin: Effective Therapy for Elderly Patients with Small Cell Lung Cancer
Evans, W. K., Radwi, A., Tomiak, E. M., Logan, D. M., Martins, H., Stewart, D. J., Goss, G., Maroun, J., & Dahrouge, S. (1995) · American Journal of Clinical Oncology · doi:10.1097/00000421-199504000-00011 · Cited by 69
Pharmacology of antineoplastic agents in older cancer patients.
Lichtman, S. M., & Skirvin, J. A. (2000) · PubMed · Cited by 67
Shank, W. A., & Balducci, L. (1992) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1992.tb01936.x · Cited by 62
Cholesterol reduction and its impact on coronary artery disease and total mortality
Holme, I. (1995) · The American Journal of Cardiology · doi:10.1016/s0002-9149(99)80465-2 · Cited by 57
Screening for cancer of the cervix in elderly women
Fletcher, A. E. (1990) · The Lancet · doi:10.1016/0140-6736(90)90552-g · Cited by 56
Hartz, A. J., Kuhn, E. M., Pryor, D. B., Krakauer, H., Young, M., Heudebert, G. R., & Rimm, A. A. (1992) · The American Journal of Cardiology · doi:10.1016/0002-9149(92)91272-6 · Cited by 50
Stukenborg, G. J. (1997) · Archives of Neurology · doi:10.1001/archneur.1997.00550190018009 · Cited by 35
Davies, G., Pyke, S. D. M., & Kinmonth, A. L. (1994) · BMJ · doi:10.1136/bmj.309.6968.1553 · Cited by 26
Breast examinations in older women: questionnaire survey of attitudes of patients and doctors
Haigney, E., Morgan, R., King, D., & Spencer, B. (1997) · BMJ · doi:10.1136/bmj.315.7115.1058 · Cited by 17
Cited by
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · BMJ · doi:10.1136/bmj.n2061 · Cited by 5,808
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544
Thomas, B. H., Ciliska, D., Dobbins, M., & Micucci, S. (2004) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1524-475x.2004.04006.x · Cited by 2,118
Kaushal, R., Shojania, K. G., & Bates, D. W. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.12.1409 · Cited by 30
Metadata
- Authors
- McKee, M., Britton, A., Black, N., McPherson, K., Sanderson, C., & Bain, C.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1999-07-31
- Volume
- 319
- Issue
- 7205
- Pages
- 312-315
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2045398130
- Cited by
- 399
- References
- 37
- FWCI
- 21.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.