Evaluating non-randomised intervention studies
Open accessThe DOI matches its Crossref record; 334 of the 334 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To consider methods and related evidence for evaluating bias in non-randomised intervention studies. DATA SOURCES: Systematic reviews and methodological papers were identified from a search of electronic databases; handsearches of key medical journals and contact with experts working in the field. New empirical studies were conducted using data from two large randomised clinical trials. METHODS: Three systematic reviews and new empirical investigations were conducted. The reviews considered, in regard to non-randomised studies, (1) the existing evidence of bias, (2) the content of quality assessment tools, (3) the ways that study quality has been assessed and addressed. (4) The empirical investigations were conducted generating non-randomised studies from two large, multicentre randomised controlled trials (RCTs) and selectively resampling trial participants according to allocated treatment, centre and period. RESULTS: In the systematic reviews, eight studies compared results of randomised and non-randomised studies across multiple interventions using meta-epidemiological techniques. A total of 194 tools were identified that could be or had been used to assess non-randomised studies. Sixty tools covered at least five of six pre-specified internal validity domains. Fourteen tools covered three of four core items of particular importance for non-randomised studies. Six tools were thought suitable for use in systematic reviews. Of 511 systematic reviews that included non-randomised studies, only 169 (33%) assessed study quality. Sixty-nine reviews investigated the impact of quality on study results in a quantitative manner. The new empirical studies estimated the bias associated with non-random allocation and found that the bias could lead to consistent over- or underestimations of treatment effects, also the bias increased variation in results for both historical and concurrent controls, owing to haphazard differences in case-mix between groups. The biases were large enough to lead studies falsely to conclude significant findings of benefit or harm. Four strategies for case-mix adjustment were evaluated: none adequately adjusted for bias in historically and concurrently controlled studies. Logistic regression on average increased bias. Propensity score methods performed better, but were not satisfactory in most situations. Detailed investigation revealed that adequate adjustment can only be achieved in the unrealistic situation when selection depends on a single factor. CONCLUSIONS: Results of non-randomised studies sometimes, but not always, differ from results of randomised studies of the same intervention. Non-randomised studies may still give seriously misleading results when treated and control groups appear similar in key prognostic factors. Standard methods of case-mix adjustment do not guarantee removal of bias. Residual confounding may be high even when good prognostic data are available, and in some situations adjusted results may appear more biased than unadjusted results. Although many quality assessment tools exist and have been used for appraising non-randomised studies, most omit key quality domains. Healthcare policies based upon non-randomised studies or systematic reviews of non-randomised studies may need re-evaluation if the uncertainty in the true evidence base was not fully appreciated when policies were made. The inability of case-mix adjustment methods to compensate for selection bias and our inability to identify non-randomised studies that are free of selection bias indicate that non-randomised studies should only be undertaken when RCTs are infeasible or unethical. Recommendations for further research include: applying the resampling methodology in other clinical areas to ascertain whether the biases described are typical; developing or refining existing quality assessment tools for non-randomised studies; investigating how quality assessments of non-randomised studies can be incorporated into reviews and the implications of individual quality features for interpretation of a review's results; examination of the reasons for the apparent failure of case-mix adjustment methods; and further evaluation of the role of the propensity score.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“This tool was selected for its comprehensive ability to assess the methodological quality of non‐randomized studies and has shown good reliability and validity.21, 22”
From The frequency of influenza and bacterial coinfection: a systematic review and meta-analysis. (2016) · cites this paper as [22]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“In general, the probability of systematic differences in comparison groups at baseline was low, diminishing the risk of selection bias (58).”
From Mindfulness-Based Program for Infertility: Efficacy study (2013) · cites this paper as [58]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The EPHPP has also been reported to have better interrater reliability than the Cochrane Collaboration Risk of Bias Tool”
From Improving Mental Health Service Utilization Among Men: A Systematic Review and Synthesis of Behavior Change Techniques Within Interventions Targeting Help-Seeking (2019) · cites this paper as Deeks et al., 2003
Experimental — accuracy not yet measuredIn the citing paper
“In nonrandomized studies, selection bias occurs when participants chosen for the intervention of interest have different characteristics from those allocated to the alternative intervention (or not treated) because the choice of a given intervention might be affected by the discretion of the treating clinician or patient preference, patient characteristics, and clinical history [13].”
From RoBANS 2: A Revised Risk of Bias Assessment Tool for Nonrandomized Studies of Interventions (2023) · cites this paper as [13]
In the citing paper
“The EPHPP is considered suitable to assess the quality of a wide range of quantitative study designs, including interventions (Jackson and Waters, 2005;Deeks et al., 2003).”
From Exploring the role of exposure to green and blue spaces in preventing anxiety and depression among young people aged 14–24 years living in urban settings: A systematic review and conceptual framework (2022) · cites this paper as Deeks et al., 2003
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Part of this paper’s reference list could not be split into single entries.
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
(1963) · Medical Entomology and Zoology · Cited by 15,085
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689
Practical Statistics for Medical Research.
Walter, S. D., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,668
Self-citation(1979) · Medical Entomology and Zoology · Cited by 11,252
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Statistical Methods in Cancer Research
Breslow, N. E. (1980) · Cited by 7,332
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,997
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationThe Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Clinical Epidemiology: A Basic Science for Clinical Medicine.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_9 · Cited by 3,476
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Self-citationUsers' guides to the medical literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 2,970
Simulation Study of Confounder-Selection Strategies
Maldonado, G., & Greenland, S. (1993) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116813 · Cited by 2,491
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Self-citationA comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Guide to Clinical Preventive Services
Wesley Allen, T. (1991) · The Journal of the American Osteopathic Association · doi:10.1515/jom-1991-900515 · Cited by 2,129
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
RE:“;THE IMPACT OF CONFOUNDER SELECTION CRITERIA ON EFFECT ESTIMATION”
Greenland, S., & Mickey, R. M. (1989) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115409 · Cited by 2,108
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Basic and Clinical Biostatistics,
(2002) · Survey of Ophthalmology · doi:10.1016/s0039-6257(02)00360-0 · Cited by 1,809
Hunt, D. L., Haynes, R. B., Hanna, S. E., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,669
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Rules of Evidence and Clinical Recommendations on the Use of Antithrombotic Agents
Sackett, D. L. (1989) · Chest · doi:10.1378/chest.95.2_supplement.2s · Cited by 1,368
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
The design and analysis of cohort studies
Breslow, N. E., & Day, N. E. (1987) · International Agency for Research on Cancer eBooks · Cited by 1,312
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Integrative reviews of nursing research
Ganong, L. H. (1987) · Research in Nursing & Health · doi:10.1002/nur.4770100103 · Cited by 1,296
Meta-Analysis in Clinical Research
L'ABBÉ, K. A., DETSKY, A. S., & O'ROURKE, K. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-107-2-224 · Cited by 1,267
Users' guides to the medical literature : a manual for evidence-based clinical practice
Guyatt, G. H., Rennie, D., Meade, M. O., & Cook, D. J. (2002) · Cited by 1,196
Handbook of Psychotherapy and Behavior Change: An Empirical Analysis
Bergin, A. E. (1971) · DigitalGeorgetown (Georgetown University Library) · Cited by 1,110
Nonpharmacological interventions for insomnia: a meta-analysis of treatment efficacy
(1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.8.1172 · Cited by 1,098
The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies
Cochran, W. G. (1968) · Biometrics · doi:10.2307/2528036 · Cited by 961
Best evidence synthesis: An intelligent alternative to meta-analysis
Slavin, R. E. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00097-a · Cited by 949
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
Bias in treatment assignment in controlled clinical trials
Chalmers, T. C., Celano, P., Sacks, H. S., & Smith, H. (1983) · New England Journal of Medicine · doi:10.1056/nejm198312013092204 · Cited by 864
Randomized versus historical controls for clinical trials
Sacks, H., Chalmers, T. C., & Smith, H. (1982) · The American Journal of Medicine · doi:10.1016/0002-9343(82)90815-4 · Cited by 834
McAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02786-0 · Cited by 812
Bernie, T., Les, I., Paul, G., Jan, K., David, W., & Chris, S. (1998) · BMJ · doi:10.1136/bmj.317.7158.559 · Cited by 811
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770
Clinical Trials: Design, Conduct and Analysis
Meinert, C. L. (1986) · DigitalGeorgetown (Georgetown University Library) · doi:10.1093/acprof:oso/9780195035681.001.0001 · Cited by 756
Taggart, D. P., D'Amico, R., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(01)06069-x · Cited by 732
Self-citationGAIL, M. H., WIEAND, S., & PIANTADOSI, S. (1984) · Biometrika · doi:10.1093/biomet/71.3.431 · Cited by 698
Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.2307/1174711 · Cited by 698
Kingery, W. S. (1997) · Pain · doi:10.1016/s0304-3959(97)00049-3 · Cited by 683
Compliance with therapeutic regimens
Jay, S., Litt, I. F., & Durant, R. H. (1984) · Journal of Adolescent Health Care · doi:10.1016/s0197-0070(84)80012-1 · Cited by 666
Identifying effective psychological treatments for insomnia: A meta-analysis.
Murtagh, D. R. R., & Greenwood, K. M. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.1.79 · Cited by 664
Assessing the Quality of Randomized Trials
Clark, H. D., Wells, G. A., Huët, C., McAlister, F. A., Salmi, L. R., Fergusson, D., & Laupacis, A. (1999) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00026-4 · Cited by 648
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640
Handbook of Alcoholism Treatment Approaches: Effective Alternatives.
Goldman, M. S. (1996) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/003083 · Cited by 636
Effects of Intensity of Rehabilitation After Stroke: A Research Synthesis
Kwakkel, G., Wagenaar, R. C., Koelman, T. W., Lankhorst, G. J., & Koetsier, J. C. (1997) · Stroke · doi:10.1161/01.str.28.8.1550 · Cited by 589
Effectiveness of Mastery Learning Programs: A Meta-Analysis
Kulik, C.-L. C., Kulik, J. A., & Bangert-Drowns, R. L. (1990) · Review of Educational Research · doi:10.3102/00346543060002265 · Cited by 561
The Integrative Research Review: A Systematic Approach
Cooper, H. (1986) · Educational Researcher · doi:10.2307/1175261 · Cited by 537
The clinical course and prognostic factors of non-specific neck pain: a systematic review
Borghouts, J. A. J., Koes, B. W., & Bouter, L. M. (1998) · Pain · doi:10.1016/s0304-3959(98)00058-x · Cited by 533
Critical review of the literature
HORVÁTH, I. (1984) · Modelling in the Technology of Wastewater Treatment · doi:10.1016/b978-0-08-023978-1.50007-x · Cited by 531
How study design affects outcomes in comparisons of therapy. I: Medical
Colditz, G. A., Miller, J. N., & Mosteller, F. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080408 · Cited by 520
Invited commentary: a critical look at some popular meta-analytic methods
Greenland, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117248 · Cited by 511
Ries, A. L., Carlin, B. W., Carrieri-Kohlman, V., Casaburi, R., Celli, B. R., Emery, C. F., Hodgkin, J. E., Mahler, D. A., Make, B., & Skolnick, J. (1997) · Chest · doi:10.1378/chest.112.5.1363 · Cited by 502
Reporting on Methods in Clinical Trials
DerSimonian, R., Charette, L. J., McPeek, B., & Mosteller, F. (1982) · New England Journal of Medicine · doi:10.1056/nejm198206033062204 · Cited by 499
THE EFFECT OF MISCLASSIFICATION IN THE PRESENCE OF COVARIATES
GREENLAND, S. (1980) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113025 · Cited by 494
(1985) · Cited by 487
The Periodic Health Examination
(1934) · New England Journal of Medicine · doi:10.1056/nejm193401252100413 · Cited by 483
The science of prevention: Methodological advances from alcohol and substance abuse research.
(1997) · American Psychological Association eBooks · doi:10.1037/10222-000 · Cited by 472
Confounding by Indication: An Example of Variation in the Use of Epidemiologic Terminology
Salas, M., Hotman, A., & Stricker, B. H. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009758 · Cited by 471
Is dental health education effective? A systematic review of current evidence
Kay, E. J., & Locker, D. (1996) · Community Dentistry and Oral Epidemiology · doi:10.1111/j.1600-0528.1996.tb00850.x · Cited by 470
ROSNER, B., SPIEGELMAN, D., & WILLETT, W. C. (1990) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115715 · Cited by 464
Zaza, S., Wright-De Agüero, L. K., Briss, P. A., Truman, B. I., Hopkins, D. P., Hennessy, M. H., Sosin, D. M., Anderson, L., Carande-Kulis, V. G., Teutsch, S. M., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00122-1 · Cited by 464
Powe, N. R. (1994) · Archives of Ophthalmology · doi:10.1001/archopht.1994.01090140115033 · Cited by 433
Evidence Favoring the Use of Anticoagulants in the Hospital Phase of Acute Myocardial Infarction
Chalmers, T. C., Matta, R. J., Smith, H., & Kunzler, A.-M. (1977) · New England Journal of Medicine · doi:10.1056/nejm197711172972004 · Cited by 423
A review of the use of health status measures in economic evaluation.
Brazier, Deverill, Green, Harper, & Booth (1999) · Health Technology Assessment · doi:10.3310/hta3090 · Cited by 413
Some Surprising Results about Covariate Adjustment in Logistic Regression Models
Robinson, L. D., & Jewell, N. P. (1991) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403444 · Cited by 410
Assembling Comparison Groups to Assess the Effects of Health care
Chalmers, L. (1997) · Journal of the Royal Society of Medicine · doi:10.1177/014107689709000706 · Cited by 409
Kasiske, B., Lakatua, J., Ma, J., & Louis, T. (1998) · American Journal of Kidney Diseases · doi:10.1053/ajkd.1998.v31.pm9631839 · Cited by 408
A Meta-Analysis of the Efficacy of Non-Operative Treatments for Idiopathic Scoliosis* **
Rowe, D. E., Bernstein, S. M., Riddick, M. F., Adler, F., Emans, J. B., & Gardner-Bonneau, D. (1997) · The Journal of Bone and Joint Surgery (American Volume) · doi:10.2106/00004623-199705000-00005 · Cited by 408
Sterne, J. A. C., Jüni, P., Schulz, K. F., Altman, D. G., Bartlett, C., & Egger, M. (2002) · Statistics in Medicine · doi:10.1002/sim.1184 · Cited by 382
Self-citationModified Work and Return to Work: A Review of the Literature
Krause, N., Dasinger, L. K., & Neuhauser, F. (1998) · Journal of Occupational Rehabilitation · doi:10.1023/a:1023015622987 · Cited by 378
The effects of psychoeducational care provided to adults with cancer: meta-analysis of 116 studies.
Devine, E. C., & Westlake, S. K. (1995) · PubMed · Cited by 374
Emergency treatment of malignant extradural spinal cord compression: an evidence-based guideline.
Loblaw, D. A., & Laperriere, N. J. (1998) · Journal of Clinical Oncology · doi:10.1200/jco.1998.16.4.1613 · Cited by 374
A Meta-analysis of Alcohol Consumption in Relation to Risk of Breast Cancer
Longnecker, M. P. (1988) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1988.03410050072032 · Cited by 368
Moher, Cook, Jadad, Tugwell, Moher, Jones, Pham, & Klassen (1999) · Health Technology Assessment · doi:10.3310/hta3120 · Cited by 368
A meta‐analysis of bibliotherapy studies
Marrs, R. W. (1995) · American Journal of Community Psychology · doi:10.1007/bf02507018 · Cited by 366
Studies of educational interventions and outcomes in diabetic adults: A meta-analysis revisited
Brown, S. A. (1990) · Patient Education and Counseling · doi:10.1016/0738-3991(90)90070-2 · Cited by 364
Assessment and Control for Confounding by Indication in Observational Studies
Psaty, B. M., Koepsell, T. D., Lin, D., Weiss, N. S., Siscovick, D. S., Rosendaal, F. R., Pahor, M., & Furberg, C. D. (1999) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1999.tb01603.x · Cited by 363
Effects of psychoeducational care for adult surgical patients: A meta-analysis of 191 studies
Devine, E. C. (1992) · Patient Education and Counseling · doi:10.1016/0738-3991(92)90193-m · Cited by 360
How to Use an Article About Therapy or Prevention
Guyatt, G. H., Sackett, D. L., & Cook, D. J. (1995) · Cited by 357
What works? A methodological analysis of the alcohol treatment outcome literature.
Tonigan, J. S., Hester, R., Montgomery, H., Luckie, L., Bien, T. H., Handmaker, N. S., Simpson, T., Brown, J. M., & Wr, M. (1995) · Cited by 357
Effects of Misspecification of the Propensity Score on Estimators of Treatment Effect
Drake, C. (1993) · Biometrics · doi:10.2307/2532266 · Cited by 347
Plasma lipid and lipoprotein responses to dietary fat and cholesterol: a meta-analysis
Howell, W., McNamara, D., Tosca, M., Smith, B., & Gaines, J. (1997) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/65.6.1747 · Cited by 343
Vickers, A. J. (1996) · Journal of the Royal Society of Medicine · doi:10.1177/014107689608900602 · Cited by 343
Healing Medicare: Managing Health System Change the Canadian Way
Spasoff, R. A. (1995) · Europe PMC (PubMed Central) · Cited by 333
Rating the quality of evidence for clinical practice guidelines
Hadorn, D. C., Baker, D., Hodges, J. S., & Hicks, N. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00019-4 · Cited by 332
A GENERAL ESTIMATOR FOR THE VARIANCE OF THE MANTEL HAENSZEL ODDS RATIO
ROBINS, J., GREENLAND, S., & BRESLOW, N. E. (1986) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114447 · Cited by 330
Saint, S., Elmore, J. G., Sullivan, S. D., Emerson, S. S., & Koepsell, T. D. (1998) · The American Journal of Medicine · doi:10.1016/s0002-9343(98)00240-x · Cited by 330
The Importance of Quality of Primary Studies in Producing Unbiased Systematic Reviews
Khan, K. S. (1996) · Archives of Internal Medicine · doi:10.1001/archinte.156.6.661 · Cited by 328
A Meta-Analysis of Nurse Practitioners and Nurse Midwives in Primary Care
BROWN, S. A., & GRIMES, D. E. (1995) · Nursing Research · doi:10.1097/00006199-199511000-00003 · Cited by 322
Does prenatal care improve birth outcomes? A critical review
FISCELLA, K. (1995) · Obstetrics & Gynecology · doi:10.1016/0029-7844(94)00408-6 · Cited by 320
Stock, S. R. (1991) · American Journal of Industrial Medicine · doi:10.1002/ajim.4700190111 · Cited by 319
MacLehose, Reeves, Harvey, Sheldon, Russell, & Black (2000) · Health Technology Assessment · doi:10.3310/hta4340 · Cited by 311
Acupuncture and chronic pain: A criteria-based meta-analysis
ter Riet, G., Kleunen, J., & Knipschild, P. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90020-p · Cited by 311
How important is publication bias? A synthesis of available data.
Dickersin, K. (1997) · PubMed · Cited by 311
A Proposal for Structured Reporting of Randomized Controlled Trials
Andrew, E. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520240054041 · Cited by 309
Choosing between randomised and non-randomised studies: a systematic review.
Britton, McKee, Black, McPherson, Sanderson, & Bain (1998) · Health Technology Assessment · doi:10.3310/hta2130 · Cited by 308
Shapiro, S. (1997) · PubMed · Cited by 299
Nichol, K. L., Baken, L., Wuorenma, J., & Nelson, A. (1999) · Archives of Internal Medicine · doi:10.1001/archinte.159.20.2437 · Cited by 297
Mullen, P. D., Green, L. W., & Persinger, G. S. (1985) · Preventive Medicine · doi:10.1016/0091-7435(85)90070-2 · Cited by 291
Perioperative Parenteral Nutrition: A Meta-Analysis
DETSKY, A. S., BAKER, J. P., O'ROURKE, K., & GOEL, V. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-107-2-195 · Cited by 283
Diagnosis, management and screening of early localised prostate cancer.
Selley, Donovan, Faulkner, Coast, & Gillatt (1997) · Health Technology Assessment · doi:10.3310/hta1020 · Cited by 277
Spinal manipulation and mobilisation for back and neck pain: a blinded review.
Koes, B. W., Assendelft, W. J., van der Heijden, G. J., Bouter, L. M., & Knipschild, P. G. (1991) · BMJ · doi:10.1136/bmj.303.6813.1298 · Cited by 270
The role of method in treatment effectiveness research: Evidence from meta-analysis.
Wilson, D. B., & Lipsey, M. W. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.413 · Cited by 261
Antiproteinuric effect of blood-pressure-lowering agents: a meta-analysis of comparative trials
Gansevoort, R. T., Sluiter, W. J., Hemmelder, M. H., de Zeeuw, D., & de Jong, P. E. (1995) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/10.11.1963 · Cited by 259
Childhood Injury Prevention Counseling in Primary Care Settings: A Critical Review of the Literature
Bass, J. L., Christoffel, K. K., Widome, M., Boyle, W., Scheidt, P., Stanwick, R., & Roberts, K. (1993) · Pediatrics · doi:10.1542/peds.92.4.544 · Cited by 257
Norman, G. R., & Shannon, S. (1998) · Europe PMC (PubMed Central) · Cited by 253
Effects of Antihypertensive Therapy on Serum Lipids
Kasiske, B. L., Ma, J. Z., Kalil, R. S. N., & Louis, T. A. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-2-199501150-00010 · Cited by 252
Sexual health education interventions for young people: a methodological review
Oakley, A., Fullerton, D., Holland, J., Arnold, S., Dawson, M. F., Kelley, P., & McGrellis, S. (1995) · BMJ · doi:10.1136/bmj.310.6973.158 · Cited by 250
DEVINE, E. C., & COOK, T. D. (1983) · Nursing Research · doi:10.1097/00006199-198309000-00003 · Cited by 241
Assessing the Quality of Randomised Controlled Trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch5 · Cited by 238
Self-citationRESTRICTION OF DIETARY PROTEIN AND PROGRESSION OF RENAL FAILURE IN DIABETIC NEPHROPATHY
Walker, J. D., Dodds, R. A., Murrells, T. J., Bending, J. J., Mattock, M. B., Keen, H., & Viberti, G. C. (1989) · The Lancet · doi:10.1016/s0140-6736(89)92032-1 · Cited by 236
Bérard, A., Bravo, G., & Gauthier, P. (1997) · Osteoporosis International · doi:10.1007/bf01623773 · Cited by 236
Callahan, C. M., Dittus, R. S., & Katz, B. P. (1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-3-216 · Cited by 233
Half a century of ECT use in young people
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.5.595 · Cited by 230
Health Care Needs Assessment: The Epidemiologically Based Needs Assessment Reviews
(2018) · CRC Press eBooks · doi:10.1201/9781315384719 · Cited by 229
Management of Heart Failure: Volume 1: Medical
(2015) · Springer eBooks · doi:10.1007/978-1-4471-6657-3 · Cited by 229
How to read a paper: Assessing the methodological quality of published papers
Greenhalgh, T. (1997) · BMJ · doi:10.1136/bmj.315.7103.305 · Cited by 226
Ultrasound therapy in musculoskeletal disorders: a meta-analysis
Gam, A. N., & Johannsen, F. (1995) · Pain · doi:10.1016/0304-3959(95)00018-n · Cited by 225
Concealing treatment allocation in randomised trials
Altman, D. G., & Schulz, K. F. (2001) · BMJ · doi:10.1136/bmj.323.7310.446 · Cited by 223
Self-citationEnteral nutrition in the critically ill patient: A critical review of the evidence
Heyland, D. K., Cook, D. J., & Guyatt, G. H. (1993) · Intensive Care Medicine · doi:10.1007/bf01711083 · Cited by 219
Discussing Hidden Bias in Observational Studies
Rosenbaum, P. R. (1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-115-11-901 · Cited by 213
A meta-analysis of controlled trials of cardiac patient education
Mullen, P. D., Mains, D. A., & Velez, R. (1992) · Patient Education and Counseling · doi:10.1016/0738-3991(92)90194-n · Cited by 212
VAN BALKOM, A. J. L. M., BAKKER, A., SPINHOVEN, P., BLAAUW, B. M. J. W., SMEENK, S., & RUESINK, B. (1997) · The Journal of Nervous & Mental Disease · doi:10.1097/00005053-199708000-00006 · Cited by 211
Developing improved observational methods for evaluating therapeutic effectiveness
Horwitz, R. I., Viscoli, C. M., Clemens, J. D., & Sadock, R. T. (1990) · The American Journal of Medicine · doi:10.1016/0002-9343(90)90182-d · Cited by 204
Impact of Study Quality on Outcome in Placebo-Controlled Trials of Homeopathy
Linde, K., Scholz, M., Ramirez, G., Clausius, N., Melchart, D., & Jonas, W. B. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00048-7 · Cited by 204
Behavioural interventions for HIV/AIDS prevention
Oakley, A., Fullerton, D., & Holland, J. (1995) · AIDS · doi:10.1097/00002030-199505000-00010 · Cited by 202
Control of Confounding in the Assessment of Medical Technology
GREENLAND, S., & NEUTRA, R. (1980) · International Journal of Epidemiology · doi:10.1093/ije/9.4.361 · Cited by 201
Bancroft, T. A. (1964) · Biometrics · doi:10.2307/2528486 · Cited by 198
Sullivan, F., & Mitchell, E. (1995) · BMJ · doi:10.1136/bmj.311.7009.848 · Cited by 192
Effects of Educational Interventions In Diabetes Care: A Meta-Analysis of Findings
BROWN, S. A. (1988) · Nursing Research · doi:10.1097/00006199-198807000-00010 · Cited by 189
Choi, H. W., Breman, J. G., Teutsch, S. M., Liu, S., Hightower, A. W., & Sexton, J. D. (1995) · The American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.1995.52.377 · Cited by 187
A Short Textbook of Medical Statistics
Hill, A. (1985) · Medical Entomology and Zoology · Cited by 185
Methods for Pooled Analyses of Epidemiologic Studies
Friedenreich, C. M. (1993) · Epidemiology · doi:10.1097/00001648-199307000-00004 · Cited by 184
Instruments for Assessing the Quality of Drug Studies Published in the Medical Literature
Cho, M. K. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020027007 · Cited by 180
FOXCROFT, D. R., LISTER‐SHARP, D., & LOWE, G. (1997) · Addiction · doi:10.1111/j.1360-0443.1997.tb02911.x · Cited by 180
CONFOUNDING AND MISCLASSIFICATION
GREENLAND, S., & ROBINS, J. M. (1985) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114131 · Cited by 176
Final results from a meta-analysis of remedial interventions with drink/drive offenders
WELLS-PARKER, E., BANGERT-DROWNS, R., MCMILLEN, R., & WILLIAMS, M. (1995) · Addiction · doi:10.1111/j.1360-0443.1995.tb03500.x · Cited by 176
Magnesium sulfate therapy in preeclampsia and eclampsia
Witlin, A. (1998) · Obstetrics & Gynecology · doi:10.1016/s0029-7844(98)00277-4 · Cited by 174
Evaluating the Effectiveness of Child and Adolescent Group Treatment: A Meta-Analytic Review
Hoag, M. J., & Burlingame, G. M. (1997) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2603_2 · Cited by 173
The effectiveness of acupuncture in treating acute dental pain: a systematic review
Ernst, E., & Pittler, M. H. (1998) · British Dental Journal · doi:10.1038/sj.bdj.4809654 · Cited by 167
Orthopaedic clinical research. Deficiencies in experimental design and determinations of outcome.
Gartland, J. J. (1988) · The Journal of Bone & Joint Surgery · doi:10.2106/00004623-198870090-00013 · Cited by 166
Floyd, M. R., & Scogin, F. R. (1997) · Psychology and Aging · doi:10.1037//0882-7974.12.1.150 · Cited by 165
HIV Sexual Risk Reduction Interventions for Women: A Review
Wingood, G. M., & DiClemente, R. J. (1996) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(18)30344-1 · Cited by 162
Effects of relaxation and music on postoperative pain: a review
Good, M. (1996) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1996.tb02925.x · Cited by 161
Using observational data from registries to compare treatments: The fallacy of omnimetrics
Green, S. B., & Byar, D. P. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030413 · Cited by 161
Randomized Controlled Trials of Individualized Homeopathy: A State-of-the-Art Review
Linde, K., & Melchart, D. (1998) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.1998.4.371 · Cited by 160
Systematic Reviews on the Basis of Methodological Criteria
de Vet, H. C. W., de Bie, R. A., van der Heijden, G. J. M. G., Verhagen, A. P., Sijpkes, P., & Knipschild, P. G. (1997) · Physiotherapy · doi:10.1016/s0031-9406(05)66175-5 · Cited by 160
Adult respiratory distress syndrome: A systematic overview of incidence and risk factors
Garber, B. G., Hebert, P. C., Yelle, J.-D., Hodder, R. V., & McGowan, J. M. (1996) · Critical Care Medicine · doi:10.1097/00003246-199604000-00023 · Cited by 156
Wortman, P. M. (1994) · Cited by 154
Surgery for herniated lumbar discs: A literature synthesis
Hoffman, R. M., Wheeler, K. J., & Deyo, R. A. (1993) · Journal of General Internal Medicine · doi:10.1007/bf02600110 · Cited by 152
Controlling for Continuous Confounders in Epidemiologic Research
Brenner, H., & Blettner, M. (1997) · Epidemiology · doi:10.1097/00001648-199707000-00014 · Cited by 151
Fluoride varnishes (Duraphat): A meta‐analysis
Helfenstein, U., & Steiner, M. (1994) · Community Dentistry And Oral Epidemiology · doi:10.1111/j.1600-0528.1994.tb01559.x · Cited by 146
Use of check lists in assessing the statistical content of medical studies.
Gardner, M. J., Machin, D., & Campbell, M. J. (1986) · BMJ · doi:10.1136/bmj.292.6523.810 · Cited by 143
de Craen, A. J. M., Giulio, G., Lampe-Schoenmaeckers, A. J. E. M., Kessels, A. G. H., & Kleijnen, J. (1996) · BMJ · doi:10.1136/bmj.313.7053.321 · Cited by 143
Smeenk, F. W. J. M., van Haastregt, J. C. M., de Witte, L., & Crebolder, H. F. J. M. (1998) · BMJ · doi:10.1136/bmj.316.7149.1939 · Cited by 141
Promoting Weight Loss in Type II Diabetes
Brown, S. A., Upchurch, S., Anding, R., Winter, M., & Ramìrez, G. (1996) · Diabetes Care · doi:10.2337/diacare.19.6.613 · Cited by 141
Patient Preferences in Randomised Trials: Threat or Opportunity?
Torgerson, D. J., Klaber-Moffett, J., & Russell, I. T. (1996) · Journal of Health Services Research & Policy · doi:10.1177/135581969600100403 · Cited by 140
Geriatric rehabilitation following fractures in older people: a systematic review.
Cameron, Crotty, M., Currie, Finnegan, Gillespie, Gillespie, Handoll, H. H., Kurrle, Madhok, Murray, G. D., et al. (2000) · Health Technology Assessment · doi:10.3310/hta4020 · Cited by 139
A Critique of Methodology in Studies of Anticoagulant Therapy for Acute Myocardial Infarction
Gifford, R. H., & Feinstein, A. R. (1969) · New England Journal of Medicine · doi:10.1056/nejm196902132800703 · Cited by 137
Lipid-lowering therapy in patients with renal disease
Massy, Z. A., Ma, J. Z., Louis, T. A., & Kasiske, B. L. (1995) · Kidney International · doi:10.1038/ki.1995.284 · Cited by 135
The efficacy of rational-emotive therapy: A quantitative review of the outcome research
Lyons, L. C., & Woods, P. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90113-9 · Cited by 134
Abel, U. R., & Koch, A. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00041-4 · Cited by 133
Treatment Modalities for Soft Tissue Injuries of the Ankle
Ogilvie-Harris, D. J., & Gilbart, M. K. (1995) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-199507000-00008 · Cited by 132
Maziak, D. E., Meade, M. O., & Todd, T. R. J. (1998) · CHEST Journal · doi:10.1378/chest.114.2.605 · Cited by 129
Campos-Outcalt, D. E., Senf, J. H., Watkins, A. J., & Bastacky, S. (1995) · Academic Medicine · doi:10.1097/00001888-199507000-00012 · Cited by 128
Effectiveness of Treatments of Depression in Older Ambulatory Patients
McCusker, J., Cole, M. G., Keller, E., Bellavance, F., & Bérard, A. (1998) · Archives of Internal Medicine · doi:10.1001/archinte.158.7.705 · Cited by 125
"Everyone has won and all must have prizes".
Turk, D. (2000) · The Clinical Journal of Pain · doi:10.1097/00002508-200006000-00001 · Cited by 124
Aid to the Evaluation of Therapeutic Studies
Reisch, J. S., Tyson, J. E., & Mize, S. G. (1989) · Pediatrics · doi:10.1542/peds.84.5.815 · Cited by 123
Antibiotic Prophylaxis After Basilar Skull Fractures: A Meta‐Analysis
Villalobos, T., Arango, C., Kubilis, P. S., & Rathore, M. H. (1998) · Clinical Infectious Diseases · doi:10.1086/514666 · Cited by 122
ESTIMATING AND CORRECTING FOR CONFOUNDER MISCLASSIFICATION
Savitz, D. A., & Barón, A. E. (1989) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115210 · Cited by 122
Local versus general anaesthesia in carotid endarterectomy: a systematic review of the evidence
Tangkanakul, C., Counsell, C. E., & Warlow, C. P. (1997) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/s1078-5884(97)80178-5 · Cited by 120
Elvik, R. (1995) · Accident Analysis & Prevention · doi:10.1016/0001-4575(95)00003-i · Cited by 118
Patient outcomes following unicompartmental or bicompartmental knee arthroplasty
Callahan, C. M., Drake, B. G., Heck, D. A., & Dittus, R. S. (1995) · The Journal of Arthroplasty · doi:10.1016/s0883-5403(05)80120-2 · Cited by 118
Solomon, D. H., Bates, D. W., Panush, R. S., & Katz, J. N. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-1-199707010-00009 · Cited by 118
Pharmacological management of alcohol withdrawal.
Naik, P. C., & Lawton, J. (1993) · PubMed · Cited by 118
Simons, M. P., Kleijnen, J., van Geldere, D., Hoitsma, H. F. W., & Obertop, H. (1996) · British journal of surgery · doi:10.1002/bjs.1800830606 · Cited by 116
Primary Prevention of Child Physical Abuse and Neglect: A Critical Review. Part I
MacMillan, H. L., MacMillan, J. H., Offord, D. R., Griffith, L. E., & MacMillan, A. B. (1994) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1994.tb02298.x · Cited by 115
Evaluation of the effectiveness of immunization delivery methods.
Gyorkos, T. W., Tannenbaum, T. N., Abrahamowicz, M., Bédard, L., Carsley, J., Franco, E. D., Delage, G., Miller, M. A., Lamping, D. L., & Grover, S. A. (1994) · PubMed · Cited by 113
Evaluation of Psychotherapy with Alcoholics; A Critical Review
Hill, M. J., & Blane, H. T. (1967) · Quarterly Journal of Studies on Alcohol · doi:10.15288/qjsa.1967.28.076 · Cited by 110
Elective Cyclosporine Withdrawal After Renal Transplantation: A Meta-analysis
Kasiske, B. L. (1993) · JAMA · doi:10.1001/jama.269.3.395 · Cited by 110
Studies without Internal Controls
Bailar, J. C., Louis, T. A., Lavori, P. W., & Polansky, M. (1984) · New England Journal of Medicine · doi:10.1056/nejm198407193110306 · Cited by 109
Bradley, C. (1993) · Diabetes Care · doi:10.2337/diacare.16.2.509 · Cited by 109
Immunomodulation with echinacea — a systematic review of controlled clinical trials
Melchart, D., Linde, K., Worku, F., Bauer, R., & Wagner, H. (1994) · Phytomedicine · doi:10.1016/s0944-7113(11)80072-3 · Cited by 107
Research works printed but not linked: 19
- Abel U, Koch A. The role of randomization in clinical studies: myths and beliefs. J Clin Epidemiol 1999;52:487-97.
- Feinstein AR, Horwitz RI. Problems in the "evidence" of "evidence-based medicine". Am J Med 1997;103:529-35.
- Horwitz RI, Feinstein AR. The application of therapeutic trial principles to improve the design of epidemiologic research. J Chron Dis 1981;34:575-83.
- Byar DP. Problems with using observational data bases to compare treatments. Stat Med 1991;10:663-6.
- Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995;273:408-12.
- Kunz R, Vist G, Oxman AD. Randomisation to protect against selection bias in healthcare trials (Cochrane Methodology Review). In The Cochrane Library, Issue 4. Oxford: Update Software; 2002.
- Diehl LF, Perry DJ. A comparison of randomized concurrent control groups with matched historical control groups: are historical controls valid? J Clin Oncol 1986;4:1114-20.
- Lipsey MW, Wilson DB. The efficacy of psychological educational, and behavioural treatments: confirmation from meta-analysis. Am Psychol 1993;48:1181-209.
- Miller JN, Colditz GA, Mosteller F. How study design affects outcomes in comparisons of therapy. II: surgical. Stat Med 1989;8:455-66.
- Pocock SJ, Elbourne DR. Randomized trials or observational tribulations? N Engl J Med 2000;342:1907-9.
- Moher D, Jadad AR, Tugwell P. Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care 1996;12:195-208.
- Critical Appraisal Skills Programme. 12 questions to help you make sense of a cohort study. Oxford: Critical Appraisal Skills Programme; 1999.
- Kleijnen J, Knipschild P, Ter Riet G. Clinical trials of homeopathy. BMJ 1991;302:316-32.
- van der Windt DA, van der Heijden GJ, Scholten RJ, Koes BW, Bouter LM. The efficacy of non-steroidal anti-inflammatory drugs for shoulder complaints. J Clin Epidemiol 1995;48:691-704.
- Kleijnen J, Riet ter G, Knipschild P. Vitamine C en verkoudheid. Overzicht van een megadosis literatuur. Ned Tijdschr Geneeskd 1989;133:1535.
- Riet ter G, Kleijnen J, Knipschild P. De meta- analyse als review-methode [De effectiviteit van acupunctuur]. Huisarts en Wetenschap 1989;32: 176-81.
- Nicolucci A, Grilli R, Alexanian A, Apolone G, Torri V, Liberati A. Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. JAMA 1989; 262:2101-7.
- Baker DW, Jones R, Hodges J, Massie BM, Konstam MA, Rose EA. Management of heart failure. III. The role of revascularization in the treatment of patients with moderate or severe left ventricular systolic dysfunction. JAMA 1994;272:1528-34.
- Coleridge Smith P. The management of chronic venous disorders of the leg: an evidence-based report of an International Task Force. Phlebology 1999;14:3-19.
Cited by
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationStang, A. (2010) · European Journal of Epidemiology · doi:10.1007/s10654-010-9491-z · Cited by 17,396
“concluded that with a few caveats (missing item for the appropriateness of the analysis, lack of information related to the reliability and validity), the NOS is “suitable for use in a systematic review” and is “easy to use” [3].”
BackgroundMethodInfluentialMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
“[305] [306] Bias jeopardises even RCTs, however, if investigators carry out such trials improperly.”
BackgroundSelf-citationGRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Metadata
- Authors
- Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D.
- Affiliations
- University of Oxford (GB)
- University of Southampton (GB)
- University of York (GB)
- University of Birmingham (GB)
- MRC/CSO Social and Public Health Sciences Unit (GB)
- Venue
- Health Technology Assessment
- Published
- 2003-09
- Volume
- 7
- Issue
- 27
- Pages
- iii-x, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W1981501248
- Semantic Scholar
- 3b3a2281d097cc0c60e93d42d570bd2dfadb6492
- Cited by
- 2,907
- References
- 332
- Citations by year
- 2026: 37 · 2025: 76 · 2024: 107 · 2023: 115 · 2022: 142 · 2021: 188 · 2020: 176 · 2019: 164 · 2018: 148 · 2017: 191 · 2016: 169 · 2015: 185 · 2014: 177 · 2013: 141 · 2012: 123
- FWCI
- 81.72
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Technology Assessment (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Funders
- Health Technology Assessment programme (96/26/99)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- bias in observational studies, internal validity, quality assessment tools, risk adjustment, residual confounding, propensity score methods, meta-epidemiology, treatment effect estimation, prognostic factors, selection bias, confounding, reporting bias, reporting quality, randomized controlled trials
- MeSH terms
- Clinical Trials as Topic, Diagnosis-Related Groups, Humans, Quality Control, Research Design, Reproducibility of Results, Bias, Selection Bias, Patient Selection, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.