The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Comparing apples and oranges
Open accessAbstract
M itral valve repair versus replacement, internal thoracic artery versus saphenous vein graft conduits for coronary bypass, effect of chronic preoperative atrial fibrillation on outcome, gastric versus colon esophageal substitutes, complete versus incomplete off-pump revascularization, surgery in highversus low-volume centers, balloon versus surgical aortic valvotomy. These are but a sample of studies of comparative outcome whose basis was clinical experience rather than a formal clinical trial. Often, a cursory glance at patient characteristics in each group reveals important differences that lead medical and statistical reviewers and readers alike to scoff, “They’re comparing ‘apples and oranges!’” What does it take to convince the skeptic that the difference in outcome attributed to difference in treatment (or patient condition) is real? The answer to this question is not academic; it can affect the way we as physicians learn to treat our patients from studies of clinical experience. When comparison is made in the context of a properly designed, appropriate, ethical, feasible, well-analyzed, generalizable randomized trial, most of us would accept a cause-and-effect linkage between treatment and difference in outcome. In contrast, when the comparison emanates from studies of clinical experience—ubiquitous in surgical experience and reporting—cause-and-effect attribution is considered “speculative” at best. For 3 decades, multivariable risk factor analysis has been the mainstay for identifying and quantifying treatment outcome differences adjusted for patient characteristics. However, Kirklin and Barratt-Boyes1 recommended that these differences be treated as associations with outcomes, not causes. There is no guarantee that risk factor analysis is an effective strategy for discovery of cause-and-effect mechanisms.2,3 During the 1980s, federal support for complex clinical trials in heart disease was abundant. Few of us noticed important advances being made in statistical methods for valid, nonrandomized comparisons. An example of the advances was the seminal 1983 Biometrika article by Paul Rosenbaum at the University of Wisconsin, Madison, and Donald Rubin at the University of Chicago, “The Central Role of the Propensity Score in Observational Studies for Causal Effects.”4 In the 1990s, as the funding climate changed, interest in methods for making nonrandomized comparisons accelerated.5-10 Recently, these methods have been recommended by statistical reviewers for comparative clinical studies and have been adopted by some clinical research groups. The result has been the introduction into our literature of unfamiliar methods with their unfamiliar terminology. Rather than being relieved that at last applesto-apples comparisons can be made with rigor, medical and sometimes statistical reviewers, as well as readers, have become bewildered! From the Departments of Thoracic and Cardiovascular Surgery and Biostatistics and Epidemiology, The Cleveland Clinic Foundation, Cleveland, Ohio.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
The Effectiveness of Right Heart Catheterization in the Initial Care of Critically III Patients
Connors, A. F. (1996) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1996.03540110043030 · Cited by 2,210
Invited Commentary: Propensity Scores
Joffe, M. M., & Rosenbaum, P. R. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010011 · Cited by 1,048
Two internal thoracic artery grafts are better than one
Lytle, B. W., Blackstone, E. H., Loop, F. D., Houghtaling, P. L., Arnold, J. H., Akhrass, R., McCarthy, P. M., & Cosgrove, D. M. (1999) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/s0022-5223(99)70365-x · Cited by 920
Self-citationClinical Trials : A Methodologic Perspective
Piantadosi, S. (1997) · Cited by 803
Reducing bias in a propensity score matched-pair sample using greedy matching techniques
Parsons, L. (2001) · Medical Entomology and Zoology · Cited by 733
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721
Optimal Matching for Observational Studies
Rosenbaum, P. R. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478868 · Cited by 715
Bias Reduction Using Mahalanobis-Metric Matching
Rubin, D. B. (1980) · Biometrics · doi:10.2307/2529981 · Cited by 530
The Bias Due to Incomplete Matching
Rosenbaum, P. R., & Rubin, D. B. (1985) · Biometrics · doi:10.2307/2530647 · Cited by 518
The Bias Due to Incomplete Matching
Rosenbaum, P. R. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.020 · Cited by 422
Mark, D. B., Nelson, C. L., Califf, R. M., Harrell, F. E., Lee, K. L., Jones, R. H., Fortin, D. F., Stack, R. S., Glower, D. D., & Smith, L. R. (1994) · Circulation · doi:10.1161/01.cir.89.5.2015 · Cited by 421
Estimating Exposure Effects by Modelling the Expectation of Exposure Conditional on Confounders
Robins, J. M., Mark, S. D., & Newey, W. K. (1992) · Biometrics · doi:10.2307/2532304 · Cited by 391
Effects of Misspecification of the Propensity Score on Estimators of Treatment Effect
Drake, C. (1993) · Biometrics · doi:10.2307/2532266 · Cited by 347
Survival and Functional Status after Resection of Recurrent Glioblastoma Multiforme
Barker, F. G., Chang, S. M., Gutin, P. H., Malec, M. K., McDermott, M. W., Prados, M. D., & Wilson, C. B. (1998) · Neurosurgery · doi:10.1097/00006123-199804000-00013 · Cited by 330
Estimating and Using Propensity Scores with Partially Missing Data
D'Agostino, R. B., & Rubin, D. B. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474263 · Cited by 300
Rosenbaum, P. R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477060 · Cited by 279
Why I Prefer Logits to Probits
Berkson, J. (1951) · Biometrics · doi:10.2307/3001655 · Cited by 218
Heckman, J. J., Ichimura, H., Smith, J., & Todd, P. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.23.13416 · Cited by 189
Shroyer, A. L. W., Grover, F. L., & Edwards, F. H. (1998) · The Annals of Thoracic Surgery · doi:10.1016/s0003-4975(98)00025-3 · Cited by 174
Nakamura, Y., Moss, A. J., Brown, M. W., Kinoshita, M., & Kawai, C. (1999) · American Heart Journal · doi:10.1016/s0002-8703(99)70163-8 · Cited by 165
Auerbach, A. D., Hamel, M. B., Davis, R. B., Connors, A. F., Regueiro, C. R., Desbiens, N. A., Goldman, L., Califf, R. M., Dawson, N. V., Wenger, N. S., et al. (2000) · Annals of Internal Medicine · doi:10.7326/0003-4819-132-3-200002010-00004 · Cited by 124
Polytomous logistic regression
Engel, J. (1988) · Statistica Neerlandica · doi:10.1111/j.1467-9574.1988.tb01238.x · Cited by 120
Shroyer, A. L., Plomondon, M. E., Grover, F. L., & Edwards, F. H. (1999) · The Annals of Thoracic Surgery · doi:10.1016/s0003-4975(99)00206-4 · Cited by 116
Cook, E. F., & Goldman, L. (1989) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(89)90036-x · Cited by 114
Prognostic Models and the Propensity Score
Drake, C., & Fisher, L. D. (1995) · International Journal of Epidemiology · doi:10.1093/ije/24.1.183 · Cited by 109
Stone, R. A., Obrosky, D. S., Singer, D. E., Kapoor, W. N., & Fine, M. J. (1995) · Medical Care · Cited by 73
Legorreta, A. P., Leung, K., Berkbigler, D., et al. (2000) · Annals of Allergy Asthma & Immunology · doi:10.1016/s1081-1206(10)62430-1 · Cited by 67
Cook, E. F., & Goldman, L. (1988) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114838 · Cited by 49
D’Agostino (1998) · doi:10.1002/(sici)1097-0258(19981015)17:19<2265::aid-sim918>3.0.co;2-b
Cited by
Tricuspid valve repair: durability and risk factors for failure
McCarthy, P. M., Bhudia, S. K., Rajeswaran, J., Hoercher, K. J., Lytle, B. W., Cosgrove, D. M., & Blackstone, E. H. (2004) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2003.11.019 · Cited by 731
Self-citationStatistical primer: propensity score matching and its alternatives
Benedetto, U., Head, S. J., Angelini, G. D., & Blackstone, E. H. (2018) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezy167 · Cited by 695
Self-citationRecurrent mitral regurgitation after annuloplasty for functional ischemic mitral regurgitation
McGee, E. C., Gillinov, A. M., Blackstone, E. H., Rajeswaran, J., Cohen, G., Najam, F., Shiota, T., Sabik, J. F., Lytle, B. W., McCarthy, P. M., et al. (2004) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2004.07.037 · Cited by 617
Self-citationAustin, P. C. (2007) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2007.07.021 · Cited by 589
Mihaljevic, T., Lam, B.-K., Rajeswaran, J., Takagaki, M., Lauer, M. S., Gillinov, A. M., Blackstone, E. H., & Lytle, B. W. (2007) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.02.043 · Cited by 475
Self-citation
Metadata
- Authors
- Blackstone, E. H.
- Venue
- The Journal of Thoracic and Cardiovascular Surgery
- Publisher
- Elsevier BV
- Published
- 2002-01
- Volume
- 123
- Issue
- 1
- Pages
- 8-15
- ISSN
- 0022-5223 (ISSN-L)
- OpenAlex
- W2169132724
- Cited by
- 599
- References
- 34
- FWCI
- 32.06
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.