The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Comparing two correlated C indices with right‐censored survival outcome: a one‐shot nonparametric approach
Open accessAbstract
The area under the receiver operating characteristic curve is often used as a summary index of the diagnostic ability in evaluating biomarkers when the clinical outcome (truth) is binary. When the clinical outcome is right‐censored survival time, the C index, motivated as an extension of area under the receiver operating characteristic curve, has been proposed by Harrell as a measure of concordance between a predictive biomarker and the right‐censored survival outcome. In this work, we investigate methods for statistical comparison of two diagnostic or predictive systems, of which they could either be two biomarkers or two fixed algorithms, in terms of their C indices. We adopt a U‐statistics‐based C estimator that is asymptotically normal and develop a nonparametric analytical approach to estimate the variance of the C estimator and the covariance of two C estimators. A z‐score test is then constructed to compare the two C indices. We validate our one‐shot nonparametric method via simulation studies in terms of the type I error rate and power. We also compare our one‐shot method with resampling methods including the jackknife and the bootstrap. Simulation results show that the proposed one‐shot method provides almost unbiased variance estimations and has satisfactory type I error control and power. Finally, we illustrate the use of the proposed method with an example from the Framingham Heart Study. Copyright © 2014 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Nishimura, R., Osako, T., Nishiyama, Y., Tashima, R., Nakano, M., Fujisue, M., Toyozumi, Y., & Arima, N. (2013) · Oncology · doi:10.1159/000353099 · Cited by 13,166
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Basic principles of ROC analysis
Metz, C. E. (1978) · Seminars in Nuclear Medicine · doi:10.1016/s0001-2998(78)80014-2 · Cited by 6,026
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Survival Analysis, Techniques for Censored and Truncated Data
Rao, M. B. (1998) · Technometrics · doi:10.1080/00401706.1998.10485206 · Cited by 3,617
Evaluating the Yield of Medical Tests
Harrell, F. E. (1982) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1982.03320430047030 · Cited by 3,490
Time‐Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker
Heagerty, P. J., Lumley, T., & Pepe, M. S. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00337.x · Cited by 2,854
The epidemiology of heart failure: The Framingham Study
Ho, K. K. L., Pinsky, J. L., Kannel, W. B., & Levy, D. (1993) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(93)90455-a · Cited by 2,247
The Statistical Evaluation of Medical Tests for Classification and Prediction
Pepe, M. S. (2003) · doi:10.1093/oso/9780198509844.001.0001 · Cited by 2,198
Epidemiological approaches to heart disease: the Framingham study
Dawber, T. R., Meadors, G. F., & Moore, F. E. (1951) · American Journal of Public Health and the Nations Health · doi:10.2105/ajph.41.3.279 · Cited by 2,148
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1948) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730196 · Cited by 1,928
Greiner, M., Pfeiffer, D., & Smith, R. D. (2000) · Preventive Veterinary Medicine · doi:10.1016/s0167-5877(00)00115-x · Cited by 1,923
The Statistical Evaluation of Medical Tests for Classification and Prediction
(2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,899
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_20 · Cited by 1,851
Regression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,798
Statistical Methods in Diagnostic Medicine
Zhou, X., Obuchowski, N. A., & McClish, D. K. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9780470906514 · Cited by 1,784
Uno, H., Cai, T., Pencina, M. J., D'Agostino, R. B., & Wei, L. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4154 · Cited by 1,535
Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models
Zou, K. H., O’Malley, A. J., & Mauri, L. (2007) · Circulation · doi:10.1161/circulationaha.105.594929 · Cited by 1,473
Survival Model Predictive Accuracy and ROC Curves
Heagerty, P. J., & Zheng, Y. (2005) · Biometrics · doi:10.1111/j.0006-341x.2005.030814.x · Cited by 1,464
Pencina, M. J., & D'Agostino, R. B. (2004) · Statistics in Medicine · doi:10.1002/sim.1802 · Cited by 1,444
Bamber, D. (1975) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(75)90001-2 · Cited by 1,439
(1982) · Cited by 1,288
An Introduction to Mathematical Statistics and its Applications.
Skarpness, B., Larsen, R. J., & Marx, M. L. (1983) · Journal of the American Statistical Association · doi:10.2307/2287143 · Cited by 1,149
Epidemiology of coronary heart disease: The Framingham study
Castelli, W. P. (1984) · The American Journal of Medicine · doi:10.1016/0002-9343(84)90952-5 · Cited by 1,046
Blood Pressure, Systolic and Diastolic, and Cardiovascular Risks: US Population Data
Stamler, J. (1993) · Archives of Internal Medicine · doi:10.1001/archinte.1993.00410050036006 · Cited by 1,015 · cited 1×
“that systolic blood pressure relates more strongly to all cardiovascular risk than diastolic blood pressure [48].”
BackgroundSystolic versus diastolic blood pressure and risk of coronary heart disease
Kannel, W. B., Gordon, T., & Schwartz, M. J. (1971) · The American Journal of Cardiology · doi:10.1016/0002-9149(71)90428-0 · Cited by 925
Dorfman, D. D., & Alf, E. (1969) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(69)90019-4 · Cited by 874
American Heart Association Call to Action: Obesity as a Major Risk Factor for Coronary Heart Disease
Eckel, R. H., & Krauss, R. M. (1998) · Circulation · doi:10.1161/01.cir.97.21.2099 · Cited by 805
Neaton, J. D. (1992) · Archives of Internal Medicine · doi:10.1001/archinte.1992.00400130082009 · Cited by 784
Klein, J. P., & Moeschberger, M. L. (1997) · Statistics for Biology and Health · doi:10.1007/978-1-4757-2728-9 · Cited by 685
Concordance probability and discriminatory power in proportional hazards regression
Gönen, M., & Heller, G. (2005) · Biometrika · doi:10.1093/biomet/92.4.965 · Cited by 673
Sobczyk, K., & Kirkner, D. J. (2001) · Modeling and Simulation in Science, Engineering and Technology · doi:10.1007/978-1-4612-0121-2_5 · Cited by 436
Kannel, W. B. (1976) · BMJ · doi:10.1136/bmj.2.6046.1255-a · Cited by 394
Murphy, J. M. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800180068011 · Cited by 367
Metz, C. E., Wang, P.-L., & Kronman, H. B. (1984) · Information Processing in Medical Imaging · doi:10.1007/978-94-009-6045-9_25 · Cited by 356
Estimation of time‐dependent area under the ROC curve for long‐term risk prediction
Chambless, L. E., & Diao, G. (2006) · Statistics in Medicine · doi:10.1002/sim.2299 · Cited by 311
Misuse of DeLong test to compare AUCs for nested models
Demler, O. V., Pencina, M. J., & D'Agostino, R. B. (2012) · Statistics in Medicine · doi:10.1002/sim.5328 · Cited by 306
Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests
Zou, K. H., Hall, W. J., & Shapiro, D. E. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971015)16:19<2143::aid-sim655>3.0.co;2-3 · Cited by 274
EXPLAINED VARIATION IN SURVIVAL ANALYSIS
SCHEMPER, M., & Stare, J. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961015)15:19<1999::aid-sim353>3.0.co;2-d · Cited by 220
Survival Analysis: State of the Art.
Powell, S. J., Klein, J. P., & Goel, P. K. (1994) · The Statistician · doi:10.2307/2348153 · Cited by 208
Survival Analysis: State of the Art
(1992) · Springer eBooks · doi:10.1007/978-94-015-7983-4 · Cited by 206
One statistical test is sufficient for assessing new predictive markers
Vickers, A. J., Cronin, A. M., & Begg, C. B. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-13 · Cited by 198
Measures of explained variation for survival data
Korn, E. L., & Simon, R. M. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090503 · Cited by 194
On Some Convergence Properties of UStatistics
Sen, P. K. (1960) · Calcutta Statistical Association Bulletin · doi:10.1177/0008068319600101 · Cited by 184
An ROC-type measure of diagnostic accuracy when the gold standard is continuous-scale
Obuchowski, N. A. (2005) · Statistics in Medicine · doi:10.1002/sim.2228 · Cited by 122
Spatio-temporal interaction with disease mapping
Sun, D., Tsutakawa, R. K., Kim, H., & He, Z. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20000815)19:15<1997::aid-sim511>3.0.co;2-c · Cited by 115
Quantifying discrimination of Framingham risk functions with different survival C statistics
Pencina, M. J., D’Agostino, R. B., & Song, L. (2012) · Statistics in Medicine · doi:10.1002/sim.4508 · Cited by 97
The Concordance Index C and the Mann–Whitney Parameter Pr(X>Y) with Randomly Censored Data
Koziol, J. A., & Jia, Z. (2009) · Biometrical Journal · doi:10.1002/bimj.200800228 · Cited by 88
Elements of Nonparametric Statistics.
Buckland, W. R., & Noether, G. E. (1967) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2987095 · Cited by 79
Elements of Nonparametric Statistics.
Yen, E. H., & Noether, G. E. (1968) · Journal of the American Statistical Association · doi:10.2307/2284048 · Cited by 79
The sensitivity and specificity of markers for event times
Cai, T., PEPE, M. S., Zheng, Y., Lumley, T., & Jenny, N. S. (2005) · Biostatistics · doi:10.1093/biostatistics/kxi047 · Cited by 75
Inference on Correlated Discrimination Measures in Survival Analysis: A Nonparametric Approach
Antolini, L., Nam, B., & D’Agostino, R. B. (2004) · Communication in Statistics- Theory and Methods · doi:10.1081/sta-200026579 · Cited by 69
Predictive Measures of Ordinal Association
Kim, J.-O. (1971) · American Journal of Sociology · doi:10.1086/225004 · Cited by 58
Discrimination Index, the Area Under the ROC Curve
Nam, B., & D’Agostino, R. B. (2002) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4612-0103-8_20 · Cited by 46
Vexler, A., Liu, A., Eliseeva, E., & Schisterman, E. F. (2007) · Biometrics · doi:10.1111/j.1541-0420.2007.00941.x · Cited by 46
Problems and prediction in survival‐data analysis
Henderson, R. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140208 · Cited by 40
On the assessment of the added value of new predictive biomarkers
Chen, W., Samuelson, F. W., Gallas, B. D., Kang, L., Sahiner, B., & Petrick, N. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-98 · Cited by 32
Self-citation
Cited by
Li, B., Cui, Y., Diehn, M., & Li, R. (2017) · JAMA Oncology · doi:10.1001/jamaoncol.2017.1609 · Cited by 514
Boursier, J., Hagström, H., Ekstedt, M., Moreau, C., Bonacci, M., Cure, S., Ampuero, J., Nasr, P., Tallab, L., Canivet, C. M., et al. (2022) · Journal of Hepatology · doi:10.1016/j.jhep.2021.12.031 · Cited by 206
Corpechot, C., Carrat, F., Gaouar, F., Chau, F., Hirschfield, G., Gulamhusein, A., Montano-Loza, A. J., Lytvyak, E., Schramm, C., Pares, A., et al. (2022) · Journal of Hepatology · doi:10.1016/j.jhep.2022.06.017 · Cited by 128
Lu, L., Dercle, L., Zhao, B., & Schwartz, L. H. (2021) · Nature Communications · doi:10.1038/s41467-021-26990-6 · Cited by 104
Artificial Intelligence–Enabled Prediction of Heart Failure Risk From Single-Lead Electrocardiograms
Dhingra, L. S., Aminorroaya, A., Pedroso, A. F., Khunte, A., Sangha, V., McIntyre, D., Chow, C. K., Asselbergs, F. W., Brant, L. C. C., Barreto, S. M., et al. (2025) · JAMA Cardiology · doi:10.1001/jamacardio.2025.0492 · Cited by 65
Metadata
- Authors
- Kang, L., Chen, W., Petrick, N. A., & Gallas, B. D.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2014-11-17
- Volume
- 34
- Issue
- 4
- Pages
- 685-703
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2142457016
- Cited by
- 420
- References
- 62
- FWCI
- 9.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.