A simulation study of predictive ability measures in a survival model I: Explained variation measures
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Measures of predictive ability play an important role in quantifying the clinical significance of prognostic factors. Several measures have been proposed to evaluate the predictive ability of survival models in the last two decades, but no single measure is consistently used. The proposed measures can be classified into the following categories: explained variation, explained randomness, and predictive accuracy. The three categories are conceptually different and are based on different principles. Several new measures have been proposed since Schemper and Stare's study in 1996 on some of the existing measures. This paper is the first of two papers that study the proposed measures systematically by applying a set of criteria that a measure of predictive ability should possess in the context of survival analysis. The present paper focuses on the explained variation category, and part II studies the proposed measures in the other categories. Simulation studies are used to examine the performance of five explained variation measures with respect to these criteria, discussing their strengths and shortcomings. Our simulation studies show that the measures proposed by Kent and O'Quigley, R, and Royston and Sauerbrei, R, appear to be the best overall at quantifying predictive ability. However, it should be noted that neither measure is perfect; R is sensitive to outliers and R to (marked) non‐normality of the distribution of the prognostic index. The results show that the other measures perform poorly, primarily because they are adversely affected by censoring. Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A note on a general definition of the coefficient of determination
NAGELKERKE, N. J. D. (1991) · Biometrika · doi:10.1093/biomet/78.3.691 · Cited by 5,927
Partial residuals for the proportional hazards regression model
SCHOENFELD, D. (1982) · Biometrika · doi:10.1093/biomet/69.1.239 · Cited by 3,111
A new measure of prognostic separation in survival data
Royston, P., & Sauerbrei, W. (2004) · Statistics in Medicine · doi:10.1002/sim.1621 · Cited by 450 · cited 9×
“The graphs show that the measure proposed by Royston and Sauerbrei [7], R(2)D , is resistant to the extreme and outlier observation in the data since its mean remains approximately constant.”
BackgroundMethodResultInfluentialSelf-citation
Cited by
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
R-squared for Bayesian Regression Models
Gelman, A., Goodrich, B., Gabry, J., & Vehtari, A. (2019) · The American Statistician · doi:10.1080/00031305.2018.1549100 · Cited by 912
External validation of a Cox prognostic model: principles and methods
Royston, P., & Altman, D. G. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-33 · Cited by 911
Self-citationCollins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665
“We examined two R(2)-type measures [40,41] (explained variation [32] and explained randomness”
MethodHawker, G. A., Croxford, R., Bierman, A. S., Harvey, P. J., Ravi, B., Stanaitis, I., & Lipscombe, L. L. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091286 · Cited by 260
Van Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112
Austin, P. C., Pencinca, M. J., & Steyerberg, E. W. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280214567141 · Cited by 39
“that the measure of predictive accuracy takes on higher values as the magnitude of the effect of a covariate on the outcome increases), (iii) interpretability, and (iv) robustness against influential observations.(5) Based on these criteria, Choodari-Oskooei et al.”
BackgroundJinks, R. C., Royston, P., & Parmar, M. K. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0078-y · Cited by 32
Self-citationCovariate‐adjusted measures of discrimination for survival data
White, I. R., Rapsomaniki, E., & for the Emerging Risk Factors Collaboration (2015) · Biometrical Journal · doi:10.1002/bimj.201400061 · Cited by 13
“For a survival outcome, many measures of prognostic ability have been proposed (Choodari-Oskooei et al., 2012a, 2012b).”
BackgroundJob market polarization and American poverty
Siddique, A. B. (2023) · Journal for Labour Market Research · doi:10.1186/s12651-023-00356-5 · Cited by 9
Quantifying predictive accuracy in survival models
Lirette, S. T., & Aban, I. (2017) · Journal of Nuclear Cardiology · doi:10.1007/s12350-015-0296-z · Cited by 8
Metadata
- Authors
- Choodari‐Oskooei, B., Royston, P., & Parmar, M. K. B.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2011-04-26
- Volume
- 31
- Issue
- 23
- Pages
- 2627-2643
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2144484686
- Cited by
- 89
- References
- 3
- FWCI
- 4.45
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.