The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Novel metrics for evaluating improvement in discrimination: net reclassification and integrated discrimination improvement for normal variables and nested models
Open accessAbstract
Net reclassification and integrated discrimination improvements have been proposed as alternatives to the increase in the area under the curve for evaluating improvement in the performance of risk assessment algorithms introduced by the addition of new phenotypic or genetic markers. In this paper, we demonstrate that in the setting of linear discriminant analysis, under the assumptions of multivariate normality, all three measures can be presented as functions of the squared Mahalanobis distance. This relationship affords an interpretation of the magnitude of these measures in the familiar language of effect size for uncorrelated variables. Furthermore, it allows us to conclude that net reclassification improvement can be viewed as a universal measure of effect size. Our theoretical developments are illustrated with an example based on the Framingham Heart Study risk assessment model for high‐risk men in primary prevention of cardiovascular disease. Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
An Analysis of Transformations
Box, G. E. P., & Cox, D. R. (1964) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1964.tb00553.x · Cited by 15,052
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Self-citationPencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493
Self-citationDecision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341
On the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers
Pencina, M. J., D'Agostino, R. B., & Steyerberg, E. W. (2011) · Statistics in Medicine · doi:10.1002/sim.4085 · Cited by 2,453
Self-citationMultivariate Statistical Methods.
Clarke, G. M., & Morrison, D. F. (1977) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344930 · Cited by 2,165
Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction
Cook, N. R. (2007) · Circulation · doi:10.1161/circulationaha.106.672402 · Cited by 2,112
Estimation of the probability of an event as a function of several independent variables
WALKER, S. H., & DUNCAN, D. B. (1967) · Biometrika · doi:10.1093/biomet/54.1-2.167 · Cited by 1,682
Uno, H., Cai, T., Pencina, M. J., D'Agostino, R. B., & Wei, L. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4154 · Cited by 1,535
Self-citationSurvival Model Predictive Accuracy and ROC Curves
Heagerty, P. J., & Zheng, Y. (2005) · Biometrics · doi:10.1111/j.0006-341x.2005.030814.x · Cited by 1,464
Pencina, M. J., & D'Agostino, R. B. (2004) · Statistics in Medicine · doi:10.1002/sim.1802 · Cited by 1,444
Self-citationPepe, M. S. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh101 · Cited by 1,276
Tjur, T. (2009) · The American Statistician · doi:10.1198/tast.2009.08210 · Cited by 911
The Limitations of Risk Factors as Prognostic Tools
Ware, J. H. (2006) · New England Journal of Medicine · doi:10.1056/nejmp068249 · Cited by 466
External correspondence: Decompositions of the mean probability score
Yates, J. F. (1982) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(82)90237-9 · Cited by 428
Estimation of time‐dependent area under the ROC curve for long‐term risk prediction
Chambless, L. E., & Diao, G. (2006) · Statistics in Medicine · doi:10.1002/sim.2299 · Cited by 311
Linear Combinations of Multiple Diagnostic Markers
Su, J. Q., & Liu, J. S. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476417 · Cited by 278
Assessment of Claims of Improved Prediction Beyond the Framingham Risk Score
Tzoulaki, I. (2009) · JAMA · doi:10.1001/jama.2009.1757 · Cited by 276
Assessing the Value of Risk Predictions by Using Risk Stratification Tables
Janes, H., Pepe, M. S., & Gu, W. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-10-200811180-00009 · Cited by 249
Several methods to assess improvement in risk prediction models: Extension to survival analysis
Chambless, L. E., Cummiskey, C. P., & Cui, G. (2011) · Statistics in Medicine · doi:10.1002/sim.4026 · Cited by 194
Using Relative Utility Curves to Evaluate Risk Prediction
Baker, S. G., Cook, N. R., Vickers, A., & Kramer, B. S. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00592.x · Cited by 142
Evaluating diagnostic tests: The area under the ROC curve and the balance of errors
Hand, D. J. (2010) · Statistics in Medicine · doi:10.1002/sim.3859 · Cited by 133
Value of Adding Single-Nucleotide Polymorphism Genotypes to a Breast Cancer Risk Model
Gail, M. H. (2009) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djp130 · Cited by 131
Comments on ‘Integrated discrimination and net reclassification improvements—Practical advice’
Pencina, M. J., D’Agostino, R. B., D’Agostino, R. B., & Vasan, R. S. (2007) · Statistics in Medicine · doi:10.1002/sim.3106 · Cited by 112
Self-citationPepe, M. S., Feng, Z., & Gu, J. W. (2007) · Statistics in Medicine · doi:10.1002/sim.2991 · Cited by 107
(2007) · SAGE Publications India Pvt Ltd eBooks · doi:10.4135/9789351507741.n6 · Cited by 88
Properties ofR2 statistics for logistic regression
Hu, B., Palta, M., & Shao, J. (2005) · Statistics in Medicine · doi:10.1002/sim.2300 · Cited by 61
Demler, O., Pencina, M. J., & D’Agostino, R. B. (2011) · Statistics in Medicine · doi:10.1002/sim.4196 · Cited by 36
Self-citationC-reactive protein and cardiovascular risk: more fuel to the fire
Boekholdt, S. M., & Kastelein, J. J. P. (2009) · The Lancet · doi:10.1016/s0140-6736(09)62098-5 · Cited by 26
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
(1950) · doi:10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3
Cited by
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Biomarker definitions and their applications
Califf, R. M. (2018) · Experimental Biology and Medicine · doi:10.1177/1535370217750088 · Cited by 1,528
Leening, M. J. G., Vedder, M. M., Witteman, J. C. M., Pencina, M. J., & Steyerberg, E. W. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1522 · Cited by 594
Self-citationBendapudi, P. K., Hurwitz, S., Fry, A., Marques, M. B., Waldo, S. W., Li, A., Sun, L., Upadhyay, V., Hamdan, A., Brunner, A. M., et al. (2017) · The Lancet Haematology · doi:10.1016/s2352-3026(17)30026-1 · Cited by 561
Ohkuma, T., Ninomiya, T., Tomiyama, H., Kario, K., Hoshide, S., Kita, Y., Inoguchi, T., Maeda, Y., Kohara, K., Tabara, Y., et al. (2017) · Hypertension · doi:10.1161/hypertensionaha.117.09097 · Cited by 541
Metadata
- Authors
- Pencina, M. J., D'Agostino, R. B., & Demler, O. V.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2011-12-07
- Volume
- 31
- Issue
- 2
- Pages
- 101-113
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W1990479835
- Cited by
- 349
- References
- 37
- FWCI
- 16.41
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.