The DOI matches its Crossref record; 140 of the 141 references it cites were found in a registry or an index.
Net Reclassification Improvement: Computation, Interpretation, and Controversies: A Literature Review and Clinician's Guide
Open accessAbstract
The net reclassification improvement (NRI) is an increasingly popular measure for evaluating improvements in risk predictions. This article details a review of 67 publications in high-impact general clinical journals that considered the NRI. Incomplete reporting of NRI methods, incorrect calculation, and common misinterpretations were found. To aid improved applications of the NRI, the article elaborates on several aspects of the computation and interpretation in various settings. Limitations and controversies are discussed, including the effect of miscalibration of prediction models, the use of the continuous NRI and “clinical NRI,” and the relation with decision analytic measures. A systematic approach toward presenting NRI analysis is proposed: Detail and motivate the methods used for computation of the NRI, use clinically meaningful risk cutoffs for the category-based NRI, report both NRI components, address issues of calibration, and do not interpret the overall NRI as a percentage of the study population reclassified. Promising NRI findings need to be followed with decision analytic or formal cost-effectiveness evaluations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Dedicated measures, such as the widely used but improper net reclassification improvement, are available for evaluating competing models.”
From Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance (2025) · cites this paper as [119]
Citations
Cites
Grundy, S. M., Bilheimer, D. W., Chait, A., Clark, L. T., Denke, M. A., Havel, R. J., Hazzard, W. R., Hulley, S. B., Hunninghake, D. B., Kreisberg, R. A., et al. (1993) · JAMA · doi:10.1001/jama.269.23.3015 · Cited by 27,944
Expert Panel on Detection, E. (2001) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.285.19.2486 · Cited by 26,011
Detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III)
Grundy, S. M., Becker, D. M., Clark, L. T., Cooper, R., Denke, M. A., Howard, J. L., Hunninghake, D. B., Illingworth, D. R., Luepker, R. V., McBride, P. E., et al. (2002) · Civil War Book Review · Cited by 12,198
European Guidelines on cardiovascular disease prevention in clinical practice (version 2012)
Authors/Task Force Members:, Perk, J., De Backer, G., Gohlke, H., Graham, I., Reiner, Ž., Verschuren, M., Albus, C., Benlian, P., Boysen, G., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs092 · Cited by 8,490
Roffi, M., Patrono, C., Collet, J.-P., Mueller, C., Valgimigli, M., Andreotti, F., Bax, J. J., Borger, M. A., Brotons, C., Chew, D. P., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehv320 · Cited by 8,261
Pencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493
Self-citationDecision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341
Kearon (2012) · doi:10.1378/chest.11-2301 · Cited by 6,119
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Self-citation
Flagged first, then by citations
1 of the 141 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Di Angelantonio E, 2012, JAMA, 307, 2499
- Melander O, 2009, JAMA, 302, 2090
- Greenland P, 2010, Circulation, 122, 584
- Hilden J, 2013, Stat Med
Cited by
Sorted by citations
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationTraumatic brain injury: integrated approaches to improve prevention, clinical care, and research
Maas, A. I. R., Menon, D. K., Adelson, P. D., Andelic, N., Bell, M. J., Belli, A., Bragge, P., Brazinova, A., Büki, A., Chesnut, R. M., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30371-x · Cited by 2,609
Self-citationTowards better clinical prediction models: seven steps for development and an ABCD for validation
Steyerberg, E. W., & Vergouwe, Y. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu207 · Cited by 1,928
Self-citationLi, X. S., Obeid, S., Klingenberg, R., Gencer, B., Mach, F., Räber, L., Windecker, S., Rodondi, N., Nanchen, D., Muller, O., et al. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehw582 · Cited by 479
Lammers, W. J., Hirschfield, G. M., Corpechot, C., Nevens, F., Lindor, K. D., Janssen, H. L. A., Floreani, A., Ponsioen, C. Y., Mayo, M. J., Invernizzi, P., et al. (2015) · Gastroenterology · doi:10.1053/j.gastro.2015.07.061 · Cited by 441
Clinical Features Predicting Mortality Risk in Patients With Viral Pneumonia: The MuLBSTA Score
Guo, L., Wei, D., Zhang, X., Wu, Y., Li, Q. Y., Zhou, M., & Qu, J. (2019) · Frontiers in Microbiology · doi:10.3389/fmicb.2019.02752 · Cited by 412
Principles and methods for transferring polygenic risk scores across global populations
Kachuri, L., Chatterjee, N., Hirbo, J. B., Schaid, D. J., Martin, I. K., Kullo, I. J., Kenny, E. E., Paşaniuc, B., Auer, P. L., Conomos, M. P., et al. (2023) · Nature Reviews Genetics · doi:10.1038/s41576-023-00637-2 · Cited by 366
Reddy, Y. N. V., Obokata, M., Egbe, A. C., Yang, J. H., Pislaru, S. V., Lin, G., Carter, R. E., & Borlaug, B. A. (2019) · European Journal of Heart Failure · doi:10.1002/ejhf.1464 · Cited by 323
In-depth mining of clinical data: the construction of clinical prediction model with R
Zhou, Z., Wang, W., Li, Y., Jin, K., Wang, X., Wang, Z., Chen, Y.-S., Wang, S.-J., Hu, J., Zhang, H., et al. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2019.08.63 · Cited by 300
An algorithm based on deep learning for predicting in-hospital cardiac arrest
Kwon, J., Lee, Y., Lee, Y., Lee, S., & Park, J. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.008678 · Cited by 299
Large-scale Metabolomic Profiling Identifies Novel Biomarkers for Incident Coronary Heart Disease
Ganna, A., Salihović, S., Sundström, J., Broeckling, C. D., Hedman, Å. K., Magnusson, P. K. E., Pedersen, N. L., Larsson, A. O., Siegbahn, A. G., Zilmer, M., et al. (2014) · PLoS Genetics · doi:10.1371/journal.pgen.1004801 · Cited by 287
Troponin I and cardiovascular risk prediction in the general population: the BiomarCaRE consortium
Blankenberg, S., Salomaa, V. V., Makarova, N., Ojeda, F., Wild, P. S., Lackner, K. J., Jørgensen, T., Thorand, B., Peters, A., Nauck, M. A., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw172 · Cited by 274
Cystatin C as a biomarker for estimating glomerular filtration rate
Ferguson, T. W., Komenda, P. V. J., & Tangri, N. (2015) · Current Opinion in Nephrology & Hypertension · doi:10.1097/mnh.0000000000000115 · Cited by 276
Cowley, L., Farewell, D. M., Maguire, S., & Kemp, A. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0060-y · Cited by 266
Multicenter Development and Validation of a Risk Stratification Tool for Ward Patients
Churpek, M. M., Yuen, T. C., Winslow, C. J., Robicsek, A. A., Meltzer, D. O., Gibbons, R. D., & Edelson, D. P. (2014) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201406-1022oc · Cited by 263
He, L., Huang, Y., Ma, Z., Liang, C., Liang, C., & Liu, Z. (2016) · Scientific Reports · doi:10.1038/srep34921 · Cited by 253
Binuya, M. A. E., Engelhardt, E. G., Schats, W., Schmidt, M. K., & Steyerberg, E. W. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01801-8 · Cited by 246
Self-citationWaldeyer, C., Makarova, N., Zeller, T., Schnabel, R. B., Brunner, F. J., Jørgensen, T., Linneberg, A. R., Niiranen, T., Salomaa, V. V., Jousilahti, P., et al. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehx166 · Cited by 244
Coronary Functional Abnormalities in Patients With Angina and Nonobstructive Coronary Artery Disease
Suda, A., TAKAHASHI, J. C., Hao, K., Kikuchi, Y., Shindo, T., Ikeda, S., Sato, K., Sugisawa, J., Matsumoto, Y., Miyata, S., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.08.1056 · Cited by 223
Al‐Zaiti, S. S., Besomi, L., Bouzid, Z., Faramand, Z., Frisch, S. O., Martin‐Gill, C., Gregg, R. E., Saba, S., Callaway, C. W., & Sejdić, E. (2020) · Nature Communications · doi:10.1038/s41467-020-17804-2 · Cited by 198
Quantifying the added value of new biomarkers: how and how not
Cook, N. R. (2018) · Diagnostic and Prognostic Research · doi:10.1186/s41512-018-0037-2 · Cited by 198
Carotid Plaque Characteristics Predict Recurrent Ischemic Stroke and TIA
van Dam-Nolen, D. H. K., Truijman, M. T. B., van der Kolk, A. G., Liem, M. I., Schreuder, F. H. B. M., Boersma, E. H., Daemen, M. J. A. P., Mess, W. H., van Oostenbrugge, R. J., van der Steen, A. F. W., et al. (2022) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2022.04.003 · Cited by 193
Newman, C. B., Blaha, M. J., Boord, J. B., Cariou, B., Chait, A., Fein, H. G., Ginsberg, H. N., Goldberg, I. J., Murad, M. H., Subramanian, S., et al. (2020) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa674 · Cited by 182
Risk prediction models for contrast induced nephropathy: systematic review
Silver, S. A., Shah, P. S., Chertow, G. M., Harel, S., Wald, R., & Harel, Z. (2015) · BMJ · doi:10.1136/bmj.h4395 · Cited by 179
Comparison of Methods for Improving Fracture Risk Assessment in Diabetes: The Manitoba BMD Registry
Leslie, W. D., Johansson, H., McCloskey, E. V., Harvey, N. C., Kanis, J. А., & Hans, D. B. (2018) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3538 · Cited by 178
Oussalah, A., Rischer, S., Bensenane, M., Conroy, G., Filhine-Trésarrieu, P., Debard, R., Tramoy, D., Josse, T., Reinicke, D., Garcia, M., et al. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2018.03.029 · Cited by 167
Han, K., Song, K., & Choi, B. W. (2016) · Korean Journal of Radiology · doi:10.3348/kjr.2016.17.3.339 · Cited by 161
Polygenic risk scores in cardiovascular risk prediction: A cohort study and modelling analyses
Sun, L., Pennells, L. A. M., Kaptoge, S. K., Nelson, C. P., Abraham, G., Arnold, M., Bell, S., Bolton, T., Burgess, S., Dudbridge, F., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003498 · Cited by 172
Belard, A., Buchman, T. G., Forsberg, J. A., Potter, B. K., Dente, C. J., Kirk, A. D., & Elster, E. A. (2016) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-016-9849-1 · Cited by 166
Jiang, G., Luk, A. O. Y., Tam, C. H. T., Xie, F., Carstensen, B., Lau, E. S. H., Lim, C. K. P., Lee, H. M., Ng, A. C. W., Ng, M. C. Y., et al. (2019) · Kidney International · doi:10.1016/j.kint.2018.08.026 · Cited by 159
Sharma, N., Schwendimann, R., Endrich, O., Ausserhofer, D., & Simon, M. (2021) · BMC Health Services Research · doi:10.1186/s12913-020-05999-5 · Cited by 166
Wihersaari, L., Ashton, N. J., Reinikainen, M., Jakkula, P., Pettilä, V., Hästbacka, J., Tiainen, M., Loisa, P., Friberg, H., Cronberg, T., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06218-9 · Cited by 148
Liu, D., Liu, F., Xie, X., Su, L., Liu, M., Xie, X., Kuang, M., Huang, G., Wang, Y., Zhou, H., et al. (2020) · European Radiology · doi:10.1007/s00330-019-06553-6 · Cited by 145
Chen, M., Zhang, Q. H., Zhang, C., Zhao, X., Marra, G., Gao, J., Lv, X., Zhang, B., Fu, Y. S., Wang, F., et al. (2018) · Journal of Nuclear Medicine · doi:10.2967/jnumed.118.221010 · Cited by 124
Validation of a Machine Learning Algorithm to Predict 180-Day Mortality for Outpatients With Cancer
Manz, C. R., Chen, J., Liu, M., Chivers, C., Regli, S. H., Braun, J., Draugelis, M. E., Hanson, C. W., Shulman, L. N., Schuchter, L. M., et al. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2020.4331 · Cited by 116
Aliberti, M. J. R., Cenzer, I. S., Smith, A. K., Lee, S. J., Yaffe, K. S., & Covinsky, K. E. (2018) · Journal of the American Geriatrics Society · doi:10.1111/jgs.15683 · Cited by 117
Bos, D., Leening, M. J. G., Kavousi, M., Albert Hofman, D., Franco, O. H., van der Lugt, A., Vernooij, M. W., & Ikram, M. A. (2015) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.115.003843 · Cited by 115
Self-citationSegar, M. W., Hall, J. L., Jhund, P., Powell-Wiley, T., Morris, A., Kao, D. P., Fonarow, G., Hernandez, R., Ibrahim, N. E., Rutan, C., et al. (2022) · JAMA cardiology · doi:10.1001/jamacardio.2022.1900 · Cited by 109
Van Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112
Self-citationCawthon, P. M., Blackwell, T., Cauley, J. A., Kado, D. M., Barrett-Connor, E. L., Lee, C. G., Hoffman, A. R., Nevitt, M. C., Stefanick, M. L., Lane, N. E., et al. (2015) · Journal of the American Geriatrics Society · doi:10.1111/jgs.13788 · Cited by 110
Kim, Y.-H., Nijst, P., Kiefer, K., & Tang, W. H. W. (2017) · Current Heart Failure Reports · doi:10.1007/s11897-017-0320-5 · Cited by 108
Recurrence of Pancreatic Neuroendocrine Tumors and Survival Predicted by Ki67
Genc, C., Falconi, M., Partelli, S., Muffatti, F., van Eeden, S., Doglioni, C., Klümpen, H., van Eijck, C. H. J., & van Dijkum, E. J. M. N. (2018) · Annals of Surgical Oncology · doi:10.1245/s10434-018-6518-2 · Cited by 107
Deep-learning-based out-of-hospital cardiac arrest prognostic system to predict clinical outcomes
Kwon, J., Jeon, K., Kim, H. M., Kim, M. J., Lim, S., Kim, K., Song, P. S., Park, J., Choi, R. K., & Oh, B. (2019) · Resuscitation · doi:10.1016/j.resuscitation.2019.04.007 · Cited by 109
Park, Y., Kim, S. U., Kim, B. K., Park, J. Y., Kim, D. Y., Ahn, S. H., Park, Y. E., Park, J. H., Lee, Y. I., Yun, H., et al. (2015) · Liver International · doi:10.1111/liv.12878 · Cited by 104
Walsh, C. G., Sharman, K., & Hripcsak, G. M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.10.008 · Cited by 102
Li, Y., Bisson, A., Bodin, A., Herbert, J., Grammatico‐Guillon, L., Joung, B., Wang, Y., Lip, G. Y. H., & Fauchier, L. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.119.012546 · Cited by 102
Development and Validation of a Pediatric Comorbidity Index
Sun, J. W., Bourgeois, F. T., Haneuse, S., Hernández–Dı́az, S., Landon, J. E., Bateman, B. T., & Huybrechts, K. F. (2020) · American Journal of Epidemiology · doi:10.1093/aje/kwaa244 · Cited by 107
Integrated genetic and epigenetic prediction of coronary heart disease in the Framingham Heart Study
Dogan, M. V., Grumbach, I. M., Michaelson, J. J., & Philibert, R. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190549 · Cited by 99
Strand, E., Pedersen, E. R., Svingen, G. F. T., Olsén, T., Bjørndal, B., Karlsson, T. R., Dierkes, J., Njølstad, P. R., Mellgren, G., Tell, G. S., et al. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.116.003620 · Cited by 105
Key steps and common pitfalls in developing and validating risk models
Wynants, L., Collins, P. G. S., & CALSTER, B. V. (2016) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14170 · Cited by 99
Schousboe, J. T., Vo, T., Taylor, B. C., Cawthon, P. M., Schwartz, A. V., Bauer, D. C., ORWOLL, E. S., Lane, N. E., Barrett-Connor, E. L., & Ensrud, K. E. (2015) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2713 · Cited by 95
Mehta, H. B., Li, S., An, H., Goodwin, J. S., Alexander, G. C., & Segal, J. B. (2022) · Annals of Internal Medicine · doi:10.7326/m21-4204 · Cited by 97
Prospective Associations of Systemic and Urinary Choline Metabolites with Incident Type 2 Diabetes
Svingen, G. F. T., Schartum-Hansen, H., Pedersen, E. R., Ueland, P. M., Tell, G. S., Mellgren, G., Njølstad, P. R., Seifert, R., Strand, E., Karlsson, T. R., et al. (2016) · Clinical Chemistry · doi:10.1373/clinchem.2015.250761 · Cited by 93
Net reclassification index at event rate: properties and relationships
Pencina, M. J., Steyerberg, E. W., & D’Agostino, R. B. (2016) · Statistics in Medicine · doi:10.1002/sim.7041 · Cited by 91
Self-citationDeBoer, M. D., Gurka, M. J., Golden, S. H., Musani, S. K., Sims, M., Vishnu, A., Guo, Y. M., & Pearson, T. A. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.10.088 · Cited by 88
Volpato, S., Bazzano, S., Fontana, A., Ferrucci, L., & Pilotto, A. (2014) · The Journals of Gerontology Series A · doi:10.1093/gerona/glu167 · Cited by 86
Yao, X., Gersh, B. J., Sangaralingham, L. R., Kent, D. M., Shah, N. D., Abraham, N. S., & Noseworthy, P. A. (2017) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2017.07.051 · Cited by 86
Dong, J., Buas, M. F., Gharahkhani, P., Kendall, B. J., Onstad, L., Zhao, S., Anderson, L. A., Wu, A. H., Ye, W., Bird, N. C., et al. (2017) · Gastroenterology · doi:10.1053/j.gastro.2017.12.003 · Cited by 85
Buse, G. L., Puelacher, C., Gualandro, D. M., Genini, A., Hidvegi, R., Bolliger, D., Arslani, K., Steiner, L. A., Kindler, C. H., Mueller, C. E., et al. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.08.041 · Cited by 84
Hahn, S.-J., Kim, S., Choi, Y. S., Lee, J., & Kang, J. (2022) · EBioMedicine · doi:10.1016/j.ebiom.2022.104383 · Cited by 89
Fairchild, K. D., Lake, D. E., Kattwinkel, J., Moorman, J. R., Bateman, D., Grieve, P. G., Isler, J. R., & Sahni, R. (2016) · Pediatric Research · doi:10.1038/pr.2016.215 · Cited by 83
Więckowska, B., Kubiak, K. B., Jóźwiak, P., Moryson, W., & Stawińska-Witoszyńska, B. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191610213 · Cited by 82
Cucchetti, A., Serenari, M., Sposito, C., Sandro, S. D., Mosconi, C., Vicentin, I., Garanzini, E. M., Mazzaferro, V., Carlis, L. G. D., Golfieri, R., et al. (2020) · Journal of Hepatology · doi:10.1016/j.jhep.2020.03.018 · Cited by 80
Baker, S. G., Schuit, E., Steyerberg, E. W., Pencina, M. J., Vickers, A. J., Moons, K. G. M., Mol, B. W., & Lindeman, K. S. (2014) · Statistics in Medicine · doi:10.1002/sim.6195 · Cited by 78
Self-citationMartineau, P., Leslie, W. D., Johansson, H., Odén, A., McCloskey, E. V., Hans, D. B., & Kanis, J. А. (2017) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3124 · Cited by 77
Nguyen, O. K., Makam, A. N., Clark, C., Zhang, S., Xie, B., Velasco, F., Amarasingham, R., & Halm, E. A. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2568 · Cited by 76
A deep learning-based electrocardiogram risk score for long term cardiovascular death and disease
Hughes, J. W., Tooley, J., Soto, J. T., Ostropolets, A., Poterucha, T. J., Christensen, M. K., Yuan, N., Ehlert, B., Kaur, D., Kang, G., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00916-6 · Cited by 78
Beyond Coronary Calcification, Family History, and C-Reactive Protein
Mody, P. S., Joshi, P. H., Khera, A., Ayers, C. R., & Rohatgi, A. K. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.03.538 · Cited by 76
Do air pollution and neighborhood greenness exposures improve the predicted cardiovascular risk?
Yitshak‐Sade, M., Kloog, I., & Novack, V. (2017) · Environment International · doi:10.1016/j.envint.2017.07.011 · Cited by 76
Novel Biomarkers to Improve the Prediction of Cardiovascular Event Risk in Type 2 Diabetes Mellitus
van der Leeuw, J., Beulens, J. W. J., van Dieren, S., Schalkwijk, C. G., Glatz, J. F. C., Hofker, M. H., Verschuren, W. M. M., Boer, J. M. A., van der Graaf, Y., Visseren, F. L. J., et al. (2016) · Journal of the American Heart Association · doi:10.1161/jaha.115.003048 · Cited by 76
Dynamic α-Fetoprotein Response and Outcomes After Liver Transplant for Hepatocellular Carcinoma
Halazun, K. J., Rosenblatt, R. E., Mehta, N. J., Lai, Q., Hajifathalian, K., Gorgen, A., Brar, G., Sasaki, K., Doyle, M. B. M., Tabrizian, P., et al. (2021) · JAMA Surgery · doi:10.1001/jamasurg.2021.0954 · Cited by 74
Seliger, S. L., de Lemos, J. A., Neeland, I. J., Christenson, R. H., Gottdiener, J. S., Drazner, M. H., Berry, J. D., Sorkin, J. D., & deFilippi, C. R. (2015) · JACC Heart Failure · doi:10.1016/j.jchf.2014.12.018 · Cited by 72
Cust, A. E., Drummond, M., Kanetsky, P. A., Mann, G. J., Cust, A. E., Schmid, H., Hopper, J. L., Aitken, J. F., Armstrong, B. K., Giles, G. G., et al. (2018) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.05.023 · Cited by 72
Effective hospital readmission prediction models using machine-learned features
Davis, S., Zhang, J., Lee, I., Rezaei, M., Greiner, R., McAlister, F. A., & Padwal, R. S. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08748-y · Cited by 68
Wang, Y., Wang, L., Yang, Y., & Lian, T. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114090 · Cited by 67
Ma, J., Siminoski, K. G., Alos, N., Halton, J., Ho, J., Lentle, B. C., Matzinger, M., Shenouda, N. F., Atkinson, S. A., Barr, R. D., et al. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-3096 · Cited by 67
Acute kidney injury as an independent risk factor for unplanned 90-day hospital readmissions
Sawhney, S., Marks, A., Fluck, N., McLernon, D. J., Prescott, G. J., & Black, C. (2017) · BMC Nephrology · doi:10.1186/s12882-016-0430-4 · Cited by 67
Radiomics approach for preoperative identification of stages I−II and III−IV of esophageal cancer
Wu, L., Wang, C., Tan, X.-Z., Cheng, Z., Zhao, K., Yan, L., Liang, Y., Liu, Z., & Liang, C. (2018) · Chinese Journal of Cancer Research · doi:10.21147/j.issn.1000-9604.2018.04.02 · Cited by 67
Baskaran, L., Danad, I., Gransar, H., Hartaigh, B. Ó., Schulman‐Marcus, J., Lin, F. Y.-H., Peña, J. M., Hunter, A. L., Newby, D. E., Adamson, P. D., et al. (2018) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2018.02.020 · Cited by 65
Kelly, P. J., Albers, G. W., Chatzikonstantinou, A., Marchis, G. M. D., Ferrari, J., George, P. M., Mira, K., Knoflach, M., Kim, J. S., Li, L., et al. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(16)30236-8 · Cited by 64
The PROGRESS Study Group, Ahnert, P., Creutz, P., Horn, K., Schwarzenberger, F., Kiehntopf, M., Hossain, H., Bauer, M. W., Brunkhorst, F. M., Reinhart, K., et al. (2019) · Critical Care · doi:10.1186/s13054-019-2316-x · Cited by 63
Iki, M., Fujita, Y., Tamaki, J., Kouda, K., Yura, A., Sato, Y., Moon, J., Winzenrieth, R., Okamoto, N., & Kurumatani, N. (2015) · Osteoporosis International · doi:10.1007/s00198-015-3092-3 · Cited by 63
Challenges of developing a cardiovascular risk calculator for patients with rheumatoid arthritis
Crowson, C. S., Rollefstad, S., Kitas, G. D., van Riel, P. L. C. M., Gabriel, S. E., & Semb, A. G. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174656 · Cited by 65
Lee, Y. J., Cho, K.-J., Kwon, O., Park, H., Lee, Y., Kwon, J., Park, J., Kim, J. S., Lee, M., Kim, A. J., et al. (2021) · Resuscitation · doi:10.1016/j.resuscitation.2021.04.013 · Cited by 63
Li, G., Esangbedo, I. C., Xu, L., Fu, J., Li, L., Feng, D., Han, L., Xiao, X., Li, M., Mi, J., et al. (2018) · Cardiovascular Diabetology · doi:10.1186/s12933-018-0707-y · Cited by 63
Mortensen, M. B., Nordestgaard, B. G., Afzal, S., & Falk, E. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw426 · Cited by 61
Sharouni, M. E., Stodell, M., Ahmed, T., Suijkerbuijk, K. P. M., Cust, A. E., Witkamp, A. J., Sigurdsson, V., van Diest, P. J., Scolyer, R. A., Thompson, J. F., et al. (2020) · Annals of Oncology · doi:10.1016/j.annonc.2020.11.015 · Cited by 60
Liu, J., Pek, S. L. T., Ang, K., Subramaniam, T., Lim, S. C., & study, F. S. (2017) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2017-00930 · Cited by 60
Buse, G. L., Mauermann, E., Ionescu, D. C., Szczeklik, W., Hert, S. G. D., Filipovic, M., Beck‐Schimmer, B., Spadaro, S., Matute, P., Bolliger, D., et al. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.02.030 · Cited by 58
Key Concepts and Limitations of Statistical Methods for Evaluating Biomarkers of Kidney Disease
Parikh, C. R., & Thiessen‐Philbrook, H. (2014) · Journal of the American Society of Nephrology · doi:10.1681/asn.2013121300 · Cited by 58
In which patients does lumbar spine trabecular bone score (TBS) have the largest effect?
Martineau, P., Leslie, W. D., Johansson, H., Harvey, N. C., McCloskey, E. V., Hans, D., & Kanis, J. A. (2018) · Bone · doi:10.1016/j.bone.2018.05.026 · Cited by 58
Zhang, Y., Zhang, Y., Sholle, E., Abedian, S., Sharko, M., Turchioe, M. R., Wu, Y., & Ancker, J. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0235064 · Cited by 57
Xu, B., Dong, S.-Y., Bai, X., Song, T., Zhang, B., Zhou, L., Chen, Y., Zeng, Z., Wang, K., Zhao, H., et al. (2022) · Liver Cancer · doi:10.1159/000528034 · Cited by 57
Paige, E., Barrett, J., Pennells, L. A. M., Sweeting, M. J., Willeit, P., Angelantonio, E. D., Gudnason, V. G., Nordestgaard, B. G., Psaty, B. M., Goldbourt, U., et al. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx149 · Cited by 58
Bjornstad, P., Maahs, D. M., Rivard, C. J., Pyle, L., Rewers, M., Johnson, R. J., & Snell‐Bergeon, J. K. (2014) · Acta Diabetologica · doi:10.1007/s00592-014-0611-1 · Cited by 55
Leening, M. J. G., Steyerberg, E. W., CALSTER, B. V., D’Agostino, R. B., & Pencina, M. J. (2014) · Statistics in Medicine · doi:10.1002/sim.6133 · Cited by 55
Self-citationVanhaverbeke, M., Attard, R., Barteková, M., Ben‐Aicha, S., Brandenburger, T., de Gonzalo‐Calvo, D., Emanueli, C., Farrugia, R. C., Grillari, J., Hackl, M., et al. (2021) · Cardiovascular Research · doi:10.1093/cvr/cvab327 · Cited by 54
Thomas, L. E., O'Brien, E. C., Piccini, J. P., D’Agostino, R. B., & Pencina, M. J. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy345 · Cited by 54
Self-citationPrediction modeling—part 1: regression modeling
Au, E. H. K., Francis, A., Bernier-Jean, A., & Teixeira-Pinto, A. M. (2020) · Kidney International · doi:10.1016/j.kint.2020.02.007 · Cited by 56
A CT-based radiomics nomogram for distinguishing between benign and malignant bone tumours
Sun, W., Liu, S., Guo, J., Liu, S., Hao, D., Hou, F., Wang, H., & Xu, W. (2021) · Cancer Imaging · doi:10.1186/s40644-021-00387-6 · Cited by 53
Metadata
- Authors
- Leening, M. J. G., Vedder, M. M., Witteman, J. C. M., Pencina, M. J., & Steyerberg, E. W.
- Affiliations
- Duke University (US)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2014-01-21
- Volume
- 160
- Issue
- 2
- Pages
- 122-131
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2103645914
- Cited by
- 594
- References
- 141
- Citations by year
- 2026: 38 · 2025: 30 · 2024: 41 · 2023: 59 · 2022: 59 · 2021: 53 · 2020: 56 · 2019: 39 · 2018: 49 · 2017: 44 · 2016: 55 · 2015: 47 · 2014: 23
- FWCI
- 7.11
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- RePub (Erasmus University Rotterdam) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- net reclassification improvement, risk prediction model, model calibration, cost-effectiveness, reporting quality
- MeSH terms
- Data Interpretation, Statistical, Decision Support Techniques, Humans, Models, Statistical, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review