Net Reclassification Improvement: Computation, Interpretation, and Controversies: A Literature Review and Clinician's Guide
Open accessAbstract
The net reclassification improvement (NRI) is an increasingly popular measure for evaluating improvements in risk predictions. This article details a review of 67 publications in high-impact general clinical journals that considered the NRI. Incomplete reporting of NRI methods, incorrect calculation, and common misinterpretations were found. To aid improved applications of the NRI, the article elaborates on several aspects of the computation and interpretation in various settings. Limitations and controversies are discussed, including the effect of miscalibration of prediction models, the use of the continuous NRI and “clinical NRI,” and the relation with decision analytic measures. A systematic approach toward presenting NRI analysis is proposed: Detail and motivate the methods used for computation of the NRI, use clinically meaningful risk cutoffs for the category-based NRI, report both NRI components, address issues of calibration, and do not interpret the overall NRI as a percentage of the study population reclassified. Promising NRI findings need to be followed with decision analytic or formal cost-effectiveness evaluations.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The net reclassification improvement is improper.
“Dedicated measures, such as the widely used but improper net reclassification improvement, are available for evaluating competing models.”
From Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance (2025) · cites this paper as [119]
Cites
Grundy, S. M., Bilheimer, D. W., Chait, A., Clark, L. T., Denke, M. A., Havel, R. J., Hazzard, W. R., Hulley, S. B., Hunninghake, D. B., Kreisberg, R. A., et al. (1993) · JAMA · doi:10.1001/jama.269.23.3015 · Cited by 27,944 · see citing works
Expert Panel on Detection, E. (2001) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.285.19.2486 · Cited by 26,011 · see citing works
Detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III)
Grundy, S. M., Becker, D. M., Clark, L. T., Cooper, R., Denke, M. A., Howard, J. L., Hunninghake, D. B., Illingworth, D. R., Luepker, R. V., McBride, P. E., et al. (2002) · Civil War Book Review · Cited by 12,198 · see citing works
European Guidelines on cardiovascular disease prevention in clinical practice (version 2012)
Authors/Task Force Members:, Perk, J., De Backer, G., Gohlke, H., Graham, I., Reiner, Ž., Verschuren, M., Albus, C., Benlian, P., Boysen, G., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs092 · Cited by 8,490 · see citing works
Roffi, M., Patrono, C., Collet, J.-P., Mueller, C., Valgimigli, M., Andreotti, F., Bax, J. J., Borger, M. A., Brotons, C., Chew, D. P., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehv320 · Cited by 8,261 · see citing works
Pencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493 · see citing works
Self-citationDecision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341 · see citing works
Kearon (2012) · doi:10.1378/chest.11-2301 · Cited by 6,119 · see citing works
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170 · see citing works
Self-citationClinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281 · see citing works
Self-citationAuthors Task Force Members, Hamm, C. W., Bassand, J., Agewall, S., Bax, J. J., Boersma, E. H., Bueno, H., Caso, P., Dudek, D., Gielen, S., et al. (2011) · European Heart Journal · doi:10.1093/eurheartj/ehr236 · Cited by 3,069 · see citing works
Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers
Pencina, M. J., D’Agostino, R. B., & Steyerberg, E. W. (2010) · Statistics in Medicine · doi:10.1002/sim.4085 · Cited by 2,478 · see citing works
Self-citationGeneral and abdominal adiposity and risk of death in Europe
Pischon, T., Boeing, H., Hoffmann, K., Bergmann, M., Schulze, M. B., Overvad, K., van der Schouw, Y. T., Spencer, E., Moons, K. G. M., Tjønneland, A., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0801891 · Cited by 2,155 · see citing works
Mosca, L., Benjamin, E. J., Berra, K., Bezanson, J. L., Dolor, R. J., Lloyd-Jones, D. M., Newby, L. K., Piña, I. L., Roger, V. L., Shaw, L. J., et al. (2011) · Circulation · doi:10.1161/cir.0b013e31820faaf8 · Cited by 2,143 · see citing works
Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction
Cook, N. R. (2007) · Circulation · doi:10.1161/circulationaha.106.672402 · Cited by 2,123 · see citing works
2010 ACCF/AHA Guideline for Assessment of Cardiovascular Risk in Asymptomatic Adults
Greenland, P., Alpert, J. S., Beller, G. A., Benjamin, E. J., Budoff, M. J., Fayad, Z. A., Foster, E., Hlatky, M. A., Hodgson, J. M., Kushner, F. G., et al. (2010) · Circulation · doi:10.1161/cir.0b013e3182051b4c · Cited by 1,968 · see citing works
Cholesterol efflux capacity, high-density lipoprotein function, and atherosclerosis
Khera, A. V., Cuchel, M., de la Llera-Moya, M., Rodrigues, A., Burke, M. F., Jafri, K., French, B. C., Phillips, J. A., Mucksavage, M. L., Wilensky, R. L., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1001689 · Cited by 1,943 · see citing works
KANNEL, W. B., DAWBER, T. R., KAGAN, A., REVOTSKIE, N., & STOKES, J. (1961) · Annals of Internal Medicine · doi:10.7326/0003-4819-55-1-33 · Cited by 1,837 · see citing works
Modern Epidemiology 3rd edition
Rothman, K. J., Lash, T. L., & Greenland, S. (1986) · Cited by 1,736 · see citing works
Glycated hemoglobin, diabetes, and cardiovascular risk in nondiabetic adults
Selvin, E., Steffes, M. W., Zhu, H., Matsushita, K., Wagenknecht, L., Pankow, J., Coresh, J., & Brancati, F. L. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa0908359 · Cited by 1,544 · see citing works
Genomewide Association Studies and Assessment of the Risk of Disease
Manolio, T. A. (2010) · New England Journal of Medicine · doi:10.1056/nejmra0905980 · Cited by 1,512 · see citing works
Hyponatremia and Mortality among Patients on the Liver-Transplant Waiting List
Kim, W. R., Biggins, S. W., Kremers, W. K., Wiesner, R. H., Kamath, P. S., Benson, J. T., Edwards, E. B., & Therneau, T. M. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0801209 · Cited by 1,485 · see citing works
Severe hypoglycemia and risks of vascular events and death
Zoungas, S., Patel, A., Chalmers, J., de Galan, B. E., Li, Q., Billot, L., Woodward, M., Ninomiya, T., Neal, B., MacMahon, S., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1003795 · Cited by 1,471 · see citing works
A Predictive Model for Progression of Chronic Kidney Disease to Kidney Failure
Tangri, N. (2011) · JAMA · doi:10.1001/jama.2011.451 · Cited by 1,359 · see citing works
Greenland, P. (2007) · Statistics in Medicine · doi:10.1002/sim.2976 · Cited by 1,300 · see citing works
Pepe, M. S. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh101 · Cited by 1,276 · see citing works
The Emerging Risk Factors Collaboration (2011) · The Lancet · doi:10.1016/s0140-6736(11)60105-0 · Cited by 1,216 · see citing works
Gulati, A., Jabbour, A., Ismail, T. F., Guha, K., Khwaja, J., Raza, S., Morarji, K., Brown, T. D. H., Ismail, N. A., Dweck, M. R., et al. (2013) · JAMA · doi:10.1001/jama.2013.1363 · Cited by 1,183 · see citing works
Criteria for Evaluation of Novel Markers of Cardiovascular Risk
Hlatky, M., Greenland, P., Arnett, D., Ballantyne, C., Criqui, M., Elkind, M., Go, A., Harrell, F. E. J., Hong, Y.-L., Howard, B., et al. (2009) · Circulation · doi:10.1161/circulationaha.109.192278 · Cited by 1,153 · see citing works
C-reactive protein, fibrinogen, and cardiovascular disease prediction
The Emerging Risk Factors Collaboration (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1107477 · Cited by 1,150 · see citing works
Coronary Artery Calcium Score and Risk Classification for Coronary Heart Disease Prediction
Polonsky, T. S. (2010) · JAMA · doi:10.1001/jama.2010.461 · Cited by 1,123 · see citing works
Yeboah, J., McClelland, R. L., Polonsky, T. S., Burke, G. L., Sibley, C. T., O’Leary, D., Carr, J. J., Goff, D. C., Greenland, P., & Herrington, D. M. (2012) · JAMA · doi:10.1001/jama.2012.9624 · Cited by 1,122 · see citing works
de Lemos, J. A., Drazner, M. H., Omland, T., Ayers, C. R., Khera, A., Rohatgi, A. K., Hashim, I. A., Berry, J. D., Das, S. R., Morrow, D. A., et al. (2010) · JAMA · doi:10.1001/jama.2010.1768 · Cited by 1,105 · see citing works
Devereaux, P. J., Chan, M. T. V., Alonso‐Coello, P., Walsh, M., Berwanger, O. B., Villar, J. C., Wang, C. Y., Garutti, R. I., Jacka, M. J., Sigamani, A., et al. (2012) · JAMA · doi:10.1001/jama.2012.5502 · Cited by 1,102 · see citing works
Schnabel, R. B., SULLIVAN, L. M., Levy, D. A., Pencina, M. J., Massaro, J. M., D’Agostino, R. B., Newton‐Cheh, C., Yamamoto, J. F., Magnani, J. W., Tadros, T. M., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60443-8 · Cited by 1,038 · see citing works
Self-citationSelection Criteria for Lung-Cancer Screening
Tammemägi, M. C., Katki, H. A., Hocking, W. G., Church, T. R., Caporaso, N. E., Kvale, P. A., Chaturvedi, A. K., Silvestri, G. A., Riley, T. L., Commins, J. M., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1211776 · Cited by 1,023 · see citing works
Matsushita, K., Mahmoodi, B. K., Woodward, M., Emberson, J., Jafar, T. H., Jee, S. H., Polkinghorne, K. R., Shankar, A., Smith, D. H., Tonelli, M. A., et al. (2012) · JAMA · doi:10.1001/jama.2012.3954 · Cited by 987 · see citing works
Clinical risk factors, DNA variants, and the development of type 2 diabetes
Lyssenko, V., Jonsson, A., Almgren, P., Pulizzi, N., Isomaa, B., Tuomi, T., Berglund, G., Altshuler, D., Nilsson, P., & Groop, L. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0801869 · Cited by 938 · see citing works
A Sensitive Cardiac Troponin T Assay in Stable Coronary Artery Disease
Omland, T., de Lemos, J. A., Sabatine, M. S., Christophi, C. A., Rice, M. M., Jablonski, K. A., Tjora, S., DOMANSKI, M. J., Gersh, B. J., Rouleau, J. L., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0805299 · Cited by 901 · see citing works
Use of Multiple Biomarkers to Improve the Prediction of Death from Cardiovascular Causes
Zethelius, B., Berglund, L., Sundström, J., Ingelsson, E., Basu, S., Larsson, A. O., Venge, P., & Ärnlöv, J. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0707064 · Cited by 887 · see citing works
Kramer, A. A., & Zimmerman, J. E. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000275267.64078.b0 · Cited by 886 · see citing works
Predicting the 30-Year Risk of Cardiovascular Disease
Pencina, M. J., D’Agostino, R. B., Larson, M. G., Massaro, J. M., & Vasan, R. S. (2009) · Circulation · doi:10.1161/circulationaha.108.816694 · Cited by 869 · see citing works
Self-citationAuthors/Task Force Members: Joep Perk (Chairperson) (Sweden)*, G. D. B. (. (2012) · European Journal of Preventive Cardiology · doi:10.1177/2047487312450228 · Cited by 863 · see citing works
Farooq, V., Klaveren, D. V., Steyerberg, E. W., Meliga, E., Vergouwe, Y., Chieffo, A., Kappetein, A. P., Colombo, A., Holmes, D. R., Mack, M. J., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60108-7 · Cited by 837 · see citing works
Self-citationCarotid-Wall Intima–Media Thickness and Cardiovascular Events
Polak, J. F., Pencina, M. J., Pencina, K. M., O’Donnell, C. J., Wolf, P. A., & D’Agostino, R. B. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1012592 · Cited by 829 · see citing works
Self-citationDen Ruijter, H. M., Peters, S. A. E., Anderson, T. J., Britton, A. R., Dekker, J. M., Eijkemans, M. J., Engström, G., Evans, G. W., de Graaf, J., Grobbee, D. E., et al. (2012) · JAMA · doi:10.1001/jama.2012.9630 · Cited by 760 · see citing works
Self-citationGenotype score in addition to common risk factors for prediction of type 2 diabetes
Meigs, J. B., Shrader, P., Sullivan, L. M., McAteer, J. B., Fox, C. S., Dupuis, J., Manning, A. K., Florez, J. C., Wilson, P. W. F., D'Agostino, R. B., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0804742 · Cited by 759 · see citing works
deFilippi, C. R., de Lemos, J. A., Christenson, R. H., Gottdiener, J. S., Kop, W. J., Zhan, M., & Seliger, S. L. (2010) · JAMA · doi:10.1001/jama.2010.1708 · Cited by 716 · see citing works
Polymorphisms Associated with Cholesterol and Risk of Cardiovascular Events
Kathiresan, S., Melander, O., Anevski, D., Guiducci, C., Burtt, N. P., Roos, C., Hirschhorn, J. N., Berglund, G., Hedblad, B., Groop, L., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0706728 · Cited by 696 · see citing works
Bates, S. M., Jaeschke, R., Stevens, S. M., Goodacre, S. W., Wells, P. S., Stevenson, M. D., Kearon, C., Schünemann, H. J., Crowther, M. A., Pauker, S. G., et al. (2012) · CHEST Journal · doi:10.1378/chest.11-2299 · Cited by 687 · see citing works
Ripatti, S., Tikkanen, E., Orho-Melander, M., Havulinna, A. S., Silander, K., Sharma, A., Guiducci, C., Perola, M., Jula, A., Sinisalo, J., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61267-6 · Cited by 562 · see citing works
Buckley, D., Fu, R. F., Freeman, M., Rogers, K. R., & Helfand, M. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-7-200910060-00009 · Cited by 557 · see citing works
Two further applications of a model for binary regression
COX, D. R. (1958) · Biometrika · doi:10.1093/biomet/45.3-4.562 · Cited by 556 · see citing works
Novel and Conventional Biomarkers for Prediction of Incident Cardiovascular Events in the Community
Melander, O. (2009) · JAMA · doi:10.1001/jama.2009.943 · Cited by 552 · see citing works
Lipid-Related Markers and Cardiovascular Disease Prediction
The Emerging Risk Factors Collaboration (2012) · JAMA · doi:10.1001/jama.2012.6571 · Cited by 539 · see citing works
Predictive accuracy of the Framingham coronary risk score in British men:prospective cohort study
Brindle, P. M., Emberson, J., Lampe, F. C., Walker, M., Whincup, P. H., Fahey, T. P., & Ebrahim, S. B. J. (2003) · BMJ · doi:10.1136/bmj.327.7426.1267 · Cited by 524 · see citing works
Serial Changes in Highly Sensitive Troponin I Assay and Early Diagnosis of Myocardial Infarction
Keller, T., Zeller, T., Ojeda, F., Tzikas, S., Lillpopp, L., Sinning, C., Wild, P. S., Genth‐Zotz, S., Warnholtz, A., Giannitsis, E., et al. (2011) · JAMA · doi:10.1001/jama.2011.1896 · Cited by 508 · see citing works
Interpreting Incremental Value of Markers Added to Risk Prediction Models
Pencina, M. J., D'Agostino, R. B., Pencina, K. M., Janssens, A. C. J. W., & Greenland, P. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kws207 · Cited by 506 · see citing works
Self-citationThe effect of including C-reactive protein in cardiovascular risk prediction models for women
Cook, N. R., Buring, J. E., & Ridker, P. M. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-1-200607040-00128 · Cited by 504 · see citing works
Cook, N. R., & Ridker, P. M. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-11-200906020-00007 · Cited by 457 · see citing works
Performance of Common Genetic Variants in Breast-Cancer Risk Models
Wacholder, S., Hartge, P. A., Prentice, R. L., García‐Closas, M., Feigelson, H. S., Diver, W. R., Thun, M. J., Cox, D. G., Hankinson, S. E., Kraft, P., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa0907727 · Cited by 412 · see citing works
Authors/Task Force Members:, Perk, J., Backer, G. D., Gohlke, H., Graham, I. D., Reiner, Ž., Verschuren, W. M. M., Albus, C., Benlian, P., Boysen, G., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs254 · Cited by 390 · see citing works
Helfand, M., Buckley, D., Freeman, M., Fu, R. F., Rogers, K. R., Fleming, C., & Humphrey, L. L. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-7-200910060-00010 · Cited by 380 · see citing works
Hense, H. (2003) · European Heart Journal · doi:10.1016/s0195-668x(03)00081-2 · Cited by 372 · see citing works
Association between a literature-based genetic risk score and cardiovascular events in women
Paynter, N. P. (2010) · JAMA · doi:10.1001/jama.2010.119 · Cited by 361 · see citing works
Evaluation of Newer Risk Markers for Coronary Heart Disease Risk Classification: A Cohort Study
Kavousi, M., Elias-Smale, S., Rutten, J. H. W., Leening, M. J. G., Vliegenthart, R., Verwoert, G. C., Krestin, G. P., Oudkerk, M., de Maat, M. P. M., Leebeek, F. W. G., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-6-201203200-00006 · Cited by 360 · see citing works
Self-citationPencina, M. J., D’Agostino, R. B., & Demler, O. (2011) · Statistics in Medicine · doi:10.1002/sim.4348 · Cited by 348 · see citing works
Self-citationStatistical methods for assessment of added usefulness of new biomarkers
Pencina, M. J., D’Agostino, R. B., & Vasan, R. S. (2010) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm.2010.340 · Cited by 335 · see citing works
Self-citationAssociation Between Familial Atrial Fibrillation and Risk of New-Onset Atrial Fibrillation
Lubitz, S. A., Yin, X., Fontes, J. D., Magnani, J. W., Rienstra, M., Pai, M., Villalon, M. L., Vasan, R. S., Pencina, M. J., Levy, D., et al. (2010) · JAMA · doi:10.1001/jama.2010.1690 · Cited by 313 · see citing works
Self-citationMunshi, N. C., Anderson, K. C., Bergsagel, P. L., Shaughnessy, J. D., Palumbo, A. P., Durie, B. G. M., Fonseca, R., Stewart, A. K., Harousseau, J., Dimopoulos, M. A., et al. (2011) · Blood · doi:10.1182/blood-2010-10-300970 · Cited by 312 · see citing works
Comparisons of established risk prediction models for cardiovascular disease: systematic review
Siontis, G. C. M., Tzoulaki, I., Siontis, K. C., & Ioannidis, J. P. A. (2012) · BMJ · doi:10.1136/bmj.e3318 · Cited by 300 · see citing works
Visvanathan, K., Chlebowski, R. T., Hurley, P. A., Col, N. F., Ropka, M. E., Collyar, D. E., Morrow, M., Runowicz, C. D., Pritchard, K. I., Hagerty, K. L., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.20.5179 · Cited by 285 · see citing works
Schelbert, E. B., Cao, J. J., Sigurdsson, S. O., Aspelund, T., Kellman, P., Aletras, A. H., Dyke, C. K., Þorgeirsson, G., Eiríksdóttir, G., Launer, L. J., et al. (2012) · JAMA · doi:10.1001/2012.jama.11089 · Cited by 284 · see citing works
Assessment of Claims of Improved Prediction Beyond the Framingham Risk Score
Tzoulaki, I. (2009) · JAMA · doi:10.1001/jama.2009.1757 · Cited by 276 · see citing works
Cook, N. R., Paynter, N. P., Eaton, C. B., Manson, J. E., Martin, L. W., Robinson, J. G., Rossouw, J. E., Wassertheil-Smoller, S. W., & Ridker, P. M. (2012) · Circulation · doi:10.1161/circulationaha.111.075929 · Cited by 264 · see citing works
Sudden Death After Myocardial Infarction
Adabağ, S. (2008) · JAMA · doi:10.1001/jama.2008.553 · Cited by 263 · see citing works
Paynter, N. P., Chasman, D. I., Buring, J. E., Shiffman, D., Cook, N. R., & Ridker, P. M. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-2-200901200-00003 · Cited by 259 · see citing works
Assessing the Value of Risk Predictions by Using Risk Stratification Tables
Janes, H., PEPE, M. S., & Gu, W. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-10-200811180-00009 · Cited by 249 · see citing works
Vergouwe, Y., Moons, K. G. M., & Steyerberg, E. W. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq223 · Cited by 243 · see citing works
Self-citationTesting for improvement in prediction model performance
PEPE, M. S., Kerr, K. F., Longton, G., & Wang, Z. (2013) · Statistics in Medicine · doi:10.1002/sim.5727 · Cited by 239 · see citing works
Cornelis, M. C., Qi, L., Zhang, C., Kraft, P. L., Manson, J. E., Cai, T., Hunter, D. J., & Hu, F. B. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-150-8-200904210-00008 · Cited by 228 · see citing works
Association of Major and Minor ECG Abnormalities With Coronary Heart Disease Events
Bauer, D. C. (2012) · JAMA · doi:10.1001/jama.2012.434 · Cited by 213 · see citing works
Hilden, J., & Gerds, T. A. (2013) · Statistics in Medicine · doi:10.1002/sim.5804 · Cited by 200 · see citing works
One statistical test is sufficient for assessing new predictive markers
Vickers, A. J., Cronin, A. M., & Begg, C. B. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-13 · Cited by 198 · see citing works
Fonarow, G. C., Pan, W., Saver, J. L., Smith, E. E., Reeves, M. J., Broderick, J. P., Kleindorfer, D., Sacco, R. L., Olson, D. M., Hernandez, A. F., et al. (2012) · JAMA · doi:10.1001/jama.2012.7870 · Cited by 181 · see citing works
Rosenberg, S. J., Elashoff, M. R., Beineke, P., Daniels, S. E., Wingrove, J. A., Tingley, W. G., Sager, P. T., Sehnert, A. J., Yau, M., Kraus, W. E., et al. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-7-201010050-00005 · Cited by 172 · see citing works
Association Between 9p21 Genomic Markers and Heart Disease
Palomaki, G. E., Melillo, S. N., & Bradley, L. (2010) · JAMA · doi:10.1001/jama.2010.118 · Cited by 158 · see citing works
Beyond the Usual Prediction Accuracy Metrics: Reporting Results for Clinical Decision Making
Localio, A. R., & Goodman, S. N. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-4-201208210-00014 · Cited by 139 · see citing works
Individualized Guidelines: The Potential for Increasing Quality and Reducing Costs
Eddy, D. M., Adler, J. S., Patterson, B., Lucas, D., Smith, K. A., & Morris, M. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-9-201105030-00008 · Cited by 139 · see citing works
Chou, R., Arora, B., Dana, T., Fu, R. F., Walker, M., & Humphrey, L. L. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-6-201109200-00006 · Cited by 136 · see citing works
Issues in methodological research: perspectives from researchers and commissioners
Lilford, R. J., Richardson, A., Stevens, A., Fitzpatrick, R., Edwards, S., Rock, F., & Hutton, J. L. (2001) · Health Technology Assessment · doi:10.3310/hta5080 · Cited by 132 · see citing works
Assessing New Biomarkers and Predictive Models for Use in Clinical Practice
McGeechan, K., Macaskill, P., Irwig, L., Liew, G., & Wong, T. Y. (2008) · Archives of Internal Medicine · doi:10.1001/archinte.168.21.2304 · Cited by 129 · see citing works
Performance of reclassification statistics in comparing risk prediction models
Cook, N. R., & Paynter, N. P. (2011) · Biometrical Journal · doi:10.1002/bimj.201000078 · Cited by 122 · see citing works
Comments on ‘Integrated discrimination and net reclassification improvements—Practical advice’
Pencina, M. J., D’Agostino, R. B., D’Agostino, R. B., & Vasan, R. S. (2007) · Statistics in Medicine · doi:10.1002/sim.3106 · Cited by 112 · see citing works
Self-citationMcGeechan, K., Liew, G., Macaskill, P., Irwig, L., Klein, R., Sharrett, A. R., Klein, B. E. K., Wang, J. J., Chambless, L. E., & Wong, T. Y. (2008) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2008.02.094 · Cited by 112 · see citing works
Pepe, M. S., Feng, Z., & Gu, J. W. (2007) · Statistics in Medicine · doi:10.1002/sim.2991 · Cited by 105 · see citing works
de Boer, I. H., Levin, G., Robinson‐Cohen, C., Biggs, M. L., Hoofnagle, A. N., Siscovick, D. S., & Kestenbaum, B. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-9-201205010-00004 · Cited by 102 · see citing works
Problems With Risk Reclassification Methods for Evaluating Prediction Models
Pepe, M. S. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr013 · Cited by 102 · see citing works
Cook, N. R. (2007) · Statistics in Medicine · doi:10.1002/sim.2987 · Cited by 101 · see citing works
Ganna, A., Reilly, M., Fairé, U. D., Pedersen, N., Magnusson, P. K. E., & Ingelsson, E. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kwr374 · Cited by 90 · see citing works
Reclassification Calculations for Persons With Incomplete Follow-up
Steyerberg, E. W., & Pencina, M. J. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-3-201002020-00019 · Cited by 88 · see citing works
Self-citationUsing Additional Information on Working Hours to Predict Coronary Heart Disease
Mika Kivimaki, B., Batty, G. D., Hamer, M., Ferrie, J. E., Vahtera, J., Virtanen, M., Marmot, M. G., Singh‐Manoux, A., & Shipley, M. J. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-7-201104050-00003 · Cited by 87 · see citing works
Greenland, S. (2007) · Statistics in Medicine · doi:10.1002/sim.2995 · Cited by 80 · see citing works
Evaluation of Markers and Risk Prediction Models
CALSTER, B. V., Vickers, A. J., Pencina, M. J., Baker, S. G., Timmerman, D., & Steyerberg, E. W. (2013) · Medical Decision Making · doi:10.1177/0272989x12470757 · Cited by 76 · see citing works
Self-citationKoller, M., Leening, M. J. G., Wolbers, M., Steyerberg, E. W., Hunink, M. G. M., Schoop, R., Albert Hofman, D., Bucher, H. C., Psaty, B. M., Lloyd‐Jones, D. M., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00002 · Cited by 74 · see citing works
Self-citationUse of reclassification for assessment of improved prediction: an empirical evaluation
Tzoulaki, I., Liberopoulos, G., & Ioannidis, J. P. A. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyr013 · Cited by 70 · see citing works
Mihăescu, R., van Zitteren, M., van Hoek, M., Sijbrands, E. J. G., Uitterlinden, A. G., Witteman, J. C. M., Albert Hofman, D., Hunink, M. G. M., van Duijn, C. M., & Janssens, A. C. J. W. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq122 · Cited by 69 · see citing works
Self-citationValidity of the Framingham point scores in the elderly: Results from the Rotterdam study
Koller, M., Steyerberg, E. W., Wolbers, M., Stijnen, T., Bucher, H. C., Hunink, M. G. M., & Witteman, J. C. M. (2007) · American Heart Journal · doi:10.1016/j.ahj.2007.03.022 · Cited by 54 · see citing works
Self-citationBiases Introduced by Choosing Controls to Match Risk Factors of Cases in Biomarker Research
PEPE, M. S., Fan, J., Seymour, C. W., Li, C., Huang, Y., & Feng, Z. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2012.186007 · Cited by 48 · see citing works
Austin, P. C., & Steyerberg, E. W. (2012) · Statistics in Medicine · doi:10.1002/sim.5598 · Cited by 47 · see citing works
Self-citationStrengthening the reporting of genetic risk prediction studies: the GRIPS statement
Janssens, A. C. J. W., Ioannidis, J. P. A., van Duijn, C. M., Little, J., Khoury, M. J., & the GRIPS Group (2011) · Genome Medicine · doi:10.1186/gm230 · Cited by 44 · see citing works
One-Year Risk for Advanced Colorectal Neoplasia: U.S. Versus U.K. Risk-Stratification Guidelines
Martínez, M. E., Thompson, P. A., Messer, K. S., Ashbeck, E. L., Lieberman, D. A., Baron, J. A., Ahnen, D. J., Robertson, D. J., Jacobs, E. T., Greenberg, E. R., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-12-201212180-00005 · Cited by 42 · see citing works
A Bias-Corrected Net Reclassification Improvement for Clinical Subgroups
Paynter, N. P., & Cook, N. R. (2012) · Medical Decision Making · doi:10.1177/0272989x12461856 · Cited by 39 · see citing works
Strengthening the reporting of Genetic RIsk Prediction Studies: the GRIPS Statement
Janssens, A. C. J. W., Ioannidis, J. P. A., van Duijn, C. M., Little, J., & Khoury, M. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.02.004 · Cited by 37 · see citing works
Use of risk stratification to guide ambulatory management of neutropenic fever
Worth, L. J., Lingaratnam, S. M., Taylor, A., Hayward, A., Morrissey, S., Cooney, J. P., Bastick, P. A., Eek, R. W., Wei, A. H., & Thursky, K. (2011) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2010.02339.x · Cited by 36 · see citing works
Primary Prevention of Cardiovascular Disease
Hingorani, A. D., & Psaty, B. M. (2009) · JAMA · doi:10.1001/jama.2009.1698 · Cited by 36 · see citing works
Mühlenbruch, K., Heraclides, A., Steyerberg, E. W., Joost, H., Boeing, H., & Schulze, M. B. (2012) · European Journal of Epidemiology · doi:10.1007/s10654-012-9744-0 · Cited by 34 · see citing works
Self-citationChallenges to Improve Coronary Heart Disease Risk Assessment
Wilson, P. W. F. (2009) · JAMA · doi:10.1001/jama.2009.1765 · Cited by 26 · see citing works
Commentary: Reporting standards are needed for evaluations of risk reclassification
Pepe, M. S., & Janes, H. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyr083 · Cited by 26 · see citing works
Mapping Out Biomarkers for Alzheimer Disease
Breteler, M. M. B. (2011) · JAMA · doi:10.1001/jama.2010.2017 · Cited by 24 · see citing works
Net reclassification improvement and decision theory
Vickers, A. J., Elkin, E. B., & Steyerberg, E. W. (2007) · Statistics in Medicine · doi:10.1002/sim.3087 · Cited by 24 · see citing works
Self-citationCook, N. R., & Paynter, N. P. (2011) · Statistics in Medicine · doi:10.1002/sim.4209 · Cited by 24 · see citing works
Merry, A. H. H., Boer, J. M. A., Schouten, L. J., Ambergen, T., Steyerberg, E. W., Feskens, E. J. M., Verschuren, W. M. M., Gorgels, A. P. M., & van den Brandt, P. A. (2011) · European Journal of Preventive Cardiology · doi:10.1177/1741826711410256 · Cited by 22 · see citing works
Self-citationStrengthening the Reporting of Genetic Risk Prediction Studies: The GRIPS Statement
Janssens, A. C. J. W., Ioannidis, J. P. A., van Duijn, C. M., Little, J., Khoury, M. J., & for the GRIPS Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-6-201103150-00008 · Cited by 16 · see citing works
Framework for Evaluating Novel Risk Markers
Hlatky, M. A. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-6-201203200-00013 · Cited by 13 · see citing works
Biomarkers for Prediction of Cardiovascular Events
Cook, N. R. (2009) · JAMA · doi:10.1001/jama.2009.1636 · Cited by 12 · see citing works
Fibrosis and Mortality in Patients With Dilated Cardiomyopathy
Leening, M. J. G., & Steyerberg, E. W. (2013) · JAMA · doi:10.1001/jama.2013.6470 · Cited by 11 · see citing works
Self-citationNet reclassification improvement: a link between statistics and clinical practice
Leening, M. J. G., & Cook, N. R. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-012-9759-6 · Cited by 11 · see citing works
Self-citationCoronary Artery Calcium Score and Cardiovascular Event Prediction
McEvoy, J. W. (2010) · JAMA · doi:10.1001/jama.2010.1143 · Cited by 6 · see citing works
Complications Associated With Use of Bone-Morphogenetic Proteins in Spinal Fusion Procedures
Smoljanović, T. (2009) · JAMA · doi:10.1001/jama.2009.1639 · Cited by 6 · see citing works
Comparing costs associated with risk stratification rules for t-year survival
Cai, T., Tian, L., & Lloyd‐Jones, D. M. (2011) · Biostatistics · doi:10.1093/biostatistics/kxr001 · Cited by 6 · see citing works
Markers for Prediction of Cardiovascular Disease Risk
Kavousi, M., Leening, M. J. G., & Witteman, J. C. M. (2012) · JAMA · doi:10.1001/jama.2012.25786 · Cited by 5 · see citing works
Self-citationCoronary artery calcium for guiding statin treatment
Kengne, A. P., Echouffo-Tcheugui, J. B., & Sobngwi, E. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60140-8 · Cited by 4 · see citing works
Risk categorization for calculating net reclassification improvement
Takahara, M., Katakami, N., Kaneto, H., & Shimomura, I. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-013-9824-9 · Cited by 4 · see citing works
Modeling Cardiovascular Disease Prevention
Pletcher, M. J. (2010) · JAMA · doi:10.1001/jama.2010.188 · Cited by 2 · see citing works
Body-mass index, abdominal adiposity, and cardiovascular risk – Authors' reply
Wormser, D., Angelantonio, E. D., Sattar, N. A., Collins, R., Thompson, S. G., & Danesh, J. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61122-7 · Cited by 2 · see citing works
Biomarkers for Prediction of Cardiovascular Events—Reply
Melander, O. (2009) · JAMA · doi:10.1001/jama.2009.1638 · Cited by 1 · see citing works
Flagged first, then by citations
1 of the 141 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · see citing works
Self-citationTraumatic brain injury: integrated approaches to improve prevention, clinical care, and research
Maas, A. I. R., Menon, D. K., Adelson, P. D., Andelic, N., Bell, M. J., Belli, A., Bragge, P., Brazinova, A., Büki, A., Chesnut, R. M., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30371-x · Cited by 2,609 · see citing works
Self-citationTowards better clinical prediction models: seven steps for development and an ABCD for validation
Steyerberg, E. W., & Vergouwe, Y. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu207 · Cited by 1,928 · see citing works
Self-citationLi, X. S., Obeid, S., Klingenberg, R., Gencer, B., Mach, F., Räber, L., Windecker, S., Rodondi, N., Nanchen, D., Muller, O., et al. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehw582 · Cited by 479 · see citing works
Lammers, W. J., Hirschfield, G. M., Corpechot, C., Nevens, F., Lindor, K. D., Janssen, H. L. A., Floreani, A., Ponsioen, C. Y., Mayo, M. J., Invernizzi, P., et al. (2015) · Gastroenterology · doi:10.1053/j.gastro.2015.07.061 · Cited by 441 · see citing works
Clinical Features Predicting Mortality Risk in Patients With Viral Pneumonia: The MuLBSTA Score
Guo, L., Wei, D., Zhang, X., Wu, Y., Li, Q. Y., Zhou, M., & Qu, J. (2019) · Frontiers in Microbiology · doi:10.3389/fmicb.2019.02752 · Cited by 412 · see citing works
Principles and methods for transferring polygenic risk scores across global populations
Kachuri, L., Chatterjee, N., Hirbo, J. B., Schaid, D. J., Martin, I. K., Kullo, I. J., Kenny, E. E., Paşaniuc, B., Auer, P. L., Conomos, M. P., et al. (2023) · Nature Reviews Genetics · doi:10.1038/s41576-023-00637-2 · Cited by 338 · see citing works
Reddy, Y. N. V., Obokata, M., Egbe, A. C., Yang, J. H., Pislaru, S. V., Lin, G., Carter, R. E., & Borlaug, B. A. (2019) · European Journal of Heart Failure · doi:10.1002/ejhf.1464 · Cited by 323 · see citing works
In-depth mining of clinical data: the construction of clinical prediction model with R
Zhou, Z., Wang, W., Li, Y., Jin, K., Wang, X., Wang, Z., Chen, Y.-S., Wang, S.-J., Hu, J., Zhang, H., et al. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2019.08.63 · Cited by 300 · see citing works
An algorithm based on deep learning for predicting in-hospital cardiac arrest
Kwon, J., Lee, Y., Lee, Y., Lee, S., & Park, J. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.008678 · Cited by 299 · see citing works
Large-scale Metabolomic Profiling Identifies Novel Biomarkers for Incident Coronary Heart Disease
Ganna, A., Salihović, S., Sundström, J., Broeckling, C. D., Hedman, Å. K., Magnusson, P. K. E., Pedersen, N. L., Larsson, A. O., Siegbahn, A. G., Zilmer, M., et al. (2014) · PLoS Genetics · doi:10.1371/journal.pgen.1004801 · Cited by 283 · see citing works
Troponin I and cardiovascular risk prediction in the general population: the BiomarCaRE consortium
Blankenberg, S., Salomaa, V. V., Makarova, N., Ojeda, F., Wild, P. S., Lackner, K. J., Jørgensen, T., Thorand, B., Peters, A., Nauck, M. A., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw172 · Cited by 274 · see citing works
Cystatin C as a biomarker for estimating glomerular filtration rate
Ferguson, T. W., Komenda, P. V. J., & Tangri, N. (2015) · Current Opinion in Nephrology & Hypertension · doi:10.1097/mnh.0000000000000115 · Cited by 267 · see citing works
Cowley, L., Farewell, D. M., Maguire, S., & Kemp, A. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0060-y · Cited by 265 · see citing works
Multicenter Development and Validation of a Risk Stratification Tool for Ward Patients
Churpek, M. M., Yuen, T. C., Winslow, C. J., Robicsek, A. A., Meltzer, D. O., Gibbons, R. D., & Edelson, D. P. (2014) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201406-1022oc · Cited by 258 · see citing works
He, L., Huang, Y., Ma, Z., Liang, C., Liang, C., & Liu, Z. (2016) · Scientific Reports · doi:10.1038/srep34921 · Cited by 253 · see citing works
Binuya, M. A. E., Engelhardt, E. G., Schats, W., Schmidt, M. K., & Steyerberg, E. W. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01801-8 · Cited by 246 · see citing works
Self-citationWaldeyer, C., Makarova, N., Zeller, T., Schnabel, R. B., Brunner, F. J., Jørgensen, T., Linneberg, A. R., Niiranen, T., Salomaa, V. V., Jousilahti, P., et al. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehx166 · Cited by 244 · see citing works
Coronary Functional Abnormalities in Patients With Angina and Nonobstructive Coronary Artery Disease
Suda, A., TAKAHASHI, J. C., Hao, K., Kikuchi, Y., Shindo, T., Ikeda, S., Sato, K., Sugisawa, J., Matsumoto, Y., Miyata, S., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.08.1056 · Cited by 223 · see citing works
Al‐Zaiti, S. S., Besomi, L., Bouzid, Z., Faramand, Z., Frisch, S. O., Martin‐Gill, C., Gregg, R. E., Saba, S., Callaway, C. W., & Sejdić, E. (2020) · Nature Communications · doi:10.1038/s41467-020-17804-2 · Cited by 198 · see citing works
Quantifying the added value of new biomarkers: how and how not
Cook, N. R. (2018) · Diagnostic and Prognostic Research · doi:10.1186/s41512-018-0037-2 · Cited by 198 · see citing works
Carotid Plaque Characteristics Predict Recurrent Ischemic Stroke and TIA
van Dam-Nolen, D. H. K., Truijman, M. T. B., van der Kolk, A. G., Liem, M. I., Schreuder, F. H. B. M., Boersma, E. H., Daemen, M. J. A. P., Mess, W. H., van Oostenbrugge, R. J., van der Steen, A. F. W., et al. (2022) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2022.04.003 · Cited by 193 · see citing works
Newman, C. B., Blaha, M. J., Boord, J. B., Cariou, B., Chait, A., Fein, H. G., Ginsberg, H. N., Goldberg, I. J., Murad, M. H., Subramanian, S., et al. (2020) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa674 · Cited by 180 · see citing works
Risk prediction models for contrast induced nephropathy: systematic review
Silver, S. A., Shah, P. S., Chertow, G. M., Harel, S., Wald, R., & Harel, Z. (2015) · BMJ · doi:10.1136/bmj.h4395 · Cited by 179 · see citing works
Comparison of Methods for Improving Fracture Risk Assessment in Diabetes: The Manitoba BMD Registry
Leslie, W. D., Johansson, H., McCloskey, E. V., Harvey, N. C., Kanis, J. А., & Hans, D. B. (2018) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3538 · Cited by 178 · see citing works
Oussalah, A., Rischer, S., Bensenane, M., Conroy, G., Filhine-Trésarrieu, P., Debard, R., Tramoy, D., Josse, T., Reinicke, D., Garcia, M., et al. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2018.03.029 · Cited by 167 · see citing works
Han, K., Song, K., & Choi, B. W. (2016) · Korean Journal of Radiology · doi:10.3348/kjr.2016.17.3.339 · Cited by 161 · see citing works
Polygenic risk scores in cardiovascular risk prediction: A cohort study and modelling analyses
Sun, L., Pennells, L. A. M., Kaptoge, S. K., Nelson, C. P., Abraham, G., Arnold, M., Bell, S., Bolton, T., Burgess, S., Dudbridge, F., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003498 · Cited by 161 · see citing works
Belard, A., Buchman, T. G., Forsberg, J. A., Potter, B. K., Dente, C. J., Kirk, A. D., & Elster, E. A. (2016) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-016-9849-1 · Cited by 160 · see citing works
Jiang, G., Luk, A. O. Y., Tam, C. H. T., Xie, F., Carstensen, B., Lau, E. S. H., Lim, C. K. P., Lee, H. M., Ng, A. C. W., Ng, M. C. Y., et al. (2019) · Kidney International · doi:10.1016/j.kint.2018.08.026 · Cited by 159 · see citing works
Sharma, N., Schwendimann, R., Endrich, O., Ausserhofer, D., & Simon, M. (2021) · BMC Health Services Research · doi:10.1186/s12913-020-05999-5 · Cited by 157 · see citing works
Wihersaari, L., Ashton, N. J., Reinikainen, M., Jakkula, P., Pettilä, V., Hästbacka, J., Tiainen, M., Loisa, P., Friberg, H., Cronberg, T., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06218-9 · Cited by 148 · see citing works
Liu, D., Liu, F., Xie, X., Su, L., Liu, M., Xie, X., Kuang, M., Huang, G., Wang, Y., Zhou, H., et al. (2020) · European Radiology · doi:10.1007/s00330-019-06553-6 · Cited by 145 · see citing works
Chen, M., Zhang, Q. H., Zhang, C., Zhao, X., Marra, G., Gao, J., Lv, X., Zhang, B., Fu, Y. S., Wang, F., et al. (2018) · Journal of Nuclear Medicine · doi:10.2967/jnumed.118.221010 · Cited by 124 · see citing works
Validation of a Machine Learning Algorithm to Predict 180-Day Mortality for Outpatients With Cancer
Manz, C. R., Chen, J., Liu, M., Chivers, C., Regli, S. H., Braun, J., Draugelis, M. E., Hanson, C. W., Shulman, L. N., Schuchter, L. M., et al. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2020.4331 · Cited by 116 · see citing works
Aliberti, M. J. R., Cenzer, I. S., Smith, A. K., Lee, S. J., Yaffe, K. S., & Covinsky, K. E. (2018) · Journal of the American Geriatrics Society · doi:10.1111/jgs.15683 · Cited by 115 · see citing works
Bos, D., Leening, M. J. G., Kavousi, M., Albert Hofman, D., Franco, O. H., van der Lugt, A., Vernooij, M. W., & Ikram, M. A. (2015) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.115.003843 · Cited by 115 · see citing works
Self-citationSegar, M. W., Hall, J. L., Jhund, P. S., Powell‐Wiley, T. M., Morris, A. A., Kao, D. P., Fonarow, G. C., Hernández, R., Ibrahim, N. E., Rutan, C. M., et al. (2022) · JAMA Cardiology · doi:10.1001/jamacardio.2022.1900 · Cited by 113 · see citing works
Van Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112 · see citing works
Self-citationCawthon, P. M., BLACKWELL, T. L., Cauley, J. A., Kado, D. M., Barrett-Connor, E. L., Lee, C. G., Hoffman, A. R., Nevitt, M. C., Stefanick, M. L., Lane, N. E., et al. (2015) · Journal of the American Geriatrics Society · doi:10.1111/jgs.13788 · Cited by 109 · see citing works
Kim, Y.-H., Nijst, P., Kiefer, K., & Tang, W. H. W. (2017) · Current Heart Failure Reports · doi:10.1007/s11897-017-0320-5 · Cited by 108 · see citing works
Recurrence of Pancreatic Neuroendocrine Tumors and Survival Predicted by Ki67
Genc, C., Falconi, M., Partelli, S., Muffatti, F., van Eeden, S., Doglioni, C., Klümpen, H., van Eijck, C. H. J., & van Dijkum, E. J. M. N. (2018) · Annals of Surgical Oncology · doi:10.1245/s10434-018-6518-2 · Cited by 107 · see citing works
Deep-learning-based out-of-hospital cardiac arrest prognostic system to predict clinical outcomes
Kwon, J., Jeon, K., Kim, H. M., Kim, M. J., Lim, S., Kim, K., Song, P. S., Park, J., Choi, R. K., & Oh, B. (2019) · Resuscitation · doi:10.1016/j.resuscitation.2019.04.007 · Cited by 105 · see citing works
Park, Y., Kim, S. U., Kim, B. K., Park, J. Y., Kim, D. Y., Ahn, S. H., Park, Y. E., Park, J. H., Lee, Y. I., Yun, H., et al. (2015) · Liver International · doi:10.1111/liv.12878 · Cited by 104 · see citing works
Walsh, C. G., Sharman, K., & Hripcsak, G. M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.10.008 · Cited by 102 · see citing works
Li, Y., Bisson, A., Bodin, A., Herbert, J., Grammatico‐Guillon, L., Joung, B., Wang, Y., Lip, G. Y. H., & Fauchier, L. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.119.012546 · Cited by 102 · see citing works
Development and Validation of a Pediatric Comorbidity Index
Sun, J. W., Bourgeois, F. T., Haneuse, S., Hernández–Dı́az, S., Landon, J. E., Bateman, B. T., & Huybrechts, K. F. (2020) · American Journal of Epidemiology · doi:10.1093/aje/kwaa244 · Cited by 102 · see citing works
Integrated genetic and epigenetic prediction of coronary heart disease in the Framingham Heart Study
Dogan, M. V., Grumbach, I. M., Michaelson, J. J., & Philibert, R. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190549 · Cited by 99 · see citing works
Strand, E., Pedersen, E. R., Svingen, G. F. T., Olsén, T., Bjørndal, B., Karlsson, T. R., Dierkes, J., Njølstad, P. R., Mellgren, G., Tell, G. S., et al. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.116.003620 · Cited by 99 · see citing works
Key steps and common pitfalls in developing and validating risk models
Wynants, L., Collins, P. G. S., & CALSTER, B. V. (2016) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14170 · Cited by 95 · see citing works
Schousboe, J. T., Vo, T., Taylor, B. C., Cawthon, P. M., Schwartz, A. V., Bauer, D. C., ORWOLL, E. S., Lane, N. E., Barrett-Connor, E. L., & Ensrud, K. E. (2015) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2713 · Cited by 95 · see citing works
Mehta, H. B., Li, S., An, H., Goodwin, J. S., Alexander, G. C., & Segal, J. B. (2022) · Annals of Internal Medicine · doi:10.7326/m21-4204 · Cited by 94 · see citing works
Prospective Associations of Systemic and Urinary Choline Metabolites with Incident Type 2 Diabetes
Svingen, G. F. T., Schartum-Hansen, H., Pedersen, E. R., Ueland, P. M., Tell, G. S., Mellgren, G., Njølstad, P. R., Seifert, R., Strand, E., Karlsson, T. R., et al. (2016) · Clinical Chemistry · doi:10.1373/clinchem.2015.250761 · Cited by 91 · see citing works
Net reclassification index at event rate: properties and relationships
Pencina, M. J., Steyerberg, E. W., & D’Agostino, R. B. (2016) · Statistics in Medicine · doi:10.1002/sim.7041 · Cited by 91 · see citing works
Self-citationDeBoer, M. D., Gurka, M. J., Golden, S. H., Musani, S. K., Sims, M., Vishnu, A., Guo, Y. M., & Pearson, T. A. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.10.088 · Cited by 88 · see citing works
Volpato, S., Bazzano, S., Fontana, A., Ferrucci, L., & Pilotto, A. (2014) · The Journals of Gerontology Series A · doi:10.1093/gerona/glu167 · Cited by 86 · see citing works
Yao, X., Gersh, B. J., Sangaralingham, L. R., Kent, D. M., Shah, N. D., Abraham, N. S., & Noseworthy, P. A. (2017) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2017.07.051 · Cited by 86 · see citing works
Dong, J., Buas, M. F., Gharahkhani, P., Kendall, B. J., Onstad, L., Zhao, S., Anderson, L. A., Wu, A. H., Ye, W., Bird, N. C., et al. (2017) · Gastroenterology · doi:10.1053/j.gastro.2017.12.003 · Cited by 85 · see citing works
Buse, G. L., Puelacher, C., Gualandro, D. M., Genini, A., Hidvegi, R., Bolliger, D., Arslani, K., Steiner, L. A., Kindler, C. H., Mueller, C. E., et al. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.08.041 · Cited by 84 · see citing works
Hahn, S.-J., Kim, S., Choi, Y. S., Lee, J., & Kang, J. (2022) · EBioMedicine · doi:10.1016/j.ebiom.2022.104383 · Cited by 83 · see citing works
Fairchild, K. D., Lake, D. E., Kattwinkel, J., Moorman, J. R., Bateman, D., Grieve, P. G., Isler, J. R., & Sahni, R. (2016) · Pediatric Research · doi:10.1038/pr.2016.215 · Cited by 83 · see citing works
Więckowska, B., Kubiak, K. B., Jóźwiak, P., Moryson, W., & Stawińska-Witoszyńska, B. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191610213 · Cited by 82 · see citing works
Cucchetti, A., Serenari, M., Sposito, C., Sandro, S. D., Mosconi, C., Vicentin, I., Garanzini, E. M., Mazzaferro, V., Carlis, L. G. D., Golfieri, R., et al. (2020) · Journal of Hepatology · doi:10.1016/j.jhep.2020.03.018 · Cited by 80 · see citing works
Baker, S. G., Schuit, E., Steyerberg, E. W., Pencina, M. J., Vickers, A. J., Moons, K. G. M., Mol, B. W., & Lindeman, K. S. (2014) · Statistics in Medicine · doi:10.1002/sim.6195 · Cited by 78 · see citing works
Self-citationMartineau, P., Leslie, W. D., Johansson, H., Odén, A., McCloskey, E. V., Hans, D. B., & Kanis, J. А. (2017) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3124 · Cited by 77 · see citing works
Nguyen, O. K., Makam, A. N., Clark, C., Zhang, S., Xie, B., Velasco, F., Amarasingham, R., & Halm, E. A. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2568 · Cited by 76 · see citing works
A deep learning-based electrocardiogram risk score for long term cardiovascular death and disease
Hughes, J. W., Tooley, J., Soto, J. T., Ostropolets, A., Poterucha, T. J., Christensen, M. K., Yuan, N., Ehlert, B., Kaur, D., Kang, G., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00916-6 · Cited by 76 · see citing works
Beyond Coronary Calcification, Family History, and C-Reactive Protein
Mody, P. S., Joshi, P. H., Khera, A., Ayers, C. R., & Rohatgi, A. K. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.03.538 · Cited by 76 · see citing works
Do air pollution and neighborhood greenness exposures improve the predicted cardiovascular risk?
Yitshak‐Sade, M., Kloog, I., & Novack, V. (2017) · Environment International · doi:10.1016/j.envint.2017.07.011 · Cited by 75 · see citing works
Novel Biomarkers to Improve the Prediction of Cardiovascular Event Risk in Type 2 Diabetes Mellitus
van der Leeuw, J., Beulens, J. W. J., van Dieren, S., Schalkwijk, C. G., Glatz, J. F. C., Hofker, M. H., Verschuren, W. M. M., Boer, J. M. A., van der Graaf, Y., Visseren, F. L. J., et al. (2016) · Journal of the American Heart Association · doi:10.1161/jaha.115.003048 · Cited by 75 · see citing works
Dynamic α-Fetoprotein Response and Outcomes After Liver Transplant for Hepatocellular Carcinoma
Halazun, K. J., Rosenblatt, R. E., Mehta, N. J., Lai, Q., Hajifathalian, K., Gorgen, A., Brar, G., Sasaki, K., Doyle, M. B. M., Tabrizian, P., et al. (2021) · JAMA Surgery · doi:10.1001/jamasurg.2021.0954 · Cited by 74 · see citing works
Seliger, S. L., de Lemos, J. A., Neeland, I. J., Christenson, R. H., Gottdiener, J. S., Drazner, M. H., Berry, J. D., Sorkin, J. D., & deFilippi, C. R. (2015) · JACC Heart Failure · doi:10.1016/j.jchf.2014.12.018 · Cited by 72 · see citing works
Cust, A. E., Drummond, M., Kanetsky, P. A., Mann, G. J., Cust, A. E., Schmid, H., Hopper, J. L., Aitken, J. F., Armstrong, B. K., Giles, G. G., et al. (2018) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.05.023 · Cited by 72 · see citing works
Effective hospital readmission prediction models using machine-learned features
Davis, S., Zhang, J., Lee, I., Rezaei, M., Greiner, R., McAlister, F. A., & Padwal, R. S. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08748-y · Cited by 68 · see citing works
Wang, Y., Wang, L., Yang, Y., & Lian, T. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114090 · Cited by 67 · see citing works
Ma, J., Siminoski, K. G., Alos, N., Halton, J., Ho, J., Lentle, B. C., Matzinger, M., Shenouda, N. F., Atkinson, S. A., Barr, R. D., et al. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-3096 · Cited by 67 · see citing works
Acute kidney injury as an independent risk factor for unplanned 90-day hospital readmissions
Sawhney, S., Marks, A., Fluck, N., McLernon, D. J., Prescott, G. J., & Black, C. (2017) · BMC Nephrology · doi:10.1186/s12882-016-0430-4 · Cited by 67 · see citing works
Radiomics approach for preoperative identification of stages I−II and III−IV of esophageal cancer
Wu, L., Wang, C., Tan, X.-Z., Cheng, Z., Zhao, K., Yan, L., Liang, Y., Liu, Z., & Liang, C. (2018) · Chinese Journal of Cancer Research · doi:10.21147/j.issn.1000-9604.2018.04.02 · Cited by 67 · see citing works
Baskaran, L., Danad, I., Gransar, H., Hartaigh, B. Ó., Schulman‐Marcus, J., Lin, F. Y.-H., Peña, J. M., Hunter, A. L., Newby, D. E., Adamson, P. D., et al. (2018) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2018.02.020 · Cited by 65 · see citing works
Kelly, P. J., Albers, G. W., Chatzikonstantinou, A., Marchis, G. M. D., Ferrari, J., George, P. M., Mira, K., Knoflach, M., Kim, J. S., Li, L., et al. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(16)30236-8 · Cited by 64 · see citing works
The PROGRESS Study Group, Ahnert, P., Creutz, P., Horn, K., Schwarzenberger, F., Kiehntopf, M., Hossain, H., Bauer, M. W., Brunkhorst, F. M., Reinhart, K., et al. (2019) · Critical Care · doi:10.1186/s13054-019-2316-x · Cited by 63 · see citing works
Iki, M., Fujita, Y., Tamaki, J., Kouda, K., Yura, A., Sato, Y., Moon, J., Winzenrieth, R., Okamoto, N., & Kurumatani, N. (2015) · Osteoporosis International · doi:10.1007/s00198-015-3092-3 · Cited by 63 · see citing works
Challenges of developing a cardiovascular risk calculator for patients with rheumatoid arthritis
Crowson, C. S., Rollefstad, S., Kitas, G. D., van Riel, P. L. C. M., Gabriel, S. E., & Semb, A. G. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174656 · Cited by 63 · see citing works
Lee, Y. J., Cho, K.-J., Kwon, O., Park, H., Lee, Y., Kwon, J., Park, J., Kim, J. S., Lee, M., Kim, A. J., et al. (2021) · Resuscitation · doi:10.1016/j.resuscitation.2021.04.013 · Cited by 62 · see citing works
Li, G., Esangbedo, I. C., Xu, L., Fu, J., Li, L., Feng, D., Han, L., Xiao, X., Li, M., Mi, J., et al. (2018) · Cardiovascular Diabetology · doi:10.1186/s12933-018-0707-y · Cited by 62 · see citing works
Mortensen, M. B., Nordestgaard, B. G., Afzal, S., & Falk, E. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw426 · Cited by 61 · see citing works
Sharouni, M. E., Stodell, M., Ahmed, T., Suijkerbuijk, K. P. M., Cust, A. E., Witkamp, A. J., Sigurdsson, V., van Diest, P. J., Scolyer, R. A., Thompson, J. F., et al. (2020) · Annals of Oncology · doi:10.1016/j.annonc.2020.11.015 · Cited by 60 · see citing works
Liu, J., Pek, S. L. T., Ang, K., Subramaniam, T., Lim, S. C., & study, F. S. (2017) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2017-00930 · Cited by 60 · see citing works
Buse, G. L., Mauermann, E., Ionescu, D. C., Szczeklik, W., Hert, S. G. D., Filipovic, M., Beck‐Schimmer, B., Spadaro, S., Matute, P., Bolliger, D., et al. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.02.030 · Cited by 58 · see citing works
Key Concepts and Limitations of Statistical Methods for Evaluating Biomarkers of Kidney Disease
Parikh, C. R., & Thiessen‐Philbrook, H. (2014) · Journal of the American Society of Nephrology · doi:10.1681/asn.2013121300 · Cited by 58 · see citing works
In which patients does lumbar spine trabecular bone score (TBS) have the largest effect?
Martineau, P., Leslie, W. D., Johansson, H., Harvey, N. C., McCloskey, E. V., Hans, D., & Kanis, J. A. (2018) · Bone · doi:10.1016/j.bone.2018.05.026 · Cited by 58 · see citing works
Zhang, Y., Zhang, Y., Sholle, E., Abedian, S., Sharko, M., Turchioe, M. R., Wu, Y., & Ancker, J. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0235064 · Cited by 57 · see citing works
Xu, B., Dong, S.-Y., Bai, X., Song, T., Zhang, B., Zhou, L., Chen, Y., Zeng, Z., Wang, K., Zhao, H., et al. (2022) · Liver Cancer · doi:10.1159/000528034 · Cited by 56 · see citing works
Paige, E., Barrett, J., Pennells, L. A. M., Sweeting, M. J., Willeit, P., Angelantonio, E. D., Gudnason, V. G., Nordestgaard, B. G., Psaty, B. M., Goldbourt, U., et al. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx149 · Cited by 56 · see citing works
Bjornstad, P., Maahs, D. M., Rivard, C. J., Pyle, L., Rewers, M., Johnson, R. J., & Snell‐Bergeon, J. K. (2014) · Acta Diabetologica · doi:10.1007/s00592-014-0611-1 · Cited by 55 · see citing works
Leening, M. J. G., Steyerberg, E. W., CALSTER, B. V., D’Agostino, R. B., & Pencina, M. J. (2014) · Statistics in Medicine · doi:10.1002/sim.6133 · Cited by 55 · see citing works
Self-citationVanhaverbeke, M., Attard, R., Barteková, M., Ben‐Aicha, S., Brandenburger, T., de Gonzalo‐Calvo, D., Emanueli, C., Farrugia, R. C., Grillari, J., Hackl, M., et al. (2021) · Cardiovascular Research · doi:10.1093/cvr/cvab327 · Cited by 54 · see citing works
Thomas, L. E., O'Brien, E. C., Piccini, J. P., D’Agostino, R. B., & Pencina, M. J. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy345 · Cited by 54 · see citing works
Self-citationPrediction modeling—part 1: regression modeling
Au, E. H. K., Francis, A., Bernier-Jean, A., & Teixeira-Pinto, A. M. (2020) · Kidney International · doi:10.1016/j.kint.2020.02.007 · Cited by 54 · see citing works
A CT-based radiomics nomogram for distinguishing between benign and malignant bone tumours
Sun, W., Liu, S., Guo, J., Liu, S., Hao, D., Hou, F., Wang, H., & Xu, W. (2021) · Cancer Imaging · doi:10.1186/s40644-021-00387-6 · Cited by 53 · see citing works
- Authors
- Leening, M. J. G., Vedder, M. M., Witteman, J. C. M., Pencina, M. J., & Steyerberg, E. W.
- Affiliations
- Duke University (US)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2014-01-21
- Volume
- 160
- Issue
- 2
- Pages
- 122-131
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2103645914
- Cited by
- 594
- References
- 141
- Citations by year
- 2026: 38 · 2025: 30 · 2024: 41 · 2023: 59 · 2022: 59 · 2021: 53 · 2020: 56 · 2019: 39 · 2018: 49 · 2017: 44 · 2016: 55 · 2015: 47 · 2014: 23
- FWCI
- 7.11
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- RePub (Erasmus University Rotterdam) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- net reclassification improvement, risk prediction model, model calibration, cost-effectiveness, reporting quality
- MeSH terms
- Data Interpretation, Statistical, Decision Support Techniques, Humans, Models, Statistical, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review