Interpreting Incremental Value of Markers Added to Risk Prediction Models
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
The discrimination of a risk prediction model measures that model's ability to distinguish between subjects with and without events. The area under the receiver operating characteristic curve (AUC) is a popular measure of discrimination. However, the AUC has recently been criticized for its insensitivity in model comparisons in which the baseline model has performed well. Thus, 2 other measures have been proposed to capture improvement in discrimination for nested models: the integrated discrimination improvement and the continuous net reclassification improvement. In the present study, the authors use mathematical relations and numerical simulations to quantify the improvement in discrimination offered by candidate markers of different strengths as measured by their effect sizes. They demonstrate that the increase in the AUC depends on the strength of the baseline model, which is true to a lesser degree for the integrated discrimination improvement. On the other hand, the continuous net reclassification improvement depends only on the effect size of the candidate variable and its correlation with other predictors. These measures are illustrated using the Framingham model for incident atrial fibrillation. The authors conclude that the increase in the AUC, integrated discrimination improvement, and net reclassification improvement offer complementary information and thus recommend reporting all 3 alongside measures characterizing the performance of the final model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Despite this modest effect, the inclusion of the GRS into the predictive model consistently improved the assignment of the risk of progression, as expressed by the net reclassification improvement (NRI) index21.”
From New insights into the genetic etiology of Alzheimer’s disease and related dementias (2022) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Grundy, S. M., Bilheimer, D. W., Chait, A., Clark, L. T., Denke, M. A., Havel, R. J., Hazzard, W. R., Hulley, S. B., Hunninghake, D. B., Kreisberg, R. A., et al. (1993) · JAMA · doi:10.1001/jama.269.23.3015 · Cited by 27,947
Expert Panel on Detection, E. (2001) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.285.19.2486 · Cited by 26,011
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581
Self-citationGeneral Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Self-citationPencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493
Self-citationDecision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341
On the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Research works printed but not linked: 1
- D'Agostino RB, Griffith JL, Schmidt CH, et al. Proceedings of the Biometrics Section. Alexandria, VA: American Statistical Association, Biometrics Section; 1997. Measures for evaluating model performance; pp. 253–258. [Google Scholar]
Cited by
Items 401–500 of 517
Hilkens, N. A., Li, L., Rothwell, P. M., Algra, A., & Greving, J. P. (2020) · European Stroke Journal · doi:10.1177/2396987319898064 · Cited by 4
“Calculation of both traditional performance measures (c-statistic, calibration plots) and newer reclassification measures is currently recommended to assess added value of new predictors, as these measures provide complementary information.(29) Ultimately, the best way to assess robustness of a model extension is by e…”
BackgroundResultLee, Y., Lim, N.-K., & Park, H. (2025) · BMC Public Health · doi:10.1186/s12889-025-21567-0 · Cited by 4
Nathaniel, U., Erhardt, E. B., Kumar, D. S., Wu, J., Miller, S. D., Chauhan, P., Keskin, R., Wick, T. V., Yeates, K. O., Meier, T. B., et al. (2025) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2025.100600 · Cited by 2
“Overall model performance was therefore characterized as weak (0.51 – 0.60), moderate (0.61 – 0.70), or good ( > 0.71) based on the AUC for each domain using published criteria (de Hond et al., 2022; Pencina et al., 2012).”
InfluentialCreatine-kinase and dialysis patients, a helpful tool for stratifying cardiovascular risk?
Quiroga, B., Vega, A., Abad, S., Villaverde, M., Reque, J., & López–Gómez, J. M. (2016) · Nefrología (English Edition) · doi:10.1016/j.nefroe.2016.01.010 · Cited by 2
Côté, N., Fortier, C., Desbiens, L., Nemcsik, J., & Agharazii, M. (2024) · Journal of Human Hypertension · doi:10.1038/s41371-023-00888-w · Cited by 2
“The ICPS risk categories did not show a statistically signi fi cant improvement of C-statistics but showed a clinically signi fi cant cNRI when compared to PWV, cPP and AIx@75 in our cohort of patients [19].”
He, J., Fan, B., Lau, E. S. H., Chu, N. H. S., Ng, N. Y. H., Leung, K. H. T., Poon, E. W. M., Kong, A. P. S., Ronald, C. W., Luk, A. O. Y., et al. (2024) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2023-003768 · Cited by 2
“They also had higher plasma total protein, TC, TG, LDL-c, and uACR but lower HDL-c and serum potassium (p=0.016) (table 1).”
BackgroundInfluentialTanaka, M., Sato, T., Gohda, T., Kamei, N., Murakoshi, M., Ishiwata, E., Nakata, K., Akiyama, Y., Endo, K., Kawaharata, W., et al. (2025) · Clinical Kidney Journal · doi:10.1093/ckj/sfaf056 · Cited by 2
Esteghamati, A., Hafezi‐Nejad, N., Sheikhbahaei, S., Heidari, B., Zandieh, A., & Eslami, V. (2014) · Frontiers in Neurology · doi:10.3389/fneur.2014.00009 · Cited by 2
“Recent studies have shown that C-statistics is not sensitive to show discrimination of an additive model (11).”
BackgroundBarbati, G., & Farcomeni, A. (2017) · Statistical Methods & Applications · doi:10.1007/s10260-017-0410-2 · Cited by 2
“An interpretation of 1/2 NRI has been outlined in Pencina et al. (2012), where thresholds of 10, 20 and 30% have been indicated as weak, moderate and strong evidence of improvement.”
Preoperative PFTs: The answer is blowing in the wind
Kurlansky, P. A. (2015) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2015.12.024 · Cited by 2
“Finally, improvements in area under the curve values are generally considered an inadequate major criterion for determining the value of added components to a risk model.(11) The shortcomings of this study provide no assurance that the question raised in the opening sentence has been adequately addressed.”
BackgroundBlood Pressure Indexes Associated With Mortality and Cardiovascular Outcomes—Reply
Yang, W., Zhang, Z., Staessen, J. A., & for the International Database on Ambulatory Blood Pressure in Relation to Cardiovascular Outcomes (IDACO) Investigators (2019) · JAMA · doi:10.1001/jama.2019.16839 · Cited by 3
Hoffman, D. B., Shui, A. M., Gill, R. M., Syed, S. M., & Mehta, N. J. (2023) · Cancers · doi:10.3390/cancers15092433 · Cited by 1
Nagase, T., Kikuchi, T., Akai, S., Himeno, M., Ooyama, R., Yoshida, Y., Yoshino, C., Nishida, T., Tanaka, T., Ishino, M., et al. (2024) · Journal of Arrhythmia · doi:10.1002/joa3.13148 · Cited by 1
Bordoy, J. P., Leiva, A., Ariza, M. J. A., Elosúa, R., Carratalà, F. R., Romaguera, D., Salas‐Salvadó, J., Babió, N., Martínez‐González, M. Á., Toledo, E., et al. (2025) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2024.10.011 · Cited by 1
Prediction of cardiovascular events by algorithm- and formula-based pulse wave velocity
Desbiens, L., Veillette, S., Fortier, C., Nadeau‐Fredette, A., Hametner, B., Wassertheurer, S., Madore, F., Agharazii, M., & Goupil, R. (2025) · Journal of Hypertension · doi:10.1097/hjh.0000000000004176 · Cited by 1
Florin, T. A., Reeder, R., Ambroggio, L., Ruddy, R. M., Shah, S. S., Cator, A. D., Lipshaw, M. J., Capraro, G. A., Sartori, L. F., Cheng, A. Y., et al. (2025) · Journal of Hospital Medicine · doi:10.1002/jhm.70220 · Cited by 1
“38 Alternative measures, such as the weighted NRI or likelihood ratio tests, will be explored.”
Design and rationale of the WARRIOR ancillary study for coronary CT angiographic analysis
Tamarappoo, B. K., Wolny, R., Tomasino, G. F., Berman, D. S., Handberg, E. M., Pepine, C. J., Lo, M. C., Budoff, M. J., Shaw, L. J., SHUFELT, C. L., et al. (2026) · American Heart Journal · doi:10.1016/j.ahj.2026.107340 · Cited by 1
Gokhale, T., Dey, S., Limpitikul, W. B., Gautam, N., Alaref, S. J., Cross, B. J., Saba, S., Estes, N. A. M., Vaughan, B. L., Jones, S. R., et al. (2026) · JACC. Clinical electrophysiology · doi:10.1016/j.jacep.2026.01.051 · Cited by 1
Choi, J., Lee, H., Rhee, T., Park, J., & Kwak, S. H. (2026) · Journal of Diabetes Investigation · doi:10.1111/jdi.70304 · Cited by 1
Gözgöz, H., Kabul, S., & Doruk, Ö. G. (2026) · Lipids in Health and Disease · doi:10.1186/s12944-026-02952-z · Cited by 1
Kakihara, S., Shah, J., Zhuang, K., & Fawzi, A. A. (2026) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2026.07.014 · Cited by 1
Atay, G., Erdoğan, S., Pençe, İ., Pence, M. E., & Kurt, D. (2026) · Pediatrics International · doi:10.1111/ped.70498 · Cited by 1
Han, Y., Chen, X., & Zhang, Y. (2026) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.70882 · Cited by 1
“Methodological work on new biomarkers recommends comparing a base model with the same model after addition of the candidate marker, so that improvements are not conflated with differences in covariate structure [2].”
Chen, J., Li, H., Liang, Y., Wang, X., & Meng, Z. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1790930 · Cited by 1
Sugawara, H., Tanaka, M., Yano, T., Yoshida, K., Kimura, Y., Matsui, A., Higashiura, Y., Matsumoto, T., Nishisato, K., Nishimura, M., et al. (2026) · Circulation Journal · doi:10.1253/circj.cj-26-0166 · Cited by 1
Heller, G., Seshan, V., Moskowitz, C. S., & Gönen, M. (2015) · Collection of Biostatistics Research Archive · Cited by 1
Granulomatous mass adherent to a patent foramen ovale occluder:
Ancédy, Y., Brunet, A. B., Quilliet, L., Mirza, A., & Fauchier, L. (2013) · European Heart Journal · doi:10.1093/eurheartj/eht173 · Cited by 1
Asymptotic and Finite Sample Behavior of Net Reclassification Indices
Wang, Z. (2013) · Collection of Biostatistics Research Archive · Cited by 1
Singh, S. K. S. (2016) · TSpace (University of Toronto) · Cited by 1
Appelhans, B. M., Lange‐Maia, B. S., Gabriel, K. P., Karvonen-Gutierrez, C. A., Karavolos, K., Dugan, S. A., Greendale, G. A., Avery, E., Sternfeld, B., Janssen, İ., et al. (2019) · Aging Clinical and Experimental Research · doi:10.1007/s40520-019-01355-8 · Cited by 1
Moreno, V. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-815923-1.00002-x · Cited by 1
Zelis, N., Buijs, J., de Leeuw, P. W., & Stassen, P. M. (2020) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2020.07.016 · Cited by 1
Hsein, Y.-C., Wu, I.-J., Tan, J., Huang, S., Lu, K., Su, C., Hsu, W., Chen, S., & Lee, C. (2022) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000003793 · Cited by 1
“Reclassification was assessed using the net reclassification improvement (NRI) which evaluates the overall improvement in reclassification with the new models, and integrated discriminative improvement (IDI), which is a category-free indicator that demonstrates overall improvement in both discrimination and reclassifi…”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., loannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2023) · Вопросы современной педиатрии · doi:10.15690/vsp.v22i2.2557 · Cited by 1
Improving Discrimination in Predicting Level of Care Needed for Patients Admitted with Pneumonia
Katz, D. E., Leibner, G., Kaufman, N., Esayag, Y., Brammli‐Greenberg, S., & Rose, A. J. (2025) · Journal of General Internal Medicine · doi:10.1007/s11606-025-09610-7 · Cited by 1
“13,14 We also showed how our model was able to assign quite different levels of risk to patients who were assigned to the same risk group by the CURB-65 model (Table 3 and Fig.”
Vargek, P., Karakatič, S., & Bakračevič, K. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14040056 · Cited by 1
“…be approximately compared to more familiar effect size measures, whereby a weak effect (d = 0.2) corresponds to an AUC value of 0.56, moderate effect size (d = 0.5) corresponds to an AUC value of 0.64, while a large effect size (d = 0.8) corresponds to an AUC value of 0.71 (Pencina et al., 2012).”
InfluentialBarbati, G., Farcomeni, A., Pasqualetti, P., Sinagra, G., & Bovenzi, M. (2022) · Epidemiology Biostatistics and Public Health · doi:10.2427/10003 · Cited by 1
“[18] Pencina MJ, D'Agostino RB, Pencina KM, Janssens AC, Greenland P, Interpreting Incremental Value of Markers Added to Risk Prediction Models.”
BackgroundAgarwal, R. (2012) · Hypertension · doi:10.1161/hypertensionaha.111.00053 · Cited by 1
Risk Stratification in Hypertrophic Cardiomyopathy: Highly Effective, But Could It Be Better?
Maron, M. S. (2017) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.117.006674 · Cited by 1
“A requirement for all potentially new clinically relevant imaging or biomarkers is to show that they improve on or strengthen the current predictive risk model, rather than only demonstrating statistical significance in a multivariate analysis.(8) Many robust statistical methods can now be applied to characterize the…”
Sharafoddini, A. (2019) · UWSpace (University of Waterloo) · Cited by 2
Methods for individual participant data meta-analysis in prediction research
de Jong, V. M. T. (2020) · Utrecht University Repository (Utrecht University) · doi:10.33540/469 · Cited by 1
Dihge, L., Bendahl, P., Skarping, I. D., Hjärtström, M., Ohlsson, M., & Rydén, L. (2022) · Research Square · doi:10.21203/rs.3.rs-1475276/v1 · Cited by 1
New Biomarkers in Heart Failure: The Bar is High
Hale, S., & Yancy, C. W. (2022) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2022.09.010 · Cited by 1
Discontinuation of antipsychotics among residents of saskatchewan long-term care facilities
Glew, R. A. (2014) · University Library - University of Saskatchewan (University of Saskatchewan)
Explained variation for recurrent event data
Alotaibi, R. M., Fiaccone, R. L., Henderson, R., & Stare, J. (2015) · Biometrical Journal · doi:10.1002/bimj.201300143
“…2015 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim Recent work has included interest in the added value of a new marker (e.g., Cook, 2007; Pepe et al., 2007; Pencina et al., 2008, Pencina et al., 2012; Steyerberg et al., 2010; Kerr et al., 2012) albeit with most attention on a single time point.”
BackgroundPaynter, N. P., Everett, B. M., & Cook, N. R. (2014)
Vedder, M. M. (2016) · RePub (Erasmus University Rotterdam)
Home blood pressure and treatment decisions: caveat emptor
Angeli, F., Reboldi, G., & Verdecchia, P. (2016) · Journal of Hypertension · doi:10.1097/hjh.0000000000000999
Singleton, K. (2016) · eScholarship (California Digital Library) · Cited by 1
Optimisation of GnRH antagonist use in ART
Hamdine, O. (2014) · Utrecht University Repository (Utrecht University)
Risk Prediction and Risk Classification
Wassertheil-Smoller, S. W., & Smoller, J. W. (2014) · Springer eBooks · doi:10.1007/978-1-4939-2134-8_9
Jiang, B.-Y., & Li, J.-L. (2018) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2017.08.010 · Cited by 1
“Earlier authors (Pencina et al., 2012; Leening et al., 2014) usually prefer the confidence interval approach to 18 make inference in lieu of the hypothesis test approach.”
BackgroundMethodThakur, H. (2018) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Brown, J. R. (2017) · University of Minnesota Digital Conservancy (University of Minnesota)
The role of muscle-enriched microRNAs as markers of failed myocardial reperfusion
Lima, C., & Anselmo, J. (2019)
Pang, C. L. (2020) · PEARL (University of Plymouth) · doi:10.24382/878
Predicting adverse outcomes in older medical emergency department patients
Zelis, N. (2020) · Research Publications (Maastricht University) · doi:10.26481/dis.20201216nz
Verwijmeren, L. (2021) · Utrecht University Repository (Utrecht University) · doi:10.33540/524
Huang, X., Zhou, J., Zhang, H., Gao, P., Wang, L., Yang, Y., Jiang, X., Chen, L., & Hua, F. (2021) · Research Square · doi:10.21203/rs.3.rs-579117/v1
van Sloten, T. T. (2015) · Research Publications (Maastricht University) · doi:10.26481/dis.20150520ts
Bayesian Network Models with Decision Tree Analysis for Management of Childhood Malaria in MalawiPreprint
Taneja, S. B., Douglas, G. P., Cooper, G. F., Michaels, M. G., Drużdżel, M. J., & Visweswaran, S. (2020) · doi:10.21203/rs.3.rs-60209/v1
Bayesian Network Models with Decision Tree Analysis for Management of Childhood Malaria in MalawiPreprint
Taneja, S. B., Douglas, G. P., Cooper, G. F., Michaels, M. G., Drużdżel, M. J., & Visweswaran, S. (2021) · doi:10.21203/rs.3.rs-60209/v2
The epidermal growth factor receptor pathway in polycystic kidney disease
Harskamp, L. R. (2023) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.583771151
Lin, X., Qiao, N., Shen, Y., Fang, H., Xue, Q., Cui, B., Chen, L., Zhu, H., Zhang, S., Chen, Y., et al. (2023) · doi:10.1158/1078-0432.c.6530297
ROC methods in biomarker development
Attwood, K. M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-12-815247-8.00013-9
Wang, S., Xie, Z., Wang, F., & Zhang, W. (2024) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2024.1429431
“In examining whether the addition of the echocardiographic indices further improves the model performance based on the mC 2 HEST score, novel metrics IDI and RNI are introduced as alternatives to the increase in the area under the ROC curve.”
BackgroundInfluentialBordoy, J. P., Leiva, A., Ariza, M. J. A., Elosúa, R., Carratalà, F. R., Romaguera, D., Salas‐Salvadó, J., Babió, N., Martínez‐González, M. Á., Toledo, E., et al. (2024) · Medicina Clínica · doi:10.1016/j.medcli.2024.10.010
Allo, I. J. T., Pramudyo, M., & Akbar, M. R. (2025) · Open Access Emergency Medicine · doi:10.2147/oaem.s493878
“39 In this study, the baseline GRACE score’s AUC and C-statistic value were good (AUC: 0.839), which is comparable to one reported in a systematic review (C-statistic 0.83 (95% CI 0.72–0.90)).”
InfluentialAssessing Incremental Value of Added Predictors in Cardiovascular Risk Prediction Models
Gajjar, P., Nayor, M. G., & Duncan, M. S. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15734-9.00030-3
Shi, Q., Jang, H., Wang, M., Yeung, S. L. A., Luo, S., Wan, E. Y. F., Sharp, S. J., Brage, S., Wareham, N. J., & Kim, Y. (2025) · Scientific Reports · doi:10.1038/s41598-025-99536-1
“…NRI (according to the threshold of 7.5% for LBM and PCE and 10% for SCORE2), and IDI (calculated based on the sum of the integrated sensitivity and integrated specificity, indicative of improvements in the slopes of the discrimination curves) as additional parameters of discrimination 22 .”
InfluentialOakley, P. A., Moustafa, I. M., Betz, J. W., Jaeger, J. O., & Harrison, D. E. (2025) · Healthcare · doi:10.3390/healthcare13233163
“Note: The sacral base angle (SBA) showed a moderate ability [34] to discriminate between the normal and acute low back pain groups.”
Lipoprotein(a) Elevation for Refining Risk Stratification With the PREVENT Equations
Mangalesh, S., & Nanna, M. G. (2025) · JAMA Cardiology · doi:10.1001/jamacardio.2025.4450
Multimorbidity measurement strategies for predicting hospital visits
Neves, B. D., Moreira, J. M., Gonçalves, S., Cerejo, J., Mota, I., Silva, N. A., Leite, F., & Silva, M. J. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13817-z
Qu, R., Hu, L., Ling, Y., Hou, Y., Fang, H., Zhang, H., Liang, S., He, Z., Fang, M., Li, J., et al. (2020) · Figshare · doi:10.6084/m9.figshare.13278713
Tian, X.-X., Luo, J.-Y., Liu, F., Qiu, Y.-J., Luo, F., Zeng, L., Zhang, Z.-R., Yang, Y.-N., & Li, X. (2023) · Figshare · doi:10.6084/m9.figshare.22622399
Wang, Y., Chen, Y., Chen, R., Xu, Y., Zheng, H., Xu, J., Xia, J., Cai, Y., Xu, H., & Wang, X. (2023) · Figshare · doi:10.6084/m9.figshare.24266052
Qu, R., Hu, L., Ling, Y., Hou, Y., Fang, H., Zhang, H., Liang, S., He, Z., Fang, M., Li, J., et al. (2020) · Figshare · doi:10.6084/m9.figshare.13278716
Additional file 1 of Prognostic value of serum α-HBDH levels in patients with lung cancer
Yuan, Z., Wang, L.-H., & Chen, C. (2023) · Figshare · doi:10.6084/m9.figshare.22621354
Taneja, S. B., Douglas, G. P., Cooper, G. F., Michaels, M. G., Drużdżel, M. J., & Visweswaran, S. (2021) · Figshare · doi:10.6084/m9.figshare.14608648
Nan, M. N. (2025) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya)
Sakaguchi, R., Joh, K., Honma, S., Shimizu, A., Hashiguchi, A., Katafuchi, R., Nishikawa, M., Koike, K., Hirano, K., Tsuboi, N., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-37412-2
“In addition, we calculated the integrated discrimination improvement (IDI) and the continuous net reclassification index (cNRI) 24,25 to assess whether Model 2-OX and Model 2-JHG led to better reclassification of the primary endpoint at 1, 5, and 10 years compared with Model 1.”
Yoshida, Y., Kumada, T., Hirooka, M., Ogawa, S., Yamahira, M., Gotoh, T., Kamada, Y., Sumida, Y., Shimizu, M., Hiasa, Y., et al. (2026) · Journal of Gastroenterology · doi:10.1007/s00535-026-02392-7
Wu, Y., Sun, D., Zhou, Z., Li, D., Gao, Y., Shen, C., Mei, Y., Ding, X., & Cheng, F. (2026) · BMC Medicine · doi:10.1186/s12916-026-04788-x
彭, 娇. (2026) · Advances in Clinical Medicine · doi:10.12677/acm.2026.1641598
Nathaniel, U., Erhardt, E. B., Kumar, D. S., Wu, J., Miller, S. D., Chauhan, P., Keskin, R., Wick, T. V., Yeates, K. O., Master, C. L., et al. (2026) · Journal of Neurotrauma · doi:10.1177/08977151261442218
Genetic and non-genetic influences on birth weight and type 2 diabetes
WEDEKIND, L. E. (2022) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-zbzo7yrkn
Hanson, R. L., Kobes, S., WEDEKIND, L. E., Arreola, E. V., Ramirez-Luzuriaga, M. J., & Hsueh, W. (2026) · BMC Medical Genomics · doi:10.1186/s12920-026-02386-7
“The NRI, on the other hand, is a measure of reclassification that is less dependent on strength of the other covariates [49].”
InfluentialZhang, Z., Han, S., Li, P., Guan, B., Chen, G., Wei, J., Chu, Q., Zhao, X., Li, J., & Li, R. (2026) · Medicine · doi:10.1097/md.0000000000049190
“[53] In addition, these parameters are derived from standard lipid profiles without additional cost.”
Shiohama, A., Sasaki, T., Abe, Y., Shikimoto, R., & Arai, Y. (2026) · GeroScience · doi:10.1007/s11357-026-02355-z
Adebiyi, E. O., Kim, S., LaPar, D. J., Mallula, K. K., Bauser‐Heaton, H. D., & Prada-Ruiz, A. C. (2026) · Research Square · doi:10.21203/rs.3.rs-9890150/v1
Aida, H., Tanaka, M., Sato, T., Abe, K., Nishizawa, K., Kawaharata, W., Matsumori, R., Hosaka, I., Akiyama, Y., Nakata, K., et al. (2026) · Circulation Journal · doi:10.1253/circj.cj-26-0114
Zeng, Q., Tang, W., He, Z., & Xu, C. (2026) · Laparoscopic Endoscopic and Robotic Surgery · doi:10.1016/j.lers.2026.06.003
Dojcsak, L., Abegaz, T., Islam, M., Chandler, Y., Maleku, A., Doubeni, A., Mohammed, B., Langston, M. A., & Islam, M. M. (2026) · medRxiv · doi:10.64898/2026.06.23.26356305
Beattie, S., Newton, A., AlSumadi, M., Akbar, Z., Cheung, G., & Brown, D. (2026) · Annals of The Royal College of Surgeons of England · doi:10.1308/rcsann.2026.0057
Kord, N., Asgari, S., Tohidi, M., Hosseinpour‐Niazi, S., Azizi, F., & Hadaegh, F. (2026) · Journal of Clinical Laboratory Analysis · doi:10.1002/jcla.70314
“In general, an effect size greater than 0.8 for a predictor (i.e., HR ≥ 2) is commonly regarded as indicating a strong association, and incorporating such a variable into a model may lead to a meaningful improvement in the IDI index [38, 39].”
InfluentialWu, Z., Zhang, Y., Tan, X., Zhou, X., Wang, X., Jiang, H., Chang, L., Xu, A., Fan, H., & Zhou, Y. (2026) · Cardiovascular Diabetology · doi:10.1186/s12933-026-03274-1
Reconstruction of Imagined Melody with Relative Pitch Decoding in Electrocorticography
Kwon, J., Shin, Y., Kim, J. S., Jeong, E., Kim, S.-P., Lee, E. J., & Chung, C. K. (2026) · eNeuro · doi:10.1523/eneuro.0289-25.2026
“For the fi rst selected feature, the increment value was de fi ned as the difference between the decoding accuracy achieved using the feature alone and the CL (Pencina et al., 2012).”
Guo, Y., Guo, C., Ji, D., & Niu, X. (2026) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.70923
Metadata
- Authors
- Pencina, M. J., D'Agostino, R. B., Pencina, K. M., Janssens, A. C. J. W., & Greenland, P.
- Affiliations
- Boston University (US)
- Corresponding author
- Pencina, Michael J.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-08-08
- Volume
- 176
- Issue
- 6
- Pages
- 473-481
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- PMC
- PMC3530349
- OpenAlex
- W2157026796
- Cited by
- 506
- References
- 37
- Citations by year
- 2026: 36 · 2025: 26 · 2024: 22 · 2023: 30 · 2022: 38 · 2021: 43 · 2020: 45 · 2019: 32 · 2018: 32 · 2017: 30 · 2016: 45 · 2015: 44 · 2014: 50 · 2013: 25 · 2012: 6
- FWCI
- 38.21
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Epidemiology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Funders
- National Institutes of Health (UL1TR000150, n01hc25195-41-0-1)
- National Heart, Lung, and Blood Institute (N01‐HC25195, N01-HC-025195, RC1HL101056)
- National Center for Research Resources (UL1RR025741)
- National Center for Advancing Translational Sciences
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- risk prediction model, model discrimination, area under the receiver operating characteristic, integrated discrimination improvement, nested model comparison, effect size, Framingham risk score, incident atrial fibrillation
- MeSH terms
- Adult, Aged, Aged, 80 and over, Atrial Fibrillation, Computer Simulation, Data Interpretation, Statistical, Humans, Middle Aged, Prognosis, Risk Factors, ROC Curve, Biomarkers, Logistic Models, Odds Ratio, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.