AKIpredictor, an online prognostic calculator for acute kidney injury in adult critically ill patients: development, validation and comparison to serum neutrophil gelatinase-associated lipocalin
Abstract
Purpose Early diagnosis of acute kidney injury (AKI) remains a major challenge. We developed and validated AKI prediction models in adult ICU patients and made these models available via an online prognostic calculator. We compared predictive performance against serum neutrophil gelatinase-associated lipocalin (NGAL) levels at ICU admission.Methods Analysis of the large multicenter EPaNIC database. Model development (n = 2123) and validation (n = 2367) were based on clinical information available (1) before and (2) upon ICU admission, (3) after 1 day in ICU and (4) including additional monitoring data from the first 24 h. The primary outcome was a comparison of the predictive performance between models and NGAL for the development of any AKI (AKI-123) and AKI stages 2 or 3 (AKI-23) during the first week of ICU stay.Results Validation cohort prevalence was 29% for AKI-123 and 15% for AKI-23. The AKI-123 model before ICU admission included age, baseline serum creatinine, diabetes and type of admission (medical/surgical, emergency/planned) and had an AUC of 0.75 (95% CI 0.75-0.75). The AKI-23 model additionally included height and weight (AUC 0.77 (95% CI 0.77-0.77)). Performance consistently improved with progressive data availability to AUCs of 0.82 (95% CI 0.82-0.82) for AKI-123 and 0.84 (95% CI 0.83-0.84) for AKI-23 after 24 h. NGAL was less discriminant with AUCs of 0.74 (95% CI 0.74-0.74) for AKI-123 and 0.79 (95% CI 0.79-0.79) for AKI-23.Conclusions AKI can be predicted early with models that only use routinely collected clinical information and outperform NGAL measured at ICU admission. The AKI-123 models are available at http://akipredictor.com/ . Trial registration Clinical Trials.gov NCT00512122.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many research groups have tackled early prediction of AKI using electronic health records data, but no model so far explains the rationale behind specific predictions despite a clear need for explainable and actionable predictions.
“Many research groups have tackled early prediction of AKI using electronic health records (EHR) data [8–11], but no model so far explains the rationale behind specific predictions despite a clear need for explainable and actionable predictions [6, 12].”
From Machine learning model for early prediction of acute kidney injury (AKI) in pediatric critical care (2021) · cites this paper as [11]
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058 · see citing works
KDIGO Clinical Practice Guidelines for Acute Kidney Injury
Khwaja, A. (2012) · Nephron Clinical Practice · doi:10.1159/000339789 · Cited by 8,039 · see citing works
Intravenous Fluids and Acute Kidney Injury
Ding, X., Cheng, Z., & Qian, Q. (2017) · Blood Purification · doi:10.1159/000452702 · Cited by 6,866 · see citing works
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170 · see citing works
Rosa, S. D., Samoni, S., Villa, G., & Ronco, C. (2017) · Blood Purification · doi:10.1159/000452650 · Cited by 5,037 · see citing works
Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study
Hoste, E. A. J., Bagshaw, S. M., Bellomo, R., Cely, C. M., Colman, R., Cruz, D. N., Edipidis, K., Forni, L. G., Gomersall, C. D., Govil, D., et al. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3934-7 · Cited by 3,107 · see citing works
Bellomo, R., Kellum, J. A., & Ronco, C. (2012) · The Lancet · doi:10.1016/s0140-6736(11)61454-2 · Cited by 2,607 · see citing works
Mishra, J., Dent, C., Tarabishi, R., Mitsnefes, M. M., Ma, Q., Kelly, C., Ruff, S. M., Zahedi, K., Shao, M., Bean, J., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)74811-x · Cited by 2,394 · see citing works
Acute Kidney Injury and Chronic Kidney Disease as Interconnected Syndromes
Chawla, L. S., Eggers, P. W., Star, R. A., & Kimmel, P. L. (2014) · New England Journal of Medicine · doi:10.1056/nejmra1214243 · Cited by 1,984 · see citing works
Early versus late parenteral nutrition in critically ill adults
Casaer, M. P., Mesotten, D., Hermans, G., Wouters, P. J., Schetz, M., Meyfroidt, G., Van Cromphaut, S., Ingels, C., Meersseman, P., Muller, J., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1102662 · Cited by 1,696 · see citing works
Self-citationImprovements on Cross-Validation: The .632+ Bootstrap Method
Efron, B., & Tibshirani, R. J. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474007 · Cited by 1,638 · see citing works
A Validated Prediction Model for All Forms of Acute Coronary Syndrome
Eagle, K. A., Lim, M. J., Dabbous, O. H., Pieper, K. S., Goldberg, R. J., de Werf, F. V., Goodman, S. G., Granger, C. B., Steg, P. G., Gore, J. M., et al. (2004) · JAMA · doi:10.1001/jama.291.22.2727 · Cited by 1,590 · see citing works
Discovery and validation of cell cycle arrest biomarkers in human acute kidney injury
KASHANI, K. B., Al-Khafaji, A. H., Ardiles, T., Artigas, A., Bagshaw, S. M., Bell, M., Bihorac, A., Birkhahn, R., Cely, C. M., Chawla, L. S., et al. (2013) · Critical Care · doi:10.1186/cc12503 · Cited by 1,365 · see citing works
Haase, M., Bellomo, R., Devarajan, P., Schlattmann, P., & Haase‐Fielitz, A. (2009) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2009.07.020 · Cited by 1,340 · see citing works
Mehta, R. L., Cerdá, J., Burdmann, E. A., Tonelli, M. A., García-García, G., Jha, V., Susantitaphong, P., Rocco, M. V., Vanholder, R. C., Sever, M. Ş., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60126-x · Cited by 1,164 · see citing works
The Risk of Determining Risk with Multivariable Models
Concato, J., Feinstein, A. R., & Holford, T. R. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-118-3-199302010-00009 · Cited by 1,119 · see citing works
Predictive data mining in clinical medicine: Current issues and guidelines
BELLAZZI, R., & ZUPAN, B. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.11.006 · Cited by 823 · see citing works
Urine Output Assessment as a Clinical Quality Measure
Macedo, E. (2015) · The Nephron journals/Nephron journals · doi:10.1159/000437312 · Cited by 798 · see citing works
Fitzgerald, M., Saville, B. R., & Lewis, R. (2015) · JAMA · doi:10.1001/jama.2015.37 · Cited by 789 · see citing works
Young, P., Bailey, M., Beasley, R., Henderson, S., Mackle, D., McArthur, C., McGuinness, S., Mehrtens, J., Myburgh, J., Psirides, A., et al. (2015) · JAMA · doi:10.1001/jama.2015.12334 · Cited by 728 · see citing works
Steyerberg, E. W., Bleeker, S. E., Moll, H. A., Grobbee, D. E., & Moons, K. G. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00047-7 · Cited by 611 · see citing works
Joannidis, M., Metnitz, B., Bauer, P., Schusterschitz, N., Moreno, R. P., Druml, W., & Metnitz, P. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1530-4 · Cited by 502 · see citing works
The FINNAKI Study Group, Nisula, S., Kaukonen, K., Vaara, S. T., Korhonen, A., Poukkanen, M., Karlsson, S., Haapio, M., Inkinen, O., Parviainen, I., et al. (2013) · Intensive Care Medicine · doi:10.1007/s00134-012-2796-5 · Cited by 460 · see citing works
Vanmassenhove, J., Vanholder, R. C., Nagler, E. V., & Biesen, W. V. (2012) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfs380 · Cited by 377 · see citing works
Wilson, F. P., Shashaty, M. G. S., Testani, J. M., Aqeel, I., Borovskiy, Y., Ellenberg, S. S., Feldman, H. I., Fernández, H., Gitelman, Y., Lin, J. J., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60266-5 · Cited by 353 · see citing works
Cruz, D. N., de Cal, M., Garzotto, F., Perazella, M. A., Lentini, P. L. M., Corradi, V., Piccinni, P., & Ronco, C. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1711-1 · Cited by 347 · see citing works
Bagshaw, S. M., Bennett, M., Haase, M., Haase‐Fielitz, A., Egi, M., Morimatsu, H., D’Amico, G., Goldsmith, D., Devarajan, P., & Bellomo, R. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1724-9 · Cited by 328 · see citing works
Mårtensson, J., Bell, M., Oldner, A., Xu, S., Venge, P., & Martling, C. (2010) · Intensive Care Medicine · doi:10.1007/s00134-010-1887-4 · Cited by 293 · see citing works
de Geus, H. R. H., Bakker, J., Lesaffre, E. M. E. H., & le Noble, J. L. M. L. (2010) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200908-1214oc · Cited by 268 · see citing works
High-Dose Perioperative Atorvastatin and Acute Kidney Injury Following Cardiac Surgery
Billings, F. T., Hendricks, P. A., Schildcrout, J. S., Shi, Y., Petracek, M. R., Byrne, J. G., & Brown, N. J. (2016) · JAMA · doi:10.1001/jama.2016.0548 · Cited by 237 · see citing works
Burns, K. E. A., Chu, M. W. A., Novick, R. J., Fox, S. A., Gallo, K., Martin, C. M., Stitt, L., Heidenheim, A. P., Myers, M. L., & MOIST, L. M. (2005) · JAMA · doi:10.1001/jama.294.3.342 · Cited by 211 · see citing works
Prevention of acute kidney injury and protection of renal function in the intensive care unit
Joannidis, M., Druml, W., Forni, L. G., Groeneveld, A. B. J., Honoré, P. M., Straaten, H. M. O., Ronco, C., Schetz, M. R. C., & Woittiez, A. J. J. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1678-y · Cited by 174 · see citing works
Self-citationPerioperative Aspirin and Clonidine and Risk of Acute Kidney Injury
Garg, A. X., Kurz, A. M., Sessler, D. I., Cuerden, M. S., Robinson, A., Mrkobrada, M., Parikh, C. R., Mizera, R., Jones, P. M., Tiboni, M. E., et al. (2014) · JAMA · doi:10.1001/jama.2014.15284 · Cited by 152 · see citing works
Zhang, A., Cai, Y., Wang, P., et al. (2016) · Critical Care · doi:10.1186/s13054-016-1212-x · Cited by 140 · see citing works
Urinary biomarkers in septic acute kidney injury
Bagshaw, S. M., Langenberg, C., Haase, M., et al. (2007) · Intensive Care Medicine · doi:10.1007/s00134-007-0656-5 · Cited by 128 · see citing works
Validation of Clinical Scores Predicting Severe Acute Kidney Injury After Cardiac Surgery
Englberger, L., Suri, R. M., Li, Z., Dearani, J. A., Park, S. J., Sundt, T. M., & Schaff, H. V. (2010) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2010.04.017 · Cited by 122 · see citing works
Sutherland, S. M., Chawla, L. S., Kane-Gill, S. L., Hsu, R. K., Kramer, A. A., Goldstein, S. L., Kellum, J. A., Ronco, C., Bagshaw, S. M., & on behalf of the 15 ADQI Consensus Group (2016) · Canadian Journal of Kidney Health and Disease · doi:10.1186/s40697-016-0099-4 · Cited by 115 · see citing works
Impact of Early Parenteral Nutrition on Metabolism and Kidney Injury
Gunst, J., Vanhorebeek, I., Casaer, M. P., Hermans, G., Wouters, P. J., Dubois, J., Claes, K., Schetz, M., & den Berghe, G. V. (2013) · Journal of the American Society of Nephrology · doi:10.1681/asn.2012070732 · Cited by 114 · see citing works
Self-citationComparison of Plasma and Urine Biomarker Performance in Acute Kidney Injury
Schley, G., Köberle, C., Manuilova, E., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0145042 · Cited by 96 · see citing works
Assessment of Cell-Cycle Arrest Biomarkers to Predict Early and Delayed Acute Kidney Injury
Bell, M., Larsson, A. O., Venge, P., et al. (2015) · Disease Markers · doi:10.1155/2015/158658 · Cited by 88 · see citing works
Neutrophil gelatinase–associated lipocalin (NGAL) as a Biomarker for Early Acute Kidney Injury
Shemin, D. G., & Dworkin, L. D. (2011) · Critical Care Clinics · doi:10.1016/j.ccc.2010.12.003 · Cited by 70 · see citing works
Park, M., Coca, S. G., Nigwekar, S. U., Garg, A. X., Garwood, S., & Parikh, C. R. (2010) · American Journal of Nephrology · doi:10.1159/000296277 · Cited by 69 · see citing works
Assessing calibration of multinomial risk prediction models
Hoorde, K. V., Vergouwe, Y., Timmerman, D., Huffel, S. V., Steyerberg, E. W., & CALSTER, B. V. (2014) · Statistics in Medicine · doi:10.1002/sim.6114 · Cited by 65 · see citing works
Leening, M. J. G., Steyerberg, E. W., CALSTER, B. V., D’Agostino, R. B., & Pencina, M. J. (2014) · Statistics in Medicine · doi:10.1002/sim.6133 · Cited by 55 · see citing works
Forni, L. G., Dawes, T., Sinclair, H., Cheek, E., Bewick, V., Dennis, M., & Venn, R. M. (2013) · Nephron Clinical Practice · doi:10.1159/000351509 · Cited by 49 · see citing works
Biomarkers for AKI improve clinical practice: no
Ostermann, M., & Joannidis, M. (2014) · Intensive Care Medicine · doi:10.1007/s00134-014-3540-0 · Cited by 49 · see citing works
Biomarkers, diagnosis and management of sepsis-induced acute kidney injury: a narrative review.
Zhang, Z. (2015) · Europe PMC (PubMed Central) · Cited by 35 · see citing works
Measurement of AKI biomarkers in the ICU: still striving for appropriate clinical indications
Prowle, J. R. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3662-z · Cited by 21 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The development of a machine learning inpatient acute kidney injury prediction model.
Koyner, J. L., Carey, K. A., Edelson, D. P., & Churpek, M. M. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003123 · Cited by 323 · see citing works
Machine learning model for early prediction of acute kidney injury (AKI) in pediatric critical care
Dong, J., Feng, T., Thapa-Chhetry, B., Cho, B. G., Shum, T., Inwald, D. P., Newth, C. J. L., & Vaidya, V. U. (2021) · Critical Care · doi:10.1186/s13054-021-03724-0 · Cited by 233 · see citing works
“Many research groups have tackled early prediction of AKI using electronic health records (EHR) data [8–11], but no model so far explains the rationale behind specific predictions despite a clear need for explainable and actionable predictions [6, 12].”
BackgroundAdhikari, L., Ozrazgat-Baslanti, T., Ruppert, M., Madushani, R. W. M. A., Paliwal, S., Hashemighouchani, H., Zheng, F., Tao, M., Lopes, J. M., Li, X., et al. (2019) · PLOS ONE · doi:10.1371/journal.pone.0214904 · Cited by 98 · see citing works
- Authors
- Flechet, M., Güiza, F., Schetz, M., Wouters, P., Vanhorebeek, I., Derese, I., Gunst, J., Spriet, I., Casaer, M., Van den Berghe, G., & Meyfroidt, G.
- Affiliations
- KU Leuven (BE)
- Venue
- Intensive Care Medicine
- Published
- 2017-01-27
- Volume
- 43
- Issue
- 6
- Pages
- 764-773
- ISSN
- 0342-4642 (ISSN-L)
- 1432-1238
- OpenAlex
- W2582793731
- Cited by
- 169
- References
- 50
- Citations by year
- 2026: 7 · 2025: 11 · 2024: 16 · 2023: 18 · 2022: 33 · 2021: 21 · 2020: 29 · 2019: 15 · 2018: 12 · 2017: 7
- FWCI
- 15.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Intensive Care Medicine (publishedVersion)
- PubMed (publishedVersion)
- Lirias (submittedVersion)
- Funders
- Fonds Wetenschappelijk Onderzoek (11Y1116N, 1846113N)
- Topics
- Health Sciences › Medicine › Nephrology › Acute Kidney Injury Research
- Health Sciences › Medicine › Nephrology › Chronic Kidney Disease and Diabetes
- Health Sciences › Medicine › Epidemiology › Sepsis Diagnosis and Treatment
- Keywords
- acute kidney injury, AKI prediction model, neutrophil gelatinase-associated lipocalin, critically ill adults, intensive care unit, early diagnosis, serum creatinine, model validation, AKI severity staging, clinical risk factors
- MeSH terms
- Lipocalin-2, Adult, Aged, Aged, 80 and over, Critical Care, Female, Humans, Male, Middle Aged, Predictive Value of Tests, Prognosis, Cohort Studies, Biomarkers, Critical Illness, Internet, Early Diagnosis, Acute Kidney Injury
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review