Benchmarking clinical risk prediction algorithms with ensemble machine learning for the noninvasive diagnosis of liver fibrosis in NAFLD
Abstract
Background and Aims: Ensemble machine-learning methods, like the superlearner, combine multiple models into a single one to enhance predictive accuracy. Here we explore the potential of the superlearner as a benchmarking tool for clinical risk prediction, illustrating the approach to identifying significant liver fibrosis among patients with NAFLD. Approach and Results: We used 23 demographic/clinical variables to train superlearner(s) on data from the NASH-clinical research network observational study (n = 648) and validated models with data from the FLINT trial (n = 270) and National Health and Nutrition Examination Survey (NHANES) participants with NAFLD (n = 1244). Comparing the superlearner’s performance to existing models (Fibrosis-4 [FIB-4], NAFLD fibrosis score, Forns, AST to Platelet Ratio Index [APRI], BARD, and Steatosis-Associated Fibrosis Estimator [SAFE]), it exhibited strong discriminative ability in the FLINT and NHANES validation sets, with AUCs of 0.79 (95% CI: 0.73–0.84) and 0.74 (95% CI: 0.68–0.79) respectively. Conclusions: Notably, the SAFE score performed similarly to the superlearner, both of which outperformed FIB-4, APRI, Forns, and BARD scores in the validation data sets. Surprisingly, the superlearner derived from 12 base models matched the performance of one with 90 base models. Overall, the superlearner, being the “best-in-class” machine-learning predictor, excelled in detecting fibrotic NASH, and this approach can be used to benchmark the performance of conventional clinical risk prediction models.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ML algorithms offer enhanced predictive performance over traditional rule-based methods in disease risk prediction.
“Our results align with a growing body of literature indicating that ML algorithms offer enhanced predictive performance over traditional rule-based methods in disease risk prediction [31–34].”
From Machine learning with the body roundness index and associated indicators: a new approach to predicting metabolic syndrome (2025) · cites this paper as [33]
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594 · see citing works
Sterling, R. K., Lissen, E., Clumeck, N., Sola, R., Correa, M. C., Montaner, J., S. Sulkowski, M., Torriani, F. J., Dieterich, D. T., Thomas, D. L., et al. (2006) · Hepatology · doi:10.1002/hep.21178 · Cited by 5,021 · cited 1× · see citing works
“…models and 6 additional risk scores including the AST to Platelet Ratio Index (APRI), [26,27] the BARD score, [4] the Fibrosis-4 (FIB-4) score, [1] the Forns index, [28] the NAFLD fibrosis score (NFS), [2] and the Steatosis-Associated Fibrosis Estimator (SAFE) score [3] for identifying…”
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Su, Y.-S. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.arm · Cited by 4,629 · see citing works
Angulo, P., Hui, J. M., Marchesini, G., Bugianesi, E., George, J., Farrell, G. C., Enders, F., Saksena, S., Burt, A. D., Bida, J. P., et al. (2007) · Hepatology · doi:10.1002/hep.21496 · Cited by 3,198 · see citing works
Calibration: the Achilles heel of predictive analytics
On behalf of Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative, Van Calster, B., McLernon, D. J., van Smeden, M., Wynants, L., & Steyerberg, E. W. (2019) · BMC Medicine · doi:10.1186/s12916-019-1466-7 · Cited by 2,650 · see citing works
Analysis of Complex Survey Samples
Lumley, T. (2004) · Journal of Statistical Software · doi:10.18637/jss.v009.i08 · Cited by 2,425 · see citing works
The prevalence and incidence of NAFLD worldwide: a systematic review and meta-analysis
Riazi, K., Azhari, H., Charette, J. H., Underwood, F. E., King, J. A., Afshar, E. E., Swain, M. G., Congly, S. E., Kaplan, G. G., & Shaheen, A.-A. (2022) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(22)00165-0 · Cited by 2,246 · see citing works
Neuschwander-Tetri, B. A., Loomba, R., Sanyal, A. J., Lavine, J. E., Van Natta, M. L., Abdelmalek, M. F., Chalasani, N., Dasarathy, S., Diehl, A. M., Hameed, B., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(14)61933-4 · Cited by 2,237 · see citing works
van der Laan, M. J., Polley, E., & Hubbard, A. (2007) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1309 · Cited by 1,472 · see citing works
Eddowes, P. J., Sasso, M., Allison, M., Tsochatzis, E. A., Anstee, Q. M., Sheridan, D. A., Guha, I. N., Cobbold, J., Deeks, J. J., Paradis, V., et al. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.01.042 · Cited by 1,425 · see citing works
National Center for Health Statistics (NCHS)
Zhang, Y. (2008) · Encyclopedia of Global Health · doi:10.4135/9781412963855.n815 · Cited by 1,125 · see citing works
Identification of chronic hepatitis C patients without hepatic fibrosis by a simple predictive model
Forns, X., Ampurdanés, S., Llovet, J. M., Aponte, J. Á. N., Quintó, L., Martínez‐Bauer, E., Bruguera, M., Sánchez-Tapias, J. M., & Rodés, J. (2002) · Hepatology · doi:10.1053/jhep.2002.36128 · Cited by 1,123 · see citing works
Lin, Z., Xin, Y., Dong, Q., Wang, Q., Jiang, X., Zhan, S.-H., Sun, Y. J., & Xuan, S. (2010) · Hepatology · doi:10.1002/hep.24105 · Cited by 1,071 · see citing works
Hagström, H., Nasr, P., Ekstedt, M., Hammar, U., Stål, P., Hultcrantz, R., & Kechagias, S. (2017) · Journal of Hepatology · doi:10.1016/j.jhep.2017.07.027 · Cited by 1,067 · see citing works
A tutorial on calibration measurements and calibration models for clinical prediction models
Huang, Y., Li, W., Macheret, F., Gabriel, R. A., & Ohno-Machado, L. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz228 · Cited by 486 · see citing works
Clinical, Laboratory and Histological Associations in Adults with Nonalcoholic Fatty Liver Disease†
Neuschwander‐Tetri, B. A., Clark, J. M., Bass, N. M., Natta, M. L. V., Ünalp–Arida, A., Tonascia, J. A., Zein, C. O., Brunt, E. M., Kleiner, D. E., McCullough, A. J., et al. (2010) · Hepatology · doi:10.1002/hep.23784 · Cited by 463 · see citing works
Blood Tests to Diagnose Fibrosis or Cirrhosis in Patients With Chronic Hepatitis C Virus Infection
Chou, R., & Wasson, N. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-11-201306040-00005 · Cited by 369 · see citing works
Sanyal, A. J., Foucquier, J., Younossi, Z. M., Harrison, S. A., Newsome, P. N., Chan, W., Yilmaz, Y. N., de Lédinghen, V., Costentin, C. E., Zheng, M., et al. (2022) · Journal of Hepatology · doi:10.1016/j.jhep.2022.10.034 · Cited by 228 · see citing works
Mortality Risk Score Prediction in an Elderly Population Using Machine Learning
Rose, S. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kws241 · Cited by 193 · see citing works
Taghizadeh‐Mehrjardi, R., Hamzehpour, N., Hassanzadeh, M., Heung, B., Goydaragh, M. G., Schmidt, K., & Scholten, T. (2021) · Geoderma · doi:10.1016/j.geoderma.2021.115108 · Cited by 130 · see citing works
Sripongpun, P., Kim, W. R., Mannalithara, A., Charu, V., Vidovszky, A. A., Asch, S. M., Desai, M., Kim, S. H., & Kwong, A. J. (2022) · Hepatology · doi:10.1002/hep.32545 · Cited by 124 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Dunn, N., Verma, N., & Dunn, W. (2025) · Journal of Clinical and Experimental Hepatology · doi:10.1016/j.jceh.2025.103184 · Cited by 13 · see citing works
AI-Based Models for Risk Prediction in MASLD: A Systematic Review
Njei, B. M., Al‐Ajlouni, Y. A., Lemos, S. Y., Ugwendum, D. F., Njei, N., Ta’ani, O. A., Ameyaw, P. A., Njei, L., & Boateng, S. (2025) · Digestive Diseases and Sciences · doi:10.1007/s10620-025-09499-6 · Cited by 13 · see citing works
Grady, J. T., Cyrus, J. W. W., & Sterling, R. K. (2025) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2025.02.035 · Cited by 12 · see citing works
Kim, W. R., Mannalithara, A., Charu, V., Chung, N. L., Kwong, A. J., Kwo, P. Y., Torok, N. J., Asch, S. M., & Kim, S. H. (2025) · The American Journal of Gastroenterology · doi:10.14309/ajg.0000000000003268 · Cited by 11 · see citing works
Self-citationLi, S., Zhang, Y. L., Fu, K., Fang, K., Zheng, L., Lin, Y., & Wu, J. (2025) · Journal of Advanced Research · doi:10.1016/j.jare.2025.06.072 · Cited by 7 · see citing works
Taming fatty liver: can taurine combat metabolic dysfunction in MASLD?
Meng, L., Lu, F., Zhang, B., Ma, Y., & Gao, J. (2025) · Cell Communication and Signaling · doi:10.1186/s12964-025-02439-x · Cited by 6 · see citing works
Ultrasound radiomics-based logistic regression model for fibrotic NASH
Xia, F., Wei, W., Wang, J., Wang, Y., Wang, K., Zhang, C., & Zhu, Q. (2025) · BMC Gastroenterology · doi:10.1186/s12876-025-03605-8 · Cited by 6 · see citing works
He, Y., Chen, Z., Tang, Z., Qin, Y., & Wang, F. (2025) · BMC Public Health · doi:10.1186/s12889-025-23858-y · Cited by 5 · see citing works
Ma, Y., Zhang, C., Tian, M., Hu, J., Wang, M., & Liu, S. (2025) · Diabetes Obesity and Metabolism · doi:10.1111/dom.70326 · Cited by 5 · see citing works
Roy, A., & Verma, N. (2025) · Metabolism and Target Organ Damage · doi:10.20517/mtod.2024.84 · Cited by 5 · see citing works
The evolution of artificial intelligence technology in non-alcoholic fatty liver disease
He, J., Wu, Y., Lin, Z., He, R., Li, Z., & Li, Y. (2025) · Frontiers in Radiology · doi:10.3389/fradi.2025.1634165 · Cited by 4 · see citing works
Li, S., Li, X., Xiao, H., & Dou, J. (2025) · Scientific Reports · doi:10.1038/s41598-025-15709-y · Cited by 3 · see citing works
Zhang, R., Guo, Y., Zhai, X., Wang, J., Hao, X., Yang, L., Zhou, L., Gao, J., & Liu, J. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1544724 · Cited by 2 · see citing works
Hu, X., Ye, S., Qi, D., Li, S., Tang, X., & Fang, Y. (2025) · International Journal of General Medicine · doi:10.2147/ijgm.s533558 · Cited by 2 · see citing works
Xu, Z., Zhu, Y., Chen, F., Fan, Q.-Y., Wang, R., Fu, Y., Wu, X., Zhu, L., Ha, F., Ye, Q., et al. (2025) · Liver International · doi:10.1111/liv.70491 · Cited by 2 · see citing works
Liang, T., & Ren, J. (2026) · Frontiers in Physiology · doi:10.3389/fphys.2026.1689882 · Cited by 2 · see citing works
YANG, Z., Tong, W., Zhang, K., & Guo-xin, H. (2026) · Liver Research · doi:10.1016/j.livres.2026.03.001 · Cited by 2 · see citing works
Balsano, C., Alisi, A., Burra, P., Calvaruso, V., Cammà, C., Campagner, A., Donatelli, P., Germani, G., Gerussi, A., Giuffrè, M., et al. (2026) · Digestive and Liver Disease · doi:10.1016/j.dld.2026.03.005 · Cited by 4 · see citing works
Reply: Comprehensive profiling of lipid metabolic reprogramming expands precision medicine for HCC
Liu, Q., Qi, J., Yu, Y., & Jiang, S. (2025) · Hepatology · doi:10.1097/hep.0000000000001364 · Cited by 2 · see citing works
Du, R., Yang, Y., Su, Y., & Cui, S. (2025) · Hepatology · doi:10.1097/hep.0000000000001363 · Cited by 2 · see citing works
Li, Y., Liu, X., Li, J. Y., Xie, M., Li, S., Huang, K., Zhao, J., Chen, X., He, Z., He, J., et al. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001259 · Cited by 1 · see citing works
Du, S., Yu, H., Du, J., & Xu, Y. (2026) · International Journal of Hepatology · doi:10.1155/ijh/8221645 · Cited by 1 · see citing works
Wang, R., Liu, C., Xue, M., Qian, J., & Hu, Y. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111619 · Cited by 2 · see citing works
Ma, Y., Chen, X., 尹露瑾, Chi, Y., Zhang, D., Xue, X., & Zhang, X. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1705706 · Cited by 1 · see citing works
Letter to the editor: How to count from 0 to 4 without skipping a number
Kim, W. R., Sripongpun, P., Mannalithara, A., & Charu, V. (2025) · Hepatology · doi:10.1097/hep.0000000000001387 · Cited by 1 · see citing works
Self-citationYang, Y., Luo, X., Cui, S., & Lin, Z. (2024) · Hepatology · doi:10.1097/hep.0000000000001094
Khan, Z. (2025) · International Journal of Cardiology · doi:10.1016/j.ijcard.2025.133638
LIVER FIBROSIS DETECTION USING ENSEMBLE MODEL OF SUPPORT VECTOR MACHINE AND DECISION TREE
Meeran, T., Deris, A. M., Yunus, F. B., & Ali, R. (2025) · NED University Journal of Research · doi:10.35453/nedjr-ascn039.r2
AI-Based Models for Risk Prediction in MASLD: A Systematic Review
Njei, B. M., Al‐Ajlouni, Y. A., Lemos, S. Y., Ugwendum, D. F., Njei, N., Ta’ani, O. A., Ameyaw, P. A., Njei, L., & Boateng, S. (2025) · Maryland Shared Open Access Repository (USMAI Consortium) · doi:10.13016/m2u4f8-zcqp
Tjandra, N., Fonzo, D. M. D., Wen, T., Lau, K., Lin, Y., Kwan, P. W., Yoshida, E. M., & Chahal, D. (2026) · Canadian Liver Journal · doi:10.3138/canlivj-2025-0046
Hu, X., Ye, S., Hu, R., Li, S., Li, P., & Fang, Y. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03351-1
Li, M., Li, Y., Chen, L., Chen, H., Chen, L., Liu, W., Xu, G., & Chen, S. (2026) · Journal of Visualized Experiments · doi:10.3791/70033
Marin‐Couture, É., Lajeunesse‐Trempe, F., Dimitriadis, G. K., & Vincent, R. P. (2026) · Critical Reviews in Clinical Laboratory Sciences · doi:10.1080/10408363.2026.2716664
Machine Learning‐Driven Noninvasive Prediction of Liver Fibrosis in Unclassified Liver Disease
Yang, Y., Hu, Y., Wei, T., Chen, Y., Gao, W., Tan, Y., Zhu, Y., Yuan, Y., Cao, Z., Zhao, Y., et al. (2026) · MedComm · doi:10.1002/mco2.70990
Deng, J., Song, W., Ma, Y., Fan, B., Ma, X., & Liu, Y. (2026) · Laboratory Medicine · doi:10.1093/labmed/lmag053
- Authors
- Charu, V., Liang, J. W., Mannalithara, A., Kwong, A., Tian, L., & Kim, W. R.
- Affiliations
- Stanford Medicine (US)
- Department of Biomedical Data Sciences, Stanford University School of Medicine, Stanford, California, USA
- Corresponding author
- Charu, Vivek
- Venue
- Hepatology
- Published
- 2024-04-30
- Volume
- 80
- Issue
- 5
- Pages
- 1184-1195
- ISSN
- 0270-9139 (ISSN-L)
- OpenAlex
- W4396515817
- Cited by
- 35
- References
- 22
- Citations by year
- 2026: 13 · 2025: 21 · 2024: 1
- FWCI
- 10.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Hepatology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (KL2TR003143)
- National Institute on Alcohol Abuse and Alcoholism (K23AA029197)
- National Institute of Diabetes and Digestive and Kidney Diseases (R01DK127224, P30DK116074)
- Topics
- Health Sciences › Medicine › Epidemiology › Liver Disease Diagnosis and Treatment
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Hepatology › Liver Diseases and Immunity
- Keywords
- liver fibrosis, non-alcoholic fatty liver disease, nonalcoholic steatohepatitis, super learner, ensemble learning, clinical risk prediction, benchmarking, noninvasive fibrosis assessment, FIB-4, APRI, NHANES
- MeSH terms
- Machine Learning, Adult, Algorithms, Female, Humans, Liver Cirrhosis, Male, Middle Aged, Risk Assessment, Benchmarking, Non-alcoholic Fatty Liver Disease
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review