Accuracy of noninvasive scoring systems in assessing risk of death and liver-related endpoints in patients with nonalcoholic fatty liver disease
Abstract
Background and aims Several non-invasive scoring systems have been developed to determine risk of advanced fibrosis in non-alcoholic fatty liver disease (NAFLD). We examined the association between 4 scoring systems and incident severe liver disease and overall mortality in a large cohort of patients with biopsy-proven NAFLD.Methods We performed a retrospective analysis of data from 646 patients with biopsy-proven NAFLD, recruited from 2 hospitals in Sweden, from 1971 through 2009. The NAFLD fibrosis score (NFS), FIB-4, APRI, and BARD scores were calculated at the time of the liver biopsy. Based on each score, patients were assigned to categories of low, intermediate, or high risk for advanced fibrosis. Overall mortality and severe liver disease (cirrhosis, decompensated liver disease, liver failure, or hepatocellular carcinoma) were ascertained through linkage with national registers until the end of 2014. Cox regression, area under the receiver operating characteristic (AUROC) curve, and C-statistic analyses were used to study the predictive capacity of each scoring system.Results During a mean follow-up time of 19.9±8.7 years, there were 214 deaths and 76 cases of severe liver disease. For overall mortality, AUROC curve values were: NFS, 0.72 (95% CI, 0.68-0.76); FIB-4, 0.72 (95% CI, 0.68-0.76); BARD, 0.62 (95% CI, 0.58-0.66); and APRI, 0.52 (95% CI, 0.47-0.57). For severe liver disease, AUROC curve values were: NFS, 0.72 (95% CI, 0.66-0.78); FIB-4, 0.72 (95% CI, 0.66-0.79); BARD, 0.62 (95% CI, 0.55-0.69); APRI, 0.69 (95% CI, 0.63-0.76). C-statistics for all scores were of moderate capacity to predict outcomes.Conclusions In a retrospective analysis of data from 646 patients with biopsy-proven NAFLD, we found the NFS and the FIB-4 scores to most accurately determine risk of overall death or severe liver disease. However, the AUROC values for these scoring systems are not high enough for use in the clinic; new systems are needed to determine prognoses of patients with NAFLD.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Six retrospective cohort studies on individuals with biopsy-proven MASLD showed that NFS and FIB-4 predict the occurrence of liver-related events (AUROCs from 0.72 to 0.86) and overall mortality (AUROCs from 0.67 to 0.82), with similar or lower accuracy compared to histology.
“Six retrospective cohort studies on individuals with biopsy-proven MASLD showed that NFS and FIB-4 predict the occurrence of liver-related events (AUROCs from 0.72 to 0.86) and overall mortality (AUROCs from 0.67 to 0.82), 176,177 with a similar or lower accuracy compared to histology.”
From EASL-EASD-EASO Clinical Practice Guidelines on the management of metabolic dysfunction-associated steatotic liver disease (MASLD). (2024) · cites this paper as [177]
Cites
Design and validation of a histological scoring system for nonalcoholic fatty liver disease†
Kleiner, D. E., Brunt, E. M., Van Natta, M., Behling, C., Contos, M. J., Cummings, O. W., Ferrell, L. D., Liu, Y., Torbenson, M. S., Unalp‐Arida, A., et al. (2005) · Hepatology · doi:10.1002/hep.20701 · Cited by 10,791 · see citing works
Younossi, Z. M., Koenig, A. B., Abdelatif, D., Fazel, Y., Henry, L., & Wymer, M. (2016) · Hepatology · doi:10.1002/hep.28431 · Cited by 10,781 · see citing works
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299 · see citing works
Chalasani, N., Younossi, Z., Lavine, J. E., Charlton, M., Cusi, K., Rinella, M., Harrison, S. A., Brunt, E. M., & Sanyal, A. J. (2018) · Hepatology · doi:10.1002/hep.29367 · Cited by 7,239 · see citing works
Global burden of NAFLD and NASH: trends, predictions, risk factors and prevention
Younossi, Z., Anstee, Q. M., Marietti, M., Hardy, T., Henry, L., Eslam, M., George, J., & Bugianesi, E. (2018) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/nrgastro.2017.109 · Cited by 5,249 · see citing works
External review and validation of the Swedish national inpatient register
Ludvigsson, J. F., Andersson, E., Ekbom, A., Feychting, M., Kim, J.-L., Reuterwall, C., Heurgren, M., & Olausson, P. O. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-450 · Cited by 5,055 · see citing works
Sterling, R. K., Lissen, E., Clumeck, N., Sola, R., Correa, M. C., Montaner, J., S. Sulkowski, M., Torriani, F. J., Dieterich, D. T., Thomas, D. L., et al. (2006) · Hepatology · doi:10.1002/hep.21178 · Cited by 5,021 · see citing works
Wai, C.-T., Greenson, J. K., Fontana, R. J., Kalbfleisch, J. D., Marrero, J. A., Conjeevaram, H. S., & Lok, A. S.-F. (2003) · Hepatology · doi:10.1053/jhep.2003.50346 · Cited by 4,406 · see citing works
Angulo, P., Hui, J. M., Marchesini, G., Bugianesi, E., George, J., Farrell, G. C., Enders, F., Saksena, S., Burt, A. D., Bida, J. P., et al. (2007) · Hepatology · doi:10.1002/hep.21496 · Cited by 3,198 · see citing works
Angulo, P., Kleiner, D. E., Dam-Larsen, S., Adams, L. A., Bjornsson, E. S., Charatcharoenwitthaya, P., Mills, P. R., Keach, J. C., Lafferty, H. D., Stahler, A., et al. (2015) · Gastroenterology · doi:10.1053/j.gastro.2015.04.043 · Cited by 2,987 · see citing works
Long-term follow-up of patients with NAFLD and elevated liver enzymes
Ekstedt, M., Franzén, L. E., Mathiesen, U. L., Thorelius, L., Holmqvist, M., Bodemar, G., & Kechagias, S. (2006) · Hepatology · doi:10.1002/hep.21327 · Cited by 2,302 · see citing works
Self-citationEkstedt, M., Hagström, H., Nasr, P., Fredrikson, M., Stål, P., Kechagias, S., & Hultcrantz, R. (2015) · Hepatology · doi:10.1002/hep.27368 · Cited by 2,287 · see citing works
Self-citationDulai, P. S., Singh, S., Patel, J., Soni, M., Prokop, L. J., Younossi, Z., Sebastiani, G., Ekstedt, M., Hagstrom, H., Nasr, P., et al. (2017) · Hepatology · doi:10.1002/hep.29085 · Cited by 1,965 · see citing works
Self-citationRegression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,804 · see citing works
Loomba, R. S., & Sanyal, A. J. (2013) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/nrgastro.2013.171 · Cited by 1,696 · see citing works
The Swedish cause of death register
Brooke, H. L., Talbäck, M., Hörnblad, J., Johansson, L. A., Ludvigsson, J. F., Druid, H., Feychting, M., & Ljung, R. (2017) · European Journal of Epidemiology · doi:10.1007/s10654-017-0316-1 · Cited by 1,382 · see citing works
The completeness of the Swedish Cancer Register – a sample survey for year 1998
Barlow, L., Westergren, K., Holmberg, L., & Talbäck, M. (2008) · Acta Oncologica · doi:10.1080/02841860802247664 · Cited by 1,240 · see citing works
Hagström, H., Nasr, P., Ekstedt, M., Hammar, U., Stål, P., Hultcrantz, R., & Kechagias, S. (2017) · Journal of Hepatology · doi:10.1016/j.jhep.2017.07.027 · Cited by 1,067 · see citing works
Self-citationMcPherson, S., Stewart, S. F., Henderson, E., Burt, A. D., & Day, C. P. (2010) · Gut · doi:10.1136/gut.2010.216077 · Cited by 946 · see citing works
Age as a confounding factor for the accurate non-invasive diagnosis of advanced NAFLD fibrosis
McPherson, S., Hardy, T., Dufour, J.-F., Petta, S., Romero-Gomez, M., Allison, M., Oliveira, C. P., Francque, S., Van Gaal, L., Schattenberg, J. M., et al. (2017) · American Journal of Gastroenterology · doi:10.1038/ajg.2016.453 · Cited by 945 · see citing works
Harrison, S. A., Oliver, D., Arnold, H. L., Gogia, S., & Neuschwander‐Tetri, B. A. (2008) · Gut · doi:10.1136/gut.2007.146019 · Cited by 869 · see citing works
Kim, D., Kim, R. W., Kim, H. J., & Therneau, T. M. (2013) · Hepatology · doi:10.1002/hep.26156 · Cited by 772 · see citing works
Guha, I. N., Parkes, J., Roderick, P. J., Chattopadhyay, D., Cross, R., Harris, S., Kaye, P., Burt, A. D., Ryder, S. D., Aithal, G. P., et al. (2007) · Hepatology · doi:10.1002/hep.21984 · Cited by 744 · see citing works
Angulo, P., Bugianesi, E., Bjornsson, E. S., Charatcharoenwitthaya, P., Mills, P. R., Barrera, F., Haflidadottir, S., Day, C. P., & George, J. (2013) · Gastroenterology · doi:10.1053/j.gastro.2013.06.057 · Cited by 502 · see citing works
Stepanova, M., Rafiq, N., Makhlouf, H. R., Agrawal, R., Kaur, I., Younoszai, Z., McCullough, A. J., Goodman, Z. D., & Younossi, Z. M. (2013) · Digestive Diseases and Sciences · doi:10.1007/s10620-013-2743-5 · Cited by 301 · see citing works
Le, M. H., Devaki, P., Ha, N. B., Jun, D. W., Te, H. S., Cheung, R. C., & Nguyen, M. H. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173499 · Cited by 287 · see citing works
Noninvasive evaluation of NAFLD
Castéra, L., Vilgrain, V., & Angulo, P. (2013) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/nrgastro.2013.175 · Cited by 272 · see citing works
Liver fibrosis scores predict liver disease mortality in the United States population
Ünalp–Arida, A., & Ruhl, C. E. (2017) · Hepatology · doi:10.1002/hep.29113 · Cited by 261 · see citing works
Treeprasertsuk, S. (2013) · World Journal of Gastroenterology · doi:10.3748/wjg.v19.i8.1219 · Cited by 200 · see citing works
Reed, C. C., Wolf, W. A., Cotton, C. C., Rusin, S., Perjar, I., Hollyfield, J., Woosley, J. T., Shaheen, N. J., & Dellon, E. S. (2017) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2017.09.046 · Cited by 132 · see citing works
Liver Fibrosis Score Predicts Mortality in Heart Failure Patients with Preserved Ejection Fraction
Yoshihisa, A., Sato, Y., Yokokawa, T., Sato, T., Suzuki, S., Oikawa, M., Kobayashi, A., Yamaki, T., Kunii, H., Nakazato, K., et al. (2017) · ESC Heart Failure · doi:10.1002/ehf2.12222 · Cited by 121 · see citing works
Sebastiani, G., Alshaalan, R., Wong, P. Y. N., Rubino, M., Salman, A., Metrakos, P. P., Deschênes, M., & Ghali, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0128774 · Cited by 99 · see citing works
Caussy, C., Chen, J., Alquiraish, M. H., Cepin, S., Nguyen, P., Hernandez, C., Yin, M., Bettencourt, R., Cachay, E. R., Jayakumar, S., et al. (2018) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2017.10.037 · Cited by 67 · see citing works
Xun, Y., Guo, J., Lou, G., Jiang, Y., Zhuang, Z., Zhu, M., Luo, Y., Ma, X., Liu, J., Bian, D., et al. (2014) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/1440-1681.12260 · Cited by 33 · see citing works
The Potential Role of Vedolizumab in Concomitant Eosinophilic Esophagitis and Crohn’s Disease
Taft, T., & Mutlu, E. (2018) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.06.022 · Cited by 30 · see citing works
Lykiardopoulos, B., Hagström, H., Fredrikson, M. G., Ignatova, S., Stal, P. I., Hultcrantz, R. W., Ekstedt, M., & Kechagias, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0167776 · Cited by 22 · see citing works
Self-citationNonalcoholic Fatty Liver Disease and Mortality
Stefan, N. (2018) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.02.016 · Cited by 18 · see citing works
Joelson, A. M., Geller, M. G., Zylberberg, H. M., Green, P. H. R., & Lebwohl, B. (2018) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.09.006 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Tacke, F., Horn, P., Wai-Sun Wong, V., Ratziu, V., Bugianesi, E., Francque, S., Zelber-Sagi, S., Valenti, L., Roden, M., Schick, F., et al. (2024) · Journal of Hepatology · doi:10.1016/j.jhep.2024.04.031 · Cited by 2,210 · see citing works
Boursier, J., Hagström, H., Ekstedt, M., Moreau, C., Bonacci, M., Cure, S., Ampuero, J., Nasr, P., Tallab, L., Canivet, C. M., et al. (2022) · Journal of Hepatology · doi:10.1016/j.jhep.2021.12.031 · Cited by 206 · see citing works
Self-citationYounes, R., Caviglia, G. P., Govaere, O., Rosso, C., Armandi, A., Sanavia, T., Pennisi, G., Liguori, A., Francione, P., Gallego-Durán, R., et al. (2021) · Journal of Hepatology · doi:10.1016/j.jhep.2021.05.008 · Cited by 196 · see citing works
Noninvasive assessment of liver fibrosis in NAFLD
Sanyal, A. J., Castera, L., & Wong, V. W.-S. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2023.03.042 · Cited by 157 · see citing works
Risk for hepatic and extra-hepatic outcomes in nonalcoholic fatty liver disease
Hagström, H., Kechagias, S., & Ekstedt, M. (2022) · Journal of Internal Medicine · doi:10.1111/joim.13343 · Cited by 52 · see citing works
Self-citationMortality outcomes in individuals with MASLD <i>versus</i> MASLD and increased alcohol intake
Aboona, M. B., Danpanichkul, P., Chen, V. L., Rangan, P., Kim, D., Alkhouri, N., Fallon, M. B., Noureddin, M., Arab, J. P., & Wijarnpreecha, K. (2024) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.16726 · Cited by 29 · see citing works
- Authors
- Hagström, H., Nasr, P., Ekstedt, M., Stål, P., Hultcrantz, R., & Kechagias, S.
- Affiliations
- Karolinska University Hospital (SE)
- Linköping University (SE)
- Corresponding author
- Hagström, Hannes
- Venue
- Clinical Gastroenterology and Hepatology
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 17
- Issue
- 6
- Pages
- 1148-1156.e4
- ISSN
- 1542-3565 (ISSN-L)
- OpenAlex
- W2901791755
- Cited by
- 132
- References
- 39
- Citations by year
- 2026: 4 · 2025: 16 · 2024: 23 · 2023: 30 · 2022: 17 · 2021: 23 · 2020: 16 · 2019: 3
- FWCI
- 8.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Gastroenterology and Hepatology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Stockholm City Council
- Topics
- Health Sciences › Medicine › Epidemiology › Liver Disease Diagnosis and Treatment
- Health Sciences › Medicine › Hepatology › Liver Disease and Transplantation
- Health Sciences › Medicine › Hepatology › Liver Diseases and Immunity
- Keywords
- non-alcoholic fatty liver disease, NAFLD fibrosis score, FIB-4, APRI, BARD score, advanced liver fibrosis, mortality prediction, liver-related mortality, liver cirrhosis, hepatocellular carcinoma, decompensated liver disease, liver failure, prognostic accuracy, liver biopsy, risk stratification
- MeSH terms
- Adult, Alanine Transaminase, Aspartate Aminotransferases, Biopsy, Cause of Death, Female, Follow-Up Studies, Forecasting, Humans, Liver, Male, Middle Aged, Prognosis, Retrospective Studies, ROC Curve, Severity of Illness Index, Sweden, Biomarkers, Survival Rate, Disease Progression, Risk Assessment, Non-alcoholic Fatty Liver Disease
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review