Deep learning with ultrasonography: automated classification of liver fibrosis using a deep convolutional neural network
Abstract
Objectives The aim of this study was to develop a deep convolutional neural network (DCNN) for the prediction of the METAVIR score using B-mode ultrasonography images.Methods Datasets from two tertiary academic referral centers were used. A total of 13,608 ultrasonography images from 3446 patients who underwent surgical resection, biopsy, or transient elastography were used for training a DCNN for the prediction of the METAVIR score. Pathological specimens or estimated METAVIR scores derived from transient elastography were used as a reference standard. A four-class model (F0 vs. F1 vs. F23 vs. F4) was developed. Diagnostic performance of the algorithm was validated on a separate internal test set of 266 patients with 300 images and external test set of 572 patients with 1232 images. Performance in classification of cirrhosis was compared between the DCNN and five radiologists.Results The accuracy of the four-class model was 83.5% and 76.4% on the internal and external test set, respectively. The area under the receiver operating characteristic curve (AUC) for classification of cirrhosis (F4) was 0.901 (95% confidence interval [CI], 0.865-0.937) on the internal test set and 0.857 (95% CI, 0.825-0.889) on the external test set, respectively. The AUC of the DCNN for classification of cirrhosis (0.857) was significantly higher than that of all five radiologists (AUC range, 0.656-0.816; p value < 0.05) using the external test set.Conclusions The DCNN showed high accuracy for determining METAVIR score using ultrasonography images and achieved better performance than that of radiologists in the diagnosis of cirrhosis.Key points • DCNN accurately classified the ultrasonography images according to the METAVIR score. • The AUROC of this algorithm for cirrhosis assessment was significantly higher than that of radiologists. • DCNN using US images may offer an alternative tool for monitoring liver fibrosis.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Deep CNNs can be successfully used to extract and analyze information obtained from medical images.
“Recent research on medical data has shown that deep CNNs can be successfully used to extract and analyze information obtained from medical images [16–18].”
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · see citing works
Forner, A., Reig, M., & Bruix, J. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30010-2 · Cited by 5,569 · see citing works
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · see citing works
Castéra, L., Vergniol, J., Foucher, J., Bail, B. L., Chanteloup, E., Haaser, M., Darriet, M., Couzigou, P., & de Lédinghen, V. (2005) · Gastroenterology · doi:10.1053/j.gastro.2004.11.018 · Cited by 2,480 · see citing works
Ting, D. S. W., Cheung, C. Y.-L., Lim, G., Tan, G. S. W., Quang, N. D., Gan, A., Hamzah, H., Garcia-Franco, R., San Yeo, I. Y., Lee, S. Y., et al. (2017) · JAMA · doi:10.1001/jama.2017.18152 · Cited by 2,402 · see citing works
(2015) · Journal of Hepatology · doi:10.1016/j.jhep.2015.04.006 · Cited by 1,875 · see citing works
Tsochatzis, E. A., Bosch, J., & Burroughs, A. K. (2014) · The Lancet · doi:10.1016/s0140-6736(14)60121-5 · Cited by 1,823 · see citing works
Lakhani, P., & Sundaram, B. (2017) · Radiology · doi:10.1148/radiol.2017162326 · Cited by 1,775 · see citing works
Can we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773 · see citing works
Deep Learning in Medical Imaging: General Overview
Lee, J., Jun, S., Cho, Y.-W., Lee, H., Kim, G. B., Seo, J. B., & Kim, N. (2017) · Korean Journal of Radiology · doi:10.3348/kjr.2017.18.4.570 · Cited by 1,287 · see citing works
Self-citationDietrich, C., Bamber, J. C., Berzigotti, A., Bota, S. I., Cantisani, V., Castéra, L., Cosgrove, D. O., Ferraioli, G., Friedrich‐Rust, M., Gilja, O. H., et al. (2017) · Ultraschall in der Medizin - European Journal of Ultrasound · doi:10.1055/s-0043-103952 · Cited by 1,016 · see citing works
Park, S. H., & Han, K. (2018) · Radiology · doi:10.1148/radiol.2017171920 · Cited by 894 · see citing works
Sources of variability in histological scoring of chronic viral hepatitis†
Rousselet, M., Michalak, S., Dupré, F., et al. (2005) · Hepatology · doi:10.1002/hep.20535 · Cited by 541 · see citing works
Seeff, L. B., Everson, G. T., Morgan, T. R. M., Curto, T. M., Lee, W. M., Ghany, M. G., Shiffman, M. L., Fontana, R. J., Bisceglie, A. M. D., Bonkovsky, H. L., et al. (2010) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2010.03.025 · Cited by 472 · see citing works
Vergniol, J., Foucher, J., Terrebonne, É., Bernard, P., Bail, B. L., Merrouche, W., Couzigou, P., & de Lédinghen, V. (2011) · Gastroenterology · doi:10.1053/j.gastro.2011.02.058 · Cited by 411 · see citing works
Diagnosis and Quantitation of Fibrosis
Manning, D. S., & Afdhal, N. H. (2008) · Gastroenterology · doi:10.1053/j.gastro.2008.03.001 · Cited by 398 · see citing works
Hamm, C. A., Wang, C. J., Savic, L. J., Ferrante, M., Schobert, I. T., Schlachter, T. R., Lin, M., Duncan, J. S., Weinreb, J. C., Chapiro, J., et al. (2019) · European Radiology · doi:10.1007/s00330-019-06205-9 · Cited by 341 · see citing works
Severe Liver Fibrosis or Cirrhosis: Accuracy of US for Detection—Analysis of 300 Cases
Colli, A., Fraquelli, M., Andreoletti, M., Marino, B., Zuccoli, E., & Conte, D. (2003) · Radiology · doi:10.1148/radiol.2272020193 · Cited by 327 · see citing works
Singh, S., Muir, A. J., Dieterich, D. T., & Falck-Ytter, Y. T. (2017) · Gastroenterology · doi:10.1053/j.gastro.2017.03.016 · Cited by 262 · see citing works
Dietrich, C. F., Bamber, J. C., Berzigotti, A., et al. (2017) · Ultraschall in der Medizin - European Journal of Ultrasound · doi:10.1055/a-0641-0076 · Cited by 241 · see citing works
Choi, K. J., Jang, J. K., Lee, S. S., Sung, Y. S., Shim, W. H., Kim, H. S., Yun, J., Choi, J., Lee, Y., Kang, B.-K., et al. (2018) · Radiology · doi:10.1148/radiol.2018180763 · Cited by 219 · see citing works
Yasaka, K., Akai, H., Kunimatsu, A., Abe, O., & Kiryu, S. (2017) · Radiology · doi:10.1148/radiol.2017171928 · Cited by 206 · see citing works
Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution
Hu, P., Wu, F., Peng, J., Liang, P., & Kong, D.-X. (2016) · Physics in Medicine and Biology · doi:10.1088/1361-6560/61/24/8676 · Cited by 204 · see citing works
Liver Biopsy Sampling in Chronic Viral Hepatitis
Guido, M., & Rugge, M. (2004) · Seminars in Liver Disease · doi:10.1055/s-2004-823103 · Cited by 201 · see citing works
Tang, A., Cloutier, G., Szeverenyi, N. M., & Sirlin, C. B. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.15.14553 · Cited by 197 · see citing works
Lim, J. K., Flamm, S. L., Singh, S., et al. (2017) · Gastroenterology · doi:10.1053/j.gastro.2017.03.017 · Cited by 181 · see citing works
Cardoso, A. C., de Carvalho‐Filho, R. J., Stern, C., et al. (2011) · Liver International · doi:10.1111/j.1478-3231.2011.02660.x · Cited by 149 · see citing works
Deep learning for staging liver fibrosis on CT: a pilot study
Yasaka, K., Akai, H., Kunimatsu, A., Abe, O., & Kiryu, S. (2018) · European Radiology · doi:10.1007/s00330-018-5499-7 · Cited by 136 · see citing works
Prediction of liver cirrhosis, using diagnostic imaging tools
Yeom, S. K. (2015) · World Journal of Hepatology · doi:10.4254/wjh.v7.i17.2069 · Cited by 130 · see citing works
Berzigotti, A., Abraldeṣ, J. G., Tandon, P., Erice, E., Gilabert, R., García‐Pagán, J. C., & Bosch, J. (2010) · Journal of Hepatology · doi:10.1016/j.jhep.2009.12.031 · Cited by 117 · see citing works
Non invasive tools for the diagnosis of liver cirrhosis
Soresi, M. (2014) · World Journal of Gastroenterology · doi:10.3748/wjg.v20.i48.18131 · Cited by 111 · see citing works
Huber, A. T., Ebner, L., Heverhagen, J. T., & Christe, A. (2015) · European Journal of Radiology Open · doi:10.1016/j.ejro.2015.05.002 · Cited by 97 · see citing works
Noninvasive Assessment of Portal Hypertension in Advanced Chronic Liver Disease: An Update
Ravaioli, F., Montagnani, M., Lisotti, A., et al. (2018) · Gastroenterology Research and Practice · doi:10.1155/2018/4202091 · Cited by 59 · see citing works
Lee, C. H., Choi, J. W., Kim, K. A., et al. (2006) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2006.06.014 · Cited by 52 · see citing works
Self-citationLiver biopsy complications and routine ultrasound.
Stotland, B. R., & Lichtenstein, G. (1996) · PubMed · Cited by 52 · see citing works
Liver diseases in developing countries
Cainelli, F. (2012) · World Journal of Hepatology · doi:10.4254/wjh.v4.i3.66 · Cited by 39 · see citing works
US Features of Liver Surface Nodularity as a Predictor of Severe Fibrosis in Chronic Hepatitis C
Viganò, M., Visentin, S., Aghemo, A., Rumi, M. G., & Ronchi, G. (2005) · Radiology · doi:10.1148/radiol.2342041267 · Cited by 22 · see citing works
Li, R., Hua, X., Guo, Y., et al. (2006) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2006.06.009 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
van der Velden, B. H. M., Kuijf, H. J., Gilhuijs, K. G. A., & Viergever, M. A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102470 · Cited by 1,328 · see citing works
The Integration of Artificial Intelligence into Clinical Practice
Karalis, V. D. (2024) · Applied Biosciences · doi:10.3390/applbiosci3010002 · Cited by 255 · see citing works
Huo, T., Li, L., Chen, X., Wang, Z., Zhang, X., Liu, S., Huang, J., Zhang, J., Yang, Q., Wu, W., et al. (2023) · Scientific Reports · doi:10.1038/s41598-022-26771-1 · Cited by 38 · see citing works
Artificial intelligence for ultrasonography: unique opportunities and challenges
Park, S. H. (2021) · Ultrasonography · doi:10.14366/usg.20078 · Cited by 37 · see citing works
Wang, Y., Zhang, Q., Yin, C., Chen, L., Yang, Z., Jia, S., Sun, X., Bai, Y., Han, F., & Yuan, Z. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-04936-0 · Cited by 19 · see citing works
Artificial Intelligence in Coronary Artery Calcium Scoring
Aromiwura, A. A., & Kalra, D. K. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13123453 · Cited by 11 · see citing works
- Authors
- Lee, J. H., Joo, I., Kang, T. W., Paik, Y. H., Sinn, D. H., Ha, S. Y., Kim, K., Choi, C., Lee, G., Yi, J., & Bang, W.-C.
- Affiliations
- Samsung Medical Center (KR)
- Seoul National University (KR)
- Samsung Electronics (South Korea) (KR)
- Corresponding author
- Kang, Tae Wook
- ORCID
- Venue
- European Radiology
- Published
- 2019-09-02
- Volume
- 30
- Issue
- 2
- Pages
- 1264-1273
- ISSN
- 0938-7994 (ISSN-L)
- 1432-1084
- OpenAlex
- W2972256375
- Cited by
- 144
- References
- 40
- Citations by year
- 2026: 14 · 2025: 30 · 2024: 23 · 2023: 24 · 2022: 24 · 2021: 21 · 2020: 8
- FWCI
- 8.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- European Radiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Samsung Medical Center (#PHO0132251)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Epidemiology › Liver Disease Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Keywords
- liver fibrosis, METAVIR score, deep convolutional neural networks, B-mode ultrasound, automated image analysis, radiologist comparison
- MeSH terms
- Radiologists, Deep Learning, Algorithms, Clinical Competence, Female, Humans, Liver Cirrhosis, Male, Middle Aged, Retrospective Studies, ROC Curve, Ultrasonography, Reproducibility of Results, Elasticity Imaging Techniques
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
