Deep learning based classification of breast tumors with shear-wave elastography
Abstract
This study aims to build a deep learning (DL) architecture for automated extraction of learned-from-data image features from the shear-wave elastography (SWE), and to evaluate the DL architecture in differentiation between benign and malignant breast tumors. We construct a two-layer DL architecture for SWE feature extraction, comprised of the point-wise gated Boltzmann machine (PGBM) and the restricted Boltzmann machine (RBM). The PGBM contains task-relevant and task-irrelevant hidden units, and the task-relevant units are connected to the RBM. Experimental evaluation was performed with five-fold cross validation on a set of 227 SWE images, 135 of benign tumors and 92 of malignant tumors, from 121 patients. The features learned with our DL architecture were compared with the statistical features quantifying image intensity and texture. Results showed that the DL features achieved better classification performance with an accuracy of 93.4%, a sensitivity of 88.6%, a specificity of 97.1%, and an area under the receiver operating characteristic curve of 0.947. The DL-based method integrates feature learning with feature selection on SWE. It may be potentially used in clinical computer-aided diagnosis of breast cancer.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SDAE, PGBM combined with RBM, and GoogLeNet CNN applied to breast US or shear-wave elastography images for breast cancer diagnosis obtained superior performance compared with human experts.
“In addition, the stacked denoising auto-encoder (SDAE) [88], a combination of the point-wise gated Boltzmann machine (PGBM) and RBM [89], and the GoogLeNet CNN [90] have been applied to breast US or shear-wave elastography images for breast cancer diagnosis; all of these obtained a superior performance when compared with human experts.”
From Deep Learning in Medical Ultrasound Analysis: A Review (2019) · cites this paper as [89]
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · see citing works
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928 · see citing works
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · see citing works
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · see citing works
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285 · see citing works
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · see citing works
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,869 · see citing works
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759 · see citing works
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 4,834 · see citing works
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,701 · see citing works
WFUMB Guidelines and Recommendations for Clinical Use of Ultrasound Elastography: Part 3: Liver
Ferraioli, G., Fìlice, C., Castéra, L., Choi, B. I., Sporea, I., Wilson, S. R., Cosgrove, D. O., Dietrich, C. F., Amy, D., Bamber, J. C., et al. (2015) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2015.03.007 · Cited by 880 · see citing works
Berg, W. A., Cosgrove, D. O., Doré, C. J., Schäfer, F. K. W., Svensson, W. E., Hooley, R. J., Ohlinger, R., Mendelson, E. B., Balu-Maestro, C., Locatelli, M., et al. (2012) · Radiology · doi:10.1148/radiol.11110640 · Cited by 844 · see citing works
On Deep Multi-View Representation Learning
Wang, W., Livescu, K., & Bilmes, J. (2015) · Cited by 751 · see citing works
Classification using discriminative restricted Boltzmann machines
Larochelle, H., & Bengio, Y. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390224 · Cited by 666 · see citing works
Improving Computer-Aided Detection UsingConvolutional Neural Networks and Random View Aggregation
Roth, H. R., Lu, L., Liu, J., Yao, J., Seff, A., Cherry, K., Kim, L., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2482920 · Cited by 608 · see citing works
Campbell, M. J., Julious, S. A., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.311.7013.1145 · Cited by 476 · see citing works
WFUMB Guidelines and Recommendations for Clinical Use of Ultrasound Elastography: Part 2: Breast
Barr, R. G., Nakashima, K., Amy, D., et al. (2015) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2015.03.008 · Cited by 473 · see citing works
Quantitative shear wave ultrasound elastography: initial experience in solid breast masses
Evans, A. J., Whelehan, P., Thomson, K., McLean, D., Brauer, K., Purdie, C. A., Jordan, L. B., Baker, L., & Thompson, A. (2010) · Breast Cancer Research · doi:10.1186/bcr2787 · Cited by 452 · see citing works
Breast cancer—facts and figures
Harvey, J., Down, S. K., Bright-Thomas, R., Winstanley, J. H. R., & Bishop, H. (2013) · Oxford University Press eBooks · doi:10.1093/med/9780199215065.003.0005 · Cited by 286 · see citing works
Segmentation of ultrasound B-mode images with intensity inhomogeneity correction
Xiao, G., Brady, M., Noble, J. A., & Zhang, Y. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/42.981233 · Cited by 188 · see citing works
Stiffness of tumours measured by shear-wave elastography correlated with subtypes of breast cancer
Chang, J. M., Park, I. A., Lee, S. H., et al. (2013) · European Radiology · doi:10.1007/s00330-013-2866-2 · Cited by 182 · see citing works
Zhou, J., Zhan, W., Chang, C., Zhang, X.-X., Jia, Y., Dong, Y., Zhou, C. J., Sun, J., & Grant, E. G. (2014) · Radiology · doi:10.1148/radiol.14130818 · Cited by 173 · see citing works
Zheng, J., Guo, H., Zeng, J., et al. (2015) · Radiology · doi:10.1148/radiol.14140828 · Cited by 134 · see citing works
Tozaki, M., & Fukuma, E. (2011) · Acta Radiologica · doi:10.1258/ar.2011.110276 · Cited by 127 · see citing works
Zhang, Z. J., Ng, G. Y.-F., Lee, W. C., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108337 · Cited by 124 · see citing works
Shear wave elastography of thyroid nodules for the prediction of malignancy in a large scale study
Park, A. Y., Son, E. J., Han, K., et al. (2014) · European Journal of Radiology · doi:10.1016/j.ejrad.2014.11.019 · Cited by 124 · see citing works
Ahmad, S., Cao, R., Varghese, T., Bidaut, L. M., & Nabi, G. (2013) · Surgical Endoscopy · doi:10.1007/s00464-013-2906-7 · Cited by 114 · see citing works
Hinton, G. E. (2013) · Cognitive Science · doi:10.1111/cogs.12049 · Cited by 108 · see citing works
Learning and Selecting Features Jointly with Point-wise Gated Boltzmann Machines
Sohn, K., Zhou, G., Lee, C., & Lee, H. (2013) · Cited by 94 · see citing works
Robust phase-based texture descriptor for classification of breast ultrasound images
Cai, L., Wang, X., Wang, Y., Guo, Y., Yu, J., & Wang, Y. (2015) · BioMedical Engineering OnLine · doi:10.1186/s12938-015-0022-8 · Cited by 88 · see citing works
Moon, W. K., Shen, Y.-W., Huang, C., Chiang, L.-R., & Chang, R. (2011) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2011.01.006 · Cited by 88 · see citing works
Ultrasound RF Time Series for Classification of Breast Lesions
Uniyal, N., Eskandari, H., Abolmaesumi, P., Sojoudi, S., Gordon, P. B., Warren, L. J., Rohling, R. N., Salcudean, S. E., & Moradi, M. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2365030 · Cited by 83 · see citing works
Computer-Aided Lesion Diagnosis in Automated 3-D Breast Ultrasound Using Coronal Spiculation
Tan, T., Platel, B., Huisman, H. J., et al. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2184549 · Cited by 80 · see citing works
Implicit Mixtures of Restricted Boltzmann Machines
Nair, V. B., & Hinton, G. E. (2008) · Cited by 72 · see citing works
Berg, W. A., Mendelson, E. B., Cosgrove, D. O., et al. (2015) · American Journal of Roentgenology · doi:10.2214/ajr.14.13448 · Cited by 70 · see citing works
Erdoğan, Ş. Z., & Bilgin, T. T. (2012) · IET Communications · doi:10.1049/iet-com.2011.0228 · Cited by 64 · see citing works
Xiao, Y., Zeng, J., Niu, L., et al. (2013) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2013.09.032 · Cited by 58 · see citing works
Self-citationQuantitative Ultrasound Analysis for Classification of BI-RADS Category 3 Breast Masses
Moon, W. K., Lo, C., Chang, J. M., et al. (2013) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-013-9593-8 · Cited by 54 · see citing works
An integrated system for the segmentation of atherosclerotic carotid plaque ultrasound video
Loizou, C. P., Petroudi, S., Pantziaris, M., et al. (2014) · IEEE Transactions on Ultrasonics Ferroelectrics and Frequency Control · doi:10.1109/tuffc.2014.6689778 · Cited by 53 · see citing works
Zhang, Q., Xiao, Y., Chen, S., Wang, C., & Zheng, H. (2014) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2014.09.003 · Cited by 52 · see citing works
Self-citationRelationship between elasticity and collagen fiber content in breast disease: A preliminary report
Wang, Z., Sun, L., Li, Y., & Li, N. (2014) · Ultrasonics · doi:10.1016/j.ultras.2014.10.016 · Cited by 50 · see citing works
Moon, W. K., Lo, C., Chang, J. M., et al. (2012) · Medical Physics · doi:10.1118/1.4754801 · Cited by 41 · see citing works
Zhang, Q., Li, C., Han, H., et al. (2014) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2014.03.005 · Cited by 31 · see citing works
Self-citationTan, T., Platel, B., Twellmann, T., et al. (2013) · Academic Radiology · doi:10.1016/j.acra.2013.07.013 · Cited by 30 · see citing works
Breast-lesion Segmentation Combining B-Mode and Elastography Ultrasound
Pons, G., Martı́, J., Martí, R., Ganau, S., & Noble, J. A. (2015) · Ultrasonic Imaging · doi:10.1177/0161734615589287 · Cited by 26 · see citing works
Schäfer, F. K. W., Hooley, R. J., Ohlinger, R., et al. (2013) · Ultraschall in der Medizin - European Journal of Ultrasound · doi:10.1055/s-0033-1335523 · Cited by 25 · see citing works
Medical Computer Vision: Algorithms for Big Data
Metaxas, D., Cai, W. (., Zhang, S., et al. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13972-2 · Cited by 19 · see citing works
Quantitative analysis of breast echotexture patterns in automated breast ultrasound images
Chang, R., Hou, Y.-L., Lo, C., et al. (2015) · Medical Physics · doi:10.1118/1.4923754 · Cited by 13 · see citing works
Object Classification in an Ultrasound Video Using LP-SIFT Features
Maraci, M. A., Napolitano, R., Papageorghiou, A. T., et al. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13972-2_7 · Cited by 10 · see citing works
Fisher vector encoding for detecting objects of interest in ultrasound videos
Maraci, M. A., Napolitano, R., Papageorghiou, A. T., & Noble, J. A. (2015) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2015.7163957 · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332 · see citing works
Deep Learning in Medical Ultrasound Analysis: A Review
Liu, S., Wang, Y., Yang, X., Lei, B., Liu, L., Li, S. X., Ni, D., & Wang, T. (2019) · Engineering · doi:10.1016/j.eng.2018.11.020 · Cited by 798 · see citing works
Machine learning for medical ultrasound: status, methods, and future opportunities
Brattain, L. J., Telfer, B. A., Dhyani, M., Grajo, J. R., & Samir, A. E. (2018) · Abdominal Radiology · doi:10.1007/s00261-018-1517-0 · Cited by 262 · see citing works
Byra, M., Galperin, M., Ojeda‐Fournier, H., Olson, L., O'Boyle, M., Comstock, C., & Andre, M. (2019) · Medical Physics · doi:10.1002/mp.13361 · Cited by 253 · see citing works
Pfob, A., Sidey-Gibbons, C., Barr, R. G., Duda, V., Alwafai, Z., Balleyguier, C., Clevert, D.-A., Fastner, S., Gomez, C., Goncalo, M., et al. (2022) · European Journal of Cancer · doi:10.1016/j.ejca.2022.09.018 · Cited by 27 · see citing works
- Authors
- Zhang, Q., Xiao, Y., Dai, W., Suo, J., Wang, C., Shi, J., & Zheng, H.
- Affiliations
- Shanghai University (CN)
- Chinese Academy of Sciences (CN)
- Corresponding author
- Zhang, Qi
- Zheng, Hairong
- Venue
- Ultrasonics
- Publisher
- Elsevier BV
- Published
- 2016-12
- Volume
- 72
- Pages
- 150-157
- ISSN
- 0041-624X (ISSN-L)
- OpenAlex
- W2509685700
- Cited by
- 240
- References
- 52
- Citations by year
- 2026: 5 · 2025: 15 · 2024: 35 · 2023: 22 · 2022: 19 · 2021: 40 · 2020: 36 · 2019: 28 · 2018: 19 · 2017: 21
- FWCI
- 19.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ultrasonics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61401267, 61302039, 61471231)
- Shanghai Natural Science Fund for Youth Scholars (12ZR1444100)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Ultrasound Imaging and Elastography
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- breast cancer, shear wave elastography, benign versus malignant breast tumors, deep learning, restricted Boltzmann machine, feature extraction, feature selection, computer-aided diagnosis, tumor classification
- MeSH terms
- Adult, Biopsy, Breast Neoplasms, Diagnosis, Differential, Female, Humans, Image Interpretation, Computer-Assisted, Retrospective Studies, Sensitivity and Specificity, Ultrasonography, Mammary, Neural Networks, Computer, Elasticity Imaging Techniques
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review