The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
A deep learning approach for the analysis of masses in mammograms with minimal user intervention
Abstract
HighlightsWe introduce a novel automated CAD system with minimal user intervention that can detect, segment and classify breast masses from mammograms. We explore deep learning and structured output models for the design and development of the proposed CAD system. More specifically for the detection, we propose a cascade of deep learning methods to select hypotheses that are refined based on Bayesian optimization. For the segmentation, we propose the use of deep structured output learning that is subsequently refined by a level set method. Finally, for the classification, we propose a deep learning classifier that is pre‐trained with a regression to hand‐crafted feature values and fine‐tuned based on the annotations of the breast mass classification dataset. Our proposed CAD system produces the current state‐of‐the‐art detection, segmentation and classification results for the INbreast dataset. Graphical abstract Figure. No Caption available. Abstract We present an integrated methodology for detecting, segmenting and classifying breast masses from mammograms with minimal user intervention. This is a long standing problem due to low signal‐to‐noise ratio in the visualisation of breast masses, combined with their large variability in terms of shape, size, appearance and location. We break the problem down into three stages: mass detection, mass segmentation, and mass classification. For the detection, we propose a cascade of deep learning methods to select hypotheses that are refined based on Bayesian optimisation. For the segmentation, we propose the use of deep structured output learning that is subsequently refined by a level set method. Finally, for the classification, we propose the use of a deep learning classifier, which is pre‐trained with a regression to hand‐crafted feature values and fine‐tuned based on the annotations of the breast mass classification dataset. We test our proposed system on the publicly available INbreast dataset and compare the results with the current state‐of‐the‐art methodologies. This evaluation shows that our system detects 90% of masses at 1 false positive per image, has a segmentation accuracy of around 0.85 (Dice index) on the correctly detected masses, and overall classifies masses as malignant or benign with sensitivity (Se) of 0.98 and specificity (Sp) of 0.7.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2010) · International Conference on Machine Learning · Cited by 13,995
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Chan, T. F., & Vese, L. A. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.902291 · Cited by 10,304
Jemal, A., Siegel, R., Ward, E., Hao, Y., Xu, J., Murray, T., & Thun, M. J. (2008) · CA: A Cancer Journal for Clinicians · doi:10.3322/ca.2007.0010 · Cited by 10,188
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
The Handbook of brain theory and neural networks
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4484 · Cited by 3,870
Sethian, J. A. (1999) · Cited by 3,622
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Proceedings of IEEE International Conference on Computer Vision
(1995) · doi:10.1109/iccv.1995 · Cited by 2,280
Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536 · cited 3×
“increase in the number of training images (Cireşan et al. (2013)), or a combination with other machine learning techniques (Dhungel et al. (2015a,b); Ngo and Carneiro (2014)).”
BackgroundInfluential2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1994) · 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1994.323798 · Cited by 1,477
Moreira, I. C., Amaral, I., Domingues, I., Cardoso, A., Cardoso, M. J., & Cardoso, J. S. (2012) · Academic Radiology · doi:10.1016/j.acra.2011.09.014 · Cited by 1,177
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
Influence of Computer-Aided Detection on Performance of Screening Mammography
Fenton, J. J., Taplin, S. H., Carney, P. A., Abraham, L., Sickles, E. A., D'Orsi, C., Berns, E. A., Cutter, G., Hendrick, R. E., Barlow, W. E., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa066099 · Cited by 619
Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances
Tang, J., Rangayyan, R. M., Xu, J., El Naqa, I., & Yang, Y. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2008.2009441 · Cited by 619
Computer-aided diagnosis in chest radiography: a survey
Van Ginneken, B., Ter Haar Romeny, B. M., & Viergever, M. A. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.974918 · Cited by 516
Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
McAllester, D. (2009) · Uncertainty in Artificial Intelligence · Cited by 464
A review of automatic mass detection and segmentation in mammographic images
Oliver, A., Freixenet, J., Martí, J., Pérez, E., Pont, J., Denton, E. R. E., & Zwiggelaar, R. (2010) · Medical Image Analysis · doi:10.1016/j.media.2009.12.005 · Cited by 398
(2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8 · Cited by 377
Yu, S., & Guan, L. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.836371 · Cited by 324
Girshick, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.08083 · Cited by 276
Elmore, J. G., Jackson, S. L., Abraham, L., Miglioretti, D. L., Carney, P. A., Geller, B. M., Yankaskas, B. C., Kerlikowske, K., Onega, T., Rosenberg, R. D., et al. (2009) · Radiology · doi:10.1148/radiol.2533082308 · Cited by 263
Proceedings of the 28th Annual ACM Symposium on Applied Computing
(2013) · doi:10.1145/2480362 · Cited by 249
Structured Learning and Prediction in Computer Vision
Nowozin, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984579 · Cited by 239
Unregistered Multiview Mammogram Analysis with Pre-trained Deep Learning Models
Carneiro, G., Nascimento, J., & Bradley, A. P. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24574-4_78 · Cited by 235
Self-citationAutomated Mass Detection in Mammograms Using Cascaded Deep Learning and Random Forests
Dhungel, N., Carneiro, G., & Bradley, A. P. (2015) · 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2015.7371234 · Cited by 228
Self-citationZhang, Y., Sohn, K., Villegas, R., Pan, G., & Lee, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298621 · Cited by 216
Computerized analysis of breast lesions in three dimensions using dynamic magnetic‐resonance imaging
Gilhuijs, K. G. A., Giger, M. L., & Bick, U. (1998) · Medical Physics · doi:10.1118/1.598345 · Cited by 195
Deep Learning and Structured Prediction for the Segmentation of Mass in Mammograms
Dhungel, N., Carneiro, G., & Bradley, A. P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_74 · Cited by 191
Self-citationSahiner, B., Chan, H., Petrick, N., Helvie, M. A., & Hadjiiski, L. M. (2001) · Medical Physics · doi:10.1118/1.1381548 · Cited by 190
Learning Graphical Model Parameters with Approximate Marginal Inference
Domke, J. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.31 · Cited by 179
Structured Learning and Prediction in Computer Vision
Nowozin, S., & Lampert, C. H. (2011) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000033 · Cited by 178
2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI)
(2016) · doi:10.1109/isbi31200.2016 · Cited by 176
Wainwright, M. J., Jaakkola, T., & Willsky, A. S. (2003) · Cited by 167
Timp, S., & Karssemeijer, N. (2004) · Medical Physics · doi:10.1118/1.1688039 · Cited by 165
A Concentric Morphology Model for the Detection of Masses in Mammography
Eltonsy, N. H., Tourassi, G. D., & Elmaghraby, A. S. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.895460 · Cited by 161
The Automated Learning of Deep Features for Breast Mass Classification from Mammograms
Dhungel, N., Carneiro, G., & Bradley, A. P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_13 · Cited by 160
Self-citationComputed-aided diagnosis (CAD) in the detection of breast cancer
Dromain, C., Boyer, B., Ferré, R., Canale, S., Delaloge, S., & Balleyguier, C. (2012) · European Journal of Radiology · doi:10.1016/j.ejrad.2012.03.005 · Cited by 155
de Bruijne, M., Cattin, P. C., Cotin, S., Padoy, N., Speidel, S., Zheng, Y., & Essert, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87237-3 · Cited by 150
An automatic method to discriminate malignant masses from normal tissue in digital mammograms1
Brake, G. M. T., Karssemeijer, N., & Hendriks, J. H. C. L. (2000) · Physics in Medicine and Biology · doi:10.1088/0031-9155/45/10/308 · Cited by 126
Toward breast cancer diagnosis based on automated segmentation of masses in mammograms
Rojas‐Domínguez, A., & Nandi, A. K. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2008.08.006 · Cited by 122
A completely automated CAD system for mass detection in a large mammographic database
Bellotti, R., Carlo, F. D., Tangaro, S., Gargano, G., Maggipinto, G., Castellano, M., Massafra, R., Cascio, D., Fauci, F., Magro, R., et al. (2006) · Medical Physics · doi:10.1118/1.2214177 · Cited by 112
Computer‐aided detection of breast masses on full field digital mammograms
Wei, J., Sahiner, B., Hadjiiski, L. M., Chan, H., Petrick, N., Helvie, M. A., Roubidoux, M. A., Ge, J., & Zhou, C. (2005) · Medical Physics · doi:10.1118/1.1997327 · Cited by 105
Shi, J., Sahiner, B., Chan, H., Ge, J., Hadjiiski, L. M., Helvie, M. A., Nees, A. V., Wu, Y., Wei, J., Zhou, C., et al. (2007) · Medical Physics · doi:10.1118/1.2820630 · Cited by 104
Use of border information in the classification of mammographic masses
Varela, C., Timp, S., & Karssemeijer, N. (2006) · Physics in Medicine and Biology · doi:10.1088/0031-9155/51/2/016 · Cited by 102
Convergent message passing algorithms - a unifying viewPreprint
Meltzer, T., Globerson, A., & Weiss, Y. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2625 · Cited by 101
Mammography segmentation with maximum likelihood active contours
Rahmati, P., Adler, A., & Hamarneh, G. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.05.005 · Cited by 80
Deep structured learning for mass segmentation from mammograms
Dhungel, N., Carneiro, G., & Bradley, A. P. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351343 · Cited by 78
Self-citationComputer Vision - ECCV 2014 Workshops
Agapito, L., Bronstein, M. M., & Rother, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16199-0 · Cited by 72
Assessment of a novel mass detection algorithm in mammograms
Kozegar, E., Soryani, M., Bidgoli, B. M., et al. (2013) · Journal of Cancer Research and Therapeutics · doi:10.4103/0973-1482.126453 · Cited by 69
A model‐based framework for the detection of spiculated masses on mammographya)
Sampat, M. P., Bovik, A. C., Whitman, G. J., & Markey, M. K. (2008) · Medical Physics · doi:10.1118/1.2890080 · Cited by 61
Breast Mass Segmentation in Mammography Using Plane Fitting and Dynamic Programming
Song, E., Jiang, L., Jin, R., et al. (2009) · Academic Radiology · doi:10.1016/j.acra.2008.11.014 · Cited by 49
Ngo, T. A., & Carneiro, G. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.399 · Cited by 47
Self-citationDhungel, N., Carneiro, G., & Bradley, A. P. (2015) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2015.7163983 · Cited by 36
Self-citationMedical imaging and computers in the diagnosis of breast cancer
Giger, M. L. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2059826 · Cited by 11
Cited by
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Applications of deep learning and reinforcement learning to biological data
Mahmud, M., Kaiser, M. S., Hussain, A., & Vassanelli, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2790388 · Cited by 765
A Deep Learning Model to Predict a Diagnosis of Alzheimer Disease by Using 18 F-FDG PET of the Brain
Ding, Y., Sohn, J. H., Kawczynski, M. G., Trivedi, H., Harnish, R., Jenkins, N. W., Lituiev, D., Copeland, T. P., Aboian, M. S., Mari Aparici, C., et al. (2019) · Radiology · doi:10.1148/radiol.2018180958 · Cited by 577
Breast cancer detection using deep convolutional neural networks and support vector machines
Ragab, D. A., Sharkas, M., Marshall, S., & Ren, J. (2019) · PeerJ · doi:10.7717/peerj.6201 · Cited by 513
Convolutional Neural Networks for Radiologic Images: A Radiologist’s Guide
Soffer, S., Ben-Cohen, A., Shimon, O., Amitai, M. M., Greenspan, H., & Klang, E. (2019) · Radiology · doi:10.1148/radiol.2018180547 · Cited by 511
Metadata
- Authors
- Dhungel, N., Carneiro, G., & Bradley, A. P.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2017-04
- Volume
- 37
- Pages
- 114-128
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2580480204
- Cited by
- 336
- References
- 67
- FWCI
- 20.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.