Challenges of Deep Learning in Medical Image Analysis—Improving Explainability and Trust
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Deep learning has revolutionized the detection of diseases and is helping the healthcare sector break barriers in terms of accuracy and robustness to achieve efficient and robust computer-aided diagnostic systems. The application of deep learning techniques empowers automated AI-based utilities requiring minimal human supervision to perform any task related to medical diagnosis of fractures, tumors, and internal hemorrhage; preoperative planning; intra-operative guidance, etc. However, deep learning faces some major threats to the flourishing healthcare domain. This paper traverses the major challenges that the deep learning community of researchers and engineers faces, particularly in medical image diagnosis, like the unavailability of balanced annotated medical image data, adversarial attacks faced by deep neural networks and architectures due to noisy medical image data, a lack of trustability among users and patients, and ethical and privacy issues related to medical data. This study explores the possibilities of AI autonomy in healthcare by overcoming the concerns about trust that society has in autonomous intelligent systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00917 · Cited by 4,332
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974
Machine learning and deep learning
Janiesch, C., Zschech, P., & Heinrich, K. (2021) · Electronic Markets · doi:10.1007/s12525-021-00475-2 · Cited by 2,959
Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.013 · Cited by 1,938
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
A survey of deep learning techniques for autonomous driving
Grigorescu, S., Trasnea, B., Cocias, T., & Macesanu, G. (2020) · Journal of Field Robotics · doi:10.1002/rob.21918 · Cited by 1,809
Meta-Learning in Neural Networks: A Survey
Hospedales, T., Antoniou, A., Micaelli, P., & Storkey, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05439 · Cited by 886 · cited 1×
“Zhang et al. [36] used a domain adaptation technique to overcome the unavailability of medical image data by segmenting medical images using meta-learning [37].”
Synthetic data augmentation using GAN for improved liver lesion classification
Frid-Adar, M., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363576 · Cited by 860
CT artifacts: causes and reduction techniques
Boas, F. E., & Fleischmann, D. (2012) · Imaging in Medicine · doi:10.2217/iim.12.13 · Cited by 848
Medical Image Denoising Using Convolutional Denoising Autoencoders
Gondara, L. (2016) · 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw.2016.0041 · Cited by 737 · cited 1×
“Gondara [20] showed that denoising autoencoders using convolutional layer blocks can be used as effective denoising tools for medical imaging.”
BackgroundGu, R., Wang, G., Song, T., Huang, R., Aertsen, M., Deprest, J., Ourselin, S., Vercauteren, T., & Zhang, S. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3035253 · Cited by 720
Medical Image Synthesis with Deep Convolutional Adversarial Networks
Nie, D., Trullo, R., Lian, J., Wang, L., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2814538 · Cited by 625
Machine learning, medical diagnosis, and biomedical engineering research - commentary
Foster, K. R., Koprowski, R., & Skufca, J. D. (2014) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-13-94 · Cited by 385
Magesh, P. R., Myloth, R. D., & Tom, R. J. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104041 · Cited by 295
Responsible AI—two frameworks for ethical design practice
Peters, D., Vold, K., Robinson, D., & Calvo, R. A. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2974991 · Cited by 293 · cited 1×
“To remedy such challenges, researchers could use techniques involving pseudonymized data or differential privacy rather than identified data [44].”
BackgroundPredicting COVID-19 Pneumonia Severity on Chest X-ray With Deep Learning
Cohen, J. P., Dao, L., Roth, K., Morrison, P., Bengio, Y., Abbasi, A. F., Shen, B., Mahsa, H. K., Ghassemi, M., Li, H., et al. (2020) · Cureus · doi:10.7759/cureus.9448 · Cited by 259
Medical image denoising using convolutional neural network: a residual learning approach
Jifara, W., Jiang, F., Rho, S., Cheng, M., & Liu, S. (2019) · The Journal of Supercomputing · doi:10.1007/s11227-017-2080-0 · Cited by 231
MetaMed: Few-shot medical image classification using gradient-based meta-learning
Singh, R., Bharti, V., Purohit, V., Kumar, A., Singh, A. K., & Singh, S. K. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108111 · Cited by 183
Towards a science of integrated AI and Robotics
Rajan, K., & Saffiotti, A. (2017) · Artificial Intelligence · doi:10.1016/j.artint.2017.03.003 · Cited by 180
Machine Learning and AI for Healthcare: Big Data for Improved Health Outcomes
Panesar, A. (2019) · Apress eBooks · doi:10.1007/978-1-4842-3799-1 · Cited by 166
Motion Artifact in Magnetic Resonance Imaging: Implications for Automated Analysis
Blumenthal, J. D., Zijdenbos, A. P., Molloy, E. A., & Giedd, J. N. (2002) · NeuroImage · doi:10.1006/nimg.2002.1076 · Cited by 158
Machine learning in biomedical engineering
Park, C., Took, C. C., & Seong, J.-K. (2018) · Biomedical Engineering Letters · doi:10.1007/s13534-018-0058-3 · Cited by 158
GAN-Based Data Augmentation and Anonymization for Skin-Lesion Analysis: A Critical Review
Bissoto, A. E., Junior, E. A. D. V., & Avila, S. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00204 · Cited by 137
Medical Image Denoising Using Bilateral Filter
Bhonsle, D., Chandra, V. K., & Sinha, G. R. (2012) · International Journal of Image Graphics and Signal Processing · doi:10.5815/ijigsp.2012.06.06 · Cited by 117
APPLICATIONS OF ARTIFICIAL INTELLIGENCE TECHNIQUES TO REMOTE SENSING∗
Estes, J. E., Sailer, C. T., & Tinney, L. R. (1986) · The Professional Geographer · doi:10.1111/j.0033-0124.1986.00133.x · Cited by 43
Trust‐aware generative adversarial network with recurrent neural network for recommender systems
Chen, H., Wang, S., Jiang, N., Li, Z., Yan, N., & Shi, L. (2020) · International Journal of Intelligent Systems · doi:10.1002/int.22320 · Cited by 37
Domain Adaptation for Medical Image Segmentation: A Meta-Learning Method
Zhang, P., Li, J., Wang, Y., & Pan, J. (2021) · Journal of Imaging · doi:10.3390/jimaging7020031 · Cited by 36
Medical image blind denoising using context bilateral filter
Liao, Z., Hu, S., Yu, Z., & Sun, D. (2010) · International Conference of Medical Image Analysis and Clinical Application (MIACA) · doi:10.1109/miaca.2010.5528280 · Cited by 15
Mine, P., Fernández-Quilez, Á., Aarsland, D., Ferreira, D., Westman, E., Lemstra, A. W., ten Kate, M., Padovani, A., Rektorova, I., Bonanni, L., et al. (2022) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2611339 · Cited by 8
Cited by
Yuan, H., Hong, C., Jiang, P.-T., Zhao, G., Tran, N. T. A., Xu, X., Yan, Y. Y., & Liu, N. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104673 · Cited by 11
Metadata
- Authors
- Dhar, T., Dey, N., Borra, S., & Sherratt, R. S.
- Venue
- IEEE Transactions on Technology and Society
- Published
- 2023-03
- Volume
- 4
- Issue
- 1
- Pages
- 68-75
- ISSN
- 2637-6415 (ISSN-L)
- OpenAlex
- W4313484972
- Cited by
- 309
- References
- 36
- FWCI
- 10.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.