The DOI matches its Crossref record; 36 of the 39 references it cites were found in a registry or an index, and 1 are not checked yet.
Deep learning in radiology: ethics of data and on the value of algorithm transparency, interpretability and explainability
Open accessAbstract
AI systems are quickly being adopted in radiology and, in general, in healthcare. A myriad of systems is being proposed and developed on a daily basis for high-stake decisions that can lead to unwelcome and negative consequences. AI systems trained under the supervised learning paradigm greatly depend on the quality and amount of data used to develop them. Nevertheless, barriers in data collection and sharing limit the data accessibility and potential ethical challenges might arise due to them leading, for instance, to systems that do not offer equity in their decisions and discriminate against certain patient populations or that are vulnerable to appropriation of intellectual property, among others. This paper provides an overview of some of the ethical issues both researchers and end-users might meet during data collection and development of AI systems, as well an introduction to the current state of transparency, interpretability and explainability of the systems in radiology applications. Furthermore, we aim to provide a comprehensive summary of currently open questions and identify key issues during the development and deployment of AI systems in healthcare, with a particular focus on the radiology area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Bias in clinical AI-model can be introduced either by the biased features that specify the disease or the hardware module used for image data collection [43,150].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“In particular, deep learning (DL) techniques have led to important breakthroughs in the computer vision area [2], which have been successfully applied to the radiology domain to, for example, classify patients based on chest X-rays diagnosis [3]—a key clinical focus area [4]—or nodule detection in…”
BackgroundAdvances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772 · cited 1×
“The DL field has quickly progressed during the past years, and as the field keeps evolving, medical imaging systems powered by DL algorithms will become more widespread leading to a larger number of radiology data analysis results that will depend on the performance and efficiency of such systems [7].”
BackgroundThe false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724 · cited 4×
“However, it has been argued that in their current form, explainable techniques for DL applications might not be suitable for scenarios such as the radiology one in which patients’ lives might be at stake [13].”
BackgroundInfluentialDeep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406 · cited 4×
“…vision area [2], which have been successfully applied to the radiology domain to, for example, classify patients based on chest X-rays diagnosis [3]—a key clinical focus area [4]—or nodule detection in computed tomography (CT) images [5], enabling the field to develop tools in times of crisis…”
BackgroundMethodInfluentialWHOQOL Group (1993) · Quality of Life Research · doi:10.1007/bf00435734 · Cited by 1,375
Do no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266 · cited 3×
“Even though DL algorithms have been shown to potentially reduce bias and improve healthcare practices or workflows [24], application of DL algorithms has also been shown to systemize or amplify biases [11, 25].”
BackgroundBenjamens, S., Dhunnoo, P., & Meskó, B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00324-0 · Cited by 1,215 · cited 2×
“A detailed and comprehensive list of the current CE and FDA cleared products and more details about CE and FDA marks can be found in [20, 21].”
Background(2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00937-3 · Cited by 1,048
Research works printed but not linked: 14
- Ding, J., Li, A., Hu, Z., Wang, L.: In medical image computing and computer assisted intervention—MICCAI, pp. 559–567. Springer, Cham (2017)
- Raghu M, Zhang C, Kleinberg J, Bengio S. Transfusion: Understanding transfer learning for medical imaging. arXiv preprint arXiv:1902.07208. 2019 Feb 14. · arXiv
- Seyyed-Kalantari, L., Zhang, H., McDermott, M., Chen, I.Y., Ghassemi, M.: Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nat. Med. 10, 1–7 (2021)
- Hardesty, L.: Study finds gender and skin-type bias in commercial artificial-intelligence systems. Retriev April. 11(3), 2019 (2018)
- Chen RJ, Chen TY, Lipkova J, Wang JJ, Williamson DF, Lu MY, Sahai S, Mahmood F. Algorithm fairness in AI for medicine and healthcare. arXiv preprint arXiv:2110.00603. (2021 Oct 1). · arXiv
- Puyol-Antón, E., Ruijsink, B., Piechnik, S.K., Neubauer, S., Petersen, S.E., Razavi, R., King, A.P.: Fairness in cardiac MR image analysis: an investigation of bias due to data imbalance in deep learning-based segmentation. In international conference on medical image computing and computer-assisted intervention, pp. 413–423. Springer, Cham (2021)
- Khullar, D.: Opinion A.I. could worsen health disparities. N.Y. Times, New York (2019)
- Karimian, G., Petelos, E., Evers, S.M.: The ethical issues of the application of artificial intelligence in healthcare: a systematic scoping review. AI Ethics. 28, 1–3 (2022)
- Mammen PM. Federated learning: opportunities and challenges. arXiv preprint arXiv:2101.05428. 2021 Jan 14. · arXiv
- Chen T, Kornblith S, Norouzi M, Hinton G. A simple framework for contrastive learning of visual representations. In International conference on machine learning. pp. 1597–1607. PMLR. (2020)
- Johnson, S.: Racing into the fourth industrial revolution: exploring the ethical dimensions of medical AI and rights-based regulatory framework. AI Ethics. 23, 1–6 (2022)
- Bleher, H., Braun, M.: Diffused responsibility: attributions of responsibility in the use of AI-driven clinical decision support systems. AI Ethics. 24, 1–5 (2022)
- Rajpurkar P, Irvin J, Zhu K, Yang B, Mehta H, Duan T, Ding D, Bagul A, Langlotz C, Shpanskaya K, Lungren MP. Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning. arXiv preprint arXiv:1711.05225. (2017 Nov 14). · arXiv
- Kaplan, S., Handelman, D., Handelman, A.: Sensitivity of neural networks to corruption of image classification. AI Ethics. 23, 1 (2021)
Cited by
Interpretability research of deep learning: A literature survey
Xu, B., & Yang, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102721 · Cited by 211
A Review of Machine Learning Algorithms for Biomedical Applications
Binson, V. A., Thomas, S., Subramoniam, M., Arun, J., Naveen, S., & Madhu, S. (2024) · Annals of Biomedical Engineering · doi:10.1007/s10439-024-03459-3 · Cited by 163
“Many machine learning models, like deep neural networks, are complex and difficult to interpret, which makes it complicated to understand the reasoning behind their predictions [162].”
Artificial Intelligence-Empowered Radiology—Current Status and Critical Review
Obuchowicz, R., Lasek, J., Wodziński, M., Piórkowski, A., Strzelecki, M., & Nurzyǹska, K. (2025) · Diagnostics · doi:10.3390/diagnostics15030282 · Cited by 146
Automated Radiology Report Generation: A Review of Recent Advances
Sloan, P., Clatworthy, P. L., Simpson, E., & Mirmehdi, M. (2024) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2024.3408456 · Cited by 168
“Ethical and confidentiality issues surrounding the public release of medical data [46] means medical datasets with associated radiology reports are scarce.”
Standards, frameworks, and legislation for artificial intelligence (AI) transparency
Lund, B. D., Orhan, Z., Mannuru, N. R., Bevara, R. V. K., Porter, B., Vinaih, M. K., & Bhaskara, P. (2025) · AI and Ethics · doi:10.1007/s43681-025-00661-4 · Cited by 135
“In healthcare, such opacity can undermine trust, leaving both patients and providers uncertain about the AI’s reliability and accuracy, which can lead to harmful outcomes for the patient [22].”
Metadata
- Authors
- Fernandez-Quilez, A.
- Venue
- AI and Ethics
- Published
- 2022-04-28
- Volume
- 3
- Issue
- 1
- Pages
- 257-265
- ISSN
- 2730-5953 (ISSN-L)
- 2730-5961
- OpenAlex
- W4225003227
- Cited by
- 66
- References
- 39
- Citations by year
- 2026: 10 · 2025: 18 · 2024: 18 · 2023: 17 · 2022: 3
- FWCI
- 4.24
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- AI and Ethics (publishedVersion, cc-by)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Funders
- Universitetet i Stavanger
- University Of Stavanger
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- artificial intelligence in healthcare, data ethics, algorithmic transparency, algorithmic interpretability, explainability, barriers to data sharing, algorithmic discrimination, algorithmic fairness, intellectual property, supervised learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deep learning in radiology: ethics of data and on the value of algorithm transparency, interpretability and explainability. https://app.cochat.ai/papers/10.1007/s43681-022-00161-9
- The paper
- Fernandez-Quilez, A. (2023). Deep learning in radiology: ethics of data and on the value of algorithm transparency, interpretability and explainability. AI and Ethics. https://doi.org/10.1007/s43681-022-00161-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.