Guest Editorial Explainable AI: Towards Fairness, Accountability, Transparency and Trust in Healthcare
Open accessAbstract
The papers in this special section focus on explainable artificial intelligence (AI) in healthcare services. Recent advances in AI, precision health, and medicine have paved the way for the accelerated adaptation and use of intelligent tools and systems in decision-making processes across the healthcare spectrum. Insights and knowledge derived from complex analytics are used to implement diagnostic and therapeutic solutions and targeted interventions in individuals and communities across the globe. Given the complexity of the current multi-dimensional clinical and public health data landscape, providing explainability in the context of socio-environmental and technical systems is a key to revealing pathways from socio-economic disadvantages to health disparities and implementing equitable interventions. As the complexity of the underlying data sets and AI-based algorithms increases, the explainability and justifiability of the insights generated decrease. Humans need to understand the underlying mechanism behind these insights to know whether they are sound, correct, trustable, and justifiable to make informed decisions. Lack of understandability and explainability in the biomedical domain often leads to poor transparency and accountability and ultimately lower quality of care and suboptimal and unfair health policies. Explainability is considered one of the prerequisites for deep medicine, where AI is meant to provide composite, panoramic views of individuals’ medical data.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The integration of AI into healthcare alters traditional decision-making practices based on epistemic probability and prudence and raises ethical, legal, and medical dilemmas when making critical decisions about human lives and medical conditions.
“Additionally, the integration of AI into healthcare alters traditional decision-making practices based on epistemic probability and prudence (Parviainen, Rantala (2022)) and raises ethical, legal, and medical dilemmas when it comes to making critical decisions about human lives and medical conditions (Shaban-Nejad et al., 2021;Vilaza & McCashin, 2021).”
From Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation (2024) · cites this paper as Shaban-Nejad et al., 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
XAI—Explainable artificial intelligence
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019) · Science Robotics · doi:10.1126/scirobotics.aay7120 · Cited by 2,053 · see citing works
Causability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885 · see citing works
(2019) · Cited by 986 · see citing works
Lauritsen, S. M., Kristensen, M., Olsen, M. V., Larsen, M. S., Lauritsen, K. M., Jørgensen, M. J., Lange, J., & Thiesson, B. (2020) · Nature Communications · doi:10.1038/s41467-020-17431-x · Cited by 448 · see citing works
Goh, K. H., Wang, L., Yeow, A. Y. K., Poh, H., Li, K., Yeow, J. J. L., & Tan, G. Y. H. (2021) · Nature Communications · doi:10.1038/s41467-021-20910-4 · Cited by 415 · see citing works
Theoretical Impediments to Machine Learning With Seven Sparks from the Causal Revolution
Pearl, J. (2018) · Web Search and Data Mining · doi:10.1145/3159652.3176182 · Cited by 375 · see citing works
Hossain, M. S., Muhammad, G., & Guizani, N. (2020) · IEEE Network · doi:10.1109/mnet.011.2000458 · Cited by 347 · see citing works
Morphological and molecular breast cancer profiling through explainable machine learning
Binder, A., Bockmayr, M., Hägele, M., Wienert, S., Heim, D., Hellweg, K., Ishii, M., Stenzinger, A., Hocke, A., Denkert, C., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00303-4 · Cited by 156 · see citing works
Shin, E. K., Mahajan, R., Akbilgiç, O., & Shaban‐Nejad, A. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0056-y · Cited by 66 · see citing works
Self-citationAnguita‐Ruiz, A., Segura‐Delgado, A., Alcalá, R., Aguilera, C. M., & Alcalá‐Fdez, J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007792 · Cited by 63 · see citing works
Ammar, N., & Shaban‐Nejad, A. (2020) · JMIR Medical Informatics · doi:10.2196/18752 · Cited by 62 · see citing works
Self-citationSeven pillars of precision digital health and medicine
Shaban‐Nejad, A., Michalowski, M., Peek, N. B., Brownstein, J. S., & Buckeridge, D. L. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101793 · Cited by 37 · see citing works
Self-citationExplainability and Interpretability: Keys to Deep Medicine
Shaban-Nejad, A., Michalowski, M., & Buckeridge, D. L. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-53352-6_1 · Cited by 35 · see citing works
Self-citationGeo-clustered chronic affinity: pathways from socio-economic disadvantages to health disparities
Shin, E. K., Kwon, Y., & Shaban-Nejad, A. (2019) · JAMIA Open · doi:10.1093/jamiaopen/ooz029 · Cited by 24 · see citing works
Self-citationHealth Intervention Evaluation Using Semantic Explainability and Causal Reasoning
Brenas, J. H., & Shaban-Nejad, A. (2020) · IEEE Access · doi:10.1109/access.2020.2964802 · Cited by 24 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 12
- W. Shi, L. Tong, Y. Zhu, and M. D. Wang, "COVID- 19 automatic diagnosis with radiographic imaging: Ex- plainable attentiontransfer deep neural networks," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- Y. Jeon et al., "Interpretable and lightweight 3-D deep learning model for automated ACL diagnosis," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- P. Ivaturi, M. Gadaleta, A. C. Pandey, M. Pazzani, S. R. Steinhubl, and G. Quer, "A comprehensive explanation framework for biomedical time series classification," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- N. Beebe-Wang, A. Okeson, T. Althoff, and S. I. Lee, "Efficient and explainable risk assessments for immi- nent dementia in an aging cohort study," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- L. Alexandre, R. S. Costa, L. L. Santos, and R. Hen- riques, "Mining pre-surgical patterns able to discrimi- nate post-surgical outcomes in the oncological domain," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- K. K. Wickstrom, K. OyvindMikalsen, M. Kampffmeyer, A. Revhaug, and R. Jenssen, "Uncertainty-Aware deep ensembles for reliable and explainable predictions of clinical time series," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- H. Xu, J. Pang, W. Zhang, X. Li, M. Li, and D. Zhao, "Predicting recurrence for patients with ischemic cere- brovascular events based on process discovery and trans- fer learning," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- A. Chaddad, P. Sargos, and C. Desrosiers, "Modeling texture in deep 3D CNN for survival analysis," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- Y. Shang et al., "EHR-oriented knowledge graph sys- tem: Toward efficient utilization of Non-used informa- tion buried in routine clinical practice," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- W. Oh, M. S. Steinbach, M. R. Castro, K. A. Peterson, and V. Kumar, "A computational method for learning disease trajectories from partially observable EHR data," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021.
- G. Feng, K. Yu, Y. Wang, Y. Yuan, and P. M. Djuric, "Exploiting causality for improved prediction of pa- tient volumes by Gaussian processes," IEEE J. Biomed. Health Inform., vol. 25, no. 7, Jul. 2021. REFERENCES
- A. Holzinger, G. Langs, H. Denk, K. Zatloukal, and H. Müller, "Caus- ability and explain-ability of artificial intelligence in medicine," Wiley Interdiscip. Rev. Data Min. Knowl. Discov., vol. 9, no. 4, Jul./Aug. 2019, Art. no. e1312.
Cited by
Sorted by citations
Ali, O., Abdelbaki, W., Shrestha, A., Elbasi, E., Alryalat, M. A. A., & Dwivedi, Y. K. (2023) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2023.100333 · Cited by 568 · see citing works
Polyportis, A., & Pahos, N. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02464-6 · Cited by 64 · see citing works
Wang, B., Asan, O., & Mansouri, M. (2023) · JMIR Human Factors · doi:10.2196/49788 · Cited by 23 · see citing works
- Authors
- Shaban-Nejad, A., Michalowski, M., Brownstein, J., & Buckeridge, D.
- Affiliations
- University of Minnesota (US)
- Boston Children's Hospital (US)
- McGill University (CA)
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2021-07
- Volume
- 25
- Issue
- 7
- Pages
- 2374-2375
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W3185885987
- Cited by
- 71
- References
- 15
- Citations by year
- 2026: 10 · 2025: 13 · 2024: 19 · 2023: 17 · 2022: 9 · 2021: 3
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- IEEE Journal of Biomedical and Health Informatics (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- explainable AI, artificial intelligence in healthcare, fairness, accountability, transparency, trust, health disparities, clinical decision support, precision health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review