CoChat
Sign Up
PreprintCited by 12Explainable Artificial Intelligence (XAI)Ethics and Social Impacts of AISafety Systems Engineering in Autonomy

Explainable AI is Responsible AI: How Explainability Creates Trustworthy and Socially Responsible Artificial Intelligence

Open access
Baker, Stephanie, Xiang, Wei·2023·arXiv
DOI 10.48550/arxiv.2312.01555arXiv 2312.01555
Open this paper in CoChat — free accountOpen PDF

Abstract

Artificial intelligence (AI) has been clearly established as a technology with the potential to revolutionize fields from healthcare to finance - if developed and deployed responsibly. This is the topic of responsible AI, which emphasizes the need to develop trustworthy AI systems that minimize bias, protect privacy, support security, and enhance transparency and accountability. Explainable AI (XAI) has been broadly considered as a building block for responsible AI (RAI), with most of the literature considering it as a solution for improved transparency. This work proposes that XAI and responsible AI are significantly more deeply entwined. In this work, we explore state-of-the-art literature on RAI and XAI technologies. Based on our findings, we demonstrate that XAI can be utilized to ensure fairness, robustness, privacy, security, and transparency in a wide range of contexts. Our findings lead us to conclude that XAI is an essential foundation for every pillar of RAI.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2312.01555

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In computer science, the terms responsible AI and explainable AI are often considered nearly interchangeable.

    “Se in ambito informatico i termini IA responsabile e IA spiegabile sono considerati spesso pressoché intercambiabili 3”

    From Responsible use of Artificial Intelligence in archives through the use of paradata (2025) · cites this paper as Baker, Xiang 2023

    Section 1.1 says the literature typically considers explainable AI (XAI) and responsible AI (RAI) as separate topics, contrary to the claim that the terms are often nearly interchangeable. Section 4 argues instead that XAI is foundational to RAI; it does not treat the terms as synonyms. Page numbers are unavailable in our copy. (LLM, conf=0.87)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 145

  1. A Adadi and M Berrada. 2018. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI). IEEE Access 6 (2018), 52138-52160. https://doi.org/10.1109/ACCESS.2018.2870052 · DOI · Paper page
  2. J Aechtner, L Cabrera, D Katwal, and others. 2022. Comparing User Perception of Explanations Developed with XAI Methods. In 2022 IEEE International Conference on Fuzzy Systems. 1-7. https://doi.org/10.1109/FUZZ-IEEE55066. 2022.9882743 · DOI
  3. F Afshar, S Seyedabrishami, and S Moridpour. 2022. Application of Extremely Randomised Trees for exploring influential factors on variant crash severity data. Scientific Reports 12, 1 (2022), 11476. https://doi.org/10.1038/s41598- 022-15693-7 · DOI
  4. I Ahmed, G Jeon, and F Piccialli. 2022. From Artificial Intelligence to Explainable Artificial Intelligence in Industry 4.0: A Survey on What, How, and Where. IEEE Transactions on Industrial Informatics 18, 8 (2022), 5031-5042. https://doi.org/10.1109/TII.2022.3146552 · DOI · Paper page
  5. M M Ahsan, R Nazim, Z Siddique, and P Huebner. 2021. Detection of covid-19 patients from ct scan and chest x-ray data using modified mobilenetv2 and lime. Healthcare (Switzerland) 9, 9 (2021), 1099. https://doi.org/10.3390/ healthcare9091099 · DOI
  6. Lamia Alam and Shane Mueller. 2021. Examining the effect of explanation on satisfaction and trust in AI diagnostic systems. BMC Medical Informatics and Decision Making 21, 1 (2021), 178. https://doi.org/10.1186/s12911-021-01542-6 · DOI
  7. E Amri, P Dardouillet, A Benoit, and others. 2022. Offshore Oil Slick Detection: From Photo-Interpreter to Explainable Multi-Modal Deep Learning Models Using SAR Images and Contextual Data. Remote Sensing 14, 15 (2022), 3565. https://doi.org/10.3390/rs14153565 · DOI
  8. Marianna Anagnostou, Olga Karvounidou, Chrysovalantou Katritzidaki, and others. 2022. Characteristics and challenges in the industries towards responsible AI: a systematic literature review. Ethics and Information Technology 24, 3 (2022), 37. https://doi.org/10.1007/s10676-022-09634-1 · DOI
  9. Deepak Anand, Kumar Yashashwi, Neeraj Kumar, and others. 2021. Weakly supervised learning on unannotated H&E-stained slides predicts BRAF mutation in thyroid cancer with high accuracy. The Journal of Pathology 255, 3 (nov 2021), 232-242. https://doi.org/10.1002/path.5773 · DOI
  10. I Arous, L Dolamic, J Yang, and others. 2021. MARTA: Leveraging Human Rationales for Explainable Text Classification. In 35th AAAI Conference on Artificial Intelligence, AAAI 2021, Vol. 7. AAAI Press, Vancouver, Canada, 5868-5876. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85129363314&partnerID=40&md5= 56f214b67454396f0aea9aa933bad621
  11. Mona Ashok, Rohit Madan, Anton Joha, and Uthayasankar Sivarajah. 2022. Ethical framework for Artificial Intelligence and Digital technologies. International Journal of Information Management 62 (2022), 102433. https://doi.org/10. 1016/j.ijinfomgt.2021.102433 · DOI · Paper page
  12. Nida Aslam, Irfan Ullah Khan, Aisha Alansari, and others. 2022. Anomaly Detection Using Explainable Random Forest for the Prediction of Undesirable Events in Oil Wells. Applied Computational Intelligence and Soft Computing 2022 (2022), 1558381. https://doi.org/10.1155/2022/1558381 · DOI
  13. M Atif, A Ceccarelli, T Zoppi, and others. 2022. Robust Traffic Sign Recognition Against Camera Failures. IEEE Open Journal of Intelligent Transportation Systems 3 (2022), 709-722. https://doi.org/10.1109/OJITS.2022.3213183 · DOI
  14. Edmond Awad, Sohan Dsouza, Richard Kim, and others. 2018. The Moral Machine experiment. Nature 563, 7729 (2018), 59-64. https://doi.org/10.1038/s41586-018-0637-6 · DOI · Paper page
  15. Jacqui Ayling and Adriane Chapman. 2022. Putting AI ethics to work: are the tools fit for purpose? AI and Ethics 2, 3 (2022), 405-429. https://doi.org/10.1007/s43681-021-00084-x · DOI · Paper page
  16. J Ayoub, X J Yang, and F Zhou. 2021. Combat COVID-19 infodemic using explainable natural language processing models. Information Processing and Management 58, 4 (2021), 102569. https://doi.org/10.1016/j.ipm.2021.102569 · DOI
  17. Xiao Bai, Xiang Wang, Xianglong Liu, and others. 2021. Explainable deep learning for efficient and robust pattern recognition: A survey of recent developments. Pattern Recognition 120 (2021), 108102. https://doi.org/10.1016/j. patcog.2021.108102 · DOI · Paper page
  18. Stephanie Baker and Wei Xiang. 2023. Artificial Intelligence of Things for Smarter Healthcare: A Survey of Ad- vancements, Challenges, and Opportunities. IEEE Communications Surveys & Tutorials 25, 2 (2023), 1261-1293. https://doi.org/10.1109/COMST.2023.3256323 · DOI
  19. Stephanie Baker, Wei Xiang, and Ian Atkinson. 2021. Hybridized neural networks for non-invasive and continuous mortality risk assessment in neonates. Comp. Biol. Med. 134 (2021), 104521. https://doi.org/10.1016/j.compbiomed. 2021.104521 · DOI
  20. Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, and others. 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion 58 (2020), 82-115. https://doi.org/10.1016/j.inffus.2019.12.012 · DOI · Paper page
  21. Shivam Behl, Aman Rao, Sahil Aggarwal, and others. 2021. Twitter for disaster relief through sentiment analysis for COVID-19 and natural hazard crises. International Journal of Disaster Risk Reduction 55 (2021), 102101. https: //doi.org/10.1016/j.ijdrr.2021.102101 · DOI
  22. Adrien Bennetot, Gianni Franchi, Javier Del Ser, and others. 2022. Greybox XAI: A Neural-Symbolic learning framework to produce interpretable predictions for image classification. Knowledge-Based Systems 258 (2022), 109947. https://doi.org/10.1016/j.knosys.2022.109947 · DOI
  23. T J Bollyky, E N Hulland, R M Barber, and others. 2022. Pandemic preparedness and COVID-19: an exploratory analysis of infection and fatality rates, and contextual factors associated with preparedness in 177 countries, from Jan 1, 2020, to Sept 30, 2021. The Lancet 399 (2022), 1489-1512. Issue 10334. https://doi.org/10.1016/S0140-6736(22)00172-6 · DOI · Paper page
  24. K W Bowyer, M C King, W J Scheirer, and K Vangara. 2020. The "Criminality From Face" Illusion. IEEE Transactions on Technology and Society 1, 4 (2020), 175-183. https://doi.org/10.1109/TTS.2020.3032321 · DOI
  25. Aso Bozorgpanah, Vicenç Torra, and Laya Aliahmadipour. 2022. Privacy and Explainability: The Effects of Data Protection on Shapley Values. https://doi.org/10.3390/technologies10060125 · DOI
  26. L C Brito, G A Susto, J N Brito, and M A V Duarte. 2022. An explainable artificial intelligence approach for unsupervised fault detection and diagnosis in rotating machinery. Mechanical Systems and Signal Processing 163 (2022), 108105. https://doi.org/10.1016/j.ymssp.2021.108105 · DOI
  27. Michael Bücker, Gero Szepannek, Alicja Gosiewska, and Przemyslaw Biecek. 2022. Transparency, auditability, and explainability of machine learning models in credit scoring. Journal of the Operational Research Society 73, 1 (jan 2022), 70-90. https://doi.org/10.1080/01605682.2021.1922098 · DOI
  28. Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81). PMLR, 77-91. https://proceedings.mlr.press/v81/buolamwini18a.html
  29. H Chefer, S Gur, and L Wolf. 2021. Transformer Interpretability Beyond Attention Visualization. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Curran Associates, Montreal, Canada, 782-791. https://doi.org/10.1109/CVPR46437.2021.00084 · DOI · Paper page
  30. P.-J. Chun, T Yamane, and Y Maemura. 2022. A deep learning-based image captioning method to automatically generate comprehensive explanations of bridge damage. Computer-Aided Civil and Infrastructure Engineering 37, 11 (2022), 1387-1401. https://doi.org/10.1111/mice.12793 · DOI
  31. Joowon Chung, Doyun Kim, Jongmun Choi, and others. 2022. Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph xAI model: efficient development of auditable risk prediction models via a fine-tuning approach. Scientific Reports 12, 1 (2022), 21164. https://doi.org/10.1038/s41598-022-24721-5 · DOI
  32. Ketki V. Deshpande, Shimei Pan, and James R. Foulds. 2020. Mitigating Demographic Bias in AI-Based Resume Filtering. In Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization (Genoa, Italy) (UMAP '20 Adjunct). ACM, New York, NY, USA, 268-275. https://doi.org/10.1145/3386392.3399569 · DOI
  33. Weiping Ding, Mohamed Abdel-Basset, Hossam Hawash, and Ahmed M Ali. 2022. Explainability of artificial intelligence methods, applications and challenges: A comprehensive survey. Information Sciences 615 (2022), 238-292. https://doi.org/10.1016/j.ins.2022.10.013 · DOI
  34. Rachel Lea Draelos and Lawrence Carin. 2020. HiResCam: Faithful location representation in visual attention for explainable 3D medical image classification. arXiv preprint arXiv:2011.08891 1 (2020), 1. · arXiv
  35. Rudresh Dwivedi, Devam Dave, Het Naik, and others. 2023. Explainable AI (XAI): Core Ideas, Techniques, and Solutions. ACM Comput. Surv. 55, 9 (jan 2023), 1-33. https://doi.org/10.1145/3561048 · DOI · Paper page
  36. Danielle Ensign, Sorelle A Friedler, Scott Neville, and others. 2018. Runaway feedback loops in predictive policing. In Proceedings of Machine Learning Research 2018. PMLR, New York, 160-171.
  37. Y V Fan, P Jiang, R R Tan, and others. 2022. Forecasting plastic waste generation and interventions for environmental hazard mitigation. Journal of Hazardous Materials 424 (2022), 127330. https://doi.org/10.1016/j.jhazmat.2021.127330 · DOI
  38. Heike Felzmann, Eduard Fosch-Villaronga, Christoph Lutz, and Aurelia Tamò-Larrieux. 2020. Towards transparency by design for artificial intelligence. Science and Engineering Ethics 26, 6 (2020), 3333-3361.
  39. Howard N Garb. 2021. Race bias and gender bias in the diagnosis of psychological disorders. Clinical Psychology Review 90 (2021), 102087. https://doi.org/10.1016/j.cpr.2021.102087 · DOI
  40. Alex Gaudio, Asim Smailagic, Christos Faloutsos, and others. 2023. DeepFixCX: Explainable privacy-preserving image compression for medical image analysis. WIREs Data Mining and Knowledge Discovery n/a, n/a (mar 2023), e1495. https://doi.org/10.1002/widm.1495 · DOI
  41. L Gaur, M Bhandari, T Razdan, and others. 2022. Explanation-Driven Deep Learning Model for Prediction of Brain Tumour Status Using MRI Image Data. Frontiers in Genetics 13 (2022), 822666. https://doi.org/10.3389/fgene.2022. 822666 · DOI
  42. P Ghosh, S Azam, M Jonkman, and others. 2021. Efficient prediction of cardiovascular disease using machine learning algorithms with relief and lasso feature selection techniques. IEEE Access 9 (2021), 19304-19326. https: //doi.org/10.1109/ACCESS.2021.3053759 · DOI
  43. V Granata, R Fusco, F De Muzio, and others. 2022. EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases. Cancers 14, 5 (2022), 1239. https://doi.org/10.3390/ cancers14051239 · DOI
  44. R Guidotti. 2022. Counterfactual explanations and how to find them: literature review and benchmarking. Data Mining and Knowledge Discovery 36 (2022), 1-55. https://doi.org/10.1007/s10618-022-00831-6 · DOI
  45. Y Himeur, K Ghanem, A Alsalemi, and others. 2021. Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives. Applied Energy 287 (2021), 116601. https://doi.org/10.1016/j.apenergy.2021.116601 · DOI · Paper page
  46. A Hosseinzadeh, J L Zhou, A Altaee, and D Li. 2022. Machine learning modeling and analysis of biohydrogen production from wastewater by dark fermentation process. Bioresource Technology 343 (2022), 126111. https: //doi.org/10.1016/j.biortech.2021.126111 · DOI
  47. Z A E Houda, B Brik, and L Khoukhi. 2022. "Why Should I Trust Your IDS?": An Explainable Deep Learning Framework for Intrusion Detection Systems in Internet of Things Networks. IEEE Open Journal of the Communications Society 3 (2022), 1164-1176. https://doi.org/10.1109/OJCOMS.2022.3188750 · DOI
  48. Yeonju Jang, Seongyune Choi, Heeseok Jung, and Hyeoncheol Kim. 2022. Practical early prediction of students' performance using machine learning and eXplainable AI. Education and Information Technologies 27, 9 (2022), 12855-12889. https://doi.org/10.1007/s10639-022-11120-6 · DOI · Paper page
  49. X Jia, K Shahzad, J J Klemeš, and X Jia. 2022. Changes in water use and wastewater generation influenced by the COVID-19 pandemic: A case study of China. Journal of Environmental Management 314 (2022), 115024. https: //doi.org/10.1016/j.jenvman.2022.115024 · DOI
  50. Y Jia, J McDermid, T Lawton, and I Habli. 2022. The Role of Explainability in Assuring Safety of Machine Learning in Healthcare. IEEE Transactions on Emerging Topics in Computing 10, 4 (2022), 1746-1760. https://doi.org/10.1109/ TETC.2022.3171314 · DOI
  51. Ke-Wen Jiang, Yang Song, Ying Hou, and others. 2023. Performance of Artificial Intelligence-Aided Diagnosis System for Clinically Significant Prostate Cancer with MRI: A Diagnostic Comparison Study. Journal of Magnetic Resonance Imaging 57, 5 (may 2023), 1352-1364. https://doi.org/10.1002/jmri.28427 · DOI
  52. Davinder Kaur, Suleyman Uslu, Kaley J Rittichier, and Arjan Durresi. 2022. Trustworthy Artificial Intelligence: A Review. ACM Comput. Surv. 55, 2 (jan 2022), 1-38. https://doi.org/10.1145/3491209 · DOI · Paper page
  53. M Khan, Z Ullah, O Mašek, and others. 2022. Artificial neural networks for the prediction of biochar yield: A comparative study of metaheuristic algorithms. Bioresource Technology 355 (2022), 127215. https://doi.org/10.1016/j. biortech.2022.127215 · DOI
  54. Elham Khodabandehloo, Daniele Riboni, and Abbas Alimohammadi. 2021. HealthXAI: Collaborative and explainable AI for supporting early diagnosis of cognitive decline. Future Generation Computer Systems 116 (2021), 168-189. https://doi.org/10.1016/j.future.2020.10.030 · DOI
  55. A Khurana, P Alamzadeh, and P K Chilana. 2021. ChatrEx: Designing Explainable Chatbot Interfaces for Enhancing Usefulness, Transparency, and Trust. In 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). 1-11. https://doi.org/10.1109/VL/HCC51201.2021.9576440 · DOI
  56. K Kim, H Yang, J Yi, and others. 2021. Real-time clinical decision support based on recurrent neural networks for in-hospital acute kidney injury: External validation and model interpretation. Journal of Medical Internet Research 23, 4 (2021), e24120. https://doi.org/10.2196/24120 · DOI
  57. G Kostopoulos, T Panagiotakopoulos, S Kotsiantis, and others. 2021. Interpretable Models for Early Prediction of Certification in MOOCs: A Case Study on a MOOC for Smart City Professionals. IEEE Access 9 (2021), 165881-165891. https://doi.org/10.1109/ACCESS.2021.3134787 · DOI
  58. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems -Volume 1 (Lake Tahoe, Nevada) (NIPS'12).
  59. Valerio La Gatta, Vincenzo Moscato, Marco Postiglione, and Giancarlo Sperlì. 2021. CASTLE: Cluster-aided space transformation for local explanations. Expert Systems with Applications 179 (2021), 115045. https://doi.org/10.1016/j. eswa.2021.115045 · DOI
  60. Linnea Laestadius, Andrea Bishop, Michael Gonzalez, and others. 2022. Too human and not human enough: A grounded theory analysis of mental health harms from emotional dependence on the social chatbot Replika. New Media & Society 26 (dec 2022), 14614448221142007. https://doi.org/10.1177/14614448221142007 · DOI · Paper page
  61. Bo Li, Peng Qi, Bo Liu, and others. 2023. Trustworthy ai: From principles to practices. Comput. Surveys 55, 9 (2023), 1-46.
  62. M Liang, Z Chang, Z Wan, and others. 2022. Interpretable Ensemble-Machine-Learning models for predicting creep behavior of concrete. Cement and Concrete Composites 125 (2022), 104295. https://doi.org/10.1016/j.cemconcomp. 2021.104295 · DOI
  63. Hui Wen Loh, Chui Ping Ooi, Silvia Seoni, and others. 2022. Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011-2022). Computer Methods and Programs in Biomedicine 226 (2022), 107161. https://doi.org/10.1016/j.cmpb.2022.107161 · DOI · Paper page
  64. Scott M Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems 30.
  65. Curran Associates, Inc., Long Beach, CA, USA, 4765-4774. http: //papers.nips.cc/paper/7062-a-unified-approach-to-interpreting-model-predictions.pdf
  66. Md. Abdul Malek. 2022. Criminal courts' artificial intelligence: the way it reinforces bias and discrimination. AI and Ethics 2, 1 (2022), 233-245. https://doi.org/10.1007/s43681-022-00137-9 · DOI
  67. AL-Essa Malik, Giuseppina Andresini, Annalisa Appice, and Donato Malerba. 2022. An XAI-based adversarial training approach for cyber-threat detection. In 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech). IEEE, 1-8.
  68. K O Maloney, C Buchanan, R D Jepsen, and others. 2022. Explainable machine learning improves interpretability in the predictive modeling of biological stream conditions in the Chesapeake Bay Watershed, USA. Journal of Environmental Management 322 (2022), 116068. https://doi.org/10.1016/j.jenvman.2022.116068 · DOI
  69. Guillermo S Marcillo, Nicolas F Martin, Brian W Diers, and others. 2021. Implementation of a Generalized Additive Model (GAM) for Soybean Maturity Prediction in African Environments. https://doi.org/10.3390/agronomy11061043 · DOI
  70. Laura Martinengo, Elaine Lum, and Josip Car. 2022. Evaluation of chatbot-delivered interventions for self-management of depression: Content analysis. Journal of Affective Disorders 319 (2022), 598-607. https://doi.org/10.1016/j.jad.2022. 09.028 · DOI · Paper page
  71. Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, and others. 2021. A Survey on Bias and Fairness in Machine Learning. ACM Comput. Surv. 54, 6, Article 115 (jul 2021), 35 pages. https://doi.org/10.1145/3457607 · DOI · Paper page
  72. X Mi, B Zou, F Zou, and J Hu. 2021. Permutation-based identification of important biomarkers for complex diseases via machine learning models. Nature Communications 12, 1 (2021), 3008. https://doi.org/10.1038/s41467-021-22756-2 · DOI
  73. Dang Minh, H Xiang Wang, Y Fen Li, and Tan N Nguyen. 2022. Explainable artificial intelligence: a comprehensive review. Artificial Intelligence Review 55, 5 (2022), 3503-3568. https://doi.org/10.1007/s10462-021-10088-y · DOI · Paper page
  74. Ministry of Economy Trade and Industry (Japan). 2022. AI Governance in Japan. Technical Report. https://www. meti.go.jp/english/press/2022/0128_003.html
  75. M Miron, S Tolan, E Gómez, and C Castillo. 2021. Evaluating causes of algorithmic bias in juvenile criminal recidivism. Artificial Intelligence and Law 29, 2 (2021), 111-147. https://doi.org/10.1007/s10506-020-09268-y · DOI
  76. A K Mondal, A Bhattacharjee, P Singla, and A P Prathosh. 2022. xViTCOS: Explainable Vision Transformer Based COVID-19 Screening Using Radiography. IEEE Journal of Translational Engineering in Health and Medicine 10 (2022), 1-10. https://doi.org/10.1109/JTEHM.2021.3134096 · DOI
  77. S M Muddamsetty, M N S Jahromi, A E Ciontos, and others. 2022. Visual explanation of black-box model: Similarity Difference and Uniqueness (SIDU) method. Pattern Recognition 127 (2022). https://doi.org/10.1016/j.patcog.2022.108604 · DOI
  78. K Muhammad, A Ullah, J Lloret, and others. 2021. Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions. IEEE Transactions on Intelligent Transportation Systems 22, 7 (2021), 4316-4336. https: //doi.org/10.1109/TITS.2020.3032227 · DOI
  79. Yuri Nakao, Simone Stumpf, Subeida Ahmed, and others. 2022. Toward Involving End-Users in Interactive Human- in-the-Loop AI Fairness. ACM Trans. Interact. Intell. Syst. 12, 3, Article 18 (jul 2022), 30 pages. https://doi.org/10. 1145/3514258 · DOI · Paper page
  80. Inês Neves, Duarte Folgado, Sara Santos, and others. 2021. Interpretable heartbeat classification using local model- agnostic explanations on ECGs. Computers in Biology and Medicine 133 (2021), 104393. https://doi.org/10.1016/j. compbiomed.2021.104393 · DOI
  81. Adam Noack, Isaac Ahern, Dejing Dou, and Boyang Li. 2021. An Empirical Study on the Relation Between Network Interpretability and Adversarial Robustness. SN Computer Science 2, 1 (2021), 32. https://doi.org/10.1007/s42979-020- 00390-x · DOI
  82. Natalia Norori, Qiyang Hu, Florence Marcelle Aellen, and others. 2021. Addressing bias in big data and AI for health care: A call for open science. Patterns 2, 10 (2021), 100347. https://doi.org/10.1016/j.patter.2021.100347 · DOI · Paper page
  83. Jihad S Obeid, Matthew Davis, Matthew Turner, and others. 2020. An artificial intelligence approach to COVID-19 infection risk assessment in virtual visits: A case report. Journal of the American Medical Informatics Association 27, 8 (aug 2020), 1321-1325. https://doi.org/10.1093/jamia/ocaa105 · DOI
  84. Darian M Onchis and Gilbert-Rainer Gillich. 2021. Stable and explainable deep learning damage prediction for prismatic cantilever steel beam. Computers in Industry 125 (2021), 103359. https://doi.org/10.1016/j.compind.2020. 103359 · DOI
  85. M Onishi and T Ise. 2021. Explainable identification and mapping of trees using UAV RGB image and deep learning. Scientific Reports 11, 1 (2021), 903. https://doi.org/10.1038/s41598-020-79653-9 · DOI
  86. N Pachauri and C W Ahn. 2022. Electrical Energy Prediction of Combined Cycle Power Plant Using Gradient Boosted Generalized Additive Model. IEEE Access 10 (2022), 24566-24577. https://doi.org/10.1109/ACCESS.2022.3153720 · DOI
  87. Paulo Henrique Padovan, Clarice Marinho Martins, and Chris Reed. 2023. Black is the new orange: how to determine AI liability. Artificial Intelligence and Law 31, 1 (2023), 133-167. https://doi.org/10.1007/s10506-022-09308-9 · DOI
  88. Cecilia Panigutti, Alan Perotti, André Panisson, and others. 2021. FairLens: Auditing black-box clinical decision support systems. Information Processing & Management 58, 5 (2021), 102657. https://doi.org/10.1016/j.ipm.2021.102657 · DOI · Paper page
  89. M S Park, H Son, C Hyun, and H J Hwang. 2021. Explainability of Machine Learning Models for Bankruptcy Prediction. IEEE Access 9 (2021), 124887-124899. https://doi.org/10.1109/ACCESS.2021.3110270 · DOI · Paper page
  90. J Peng, K Zou, M Zhou, and others. 2021. An Explainable Artificial Intelligence Framework for the Deterioration Risk Prediction of Hepatitis Patients. Journal of Medical Systems 45, 5 (2021), 61. https://doi.org/10.1007/s10916-021-01736-5 · DOI
  91. Nathan Phelps and Douglas G Woolford. 2021. Comparing calibrated statistical and machine learning methods for wildland fire occurrence prediction: a case study of human-caused fires in Lac La Biche, Alberta, Canada. International Journal of Wildland Fire 30, 11 (2021), 850-870. https://doi.org/10.1071/WF20139 · DOI
  92. Francesco Piccialli, Vittorio Di Somma, Fabio Giampaolo, and others. 2021. A survey on deep learning in medicine: Why, how and when? Information Fusion 66 (2021), 111-137. https://doi.org/10.1016/j.inffus.2020.09.006 · DOI
  93. Romila Pradhan, Jiongli Zhu, Boris Glavic, and Babak Salimi. 2022. Interpretable Data-Based Explanations for Fairness Debugging. In Proceedings of the 2022 International Conference on Management of Data (Philadelphia, PA, USA) (SIGMOD '22). ACM, New York, NY, USA, 247-261. https://doi.org/10.1145/3514221.3517886 · DOI
  94. Y Qiu, J Wang, Z Jin, and others. 2022. Pose-guided matching based on deep learning for assessing quality of action on rehabilitation training. Biomedical Signal Processing and Control 72 (2022), 103323. https://doi.org/10.1016/j.bspc. 2021.103323 · DOI
  95. V Quan Tran, V Quoc Dang, and L Si Ho. 2022. Evaluating compressive strength of concrete made with recycled concrete aggregates using machine learning approach. Construction and Building Materials 323 (2022), 126578. https://doi.org/10.1016/j.conbuildmat.2022.126578 · DOI
  96. Inioluwa Deborah Raji and Joy Buolamwini. 2022. Actionable Auditing Revisited: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. Commun. ACM 66, 1 (dec 2022), 101-108. https://doi.org/10.1145/3571151 · DOI · Paper page
  97. Ali Raza, Kim Phuc Tran, Ludovic Koehl, and Shujun Li. 2022. Designing ECG monitoring healthcare system with federated transfer learning and explainable AI. Knowledge-Based Systems 236 (2022), 107763. https://doi.org/10.1016/ j.knosys.2021.107763 · DOI
  98. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. "Why Should I Trust You?": Explaining the Predictions of Any Classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 13-17, 2016. ACM, San Francisco, CA, USA, 1135-1144.
  99. Tapani Rinta-Kahila, Ida Someh, Nicole Gillespie, and others. 2022. Algorithmic decision-making and system destructiveness: A case of automatic debt recovery. European Journal of Information Systems 31, 3 (may 2022), 313-338. https://doi.org/10.1080/0960085X.2021.1960905 · DOI
  100. Lionel P Robert, Casey Pierce, Liz Marquis, and others. 2020. Designing fair AI for managing employees in or- ganizations: a review, critique, and design agenda. Human-Computer Interaction 35, 5-6 (nov 2020), 545-575. https://doi.org/10.1080/07370024.2020.1735391 · DOI · Paper page
  101. Waddah Saeed and Christian Omlin. 2023. Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities. Knowledge-Based Systems 263 (2023), 110273. https://doi.org/10.1016/j.knosys.2023.110273 · DOI · Paper page
  102. N Safaei, B Safaei, S Seyedekrami, and others. 2022. E-CatBoost: An efficient machine learning framework for predicting ICU mortality using the eICU Collaborative Research Database. PLoS ONE 17, 5 May (2022), 0262895. https://doi.org/10.1371/journal.pone.0262895 · DOI
  103. V Saiz-Rubio and F Rovira-Más. 2020. From smart farming towards agriculture 5.0: A review on crop data management. Agronomy 10, 2 (2020). https://doi.org/10.3390/agronomy10020207 · DOI
  104. Oliver Lester Saldanha, Philip Quirke, Nicholas P West, and others. 2022. Swarm learning for decentralized artificial intelligence in cancer histopathology. Nature Medicine 28, 6 (2022), 1232-1239. https://doi.org/10.1038/s41591-022- 01768-5 · DOI · Paper page
  105. Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, and others. 2017. Grad-CAM: Visual Explanations From Deep Networks via Gradient-Based Localization. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).
  106. Shubham Sharma, Jette Henderson, and Joydeep Ghosh. 2020. CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-Box Models. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (New York, NY, USA) (AIES '20). ACM, New York, NY, USA, 166-172. https: //doi.org/10.1145/3375627.3375812 · DOI · Paper page
  107. Donghee Shin. 2021. The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI. International Journal of Human-Computer Studies 146 (2021), 102551. https://doi.org/10.1016/j. ijhcs.2020.102551 · DOI · Paper page
  108. Sumedha Singla, Motahhare Eslami, Brian Pollack, and others. 2023. Explaining the black-box smoothly-A counter- factual approach. Medical Image Analysis 84 (2023), 102721. https://doi.org/10.1016/j.media.2022.102721 · DOI
  109. X.-F. Song, Y Zhang, D.-W. Gong, and X.-Y. Sun. 2021. Feature selection using bare-bones particle swarm optimization with mutual information. Pattern Recognition 112 (2021), 107804. https://doi.org/10.1016/j.patcog.2020.107804 · DOI
  110. Isabel Straw. 2020. The automation of bias in medical Artificial Intelligence (AI): Decoding the past to create a better future. Artificial Intelligence in Medicine 110 (2020), 101965. https://doi.org/10.1016/j.artmed.2020.101965 · DOI · Paper page
  111. R Taghizadeh-Mehrjardi, N Hamzehpour, M Hassanzadeh, and others. 2021. Enhancing the accuracy of machine learning models using the super learner technique in digital soil mapping. Geoderma 399 (2021), 115108. https: //doi.org/10.1016/j.geoderma.2021.115108 · DOI
  112. Lianping Ti, Anita Ho, and Rod Knight. 2021. Towards Equitable AI Interventions for People Who Use Drugs: Key Areas That Require Ethical Investment. Journal of Addiction Medicine 15, 2 (2021). https://journals.lww.com/ journaladdictionmedicine/Fulltext/2021/04000/Towards_Equitable_AI_Interventions_for_People_Who.3.aspx
  113. Nicholas Tilmes. 2022. Disability, fairness, and algorithmic bias in AI recruitment. Ethics and Information Technology 24, 2 (2022), 21. https://doi.org/10.1007/s10676-022-09633-2 · DOI
  114. Matus Tomlein, Branislav Pecher, Jakub Simko, and others. 2021. An Audit of Misinformation Filter Bubbles on YouTube: Bubble Bursting and Recent Behavior Changes. In Proceedings of the 15th ACM Conference on Recommender Systems (Amsterdam, Netherlands) (RecSys '21). ACM, New York, NY, USA, 1-11. https://doi.org/10.1145/3460231. 3474241 · DOI · Paper page
  115. Cristina Trocin, Patrick Mikalef, Zacharoula Papamitsiou, and Kieran Conboy. 2021. Responsible AI for Digital Health: a Synthesis and a Research Agenda. Information Systems Frontiers 23 (2021), 1-19. Issue 3. https://doi.org/10. 1007/s10796-021-10146-4 · DOI · Paper page
  116. M Tubishat, S Ja'afar, M Alswaitti, and others. 2021. Dynamic Salp swarm algorithm for feature selection. Expert Systems with Applications 164 (2021), 113873. https://doi.org/10.1016/j.eswa.2020.113873 · DOI
  117. Md Zia Uddin, Kim Kristoffer Dysthe, Asbjørn Følstad, and Petter Bae Brandtzaeg. 2022. Deep learning for prediction of depressive symptoms in a large textual dataset. Neural Computing and Applications 34, 1 (2022), 721-744. https: //doi.org/10.1007/s00521-021-06426-4 · DOI
  118. Md Zia Uddin and Ahmet Soylu. 2021. Human activity recognition using wearable sensors, discriminant analysis, and long short-term memory-based neural structured learning. Scientific Reports 11, 1 (2021), 16455. https://doi.org/ 10.1038/s41598-021-95947-y · DOI
  119. Shahadat Uddin, Ibtisham Haque, Haohui Lu, and others. 2022. Comparative performance analysis of K-nearest neighbour (KNN) algorithm and its different variants for disease prediction. Scientific Reports 12, 1 (2022), 1-11.
  120. I Ullah, K Liu, T Yamamoto, and others. 2022. Prediction of electric vehicle charging duration time using ensemble machine learning algorithm and Shapley additive explanations. International Journal of Energy Research 46, 11 (2022), 15211-15230. https://doi.org/10.1002/er.8219 · DOI
  121. Jasper van der Waa, Tjeerd Schoonderwoerd, Jurriaan van Diggelen, and Mark Neerincx. 2020. Interpretable confidence measures for decision support systems. International Journal of Human-Computer Studies 144 (2020), 102493. https://doi.org/10.1016/j.ijhcs.2020.102493 · DOI
  122. Eva A M van Dis, Johan Bollen, Willem Zuidema, and others. 2023. ChatGPT: five priorities for research. Nature 614, 7947 (2023), 224-226.
  123. D Wang, S Thunéll, U Lindberg, and others. 2022. Towards better process management in wastewater treatment plants: Process analytics based on SHAP values for tree-based machine learning methods. Journal of Environmental Management 301 (2022), 113941. https://doi.org/10.1016/j.jenvman.2021.113941 · DOI
  124. Haofan Wang, Zifan Wang, Mengnan Du, and others. 2020. Score-CAM: Score-weighted visual explanations for convolutional neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops. Curran Associates, Nashville, USA, 24-25.
  125. R Wang, J.-H. Kim, and M.-H. Li. 2021. Predicting stream water quality under different urban development pattern scenarios with an interpretable machine learning approach. Science of the Total Environment 761 (2021), 144057. https://doi.org/10.1016/j.scitotenv.2020.144057 · DOI
  126. Dingming Wu, Xiaolong Wang, and Shaocong Wu. 2022. Jointly modeling transfer learning of industrial chain information and deep learning for stock prediction. Expert Systems with Applications 191 (2022), 116257. https: //doi.org/10.1016/j.eswa.2021.116257 · DOI
  127. Josephine Yam and Joshua August Skorburg. 2021. From human resources to human rights: Impact assessments for hiring algorithms. Ethics and Information Technology 23, 4 (2021), 611-623. https://doi.org/10.1007/s10676-021- 09599-7 · DOI
  128. Anli Yan, Teng Huang, Lishan Ke, and others. 2023. Explanation leaks: Explanation-guided model extraction attacks. Information Sciences 632 (2023), 269-284. https://doi.org/10.1016/j.ins.2023.03.020 · DOI
  129. Yee Hui Yeo, Jamil S Samaan, Wee Han Ng, and others. 2023. Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma. medRxiv (2023), 2002-2023.
  130. Muhsin Yesilada and Stephan Lewandowsky. 2022. Systematic review: YouTube recommendations and problematic content. Internet Policy Review 11, 1 (2022), 1-22. https://doi.org/10.14763/2022.1.1652 · DOI
  131. Vithya Yogarajan, Gillian Dobbie, Sharon Leitch, and others. 2022. Data and model bias in artificial intelligence for healthcare applications in New Zealand . https://www.frontiersin.org/articles/10.3389/fcomp.2022.1070493 · DOI
  132. S Yoo and N Kang. 2021. Explainable artificial intelligence for manufacturing cost estimation and machining feature visualization. Expert Systems with Applications 183 (2021), 115430. https://doi.org/10.1016/j.eswa.2021.115430 · DOI
  133. Rich Zemel, Yu Wu, Kevin Swersky, and others. 2013. Learning Fair Representations. , 325-333 pages. http: //proceedings.mlr.press/v28/zemel13.pdfhttps://proceedings.mlr.press/v28/zemel13.html
  134. Chen Zhan, Elizabeth Roughead, Lin Liu, and others. 2020. Detecting potential signals of adverse drug events from prescription data. Artificial Intelligence in Medicine 104 (2020), 101839. https://doi.org/10.1016/j.artmed.2020.101839 · DOI
  135. G Zhang, M Wang, and K Liu. 2021. Deep neural networks for global wildfire susceptibility modelling. Ecological Indicators 127 (2021), 107735. https://doi.org/10.1016/j.ecolind.2021.107735 · DOI
  136. X Zhang, L Han, W Zhu, and others. 2022. An Explainable 3D Residual Self-Attention Deep Neural Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI. IEEE Journal of Biomedical and Health Informatics 26, 11 (2022), 5289-5297. https://doi.org/10.1109/JBHI.2021.3066832 · DOI
  137. Y Zhang, T Zhou, W Wu, and others. 2022. Improving EEG Decoding via Clustering-Based Multitask Feature Learning. IEEE Transactions on Neural Networks and Learning Systems 33, 8 (2022), 3587-3597. https://doi.org/10.1109/TNNLS. 2021.3053576 · DOI
  138. Z Zhang, E Damiani, H A Hamadi, and others. 2022. Explainable Artificial Intelligence to Detect Image Spam Using Convolutional Neural Network. In 2022 International Conference on Cyber Resilience (ICCR). Curran Associates, Dubai, UAE, 1-5. https://doi.org/10.1109/ICCR56254.2022.9995839 · DOI
  139. Huan Zhao, Ruixue Wang, Yaguo Lei, and others. 2022. Severity level diagnosis of Parkinson's disease by ensemble K-nearest neighbor under imbalanced data. Expert Systems with Applications 189 (2022), 116113. https://doi.org/10. 1016/j.eswa.2021.116113 · DOI
  140. X. Zhao, W. Zhang, X. Xiao, and B. Lim. 2021. Exploiting Explanations for Model Inversion Attacks. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE Computer Society, Los Alamitos, CA, USA, 662-672. https://doi.org/10.1109/ICCV48922.2021.00072 · DOI
  141. Quan Zheng, Ziwei Wang, Jie Zhou, and Jiwen Lu. 2022. Shap-CAM: Visual Explanations for Convolutional Neural Networks Based on Shapley Value. In Computer Vision-ECCV 2022: 17th European Conference. Springer, Tel Aviv, Israel, 459-474.
  142. J Zhi, X Cao, Z Zhang, and others. 2022. Identifying the determinants of crop yields in China since 1952 and its policy implications. Agricultural and Forest Meteorology 327 (2022), 109216. https://doi.org/10.1016/j.agrformet.2022.109216 · DOI
  143. J Y. Zhu, T Park, P Isola, and A A Efros. 2017. Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. In 2017 IEEE International Conference on Computer Vision (ICCV). 2242-2251. https://doi.org/ 10.1109/ICCV.2017.244 · DOI · Paper page
  144. M Zhu, B Zang, L Ding, and others. 2022. LIME-Based Data Selection Method for SAR Images Generation Using GAN. Remote Sensing 14, 1 (2022), 204. https://doi.org/10.3390/rs14010204 · DOI
  145. Leying Zou and Warut Khern-am nuai. 2022. AI and housing discrimination: the case of mortgage applications. AI and Ethics (2022). https://doi.org/10.1007/s43681-022-00234-9 Received dd Month 2023; revised dd Month 2023; accepted dd Month 2023 · DOI

Cited by

Sorted by citations

Authors
Baker, S., & Xiang, W.
Affiliations
La Trobe University (AU)
ORCID
Baker, Stephanie
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2312.01555
arXiv
2312.01555
OpenAlex
W4389363870
Cited by
12
References
2
Citations by year
2026: 2 · 2025: 6 · 2024: 4
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
explainable AI, responsible AI, trustworthy AI, algorithmic fairness, robustness, privacy, security (computing), transparency, accountability, social responsibility

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review