Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems
The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Abstract
This article attempts to bridge the gap between widely discussed ethical principles of Human-centered AI (HCAI) and practical steps for effective governance. Since HCAI systems are developed and implemented in multiple organizational structures, I propose 15 recommendations at three levels of governance: team, organization, and industry. The recommendations are intended to increase the reliability, safety, and trustworthiness of HCAI systems: (1) reliable systems based on sound software engineering practices, (2) safety culture through business management strategies, and (3) trustworthy certification by independent oversight. Software engineering practices within teams include audit trails to enable analysis of failures, software engineering workflows, verification and validation testing, bias testing to enhance fairness, and explainable user interfaces. The safety culture within organizations comes from management strategies that include leadership commitment to safety, hiring and training oriented to safety, extensive reporting of failures and near misses, internal review boards for problems and future plans, and alignment with industry standard practices. The trustworthiness certification comes from industry-wide efforts that include government interventions and regulation, accounting firms conducting external audits, insurance companies compensating for failures, non-governmental and civil society organizations advancing design principles, and professional organizations and research institutes developing standards, policies, and novel ideas. The larger goal of effective governance is to limit the dangers and increase the benefits of HCAI to individuals, organizations, and society.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These challenges raise ethical questions around accountability-who is responsible when AI-generated code causes harm?-and the need for governance mechanisms that ensure human oversight and traceability [34].”
From Redefining the Programmer: Human-AI Collaboration, LLMs, and Security in Modern Software Engineering (2025) · cites this paper as [34]
In the citing paper
“In short, currently available knowledge related to responsible and ethical AI is often of a high level of abstraction.”
From Contestable AI by Design: Towards a Framework (2022) · cites this paper as Shneiderman, 2020
In the citing paper
“while AI tools are essential in detecting harmful content, their effectiveness remains highly variable, requiring structured evaluation frameworks to assess their reliability and ethical implications (Shneiderman, 2020).”
From Virtual Reality Risks for Children in the Metaverse: An Examination through Criminological Perspectives (2026) · cites this paper as Shneiderman, 2020
In the citing paper
“When these mechanisms are aligned with efforts needed to establish social, organizational, and regulatory ecosystems for the assurance of trustworthy AI [9, 30, 54], they are likely to satisfy the calibration condition.”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [54]
In the citing paper
“Finally, as monitoring and auditing of AIPMs in practice are widely recommended (covered in more detail in phase 6), the developed software should facilitate this10,22,26,32,58,62,104.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [58]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Research in Organizational Behavior.
Grimes, A. J., Cummings, L. L., & Staw, B. M. (1986) · Administrative Science Quarterly · doi:10.2307/2392975 · Cited by 10,899
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“Du et al. [28] make useful distinctions between intrinsically understandable machine learning models, such as decision trees or rule-based models [67, 26, 97], and the more common approach of post hoc explanations.”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 1×
“Du et al. [28] make useful distinctions between intrinsically understandable machine learning models, such as decision trees or rule-based models [67, 26, 97], and the more common approach of post hoc explanations.”
BackgroundResilience Engineering: Concepts and Precepts
Wears, R. L. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2006.018390 · Cited by 2,900
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 2×
“However, they can produce important internal efforts such as Google’s internal review and algorithmic auditing framework [92] (see Section 3.”
BackgroundEuropean Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“Furthermore, explanations have become a legal requirement in many countries based on the European Union’s General Data Protection Regulation (GDPR) requirement of a “right to explanation” [41, 115].”
BackgroundThe nature of safety culture: a review of theory and research
Guldenmund, F. W. (2000) · Safety Science · doi:10.1016/s0925-7535(00)00014-x · Cited by 1,831 · cited 1×
“A fourth theme described how organizations cultivate safety cultures [43, 8], especially in healthcare [32] by open management strategies.”
BackgroundHuman-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · cited 2×
“In contrast, HCAI focuses on amplifying, augmenting, and enhancing human performance [103] in ways that make systems reliable, safe, and trustworthy [102].”
BackgroundSelf-citationRule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project
(1986) · Telematics and Informatics · doi:10.1016/s0736-5853(86)80073-9 · Cited by 1,701
Research works printed but not linked: 30
- S. Alsheibani , C. Messom , and Y. Cheung . 2019. Towards an artificial intelligence maturity model: From science fiction to business facts . Proceedings of the 23rd Pacific Asia Conference on Information Systems. Association for Information Systems. Retrieved from http://www.pacis2019.org/wd/Submissions/PACIS 2019 _paper_146.pdf. S. Alsheibani, C. Messom, and Y. Cheung. 2019. Towards an artificial intelligence maturity model: From science fiction to business facts. Proceedings of the 23rd Pacific Asia Conference on Information Systems. Association for Information Systems. Retrieved from http://www.pacis2019.org/wd/Submissions/PACIS2019_paper_146.pdf.
- S. Amershi , A. Begel , C. Bird , R. DeLine , H. Gall , E. Kamar , N. Nagappan , B. Nushi , and T. Zimmermann . 2019a. Software engineering for machine learning: A case study . In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19) . IEEE, 291--300. S. Amershi, A. Begel, C. Bird, R. DeLine, H. Gall, E. Kamar, N. Nagappan, B. Nushi, and T. Zimmermann. 2019a. Software engineering for machine learning: A case study. In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19). IEEE, 291--300.
- S. Amershi , D. Weld , M. Vorvoreanu , A. Fourney , B. Nushi , P. Collisson , and E. Horvitz . 2019b. Guidelines for human-AI interaction . In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 1--13 . S. Amershi, D. Weld, M. Vorvoreanu, A. Fourney, B. Nushi, P. Collisson, and E. Horvitz. 2019b. Guidelines for human-AI interaction. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 1--13.
- O. Biran and C. Cotton . 2017. Explanation and justification in machine learning: A survey . In Proceedings of the International Joint Conference on Artificial Inteeligence Workshop on Explainable AI (XAI’17) . O. Biran and C. Cotton. 2017. Explanation and justification in machine learning: A survey. In Proceedings of the International Joint Conference on Artificial Inteeligence Workshop on Explainable AI (XAI’17).
- E. Breck , N. Polyzotis , S. Roy , S. E. Whang , and M. Zinkevich . 2019. Data validation for machine learning . In Proceedings of the Conference on Systems and Machine Learning (SysML’19) . Retrieved from https://www.sysml.cc/doc/ 2019 /167.pdf. E. Breck, N. Polyzotis, S. Roy, S. E. Whang, and M. Zinkevich. 2019. Data validation for machine learning. In Proceedings of the Conference on Systems and Machine Learning (SysML’19). Retrieved from https://www.sysml.cc/doc/2019/167.pdf.
- J. Buolamwini and T. Gebru . 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification . Proc. Mach. Learn. Res. 81 , ( 2018 ), 77--91. J. Buolamwini and T. Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. Proc. Mach. Learn. Res. 81, (2018), 77--91.
- Calo Ryan . 2016. Robots in American law . University of Washington School of Law Research Paper. Retrieved from https ://papers.ssrn.com/sol3/papers.cfm?abstract_id=2737598. Calo Ryan. 2016. Robots in American law. University of Washington School of Law Research Paper. Retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2737598.
- N. Campbell . 2007 . The evolution of flight data analysis . Proceedings of Australian Society of Air Safety Investigators. Retrieved from https://asasi.org/papers/2007/The_Evolution_of_Flight_Data_Analysis_Neil_Campbell.pdf. N. Campbell. 2007. The evolution of flight data analysis. Proceedings of Australian Society of Air Safety Investigators. Retrieved from https://asasi.org/papers/2007/The_Evolution_of_Flight_Data_Analysis_Neil_Campbell.pdf.
- H. F. Cheng , R. Wang , Z. Zhang , F. O'Connell , T. Gray , F. M. Harper , and H. Zhu . 2019. Explaining decision-making algorithms through UI: Strategies to help non-expert stakeholders . In Proceedings of the CHI Conference on Human Factors in Computing Systems ACM, 1--12 . H. F. Cheng, R. Wang, Z. Zhang, F. O'Connell, T. Gray, F. M. Harper, and H. Zhu. 2019. Explaining decision-making algorithms through UI: Strategies to help non-expert stakeholders. In Proceedings of the CHI Conference on Human Factors in Computing Systems ACM, 1--12.
- 10.5555/16244.16245 · doi:10.5555/16244.16245
- J. Couzin-Frankel . 2019. Medicine contends with how to use artificial intelligence. Science 354, 6446 ( 2019 ), 1119--1120. J. Couzin-Frankel. 2019. Medicine contends with how to use artificial intelligence. Science 354, 6446 (2019), 1119--1120.
- P. R. Daugherty and H. J. Wilson . 2018 . Human + Machine: Reimagining Work in the Age of AI . Harvard Business Press . P. R. Daugherty and H. J. Wilson. 2018. Human+ Machine: Reimagining Work in the Age of AI. Harvard Business Press.
- S. M. Erickson , J. Wolcott , J. M. Corrigan , and P. Aspden (Eds.). 2004 . Patient Safety: Achieving a New Standard for Care . National Academies Press , Washington, DC . S. M. Erickson, J. Wolcott, J. M. Corrigan, and P. Aspden (Eds.). 2004. Patient Safety: Achieving a New Standard for Care. National Academies Press, Washington, DC.
- P. Fraser , J. Moultrie , and M. Gregory . 2002. The use of maturity models/grids as a tool in assessing product development capability . In Proceedings of the IEEE International Engineering Management Conference. IEEE, 244--249 . P. Fraser, J. Moultrie, and M. Gregory. 2002. The use of maturity models/grids as a tool in assessing product development capability. In Proceedings of the IEEE International Engineering Management Conference. IEEE, 244--249.
- D. R. Grossi . 1999 . Aviation Recorder Overview . In Proceedings of the International Symposium on Transportation Recorders. 153--164 . D. R. Grossi. 1999. Aviation Recorder Overview. In Proceedings of the International Symposium on Transportation Recorders. 153--164.
- F. Hohman , A. Head , R. Caruana , R. DeLine , and S. M. Drucker . 2019. Gamut: A design probe to understand how data scientists understand machine learning models . In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 1--13 . F. Hohman, A. Head, R. Caruana, R. DeLine, and S. M. Drucker. 2019. Gamut: A design probe to understand how data scientists understand machine learning models. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 1--13.
- A. Hopkins . 1999 . The limits of normal accident theory . Safety Sci. 32 , 2 (1999), 93 -- 102 . A. Hopkins. 1999. The limits of normal accident theory. Safety Sci. 32, 2 (1999), 93--102.
- R. Hull , B. Kumar , D. Lieuwen , P. F. Patel-Schneider , A. Sahuguet , S. Varadarajan , and A. Vyas . 2003. Everything personal, not just business: Improving user experience through rule-based service customization . In Proceedings of the International Conference on Service-Oriented Computing. Springer , Berlin, 149--164. R. Hull, B. Kumar, D. Lieuwen, P. F. Patel-Schneider, A. Sahuguet, S. Varadarajan, and A. Vyas. 2003. Everything personal, not just business: Improving user experience through rule-based service customization. In Proceedings of the International Conference on Service-Oriented Computing. Springer, Berlin, 149--164.
- IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems ( 2019 ). Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems , 1 st ed. IEEE. Retrieved from https://standards.ieee.org/content/ieee-standards/en/industry-connections/ec/autonomous-systems.html https://ethicsinaction.ieee.org/. IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems (2019). Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems, 1st ed. IEEE. Retrieved from https://standards.ieee.org/content/ieee-standards/en/industry-connections/ec/autonomous-systems.html https://ethicsinaction.ieee.org/.
- X. Liang , S. Shetty , D. Tosh , C. Kamhoua , K. Kwiat , and L. Njilla . 2017. Provchain: A blockchain-based data provenance architecture in cloud environment with enhanced privacy and availability . In Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID’17) , 468--477. X. Liang, S. Shetty, D. Tosh, C. Kamhoua, K. Kwiat, and L. Njilla. 2017. Provchain: A blockchain-based data provenance architecture in cloud environment with enhanced privacy and availability. In Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID’17), 468--477.
- T. Mai , R. Khanna , J. Dodge , J. Irvine , K. H. Lam , Z. Lin , N. Kiddle , E. Newman , S. Raja , C. Matthews , C. Perdriau , M. Burnett , and A. Fern . 2020. Keeping it “organized and logical”: After-action review for AI (AAR/AI) . In Proceedings of the 25th International Conference on Intelligent User Interfaces. ACM, 465--476 . T. Mai, R. Khanna, J. Dodge, J. Irvine, K. H. Lam, Z. Lin, N. Kiddle, E. Newman, S. Raja, C. Matthews, C. Perdriau, M. Burnett, and A. Fern. 2020. Keeping it “organized and logical”: After-action review for AI (AAR/AI). In Proceedings of the 25th International Conference on Intelligent User Interfaces. ACM, 465--476.
- A. Mitrevski , S. Thoduka , A. O. Sáinz , M. Schöbel , P. Nagel , P. G. Plöger , and E. Prassler . 2018. Deploying robots in everyday environments: Toward dependable and practical robotic systems . In Proceedings of the 29th International Workshop Principles of Diagnosis (DX’18) . Retrieved from http://www.ropod.org/downloads/dx18.pdf. A. Mitrevski, S. Thoduka, A. O. Sáinz, M. Schöbel, P. Nagel, P. G. Plöger, and E. Prassler. 2018. Deploying robots in everyday environments: Toward dependable and practical robotic systems. In Proceedings of the 29th International Workshop Principles of Diagnosis (DX’18). Retrieved from http://www.ropod.org/downloads/dx18.pdf.
- M. R. Morris . 2020. AI and accessibility: A discussion of ethical considerations. Commun. ACM 63, 6 ( 2016 ), ACM 35--37. 10.1145/3356727 M. R. Morris. 2020. AI and accessibility: A discussion of ethical considerations. Commun. ACM 63, 6 (2016), ACM 35--37. 10.1145/3356727 · DOI · Paper page
- Nadella Satya ( 2016 ). The partnership of the future , Slate. Retrieved from https://slate.com/technology/2016/06/microsoft-ceo-satya-nadella-humans-and-a-i-can-work-together-to-solve-societys-challenges.html. Nadella Satya (2016). The partnership of the future, Slate. Retrieved from https://slate.com/technology/2016/06/microsoft-ceo-satya-nadella-humans-and-a-i-can-work-together-to-solve-societys-challenges.html.
- F. Rosenberg and S. Dustdar . 2005. Design and implementation of a service-oriented business rules broker . In Proceedings of the 7th IEEE International Conference on E-Commerce Technology Workshops. IEEE, 55--63 . F. Rosenberg and S. Dustdar. 2005. Design and implementation of a service-oriented business rules broker. In Proceedings of the 7th IEEE International Conference on E-Commerce Technology Workshops. IEEE, 55--63.
- M. Rotenberg . 2020. The AI Policy Sourcebook 2020 . Electronic Privacy Information Center, Washington , DC. M. Rotenberg. 2020. The AI Policy Sourcebook 2020. Electronic Privacy Information Center, Washington, DC.
- H. Sharp , J. Preece , and Y. Rogers . 2019 . Interaction Design: Beyond Human-Computer Interaction , 5 th ed. Wiley Publishers . H. Sharp, J. Preece, and Y. Rogers. 2019. Interaction Design: Beyond Human-Computer Interaction, 5th ed. Wiley Publishers.
- B. Shneiderman , C. Plaisant , M. Cohen , S. Jacobs , and N. Elmqvist . 2016 . Designing the User Interface: Strategies for Effective Human-Computer Interaction , 6 th ed. Pearson . B. Shneiderman, C. Plaisant, M. Cohen, S. Jacobs, and N. Elmqvist. 2016. Designing the User Interface: Strategies for Effective Human-Computer Interaction, 6th ed. Pearson.
- 10.1109/MS.2010.96 · doi:10.1109/ms.2010.96
- A. F. Winfield and M. Jirotka . 2017. The case for an ethical black box . In Proceedings of the Annual Conference Towards Autonomous Robotic Systems, Springer 262--273 . Retrieved from https://link.springer.com/chapter/10.1007/978-3-319-64107-2_21. A. F. Winfield and M. Jirotka. 2017. The case for an ethical black box. In Proceedings of the Annual Conference Towards Autonomous Robotic Systems, Springer 262--273. Retrieved from https://link.springer.com/chapter/10.1007/978-3-319-64107-2_21. · DOI · Paper page
Cited by
Items 101–200 of 772
AI and Ethics—Operationalizing Responsible AI
Zhu, L., Xu, X., Lu, Q., Governatori, G., & Whittle, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-72188-6_2 · Cited by 86
Nagitta, O. P., Mugurusi, G., Obicci, P. A., & Awuor, E. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.01.308 · Cited by 73
Human-Centered Responsible Artificial Intelligence: Current & Future Trends
Tahaei, M., Constantinides, M., Quercia, D., Kennedy, S., Muller, M., Stumpf, S., Liao, Q. V., Baeza-Yates, R., Aroyo, L., Holbrook, J., et al. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3583178 · Cited by 46
The Foundation Model Transparency Index
Bommasani, R., Klyman, K., Longpre, S., Kapoor, S., Maslej, N., Xiong, B., Zhang, D., & Liang, P. (2023) · arXiv · doi:10.48550/arxiv.2310.12941 · Cited by 46
Hauptman, A. I., Schelble, B. G., Duan, W., Flathmann, C., & McNeese, N. J. (2024) · Cognition Technology & Work · doi:10.1007/s10111-024-00765-7 · Cited by 67
Fault prognosis of Li-ion batteries in electric vehicles: Recent progress, challenges and prospects
Li, H., Kaleem, M. B., Liu, K., Wu, Y., Liu, W., & Peng, Q. (2025) · Journal of Energy Storage · doi:10.1016/j.est.2025.116002 · Cited by 52
Comes, T. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09750-0 · Cited by 61
“Human control and oversight are at the heart of human-centred AI (Shneiderman, 2020) and instrumental to the discussions around AI, see e.g., the UNESCO guidelines (UNESCO, 2022) or the EU’s guidelines on trustworthy AI (EC, 2019).”
InfluentialTowards a multi-stakeholder value-based assessment framework for algorithmic systems
Yurrita, M., Murray-Rust, D., Balayn, A., & Bozzon, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533118 · Cited by 39
del Gobbo, E., Guarino, A., Cafarelli, B., & Grilli, L. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01892-9 · Cited by 70
David, A. J., Yiğitcanlar, T., Desouza, K. C., Li, R. Y. M., Cheong, P. H., Mehmood, R., & Corchado, J. M. (2024) · Cities · doi:10.1016/j.cities.2024.105502 · Cited by 68
Trakunphutthirak, R., & Lee, V. C. S. (2021) · Journal of Educational Computing Research · doi:10.1177/07356331211048777 · Cited by 62
“754 Education-oriented applications should be confidential (protecting Trakunphutthirak and Lee privacy), fair, reliable, safe, user-friendly, and explanatory (Polonetsky & Tene, 2014; Reidenberg & Schaub, 2018; Shneiderman, 2020; Xu et al., 2011).”
AI Regulation Is (not) All You Need
Lucaj, L., van der Smagt, P., & Benbouzid, D. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594079 · Cited by 40
From human-centered to symbiotic artificial intelligence: a focus on medical applications
Desolda, G., Esposito, A., Lanzilotti, R., Piccinno, A., & Costabile, M. F. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20414-5 · Cited by 69
Understanding human–technology interaction: evolving boundaries
Magliocca, P., Canestrino, R., Carayannis, E. G., & Gagliardi, A. R. (2024) · European Journal of Innovation Management · doi:10.1108/ejim-04-2024-0341 · Cited by 81
Software Engineering by and for Humans in an AI Era
Abrahão, S., Grundy, J., Pezzè, M., Storey, M.-A., & Tamburri, D. A. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715111 · Cited by 37
Ethics in AI through the practitioner’s view: a grounded theory literature review
Pant, A., Hoda, R., Tantithamthavorn, C. K., & Turhan, B. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10465-5 · Cited by 66
“Similarly, Shneiderman (2020) provided 15 recommendations to bridge the gap between ethical principles of AI and practical steps for ethical governance.”
How Do Employees Form Initial Trust in Artificial Intelligence: Hard to Explain But Leaders Help
Xu, Y., Huang, Y., Wang, J., & Zhou, D. (2022) · Asia Pacific Journal of Human Resources · doi:10.1111/1744-7941.12402 · Cited by 63
Perry, N., Sun, C., Munro, M., Boulton, K., & Guastella, A. J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01355-7 · Cited by 59
Petsolari, M., Ibrahim, S. B., & Slovak, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642619 · Cited by 35
“To this end, the transparency and trust of AI systems should also be viewed as a part of the design process [318].”
Cognitive architectures for artificial intelligence ethics
Bickley, S. J., & Torgler, B. (2022) · AI & Society · doi:10.1007/s00146-022-01452-9 · Cited by 55
“For a human-centred AI approach, Shneiderman (2020) provides a three-level governance structure incorporating team technical practices and software engineering, organisation management strategies and standards, and industry over-sight, regulation, and policymaking.”
MethodIntegrating a Blockchain-Based Governance Framework for Responsible AI
Asif, R., Hassan, S. R., & Parr, G. P. (2023) · Future Internet · doi:10.3390/fi15030097 · Cited by 54
Exploring citizens’ stances on AI in public services: A social contract perspective
Schmager, S., Grøder, C. H., Parmiggiani, E., Pappas, I., & Vassilakopoulou, P. (2024) · Data & Policy · doi:10.1017/dap.2024.13 · Cited by 35
“There have been various undertakings to formulate normative guidelines for the responsible design and development of AI with the goal of human benefit (Xu, 2019; Shneiderman, 2020).”
Background'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research Practices
Kapania, S., Wang, R., Li, T. J.-J., Li, T., & Shen, H. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711000 · Cited by 80
Blösser, M., & Weihrauch, A. (2023) · European Journal of Marketing · doi:10.1108/ejm-01-2023-0009 · Cited by 49
Laato, S., Birkstedt, T., Mäntymäki, M., Minkkinen, M., & Mikkonen, T. (2022) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3522664.3528598 · Cited by 76
An external stability audit framework to test the validity of personality prediction in AI hiring
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., Khan, F. A., & Stoyanovich, J. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00861-0 · Cited by 57
What Do Users Ask in Open-Source AI Repositories? An Empirical Study of GitHub Issues
Yang, Z., Wang, C., Shi, J., Hoang, T., Kochhar, P. S., Lu, Q., Xing, Z., & Lo, D. (2023) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr59073.2023.00024 · Cited by 63
Vivek, R. (2023) · Информатика Экономика Управление - Informatics Economics Management · doi:10.47813/2782-5280-2023-2-4-0101-0118 · Cited by 62
Plotkina, L., & Ramalu, S. S. (2024) · Journal of Management Development · doi:10.1108/jmd-06-2024-0182 · Cited by 44
Liu, B., Boysen, J. G., Unarta, I. C., Du, X., Li, Y., & Huang, X. (2025) · Nature Communications · doi:10.1038/s41467-024-55228-4 · Cited by 45
Zhang, R., Flathmann, C., Musick, G., Schelble, B. G., McNeese, N. J., Knijnenburg, B. P., & Duan, W. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3635474 · Cited by 44
Discerning Between the “Easy” and “Hard” Problems of AI Governance
Minkkinen, M., & Mäntymäki, M. (2023) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2023.3267382 · Cited by 43
Towards a Human-Centred Artificial Intelligence Maturity Model
Hartikainen, M., Väänänen, K., & Olsson, T. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585752 · Cited by 40
Nourani, M., Roy, C., Block, J. E., Honeycutt, D. R., Rahman, T., Ragan, E. D., & Gogate, V. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3531066 · Cited by 47
AI Guidelines and Ethical Readiness Inside SMEs: A Review and Recommendations
Soudi, M., & Bauters, M. (2024) · Digital Society · doi:10.1007/s44206-024-00087-1 · Cited by 51
“To achieve that level of institutional trust, one of the possible solutions could be establishing a responsible AI accreditation process and certification released by independent unbiased organisations (Roski et al., 2021; Shneiderman, 2020).”
InfluentialPanakkal, P., & Padgett, J. E. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110368 · Cited by 31
Competing narratives in AI ethics: a defense of sociotechnical pragmatism
Watson, D., Mökander, J., & Floridi, L. (2024) · AI & Society · doi:10.1007/s00146-024-02128-2 · Cited by 56
“Today, countless startups and consulting companies offer AI auditing services designed to help clients ensure that AI systems are “fair” or “ethical” (Shneiderman 2020; Mökander 2023).”
Framing the Human-Centered Artificial Intelligence Concepts and Methods: Scoping Review
Bevilacqua, R., Bailoni, T., Maranesi, E., Amabili, G., Barbarossa, F., Ponzano, M., Virgolesi, M., Rea, T., Illario, M., Piras, E. M., et al. (2025) · JMIR Human Factors · doi:10.2196/67350 · Cited by 37
Towards Ethical Data-Driven Software: Filling the Gaps in Ethics Research & Practice
Johnson, B., & Smith, J. (2021) · Workshop on Ethics in Software Engineering Research and Practice · doi:10.1109/sethics52569.2021.00011 · Cited by 46
Tech Giants’ Responsible Innovation and Technology Strategy: An International Policy Review
Li, W., Yiğitcanlar, T., Nili, A., & Browne, W. N. (2023) · Smart Cities · doi:10.3390/smartcities6060153 · Cited by 45
The Role of AI Ethics in Cost and Complexity Reduction
Tariq, M. U. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-2643-5.ch004 · Cited by 28
Safety and Reliability of Artificial Intelligence Systems
Nguyễn, T. H., Saghir, A., Tran, K. D., Nguyen, D. H., Luong, N. A., & Tran, K. P. (2024) · Springer series in reliability engineering · doi:10.1007/978-3-031-71495-5_9 · Cited by 37
Hussain, M. S., Ramalingam, P. S., Chellasamy, G., Yun, K., Bisht, A. S., & Gupta, G. (2025) · Clinical Breast Cancer · doi:10.1016/j.clbc.2025.03.006 · Cited by 35
Fischer, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-79840-6_1 · Cited by 40
The Ethics of Privacy in Research and Design: Principles, Practices, and Potential
Kisselburgh, L. G., & Beever, J. (2022) · Springer eBooks · doi:10.1007/978-3-030-82786-1_17 · Cited by 52
“Centering humans and their values in the loop is a key part of human-centric computing [49, 50], where technological devices, algorithms, and systems are designed with consideration of the human impact, and human values are centered in the design process (see also value-sensitive design [51] and…”
BackgroundArtificial Intelligence in Kidney Disease: A Comprehensive Study and Directions for Future Research
Wu, C.-C., Islam, M. M., Poly, T. N., & Weng, Y.-C. (2024) · Diagnostics · doi:10.3390/diagnostics14040397 · Cited by 34
“Health care providers should establish stringent regulatory frameworks and standards for AI in healthcare, ensuring strict adherence to ethical guidelines and legal requirements [65].”
BackgroundTrusting AI: does uncertainty visualization affect decision-making?
Reyes, J., Batmaz, A. U., & Kersten-Oertel, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1464348 · Cited by 27
Designing for Hybrid Intelligence: A Taxonomy and Survey of Crowd-Machine Interaction
Correia, A., Grover, A., Schneider, D., Pimentel, A. P., Chaves, R., de Almeida, M. A., & Fonseca, B. (2023) · Applied Sciences · doi:10.3390/app13042198 · Cited by 34
Haskard, A., & Herath, D. C. (2025) · ACM Computing Surveys · doi:10.1145/3723050 · Cited by 53
Explainable AI for Sensor Signal Interpretation to Revolutionize Human Health Monitoring: A Review
Alharthi, A. S., Alqurashi, A., Alharbi, T. E. A., Alammar, M. M., Aldosari, N., Bouchekara, H. R. E. H., Sha’aban, Y. A., Shahriar, M. S., & Ayidh, A. A. (2025) · IEEE Access · doi:10.1109/access.2025.3585764 · Cited by 44
Human-Centered AI: A New Synthesis
Shneiderman, B. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-85623-6_1 · Cited by 27
Self-citationTowards Implementing Responsible AI
Sanderson, C., Lu, Q., Douglas, D., Xu, X., Zhu, L., & Whittle, J. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10021121 · Cited by 28
Guesmi, M., Chatti, M. A., Joarder, S., Ain, Q. U., Alatrash, R., Siepmann, C., & Vahidi, T. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2262797 · Cited by 37
“…other application domains, including XAI (Cheng et al., 2019; Krause et al., 2016; Kulesza et al., 2015; Sokol & Flach, 2020), human-centered AI (Shneiderman, 2020), interactive machine learning (Amershi, Cakmak, Knox, & Kulesza, 2014), interactive recommendation (He et al., 2016; Jugovac &…”
Torkamaan, H., Tahaei, M., Buijsman, S., Xiao, Z., Wilkinson, D., & Knijnenburg, B. P. (2024) · Human-computer interaction series · doi:10.1007/978-3-031-55109-3_2 · Cited by 40
Ibrahim, S. T., Li, M., Patel, J., & Katapally, T. R. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109859 · Cited by 42
Chen, X., Hu, Z., Li, Y., & Wang, C. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2472288 · Cited by 39
“This form of AI serves primarily as an auxiliary tool for humans; it can be highly automated, but all critical decisions remain under human control (Shneiderman, 2020).”
InfluentialFMEA-AI: AI fairness impact assessment using failure mode and effects analysis
Li, J. J., & Chignell, M. (2022) · AI and Ethics · doi:10.1007/s43681-022-00145-9 · Cited by 55
‘It Is Not Always Discovery Time’: Four Pragmatic Approaches in Designing AI Systems
Windl, M., Feger, S. S., Zijlstra, L., Schmidt, A., & Woźniak, P. W. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501943 · Cited by 41
Duan, X., Pei, B., Ambrose, G. A., Hershkovitz, A., Cheng, Y., & Wang, C. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11954-8 · Cited by 35
“Trustworthy interactions can promote the incorporation of AI into society in a safer manner (Shneiderman, 2020 ).”
Torkamaan, H., Steinert, S., Pera, M. S., Kudina, O., Freire, S. K., Verma, H., Kelly, S., Sekwenz, M.-T., Yang, J., van Nunen, K., et al. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2431068 · Cited by 43
Ethics and AI Issues: Old Container with New Wine?
Niederman, F., & Baker, E. W. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10305-1 · Cited by 35
“Aligned loosely with Habermas’ notion of pragmatics, Shneiderman (2020) presents a set of 15 principles or guidelines (see Appendix 3 for a complete list) that embed some prescription for preempting AI ethical difficulties.”
Gunser, V. E., Gottschling, S., Brucker, B., Richter, S., & Gerjets, P. (2021) · Communications in Computer and Information Science · doi:10.1007/978-3-030-78635-9_67 · Cited by 25
Monitoring oral health remotely: ethical considerations when using AI among vulnerable populations
McGrath, C. P. J., Chau, R. C. W., & Molina, G. F. (2025) · Frontiers in Oral Health · doi:10.3389/froh.2025.1587630 · Cited by 33
Artificial Intelligence Project Success Factors—Beyond the Ethical Principles
Miller, G. J. (2022) · Lecture notes in business information processing · doi:10.1007/978-3-030-98997-2_4 · Cited by 39
Research Challenges for the Design of Human-Artificial Intelligence Systems (HAIS)
Hevner, A. R., & Storey, V. C. (2022) · ACM Transactions on Management Information Systems · doi:10.1145/3549547 · Cited by 35
Wang, S., Cooper, N., & Eby, M. R. (2024) · Big Data & Society · doi:10.1177/20539517241290220 · Cited by 43
“Human-centered AI is an umbrella term for a wide research agenda (Shneiderman, 2020).”
BackgroundArtificial Intelligence-driven regional energy transition:Evidence from China
Zhao, Z., Zhao, Q., Li, S., & Yan, J. (2024) · Economic Analysis and Policy · doi:10.1016/j.eap.2024.10.004 · Cited by 29
David, A. J., Yiğitcanlar, T., Desouza, K. C., Mossberger, K., Cheong, P. H., Corchado, J. M., Beeramoole, P. B., & Paz, A. (2025) · Government Information Quarterly · doi:10.1016/j.giq.2025.102054 · Cited by 38
Projections and the Potential Societal Impact of the Future of Neurotechnologies
Gaudry, K. S., Ayaz, H., Bedows, A., Celnik, P. A., Eagleman, D. M., Grover, P., Illes, J., Rao, R. P. N., Robinson, J. T., Thyagarajan, K., et al. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.658930 · Cited by 36
Configurations of human-centered AI at work: seven actor-structure engagements in organizations
Wilkens, U., Lupp, D., & Langholf, V. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1272159 · Cited by 38
“To add an illustration for this challenge, Shneiderman (2020a,b,c) stresses accountability and safety culture as important issues in human-centered AI, but without naming responsible actors.”
BackgroundTrust, artificial intelligence and software practitioners: an interdisciplinary agenda
Pink, S., Quilty, E., Grundy, J., & Hoda, R. (2024) · AI & Society · doi:10.1007/s00146-024-01882-7 · Cited by 39
Human-Centered Trustworthy Framework: A Human–Computer Interaction Perspective
Sousa, S., Lamas, D., Cravino, J., & Martins, P. (2024) · Computer · doi:10.1109/mc.2023.3287563 · Cited by 37
“Similarly, regarding TAI frameworks, a trustworthy AI was designed by [43], an agile framework for producing trustworthy AI was detailed in [26], and an article entitled Human-centered artificial intelligence: Reliable, safe & trustworthy was presented by Shneiderman (2020) [42].”
MethodLiang, Q., Gou, J., Wang, Z., & Dabić, M. (2024) · Journal of Global Information Management · doi:10.4018/jgim.357260 · Cited by 28
Reframing deception for human-centered AI
Umbrello, S., & Natale, S. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01184-4 · Cited by 23
HI-TAM, a hybrid intelligence framework for training and adoption of generative design assistants
Mao, Y., Rafner, J. F., Wang, Y., & Sherson, J. F. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1460381 · Cited by 39
Echeverría, V., Zhao, L., Alfredo, R., Milesi, M. E., Jin, Y., Abel, S., Fan, J. X., Yan, L., Dix, S., Wotherspoon, R., et al. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713395 · Cited by 44
Schmid, D., Staehelin, D., Bucher, A. M., Dolata, M., & Schwabe, G. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492845 · Cited by 27
Bove, C., Lesot, M., Tijus, C., & Detyniecki, M. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584082 · Cited by 43
Bingley, W., Haslam, S. A., Steffens, N. K., Gillespie, N. A., Worthy, P., Curtis, C., Lockey, S., Bialkowski, A., Ko, R. K. L., & Wiles, J. (2023) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2023.101025 · Cited by 35
Examination of Ethical Principles for LLM-Based Recommendations in Conversational AI
Bang, J., Lee, B., & Park, P. (2023) · International Conference on Platform Technology and Service · doi:10.1109/platcon60102.2023.10255221 · Cited by 22
How Learners’ Trust Changes in Generative AI over a Semester of Undergraduate Courses
Song, D. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00446-6 · Cited by 32
“These concerns have spurred investigations into trustworthy AI systems; for example, Shneiderman (2020) investigated a framework for human-centered AI, advocating for AI technologies to prioritize reliable, safe, and trustworthy design, which ultimately enhances human performance, creativity, and…”
Larasati, R. A., Liddo, A. D., & Motta, E. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3631614 · Cited by 27
Olugboja, A. M., & Agbakwuru, E. M. (2024) · International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA) · doi:10.1109/acdsa59508.2024.10467443 · Cited by 36
“These collaborative initiatives offer valuable insights and support for navigating the complex world of healthcare regulations, thereby alleviating the regulatory burden faced by rural facilities [6].”
BackgroundAlahmed, Y., Abadla, R., & Ansari, M. J. A. (2024) · International Conference on Intelligent Data Science Technologies and Applications (IDSTA) · doi:10.1109/idsta62194.2024.10746990 · Cited by 35
Conceptual Framework Explaining Recurrence Mechanisms of Unsafe Behaviors in High-Hazard Worksites
Obriki, O. D., & Arumosoye, O. M. (2022) · Shodhshauryam International Scientific Refereed Research Journal · doi:10.32628/shisrrj225489 · Cited by 46
Misty: UI Prototyping Through Interactive Conceptual Blending
Lu, Y., Leung, A., Swearngin, A., Nichols, J. W., & Barik, T. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713924 · Cited by 42
Explainability as a User Requirement for Artificial Intelligence Systems
Jovanovic, M., & Schmitz, M. (2022) · Computer · doi:10.1109/mc.2021.3127753 · Cited by 23
Tangible Explainable AI - an Initial Conceptual Framework
Colley, A., Väänänen, K., & Häkkilä, J. (2022) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3568444.3568456 · Cited by 27
GAM Coach: Towards Interactive and User-centered Algorithmic Recourse
Wang, Z. J., Vaughan, J. W., Caruana, R., & Chau, D. H. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580816 · Cited by 35
Samuel-Okon, A. D., Olateju, O. O., Okon, S. U., Olaniyi, O. O., & Igwenagu, U. T. I. (2024) · Archives of Current Research International · doi:10.9734/acri/2024/v24i5735 · Cited by 29
AI apology: a critical review of apology in AI systems
Harland, H., Dazeley, R., Senaratne, H., Vamplew, P., Cruz, F., & Nakisa, B. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11305-8 · Cited by 19
Alshehhi, K., Cheaitou, A., & Rashid, H. (2024) · Sustainability · doi:10.3390/su16177724 · Cited by 19
Wang, J., Huo, Y., Mahe, J., Ge, Z., Liu, Z., Wang, W., & Zhang, L. (2024) · IEEE Access · doi:10.1109/access.2024.3501332 · Cited by 32
Artificial intelligence in corporate governance
Ustahaliloğlu, M. K. (2025) · Corporate Law & Governance Review · doi:10.22495/clgrv7i1p11 · Cited by 43
Mehdiyev, N., Houy, C., Gutermuth, O., Mayer, L., & Fettke, P. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86790-4_28 · Cited by 35
Legal Provocations for HCI in the Design and Development of Trustworthy Autonomous Systems
Urquhart, L., McGarry, G., & Crabtree, A. (2022) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3546155.3546690 · Cited by 29
AI and Machine Learning Approaches for Chronic Kidney Disease Progression: A Systematic Review
Jettaboina, S., & Sharma, D. A. (2025) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit25112791 · Cited by 19
Artificial Intelligence in Risk Management
Yadav, P., Gupta, P., Sijariya, R., & Sharma, Y. (2024) · Wiley eBooks · doi:10.1002/9781394175574.ch1 · Cited by 26
Beyond Code and Algorithms: Navigating Ethical Complexities in Artificial Intelligence
Ľuptáková, I. D., Pospíchal, J., & Huraj, L. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-54813-0_30 · Cited by 28
Calvano, M., Curci, A., Desolda, G., Esposito, A., Lanzilotti, R., & Piccinno, A. (2025) · Minds and Machines · doi:10.1007/s11023-025-09753-w · Cited by 33
“Among these, biases and lack of explainability greatly endanger the users of AI models (Shneiderman, 2020a), who may be treated unfairly or exposed to life-threatening risks (National Transportation Safety Board, 2017).”
Metadata
- Authors
- Shneiderman, B.
- Affiliations
- University of Maryland, College Park (US)
- Corresponding author
- Shneiderman, Ben
- ORCID
- Shneiderman, Ben
- Venue
- ACM Transactions on Interactive Intelligent Systems
- Published
- 2020-10-16
- Volume
- 10
- Issue
- 4
- Pages
- 1-31
- ISSN
- 2160-6455 (ISSN-L)
- 2160-6463
- OpenAlex
- W3094233077
- Cited by
- 768
- References
- 89
- Citations by year
- 2026: 185 · 2025: 208 · 2024: 153 · 2023: 105 · 2022: 78 · 2021: 38 · 2020: 1
- FWCI
- 75.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Interactive Intelligent Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- human-centered AI, AI governance, software engineering practices, safety culture, audit trail, verification and validation, bias testing, failure reporting, near misses, AI regulation, organizational leadership
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.