Operationalising AI ethics: barriers, enablers and next steps
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
By mid-2019 there were more than 80 AI ethics guides available in the public domain. Despite this, 2020 saw numerous news stories break related to ethically questionable uses of AI. In part, this is because AI ethics theory remains highly abstract, and of limited practical applicability to those actually responsible for designing algorithms and AI systems. Our previous research sought to start closing this gap between the ‘what’ and the ‘how’ of AI ethics through the creation of a searchable typology of tools and methods designed to translate between the five most common AI ethics principles and implementable design practices. Whilst a useful starting point, that research rested on the assumption that all AI practitioners are aware of the ethical implications of AI, understand their importance, and are actively seeking to respond to them. In reality, it is unclear whether this is the case. It is this limitation that we seek to overcome here by conducting a mixed-methods qualitative analysis to answer the following four questions: what do AI practitioners understand about the need to translate ethical principles into practice? What motivates AI practitioners to embed ethical principles into design practices? What barriers do AI practitioners face when attempting to translate ethical principles into practice? And finally, what assistance do AI practitioners want and need when translating ethical principles into practice?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
A Unified Framework of Five Principles for AI in Society
Floridi, L., & Cowls, J. (2019) · Harvard Data Science Review · doi:10.1162/99608f92.8cd550d1 · Cited by 1,631 · cited 1×
“…framework; the creation of a searchable typology of tools and methods designed to translate between the five most common AI ethics principles (Floridi and Cowls 2019) and implementable design practices (Morley et al. 2020a, b; https:// www. digic atapu lt. org. uk/ for-start ups/ other-progr…”
MethodSelf-citationCase Study: A Strategic Research Methodology
Noor, K. B. M. (2008) · American Journal of Applied Sciences · doi:10.3844/ajassp.2008.1602.1604 · Cited by 1,032
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882
Self-citationAlgorithmic Accountability: Journalistic investigation of computational power structures
Diakopoulos, N. (2015) · Digital Journalism · doi:10.1080/21670811.2014.976411 · Cited by 733
Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical
Floridi, L. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00354-x · Cited by 524 · cited 1×
“This has created a scenario in which those producing, purchasing, or using AI systems can ‘ethics shop,’ ‘ethics wash,’ and ‘ethics dump’ without fear of facing any real consequences (Floridi 2019).”
BackgroundSelf-citationAlgorithmic Accountability and Public Reason
Binns, R. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0263-5 · Cited by 457 · cited 1×
“Finally, in a democratic society different people might reasonably disagree over the different values that should be embedded in different algorithms in different con-texts—we must allow for value pluralism (Binns, 2018).”
BackgroundThe Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions
Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314289 · Cited by 399 · cited 1×
“Both Whittlestone et al. (2019) and Terzis (2020) discuss the complexities of encountering tensions in AI ethics, in more detail.”
BackgroundThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000375277 · Cited by 360
Ethical guidelines for COVID-19 tracing apps
Morley, J., Cowls, J., Taddeo, M., & Floridi, L. (2020) · Nature · doi:10.1038/d41586-020-01578-0 · Cited by 348
Self-citationCollingridge and the dilemma of control: Towards responsible and accountable innovation
Genus, A., & Stirling, A. (2018) · Research Policy · doi:10.1016/j.respol.2017.09.012 · Cited by 301
Ethics-Based Auditing to Develop Trustworthy AI
Mökander, J., & Floridi, L. (2021) · Minds and Machines · doi:10.1007/s11023-021-09557-8 · Cited by 268 · cited 1×
“Currently, the use of external accountability mechanisms such as ethics-based auditing (Mökander et al., 2021) is limited.”
BackgroundSelf-citationEthics as a Service: A Pragmatic Operationalisation of AI Ethics
Morley, J., Elhalal, A., Garcia, F., Kinsey, L., Mökander, J., & Floridi, L. (2021) · Minds and Machines · doi:10.1007/s11023-021-09563-w · Cited by 266
Self-citationSoft ethics, the governance of the digital and the General Data Protection Regulation
Floridi, L. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0081 · Cited by 234 · cited 3×
“…themselves facing the same ‘grey’ issue repeatedly, and society finds itself suffering from the consequences of related poor-decisions, is it likely that legislation will be developed to provide AI practitioners with the reas-surance they seek—this is known as the normative cascade (Floridi 2018).”
BackgroundInfluentialSelf-citationFloridi, L. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.3835211 · Cited by 227
Self-citationAI ethics should not remain toothless! A call to bring back the teeth of ethics
Rességuier, A., & Rodrigues, R. (2020) · Big Data & Society · doi:10.1177/2053951720942541 · Cited by 224
Buhmann, A., Paßmann, J., & Fieseler, C. (2020) · Journal of Business Ethics · doi:10.1007/s10551-019-04226-4 · Cited by 167 · cited 1×
“The third level operationalises Habermas’s concept of discourse ethics (Buhmann et al. 2019), i.e. an approach that seeks to establish normative values and ethical truths through open discourse, and consists of a series of questions that are designed to encourage AI practitioners to conduct ethical…”
BackgroundPractical ethics for building learning analytics
Kitto, K., & Knight, S. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12868 · Cited by 139
Varieties of responsibility: two problems of responsible innovation
van de Poel, I., & Sand, M. (2018) · Synthese · doi:10.1007/s11229-018-01951-7 · Cited by 134
Nicholls, S. G., Hayes, T., Brehaut, J., McDonald, M., Weijer, C., Saginur, R., & Fergusson, D. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0133639 · Cited by 100
Practical virtue ethics: healthcare whistleblowing and portable digital technology
Bolsin, S. N. C., Faunce, T., & Oakley, J. G. (2005) · Journal of Medical Ethics · doi:10.1136/jme.2004.010603 · Cited by 100
Ethical Foresight Analysis: What it is and Why it is Needed?
Floridi, L., & Strait, A. (2020) · Minds and Machines · doi:10.1007/s11023-020-09521-y · Cited by 78 · cited 2×
“…applicable to real-world ethical decisions (Schwarz 2005; Vidgen et al. 2020); (v) enable developers to think through potential future scenarios (Floridi and Strait 2020); and (vi) ensure all stakeholders are engaged and involved in design decisions, rather than simply consulted about them…”
BackgroundSelf-citationThe Logic of Design as a Conceptual Logic of Information
Floridi, L. (2017) · Minds and Machines · doi:10.1007/s11023-017-9438-1 · Cited by 76 · cited 1×
“However, over time, it has become increasingly clear that whilst these documents’ existence might be necessary for the creation of these much-needed pro-ethical conditions (Floridi 2017), it is far from sufficient (Vidgen et al.”
BackgroundSelf-citationExploring the ethical implications of business analytics with a business ethics canvas
Vidgen, R. T., Hindle, G. A., & Randolph, I. (2019) · European Journal of Operational Research · doi:10.1016/j.ejor.2019.04.036 · Cited by 69
“This is Just a Prototype”: How Ethics Are Ignored in Software Startup-Like Environments
Vakkuri, V., Kemell, K.-K., Jantunen, M., & Abrahamsson, P. (2020) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-030-49392-9_13 · Cited by 54
Mapping the public debate on ethical concerns: algorithms in mainstream media
Barn, B. S. (2019) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-04-2019-0039 · Cited by 49
Artificial Intelligence: Power to the People
Roff, H. M. (2019) · Ethics & International Affairs · doi:10.1017/s0892679419000121 · Cited by 48
Evaluating Ethics Committees: A View from the Outside
Hoffmann, D. E. (1993) · Milbank Quarterly · doi:10.2307/3350425 · Cited by 44
Onward for the freedom of others: marching beyond the AI ethics
Terzis, P. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3373152 · Cited by 36
Implementing AI Ethics in Practice: An Empirical Evaluation of the RESOLVEDD Strategy
Vakkuri, V., & Kemell, K.-K. (2019) · Lecture notes in business information processing · doi:10.1007/978-3-030-33742-1_21 · Cited by 33
Fiore, E. (2020) · FormAkademisk - forskningstidsskrift for design og designdidaktikk · doi:10.7577/formakademisk.2201 · Cited by 33
Learning on mobile augmented reality trails of integrity and ethics
Wong, E. Y. W., Kwong, T. F. N., & Pegrum, M. A. (2018) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-018-0088-6 · Cited by 27
Getting into the engine room: a blueprint to investigate the shadowy steps of AI ethics
Rochel, J., & Évéquoz, F. (2020) · AI & Society · doi:10.1007/s00146-020-01069-w · Cited by 23
The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions
Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019) · Apollo (University of Cambridge) · doi:10.17863/cam.37097 · Cited by 23
Meticulous Transparency—An Evaluation Process for an Agile AI Regulatory Scheme
Benrimoh, D. A., Israel, S. A., Perlman, K., Fratila, R., & Krause, M. R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-92058-0_83 · Cited by 19
The Democratic Governance of Information Societies. A Critique to the Theory of Stakeholders
Durante, M. (2014) · Philosophy & Technology · doi:10.1007/s13347-014-0162-y · Cited by 15
Innovation empathy: a framework for customer-oriented lean innovation
Montonen, T., Eriksson, P., Asikainen, I., & Lehtimäki, H. P. (2014) · International Journal of Entrepreneurship and Innovation Management · doi:10.1504/ijeim.2014.064719 · Cited by 10
Teaching ethics and computer forensics
Schwarz, T. S. J. (2005) · Annual Conference on Information Security Curriculum Development (InfoSecCD) · doi:10.1145/1107622.1107637 · Cited by 5
An Exploration of How Ethics Informs Health Care Practice
Concannon, M., Gillibrand, W. P., & Jones, P. M. (2019) · Huddersfield Research Portal (University of Huddersfield) · Cited by 2
Research works printed but not linked: 2
- Babbie ER (2016) The practice of social research (Fourteenth). Cengage Learning
- Guariglia M, Tsukayama H (2021) Questions remain about pretrial risk-assessment algorithms: year in review 2020. Electronic Frontier Foundation. https://www.eff.org/deeplinks/2020/12/questions-remain-about-pretrial-risk-assessment-algorithms-year-review-2020
Cited by
SHIFTing artificial intelligence to be responsible in healthcare: a systematic review
Siala, H., & Wang, Y. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114782 · Cited by 358
Operationalising AI governance through ethics-based auditing: an industry case study
Mökander, J., & Floridi, L. (2023) · AI and Ethics · doi:10.1007/s43681-022-00171-7 · Cited by 129
Self-citationFehr, J., Citro, B., Malpani, R., Lippert, C., & Madai, V. I. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1267290 · Cited by 188
“…to provide public transparency about the safety and risks of their medical AI tools (24, 27 – 29 So far, the limited documentation of medical AI software has been justi fi ed by a lack of understanding on ethics among developers (51 – 53) or as a threat to intellectual property (IP) (30, 54).”
AI Ethics Principles in Practice: Perspectives of Designers and Developers
Sanderson, C., Douglas, D., Lu, Q., Schleiger, E., Whittle, J., Lacey, J., Newnham, G., Hajkowicz, S., Robinson, C., & Hansen, D. (2023) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2023.3257303 · Cited by 99
“However, there is still a large gap between high-level AI principles and practical techniques that can be readily used in the design and development of responsible AI systems [14], [15].”
BackgroundDesigning Responsible AI: Adaptations of UX Practice to Meet Responsible AI Challenges
Wang, Q., Madaio, M., Kane, S., Kapania, S., Terry, M., & Wilcox, L. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581278 · Cited by 90
“Recent work has explored the sociotechnical practice of how RAI toolkits are integrated into practitioners’ work-fows [30, 70, 73, 114].”
Background
Metadata
- Authors
- Morley, J., Kinsey, L., Elhalal, A., Garcia, F., Ziosi, M., & Floridi, L.
- Affiliations
- University of Oxford (GB)
- Digital Catapult (GB)
- Corresponding author
- Morley, Jessica
- Venue
- AI & SOCIETY
- Published
- 2021-11-15
- Volume
- 38
- Issue
- 1
- Pages
- 411-423
- ISSN
- 0951-5666 (ISSN-L)
- 1435-5655
- OpenAlex
- W3212259563
- Cited by
- 215
- References
- 40
- Citations by year
- 2026: 56 · 2025: 59 · 2024: 59 · 2023: 24 · 2022: 17
- FWCI
- 31.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- AI & Society (publishedVersion, cc-by)
- Funders
- Wellcome Trust
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- AI ethics, ethical principles, design practice, AI practitioners, enabling factors, practitioner awareness, ethical guidance, AI system design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.