The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; none of the 10 sources its claims cite is checked for support yet.
Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications
Open accessAbstract
Purpose: The purpose of this paper is clearly illustrate this convergence and the prescriptive recommendations that such documents entail. There is a significant amount of research into the ethical consequences of artificial intelligence (AI). This is reflected by many outputs across academia, policy and the media. Many of these outputs aim to provide guidance to particular stakeholder groups. It has recently been shown that there is a large degree of convergence in terms of the principles upon which these guidance documents are based. Despite this convergence, it is not always clear how these principles are to be translated into practice. Design/methodology/approach: In this paper, the authors move beyond the high-level ethical principles that are common across the AI ethics guidance literature and provide a description of the normative content that is covered by these principles. The outcome is a comprehensive compilation of normative requirements arising from existing guidance documents. This is not only required for a deeper theoretical understanding of AI ethics discussions but also for the creation of practical and implementable guidance for developers and users of AI. Findings: In this paper, the authors therefore provide a detailed explanation of the normative implications of existing AI ethics guidelines but directed towards developers and organisational users of AI. The authors believe that the paper provides the most comprehensive account of ethical requirements in AI currently available, which is of interest not only to the research and policy communities engaged in the topic but also to the user communities that require guidance when developing or deploying AI systems. Originality/value: The authors believe that they have managed to compile the most comprehensive document collecting existing guidance which can guide practical action but will hopefully also support the consolidation of the guidelines landscape. The authors’ findings should also be of academic interest and inspire philosophical research on the consistency and justification of the various normative statements that can be found in the literature.
Overview
CoChat Summary
TL;DR
This paper maps the normative content of existing AI ethics guidelines for developers and organisational users, moving beyond high-level principles to detailed constituent issues. It compiles 91 guidelines and presents 11 ethical principles with associated guidance, while explicitly not assessing their consistency or philosophical justification.
Key findings
- The authors analysed 91 AI ethics guidelines: Jobin et al.’s 82 sets plus 9 additional guidelines not included there.
- They identify 11 guiding ethical principles and their constituent issues: transparency, justice and fairness, non-maleficence, responsibility, privacy, beneficence, freedom and autonomy, trust, sustainability, dignity and solidarity.
- Guidelines show strong overlap on main issues and themes but differ in emphasis, tone, length (ranging from 1 page to over 266 pages), technicality and intended audience.
- The paper provides normative guidance directed at developers and organisational users of AI, referred to as “AI organisations,” covering subcategories such as explainability, fairness, accountability, privacy, consent, safety and sustainability.
Methods
- Structured search of Scopus, Web of Science and Google Scholar using terms including “AI ethics” and “AI guidelines,” compared against existing collections such as Stix’s European AI Ecosystem, Algorithmwatch’s AI Ethics Guidelines Global Inventory and broader AI repositories.
- Used Jobin et al. (2019) to validate the data set, resulting in 82 of Jobin’s guidelines plus 9 additional guidelines, for a total of 91.
- Conducted thematic analysis of all guidelines, using the EU HLEG ethical principles as high-level coding points, then identified principles and subcategories through close reading, erring on inclusion, and distilled the guidance into normative statements.
Limitations
- The authors state they are not providing prescriptive recommendations but mapping the prescriptive recommendations found in the guidelines.
- They state that they do not conduct a proper ethical analysis of the guidance, including detailed ethical justification or a consistency check, and that they have not checked whether or how far the guidelines are consistent.
- They note that potential conflicts between principles, such as privacy versus transparency, are not explored, and that further work is needed to provide implementation detail and map tools against ethical guidelines.
- Evident from the text: the analysis relies on Jobin et al.’s categorisation and the EU HLEG principles as starting points, and the authors provide only minimal references per section rather than a systematic mapping of guidelines to issues.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 6 Not valid · 9 Not checked · 20 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Issues of responsibility, accountability, liability and acting with integrity appeared in many of the ethics guidelines that we analysed.”
§ Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications > 4.4 Responsibility
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The result was that we analysed Jobin's 82 sets of ethical guidelines and an additional 9 guidelines (see articles in bold in Appendix) that they did not include (the total was 91 guidelines).”
§ Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications > 3. Methodology
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite this, it did not appear as an overly pressing concern in the majority of guidelines, demonstrating a greater need to identify how it can be incorporated more effectively.”
§ Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications > 4.9 Sustainability
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“There are by now large numbers of tools and initial attempts to collect and categories them that help address various ethical issues of AI (Morley et al., 2019).”
§ Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications > 5. Discussion and conclusion
What the sources say
- Not checked yetcites Morley et al., 2019
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“It has recently been shown that there is a large degree of convergence in terms of the principles upon which these guidance documents are based.”
- Also stated in: § 1. Introduction · boosted
“It has been shown that there is a large degree of convergence in terms of the principles that guidance documents are based on (Jobin et al., 2019).”
§ Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications > Abstract
What the sources say
- Not checked yetcites Jobin et al., 2019
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · boosted
1 more claim
Create a free account to see all 35 claims and to verify the 10 references still open.
- Probably not a substantial claim. 28
- It may state two separate claims as one. 8
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When new software vulnerabilities come to light, they should be documented and reported32,61, and so should any changes made to the AIPM in response to an attack after thorough testing10,23,35,61.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [32]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This sets our review apart from other work that was previously undertaken (e.g.,32,123,124).”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [32]
In the citing paper
“Also, developers should keep evaluating algorithmic bias at every stage of the development process32.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [32]
In the citing paper
“Multiple sources state that the design should match social norms, and make sure its presentation does not reinforce stereotypes (e.g., regarding a prespecified fairness position or bias impact statement, see phase 2)22,24,26,32,99.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [32]
In the citing paper
“Finally, as monitoring and auditing of AIPMs in practice are widely recommended (covered in more detail in phase 6), the developed software should facilitate this10,22,26,32,58,62,104.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [32]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 5×
“…minimal references per section because our aim is to give an overview of the ethical aspects and the normative content within all of these guidelines, rather than providing a systematic and robust mapping of guidelines to issues, as this has already been done quite well in Jobin et al. (2019).”
InfluentialFloridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 6×
“AI organisations should understand how their AI works and explain the technical functioning and decisions reached by those technologies, whenever possible (Floridi et al. , 2018).”
BackgroundInfluentialKaplan, A., & Haenlein, M. (2019) · Business Horizons · doi:10.1016/j.bushor.2018.08.004 · Cited by 3,140 · cited 1×
“A typical de fi nition is “ we de fi ne AI as a system ’ s ability to interpret external data correctly, to learn from such data and to use those learnings to achieve speci fi c goals and tasks through fl exible adaptation ” (Kaplan and Haenlein, 2019, p. 17).”
BackgroundHaenlein, M., & Kaplan, A. (2019) · California Management Review · doi:10.1177/0008125619864925 · Cited by 2,655 · cited 1×
“In doing so, AI will not only impact our personal lives but also fundamentally transform how fi rms take decisions and interact with their external stakeholders (e.g. employees, customers) ( Haenlein and Kaplan, 2019, p. 9).”
BackgroundPrinciples alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886 · cited 2×
“…at the dominant approach to principle-based guidelines is that they can oversimplify complex and dif fi cult ethical debates and lead to an appearance of moral consensus where in fact the dif fi cult ethical questions are hidden in the details of the application of principles (Mittelstadt, 2019).”
BackgroundA Pragmatic View of Thematic Analysis
Aronson, J. (1995) · The Qualitative Report · doi:10.46743/2160-3715/1995.2069 · Cited by 1,758
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882
MOOR, J. H. (1985) · Metaphilosophy · doi:10.1111/j.1467-9973.1985.tb00173.x · Cited by 863
Preparing for the future of Artificial Intelligence
Bundy, A. (2017) · AI & SOCIETY · doi:10.1007/s00146-016-0685-0 · Cited by 425 · cited 1×
“There have been numerous high-level policy reports that describe the current and expected effects of AI on society and economy (Executive Of fi ce of the President, 2016a, 2016b; HoL, 2018; House of Commons Science and Technology Committee, 2016; OECD, 2019).”
Background
Research works printed but not linked: 9
- ACM, 2017, Statement on algorithmic transparency and accountability
- Asilomar Conference (2017), “Asilomar AI principles”, Future of Life Institute, available at: https://futureoflife.org/ai-principles/ (accessed 10 February 2018).
- 1979, Principles of Biomedical Ethics
- 2003, Computer Ethics and Professional Responsibility: Introductory Text and Readings
- IEEE, 2017, Ethically aligned design: a vision for prioritizing human well-being with autonomous and intelligent systems
- IEEE, 2019, Ethically aligned design: a vision for prioritizing human well-being with autonomous and intelligent systems
- 2016, Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
- 2019, A Survey of the European Union’s Artificial Intelligence Ecosystem
- The Conference toward AI Network Society, 2017, Draft AI R&D guidelines for international discussions
Cited by
de Hond, A. A. H., Leeuwenberg, A. M., Hooft, L., Kant, I. M. J., Nijman, S. W. J., van Os, H. J. A., Aardoom, J. J., Debray, T. P. A., Schuit, E., van Smeden, M., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-021-00549-7 · Cited by 499
“Identifying and involving the right expertise and stakeholders in each consecutive phase of the AIPM development, evaluation and implementation cycle is crucial for its success in daily healthcare practice 8,18,22,23,26,32,58,79,88 .”
BackgroundMethodInfluentialAn Overview of Artificial Intelligence Ethics
Huang, C., Zhang, Z., Mao, B., & Yao, X. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3194503 · Cited by 482
“To formulate ethical standards for AI, researchers and practitioners should well understand the existing ethical theories and principles [13], [24].”
BackgroundInfluentialThe Ethical Implications of Artificial Intelligence (AI) For Meaningful Work
Bankins, S., & Formosa, P. (2023) · Journal of Business Ethics · doi:10.1007/s10551-023-05339-7 · Cited by 448
“An analysis by Ryan and Stahl (2020, p. 67) mentions the need to “retrain and retool” human workers who are fully replaced by AI, but this sidelines human-AI collaborations in workplaces and AI’s broader impacts on meaningful work.”
MethodRobinson, S. C. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101421 · Cited by 338
Stahl, B. C. (2021) · SpringerBriefs in Research and Innovation Governance · doi:10.1007/978-3-030-69978-9 · Cited by 317
Self-citation
Metadata
- Authors
- Ryan, M., & Stahl, B. C.
- Affiliations
- KTH Royal Institute of Technology (SE)
- De Montfort University (GB)
- Corresponding author
- Ryan, Mark
- Venue
- Journal of Information, Communication and Ethics in Society
- Publisher
- Emerald
- Published
- 2020-06-09
- Volume
- 19
- Issue
- 1
- Pages
- 61-86
- ISSN
- 1477-996X (ISSN-L)
- OpenAlex
- W3026607820
- Semantic Scholar
- d1608de30366431a14ec0ad7bb7c7235d55cee57
- Cited by
- 310
- References
- 28
- Citations by year
- 2026: 60 · 2025: 65 · 2024: 70 · 2023: 36 · 2022: 47 · 2021: 27 · 2020: 5
- FWCI
- 39.13
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- www.emerald.com/insight/site-policies (tdm)
- Locations
- Journal of Information Communication and Ethics in Society (publishedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (publishedVersion, other-oa)
- Socio-Environmental Systems Modeling (acceptedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- DMU Open Research Archive (De Montfort University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- AI ethics, AI ethics guidelines, normative requirements, ethical principles, AI developers, AI users
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications. https://app.cochat.ai/papers/10.1108/jices-12-2019-0138
- The paper
- Ryan, M., & Stahl, B. C. (2021). Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications. Journal of Information, Communication and Ethics in Society. https://doi.org/10.1108/jices-12-2019-0138
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.