CoChat

The Ethics of AI Ethics: An Evaluation of Guidelines

Open access
Hagendorff, Thilo · 2020 · Minds and Machines

The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index; 5 of the 88 sources its claims cite were checked for support.

Abstract

Abstract Current advances in research, development and application of artificial intelligence (AI) systems have yielded a far-reaching discourse on AI ethics. In consequence, a number of ethics guidelines have been released in recent years. These guidelines comprise normative principles and recommendations aimed to harness the “disruptive” potentials of new AI technologies. Designed as a semi-systematic evaluation, this paper analyzes and compares 22 guidelines, highlighting overlaps but also omissions. As a result, I give a detailed overview of the field of AI ethics. Finally, I also examine to what extent the respective ethical principles and values are implemented in the practice of research, development and application of AI systems—and how the effectiveness in the demands of AI ethics can be improved.

Overview

CoChat Summary

## TL;DR

This paper semi-systematically reviews 22 AI ethics guidelines, finding strong overlap on a few technicalizable topics but many important omissions. It argues that AI ethics is often ineffective in practice and should be supplemented by more concrete technical guidance and a shift toward virtue ethics.

## Key findings

  • The paper analyzes and compares 22 AI ethics guidelines and finds that accountability, privacy, and fairness appear in about 80% of them, making them the closest thing to a common minimum standard.
  • The author reports that guidelines from industrial contexts name on average 9.1 distinct ethical aspects, while science-based ethics codes average 10.8.
  • Only two guidelines contain genuinely technical explanations, and these are described as very sparse; the most extensive technical commentary is in “The Malicious Use of AI”.
  • The paper says a controlled study found the effectiveness of ethics guidelines or codes to be “almost zero”: among 63 software engineering students and 105 professional software developers, there was no statistically significant difference in responses between those who did and did not see the ACM code of ethics.
  • The paper highlights major omissions across guidelines, including political abuse of AI, hidden social and ecological costs, lack of diversity, robot ethics, trolley problems, and public-private partnerships/industry-funded research.

## Methods

  • Semi-systematic literature analysis of AI ethics guidelines, with a deliberate focus on comprehensive guideline documents rather than all AI-ethics-related writings.
  • The final sample consisted of 22 major ethical guidelines, identified through searches in Google, Google Scholar, Web of Science, ACM Digital Library, arXiv, and SSRN, plus manual reference screening and the Algorithm Watch AI Ethics Guidelines Global Inventory.
  • The paper compares which ethical issues are present or absent in the guidelines, and then relates those principles to practice using cited empirical studies and examples from AI development and deployment.

## Limitations

  • The author states the sample is biased toward western/northern documents and excludes guidelines not written in English.
  • The selection deliberately excludes guidelines focused on robot ethics, big data, algorithms, or robotics, so omissions in those areas are partly a result of the sampling method.
  • The paper notes that its list of omissions is non-exhaustive.
  • Evident from the text: the paper is primarily a theoretical/semi-systematic overview, not a direct empirical test of all AI ethics guideline implementations.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s11023-020-09517-8

Cites

98 of 98 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 3 Not valid · 63 Not checked · 64 Own results and interpretations

54 more claims

Create a free account to see all 134 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 59
  • It may state two separate claims as one. 29

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

13 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 98 references

Research works printed but not linked: 24

  1. Abrassart, C., Bengio, Y., Chicoisne, G., de Marcellis-Warin, N., Dilhac, M.-A., Gambs, S., Gautrais, V., et al. (2018). Montréal declaration for responsible development of artificial intelligence (pp. 1–21).
  2. Asimov, I. (2004). I, Robot. New York: Random House LLC.
  3. Bakewell, J. D., Clement-Jones, T. F., Giddens, A., Grender, R. M., Hollick, C. R., Holmes, C., Levene, P. K. et al. (2018). AI in the UK: Ready, willing and able?. Select committee on artificial intelligence (pp. 1–183).
  4. Baron, B., Musolesi, M. (2017). Interpretable machine learning for privacy-preserving pervasive systems. arXiv (pp. 1–10).
  5. Bourdieu, P. (1984). Distinction: A social critique of the judgement of taste. Cambridge: Harvard University Press.
  6. Brahnam, S. (2006). Gendered bots and bot abuse. In Antonella de Angeli, Sheryl Brahnam, Peter Wallis, & Peter Dix (Eds.), Misuse and abuse of interactive technologies (pp. 1–4). Montreal: ACM.
  7. Derrida, J. (1997). Of grammatology. Baltimore: Johns Hopkins Univ. Press.
  8. Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumeé, III, H., Crawford, K. (2018). Datasheets for datasets. arXiv (pp. 1–17).
  9. Google. (2019). Perspectives on issues in AI governance (pp. 1–34). Retrieved February 11, 2019. https://ai.google/static/documents/perspectives-on-issues-in-ai-governance.pdf.
  10. Helbing, D. (Ed.). (2019). Towards digital enlightment: Essays on the darf and light sides of the digital revolution. Cham: Springer.
  11. Holdren, J. P., Bruce, A., Felten, E., Lyons, T., & Garris, M. (2016). Preparing for the future of artificial intelligence (pp. 1–58). Washington, D.C: Springer.
  12. Johnson, D. G. (2017). Can engineering ethics be taught? The Bridge,47(1), 59–64.
  13. Luhmann, N. (1988). Die Wirtschaft der Gesellschaft. Frankfurt A.M: Suhrkamp.
  14. Morley, J., Floridi, L., Kinsey, L., Elhalal, A. (2019). From what to how. An overview of AI ethics tools, methods and research to translate principles into practices. arXiv (pp. 1–21).
  15. Pekka, A.-P., Bauer, W., Bergmann, U., Bieliková, M., Bonefeld-Dahl, C., Bonnet, Y., Bouarfa, L. et al. (2018). The European Commission’s high-level expert group on artificial intelligence: Ethics guidelines for trustworthy ai. Working Document for stakeholders’ consultation. Brussels (pp. 1–37).
  16. Pistono, F., Yampolskiy, R. (2016). Unethical research: How to create a malevolent artificial intelligence. arXiv (pp. 1–6).
  17. Podgaiska, I., Shklovski, I. Nordic engineers’ stand on artificial intelligence and ethics: Policy recommendations and guidelines (pp. 1–40).
  18. Rawls, J. (1975). Eine Theorie Der Gerechtigkeit. Frankfurt am Main: Suhrkamp.
  19. Shoham, Y., Perrault, R., Brynjolfsson, E., Clark, J., Manyika, J., Niebles, J. C., Lyons, T., Etchemendy, J., Grosz, B., Bauer, Z. (2018). The AI index 2018 annual report. Stanford, Kalifornien (pp. 1–94).
  20. Sitawarin, C., Bhagoji, A. N., Mosenia, A., Chiang, M., Mittal, P. (2018). DARTS: Deceiving autonomous cars with toxic signs. arXiv (pp. 1–27).
  21. Tegmark, A. (2017). Life 3.0: Being human in the age of artificial intelligence. New York: Alfred A. Knopf.
  22. The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. (2016). Ethically aligned design: A vision for prioritizing human well-being with artificial intelligence and autonomous systems (pp. 1–138).
  23. Whittaker, M., Crawford, K., Dobbe, R., Fried, G., Kaziunas, E., Mathur, V., West, S. M., Richardson, R., Schultz, J., Schwartz, O. (2018). AI now report 2018 (pp. 1–62).
  24. Zeng, Y., Lu, E., Huangfu, C. (2018). Linking artificial intelligence principles. arXiv (pp. 1–4).

Cited by

See all 1,911

Metadata

Authors
Hagendorff, T.
Affiliations
University of Tübingen (DE)
Corresponding author
Hagendorff, Thilo
Venue
Minds and Machines
Published
2020-02-01
Volume
30
Issue
1
Pages
99-120
ISSN
  • 0924-6495 (ISSN-L)
  • 1572-8641
OpenAlex
W3003385079
Cited by
1,911
References
86
Citations by year
2026: 370 · 2025: 446 · 2024: 361 · 2023: 290 · 2022: 239 · 2021: 160 · 2020: 41
FWCI
248.38
Type
journal article
Language
en
Open access
Licence
Locations
  • Minds and Machines (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Deutsche Forschungsgemeinschaft (390727645)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
Keywords
AI ethics, ethics guidelines, normative principles, moral values

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-12, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-12 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Ethics of AI Ethics: An Evaluation of Guidelines. https://app.cochat.ai/papers/10.1007/s11023-020-09517-8
The paper
Hagendorff, T. (2020). The Ethics of AI Ethics: An Evaluation of Guidelines. Minds and Machines. https://doi.org/10.1007/s11023-020-09517-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.