CoChat

Diversity, Equity, and Inclusion in Artificial Intelligence: An Evaluation of Guidelines

Open access
Cachat-Rosset, Gaelle, Klarsfeld, Alain · 2023 · Applied Artificial Intelligence

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index; none of the 81 sources its claims cite is checked for support yet.

Abstract

Artificial intelligence (AI) is present everywhere in the lives of individuals. Unfortunately, several cases of discrimination by AI systems have already been reported. Scholars have warned on risks of AI reproducing existing inequalities or even amplifying them. To tackle these risks and promote responsible AI, many ethics guidelines for AI have emerged recently, including diversity, equity, and inclusion (DEI) principles and practices. However, little is known about the DEI content of these guidelines, and to what extent they meet the most relevant accumulated knowledge from DEI literature. We performed a semi-systematic literature review of the AI guidelines regarding DEI stakes and analyzed 46 guidelines published from 2015 to today. We fleshed out the 14 DEI principles and the 18 DEI practices recommended underlying these 46 guidelines. We found that the guidelines mostly encourage one of the DEI management paradigms, namely fairness, justice, and nondiscrimination, in a limited compliance approach. We found that narrow technical practices are favored over holistic ones. Finally, we conclude that recommended practices for implementing DEI principles in AI should include actions aimed at directly influencing AI actors’ behaviors and awareness of DEI risks, rather than just stating intentions and programs.

Overview

CoChat Summary

TL;DR

This semi-systematic review analyzes 46 AI ethics guidelines published from 2015 onward and finds that their DEI content is dominated by fairness, justice, and nondiscrimination in a limited compliance approach. It concludes that guidelines favor narrow technical practices over holistic organizational ones and rarely target AI actors’ day-to-day behaviors or awareness of DEI risks.

Key findings

  • The review identified 14 DEI principles and 18 DEI practices across 46 guidelines. Of the 14 principles, 12 (86%) map to the “fair representation and treatment and nondiscrimination” paradigm, while only 2 (14%) reflect a “valuing diversity” or synergy perspective.
  • The most cited DEI principles were Equity/Fairness (76%, 35 sources), Nondiscrimination (57%, 26), and Diversity in learning datasets/Representativeness (50%, 23). The most targeted groups were female (N = 34), disabled or health vulnerable people (N = 34), and racial or ethnic minorities (N = 32).
  • In the AIS development process, the most recommended practices were verification and validation of AIS results (63%, 29), AIS learning sources and dataset (57%, 26), transparency of AIS decisions (54%, 25), and explicability of AIS decisions (52%, 24).
  • For AIS design organizations, accountability/responsibility for AIS was recommended by 57% (26), team diversity in AIS companies by 50% (23), and DEI training/awareness by 43% in Table 5 (20; described as 50% in the text). Only one of eight organizational practices directly addressed the praxis dimension—objectives/incentives for compliance with DEI principles (13%, 6)—and no guideline included penalties for noncompliance.

Methods

  • Semi-systematic literature review adapted from PRISMA, using a two-step search: prior comprehensive AI ethics reviews plus keyword-based web search. Inclusion criteria were documents published in 2015 or later, written in English, and from reliable influential sources such as governmental/intergovernmental reports, professional AI associations, and influential private AI companies; the final sample was 46 documents.
  • Content extraction and categorization used deductive categories based on DEI expertise, followed by inductive identification of additional categories. This yielded 14 DEI principles and 18 DEI practices, with 361 extracted entries for principles and 588 for practical recommendations.
  • Two research graduate students coded independently; agreement was almost perfect for principles (k = 0.85, p < .05) and AIS development process (k = 0.84, p < .05), and substantial for AIS design organizations (k = 0.80, p < .05). A third researcher specializing in DEI management in AI inspected the results.

Limitations

  • Paper-stated: the review selected only English-language sources, which may explain the strong Western domination in the results; the authors also note that no document, code, or charter dedicated specifically to DEI in AI was found within their criteria.
  • Paper-stated: the authors call for further research on whether intentions and pro-DEI programs alone can influence AI actors’ DEI behaviors, or whether binding regulation is needed; they also note the lack of diversity among guideline authors (60.8% male, 74.2% white, 78.3% nationals of Western countries) and within the AI community.
  • Evident from the text: the analysis is based on manual coding by two graduate students with a third researcher inspecting results, and the sample is limited to 46 English-language guidelines, so the categorization and geographic coverage may be shaped by those constraints.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/08839514.2023.2176618

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Image 1
CC-BY-NC · From the PDF
Image 2
CC-BY-NC · From the PDF
Image 3
CC-BY-NC · From the PDF
Figure 1 PRISMA-based flowchart of document retrieval process.
Figure 1 PRISMA-based flowchart of document retrieval process.CC-BY-NC · From the PDF

Verification

Claims the paper makes

0 Valid · 1 Not valid · 71 Not checked · 119 Own results and interpretations

79 more claims

Create a free account to see all 191 claims and to verify the 81 references still open.

See all claims — free account
  • Probably not a substantial claim. 59
  • The quote only partly states this claim. 13
  • It may state two separate claims as one. 65

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 59 references

Research works printed but not linked: 44

  1. Accenture. 2019. Responsible AI and robotics: An ethical framework. Accenture, UK.
  2. ACM. 2017. Statement on algorithmic transparency and accountability. Washington, DC: Association for Computing Machinery US Public Policy Council.
  3. Avila, R., A. Brandusescu, J. O. Freuler, and D. Takur. 2018. Artifcial intelligence: Open questions about gender inclusion. Argentina: World Wide Web Foundation.
  4. Beijing Academy of Artificial Intelligence. 2019. Beijing AI Principles. Beijing Academy of Artificial Intelligence (BAAI), Beijing: Beijing Academy of Artifcial Intelligence.
  5. Benessaieh, K. 2022. Le Québec se classe 7e au monde. La Presse, 29(2): March 9th.
  6. Dawson, D., E. Schleiger, J. Horton, J. McLaughlin, C. Robinson, G. Quezada, J. Scowcroft, and S. Hajkowicz. 2019. Artificial intelligence: Australia’s ethics framework. Data61 CSIRO, Australia.
  7. DeepMind. 2019. Ethics and society principles. London: DeepMind.
  8. Deloitte. 2020. Trustworthy AI. USA: The Deloitte AI Institute.
  9. Diakopoulos, N., Friedler S, Arenas M, Barocas S, Hay M, Howe B, Jagadish HV, Unsworth K, Sahuguet A, Venkatasubramanian S,et al. 2019. Principles for accountable algorithms and a social impact statement for algorithms. Fairness, Accountability, and Transparency in Machine Learning (FAT/ML). https://www.fatml.org/resources/principles-for-accountable-algorithms
  10. Dutch Artificial Intelligence. 2018. Dutch artificial intelligence manifesto. The Netherlands: Special Interest Group on Artificial Intelligence.
  11. Eubanks, V. 2018. Automating inequality: How high-tech tools profle, police, and punish the poor. New York: St. Marting’s Press.
  12. European Commission. 2020. The Assessment List for Trustworthy Artificial Intelligence for self assessment. In Directorate-General for Communications Networks. Content and Technology, Publications Office.
  13. Freeman, R. E. 1984. Strategic management: A stakeholder theory. Journal of Management Studies 39 (1):1–21.
  14. Future of Life Institute. 2017. Asilomar AI principles. California: Future of Life Institute.
  15. The Future Society. 2018. The future society, law & society initiative, principles for the governance of AI. Policy Research, The Law & Society Initiative.
  16. Google. 2018. Artificial intelligence at google: Our principles. Google AI.
  17. Government of the Republic of Korea. 2017. Mid- to long-term master plan in preparation for the intelligent information society: Managing the fourth industrial revolution. Korea: Government of the Republic of Korea Interdepartmental Exercise.
  18. GOV.UK. 2019. Initial code of conduct for data-driven health and care technology. United Kingdom: GOV.UK.
  19. Green Digital Working Group. 2016. Position on robotics and artificial intelligence. The Green Digital Working Group, Europe.
  20. IBM. 2018. Everyday ethics for artificial intelligence, IBM design for AI. USA.
  21. IEEE. 2016. Ethically aligned design: a vision for prioritizing human well-being with autonomous and intelligent systems, version 1. IEEE Advancing Technology for Humanity. https://standards.ieee.org/wp-content/uploads/import/documents/other/ead_v1.pdf
  22. IEEE. 2019. Ethically aligned design: A vision for prioritizing human well-being with autonomous and intelligent systems, First Edition ed, IEEE Advancing Technology for Humanity. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9398613
  23. Information Accountability Foundation. 2015. Unified ethical frame for big data analysis: IAF big data ethics initiative. Part A.
  24. Institute of Business Ethics. 2018. Business ethics and artificial intelligence. London: Institute of Business Ethics.
  25. ITI. 2017. AI policy principles. Information Technology Industry Council. https://www.itic.org/public-policy/ITIAIPolicyPrinciplesFINAL.pdf
  26. Japanese Society for Artificial Intelligence. 2017. Ethical Guidelines. In The Japanese Society for Artificial Intelligence, Japan.
  27. Klarsfeld, A., L. A. E. Booysen, E. Ng, I. Roper, and A. Tatli. 2014. Perspectives from 16 countries on diversity and equal treatment at work: An overview and transverse questions country perspectives on diversity and equal treatment. Cheltenham: Edward Elgar Publishing.
  28. Leaders of the G7. 2018. Common vision for the future of artificial intelligence, G7. Charlevoix.
  29. Microsoft Corporation. 2019. Microsoft AI principles. USA: Microsoft Corporation.
  30. Ministry of State for Science and Technology Policy. 2017. Report on Artificial Intelligence and Human Society: Unofficial Translation. In Advisory Board on Artificial Intelligence and Human Society, Japan.
  31. Montréal Declaration. 2018. Montréal declaration for a responsible development of artificial intelligence. Montreal. https://www.montrealdeclaration-responsibleai.com/
  32. Partnership on AI. 2018. Advancing positive outcomes for people and society.
  33. PwC. 2019. The responsible AI framework. PwC.
  34. Royal Society. 2017. Machine learning: The power and promise of computers that learn by example. London: The Royal Society.
  35. Thomas, D. A., and R. J. Ely. 1996. Making differences matter: A new paradigm for diversity management. Harvard Business Review 74 (5):79–90.
  36. Toronto declaration. 2018. The toronto declaration, protecting the right to equality and non-discrimination in machine learning systems. Toronto: Human Rights Watch.
  37. UNESCO. 2021. Recommendation on the ethics of artificial intelligence. Paris: SHS/BIO/REC-AIETHICS/2021.
  38. UNI Global Union. 2017. Top 10 Principles for Ethical AI. Switzerland: UNI Global Union.
  39. van Est, R., and J. Gerritsen. 2017. Human rights in the robot age: Challenges arising from the use of robotics, AI, and virtual and augmented reality. The Netherlands: Rathenau Instituut.
  40. Villani, C. 2018. For a meaningful artificial intelligence: Towards a French and European strategy. France: AI for Humanity.
  41. Wallach, W., and G. E. Marchant 2018. An agile ethical/legal model for the international and national governance of AI and robotics. Aies Conference on Artificial Intelligence, Ethics and Society, New Orleans, USA.
  42. West, S. M., M. Whittaker, and K. Crawford. 2019. Discriminating systems: Gender, race and power in AI. AI Now Institute.
  43. Whittaker, M., Crawford K, Dobbe R, Fried G, Kaziunas E, Mathur V, West SM, Richardson R, Schultz J, Schwartz O et al. 2018. AI now report 2018. New York: AI Now Institute.
  44. World Economic Forum. 2018. How to Prevent Discriminatory Outcomes in Machine Learning. In World Economic Forum Global Future Council on Human Rights 2016-18, REF, 120318–case 00040065 . Switzerland.

Cited by

See all 139

Metadata

Authors
Cachat-Rosset, G., & Klarsfeld, A.
Affiliations
  • Department of Management, Faculty of Business Administration, Université Laval, Québec, QC, Canada
  • Head of Laboratory Work, employment and Health, Toulouse Business School Toulouse, Toulouse, France
Venue
Applied Artificial Intelligence
Published
2023-02-22
Volume
37
Issue
1
ISSN
  • 0883-9514 (ISSN-L)
  • 1087-6545
OpenAlex
W4321494006
Cited by
138
References
58
Citations by year
2026: 32 · 2025: 64 · 2024: 33 · 2023: 9
FWCI
34.61
Type
journal article
Language
en
Open access
Locations
  • Applied Artificial Intelligence (publishedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
Keywords
diversity, equity, and inclusion, algorithmic discrimination, responsible AI, compliance approach

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Diversity, Equity, and Inclusion in Artificial Intelligence: An Evaluation of Guidelines. https://app.cochat.ai/papers/10.1080/08839514.2023.2176618
The paper
Cachat-Rosset, G., & Klarsfeld, A. (2023). Diversity, Equity, and Inclusion in Artificial Intelligence: An Evaluation of Guidelines. Applied Artificial Intelligence. https://doi.org/10.1080/08839514.2023.2176618

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.