CoChat
Sign Up
PreprintCited by 9Ethics and Social Impacts of AIDigitalization, Law, and RegulationExplainable Artificial Intelligence (XAI)

A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms

Open access
Abercrombie, Gavin, Benbouzid, Djalel, Giudici, Paolo, Golpayegani, Delaram, Hernandez, Julio, Noro, Pierre, Pandit, Harshvardhan, Paraschou, Eva +8 more·2024·arXiv
DOI 10.48550/arxiv.2407.01294arXiv 2407.01294
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper introduces a collaborative, human-centred taxonomy of AI, algorithmic and automation harms. We argue that existing taxonomies, while valuable, can be narrow, unclear, typically cater to practitioners and government, and often overlook the needs of the wider public. Drawing on existing taxonomies and a large repository of documented incidents, we propose a taxonomy that is clear and understandable to a broad set of audiences, as well as being flexible, extensible, and interoperable. Through iterative refinement with topic experts and crowdsourced annotation testing, we propose a taxonomy that can serve as a powerful tool for civil society organisations, educators, policymakers, product teams and the general public. By fostering a greater understanding of the real-world harms of AI and related technologies, we aim to increase understanding, empower NGOs and individuals to identify and report violations, inform policy discussions, and encourage responsible technology development and deployment.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2407.01294

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Taxonomies based on incident databases and media reports capture risks that have already occurred and were visible enough to be recorded, and are therefore less suited to identifying risks that develop gradually or have not yet produced visible harms.

    “Third, taxonomies based on incident databases and media reports (Abercrombie et al. 2024;Turri and Dzombak 2023;Paeth et al. 2025) capture risks that have already occurred and were visible enough to be recorded.They are therefore less suited to identifying risks that develop gradually or have not yet produced visible harms, such as the erosion of professional skills caused by prolonged reliance on”

    From Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents (2026) · cites this paper as Abercrombie et al. 2024

    Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

  • Most AI risk taxonomies were developed for generic AI or generative AI, rather than for AI agents, which can act more autonomously.

    “Second, most taxonomies were developed for generic AI (Abercrombie et al. 2024) or generative AI (Li et al. 2025b), rather than for AI agents, which can act more autonomously.”

    From Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents (2026) · cites this paper as Abercrombie et al. 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 22

  1. Mohamed Abdalla and Moustafa Abdalla. 2021. The Grey Hoodie Project: Big Tobacco, Big Tech, and the Threat on Academic Integrity. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society (Virtual Event, USA) (AIES '21). Association for Computing Machinery, New York, NY, USA, 287-297. https://doi.org/10.1145/3461702.3462563 · DOI
  2. Golnoosh Babaei, Paolo Giudici, and Emanuela Raffinetti. 2025. A Rank Graduation Box for SAFE AI. Expert Systems with Applications 259 (Jan. 2025), 125239. https://doi.org/10.1016/j.eswa.2024.125239 · DOI
  3. Yoshua Bengio, Geoffrey Hinton, Andrew Yao, Dawn Song, Pieter Abbeel, Trevor Darrell, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, Shai Shalev-Shwartz, Gillian Hadfield, Jeff Clune, Tegan Maharaj, Frank Hutter, Atılım Güneş Baydin, Sheila McIlraith, Qiqi Gao, Ashwin Acharya, David Krueger, Anca Dragan, Philip Torr, Stuart Russell, Daniel Kahneman, Jan Brauner, and Sören Mindermann. 2024. Managing Extreme AI Risks amid Rapid Progress. Science 384, 6698 (May 2024), 842-845. https://doi.org/10.1126/science.adn0117 · DOI · Paper page
  4. Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2022. On the Opportunities and Risks of Foundation Models. https://doi.org/10.48550/arXiv.2108.07258 arXiv:2108.07258 [cs]. · DOI · Paper page
  5. Dafna Burema, Nicole Debowski-Weimann, Alexander von Janowski, Jil Grabowski, Mihai Maftei, Mattis Jacobs, Patrick van der Smagt, and Djalel Benbouzid. 2023. A Sector-Based Approach to AI Ethics: Understanding Ethical Issues of AI-related Incidents within Their Sectoral Context. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (AIES '23). Association for Computing Machinery, New York, NY, USA, 705-714. https://doi.org/10.1145/3600211.3604680 · DOI
  6. Hilary Bussell and Amanda Larson. 2023. Scaffolding the Open: Transforming an International Studies Course Using Open Pedagogy. Communications in Information Literacy 17, 1 (2023), 279-298.
  7. Andrew Critch and Stuart Russell. 2023. TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI. http://arxiv.org/abs/2306. 06924 arXiv:2306.06924 [cs]. · arXiv
  8. Paolo Giudici and Emanuela Raffinetti. 2023. SAFE Artificial Intelligence in Finance. Finance Research Letters 56 (Sept. 2023), 104088. https://doi.org/10.1016/j.frl.2023.104088 · DOI
  9. Jake Goldenfein and Monique Mann. 2023. Tech money in civil society: whose interests do digital rights organisations represent? Cultural studies (London, England) 37, 1 (2023), 88-122.
  10. Delaram Golpayegani, Joshua Hovsha, Leon W. S. Rossmaier, Rana Saniei, and Jana Mišić. 2022. Towards a Taxonomy of AI Risks in the Health Domain. In 2022 Fourth International Conference on Transdisciplinary AI (TransAI). IEEE, Laguna Hills, CA, USA, 1-8. https://doi.org/10.1109/TransAI54797.2022.00007 · DOI
  11. Delaram Golpayegani, Harshvardhan J. Pandit, and Dave Lewis. 2023. To Be High-Risk, or Not To Be-Semantic Specifications and Implications of the AI Act's High-Risk AI Applications and Harmonised Standards. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT '23). Association for Computing Machinery, New York, NY, USA, 905-915. https://doi.org/10.1145/3593013.3594050 · DOI · Paper page
  12. Kilem L. Gwet. 2014. Handbook of Inter-Rater Reliability, 4th Edition: The Definitive Guide to Measuring The Extent of Agreement Among Raters (4 ed.). Advanced Analytics, LLC, Gaithersburg, MD, USA.
  13. Dan Hendrycks, Mantas Mazeika, and Thomas Woodside. 2023. An Overview of Catastrophic AI Risks. https://doi.org/10.48550/arXiv. 2306.12001 arXiv:2306.12001 · DOI
  14. Wiebke Hutiri, Orestis Papakyriakopoulos, and Alice Xiang. 2024. Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT '24). Association for Computing Machinery, New York, NY, USA, 359-376. https://doi.org/10.1145/3630106.3658911 · DOI
  15. Leonie Koessler and Jonas Schuett. 2023. Risk Assessment at AGI Companies: A Review of Popular Risk Assessment Techniques from Other Safety-Critical Industries. https://doi.org/10.48550/arXiv.2307.08823 arXiv:2307.08823 · DOI
  16. Sean McGregor. 2021. Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. Proceedings of the AAAI Conference on Artificial Intelligence 35, 17 (May 2021), 15458-15463. https://doi.org/10.1609/aaai.v35i17.17817 · DOI · Paper page
  17. OECD. 2023. Stocktaking for the development of an AI incident definition. https://doi.org/10.1787/c323ac71-en · DOI
  18. Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane, and Inioluwa Deborah Raji. 2024. Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling. https://doi.org/10.48550/arXiv.2402.17861 arXiv:2402.17861 · DOI
  19. Inioluwa Deborah Raji, I. Elizabeth Kumar, Aaron Horowitz, and Andrew Selbst. 2022. The Fallacy of AI Functionality. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT '22). Association for Computing Machinery, New York, NY, USA, 959-972. https://doi.org/10.1145/3531146.3533158 · DOI · Paper page
  20. Shalaleh Rismani, Renee Shelby, Andrew Smart, Edgar Jatho, Joshua Kroll, Ajung Moon, and Negar Rostamzadeh. 2023. From Plane Crashes to Algorithmic Harm: Applicability of Safety Engineering Frameworks for Responsible ML. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-18. https://doi.org/10.1145/3544548.3581407 · DOI
  21. Renee Shelby, Shalaleh Rismani, Kathryn Henne, AJung Moon, Negar Rostamzadeh, Paul Nicholas, N'Mah Yilla, Jess Gallegos, Andrew Smart, Emilio Garcia, and Gurleen Virk. 2023. Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction. https://doi.org/10.48550/arXiv.2210.05791 arXiv:2210.05791 [cs]. · DOI
  22. Elham Tabassi. 2023. Artificial Intelligence Risk Management Framework (AI RMF 1.0). https://doi.org/10.6028/NIST.AI.100-1 · DOI · Paper page

Cited by

Sorted by citations

Authors
Abercrombie, G., Benbouzid, D., Giudici, P., Golpayegani, D., Hernandez, J., Noro, P., Pandit, H., Paraschou, E., Pownall, C., Prajapati, J., Sayre, M. A., Sengupta, U., Suriyawongkul, A., Thelot, R., Vei, S., & Waltersdorfer, L.
Affiliations
  • Heriot-Watt University (GB)
  • Volkswagen Group (Germany) (DE)
  • Trinity College Dublin (IE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2407.01294
arXiv
2407.01294
OpenAlex
W4400342064
Cited by
9
References
0
Citations by year
2026: 4 · 2025: 3 · 2024: 2
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by-sa)
  • WU Research (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
AI harms, algorithmic harms, human-centered design, crowdsourced annotation, harms reporting, responsible AI development, civil society organizations, AI policy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review