Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Open accessThe DOI matches its Crossref record; 205 of the 209 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms — representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms — and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
From Helpful, harmless, honest? Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback (2025) · cites this paper as Shelby et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The rapid pace of adoption of GenAI tools, when it comes to similar concerns, have significantly exacerbated the many socio-technical issues researchers have connected to education technologies in general [160, 311] and algorithmic harms related to GenAI [317] more specifically.”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [317]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent work has expressed concern around anthropomorphism leading to over-trust [1, 91], a potential path for uncertainty expression to backfire.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [91]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Our approach followed prior scoping reviews in HCI literature [74, 223], in alignment with the extension of the PRISMA checklist [133], the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [220].”
MethodScoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 5×
“We employed a descriptive-analytical method for charting data – a process of “synthesizing and interpreting qualitative data by sifting, charting and sorting material according to key issues and themes" [11, p. 26].”
BackgroundMethodInfluentialBlack Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 2×
“Thus, relying on scoping reviews’ iterative characteristic [168], we used theoretical saturation as a signal to stop sourcing new papers.”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“systems make incorrect health inferences [158].”
Background
Research works printed but not linked: 40
- 10.1093/cybsec · doi:10.1093/cybsec
- 10.18653/v1 · DOI
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. In Ethics of Data and Analytics. Auerbach Publications, Boca Raton, FL, USA, 254–264.
- Jane Bailey, Jacquelyn Burkell, Suzie Dunn, Chandell Gosse, and Valerie Steeves. 2021. AI and Technology-Facilitated Violence and Abuse. In Artificial Intelligence and the Law in Canada, Florian Martin-Bariteau and Teresa Scassa (Eds.). LexisNexis, Toronto, Canada, Chapter 10, 1–15.
- Jane Bailey, Nicola Henry, and Asher Flynn. 2021. Technology-Facilitated Violence and Abuse: International Perspectives and Experiences. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse, Bailey Jane, Flynn Asher, and Henry Nicola (Eds.). Emerald Publishing Limited, Bingley, UK, 1–17.
- 10.18653/v1 · DOI
- Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The Problem with Bias: Allocative Versus Representational Harms in Machine Learning. In 9th Annual Conference of the Special Interest Group for Computing, Information and Society. Society for the History of Technology, Philadelphia, PA, USA.
- Samy Bengio Alina Beygelzimer Kate Crawford Jeanne Fromer Iason Gabriel Amanda Levendowski Deborah Raji and Marc’Aurelio Ranzato. 2022. Provisional Draft of the NeurIPS Code of Ethics. https://openreview.net/pdf?id=zVoy8kAFKPr
- 10.1177/205630511667248 · doi:10.1177/205630511667248
- 10.18653/v1 · DOI
- 10.5555/380681 · doi:10.5555/380681
- Virginia Braun and Victoria Clarke. 2021. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative research in psychology 18, 3 (2021), 328–352.
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. https://proceedings.mlr.press/v81/buolamwini18a.html
- Jacquelyn Burkell and Jane Bailey. 2018. Unlawful Distinctions? Canadian Human Rights Law and Algorithmic Bias. Vol. 2016/2018. Human Rights Research and Education Centre Ottawa, Ottawa, Canada, 217–230.
- Kate Crawford. 2017. Keynote: The Trouble with Bias. 2017 Conference on Neural Information Processing Systems, invited speaker.
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Boston, MA, USA.
- Batya Friedman and David G Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Boston, MA, USA.
- Steve Fuller. 1993. Helen E. Longino Science As Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton: Princeton University Press (1990), xi+ 262 pp., 19.95. Philosophy of Science 60, 2 (1993), 360–362.
- Jan Hadja. 1961. Alienation and Integration of Student Intellectualss. American Sociological Review 26, 5 (1961), 19.
- 10.1177/104973231666534 · doi:10.1177/104973231666534
- 10.1177/146144482095872 · doi:10.1177/146144482095872
- Shawn Janzen, Caroline Orr, and Sara-Jayne Terp. 2022. Cognitive Security and Resilience: A Social Ecological Model of Disinformation and Other Harms with Applications to COVID-19 Vaccine Information Behaviors. In 2nd Workshop Reducing Online Misinformation through Credible Information Retrieval. ROMCIR 2022, Stavanger, Norway, 48–88.
- Jared Katzman, Solon Barocas, Su Lin Blodgett, Kristen Laird, Morgan Klaus Scheuerman, and Hanna Wallach. 2021. Representational Harms in Image Tagging. Beyond Fair Computer Vision Workshop at CVPR 2021 (2021).
- Hank Liao, Golan Pundak, Olivier Siohan, Melissa Carroll, Noah Coccaro, Qi-Ming Jiang, Tara N Sainath, Andrew Senior, Françoise Beaufays, and Michiel Bacchiani. 2015. Large Vocabulary Automatic Speech Recognition for Children. In Interspeech 2015. International Speech Communication Association, Dresden, Germany, 1–5.
- 10.1093/ojls · doi:10.1093/ojls
- Emanuel Moss and Jacob Metcalf. 2020. Ethics Owners: A New Model of Organizational Responsibility in Data-Driven Technology Companies. https://datasociety.net/wp-content/uploads/2020/09/Ethics-Owners_20200923-DataSociety.pdf
- Emmanuel Moss and Jacob Metcalf. 2022. Data and Society Workshop: The Social Life of Algorithmic Harms. (March 2022).
- Aik Kwang Ng, David YF Ho, Shyh Shin Wong, and Ian Smith. 2003. In Search of the Good Life: A Cultural Odyssey in the East and West. Genetic, Social, and General Psychology Monographs 129, 4 (2003), 317.
- Safiya Umoja Noble. 2016. A Future for Intersectional Black Feminist Technology Studies. Scholar & Feminist Online 13, 3 (2016), 1–8.
- Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books, New York, NY, USA.
- Eva PenzeyMoog and Danielle C Slakoff. 2021. As Technology Evolves, So Does Domestic Violence: Modern-Day Tech Abuse and Possible Solutions. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse. Emerald Publishing Limited, Bingley, UK, 643–662.
- Jasbir K Puar. 2020. “I Would Rather be a Cyborg than a Boddess”: Becoming Intersectional in Assemblage Theory. In Feminist Theory Reader. Routledge, New York, NY, USA, 405–415.
- Henrik Skaug Sætra. 2021. Artificial Intelligence and its Contexts. Springer, Cham, Switzerland, Chapter A Typology of AI Applications in Politics, 27–43.
- Katie Shilton. 2015. "That’s Not An Architecture Problem!": Techniques and Challenges for Practicing Anticipatory Technology Ethics. In iConference 2015 Proceedings. iSchools Urbana-Champaign Illinois USA 1–7.
- Rebecca Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission. Yale Journal of Law & Tech. 23 (2020), 1.
- 10.1177/0002716222108470 · doi:10.1177/0002716222108470
- 10.18653/v1 · DOI
- Thi Tran, Rohit Valecha, Paul Rad, and H Raghav Rao. 2019. An Investigation of Misinformation Harms Related to Social Media During Humanitarian Crises. In International Conference on Secure Knowledge Management in Artificial Intelligence Era. Springer, Goa, India, 167–181.
- Zeynep Tufekci. 2015. Algorithmic Harms Beyond Facebook and Google: Emergent Challenges of Computational Agency. Colo. Tech. LJ 13 (2015), 203.
- Claire Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policymaking.
Cited by
Items 101–200 of 625
Ten simple rules for using large language models in science, version 1.0
Smith, G. R., Bello, C., Bialic-Murphy, L., Clark, E., Delavaux, C. S., Fournier de Lauriere, C., van den Hoogen, J., Lauber, T., Ma, H., Maynard, D. S., et al. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011767 · Cited by 25
“Because LLM use can lead not only to benefit but also to harm [13], researchers who would like to use one for their project should also first outline relevant risks [14].”
BackgroundDesigning for Harm Reduction: Communication Repair for Multicultural Users' Voice Interactions
Wenzel, K., & Kaufman, G. F. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642900 · Cited by 34
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development
Saxena, D., Jung, J.-Y., Forlizzi, J., Holstein, K., & Zimmerman, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714098 · Cited by 34
Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities
Cattell, S., Ghosh, A., & Kaffee, L.-A. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31635 · Cited by 34
“In the realm of machine learning ethics, several independent efforts have emerged to develop a classification system for potential harms caused by ML models (Weidinger et al. 2022; Shelby et al. 2023; Newman 2023; Graziani et al. 2023).”
Future Shock: Generative AI and the International AI Policy and Governance Crisis
Leslie, D., & Perini, A. M. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.88b4cc98 · Cited by 33
Generative AI in Creative Practice: ML-Artist Folk Theories of T2I Use, Harm, and Harm-Reduction
Shelby, R., Rismani, S., & Rostamzadeh, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642461 · Cited by 33
“Important work in this feld has focused on potential harms from ML systems, particularly computational harms arising from choices made in ML pipelines [105].”
BackgroundSelf-citationAcceptable Use Policies for Foundation Models
Klyman, K. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31677 · Cited by 35
How Deep Is Representational Bias in LLMs? The Cases of Caste and Religion
Seth, A., Choudhury, M., Sitaram, S., Toyama, K., Vashistha, A., & Bali, K. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36718 · Cited by 34
GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Construction
Felkner, V. K., Thompson, J., & May, J. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.760 · Cited by 32
Seger, E., Dreksler, N., Moulange, R., Dardaman, E., Schuett, J., Wei, K., Winter, C., Arnold, M., Ó hÉigeartaigh, S., Korinek, A., et al. (2023) · doi:10.2139/ssrn.4596436 · Cited by 31
“Other current and ongoing harms posed by foundation models include, but are not limited to, bias, discrimination, representational harms, hate speech and online abuse, and privacy-invading information hazards [17, 38–40].”
BackgroundUnderstanding Socio-technical Factors Configuring AI Non-Use in UX Work Practices
Cha, I., & Wong, R. Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713140 · Cited by 31
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
Prabhakaran, V., Homan, C. M., Aroyo, L. M., Davani, A. M., Parrish, A., Taylor, A. S., Díaz, M., Wang, D., & Serapio‐García, G. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.190 · Cited by 31
“Recent advancements in conversational AI also increased attention to ensure safety and mitigate potential harms (e.g., Solaiman and Dennison, 2021; Xu et al., 2021; Shelby et al., 2022; Si et al., 2022; Bian et al., 2023; Huang et al., 2023; Santurkar et al., 2023).”
BackgroundCharacterizing and modeling harms from interactions with design patterns in AI interfacesPreprint
Ibrahim, L., Rocher, L., & Valdivia, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.11370 · Cited by 32
Intersectional biases in narratives produced by open-ended prompting of generative language models
Shieh, E., Vassel, F.-M., Sugimoto, C. R., & Monroe‐White, T. (2026) · Nature Communications · doi:10.1038/s41467-025-68004-9 · Cited by 32
“Speci fi cally, this study extends existing algorithmic bias frameworks characterizing representationalharms 41,58,64 to include an investigation of what we term Laissez-Faire harms (de fi ned as let people do as they choose) where (1) the LMs freely respond to open-ended prompts, (2) prompts…”
Rejected Dialects: Biases Against African American Language in Reward Models
Mire, J., Aysola, Z. T., Chechelnitsky, D., Deas, N., Zerva, C., & Sap, M. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.417 · Cited by 30
From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguards
Chehbouni, K., Roshan, M., Ma, E., Wei, F. A., Taïk, A., Cheung, J. C. K., & Farnadi, G. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.927 · Cited by 30
Stop treating `AGI' as the north-star goal of AI researchPreprint
Blili-Hamelin, B., Graziul, C., Hancox-Li, L., Hazan, H., El-Mhamdi, E.-M., Ghosh, A., Heller, K., Metcalf, J., Murai, F., Salvaggio, E., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.03689 · Cited by 30
“We now provide three recommendations for avoiding these traps.”
Self-citationMoving Towards Epistemic Autonomy: A Paradigm Shift for Centering Participant Knowledge
Ajmani, L., Bhatt, T., & DeVito, M. A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714252 · Cited by 30
“The drive to quantify and the related drive to force all knowledge through the lens of positivism are both engines of the very epistemic injustice we must fight.”
The Psychosocial Impacts of Generative AI Harms
Vassel, F.-M., Shieh, E., Sugimoto, C. R., & Monroe‐White, T. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31251 · Cited by 29
“Representational harms that emerge in generative AI sys-tem outputs are commonly described as socially constructed biased beliefs that portray certain social identities negatively, which in turn can impact societal views about those social groups (Dev et al. 2021; Shelby et al. 2023).”
BackgroundInfluentialUnsocial Intelligence: An Investigation of the Assumptions of AGI Discourse
Blili-Hamelin, B., Hancox-Li, L., & Smart, A. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31625 · Cited by 31
“The importance of a contextual understanding of sociotechnical systems is well-recognized [83, 99, 103, 123, 124, 138].”
Self-citationHarm Amplification in Text-to-Image ModelsPreprint
Hao, S., Shelby, R. M., Liu, Y., Srinivasan, H., Bhutani, M., Ayan, B. K., Poplin, R., Poddar, S., & Laszlo, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.01787 · Cited by 29
Self-citationIn-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AIPreprint
Longpre, S., Klyman, K., Appel, R. E., Kapoor, S., Bommasani, R., Sahar, M., McGregor, S., Ghosh, A., Blili-Hamelin, B., Butters, N., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.16861 · Cited by 29
“For instance, Weidinger et al. (2023) and Shelby et al. (2023) categorize harms such as bias, misinformation, and fairness concerns, which are difficult to quantify but crucial to address.”
Understanding and Mitigating Risks of Generative AI in Financial Services
Gehrmann, S., Huang, X., Teng, X., Yurovski, S., Bhorkar, A., Thomas, N., Doucette, J. A., Rosenberg, D. S., Dredze, M. H., & Rabinowitz, D. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732168 · Cited by 28
“Communal Risk We can also view risk from the perspective of broader communities ( e.g. , society as a whole or a specific industry) [ e.g. , 10, 68, 71].”
ACM TechBrief: Generative Artificial Intelligence
Leslie, D., & Rossi, F. (2023) · ACM eBooks · doi:10.1145/3626110 · Cited by 28
Alberts, L., Keeling, G., & McCroskery, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.09082 · Cited by 28
“Anticipated risks surrounding LLM agent behaviour have mainly been on the level of semantics, such as avoiding “toxic”, biased, misleading, or inaccurate language (Wei-dinger et al. 2022; Shelby et al. 2023; Pan et al. 2023).”
BackgroundInfluentialThe Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment
Johnson, N., Moharana, S., Harrington, C., Andalibi, N., Heidari, H., & Eslami, M. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658910 · Cited by 28
“This approach involved consulting a diverse group of resources, detailed further below: • Initial dataset : We began with an initial set of cases that the authors were familiar with from research articles and reading lists focused on resisting and refusing algorithmic harm [35, 52, 150, 151, 185].”
BackgroundMethodInfluentialBiomedical Natural Language Processing in the Era of Large Language Models
Usuyama, N., Wong, C., Zhang, S., Naumann, T., & Poon, H. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095406 · Cited by 27
WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AI
Deng, W. H., Claire, W., Han, H. Z., Hong, J., Holstein, K., & Eslami, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757702 · Cited by 28
“The third prototype was a T2I harm taxonomy, mapping Shelby et al.’s sociotechnical AI harm taxonomy [107] to concrete examples of harmful T2I behaviors, based on examples from [69].”
Beyond the ML Model: Applying Safety Engineering Frameworks to Text-to-Image Development
Rismani, S., Shelby, R. M., Smart, A., Santos, R. D., Moon, A., & Rostamzadeh, N. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604685 · Cited by 27
“, sociotechnical harms) [73] and technical systems (i.”
BackgroundInfluentialSelf-citationBuilding Stereotype Repositories with Complementary Approaches for Scale and Depth
Dev, S., Jha, A., Goyal, J., Tewari, D., Dave, S., & Prabhakaran, V. (2023) · Workshop on Cross-Cultural Considerations in NLP (C3NLP) · doi:10.18653/v1/2023.c3nlp-1.9 · Cited by 27
Discipline and Label: A WEIRD Genealogy and Social Theory of Data AnnotationPreprint
Smart, A., Wang, D., Monk, E. P., Díaz, M., Kasirzadeh, A., van Liemt, E., & Schmer-Galunder, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.06811 · Cited by 27
Self-citationLi, M., Bickersteth, W., Tang, N., Cranor, L. F., Hong, J., Shen, H., & Heidari, H. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i2.36655 · Cited by 26
“Previous taxonomies of AI and Generative AI harms have identified, categorized, and suggested the implications of a wide range of harms [2, 4, 5, 15, 29, 31, 42, 55, 63–65, 73, 75, 77].”
Haimson, O. L., Mayworm, S. R., Ingber, A. S., & Andalibi, N. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732081 · Cited by 25
Matthews, T. L., Bursztein, E., Kelley, P. G., Kissner, L., Kramm, A., Oplinger, A., Schou, A., Sleeper, M., Somogyi, S., Szostak, D., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3716382 · Cited by 25
“…tech-facilitated attack (e.g., one framework classified online harm into physical, emotional, relational, and financial harm [88]; a taxonomy of sociotechnical harms of algorithmic systems discussed harms that were representational, allocative, quality of service, interpersonal, and societal [90]).”
Decoding Real-World Artificial Intelligence Incidents
Velázquez, J. D. M., Šćepanović, S., Gvirtz, A., & Quercia, D. (2024) · Computer · doi:10.1109/mc.2024.3432492 · Cited by 25
“2 While some investigations distinguish among individual, collective, societal, or biospheric harms, 9,10 others suggest standardized criteria in line with the European Union (EU) AI Act, distinguishing between an “AI subject” and “AI user.””
BackgroundIntolerable Risk Threshold Recommendations for Artificial IntelligencePreprint
Raman, D., Madkour, N., Murphy, E. R., Jackson, K., & Newman, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.05812 · Cited by 25
The Role of Inclusion, Control, and Ownership in Workplace AI-Mediated Communication
Kadoma, K., Aubin Le Quere, M., Fu, X. J., Munsch, C., Metaxa, D., & Naaman, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642650 · Cited by 24
“Feelings of inclusion, control, and ownership are core to the human experience [31].”
BackgroundMethodInfluentialWhat is AI safety? What do we want it to be?
Harding, J., & Kirk‐Giannini, C. D. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02367-z · Cited by 25
Terms-we-serve-with: Five dimensions for anticipating and repairing algorithmic harm
Rakova, B., Shelby, R. M., & Ma, M. (2023) · Big Data & Society · doi:10.1177/20539517231211553 · Cited by 24
“Harms from algorithmic systems arise from the complex interplay between technical system components and intersecting social power dynamics (Shelby et al., 2023; Young et al., 2019); thus, communities who already face systemic and structural forms of inequality disproportionately experience…”
BackgroundInfluentialSelf-citationLessons for Editors of AI Incidents from the AI Incident Database
Paeth, K., Atherton, D., Pittaras, N., Frase, H., & McGregor, S. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i28.35163 · Cited by 23
Deng, W. H., Barocas, S., & Vaughan, J. W. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711076 · Cited by 23
“…template scaffolding content, we also drew inspiration from artifacts in value sensitive design [6, 51, 95, 120, 154, 158], tools and guidelines for conducting responsible computing research [2, 19, 65, 68, 127], as well as survey papers discussing the taxonomy of socio-technical harms [119, 147].”
Beyond Behaviorist Representational Harms: A Plan for Measurement and Mitigation
Chien, J., & Danks, D. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658946 · Cited by 22
“…48, 65, 111, 115] Image Search, Image Tagging Discrimination/Incite (and Normalize) Hate/Violence [7, 48, 115, 128] LLMs Outsider Gaze [13, 23, 87] Generative AI, Story Generation Hierarchies & Marginalization [23, 111, 115] Image Tagging, Story Generation implementation, supported by a case study.”
BackgroundMethodInfluentialKirk, H. R., Vidgen, B., Röttger, P., & Hale, S. A. (2023) · arXiv · doi:10.48550/arxiv.2303.05453 · Cited by 22
“The burden of increased Effort aligns with Shelby et al. [203]’s quality of service harms from the increased labour and effort to make technologies work as intended.”
BackgroundMethodInfluentialAI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies
Zeng, Y., Klyman, K., Zhou, A., Yu, Y., Pan, M., Jia, R., Song, D., Liang, P., & Li, B. (2024) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v1i1.10603 · Cited by 22
Calderón, R., & Herrera, F. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04650-0 · Cited by 23
“Sustainability George & George, 2023; Holzapfel et al., 2022; Holzapfel et al., 2022; Gill & Kaur, 2023; Holzapfel et al., 2022; Barnett, 2023; Mannuru et al., 2023; Sastry et al. 2024; Shelby et al., 2023.”
A Framework for Auditing Chatbots for Dialect-Based Quality-of-Service Harms
Harvey, E., Kizilcec, R. F., & Koenecke, A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732137 · Cited by 22
Abbas, F., Chesterman, S. A., & Taeihagh, A. (2025) · AI & Society · doi:10.1007/s00146-025-02698-9 · Cited by 22
Building, Shifting, & Employing Power: A Taxonomy of Responses From Below to Algorithmic Harm
DeVrio, A., Eslami, M., & Holstein, K. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658958 · Cited by 21
Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and Harms
Rismani, S., Shelby, R. M., Davis, L., Rostamzadeh, N., & Moon, A. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36706 · Cited by 21
“(Shelby 2023, p. 731) All measures in this category relate to information loss or environmental harms; none reflect the harm sub-types of cultural, socio-economic, and political/civic harm.”
InfluentialSelf-citation‘Frontier AI,’ Power, and the Public Interest: Who Benefits, Who Decides?
Leslie, D., Ashurst, C., Menéndez, N., Griffiths, F. E., Jayadeva, S., Jorgensen, M., Katell, M. A., Krishna, S., Kwiatkowski, D., Martins, C. I., et al. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.4a42495c · Cited by 21
Gausen, A., Mitra, B., & Lindley, S. E. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658900 · Cited by 21
Investigating What Factors Influence Users’ Rating of Harmful Algorithmic Bias and Discrimination
Kingsley, S., Zhi, J., Deng, W. H., Lee, J. E., Zhang, S. Q., Eslami, M., Holstein, K., Hong, J., Li, T., & Shen, H. (2024) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v12i1.31602 · Cited by 21
Contextual Confidence and Generative AIPreprint
Jain, S., Hitzig, Z., & Mishkin, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.01193 · Cited by 21
Taxonomy of User Needs and ActionsPreprint
Shelby, R. M., Díaz, F., & Prabhakaran, V. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.06124 · Cited by 21
Self-citationWeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AIPreprint
Deng, W. H., Wang, C., Han, H. Z., Hong, J., Holstein, K., & Eslami, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.01397 · Cited by 20
“The third prototype was a T2I harm taxonomy, mapping Shelby et al.’s sociotechnical AI harm taxonomy [107] to concrete examples of harmful T2I behaviors, based on examples from [69].”
Beyond principles: Embedding ethical AI risks in public sector risk management practice
Sattlegger, A., & Bharosa, N. (2024) · Annual International Conference on Digital Government Research · doi:10.1145/3657054.3657063 · Cited by 21
“This ”selection, reduction, and categorization” of social realities encodes, reinforces, and amplifies systematic inequalities in AI systems [43].”
BackgroundInfluentialAlgorithmic bias: sexualized violence against women in GPT-3 models
Wyer, S., & Black, S. (2025) · AI and Ethics · doi:10.1007/s43681-024-00641-0 · Cited by 19
Materiality and risk in the age of pervasive AI sensors
Sloane, M., Moss, E., Kennedy, S., Stewart, M. P., Warden, P., Plancher, B., & Reddi, V. J. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01017-7 · Cited by 19
“1 This work has focused crucial attention on how datasets, algorithms, and machine learning systems deployed at scale produce significant impacts for human rights, equity, already-disadvantaged populations and communities, and society at large [11, 16, 42, 72, 81, 95, 97, 99, 115].”
Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators
Jo, W., Wesołowska, M., & Wojcieszak, M. (2026) · Computational Communication Research · doi:10.5117/ccr2026.4.7.jo · Cited by 19
Cross-Reality Re-Rendering: Manipulating between Digital and Physical RealitiesPreprint
Datta, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.08005 · Cited by 19
Alderman, J. E., Palmer, J., Laws, E., McCradden, M. D., Ordish, J., Ghassemi, M., Pfohl, S. R., Rostamzadeh, N., Cole-Lewis, H. J., Glocker, B., et al. (2024) · NEJM AI · doi:10.1056/aip2401088 · Cited by 19
Self-citationA structured regression approach for evaluating model performance across intersectional subgroups
Herlihy, C. P., Truong, K., Chouldechova, A., & Dudík, M. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658908 · Cited by 18
Barnett, J., Kieslich, K., & Diakopoulos, N. A. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31620 · Cited by 19
Building Solidarity Amid Hostility: Experiences of Fat People in Online Communities
Payne, B. H., Taylor, J., Spiel, K., & Fiesler, C. L. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3701186 · Cited by 19
Hadan, H., Mogavi, R. H., Zhang-Kennedy, L., & Nacke, L. E. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2549073 · Cited by 17
“…compared to studies that either did not address AI incidents within the lifecycle (e.g., Zeng et al., 2024), only distinguished pre-and post-deployment incidents (e.g., Slattery et al., 2024; Yampolskiy, 2016), or ignored the contextual factors (e.g., Shelby et al., 2023; Zeng et al., 2024).”
InfluentialTALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories
Bhagat, K., Bhatt, S., Velagapudi, A., Vashistha, A., Dave, S., & Pruthi, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790519 · Cited by 17
What Is a Subliminal Technique? An Ethical Perspective on AI-Driven Influence
Bermúdez, J. P., Nyrup, R., Deterding, S., Moradbakhti, L., Mougenot, C., You, F., & Calvo, R. A. (2023) · IEEE International Symposium on Ethics in Engineering, Science, and Technology (ETHICS) · doi:10.1109/ethics57328.2023.10155039 · Cited by 18
Misinformation, Fraud, and Stereotyping: Towards a Typology of Harm Caused by Deepfakes
Trifonova, P., & Venkatagiri, S. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3685938 · Cited by 17
“To define harm from generative AI, we reviewed relevant background literature [e.g., 4, 9, 20, 35, 37, 39].”
RAD: A Framework to Support Youth in Critiquing AI
Solyst, J., Amspoker, E., Yang, E., Eslami, M., Hammer, J., & Ogan, A. (2025) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3641554.3701966 · Cited by 17
“To illustrate this, we covered examples of two types of representational bias in image-based AI: Stereotyping (certain people represented in a specific way or associated with a specific characteristic) and Erasure (certain people not represented) [29].”
Decent Work, Decent Lives, and Healthy Lives for Sustainable Development
Silla, J. M. P., Steinebach, C., Thompson, L. F., Nuovo, S. D., Carrus, G., Gutiérrez, G., & Fabio, A. D. (2025) · Australian Journal of Career Development · doi:10.1177/10384162251374443 · Cited by 17
“The threats regarding the behavior of LLM agents are primarily at the semantic level: inferring inaccurate, biased, misleading, sometimes “ toxic ” , modalities from human language (Pan et al., 2023; Shelby et al., 2023; Weidinger et al., 2022).”
Sound Check: Auditing Recent Audio Dataset Practices
Agnew, W. S., Barnett, J., Chu, A., Hong, R. S., Feffer, M., Netzorg, R., Jiang, H. H., Awumey, E., & Das, S. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36528 · Cited by 17
“Shelby et al. (2023) highlight the sociotechnical nature of AI harms and emphasize that harms cannot exist independent of societal norms and structures—they have to exist in a set of systems.”
Gautam, S., Chandra, M., De, A., Chakravorti, T., Malik, G., & Choudhury, M. D. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i2.36611 · Cited by 17
Harm Mitigation in Recommender Systems under User Preference Dynamics
Chee, J., Kalyanaraman, S., Ernala, S. K., Weinsberg, U., Dean, S., & Ioannidis, S. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671925 · Cited by 16
Gebru, T., & Denton, E. (2024) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000102 · Cited by 16
"What is Safety?": Building Bridges Across Approaches to Digital Risks and Harms
Walker, A. M., DeVito, M. A., Badillo-Urquiola, K. A., Bellini, R. F., Chancellor, S., Feuston, J. L., Henne, K., Kelley, P. G., Rismani, S., Shelby, R. M., et al. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3681824 · Cited by 16
Self-citationAgentic Artificial Intelligence: Legal and Ethical Challenges of Autonomous Systems
Bowen, G. L. (2025) · Journal of Digital Technologies and Law · doi:10.21202/jdtl.2025.17 · Cited by 15
Malmio, I. (2024) · Discover Sustainability · doi:10.1007/s43621-024-00677-6 · Cited by 16
“Shelby et al. [112] use the term “sociotechnical harms” to address these issues, described as “harms from algorithmic systems that occur through the interplay of technical system components and societal power dynamics” [112].”
Tseng, E., Ristenpart, T., & Dell, N. L. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711035 · Cited by 15
“Researchers across CSCW and HCI are increasingly concerned with digital technologies’ role in individual and structural harms [72], like hate and harassment [78], racism [31, 54], gender-based violence [83], crisis and migration [56, 68].”
Misabstraction in Sociotechnical Systems
de Troya, Í. M. D. R., Kernahan, J., Doorn, N., Dignum, V., & Dobbe, R. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732122 · Cited by 15
Magaña, M. I., & Shilton, K. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732148 · Cited by 15
“In addition, the potential for AI systems to inflict harm, particularly discriminatory impacts, is well-documented [10, 20, 28, 55].”
Toward a Taxonomy of Algorithmic Harms for Disability: A Systematic Review
Wang, L., Kameswaran, V., & Kacorri, H. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36745 · Cited by 16
“Each harm scenario was tagged with all applicable categories for which it quali � ed and could potentially be implicated in, as de � ned in the taxonomy by Shelby et al [114].”
InfluentialGenerative AI and Perceptual Harms: Who's Suspected of using LLMs?
Kadoma, K., Metaxa, D., & Naaman, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713897 · Cited by 14
“Similarly in image generation, text-to-image models can produce stereotypical images or fail to recognize particular identities [22, 24, 66].”
InfluentialBeyond the Safety Bundle: Auditing the Helpful and Harmless Dataset
Chehbouni, K., Carr, J. C., More, Y., Cheung, J. C., & Farnadi, G. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.596 · Cited by 14
Detecting Linguistic Indicators for Stereotype Assessment with Large Language Models
Görge, R., Mock, M., & Allende‐Cid, H. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732181 · Cited by 14
“This perpetuation of stereotypes and its potential harmful impact on society and individuals is a significant concern regarding AI [27].”
Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection
Jung, J.-Y., Saxena, D., Park, M., Kim, J., Forlizzi, J., Holstein, K., & Zimmerman, J. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735745 · Cited by 14
ConflictLens: LLM-Based Conflict Resolution Training in Romantic Relationship
Chun, J., Zhang, G., & Xia, M. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746058.3758422 · Cited by 14
“Future deployments should ensure mutual consent and apply safeguards such as on-device redaction, guided by value-sensitive design [6, 16, 17].”
Tang, N., Zhang, A. Q., Wang, Q., Howe, E. S., Bullwinkel, B., Pedrelli, P., Suh, J., Heidari, H., & Shen, H. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806723 · Cited by 15
“Recent scholarship has therefore argued for broader, context-sensitive accounts of alignment that attend to social and institutional dynamics [33, 38, 57, 59, 72].”
Perreault, B., Lee, J., Shava, R., & Mustafaraj, E. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658916 · Cited by 14
“Moreover, Robertson et al. [31] find that user choice plays a larger role in engagement with partisan or unreliable news than algorithmic curation, further evidence against the idea of partisan filter bubbles.”
BackgroundCortiñas-Lorenzo, K., Lindley, S. E., Larsen-Ledet, I., & Mitra, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.09410 · Cited by 14
“Extracting and surfacing algorithmic representations of people and their work, whether implicitly or explicitly, raises multiple ethical concerns [97], as they can potentially lead to representational, allocative, quality of service and/or interpersonal harms [144].”
MiTTenS: A Dataset for Evaluating Gender Mistranslation
Robinson, K., Kudugunta, S., Stella, R., Dev, S., & Bastings, J. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.238 · Cited by 13
“…we note that this work focuses on only a subset of potential risks (Weidinger et al., 2021), and that our evaluations focus on model outputs without considering the wider sociotechnical context in which translation systems and foundation models exist (Weidinger et al., 2023; Shelby et al., 2023).”
BackgroundSobey, A. (2025) · AI and Ethics · doi:10.1007/s43681-025-00684-x · Cited by 14
“Both forms of bias create representational harms, such as stereotyping, reification, and subordination of a group based on identity markers [ 86].”
Baer, A. (2025) · Library trends · doi:10.1353/lib.2025.a961189 · Cited by 15
“Shelby et al. (2023) identify five broad categories of harms, as well as more specific types of harm within those categories: representational (e.g., stereotyping, erasing social groups), allocative (e.g., opportunity loss, economic loss), quality of service (e.g., alienation, service/benefit…”
Impact of Agent-Generated Rationales on Online Social Conformity
de Jong, S., Jacobsen, R. M., Wester, J., Wijenayake, S., Gonçalves, J., & van Berkel, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732217 · Cited by 13
“The polarisation of opinions relates to Representational Harms , while the impact on news accuracy and political culture aligns with Social System Harms , as classified in Shelby et al.’s taxonomy of sociotechnical harms [78].”
Cabitza, F., Campagner, A., Fregosi, C., Cameli, M., Gallazzi, E., Sconfienza, L. M., & Tontini, G. E. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757601 · Cited by 13
A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations
Davani, A. M., Dev, S., Pérez-Urbina, H., & Prabhakaran, V. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1526 · Cited by 13
Designing Incident Reporting Systems for Harms from General-Purpose AI
Wei, K., & Heim, L. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i44.41139 · Cited by 13
“…caused by people, not technical systems—but as GPAI systems become increasingly autonomous (Chan et al. 2023), they may cause new types of rights harms (Dobson et al. 2023; Hoff-man and Frase 2023) or magnify existing rights harms or inequities (Critch and Russell 2023; Shelby et al. 2023).”
Responsible AI measures dataset for ethics evaluation of AI systems
Rismani, S., Davis, L., Mingole, B., Rostamzadeh, N., Shelby, R. M., & Moon, A. (2025) · Scientific Data · doi:10.1038/s41597-025-06021-5 · Cited by 13
“29 : allocative harms, which involve economic or opportunity loss due to decisions assisted by or made by AI systems; representational harms, which reflect the reinforcement of unjust societal hierarchies or stereotypes; quality-of-service harms, which capture disparities in system performance…”
Self-citationNavigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education
Mak, J., Nakatumba-Nabende, J., Clear, T., Clear, A., Abluwi, I., Andrei, O., Angeli, L., MacNeil, S., Oyelere, S. S., Hale Rattigan, M., et al. (2025) · Proceedings of the 2025 Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3760545.3783975 · Cited by 12
“Through this context-based, process-oriented approach [257], we develop each concept related to the ethical and societal impacts of GenAI and its specific function within the resultant framework [271].”
Johnson, N., Silva, E., Leon, H., Eslami, M., Schwanke, B., Dotan, R., & Heidari, H. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732049 · Cited by 12
Algorithmic Impact Assessments at Scale: Practitioners’ Challenges and Needs
Ashar, A., Ginena, K., Cipollone, M., Barreto, R. D. C., & Cramer, H. S. M. (2024) · Journal of Online Trust and Safety · doi:10.54501/jots.v2i4.206 · Cited by 12
“They did, however, most closely resemble the conceptualizations of Crawford (2017) and Shelby et al. (2023), underscoring the importance of organizations not indiscriminately adopting frameworks found in the literature, but examining and contextualizing harms to get a more accurate understanding of…”
Background
Metadata
- Authors
- Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., & Virk, G.
- Affiliations
- Google (United States) (US)
- McGill University (CA)
- Australian National University (AU)
- Google, USA
- ORCID
- Venue
- Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2023-08-08
- Pages
- 723-741
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4386249234
- Cited by
- 279
- References
- 191
- Citations by year
- 2026: 97 · 2025: 101 · 2024: 65 · 2023: 15
- FWCI
- 69.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic harms, harm reduction, algorithmic systems, representational harm, interpersonal harm, social harm, sociocultural dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.