Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Open accessThe DOI matches its Crossref record; 205 of the 209 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms — representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms — and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
From Helpful, harmless, honest? Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback (2025) · cites this paper as Shelby et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The rapid pace of adoption of GenAI tools, when it comes to similar concerns, have significantly exacerbated the many socio-technical issues researchers have connected to education technologies in general [160, 311] and algorithmic harms related to GenAI [317] more specifically.”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [317]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent work has expressed concern around anthropomorphism leading to over-trust [1, 91], a potential path for uncertainty expression to backfire.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [91]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Our approach followed prior scoping reviews in HCI literature [74, 223], in alignment with the extension of the PRISMA checklist [133], the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [220].”
MethodScoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 5×
“We employed a descriptive-analytical method for charting data – a process of “synthesizing and interpreting qualitative data by sifting, charting and sorting material according to key issues and themes" [11, p. 26].”
BackgroundMethodInfluentialBlack Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 2×
“Thus, relying on scoping reviews’ iterative characteristic [168], we used theoretical saturation as a signal to stop sourcing new papers.”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“systems make incorrect health inferences [158].”
Background
Research works printed but not linked: 40
- 10.1093/cybsec · doi:10.1093/cybsec
- 10.18653/v1 · DOI
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. In Ethics of Data and Analytics. Auerbach Publications, Boca Raton, FL, USA, 254–264.
- Jane Bailey, Jacquelyn Burkell, Suzie Dunn, Chandell Gosse, and Valerie Steeves. 2021. AI and Technology-Facilitated Violence and Abuse. In Artificial Intelligence and the Law in Canada, Florian Martin-Bariteau and Teresa Scassa (Eds.). LexisNexis, Toronto, Canada, Chapter 10, 1–15.
- Jane Bailey, Nicola Henry, and Asher Flynn. 2021. Technology-Facilitated Violence and Abuse: International Perspectives and Experiences. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse, Bailey Jane, Flynn Asher, and Henry Nicola (Eds.). Emerald Publishing Limited, Bingley, UK, 1–17.
- 10.18653/v1 · DOI
- Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The Problem with Bias: Allocative Versus Representational Harms in Machine Learning. In 9th Annual Conference of the Special Interest Group for Computing, Information and Society. Society for the History of Technology, Philadelphia, PA, USA.
- Samy Bengio Alina Beygelzimer Kate Crawford Jeanne Fromer Iason Gabriel Amanda Levendowski Deborah Raji and Marc’Aurelio Ranzato. 2022. Provisional Draft of the NeurIPS Code of Ethics. https://openreview.net/pdf?id=zVoy8kAFKPr
- 10.1177/205630511667248 · doi:10.1177/205630511667248
- 10.18653/v1 · DOI
- 10.5555/380681 · doi:10.5555/380681
- Virginia Braun and Victoria Clarke. 2021. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative research in psychology 18, 3 (2021), 328–352.
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. https://proceedings.mlr.press/v81/buolamwini18a.html
- Jacquelyn Burkell and Jane Bailey. 2018. Unlawful Distinctions? Canadian Human Rights Law and Algorithmic Bias. Vol. 2016/2018. Human Rights Research and Education Centre Ottawa, Ottawa, Canada, 217–230.
- Kate Crawford. 2017. Keynote: The Trouble with Bias. 2017 Conference on Neural Information Processing Systems, invited speaker.
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Boston, MA, USA.
- Batya Friedman and David G Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Boston, MA, USA.
- Steve Fuller. 1993. Helen E. Longino Science As Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton: Princeton University Press (1990), xi+ 262 pp., 19.95. Philosophy of Science 60, 2 (1993), 360–362.
- Jan Hadja. 1961. Alienation and Integration of Student Intellectualss. American Sociological Review 26, 5 (1961), 19.
- 10.1177/104973231666534 · doi:10.1177/104973231666534
- 10.1177/146144482095872 · doi:10.1177/146144482095872
- Shawn Janzen, Caroline Orr, and Sara-Jayne Terp. 2022. Cognitive Security and Resilience: A Social Ecological Model of Disinformation and Other Harms with Applications to COVID-19 Vaccine Information Behaviors. In 2nd Workshop Reducing Online Misinformation through Credible Information Retrieval. ROMCIR 2022, Stavanger, Norway, 48–88.
- Jared Katzman, Solon Barocas, Su Lin Blodgett, Kristen Laird, Morgan Klaus Scheuerman, and Hanna Wallach. 2021. Representational Harms in Image Tagging. Beyond Fair Computer Vision Workshop at CVPR 2021 (2021).
- Hank Liao, Golan Pundak, Olivier Siohan, Melissa Carroll, Noah Coccaro, Qi-Ming Jiang, Tara N Sainath, Andrew Senior, Françoise Beaufays, and Michiel Bacchiani. 2015. Large Vocabulary Automatic Speech Recognition for Children. In Interspeech 2015. International Speech Communication Association, Dresden, Germany, 1–5.
- 10.1093/ojls · doi:10.1093/ojls
- Emanuel Moss and Jacob Metcalf. 2020. Ethics Owners: A New Model of Organizational Responsibility in Data-Driven Technology Companies. https://datasociety.net/wp-content/uploads/2020/09/Ethics-Owners_20200923-DataSociety.pdf
- Emmanuel Moss and Jacob Metcalf. 2022. Data and Society Workshop: The Social Life of Algorithmic Harms. (March 2022).
- Aik Kwang Ng, David YF Ho, Shyh Shin Wong, and Ian Smith. 2003. In Search of the Good Life: A Cultural Odyssey in the East and West. Genetic, Social, and General Psychology Monographs 129, 4 (2003), 317.
- Safiya Umoja Noble. 2016. A Future for Intersectional Black Feminist Technology Studies. Scholar & Feminist Online 13, 3 (2016), 1–8.
- Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books, New York, NY, USA.
- Eva PenzeyMoog and Danielle C Slakoff. 2021. As Technology Evolves, So Does Domestic Violence: Modern-Day Tech Abuse and Possible Solutions. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse. Emerald Publishing Limited, Bingley, UK, 643–662.
- Jasbir K Puar. 2020. “I Would Rather be a Cyborg than a Boddess”: Becoming Intersectional in Assemblage Theory. In Feminist Theory Reader. Routledge, New York, NY, USA, 405–415.
- Henrik Skaug Sætra. 2021. Artificial Intelligence and its Contexts. Springer, Cham, Switzerland, Chapter A Typology of AI Applications in Politics, 27–43.
- Katie Shilton. 2015. "That’s Not An Architecture Problem!": Techniques and Challenges for Practicing Anticipatory Technology Ethics. In iConference 2015 Proceedings. iSchools Urbana-Champaign Illinois USA 1–7.
- Rebecca Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission. Yale Journal of Law & Tech. 23 (2020), 1.
- 10.1177/0002716222108470 · doi:10.1177/0002716222108470
- 10.18653/v1 · DOI
- Thi Tran, Rohit Valecha, Paul Rad, and H Raghav Rao. 2019. An Investigation of Misinformation Harms Related to Social Media During Humanitarian Crises. In International Conference on Secure Knowledge Management in Artificial Intelligence Era. Springer, Goa, India, 167–181.
- Zeynep Tufekci. 2015. Algorithmic Harms Beyond Facebook and Google: Emergent Challenges of Computational Agency. Colo. Tech. LJ 13 (2015), 203.
- Claire Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policymaking.
Cited by
Items 301–400 of 625
Representational Harms in LLM-Generated Narratives Against Global Majority Nationalities
Nguyen, I., Suresh, H., Monroe‐White, T., & Shieh, E. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806452 · Cited by 5
“Building on this body of work, Shelby et al., 2023 [66] provide a comprehensive taxonomy of sociotechnical harms of algorithmic systems, identifying representational harms as one of five major harm categories alongside allocative, quality-of-service, interpersonal, and social system/societal harms.”
Kasneci, G., & Kasneci, E. (2026) · AI and Ethics · doi:10.1007/s43681-026-01132-0 · Cited by 5
“…surveys already support a pluralistic view of safety that includes present-day misinformation, interaction, automation, and societal harms (Abercrombie et al., 2024; Chua et al., 2024; Deng et al., 2023; Gyevnar & Kasirzadeh, 2025; M. Li et al., 2025; Shelby et al., 2023; Weidinger et al., 2021).”
Push and Pull: A Framework for Measuring Attentional Agency on Digital Platforms
Wojtowicz, Z., Jain, S., & Vincent, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732043 · Cited by 5
“The challenge of aligning digital platforms has emerged as a key concern in modern computer science, prompting a variety of authors to propose methods for operationalizing potential social objectives, suchas beneficence, equity,and fairness [37, 54].”
Correia, A., Schneider, D., Fonseca, B., Mohseni, H., Kujala, T., & Kärkkäinen, T. (2024) · International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA) · doi:10.1109/hora61326.2024.10550680 · Cited by 5
“In this particular case, metaphors can play an important role in preserving cultural identity and stability [2] while mitigating problems such as adverse cultural impacts [29] and algorithmic unfairness [30].”
BackgroundExploring expert and public perceptions of answerability and trustworthy autonomous systems
Hatherall, L., & Sethi, N. (2025) · Journal of Responsible Technology · doi:10.1016/j.jrt.2025.100106 · Cited by 5
Generating language assessment content free from representational harms
Choi, I., & Zu, J. (2025) · Language Testing · doi:10.1177/02655322251349560 · Cited by 5
“As Shelby et al.’s (2023) recent survey on representational harms showed, such damages can be further categorized into multiple subtypes.”
Troubling Taxonomies in GenAI EvaluationPreprint
Berman, G., Cooper, N., Deng, W. H., & Hutchinson, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.22985 · Cited by 5
“Shelby et al. [25], in their taxonomy, attempt to navigate this tension by distinguishing between harms that originate with computational components of AI systems, and harms that originate in their deployment.”
BackgroundUsing Scenario-Writing for Identifying and Mitigating Impacts of Generative AIPreprint
Kieslich, K., Diakopoulos, N. A., & Helberger, N. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.23704 · Cited by 5
“Most current impact assessments rely either on literature review of scholarly literature [3, 16, 28, 29, 33], corporate authored reports [33, 34], or expert judgments [6, 30].”
BackgroundRepair and redress: A research program for algorithmic futures
Davis, J. L., & Williams, A. A. (2025) · Big Data & Society · doi:10.1177/20539517251361119 · Cited by 5
Co-designing an AI Impact Assessment Report Template with AI Practitioners and AI Compliance ExpertsPreprint
Bogucka, E. P., Constantinides, M., Šćepanović, S., & Quercia, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.17374 · Cited by 6
“…that AI system impacts involve not only the underlying algorithms (Watkins et al. 2021; Bar-Copyright nett and Diakopoulos 2022) but also their systemic impacts (Ehsan et al. 2022; Shelby et al. 2023), there has been a growing demand for comprehensive AI impact assessments (AIIAs) (Selbst 2021).”
Emergence World: Adversarial Stress-Testing of Long-Horizon Multi-Agent SystemsPreprint
Akkil, D., Abuelsaad, T., Vikram, K., Pace, M., Vempaty, A., Beotra, S., Kokku, R., & Nitta, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.17320 · Cited by 5
Understanding Gender Bias in AI-Generated Product Descriptions
Kelly, M., Tahaei, M., Smyth, P., & Wilcox, L. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732169 · Cited by 4
(2025) · doi:10.1145/3715275.3732087 · Cited by 4
Self-citationSandoval, . C. B., & Jing, F. S. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732062 · Cited by 4
Gray, S. L., & Popov, J. (2025) · Learning Media and Technology · doi:10.1080/17439884.2025.2537963 · Cited by 5
Varanasi, U. S., Drobotowicz, K., & Ylipulli, J. (2025) · International Conference on Communities and Technologies (C&T) · doi:10.1145/3742800.3742847 · Cited by 4
Artificial Intelligence in Education: Positive and Negative Impacts, and Practical Limitations
KOCABIYIK, E. (2025) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2025.v07i06.60011 · Cited by 4
Raghupathi, W., Ren, J., & Kulkarni, T. (2026) · AppliedMath · doi:10.3390/appliedmath6010011 · Cited by 4
“Prior research on AI incidents has been constrained by four key limitations, as documented in recent systematic reviews of AI safety and incident documentation literature [2,3,13].”
Malice as modernization: Twenty-first century eugenics, AI, Project 2025, and disability
Ryan, A., Pineo, E., Jaeger, P. T., & Cork, S. J. (2026) · First Monday · doi:10.5210/fm.v31i2.14729 · Cited by 4
Härkki, T., Thorström, T., Leino, M., Vartiainen, H., & Tedre, M. (2025) · The Australian journal of teacher education · doi:10.14221/1835-517x.6925 · Cited by 4
Rizzo, A., & Hassan, G. (2026) · World Tax Journal · doi:10.59403/560kfb · Cited by 4
Something Old, Something New: WebQuests and GenAI in Teacher Education
Tiernan, P., Donlon, E., Hamash, M., & Lovatt, J. (2026) · AI in Education · doi:10.3390/aieduc2010007 · Cited by 4
“Beyond the harms of false information, this amplifies risks of misinformation, disinformation, and malicious use (Shelby et al., 2023; Weidinger et al., 2021).”
AI-Facilitated Coercive Control: An Experimental Study
Kim, H., Ristenpart, T., & Dell, N. L. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790859 · Cited by 4
“Biases and limitations in training data often cause representational harms in classification and generation systems, such as stereotyping or erasure [67, 79].”
Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articles
Mehrotra, S., Huang, J., Fu, X., Dobbe, R., Sánchez, C. I., & de Rijke, M. (2026) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.20729 · Cited by 4
AI in education and the future of teachers’ meaningful work
Biström, E., & Mollwing, J. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1844085 · Cited by 4
“Shelby et al. (2023) distinguish several forms of sociotechnical harm arising from algorithmic systems, including those labeled as AI: allocative harms, where algorithmic decisions distribute resources and opportunities unevenly; quality-of-service harms, where systems systematically underperform…”
Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South
Rastogi, C., Bhutani, M., Kahng, M., Muhammad, S. H., Razumovskaia, E., Suresh, P., Ahmad, I. S., Kalia, C., Mahomed, Y., Maji, M., et al. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812296 · Cited by 4
“To systematically evaluate harms of image generation models, taxonomies have been proposed [86, 90].”
Validating and Refining Measurements for Generative AI Evaluation Via Stakeholder Engagement
Nguyen, T., Garcia-Gathright, J. I., Washington, H., Chouldechova, A., Wallach, H., & Vaughan, J. W. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812403 · Cited by 4
“We situate our study in the context of measuring erasure, a type of system behavior that can cause representational harms [13, 39].”
Showkat, D. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651127 · Cited by 4
Tracy, D. G., & Jensen, G. H. (2025) · First Monday · doi:10.5210/fm.v30i2.13742 · Cited by 4
To Protect & Serve: Enabling Responsible Software Engineering for Online Safety
Zhang, M., Rauf, I., & Bandara, A. K. (2025) · doi:10.1145/3711919.3728676 · Cited by 4
Are You Sure About That: Eliciting Natural Language Confidence Indicators from Chatbots
Toney, A., & Singh, L. (2024) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3687272.3688318 · Cited by 4
“Distinct from general chat-bot hallucinations, researchers have investigated ways in which chatbots can be misinformation spreaders by unreliably responding to prompts with false information [19, 20, 22, 25].”
Chadès, I., McGrath, M. J., Bohensky, E. L., Carter, L., Coates, R. L., Harwood, B., Islam, M. Z., Kandanaarachchi, S., Ong, C. S., Reeson, A. F., et al. (2025) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2025.3556879 · Cited by 4
Fairness in Socio-Technical Systems: A Case Study of Wikipedia
Damadi, M. S., & Davoust, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42141-9_6 · Cited by 4
Perceptions in Pixels: Analyzing Perceived Gender and Skin Tone in Real-world Image Search Results
Gleason, J. M., Ghosh, A., Robertson, R. E., & Wilson, C. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645666 · Cited by 5
“There is a robust literature on representational harms [37] in image search engines.”
Molamohammadi, M., Taïk, A., Roux, N. L., & Farnadi, G. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623256 · Cited by 4
WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AIPreprint
Deng, W. H., Wang, C., Han, H. Z., Hong, J., Holstein, K., & Eslami, M. (2025) · Qeios · doi:10.32388/b1lxnv · Cited by 4
The AI Model Risk Catalog: What Developers and Researchers Miss About Real-World AI HarmsPreprint
Rao, P. S. B., Šćepanović, S., Jayagopi, D. B., Cherubini, M., & Quercia, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.16672 · Cited by 4
“The taxonomization of AI risks has grown significantly in recent years (Yampolskiy 2016; Liu et al. 2024b; Stahl and Eke 2024; Shelby et al. 2023).”
The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI SafetyPreprint
Rios-Sialer, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.06116 · Cited by 4
Cao, H., Thomas, E., & Agost, R. A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.00044 · Cited by 4
“Finally, existing bias evaluation methods remain largely disconnected from real-world applications, as assessments are primarily conducted at model checkpoints rather than within downstream tasks or daily use cases [19, 61].”
Interrogating Design Homogenization in Web Vibe CodingPreprint
Shin, D., Gao, A., Pang, R. Y., Lee, J., Reinecke, K., & Tseng, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.13036 · Cited by 4
“In this section, we analyze those risks through the lens of scholarship on sociotechnical harms [11, 62], as a starting point for possible intervention.”
Bennett, C. L., Kane, S. K., & Harrington, C. N. (2025) · Proceedings of the 5th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3757887.3763012 · Cited by 3
“Multiple participants gave up prompting even when they were not satisfied with images, accepting deficits in the tools’ quality of service [78], such as Gargi’s earlier-quoted decision to give up trying to picture disabled people without wheelchairs.”
Exploring the use of Speculative Concept Films for Co-Speculation around Data Ethics
Olson, W., & Pierce, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713245 · Cited by 3
Centering Harm in Socio-technical Systems: Connecting Design, User Experience, and Policy
Gairola, R. (2025) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3715070.3747333 · Cited by 3
“3 Part 1: Centering Harm Harm is a complex concept shaped by society and law, involving judgments about its severity and consequences and scholars have called to look beyond technical boundaries in order to map its complexities [28].”
Nahar, N., Yang, C., Chen, Y., Deng, W. H., Holstein, K., Eslami, M., & Kästner, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791285 · Cited by 3
“All disagreements on Severity stemmed from the LLM being overly generous in rating baseline stories as severe, thus overin-flating the severity results of the baseline (see Figure 6) – hence, results regarding severity likely underestimate the real effect.”
What is Safety? Corporate Discourse, Power, and the Politics of Generative AI Safety
De, A., Lima, G., & Zou, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791632 · Cited by 3
“For instance, Aber-crombie et al. [2] and Shelby et al. [122] have identified several types of risks in current AI systems, including representational and allocative harms.”
Shi, M., Song, T., Zhu, Z., & Lee, Y. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798404 · Cited by 3
Kadoma, K., Shrivastava, P., & Naaman, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790911 · Cited by 3
“It is important to note that while training data is often seen as a source of bias, it is not the only source of bias in the machine learning life cycle.”
How Tech Workers Contend with Hazards of Humanlikeness in Generative AI
Díaz, M., Shelby, R. M., Corbett, E., & Smart, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791461 · Cited by 3
Self-citationA Sociotechnical Vision for Ethical, Responsible, and Critical PK-12 Computing Education
Santo, R., Ryoo, J. J., Phelps, D., Starks, B., & Lachney, M. (2026) · ACM Inroads · doi:10.1145/3793910 · Cited by 3
Push and Pushback in Contesting AI: Demands for and Resistance to Accountability
Pi, Y., Lichner, L., Lee, J. W., Xiao, S., Zhang, R., & Singh, J. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812323 · Cited by 3
“Prior work documents these harms and examines how accountability for AI can be realized [20, 67, 98, 127, 128].”
Big AI is Accelerating the Metacrisis: What Can We Do?
Bird, S. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-short.6 · Cited by 3
Specchio riflesso! Un'esperienza etnografica con TikTok
Zurovac, E. (2025) · SOCIOLOGIA DELLA COMUNICAZIONE · doi:10.3280/sc2024-068007 · Cited by 3
Teaching Parrots to See Red: Self-Audits of Generative Language Models Overlook Sociotechnical Harms
Shieh, E., & Monroe‐White, T. (2025) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v6i1.36070 · Cited by 3
“While authors acknowledge the lack of context (Google 2023), this corresponds to quality-of-service harms for people with binary genders (Shelby et al. 2023).”
InfluentialAssessing the Impact of Sociotechnical Harms in AI-Based Medical Image Analysis
Stanley, E. A. M., Souza, R., Winder, A. J., Wilms, M., Pike, G. B., Dagasso, G., Nielsen, C., MacEachern, S. J., & Forkert, N. D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72787-0_16 · Cited by 3
DrawL: Understanding the Effects of Non-Mainstream Dialects in Prompted Image GenerationPreprint
Williams, J. N., FitzMorris, M., Aka, O., & Laszlo, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.05382 · Cited by 3
“Throughout our work, we also consider potential harms associated with the effects we study, referencing the harms taxonomy proposed in [53].”
BackgroundMethodInfluentialECHO: A Participatory Framework for Bias-Anchored AI Harm AnticipationPreprint
Tantalaki, N., Vei, S., & Vakali, A. I. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.03068 · Cited by 3
“…Guttag 2021; Mehrabi et al. 2021; van Giffen et al. 2022; Kheya et al. 2024), these accounts remain largely disconnected from AI harm taxonomies (Shelby et al. 2023; Abercrom-bie et al. 2024; Hoffmann and Frase 2023; Weidinger et al. 2022), leaving associations between AI biases and harms…”
InfluentialBarnett, J., Kieslich, K., Helberger, N., & Diakopoulos, N. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.14869 · Cited by 3
CompanionHarm: A Multi-Turn Benchmark for Detecting Harms in Real-World AI Companion ConversationsPreprint
Zhang, R., Meng, H., Chai, J., Lin, Y., & Lee, Y.-C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.25377 · Cited by 3
Introducing AI to an Online Petition Platform Changed Outputs but not Outcomes
Corpus, I., Gilbert, E., Koenecke, A., & Naaman, M. (2025) · arXiv · doi:10.48550/arxiv.2511.13949 · Cited by 2
Near to Mid-term Risks and Opportunities of Open-Source Generative AI
Eiras, F., Petrov, A., Vidgen, B., de Witt, C. S., Pizzati, F., Elkins, K., Mukhopadhyay, S., Bibi, A., Csaba, B., Steibel, F., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.17047 · Cited by 2
“This can take many forms, including physical, psychological, economic, representational and allocational harms (Shelby et al., 2023; Weidinger et al., 2023).”
BackgroundFrom Silos to Systems: Process-Oriented Hazard Analysis for AI Systems
Rismani, S., Dobbe, R., & Moon, A. (2024) · arXiv · doi:10.48550/arxiv.2410.22526 · Cited by 2
Self-citation'The plan is just survival': Data Work in Kenya and the Regime of Entrapment
Kapania, S., Yang, T., Abdelkadir, N. A., Scheuerman, M. K., Miceli, M., Taylor, A. S., & Fox, S. E. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791097 · Cited by 2
Reflecting on the Relational: Youth-Centered Approaches to Living with Technology
Gak, L. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3682047 · Cited by 2
“On the other hand, other researchers argue that relational harms should be prioritized in discussions of youth online risk [6, 16, 35, 45, 46].”
Concept Creep in Safe Artificial Intelligence
Fearnley, L., & Habli, I. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36599 · Cited by 2
“…to consider the diverse and multi-faceted impacts AI systems can have throughout their entire lifecycle, and there is now a burgeoning literature which in-terlaces a rich landscape of risks relevant for safety evaluations (Zeng et al. 2024; Li et al. 2024; Shelby et al. 2023; Raji and Dobbe 2023).”
AI Risk, Safety, and Incident Reporting
Paeth, K., & McGregor, S. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_89 · Cited by 2
Das, D., Guha, S., & Semaan, B. (2026) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3811242.3819100 · Cited by 2
Lamchek, J. S., & Trieu, V.-H. (2026) · Technology and Regulation · doi:10.71265/esg7cf11 · Cited by 2
Emotion Artificial Intelligence in the Workplace: United States Legal Considerations
Sipior, J. C., Ward, B. T., Lombardi, D. R., & Appelbaum, D. A. (2026) · Information Systems Management · doi:10.1080/10580530.2026.2616521 · Cited by 2
Time to (Re)visualise victims? Introducing shadow victims of digital misinformation
Mukherjee, S., & Chang, L. Y. C. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.109002 · Cited by 2
Classifying Harms in Social VR: A Systematic Literature Review and Taxonomy
Gerritse, M., Folpmers, I., Irawan, C. A., Freeman, G., Gugenheimer, J., & Frommel, J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3799441 · Cited by 2
“While there are related taxonomies and frameworks in other contexts, such as in AI companionship [101], sociotechnical harms in algorithmic systems [86], toxicity in games [98], or harmful content online [80], they are not specific to the social VR context.”
Zhang, S., Gu, Y., Cater, K. F., & Metatla, O. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791927 · Cited by 2
“…harms refer to instances where algorithmic systems disproportionately allocate or withhold opportunities, resources, or services from certain individuals or groups, often due to underrepresentation or historical biases in the training data, being salient in accessibility contexts [4, 31, 93, 97].”
A Framework to Characterize Reporting on Generative AI Use
Balayn, A., Rao, V. N., Blodgett, S. L., Caliskan, A., & Barocas, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791649 · Cited by 2
AI, Normality, and Oppressive Things
Lin, T.-A., & Huang, L. T.-L. (2026) · Minds and Machines · doi:10.1007/s11023-026-09778-9 · Cited by 2
“Evaluating through a sociotechnical lens, recent research has revealed different ways AI systems might impose unfair impacts on society (Shelby et al., 2023 ), including through influencing social schemas, namely the understanding and attitudes that people hold toward different social groups…”
Developing an AI Concept Envisioning Toolkit to Support Reflective Juxtaposition of Values and Harms
Sinlapanuntakul, P., Moon, S., Kawada, Y., Chung, Y., & Zachry, M. R. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3813054 · Cited by 2
“The initial value list was identified through a synthesis of VSD’s standard value repertoire [31], AI ethics literature [76, 77, 89], and harm taxonomy frameworks [83, 97].”
InfluentialOrchard, N. A., Duister, S., Zhang, R., Guan, K., Vegt, N., de Reuver, M., & Figueroa, C. A. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3810945 · Cited by 2
“The lack of input from diverse populations can create more inequalities, entrench existing biases and lead to models which perpetuate existing stereotypes and control world narratives [27 , 40].”
Machlovi, N., Saleki, M., Amin, R., Rahouti, M., Al-Maliki, S., Qadir, J., Abdallah, M. M., & Al‐Fuqaha, A. (2026) · ACM Transactions on Social Computing · doi:10.1145/3815159 · Cited by 2
LLM-augmented Empirical Game Theoretic Simulation for Socio-ecological Systems
Shi, J., Frantz, C. K., Kimmich, C., Siddiki, S., & Sarkar, A. (2026) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/sewu4006 · Cited by 2
Shi, M., Song, T., Zhu, Z., & Lee, Y. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812902 · Cited by 2
Mingole, B., Majumdar, A., Choudhury, F. A., Kraschnewski, J. L., Sundar, S. S., & Yadav, A. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812315 · Cited by 2
“This issue must be understood and mitigated as a socio-technical harm, specifically a quality-of-service harm, where algorithmic systems disproportionately underperform for certain groups of people [66].”
Unsafe at any AUC: Unlearned Lessons From Sociotechnical Disasters for Responsible AI
Kroll, J. A., Smart, A., Geiger, R. S., & Jacobs, A. Z. (2026) · Harvard Data Science Review · doi:10.1162/99608f92.91b8834f · Cited by 2
“Assurance cases provide one setting in which such roles can be made explicit (Bloomfield & Rushby, 2024; Rismani, Shelby, Smart, Delos Santos, et al., 2023; Rushby, 2015).”
Self-citationTechnically Love: The Evolution of Human–AI Romance Discourse on Reddit
Chang, T., Huh, J., & Razi, A. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816222 · Cited by 2
“Finally, Section 5.3 considers the design and governance implications of our results.”
InfluentialDownsides, Pitfalls, and Socio-Cultural Shortcomings of Human-AI Music Co-Creation
Correia, A. (2025) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 2
WildSEEK: Evaluating Language Models for Information-Seeking
Ceron, T., Baumann, J., Bassignana, E., Cabuk, B., Hovy, D., & Nozza, D. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.763 · Cited by 2
Henry, N., Umbach, R., Shelby, R. M., & Gonzalez‐Pons, K. M. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2723677 · Cited by 2
Self-citationGenerative AI Technologies, Techniques and Tensions: A Primer
Behrens, J. T. (2026) · Springer eBooks · doi:10.1007/978-3-032-24819-0_2 · Cited by 2
Position: Near to Mid-term Risks and Opportunities of Open-Source Generative AI
Eiras, F., Petrov, A., Vidgen, B., Schroeder de Witt, C., Pizzati, F., Elkins, K., Mukhopadhyay, S., Bibi, A., Csaba, B., Steibel, F., et al. (2024) · Oxford University Research Archive (ORA) (University of Oxford) · Cited by 2
Sirimalla, A. (2024) · ISCSITR-INTERNATIONAL JOURNAL OF CLOUD COMPUTING · doi:10.63397/iscsitr-ijcc_2024_05_01_003 · Cited by 2
Beyond Words: The Influence of Character-Inspired Voices on Human-AI Dialogue System
Figueroa, D. A., Alaoja, M. S., Li, C., & Chrysostomou, D. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2508315 · Cited by 2
“Some taxonomies have been proposed for general generative AI (Shelby et al., 2023; Weidinger et al., 2023), while Hutiri et al. (2024) offered a classification of risks for voice generation only.”
Wang, D., Díaz, M., Rastogi, C., Davani, A. M., Prabhakaran, V., Mishra, P., Patel, R., Parrish, A., Ashwood, Z. C., Paganini, M., et al. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36742 · Cited by 2
Technology and tactics: The intersection of safety, AI, and the resort to force
Assaad, Z., & Williams, E. (2025) · Cambridge Forum on AI Law and Governance · doi:10.1017/cfl.2025.10026 · Cited by 2
Agential harms of chatbots: an ethical perspective
MirzaeiGhazi, S., & Osman, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01240-x · Cited by 2
“…harms, along the lines of those described by Aber-crombie et al. [ 1 ], would present: ● High-level: Including “Entity: In addition, Shelby et al. [109] also present a synthesis of existing taxonomies of AI risk to propose five categories of harms that would present as a result: representational…”
Jo, C. W., Wesołowska, M., & Wojcieszak, M. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2dn8s · Cited by 3
Towards Leveraging News Media to Support Impact Assessment of AI TechnologiesPreprint
Allaham, M., Kieslich, K., & Diakopoulos, N. A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.02536 · Cited by 2
“For example, impacts relevant to alienation and loss of agency that are reported in the literature [19, 24] are missing from the news media, at least at the level of detail considered in this work, and therefore were not reflected in the generated impacts by the fine-tuned models.”
BackgroundOn the Distinction Between Tort-Based and Risk-Based AI Regulation: A Transatlantic PerspectivePreprint
Rizzo, A., & Hassan, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5205034 · Cited by 2
Beyond the Legal Lens: A Sociotechnical Taxonomy of Lived Privacy Incidents and HarmsPreprint
Chapman, K., Smith, G., Klabacka, K., Winslow, H., Barkhuus, L., Faklaris, C., Das, S., Wiśniewski, P., Knijnenburg, B. P., Lipford, H. R., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.20791 · Cited by 2
“Human-Computer Interaction (HCI) research has found many instances where privacy violations lead to harm [16, 48, 60].”
Enduring Disparities in the Workplace: A Pilot Study in the AI CommunityPreprint
Abdulsalam, Y. S., Hall, S. M., Quintero-Ossa, A. M., Agnew, W. S., Muntean, C., Tan, S., Heady, A., Thais, S. J., & Schrouff, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.04305 · Cited by 2
Opening the Scope of Openness in AIPreprint
Paris, T., Moon, A., & Guo, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.06464 · Cited by 2
Self-citationSchrage, L. (2024) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2
Towards algorithmic reform: ethical values-informed tool design and inclusive AI/ML literacy
Showkat, D. (2025) · Digital Repository Service (Northeastern University) · doi:10.17760/d20791821 · Cited by 2
Metadata
- Authors
- Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., & Virk, G.
- Affiliations
- Google (United States) (US)
- McGill University (CA)
- Australian National University (AU)
- Google, USA
- ORCID
- Venue
- Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2023-08-08
- Pages
- 723-741
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4386249234
- Cited by
- 279
- References
- 191
- Citations by year
- 2026: 97 · 2025: 101 · 2024: 65 · 2023: 15
- FWCI
- 69.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic harms, harm reduction, algorithmic systems, representational harm, interpersonal harm, social harm, sociocultural dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.