Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Open accessThe DOI matches its Crossref record; 205 of the 209 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms — representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms — and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
From Helpful, harmless, honest? Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback (2025) · cites this paper as Shelby et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The rapid pace of adoption of GenAI tools, when it comes to similar concerns, have significantly exacerbated the many socio-technical issues researchers have connected to education technologies in general [160, 311] and algorithmic harms related to GenAI [317] more specifically.”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [317]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent work has expressed concern around anthropomorphism leading to over-trust [1, 91], a potential path for uncertainty expression to backfire.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [91]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Our approach followed prior scoping reviews in HCI literature [74, 223], in alignment with the extension of the PRISMA checklist [133], the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [220].”
MethodScoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 5×
“We employed a descriptive-analytical method for charting data – a process of “synthesizing and interpreting qualitative data by sifting, charting and sorting material according to key issues and themes" [11, p. 26].”
BackgroundMethodInfluentialBlack Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 2×
“Thus, relying on scoping reviews’ iterative characteristic [168], we used theoretical saturation as a signal to stop sourcing new papers.”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“systems make incorrect health inferences [158].”
Background
Research works printed but not linked: 40
- 10.1093/cybsec · doi:10.1093/cybsec
- 10.18653/v1 · DOI
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. In Ethics of Data and Analytics. Auerbach Publications, Boca Raton, FL, USA, 254–264.
- Jane Bailey, Jacquelyn Burkell, Suzie Dunn, Chandell Gosse, and Valerie Steeves. 2021. AI and Technology-Facilitated Violence and Abuse. In Artificial Intelligence and the Law in Canada, Florian Martin-Bariteau and Teresa Scassa (Eds.). LexisNexis, Toronto, Canada, Chapter 10, 1–15.
- Jane Bailey, Nicola Henry, and Asher Flynn. 2021. Technology-Facilitated Violence and Abuse: International Perspectives and Experiences. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse, Bailey Jane, Flynn Asher, and Henry Nicola (Eds.). Emerald Publishing Limited, Bingley, UK, 1–17.
- 10.18653/v1 · DOI
- Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The Problem with Bias: Allocative Versus Representational Harms in Machine Learning. In 9th Annual Conference of the Special Interest Group for Computing, Information and Society. Society for the History of Technology, Philadelphia, PA, USA.
- Samy Bengio Alina Beygelzimer Kate Crawford Jeanne Fromer Iason Gabriel Amanda Levendowski Deborah Raji and Marc’Aurelio Ranzato. 2022. Provisional Draft of the NeurIPS Code of Ethics. https://openreview.net/pdf?id=zVoy8kAFKPr
- 10.1177/205630511667248 · doi:10.1177/205630511667248
- 10.18653/v1 · DOI
- 10.5555/380681 · doi:10.5555/380681
- Virginia Braun and Victoria Clarke. 2021. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative research in psychology 18, 3 (2021), 328–352.
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. https://proceedings.mlr.press/v81/buolamwini18a.html
- Jacquelyn Burkell and Jane Bailey. 2018. Unlawful Distinctions? Canadian Human Rights Law and Algorithmic Bias. Vol. 2016/2018. Human Rights Research and Education Centre Ottawa, Ottawa, Canada, 217–230.
- Kate Crawford. 2017. Keynote: The Trouble with Bias. 2017 Conference on Neural Information Processing Systems, invited speaker.
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Boston, MA, USA.
- Batya Friedman and David G Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Boston, MA, USA.
- Steve Fuller. 1993. Helen E. Longino Science As Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton: Princeton University Press (1990), xi+ 262 pp., 19.95. Philosophy of Science 60, 2 (1993), 360–362.
- Jan Hadja. 1961. Alienation and Integration of Student Intellectualss. American Sociological Review 26, 5 (1961), 19.
- 10.1177/104973231666534 · doi:10.1177/104973231666534
- 10.1177/146144482095872 · doi:10.1177/146144482095872
- Shawn Janzen, Caroline Orr, and Sara-Jayne Terp. 2022. Cognitive Security and Resilience: A Social Ecological Model of Disinformation and Other Harms with Applications to COVID-19 Vaccine Information Behaviors. In 2nd Workshop Reducing Online Misinformation through Credible Information Retrieval. ROMCIR 2022, Stavanger, Norway, 48–88.
- Jared Katzman, Solon Barocas, Su Lin Blodgett, Kristen Laird, Morgan Klaus Scheuerman, and Hanna Wallach. 2021. Representational Harms in Image Tagging. Beyond Fair Computer Vision Workshop at CVPR 2021 (2021).
- Hank Liao, Golan Pundak, Olivier Siohan, Melissa Carroll, Noah Coccaro, Qi-Ming Jiang, Tara N Sainath, Andrew Senior, Françoise Beaufays, and Michiel Bacchiani. 2015. Large Vocabulary Automatic Speech Recognition for Children. In Interspeech 2015. International Speech Communication Association, Dresden, Germany, 1–5.
- 10.1093/ojls · doi:10.1093/ojls
- Emanuel Moss and Jacob Metcalf. 2020. Ethics Owners: A New Model of Organizational Responsibility in Data-Driven Technology Companies. https://datasociety.net/wp-content/uploads/2020/09/Ethics-Owners_20200923-DataSociety.pdf
- Emmanuel Moss and Jacob Metcalf. 2022. Data and Society Workshop: The Social Life of Algorithmic Harms. (March 2022).
- Aik Kwang Ng, David YF Ho, Shyh Shin Wong, and Ian Smith. 2003. In Search of the Good Life: A Cultural Odyssey in the East and West. Genetic, Social, and General Psychology Monographs 129, 4 (2003), 317.
- Safiya Umoja Noble. 2016. A Future for Intersectional Black Feminist Technology Studies. Scholar & Feminist Online 13, 3 (2016), 1–8.
- Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books, New York, NY, USA.
- Eva PenzeyMoog and Danielle C Slakoff. 2021. As Technology Evolves, So Does Domestic Violence: Modern-Day Tech Abuse and Possible Solutions. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse. Emerald Publishing Limited, Bingley, UK, 643–662.
- Jasbir K Puar. 2020. “I Would Rather be a Cyborg than a Boddess”: Becoming Intersectional in Assemblage Theory. In Feminist Theory Reader. Routledge, New York, NY, USA, 405–415.
- Henrik Skaug Sætra. 2021. Artificial Intelligence and its Contexts. Springer, Cham, Switzerland, Chapter A Typology of AI Applications in Politics, 27–43.
- Katie Shilton. 2015. "That’s Not An Architecture Problem!": Techniques and Challenges for Practicing Anticipatory Technology Ethics. In iConference 2015 Proceedings. iSchools Urbana-Champaign Illinois USA 1–7.
- Rebecca Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission. Yale Journal of Law & Tech. 23 (2020), 1.
- 10.1177/0002716222108470 · doi:10.1177/0002716222108470
- 10.18653/v1 · DOI
- Thi Tran, Rohit Valecha, Paul Rad, and H Raghav Rao. 2019. An Investigation of Misinformation Harms Related to Social Media During Humanitarian Crises. In International Conference on Secure Knowledge Management in Artificial Intelligence Era. Springer, Goa, India, 167–181.
- Zeynep Tufekci. 2015. Algorithmic Harms Beyond Facebook and Google: Emergent Challenges of Computational Agency. Colo. Tech. LJ 13 (2015), 203.
- Claire Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policymaking.
Cited by
Items 401–500 of 625
Open Problems in Frontier AI Risk ManagementPreprint
Ziosi, M., Plueckebaum, M., Casper, S., Papadatos, H., Chin, Z. S., Slattery, P., Gealy, J., Rudner, T. G. J., Tse, B., Gil, A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.25982 · Cited by 2
Reflections and New Directions for Human-Centered Large Language ModelsPreprint
Ziems, C., Zhao, D., Wang, R., Jörke, M., Rushdi, A., Deepak, A., Yu, S., Agarwal, A., Agarwal, H., Aránguiz-Dias, G., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.06901 · Cited by 2
FLARE-AI: Flaw Reporting for AIPreprint
Longpre, S., Zhu, E., Ezell, C., Ghosh, A., McGregor, S., Paeth, K., Klyman, K., Kapoor, S., Bommasani, R., Appel, R. E., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.31567 · Cited by 2
“Taxonomies of AI risks and harms are extensive: Weidinger et al. (Weidinger et al., 2022; 2021), Shelby et al. (Shelby et al., 2023), NIST’s AI RMF (Tabassi, 2023), the MIT AI Risk Repository (Slattery et al., 2024), and Longpre et al.’s cheatsheet (Longpre et al., 2024a) are notable examples.”
Provocation: Who benefits from "inclusion" in Generative AI?
Dalal, S., Hall, S. M., & Johnson, N. (2024) · arXiv · doi:10.48550/arxiv.2411.09102 · Cited by 1
A STUDY OF INDUSTRY INFLUENCE IN THE FIELD OF AI RESEARCH
Berman, G., Williams, K., & Cohen, E. (2025) · AoIR Selected Papers of Internet Research · doi:10.5210/spir.v2024i0.13904 · Cited by 1
Kaji, H., Kuribayashi, J., Ohtani, H., & Ema, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719951 · Cited by 1
Position: Contextual Confidence and Generative AI
Jain, S., Hitzig, Z., & Mishkin, P. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00022 · Cited by 1
Autocompleting inequality: Large language models and the “alignment problem”
Zajko, M. (2025) · Journal of Digital Social Research · doi:10.33621/jdsr.v7i154879 · Cited by 1
Designing Support for Systematic Sociotechnical Risk Literacy
Walker, A. M., Shelby, R. M., Schlesinger, A., Tseng, E., Díaz, M., Ricci, A. E., & Smith, A. D. R. (2025) · Decennial Aarhus Conference · doi:10.1145/3737609.3747101 · Cited by 1
“This requires understanding the landscape of sociotechnical harms [22] as well as cultivating skills for identifying social and technical sources of harms, interpreting probabilistic information, understanding uncertainty, evaluating risk-benefit tradeoffs, and making decisions with incomplete…”
Self-citationBruijnem, T., Mols, A., & Pridmore, J. (2025) · Human-Machine Communication · doi:10.30658/hmc.10.5 · Cited by 1
“AI experts increasingly highlight the need for better analyses for understanding and antic-ipating (harmful) consequences of AI systems (Shelby et al., 2023 ).”
Artificial Intelligence Compliance: Perceptions within Organizations
(2025) · Issues in Information Systems · doi:10.48009/1_iis_113 · Cited by 1
Co-creating an Ontology of Online Gender-Based Harms: An Interdisciplinary Perspective
Fernández, M., Tirado, A. C. M., Pérez, Á. P., Duddin, K. S. E., Zhang, M., Bakina, K., Bandara, A. K., Capdevila, R., Lazard, L., & Jurasz, O. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09530-5_12 · Cited by 1
Uncertainties and Emerging Uses of Human-Ai Medical Diagnosis in Collaborative Clinical Practice
Correia, A., Fonseca, B., Schneider, D. M., Chaves, R., & Kärkkäinen, T. (2025) · International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT) · doi:10.1109/ismsit67332.2025.11267990 · Cited by 1
A Risk Assessment Framework for Digital Identification Systems
Woodruff, A., Balfanz, D., Drewry, W., & Raykova, M. (2026) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2026-0046 · Cited by 1
Healthier, thinner or more profitable? Technosolutionism, fat bodies and fat futures
Carter, L., & Sobey, A. (2025) · Electronic workshops in computing · doi:10.14236/ewic/bcshci2025.27 · Cited by 1
Unknown Unknowns: Do Hidden Intentions in LLMs Evade Detection?
Srivastav, D., Pape, D., & Schönherr, L. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1702 · Cited by 1
Towards a Fuzzy MCDM-Based Framework for Multi-Metric Bias Auditing in Generative AI
Ravikumar, R., Rajan, A. V., Narayan, A., & Maheshwari, P. (2025) · International Conference on Information Technology Trends (ITT) · doi:10.1109/itt69610.2025.11352932 · Cited by 1
Human-Centered and Participatory AI Auditing
Deng, W. H., Holstein, K., & Eslami, M. (2026) · Springer eBooks · doi:10.1007/978-981-97-8440-0_102-1 · Cited by 1
Can Artificial Intelligence Destroy Future Industry?
Terziyan, V. Y., Gryshko, S., Kaikova, O., & Golovianko, M. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.02.338 · Cited by 1
Christina, J. L., Alamelu, R., Sathya, M., & Purushothaman, R. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-4307-5.ch010 · Cited by 1
An Empirical Study on Reasoning and Generalization in Large Language Models
Xiang, L., Zhao, Y., Zhang, Y., Ren, Z., Zhang, X., Chen, Z., & Zong, C. (2026) · Computational Linguistics · doi:10.1162/coli.a.619 · Cited by 1
Multiplicity in Practice: Glitching the Human In/Through Personal Sensing
Haghighi, N., Do, C., Liu, K., Lall, Y., & Landay, J. A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791814 · Cited by 1
“In/visibility is without a doubt political and an ongoing source of harm [104].”
Parker, A. G., Vardoulakis, L., & Harrington, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791451 · Cited by 1
“Shelby et al. [98], for example, discuss the types of problems that AI can cause for people, such as through allocative harms that lead to the loss of resources, information, or opportunities in marginalized groups.”
Regulating AI: Where U.S. State Policy and HCI (Mis)align
Migineishvili, N., Gao, A., Adjagbodjou, A. D., Thakur, D., Just, R., & Reinecke, K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791424 · Cited by 1
“In the latter case, we classified reports as 1 if a single panelist had mentioned benefits (risks) of that topic in passing, and 2 if either multiple panelists had discussed benefits (risks) of that topic or one panelist had discussed benefits (risks) of that topic in depth.”
All Eyes on the Ranker: Participatory Auditing to Surface Blind Spots in Ranked Search Results
Rezk, A. M., Vito, P. D. C. S., Soufan, A., McDonald, G., Macdonald, C., & Ounis, I. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806467 · Cited by 1
Four Aspirations for Evaluating AI-Infused Technologies: A Narrative Review
Morey, D. A., Jalaeian, M., Reynolds, M. E., McGeorge, N., Oldham, H. K., & Rayo, M. F. (2026) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434261443032 · Cited by 1
“However, there is growing recognition that even seemingly low-stakes deployments of algorithmic technologies can contribute to large-scale sociotechnical harms (Shelby et al., 2023).”
Semantic Aggregated Adversarial Training Framework for Hate Speech Detection
Zhang, X., Tian, H., Zheng, X. B., Peng, J., & Zeng, D. D. (2026) · INFORMS journal on computing · doi:10.1287/ijoc.2023.0508 · Cited by 1
Human-Centered and Participatory AI Auditing
Deng, W. H., Holstein, K., & Eslami, M. (2026) · Springer eBooks · doi:10.1007/978-981-95-3658-0_102 · Cited by 1
Position: Responsible AI for AI companions must actively combat violence toward intimate partners
Ghoshal, A., Ghoshal, A., Shevchenko, V., Ashwini, B., Dutta, A., Abu-Salma, R., & Brandão, M. (2026) · Research Portal (King's College London) · Cited by 1
Wellness Watch or Worry Watch? Negative Psychological Impacts of Wearable Devices
Meegahapola, L., Creswell, J. D., & Quercia, D. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3810204 · Cited by 1
Adelmant, V., & Fisher, A. (2026) · Computer law & security review · doi:10.1016/j.clsr.2026.106344 · Cited by 1
Mannheim, I., Edan, Y., Peine, A., & Nimrod, G. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2693162 · Cited by 1
Amplifying Global Voices: Building a Localized Data Platform for Globalized AI
Rashid, Q. M., Nabende, J. N., van Liemt, E., Baguma, R., Shih, T., Yang, X., Ebinama, A., Yang, Z., Maji, M., Verma, A., et al. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812319 · Cited by 1
“The themes and sensitive characteristics were grounded in the work by authors [17],[48] and policy definitions from large technology organizations.”
Mapping Emerging Climate Misinformation Playbooks in the Global South
Locatelli, M. S., Dong, W., Alzamora, P. L., Dutenhefner, P. R., Meira, W., Cha, M., & Almeida, V. A. F. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806492 · Cited by 1
“The spread of “new denial” demonstrates how engagement-driven platform incentives shape information visibility; this has been identified as a source of sociotechnical harm when algorithms systematically expose users to low-quality information and reinforce social biases [52, 60, 71].”
Affordance Analyses of AI Safety Policies: A Proof-of-Concept using OpenAI's Preparedness Framework
Coggins, S., Saeri, A. K., Daniell, K. A., Henne, K., Ruster, L. P., Liu, J., & Davis, J. L. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812331 · Cited by 1
“As such, it offers an analytic tool to help practitioners better assess and thus better anticipate whether their guiding self-regulatory frameworks actually aid in minimising harms [47].”
InfluentialSelf-citationAutomated bias blind spots: Examining stereotype associations in VLM-as-a-judge paradigms
Hong, R. S., Ovalle, A., Ung, M., Spiliopoulou, E., Sagun, L., Williams, A., & Ross, C. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806459 · Cited by 1
Asscher, O., Ahmad, A., Agrawal, A., & Choudhury, M. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1098 · Cited by 1
Cheng, C., Dai, J., & Yan, L. (2026) · Risk Analysis · doi:10.1111/risa.70324 · Cited by 1
“Frameworks such as the sociotechnical harm taxonomy (Shelby et al. 2023 ) and the LLM risk taxonomy (Weidinger et al. 2022 ) derive categories from theory, specifying what risks should exist rather than documenting how failure patterns are publicly described across domains.”
Smith, A. D. R., Thompson, G., Dancy, C. L., Díaz, M., Olojo, S., & Harrington, C. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i4.43313 · Cited by 1
“We leveraged this taxonomy after recognizing that the main problems identified in our first round of analysis aligned with the harms defined in Shelby et al. (2023), and we then used it to deductively code the corpus.”
InfluentialRiesgos del uso de Inteligencia Artificial Generativa en comunicación e investigación científica
Contreras, W. M. R., Contreras, O. L. R., & Acevedo, E. C. M. (2025) · doi:10.24054/vst5gf84 · Cited by 1
Strengthening Algorithmic Safety Through Responsible and Explainable AI : A Conceptual Framework
Jain, A., Azami, S., Vishnoi, S. K., Pandita, S., & Garg, A. (2026) · Prabandhan Indian Journal of Management · doi:10.17010/pijom/2026/v19i8/175099 · Cited by 1
No More Plaudits for Algorithm Audits: A Provocation
DeVrio, A., & Widder, D. G. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i2.43185 · Cited by 1
Arzaghi', M., Farashah, A. D., Carichon, F., Plante, J., & Farnadi, G. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i1.43139 · Cited by 1
“Intrinsic bias can reinforce stereotypes and harmful social associations, whereas extrinsic bias can produce allocative harms, including unequal treatment or discrimination in high-stakes decisions (Gallegos et al. 2024; Shelby et al. 2023).”
Reparations of the horse? Algorithmic reparation and overspecialized remedies
Doyle, C., Alvarez-Garcia, M., Tracey, P., Grill, G., Whitney, C. D., & Chambers, L. M. (2024) · Big Data & Society · doi:10.1177/20539517241270670 · Cited by 1
“Likewise, algorithmic harms (Andalibi et al., 2023; Shelby et al., 2023) are also sociotechnical, as they emerge from the interplay of social factors like structural inequality and algorithmic technology.”
Kamp, S., & Fish, B. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i17.33949 · Cited by 1
Unblackboxing How Sociotemporalities Inform AI Accountability: The Case of Targeted Advertising
Hardcastle, F., Henne, K., Harb, J. I., Lee, A., Viaña, J. N. M., & Halford, S. (2025) · Social Science Computer Review · doi:10.1177/08944393251365275 · Cited by 1
“” Concerns have been raised about how targeted advertising practices can lead to allocative and representational harms (see Shelby et al., 2023).”
Self-citationRed teaming with faith leaders: expanding digital safety and accountability to frontiers of care
Lutz, N., & Weyl, E. G. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812362 · Cited by 1
“However, existing taxonomies and measures are not fully incompatible; many of our harms extend and add a layer of religious sensitivity to many of Shelby et al’s sociotechnical harms (particularly cultural and interpersonal) [63].”
InfluentialGood intentions, unintended consequences: exploring forecasting harmsPreprint
Rostami-Tabar, B., Greene, T., Shmueli, G., & Hyndman, R. J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.16531 · Cited by 1
“Shelby et al. (2023) constructed a taxonomy of sociotechnical harms at micro-, meso-and macro-levels stemming from the use of algorithms.”
Empowering Online Harm Survivors to Addressing Harm with a Restorative Justice Approach
Xiao, S. (2024) · eScholarship (California Digital Library) · Cited by 1
Combating Problematic Information Online with Dual Process Cognitive Affordances
Bhuiyan, M. M. (2023) · VTechWorks (Virginia Tech) · Cited by 1
Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and HarmsPreprint
Rismani, S., Shelby, R., Davis, L., Rostamzadeh, N., & Moon, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.10339 · Cited by 1
“(Shelby 2023, p. 731) All measures in this category relate to information loss or environmental harms; none reflect the harm sub-types of cultural, socio-economic, and political/civic harm.”
InfluentialSelf-citationBiases as Risk Factors to Patient Security? A Taxonomy of Algorithmic Harm in Health
Hille, E. M. (2026) · The American Journal of Bioethics · doi:10.1080/15265161.2025.2608618 · Cited by 1
“In their taxonomy, Shelby et al. identify five types of harm: representational, allocative, quality-of-service, interpersonal and social system harms (Shelby et al. 2023).”
InfluentialAlignment Is Not Enough: A Relational Framework for Moral Standing in Human-AI InteractionPreprint
Pasandi, F. B., & Pasandi, H. B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.00078 · Cited by 1
“Shelby et al. [Shelby et al., 2023] developed a taxonomy of sociotechnical harms, and algorithmic impact assessments [Reisman et al., 2018, Metcalf et al., 2021] have emerged as governance instruments.”
Li, M., Bickersteth, W., Tang, N., Kapoor, P., Win, K., Zhong, P., Hong, J. I., Cranor, L. F., Heidari, H., & Shen, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.22654 · Cited by 1
Sharma, T., Krishnagiri, A., Dudas, L., Adnan, A., & Berisha, V. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.24794 · Cited by 1
“Beyond technical limitations, historically, the adverse lived experiences and harms often emerge from the operation in the world through the interplay of systems and societal power dynamics rather than from technology alone [75].”
AI-Assisted Systematization for Evaluating GenAI SystemsPreprint
Agarwal, D., Sheng, E., Atalla, C., Garcia-Gathright, J. I., Mozannar, H., Washington, H., Chouldechova, A., Barocas, S., & Wallach, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.26001 · Cited by 1
Regulating AI: Where U.S. State Policy and HCI (Mis)alignPreprint
Migineishvili, N., Gao, A., Adjagbodjou, A. D., Thakur, D., Just, R., & Reinecke, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.03292 · Cited by 1
“In the latter case, we classified reports as 1 if a single panelist had mentioned benefits (risks) of that topic in passing, and 2 if either multiple panelists had discussed benefits (risks) of that topic or one panelist had discussed benefits (risks) of that topic in depth.”
Investigating Social Bias in Narrative Image GenerationPreprint
Park, J., Min, S., Jang, E., Kim, S., Jin, J., Lim, H., Bae, G., & Hong, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.01780 · Cited by 1
“Also, such harms often arise not from overtly offensive content, but from more subtle patterns of erasure, default assumptions (Gautam et al., 2024; Shelby et al., 2023), and narrative structures (Halperin & Lukin, 2023), making them difficult to detect while still impactful.”
The 2026 Singapore Consensus on Global AI Safety Research PrioritiesPreprint
Casper, S., Galeev, O., Bengio, Y., Kankanhalli, M., Lee, W. S., Maharaj, T., Meserole, C., Ong, C.-H. L., Russell, S., Song, D., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14611 · Cited by 1
Accurate in space, unreliable in time: how LLMs represent national cultural changePreprint
Daryani, Y., Bogen, M., & Daepp, M. I. G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.01902 · Cited by 1
“In this sense, the pattern resembles the representational harms described in the literature (Shelby et al., 2023), and adds to existing concerns about cultural erasure and linguistic hegemony in these systems (Daryani et al., 2026).”
Stereotypically Yours: Portrayal and Perception of Race-Coded AI CompanionsPreprint
Claire, W., Shi, J. M., Goyal, A., Sletten, G., Zhang, R., Chandrasekharan, E., & Saha, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.20637 · Cited by 1
Consequential Behaviour and Representational Fairness in the Validation of Synthetic ResearchPreprint
Kutzner, F., Kacperski, C., de Molière, L., Chidichimo, E., Jung, M. J., Wallis, F. P. S., & He, J. K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.27690 · Cited by 1
“More recent taxonomies of sociotechnical harm and of generative AI’s social impact are more concrete (Shelby et al., 2023; Solaiman et al., 2024; Wei-dinger et al., 2022), with impact assessment frameworks that specify a process (Metcalf et al., 2021) and require indicators per affected group…”
Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
La Malfa, G., Meegahapola, L., Bogucka, E., Zhang, J. M., Luck, M., Black, E., & Quercia, D. (2026) · arXiv · doi:10.48550/arxiv.2608.08601
Kiden, S., Peter, O., Reyes-Cruz, G., Klyshbekova, M., Choi, S., Bergin, A. G., Waheed, M., Eke, D., Azim, T., Ramchurn, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.27361
“Representational harms arise with high levels of stereotypes and demeaning connotation, in particular when countries or cultures are blended and blurred with neighbours [33, 79, 93].”
InfluentialMeasuring Perception of Criminality towards Women: A Descriptive Analysis
Mohan, & Majhi, J. (2024) · International Journal of Social Science and Human Research · doi:10.47191/ijsshr/v7-i03-59
Ethics and NLP: 10 years after
Fort, K., & Névéol, A. (2024) · HAL
Augmenting Youths' Critical Consciousness Through Redesign of Algorithmic Systems
Amspoker, E., Hammer, J., Ogan, A., & Solyst, J. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632621.3671425
King, T. C., Roberts, H., Mökander, J., Tsamados, A., Taddeo, M., & Floridi, L. (2024) · AI & Society · doi:10.1007/s00146-024-02001-2
Doppelgänger's Watch: A Split Objective Approach to Large Language ModelsPreprint
Ghasemlou, S., Katiyar, A., Saraf, A., Moon, S., Pujari, M., Dönmez, P., Damavandi, B., & Kumar, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.06107
Ahrweiler, P., Abe, J., & Neumann, M. (2025) · Artificial intelligence, simulation and society · doi:10.1007/978-3-031-71678-2_1
Acceptable Use Policies for Foundation Models
Klyman, K. (2024) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v1i1.10917
Human-Machine Communication: Complete Volume. Volume 10
(2025) · Human-Machine Communication · doi:10.30658/hmc.10
MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and CrowdworkersPreprint
Jo, W., & Wojcieszak, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.16304
“Further, harm is measured differently across studies (Banko, MacKeen, and Ray 2020; Scheuerman et al. 2020; Shelby et al. 2022) and harm identification approaches are best suited for text-based messages, overlooking the increasingly popular (short) video platforms, such as YouTube, In-stagram, or…”
Ten Insights from Other Domains That Inform Responsible AI Frameworks
Allison-Hope, D., Kelley, P. G., Jana, R., McKay, A., & Woodruff, A. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36534
Lay Stakeholder Centric Sociotechnical Mechanisms for Addressing the Impacts of Generative AI
Barnett, J. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36766
The Mechanisms of Muting: Deconstructing the Technology-Mediated Violence of Silence
Moore, J. C. (2025) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3715070.3747332
“There are frameworks that expand our understanding of harm [12], but existing work does not yet reveal how digital harms translate to public health outcomes.”
Georgieva, I., Oomen, T., Dom, L., & Vethman, S. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0214
PRIDE – Parameter-Efficient Reduction of Identity Discrimination for Equality in LLMsPreprint
Menke, M., & Hagendorff, T. (2026) · Research Square · doi:10.21203/rs.3.rs-9356115/v1
Khan, B. A., Shariff, W., Coyne, R., Farooq, M. A., & Corcoran, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5767228
Xenoreproduction: Exploration and Recovery of Collapsible Modes as Core AI Safety ObjectivePreprint
Rios-Sialer, I. (2025) · Engineering Archive (engrXiv) · doi:10.31224/5890
Emerging Trends in Artificial Intelligence and Blindness: A Delphi Study
Vader, M.-L., Baguhn, S. J., & Silverman, A. M. (2025) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x251399194
“The datasets that are being used to train AI have been shown to have bias and can lead to discrimination against marginalized communities (Kamikubo et al., 2022; Lewicki et al., 2023; Shelby et al., 2023).”
Textual data bias detection and mitigation - an extensible pipeline with experimental evaluation
Görge, R., Gannamaneni, S. S., Naeven, T., Abdelwahab, H., Allende‐Cid, H., Cremers, A. B., Helmer, L., Möck, M., Schmitz, A., Xue, S., et al. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132995
An Overview of the Risk-based Model of AI GovernancePreprint
Fry, V. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.15299
Algorithmic Decision-making and Model Evaluation in Socially Consequential Domains
Herlihy, C. R. (2024) · University Libraries (University of Maryland) · doi:10.13016/rzkq-aplt
Mainardi, P. (2024) · AMS Laurea Institutional Research Repository (University of Bologna)
Lantta, J. (2025) · UTUPub (University of Turku)
Guerra, F., Rovati, L., & Baraldi, A. (2025) · IRIS UNIMORE (University of Modena and Reggio Emilia)
Antoine, J.-Y., & Lefeuvre-Halftermeyer, A. (2024) · HAL
User Agency Across the Machine Learning Pipeline
Chien, J. (2025) · eScholarship (California Digital Library)
Het begrijpen van vooroordelen in de representatie van mensen in algoritmische beslissingsnemers
Scott, K. M. (2024) · Lirias (KU Leuven)
Improving the ML Tradeoff Curve: Efficiencies in Computation, Memory, and Tuning
Chee, J. (2025) · eCommons (Cornell University) · doi:10.7298/kjgc-6754
Evaluation Reporting in AI Model Releases should be StandardizedPreprint
Dhar, R., Villegas, D. S., Karamolegkou, A., Schiavone, A., Yuan, Y., Chen, X., Li, J., Frank, S., Grazia, L. D., Swain, M., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5444574
Towards trustworthy machine learning models in vision, physics, and language applications
Girbal Eiras, F. (2024) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-ozvzpzeob
Fairness in Zeiten Künstlicher Intelligenz
Brink, A. (2025) · Nomos Verlagsgesellschaft mbH & Co. KG eBooks · doi:10.5771/9783748965039
Fairness aus Prinzip - Reflexionsleitfaden für faire KI-Entscheidungen in Unternehmen
Christ, A.-S. (2025) · Nomos Verlagsgesellschaft mbH & Co. KG eBooks · doi:10.5771/9783748965039-147
Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AIPreprint
Zhao, X., Wang, T., Schumacher, D., Rammouz, V., & Rios, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.14718
“AI in health can cause real risks, like biased decisions, unfair access, or unsafe advice (Shelby et al., 2022, 2023).”
Technical methods for governing AI agents
Chan, A. (2025) · doi:10.71781/10081
AI for Health in Canadian Journalism: Topics, Actors, Controversies, and Persuasive Strategies
Salgado Arzuaga, L. E. (2025) · doi:10.11575/prism/50751
Can Bias Embedded in Image-Generative AI Systems Influence Public Perception?
Oliveira Andrade de Melo, G. (2025) · Victoria University Research Repository (Victoria University)
From openness to openwashing: Framing a debated concept in AI
Paris, T. (2025) · eScholarship@McGill (McGill) · doi:10.82308/9017
Metadata
- Authors
- Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., & Virk, G.
- Affiliations
- Google (United States) (US)
- McGill University (CA)
- Australian National University (AU)
- Google, USA
- ORCID
- Venue
- Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2023-08-08
- Pages
- 723-741
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4386249234
- Cited by
- 279
- References
- 191
- Citations by year
- 2026: 97 · 2025: 101 · 2024: 65 · 2023: 15
- FWCI
- 69.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic harms, harm reduction, algorithmic systems, representational harm, interpersonal harm, social harm, sociocultural dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.