Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Open accessThe DOI matches its Crossref record; 205 of the 209 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms — representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms — and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
From Helpful, harmless, honest? Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback (2025) · cites this paper as Shelby et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The rapid pace of adoption of GenAI tools, when it comes to similar concerns, have significantly exacerbated the many socio-technical issues researchers have connected to education technologies in general [160, 311] and algorithmic harms related to GenAI [317] more specifically.”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [317]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent work has expressed concern around anthropomorphism leading to over-trust [1, 91], a potential path for uncertainty expression to backfire.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [91]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Our approach followed prior scoping reviews in HCI literature [74, 223], in alignment with the extension of the PRISMA checklist [133], the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [220].”
MethodScoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 5×
“We employed a descriptive-analytical method for charting data – a process of “synthesizing and interpreting qualitative data by sifting, charting and sorting material according to key issues and themes" [11, p. 26].”
BackgroundMethodInfluentialBlack Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 2×
“Thus, relying on scoping reviews’ iterative characteristic [168], we used theoretical saturation as a signal to stop sourcing new papers.”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“systems make incorrect health inferences [158].”
Background
Research works printed but not linked: 40
- 10.1093/cybsec · doi:10.1093/cybsec
- 10.18653/v1 · DOI
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. In Ethics of Data and Analytics. Auerbach Publications, Boca Raton, FL, USA, 254–264.
- Jane Bailey, Jacquelyn Burkell, Suzie Dunn, Chandell Gosse, and Valerie Steeves. 2021. AI and Technology-Facilitated Violence and Abuse. In Artificial Intelligence and the Law in Canada, Florian Martin-Bariteau and Teresa Scassa (Eds.). LexisNexis, Toronto, Canada, Chapter 10, 1–15.
- Jane Bailey, Nicola Henry, and Asher Flynn. 2021. Technology-Facilitated Violence and Abuse: International Perspectives and Experiences. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse, Bailey Jane, Flynn Asher, and Henry Nicola (Eds.). Emerald Publishing Limited, Bingley, UK, 1–17.
- 10.18653/v1 · DOI
- Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The Problem with Bias: Allocative Versus Representational Harms in Machine Learning. In 9th Annual Conference of the Special Interest Group for Computing, Information and Society. Society for the History of Technology, Philadelphia, PA, USA.
- Samy Bengio Alina Beygelzimer Kate Crawford Jeanne Fromer Iason Gabriel Amanda Levendowski Deborah Raji and Marc’Aurelio Ranzato. 2022. Provisional Draft of the NeurIPS Code of Ethics. https://openreview.net/pdf?id=zVoy8kAFKPr
- 10.1177/205630511667248 · doi:10.1177/205630511667248
- 10.18653/v1 · DOI
- 10.5555/380681 · doi:10.5555/380681
- Virginia Braun and Victoria Clarke. 2021. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative research in psychology 18, 3 (2021), 328–352.
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. https://proceedings.mlr.press/v81/buolamwini18a.html
- Jacquelyn Burkell and Jane Bailey. 2018. Unlawful Distinctions? Canadian Human Rights Law and Algorithmic Bias. Vol. 2016/2018. Human Rights Research and Education Centre Ottawa, Ottawa, Canada, 217–230.
- Kate Crawford. 2017. Keynote: The Trouble with Bias. 2017 Conference on Neural Information Processing Systems, invited speaker.
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Boston, MA, USA.
- Batya Friedman and David G Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Boston, MA, USA.
- Steve Fuller. 1993. Helen E. Longino Science As Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton: Princeton University Press (1990), xi+ 262 pp., 19.95. Philosophy of Science 60, 2 (1993), 360–362.
- Jan Hadja. 1961. Alienation and Integration of Student Intellectualss. American Sociological Review 26, 5 (1961), 19.
- 10.1177/104973231666534 · doi:10.1177/104973231666534
- 10.1177/146144482095872 · doi:10.1177/146144482095872
- Shawn Janzen, Caroline Orr, and Sara-Jayne Terp. 2022. Cognitive Security and Resilience: A Social Ecological Model of Disinformation and Other Harms with Applications to COVID-19 Vaccine Information Behaviors. In 2nd Workshop Reducing Online Misinformation through Credible Information Retrieval. ROMCIR 2022, Stavanger, Norway, 48–88.
- Jared Katzman, Solon Barocas, Su Lin Blodgett, Kristen Laird, Morgan Klaus Scheuerman, and Hanna Wallach. 2021. Representational Harms in Image Tagging. Beyond Fair Computer Vision Workshop at CVPR 2021 (2021).
- Hank Liao, Golan Pundak, Olivier Siohan, Melissa Carroll, Noah Coccaro, Qi-Ming Jiang, Tara N Sainath, Andrew Senior, Françoise Beaufays, and Michiel Bacchiani. 2015. Large Vocabulary Automatic Speech Recognition for Children. In Interspeech 2015. International Speech Communication Association, Dresden, Germany, 1–5.
- 10.1093/ojls · doi:10.1093/ojls
- Emanuel Moss and Jacob Metcalf. 2020. Ethics Owners: A New Model of Organizational Responsibility in Data-Driven Technology Companies. https://datasociety.net/wp-content/uploads/2020/09/Ethics-Owners_20200923-DataSociety.pdf
- Emmanuel Moss and Jacob Metcalf. 2022. Data and Society Workshop: The Social Life of Algorithmic Harms. (March 2022).
- Aik Kwang Ng, David YF Ho, Shyh Shin Wong, and Ian Smith. 2003. In Search of the Good Life: A Cultural Odyssey in the East and West. Genetic, Social, and General Psychology Monographs 129, 4 (2003), 317.
- Safiya Umoja Noble. 2016. A Future for Intersectional Black Feminist Technology Studies. Scholar & Feminist Online 13, 3 (2016), 1–8.
- Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books, New York, NY, USA.
- Eva PenzeyMoog and Danielle C Slakoff. 2021. As Technology Evolves, So Does Domestic Violence: Modern-Day Tech Abuse and Possible Solutions. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse. Emerald Publishing Limited, Bingley, UK, 643–662.
- Jasbir K Puar. 2020. “I Would Rather be a Cyborg than a Boddess”: Becoming Intersectional in Assemblage Theory. In Feminist Theory Reader. Routledge, New York, NY, USA, 405–415.
- Henrik Skaug Sætra. 2021. Artificial Intelligence and its Contexts. Springer, Cham, Switzerland, Chapter A Typology of AI Applications in Politics, 27–43.
- Katie Shilton. 2015. "That’s Not An Architecture Problem!": Techniques and Challenges for Practicing Anticipatory Technology Ethics. In iConference 2015 Proceedings. iSchools Urbana-Champaign Illinois USA 1–7.
- Rebecca Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission. Yale Journal of Law & Tech. 23 (2020), 1.
- 10.1177/0002716222108470 · doi:10.1177/0002716222108470
- 10.18653/v1 · DOI
- Thi Tran, Rohit Valecha, Paul Rad, and H Raghav Rao. 2019. An Investigation of Misinformation Harms Related to Social Media During Humanitarian Crises. In International Conference on Secure Knowledge Management in Artificial Intelligence Era. Springer, Goa, India, 167–181.
- Zeynep Tufekci. 2015. Algorithmic Harms Beyond Facebook and Google: Emergent Challenges of Computational Agency. Colo. Tech. LJ 13 (2015), 203.
- Claire Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policymaking.
Cited by
Items 501–600 of 625
Khan, J. I., & Prithula, S. R. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28457-0_11
Biological risk and the AI capability shift
Turner, S. D. (2026) · doi:10.59350/zp9qy-3gg73
Mak, J., Nakatumba-Nabende, J., Clear, T., Clear, A., Abluwi, I., Andrei, O., Angeli, L., MacNeil, S., Oyelere, S. S., Hale Rattigan, M., et al. (2025) · doi:10.1145/3760545
Yacoby, Y. (2026) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3770762.3772549
“While users, affected communities, and researchers uncover new types of harm caused by AI, many are already well-known and can be anticipated (e.g. [35]).”
The Impacts and Governance of Artificial Intelligence: A Transfeminist Perspective
Attard-Frost, B. (2025) · TSpace (University of Toronto)
Porcaro, L., & Monaldi, C. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-07044-y
“The exchange and enactment of this repertoire constitute the local culture , the broader socio-symbolic process through which members of a social group make sense of their experiences and regulate their behavior.”
Hazard Management in Robot-Assisted Mammography SupportPreprint
Stefanakos, I., Bradley, R., Călinescu, R., Townsend, B., Wang, T., & Zhu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.05749
“Beyond individual interaction events, assistive robotic systems such as MammoBot must also be understood within a broader socio-technical context in which safety is shaped not only by technical reliability but also by social, ethical, and cultural dynamics [59].”
Measuring and Mitigating Allocation Unfairness Across the Machine Learning Pipeline
Maheshwari, G. (2024) · theses.fr (ABES) · doi:10.70675/53d53018z80cez4e3cz8a72z01467eb9b52c
Social and Emotional Uses of AI
Tseng, E., Adler, D. A., Walker, A. M., Shelby, R. M., Chancellor, S., Kim, E., Pendse, S. R., & Zhang, R. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778699
Self-citationSlurry-as-a-Service: A Modest Proposal on Scalable Pluralistic Alignment for Nutrient Optimization
Hong, R. S., Eiger, Y., Hutson, J. A., Keyes, O., & Agnew, W. S. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798866
“About “harm” [46].”
Algorithmic Governance and Public Accountability: Audits, Transparency, and Harm
Niwagaba, T. (2026) · NEWPORT INTERNATIONAL JOURNAL OF CURRENT ISSUES IN ARTS AND MANAGEMENT · doi:10.59298/nijciam/2025/71.1019
Sociotechnical Imaginaries of Responsible Design: A Case for Mitigating Gender-based Online Harm
Zhang, M., Bandara, A. K., Rugg, G., Rauf, I., Gamage, D., Nuseibeh, B., Podestà, S., Cai, W., & Robinson, S. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778700
Black LLMirror: User (Self) Perceptions in Black American English Interactions with LLMs
Campbell, M. M., Mire, J., Díaz, M., & Sap, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791111
“Many of these disparities fall under Shelby et al. [60]’s taxonomy of identity-based quality-of-service harms, such as additional labor, service benefit loss, and alienation.”
Schieber, E. A. G., & Schlesinger, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791245
“Digitally-facilitated safety risks are caused by a wide variety of (potential) harms, such as emotional distress, financial loss, threats to physical or sexual safety, impersonation, coercion, hacking, doxxing, and exposure to hateful or disturbing content [54, 112, 116, 122, 132, 140].”
Reinmund, T., Kunze, L., & Jirotka, M. D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790547
“Others propose a more relational perspective, suggesting that sociotechnical challenges are due to interactions and interplays between technical and social factors [70, 86].”
Bridging NASSS Domains and Resilience Pillars to Mitigate LLM Risk in Digital Government
Siougioudi, V., & Stamati, T. (2026) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2026.287
THINKING ISSUES: On Activism within Academic Computing
Connolly, R. W. (2026) · ACM Inroads · doi:10.1145/3797965
“…a fast-growing body of research within fields such as law [5, 17], linguistics [2], psychology [11], cognitive science [20], political science [21], and of course computing [24,29,30] as well over the past five years with regard to both big data practices and generative artificial intelligence.”
Correia, A., Mohseni, H., Sikström, P., & Kärkkäinen, T. (2026) · International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA) · doi:10.1109/acdsa67686.2026.11468048
“Since sociotechnical harms tend to manifest via AI systems and to disproportionately affect culturally marginalized and stigmatized groups [9], adopting an ethically and culturally responsive approach to AI design must be put at center stage when dealing with the cultural needs of each musician…”
Calderón, C. M. B. (n.d.) · PhilPapers (PhilPapers Foundation)
Hadiprakoso, R. B., Dramaga, R., & Qomariasih, N. (2026) · Jurnal Ilmiah Ilmu Terapan Universitas Jambi|JIITUJ| · doi:10.22437/jiituj.v10i2.53435
Systems Governance for Trustworthy AI: A Framework for Environmental Accountability
Zeleti, F. A. (2026) · Systems · doi:10.3390/systems14050485
AI Innovation, Safety, and Regulation in Canada: Perspectives from the Editorial Committee
Sen, A., Clarke, A., Morales, J. S., Penney, J. W., & Scassa, T. (2026) · Canadian Public Policy · doi:10.3138/cpp.2025-066
Beyond Distributive Justice: Hermeneutical Fairness in Ad DeliveryPreprint
Quaresmini, C., Breschi, V., Leoni, J., Schiaffonati, V., Tanelli, M., & Pasquale, G. D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.03419
“…and opportunities for knowing - along with distributive accounts in online ads to capture the full social stakes of algorithmic systems, as argued by a growing body of work (see, e.g., [Hoffmann(2019), Selbst et al.(2019), Shelby et al.(2023), Wegner et al.(2024), Grgi ´ c-Hla ˇ ca et al.(2018)]).”
Khana, B., Shariff, W., Coyne, R., Farooq, M. A., & Corcoran, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.06439
“…have revealed that facial analysis algorithms often underperform for individuals with darker skin tones, non-Western facial features, or those wearing cultural or religious head coverings, leading to inaccurate assessments of attention or fatigue levels (Shelby et al., 2023; Jambholkar, 2024).”
Bandy, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-19438-1_2
DisaBench: A Participatory Evaluation Framework for Disability Harms in Language ModelsPreprint
Kim, E., Tanase, I., & Mallon, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.12702
Fang, W., & Nie, C. (2026) · Information Research · doi:10.47989/ir31263122
Context Matters: Auditing Gender Bias in T2I Generation through Risk-Tiered Use-Case Profiles
Luna, J., Wu, Y., Xie, X., & García, N. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812261
AI Surveillance Technologies and Cybersecurity: Bridging National Security and Privacy Rights
Chhajed, S., Bhalse, Y., & Yadav, H. (2025) · Digital Social Sciences · doi:10.69971/dss.2.2.2025.43
Information is a gun: recognising information facilitated interpersonal harms
Chen, Y., & McKay, D. (2026) · Information Research · doi:10.47989/ir31isic65256
Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms
Bhange, M., Aïvodji, U., & Creager, E. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i1.43152
“Shelby et al. [2023] formalize such effects as representational harms , including erasure of social groups, alienation of those whose membership the system fails to acknowledge, denial of the opportunity to self-identify, and reification of essentialist categories.”
InfluentialPääkkönen, T., & Miettinen, S. (2026) · Proceedings of DRS · doi:10.21606/drs.2026.784
Reclaiming the Future: Visions of AI and Disability in the 2020s
Vader, M.-L., Romero, E. M., Heydarian, C. H., Baguhn, S. J., & Silverman, A. M. (2026) · International Web for All Conference (W4A) · doi:10.1145/3800424.3800611
Insidious by Design: Implications of Large Language Model Algorithmic Bias for the Global SouthPreprint
McKenna, S., & Tshuma, N. (2026) · Preprints.org · doi:10.20944/preprints202606.0485.v1
Crichton, K., Reddy, A., & Ji, J. (2026) · doi:10.51593/20250002
AI for Social Responsibility in Cybersecurity and Societal Applications
Ramachandran, M. (2026) · Texts in computer science · doi:10.1007/978-3-032-25874-8_23
Characterizing Cultural Localization in AI-Generated StoriesPreprint
Bhatt, S., Vijay, S., Milbauer, J., & Díaz, F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.14626
Luo, Z. (2026) · Media Literacy and Academic Research · doi:10.34135/mlar-26-01-01
"Are you biased right now, AI?": Investigating Supporting Youths' Systematic Evaluation of GenAI
Solyst, J., Walker, L., Handa, S., Nurdin, F., & Shapiro, R. B. (2026) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3773077.3806125
“Evaluating GenAI may involve recognizing both technical limitations (e.g., inconsistency, prompt sensitivity) and socio-technical concerns (e.g., representational harms, unfair resource allocation) [49].”
Humans and the Steepness of Hills - A Review of Estimate Studies
Forsén, N. (2026) · Jyväskylä University Digital Archive (University of Jyväskylä) · doi:10.13140/rg.2.2.10322.52164
From formal to informal: how register shift confuses LLMs in Spanish dialect recognition
Zander-Marzano, S. A., Hernández‐Orallo, J., Martínez‐Plumed, F., Amores-Giner, P., & Mehrbakhsh, B. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01177-8
“We therefore recommend that deployment be accompanied by access controls, audit logging, and explicit prohibitions on use for profiling [49], alongside the technical safeguards (reject options, entity masking) discussed above.”
Rao, P. S. B., Venkatesan, L. N. N., Jayagopi, D. B., & Cherubini, M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812234
“In this sense, the harms identified by job seekers extend beyond allocative or representational concerns toward psychological harms that affect users’ confidence, self-presentation, and emotional regulation through iterative engagement with the system [10, 12, 67].”
InfluentialDiscriminatory Compliance: How LLMs Answer Queries from Protected GroupsPreprint
Ayyappan, D., & Castillo, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.21296
“The analysis across different groups shows the risk of sociotechnical harm (Shelby et al. 2023) and epistemic in-justice (Kay, Kasirzadeh, and Mohamed 2025), when we consider the default response by LLMs to a wide range of well-being and help-seeking questions.”
InfluentialAdolescence to Adulthood Online: Tracing Youth Digital Expression on Reddit Over 13 YearsPreprint
Chang, T., Patel, K. N., Razi, A., & Phadke, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.20612
Molin, L. D. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806520
Online Communities as Collaborative Testbeds for Collective Alignment
Zent, M., Khadar, M., Yarosh, S., Chancellor, S., & Kaur, H. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812370
“Beyond effectiveness, the potential for systemic harm to manifest in ML systems is well-documented, encompassing failures related to equity, interpersonal relationships, and society [15, 27, 47, 65, 103, 139, 150].”
Future Imperfect? Evaluating Whether AI-Powered Web Accessibility Overlays are Worth the Hype
Hartman, P., & Gorichanaz, T. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812259
“Drawing on Shelby et al.’s [45] taxonomy of algorithmic harms, overlays can produce, for example, Represen-tational Harms by misrepresenting people in alt text generation, potentially erasing or alienating certain social groups [see [4]].”
Wood, M. A. (2026) · Crime Media Culture An International Journal · doi:10.1177/17416590261461898 · Cited by 1
Statistical and Structural Approaches to Algorithmic FairnessPreprint
Ferrara, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.26200
Shukla, N. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806457
From Concepts to Practice: Challenges of Risk-Benefit Assessment in AI Research & Applications
Eslami, M., Xie, S., Nikookar, N., Chang, M. L., Peng, C., Kim, J., Zimmerman, J., & Heidari, H. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812216
“For example, prior work has focused predominantly on identifying and mitigating risks and harms such as bias, discrimination, lack of transparency, and privacy violations [27, 37, 39, 42, 46].”
Examining Subject Selection Bias in Unlabeled Motion Capture Datasets using Gait Analysis
Kralofsky, B. (2026) · reposiTUm (TU Wien) · doi:10.34726/hss.2026.122573
Tiwari, A., Arrabito, R., Davoust, A., & Falk, T. H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30015-7_9
Queering the Audits: Community-Based Auditing of AI Harms to Queer Communities
QueerInAI, O. O., Pranav, A., Valentine, A. A., Markham, A., LeClair, B., Blazkova, T., Kornilitsina, E., Bruun, S. H., Spanakis, G., & Lauscher, A. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5acrwqmesyw4
Situation Perception: A Necessary Primitive to Artificial SuperintelligencePreprint
Yuan, Z., & Chua, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.30481
Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AI
Zhao, X., Wang, T., Schumacher, D., Rammouz, V., & Rios, A. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.413
“AI in health can cause real risks, like biased decisions, unfair access, or unsafe advice (Shelby et al., 2022, 2023).”
Banaybanay, R. J., & Ricafort, R. B. (2026) · International Journal of Latest Technology in Engineering Management & Applied Science · doi:10.51583/ijltemas.2026.150600080
Parrish, A., Shinde, R., Badhe, S., Bai, X., Balija, S. B., Chu, H.-R., Ferrara, E., Foundjem, A. T., Ghosh, R., Gupta, A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.06196
“…body of benchmarks now stress-test models for harmful behavior at scale, from broad taxonomies of language-model risk (Weidinger et al., 2022; Shelby et al., 2023) and human-feedback alignment (Bai et al., 2022; Ganguli et al., 2022) to industry benchmarks such as the MLCommons AILuminate…”
Disability as Mere-Difference and What It Means for Randomized Controlled Trials
Barnhart, A. J., & Braun, M. (2026) · The American Journal of Bioethics · doi:10.1080/15265161.2026.2691941
Lichtenberg, S., Gatt, A., & Masthoff, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.08515
“Generative AI reproduces and amplifies existing social biases in its outputs [5, 7, 13, 29, 36, 37, 58, 77, 87, 103], raising concerns about potential harms to marginalized groups [7, 36, 77, 76, 92].”
Andalibi, N., & Haimson, O. L. (2026) · ACM Journal on Responsible Computing · doi:10.1145/3831367
“We contribute the Perceived Personal Algorithmic Harms Scale that entails three subscales: algorithmic stigma, algorithmic privacy harms, and tangible algorithmic harms.”
InfluentialMeasuring Differential Responses: A Cross-Engine Audit of Generative AI Bias
Chernosky, J., & Halvarsson, E. M. (2026) · Issues in Informing Science and Information Technology · doi:10.28945/5805
Thought Experiments for Conceptual Work: A New Application of a (Very) Old MethodPreprint
Ajmani, L., Houtti, M., Baumer, E. P. S., & Chancellor, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.12092
Tiwari, A., Arrabito, R., Davoust, A., & Falk, T. H. (2026) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms69701.2026.11602273
“This constitutes a form of quality-of-service harm, as defined by Shelby et al. [18], wherein a system provides systematically lower or inappropriate levels of service to specific user groups, thereby raising fairness concerns.”
Welfare and AI: Female Representation and Social Inequalities
Ferrari, M. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-3043-1.ch011
A Mandate Beyond Accuracy: Forging the Algorithm’s Social Contract
Singh, N., & Foulds, J. R. (2026) · Artificial intelligence · doi:10.5772/intechopen.1015619
Berman, G., & Smithies, J. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009625180.009
Who's responsible anyway? Contextualising governance innovation in the age of AI
Ganesh, B. (2026) · ERA · doi:10.7488/era/7465
Red Teaming with Faith Leaders: Expanding Digital Safety and Accountability to Frontiers of CarePreprint
Lutz, N., & Weyl, E. G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6663398
Harms associated with engaging with AI for mental health support: A scoping review protocol
Hunt, X., Mokaya, A. G., Zannone, S., van Heerden, A. C., Sartor, C., Mateen, B. A., & Williams, G. (2026) · Wellcome Open Research · doi:10.12688/wellcomeopenres.27439.1
Kiden, S., Peter, O., Reyes-Cruz, G., Klyshbekova, M., Choi, S., Bergin, A., Waheed, M., Eke, D., Azim, T., Ramchurn, S. D., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7228948
Hwang, A. (2026) · International journal of communication · doi:10.65476/e20tjk66
AI-augmented Collaboration in Crowdsourcing : Threats and Opportunities
Chaves, R., Schneider, D., de Souza, J. M., Mohseni, H., & Correia, A. (2025) · Jyväskylä University Digital Archive (University of Jyväskylä)
Bo, J. Y., Aoyagui, P. A., Rismani, S., Das, D., Ahmed, S. I., & Anderson, A. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i1.43154
Self-citation“Death By A Thousand Taxonomies?”: AI Risk Classification In Practice
Berman, G., Cooper, N., Hwang, A. H., Deng, W. H., Shelby, R., & Hutchinson, B. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i1.43151
Self-citationAbstracted Away: Resisting Alienation and Ungrounded Abstraction in AI Research Communities
Raman, V., Gallegos, I. O., & Srivathsa, N. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i3.43296
“• Sociotechnical harms toward affected communities arise when AI systems produce adverse impacts in the social contexts in which they are used (Shelby et al. 2023).”
Empirically Derived AI Harm Profiles and the Case for Context-Sensitive Moral ResponsibilityPreprint
Mumtaz, U., Noor, R., & Mumtaz, S. (2026) · Research Square · doi:10.21203/rs.3.rs-10542055/v1
BEYOND FAIRNESS METRICS: HUMAN EXPERIENCES AND DIFFERENTIAL OUTCOMES IN AI-MEDIATED WORK SETTINGS
Kadoma, K. (2026) · eCommons (Cornell University) · doi:10.7298/4h41-w092
Value conflicts in natural language processing: A systematic literature review
Forsberg, R., & Nelimarkka, M. (2026) · Big Data & Society · doi:10.1177/20539517261481724
Risk Dimensions of Artificial Intelligence: Navigating the Uncharted Waters of Innovation
Lindeque, E. G. (2026) · Springer eBooks · doi:10.1007/978-981-95-9489-4_1
Turning Domain Expertise into Multi-Dimensional Evaluation of Biomedical AI with KareninaPreprint
Carli, F., Rusina, P. V., Ai, L., Küchenhoff, L., To, P. K. P., McDonagh, E. M., Lobentanzer, S., Petroni, F., Dugourd, A. J. F., Ochoa, D., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.01.748513
A Conceptual Typology of Scientific Harm from Misused Materials AI
Okafor, C., & Bello, A. (2024) · Journal of Artificial Intelligence for Materials Science · doi:10.68159/u520585185
150151Chapter 7 The Ordinary Ethics of Evaluating AI: A Provocation for Mapping Implications of AI
Singh, R. (2026) · De Gruyter eBooks · doi:10.1515/9783111373096-008
Enhancing Privacy, Neglecting Harms: An Analysis of Real-World Digital Privacy IncidentsPreprint
Veitch, S., Shem, C., Csomor, L., Dudiy, O., Kim, N., Le, K., Saha, L., Viand, A., Hithnawi, A., & Kacsmar, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.07217
“We broaden the scope of prior work and leverage expertise in privacy technologies to evaluate a wider range of harm mitigations [38,62,90,94,106,114,118], exploring the failures and potential of PETs for harm prevention.”
Cantwell, S., & Goldkind, L. (2026) · Oxford University Press eBooks · doi:10.1093/9780197851364.003.1706
Exploring Backdoor Vulnerabilities and Fairness Challenges in Generative Models: A Survey
Holland, R., Pal, S., & Pan, L. (2026) · ACM Computing Surveys · doi:10.1145/3847107
Gallardo, A., Klucinec, L., Bauer, L., & Cranor, L. F. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3817022
“To categorize the harms listed by participants in our study, we use Shelby et al.’s taxonomy of sociotechnical harms of algorithmic systems, which was based on a scoping review of 172 research articles [115].”
InfluentialRahman, M. H., Sadek, M., & Desai, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.25586
“…conventions, this convergence pulls non-Western users’ writing toward those norms unless they prompt against it [1], a hidden cost for the Majority World that runs from stereotype reinforcement and global power imbalances to less usable and more harmful systems [33, 44, 86, 89, 91, 105, 118, 147].”
Balayn, A., Rancourt, F., Casati, F., & Gadiraju, U. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816909
“[31, 70, 99, 130].”
Bravo, M. G. M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7500980
Hermawan, N. (2026) · Jurnal Pendidikan dan Teknologi Indonesia · doi:10.52436/1.jpti.1995
Algorithmic Harms Associated with Generative Model-Augmented Recommendation SystemsPreprint
Herlihy, C. P., Xi, X., Desai, S., Hutchful, K. B., & Silva, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.33073
“While Suresh and Guttag [30] focus on the causes of the harms, Shelby et al. [28] take a different approach by categorizing harms according to the types of impact they have.”
Agents as Software: A Programming Languages Agenda for Agent Reliability
Barke, S., & Murali, A. (2026) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3840586.3843744
“There is a significant body of literature on "harms" that AI systems can perpetuate that is centered more on hu-manistic and social concerns [27, 41, 48].”
Why and How People Check Generative AI Output for Mistakes
Kelley, P. G., Feldmann, D., Jana, R., Thompson-Kuhn, C., & Woodruff, A. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i2.43242
Malmio, I., & Wester, M. (2026) · AI & Society · doi:10.1007/s00146-026-03383-1
Nygaard‐Christensen, M., Collins, A. B., & Fabricius, V. A. V. (2026) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2026.105524
Dai, J., Wani, S., Robinson, Z., Hajiyeva, N., & Scheuerman, M. K. (2024) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Systemization of Knowledge (SoK): Human-Centered AI Safety for YouthPreprint
Saha, P., Yu, Y., & Wang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08554
“[122, 146, 164].”
Move Fast and Mend Things: Keeping Up with Evolving AI Harms Using Social Media CommentaryPreprint
Rowe, J., Srivastava, A., Peddinti, S. T., El-Sayed, S., & Taft, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.09082
“…also capture perspectives on AI-related harms that product and complaint logs may miss, as AI impacts extend far beyond direct users of a system [87] and certain structural worries or complaints about AI tools, such as fears of unauthorized data use, are not discernable from system telemetry…”
Exploring Ethics Governance for AI as Research Object and Research Tool
Mathew, S., Finn, M., Munteanu, C., Shilton, K., & Wong, R. Y. (2026) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3785651.3818814
Metadata
- Authors
- Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., & Virk, G.
- Affiliations
- Google (United States) (US)
- McGill University (CA)
- Australian National University (AU)
- Google, USA
- ORCID
- Venue
- Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2023-08-08
- Pages
- 723-741
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4386249234
- Cited by
- 279
- References
- 191
- Citations by year
- 2026: 97 · 2025: 101 · 2024: 65 · 2023: 15
- FWCI
- 69.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic harms, harm reduction, algorithmic systems, representational harm, interpersonal harm, social harm, sociocultural dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.