Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Open accessThe DOI matches its Crossref record; 205 of the 209 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms — representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms — and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
From Helpful, harmless, honest? Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback (2025) · cites this paper as Shelby et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The rapid pace of adoption of GenAI tools, when it comes to similar concerns, have significantly exacerbated the many socio-technical issues researchers have connected to education technologies in general [160, 311] and algorithmic harms related to GenAI [317] more specifically.”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [317]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent work has expressed concern around anthropomorphism leading to over-trust [1, 91], a potential path for uncertainty expression to backfire.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [91]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Our approach followed prior scoping reviews in HCI literature [74, 223], in alignment with the extension of the PRISMA checklist [133], the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [220].”
MethodScoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 5×
“We employed a descriptive-analytical method for charting data – a process of “synthesizing and interpreting qualitative data by sifting, charting and sorting material according to key issues and themes" [11, p. 26].”
BackgroundMethodInfluentialBlack Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 2×
“Thus, relying on scoping reviews’ iterative characteristic [168], we used theoretical saturation as a signal to stop sourcing new papers.”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“systems make incorrect health inferences [158].”
Background
Research works printed but not linked: 40
- 10.1093/cybsec · doi:10.1093/cybsec
- 10.18653/v1 · DOI
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. In Ethics of Data and Analytics. Auerbach Publications, Boca Raton, FL, USA, 254–264.
- Jane Bailey, Jacquelyn Burkell, Suzie Dunn, Chandell Gosse, and Valerie Steeves. 2021. AI and Technology-Facilitated Violence and Abuse. In Artificial Intelligence and the Law in Canada, Florian Martin-Bariteau and Teresa Scassa (Eds.). LexisNexis, Toronto, Canada, Chapter 10, 1–15.
- Jane Bailey, Nicola Henry, and Asher Flynn. 2021. Technology-Facilitated Violence and Abuse: International Perspectives and Experiences. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse, Bailey Jane, Flynn Asher, and Henry Nicola (Eds.). Emerald Publishing Limited, Bingley, UK, 1–17.
- 10.18653/v1 · DOI
- Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The Problem with Bias: Allocative Versus Representational Harms in Machine Learning. In 9th Annual Conference of the Special Interest Group for Computing, Information and Society. Society for the History of Technology, Philadelphia, PA, USA.
- Samy Bengio Alina Beygelzimer Kate Crawford Jeanne Fromer Iason Gabriel Amanda Levendowski Deborah Raji and Marc’Aurelio Ranzato. 2022. Provisional Draft of the NeurIPS Code of Ethics. https://openreview.net/pdf?id=zVoy8kAFKPr
- 10.1177/205630511667248 · doi:10.1177/205630511667248
- 10.18653/v1 · DOI
- 10.5555/380681 · doi:10.5555/380681
- Virginia Braun and Victoria Clarke. 2021. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative research in psychology 18, 3 (2021), 328–352.
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. https://proceedings.mlr.press/v81/buolamwini18a.html
- Jacquelyn Burkell and Jane Bailey. 2018. Unlawful Distinctions? Canadian Human Rights Law and Algorithmic Bias. Vol. 2016/2018. Human Rights Research and Education Centre Ottawa, Ottawa, Canada, 217–230.
- Kate Crawford. 2017. Keynote: The Trouble with Bias. 2017 Conference on Neural Information Processing Systems, invited speaker.
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Boston, MA, USA.
- Batya Friedman and David G Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Boston, MA, USA.
- Steve Fuller. 1993. Helen E. Longino Science As Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton: Princeton University Press (1990), xi+ 262 pp., 19.95. Philosophy of Science 60, 2 (1993), 360–362.
- Jan Hadja. 1961. Alienation and Integration of Student Intellectualss. American Sociological Review 26, 5 (1961), 19.
- 10.1177/104973231666534 · doi:10.1177/104973231666534
- 10.1177/146144482095872 · doi:10.1177/146144482095872
- Shawn Janzen, Caroline Orr, and Sara-Jayne Terp. 2022. Cognitive Security and Resilience: A Social Ecological Model of Disinformation and Other Harms with Applications to COVID-19 Vaccine Information Behaviors. In 2nd Workshop Reducing Online Misinformation through Credible Information Retrieval. ROMCIR 2022, Stavanger, Norway, 48–88.
- Jared Katzman, Solon Barocas, Su Lin Blodgett, Kristen Laird, Morgan Klaus Scheuerman, and Hanna Wallach. 2021. Representational Harms in Image Tagging. Beyond Fair Computer Vision Workshop at CVPR 2021 (2021).
- Hank Liao, Golan Pundak, Olivier Siohan, Melissa Carroll, Noah Coccaro, Qi-Ming Jiang, Tara N Sainath, Andrew Senior, Françoise Beaufays, and Michiel Bacchiani. 2015. Large Vocabulary Automatic Speech Recognition for Children. In Interspeech 2015. International Speech Communication Association, Dresden, Germany, 1–5.
- 10.1093/ojls · doi:10.1093/ojls
- Emanuel Moss and Jacob Metcalf. 2020. Ethics Owners: A New Model of Organizational Responsibility in Data-Driven Technology Companies. https://datasociety.net/wp-content/uploads/2020/09/Ethics-Owners_20200923-DataSociety.pdf
- Emmanuel Moss and Jacob Metcalf. 2022. Data and Society Workshop: The Social Life of Algorithmic Harms. (March 2022).
- Aik Kwang Ng, David YF Ho, Shyh Shin Wong, and Ian Smith. 2003. In Search of the Good Life: A Cultural Odyssey in the East and West. Genetic, Social, and General Psychology Monographs 129, 4 (2003), 317.
- Safiya Umoja Noble. 2016. A Future for Intersectional Black Feminist Technology Studies. Scholar & Feminist Online 13, 3 (2016), 1–8.
- Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books, New York, NY, USA.
- Eva PenzeyMoog and Danielle C Slakoff. 2021. As Technology Evolves, So Does Domestic Violence: Modern-Day Tech Abuse and Possible Solutions. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse. Emerald Publishing Limited, Bingley, UK, 643–662.
- Jasbir K Puar. 2020. “I Would Rather be a Cyborg than a Boddess”: Becoming Intersectional in Assemblage Theory. In Feminist Theory Reader. Routledge, New York, NY, USA, 405–415.
- Henrik Skaug Sætra. 2021. Artificial Intelligence and its Contexts. Springer, Cham, Switzerland, Chapter A Typology of AI Applications in Politics, 27–43.
- Katie Shilton. 2015. "That’s Not An Architecture Problem!": Techniques and Challenges for Practicing Anticipatory Technology Ethics. In iConference 2015 Proceedings. iSchools Urbana-Champaign Illinois USA 1–7.
- Rebecca Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission. Yale Journal of Law & Tech. 23 (2020), 1.
- 10.1177/0002716222108470 · doi:10.1177/0002716222108470
- 10.18653/v1 · DOI
- Thi Tran, Rohit Valecha, Paul Rad, and H Raghav Rao. 2019. An Investigation of Misinformation Harms Related to Social Media During Humanitarian Crises. In International Conference on Secure Knowledge Management in Artificial Intelligence Era. Springer, Goa, India, 167–181.
- Zeynep Tufekci. 2015. Algorithmic Harms Beyond Facebook and Google: Emergent Challenges of Computational Agency. Colo. Tech. LJ 13 (2015), 203.
- Claire Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policymaking.
Cited by
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441
Gemini: A Family of Highly Capable Multimodal Models
Gemini Team, Anil, R., Borgeaud, S., Alayrac, J.-B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A. M., Hauth, A., Millican, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.11805 · Cited by 990
Anil, R., Dai, A. M., Firat, O., Johnson, M., Lepikhin, D., Passos, A., Shakeri, S., Taropa, E., Bailey, P., Chen, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.10403 · Cited by 834
Foundational Challenges in Assuring Alignment and Safety of Large Language Models
Anwar, U., Saparov, A., Ramírez, J. R., Paleka, D., Turpin, M., Hase, P., Lubana, E. S., Jenner, E., Casper, S., Sourbut, O., et al. (2024) · arXiv (Cornell University) · doi:10.3929/ethz-b-000706962 · Cited by 17
Evaluating the Social Impact of Generative AI Systems in Systems and Society
Solaiman, I., Talat, Z., Agnew, W. S., Ahmad, L., Baker, D., Blodgett, S. L., Chen, C., Daumé, H., Dodge, J., Duan, I., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.05949 · Cited by 42
Multi-Agent Risks from Advanced AI
Hammond, L., Chan, A., Clifton, J., Hoelscher-Obermaier, J., Khan, A., McLean, E., Smith, C., Barfuss, W., Foerster, J., Gavenčiak, T., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.14143 · Cited by 305
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Agarwal, D., Naaman, M., & Vashistha, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713564 · Cited by 307
“While LLM-embedded applications like text autocomplete have gained widespread global adoption, these technologies also carry significant risks, such as perpetuating harmful stereotypes about marginalized groups and underserved communities.”
InfluentialAuditing Large Language Models: A Three-Layered Approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2023) · doi:10.2139/ssrn.4361607 · Cited by 292
Auditing large language models: a three-layered approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2023) · arXiv · doi:10.48550/arxiv.2302.08500 · Cited by 292
Auditing large language models: a three-layered approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00289-2 · Cited by 289
Artificial intelligence risk management framework :
National Institute of Standards and Technology (US) (2024) · NIST Trustworthy and Responsible AI · doi:10.6028/nist.ai.600-1 · Cited by 274
The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligence
Slattery, P., Saeri, A. K., Grundy, E. A. C., Graham, J., Noetel, M., Uuk, R., Dao, J., Pour, S., Casper, S., & Thompson, N. (2026) · Patterns · doi:10.1016/j.patter.2026.101517 · Cited by 260
Why human–AI relationships need socioaffective alignment
Kirk, H. R., Gabriel, I., Summerfield, C., Vidgen, B., & Hale, S. A. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04532-5 · Cited by 131
“Attending to micro factors like cognitive load, decision-making biases, and human-automation interaction patterns has proved crucial in workplace safety (Kleiner et al. 2015), and the aviation industry (Martinussen and Hunter, 2017; Rismani et al. 2023).”
On the Limits of Artificial Intelligence (AI) in Education
Selwyn, N. (2024) · Nordisk tidsskrift for pedagogikk og kritikk · doi:10.23865/ntpk.v10.6062 · Cited by 185
Open Problems in Technical AI Governance
Reuel, A., Bucknall, B., Casper, S., Fist, T., Soder, L., Aarne, O., Hammond, L., Ibrahim, L., Chan, A., Wills, P., et al. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2407.14981 · Cited by 185
OpenAI, :, Hurst, A., Lerer, A., Goucher, A. P., Perelman, A., Ramesh, A., Clark, A., Ostrow, A., Welihinda, A., et al. (2024) · arXiv · Cited by 180
“This can lead to both allocative and representational harms [13, 15] depending on how such behavior manifests.”
BackgroundAlderman, J. E., Palmer, J., Laws, E., McCradden, M. D., Ordish, J., Ghassemi, M., Pfohl, S. R., Rostamzadeh, N., Cole-Lewis, H., Glocker, B., et al. (2025) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00224-3 · Cited by 170
Self-citationInternational AI Safety Report 2026Preprint
Bengio, Y., Clare, S., Prunkl, C., Andriushchenko, M., Bucknall, B., Murray, M., Bommasani, R., Casper, S., Davidson, T., Douglas, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.21012 · Cited by 177
Self-citationPolicy advice and best practices on bias and fairness in AI
Álvarez, J. M., Colmenarejo, A. B., Elobaid, A., Fabbrizzi, S., Fahimi, M., Ferrara, A., Ghodsi, S., Mougan, C., Papageorgiou, I. T., Lobo, P. R., et al. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09746-w · Cited by 161
“However, many concerns have been raised about the—intentional or unintentional— negative impacts on individuals and society due to biases embedded in AI models 1 (Future of Privacy Forum, 2017; Shelby et al., 2023).”
Harms from Increasingly Agentic Algorithmic Systems
Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149
Self-citationKim, S. S. Y., Liao, Q. V., Vorvoreanu, M., Ballard, S., & Vaughan, J. W. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658941 · Cited by 147
Supporting Human-AI Collaboration in Auditing LLMs with LLMs
Rastogi, C., Tulio Ribeiro, M., King, N., Nori, H., & Amershi, S. (2023) · Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604712 · Cited by 78
Mapping the ethics of generative AI: a comprehensive scoping review
Hagendorff, T. (2024) · Minds and Machines · doi:10.1007/s11023-024-09694-w · Cited by 141
“…is a further predominant concern, again focusing notably on LLMs and text-to-image models (Bommasani et al., 2021; Dwivedi et al., 2023; Epstein et al., 2023; Illia et al., 2023; Li, 2023; Mozes et al., 2023; Shelby et al., 2023; Strasser, 2023; Wang et al., 2023c, 2023e; Weidinger et al., 2022).”
InfluentialGenerative Echo Chamber? Effect of LLM-Powered Search Systems on Diverse Information Seeking
Sharma, N., Liao, Q. V., & Xiao, Z. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642459 · Cited by 132
Zhang, R., Li, H., Meng, H., Zhan, J., Gan, H., & Lee, Y.-C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713429 · Cited by 123
“By focusing on mechanisms rather than solely on harm content or consequences, this typology complements existing taxonomies and frameworks in the field [26, 84, 98].”
InfluentialKirk, H. R., Vidgen, B., Röttger, P., & Hale, S. A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00820-y · Cited by 122
“Some risks are inherited from LLMs 15–17 and artificial intelligence (AI) systems 18 more generally.”
A toolbox for surfacing health equity harms and biases in large language models
Pfohl, S. R., Cole-Lewis, H., Sayres, R., Neal, D., Asiedu, M., Dieng, A., Tomasev, N., Rashid, Q. M., Azizi, S., Rostamzadeh, N., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03258-2 · Cited by 113
Self-citationNot My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators
Hutiri, W. T., Papakyriakopoulos, O., & Xiang, A. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658911 · Cited by 113
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications
Radharapu, B., Robinson, K., Aroyo, L. M., & Lahoti, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.37 · Cited by 111
Seamful XAI: Operationalizing Seamful Design in Explainable AI
Ehsan, U., Liao, Q. V., Passi, S., Riedl, M. O., & Daumé, H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637396 · Cited by 105
“2) Instead of treating seams as problematic negatives to be erased, they can be leveraged by strategically revealing (and concealing) seams to users.”
BackgroundThe beginning of ChatGPT – a systematic and bibliometric review of the literature
Baber, H., Nair, K., Gupta, R., & Gurjar, K. (2024) · Information and Learning Sciences · doi:10.1108/ils-04-2023-0035 · Cited by 66
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Agarwal, D., Naaman, M., & Vashistha, A. (2024) · arXiv · doi:10.48550/arxiv.2409.11360 · Cited by 99
“While LLM-embedded applications like text autocomplete have gained widespread global adoption, these technologies also carry significant risks, such as perpetuating harmful stereotypes about marginalized groups and underserved communities.”
InfluentialComputers as Bad Social Actors: Dark Patterns and Anti-Patterns in Interfaces that Act Socially
Alberts, L., Lyngs, U., & Kleek, M. G. V. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3653693 · Cited by 94
“…researchers have started exploring risks related to such technologies, most of the focus thus far has been on the level of semantics: making outputs as “helpful, honest, and harmless” as possible [53], by, for instance, guarding against biased, misleading, toxic, or inaccurate language [5, 57, 66].”
BackgroundViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generation
Jha, A., Prabhakaran, V., Denton, E., Laszlo, S., Dave, S., Qadri, R., Reddy, C. K. A., & Dev, S. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.667 · Cited by 92
“…a T2I model should reflect certain attributes associated with specific identity groups is a non-trivial question and can be most accurately determined by the respective developer and the downstream use case, taking into account the type of harm (Shelby et al., 2023) experienced by the end user.”
BackgroundThe Gradient of Generative AI Release: Methods and Considerations
Solaiman, I. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3593981 · Cited by 90
The Ethical Implications of Generative Audio Models: A Systematic Literature Review
Barnett, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604686 · Cited by 90
AI’s Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asia
Qadri, R., Shelby, R., Bennett, C. L., & Denton, R. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594016 · Cited by 85
Self-citationSimulacrum of Stories: Examining Large Language Models as Qualitative Research Participants
Kapania, S., Agnew, W. S., Eslami, M., Heidari, H., & Fox, S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713220 · Cited by 86
“Researchers examining the ethical and social risks of large-scale language models have articulated a variety of concerns that extend beyond issues of stereotypical and discriminatory outputs [97].”
Chan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., Kolt, N., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658948 · Cited by 84
AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate PoliciesPreprint
Zeng, Y., Klyman, K., Zhou, A., Yu, Y., Pan, M., Jia, R., Song, D., Liang, P., & Li, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.17864 · Cited by 85
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Ojewale, V., Steed, R., Vecchione, B., Birhane, A., & Raji, I. D. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713301 · Cited by 81
AI Safety in Generative AI Large Language Models: A SurveyPreprint
Chua, J., Li, Y., Yang, S., Wang, C., & Yao, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.18369 · Cited by 83
“This type of work, as demonstrated by Bommasani et al. (2022), Shelby et al. (2023), and Weidinger et al. (2022), offers crucial taxonomies and frameworks for comprehending the potential dangers of GAI-LLMs.”
BackgroundRismani, S., Shelby, R., Smart, A., Jatho, E., Kroll, J., Moon, A., & Rostamzadeh, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581407 · Cited by 33
Self-citationSaxena, D., & Guha, S. (2022) · ACM Journal on Responsible Computing · doi:10.1145/3616473 · Cited by 77
“Critics of AI systems across academia (e.g., References [92, 111]) and the press (e.g., References [36, 59, 64, 125]) have accumulated significant evidence regarding outcome-oriented harms caused by haphazardly deployed AI systems in the public sector, i.e., disparate harms that are caused to…”
BackgroundPosition is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)
Neumann, A., Kirsten, E., Zafar, M. B., & Singh, J. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732038 · Cited by 77
“The placementaffectsbothhowmodelsdescribedemographicgroups and how they make resource allocation decisions.”
Assessing Language Model Deployment with Risk CardsPreprint
Derczynski, L., Kirk, H. R., Balachandran, V., Kumar, S., Tsvetkov, Y., Leiser, M. R., & Mohammad, S. M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.18190 · Cited by 76
AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommonsPreprint
Ghosh, S., Frase, H., Williams, A., Luger, S. K. K., Röttger, P., Barez, F., McGregor, S., Fricklas, K., Kumar, M., Feuillade--Montixi, Q., et al. (2025) · TU/e Research Portal · doi:10.48550/arxiv.2503.05731 · Cited by 74
"I look at it as the king of knowledge": How Blind People Use and Understand Generative AI Tools
Adnin, R., & Das, M. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675631 · Cited by 73
Pedagogical framework for cultivating children's data agency and creative abilities in the age of AI
Kahila, J., Vartiainen, H., Tedre, M., Arkko, E., Lin, A., Pope, N., Jormanainen, I., & Valtonen, T. (2024) · Informatics in Education · doi:10.15388/infedu.2024.15 · Cited by 73
“It also involves the skills of making informed ethical and moral decisions, grounded in an understanding of the relational interaction of AI systems, epistemic practices, and social factors (see Shelby et al., 2023).”
BackgroundOpenAI's Approach to External Red Teaming for AI Models and SystemsPreprint
Ahmad, L., Agarwal, S., Lampe, M., & Mishkin, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.16431 · Cited by 73
“Issues such as disparate performance[35, 38] and quality of service issues[36, 37] as well as general user experience preferences are sometimes surfaced through red teaming campaigns.”
Berman, G., Goyal, N., & Madaio, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642398 · Cited by 40
Guan, J., Wu, J., Li, J., Cheng, C., & Wu, W. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.277 · Cited by 73
Gaps in the Safety Evaluation of Generative AI
Rauh, M., Marchal, N., Manzini, A., Hendricks, L. A., Comanescu, R., Akbulut, C., Stepleton, T., Mateos-Garcia, J. C., Bergman, S., Kay, J., et al. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31717 · Cited by 71
“We build on tax-onomies that provide overviews of sociotechnical harms and risks writ large (Solaiman et al. 2023; Liu et al. 2023; Shelby et al. 2023) or focus on specific areas of interest such as safety concerns (Shevlane et al. 2023) and malicious uses (Ferrara 2024).”
“They only care to show us the wheelchair”: disability representation in text-to-image AI models
Mack, K. A., Qadri, R., Denton, R., Kane, S. K., & Bennett, C. L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642166 · Cited by 67
“For example, by refusing to provide representations of people with bipolar disorder, the model sends the message that the user is incorrect or acting in bad faith for trying to prompt about a stigmatized disability and further alienates the blocked disability [76].”
BackgroundKieslich, K., Diakopoulos, N. A., & Helberger, N. (2024) · AI and Ethics · doi:10.1007/s43681-024-00497-4 · Cited by 66
“Shelby et al. [65] performed a scoping review of the computer science literature to identify five groups of AI harms (representational, allocation, quality of service, interpersonal, social system).”
Artificial intelligence and its ‘slow violence’ to human rights
Teo, S. A. (2024) · AI and Ethics · doi:10.1007/s43681-024-00547-x · Cited by 66
“…approaches that ‘freeze-frame’ technologies at its particular stage of development in time can be both under and over-inclusive as it foregrounds the technology (and its current characteristics) in question to the exclusion of the sociotechnical harms that the technology engenders [64, 120].”
Koessler, L., & Schuett, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.08823 · Cited by 66
“Companies like OpenAI, Google DeepMind, and Anthropic have the stated goal of building artificial general intelligence (AGI) – AI systems that perform as well as or better than humans on a wide variety of cognitive tasks.”
BackgroundInfluentialAttard-Frost, B., & Widder, D. G. (2025) · Big Data & Society · doi:10.1177/20539517251340603 · Cited by 62
“Other typologies of AI ethics concerns focus on categorizing harms into fine-grained subsets (Shelby et al., 2023) or on the ethical concerns related to specific types of AI models such as language models or generative AI (Solaiman et al., 2023; Weidinger et al., 2021), while inventories such as…”
Hartmann, D., de Pereira, J. R. L., Streitbörger, C., & Berendt, B. (2025) · AI and Ethics · doi:10.1007/s43681-024-00595-3 · Cited by 58
“Therefore, audits might have different scopes to account for these harms, which include quality of service harms, interpersonal harms, and social system harms (e.g. Shelby et al. [79]).”
Decolonial AI Alignment: Openness, Visesa-Dharma, and Including Excluded Knowledges
Varshney, K. R. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31739 · Cited by 58
The Ethics of Advanced AI Assistants
Gabriel, I., Manzini, A., Keeling, G., Hendricks, L. A., Rieser, V., Iqbal, H., Tomašev, N., Ktena, I., Kenton, Z., Rodriguez, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.16244 · Cited by 57
Self-citationLearning about Responsible AI On-The-Job: Learning Pathways, Orientations, and Aspirations
Madaio, M., Kapania, S., Qadri, R., Wang, D., Zaldivar, A., Denton, E., & Wilcox, L. G. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658988 · Cited by 56
Lessons From Red Teaming 100 Generative AI ProductsPreprint
Bullwinkel, B., Minnich, A., Chawla, S., Lopez, G., Pouliot, M., Maxwell, W., de Gruyter, J., Pratt, K., Qi, S., Chikanov, N., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.07238 · Cited by 58
Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
Wang, Z. J., Kulkarni, C., Wilcox, L., Terry, M., & Madaio, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642335 · Cited by 55
Dahlgren Lindström, A., Methnani, L., Krause, L., Ericson, P., de Rituerto de Troya, Í. M., Coelho Mollo, D., & Dobbe, R. (2025) · Ethics and Information Technology · doi:10.1007/s10676-025-09837-2 · Cited by 54
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
King, T. C., Roberts, H., Mökander, J., Tsamados, A., Taddeo, M., & Floridi, L. (2024) · AI & Society · doi:10.1007/s00146-024-01950-y · Cited by 52
Holistic Safety and Responsibility Evaluations of Advanced AI ModelsPreprint
Weidinger, L., Barnhart, J. N., Brennan, J., Butterfield, C., Young, S., Hawkins, W., Hendricks, L. A., Comanescu, R., Chang, O., Rodriguez, M. D., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.14068 · Cited by 51
“…of models in development (Gemini Team et al., 2024) and foundational research which mapped out anticipated and observed risks in large generative models (e.g., Bird et al., 2023; Bommasani et al., 2022; Shelby et al., 2023; Shevlane et al., 2023; Solaiman et al., 2023; Weidinger et al., 2023).”
BackgroundSociotechnical Safety Evaluation of Generative AI Systems
Weidinger, L., Rauh, M., Marchal, N., Manzini, A., Hendricks, L. A., Mateos-Garcia, J., Bergman, S., Kay, J., Griffin, C., Bariach, B., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.11986 · Cited by 49
Morosoli, S., Reséndez, V., Naudts, L., Helberger, N., & de Vreese, C. H. (2025) · Digital Journalism · doi:10.1080/21670811.2024.2435579 · Cited by 50
“Shelby et al. (2023) created a taxonomy of sociotechnical harms from algorithmic systems more generally, including categories of representational, allocative, quality of service related, interpersonal, and systemic or social harms. these are only some of a growing body of reports that seek to…”
Mapping the individual, social and biospheric impacts of Foundation Models
Hernández, A. D., Krishna, S., Perini, A., Katell, M. A., Bennett, S., Borda, A., Hashem, Y., Hadjiloizou, S., Mahomed, S., Jayadeva, S., et al. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658939 · Cited by 48
How to design an AI ethics board
Schuett, J., Reuel, A.-K., & Carlier, A. (2025) · AI and Ethics · doi:10.1007/s43681-023-00409-y · Cited by 46
“To identify risks, they may use risk taxonomies [154, 174] or incident databases [98].”
Awumey, E., Das, S., & Forlizzi, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658945 · Cited by 46
“We organize our findings on how these technologies impact workers into a process model building on Shelby et al. spanning the development, deployment, and use of AI-powered biometric work monitoring technologies[122].”
BackgroundMethodSummon a demon and bind it: A grounded theory of LLM red teaming
Inie, N., Stray, J., & Derczynski, L. (2025) · PLoS ONE · doi:10.1371/journal.pone.0314658 · Cited by 46
“…the late Ross Anderson, Human-Computer Interaction research generates an understanding of human thinking which can help us explore and learn how people use systems, and “security researchers need to find ways of turning these ploughshares into swords (the bad guys are already working on it)” [3].”
Large Language Models as Subpopulation Representative Models: A ReviewPreprint
Simmons, G., & Hare, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.17888 · Cited by 46
AI Consent Futures: A Case Study on Voice Data Collection with Clinicians
Wilcox, L. G., Brewer, R. N., & Díaz, F. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610107 · Cited by 45
Chandra, M., Naik, S., Ford, D., Okoli, E., De Choudhury, M., Ershadi, M., Ramos, G., Hernandez, J., Bhattacharjee, A., Warreth, S., et al. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732063 · Cited by 44
What does it mean to be a responsible AI practitioner: An ontology of roles and skills
Rismani, S., & Moon, A. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604702 · Cited by 44
“around social and ethical issues of AI-based products and services [7, 38, 48, 51, 54, 56], the role of a responsible AI practitioner has emerged as a demanding position in the technology industry.”
BackgroundSelf-citationWang, S., Cooper, N., & Eby, M. R. (2024) · Big Data & Society · doi:10.1177/20539517241290220 · Cited by 43
“…to this orientation requires a shift away from interrogating individualized interactions between user and machine, and toward anticipating and understanding the effects of those interactions on human relations in complex and situated environments (Green and Viljoen, 2020; Shelby et al., 2023).”
BackgroundCanvil: Designerly Adaptation for LLM-Powered User Experiences
Feng, K. J. K., Liao, Q. V., Xiao, Z., Vaughan, J. W., Zhang, A. X., & McDonald, D. W. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713139 · Cited by 43
Regulate against the machine: how the EU mitigates AI harm to democracy
Cupać, J., & Sienknecht, M. (2024) · Democratization · doi:10.1080/13510347.2024.2353706 · Cited by 43
Three lines of defense against risks from AI
Schuett, J. (2025) · AI & SOCIETY · doi:10.1007/s00146-023-01811-0 · Cited by 41
“To identify risks, the first line could use risk taxonomies (Weidinger et al. 2021, 2023; Raji et al. 2022a, b; Shelby et al. 2022), and Schuett 2023).”
Hwang, A. H., Siy, J. O., Shelby, R. M., & Lentz, A. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661555 · Cited by 42
“Specifcally, we took a systematic approach and built our speculation on the taxonomy of socio-technical harms [91].”
MethodSelf-citationSeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes
Bhutani, M., Robinson, K., Prabhakaran, V., Dave, S., & Dev, S. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-short.75 · Cited by 41
Lessons from complex systems science for AI governance
Kolt, N., Shur‐Ofry, M., & Cohen, R. (2025) · Patterns · doi:10.1016/j.patter.2025.101341 · Cited by 45
“27, 29 Nonlinear growth In recent years, there has been an”
Misfitting With AI: How Blind People Verify and Contest AI Errors
Alharbi, R., Lor, P., Herskovitz, J., Schoenebeck, S., & Brewer, R. N. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675659 · Cited by 40
“…between participants and camera guidance cues could be because such features do not incorporate what blind sociolo-gist Siegfried Saerberg coined as “blind style of perception,” denoting sensory schemes of interpretation that blind people develop in relation to spatial and embodied processes [105].”
Co-designing an AI Impact Assessment Report Template with AI Practitioners and AI Compliance Experts
Bogucka, E. P., Constantinides, M., Šćepanović, S., & Quercia, D. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31627 · Cited by 41
The BIG Argument for AI Safety CasesPreprint
Habli, I., Hawkins, R., Paterson, C., Ryan, P., Jia, Y., Sujan, M. A., & McDermid, J. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.11705 · Cited by 40
“The scale and signi � cance of AI-induced harms make proactive and systematic assurance of safety a priority [21][22][23].”
Painting with Cameras and Drawing with Text: AI Use in Accessible Creativity
Bennett, C. L., Shelby, R. M., Rostamzadeh, N., & Kane, S. K. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3675644 · Cited by 39
“As has been researched more widely, AI harms tend to impact those already marginalized [8, 9, 12, 45, 78, 108], and there are specific risks to people with disabilities [11, 43, 48, 56, 75, 117].”
Self-citationHaque, M. R., Saxena, D., Weathington, K., Chudzik, J., & Guha, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642738 · Cited by 38
“Academics and journalists have gathered substantial evidence high-lighting the outcome-oriented harms resulting from algorithmic systems and have specifically drawn attention to disparate harms inflicted on impacted communities [37, 62, 69, 103, 118, 135].”
BackgroundBenchmark suites instead of leaderboards for evaluating AI fairness
Wang, A., Hertzmann, A., & Russakovsky, O. (2024) · Patterns · doi:10.1016/j.patter.2024.101080 · Cited by 38
Exploring the Human-LLM Synergy in Advancing Theory-driven Qualitative Analysis
Meng, H., Yang, Y., Fu, W., Lee, J., Li, Y., & Lee, Y. (2026) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3778354 · Cited by 39
“…harm from AI systems ” could begin with an established theory-informed coding scheme (e.g., representational, allocative, and interpersonal harms [187]) to code interview transcripts with affected users, have LLMs code the same transcripts using the same scheme ( T1 ), then analyze human-LLM…”
Constructive Criticism? Working with (Rather than Against) the AIED Back-Lash
Selwyn, N. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00344-3 · Cited by 37
AI governance systems: a multi-scale analysis framework, empirical findings, and future directions
Attard-Frost, B., & Lyons, K. A. (2024) · AI and Ethics · doi:10.1007/s43681-024-00569-5 · Cited by 38
“These inequitable outcomes can include many forms of systemic discrimination and representational harm [84], as well as allocative harms, such as inequitable distributions of resources, benefits, and responsibilities across the value chains of AI systems [85] and structural barriers to accessing…”
Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World EffectsPreprint
Schwartz, R., Chowdhury, R., Kundu, A., Frase, H., Fadaee, M., David, T., Waters, G., Taïk, A., Briggs, M., Hall, P., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.18893 · Cited by 38
“…to construct benchmarking tasks that naturally elicit generative AI risks – such as harmful bias, hallucinations, or user over-reliance – [82, 1, 86, 13, 50, 31, 25] and their associated impacts[77, 7], or the broad range of user responses and behavior that may arise from LLM-based…”
AI in the Nonprofit Human Services: Distinguishing Between Hype, Harm, and Hope
Goldkind, L., Ming, J., & Fink, A. (2024) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2024.2427459 · Cited by 36
Tang, N., Zhi, J., Kuo, T.-S., Kainaroi, C., Northup, J. J., Holstein, K., Zhu, H., Heidari, H., & Shen, H. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658935 · Cited by 35
Divon, T., Are, C., & Briggs, P. (2025) · Platforms & Society · doi:10.1177/29768624241303109 · Cited by 35
“Sociotechnical harm emerges at the intersection of gender, race and disability, revealing how platform development and user experience are architecturally intertwined with cultural forces and systemic inequalities (Shelby et al., 2023).”
The Case for "Thick Evaluations" of Cultural Representation in AI
Qadri, R., Díaz, M., Wang, D., & Madaio, M. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36696 · Cited by 36
“Similarly, participants evaluated whether images lacked the expected cultural elements that they felt contributed to a place’s identity—what we refer to as missingness [cf. “erasure:” 43, 65, 66, 74].”
Representation in AI Evaluations
Bergman, A. S., Hendricks, L. A., Rauh, M., Wú, B., Agnew, W. S., Kunesch, M., Duan, I., Gabriel, I., & Isaac, W. S. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594019 · Cited by 35
My Future with My Chatbot: A Scenario-Driven, User-Centric Approach to Anticipating AI Impacts
Kieslich, K., Helberger, N., & Diakopoulos, N. A. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659026 · Cited by 35
“Impact assessment prepares developers, scholars, regulators and all affected stakeholders for potential pitfalls and includes not only technical risks, but also societal ones [51, 55].”
Background
Metadata
- Authors
- Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., & Virk, G.
- Affiliations
- Google (United States) (US)
- McGill University (CA)
- Australian National University (AU)
- Google, USA
- ORCID
- Venue
- Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2023-08-08
- Pages
- 723-741
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4386249234
- Cited by
- 279
- References
- 191
- Citations by year
- 2026: 97 · 2025: 101 · 2024: 65 · 2023: 15
- FWCI
- 69.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic harms, harm reduction, algorithmic systems, representational harm, interpersonal harm, social harm, sociocultural dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.