Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Open accessThe DOI matches its Crossref record; 205 of the 209 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms — representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms — and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, the literature on harms from LLMs and algorithmic systems more broadly has shown that many of the harms arising from such models emerge from their embedding in wider sociotechnical systems (Weidinger et al., 2021; Bender et al., 2021; Shelby et al., 2023).”
From Helpful, harmless, honest? Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback (2025) · cites this paper as Shelby et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The rapid pace of adoption of GenAI tools, when it comes to similar concerns, have significantly exacerbated the many socio-technical issues researchers have connected to education technologies in general [160, 311] and algorithmic harms related to GenAI [317] more specifically.”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [317]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent work has expressed concern around anthropomorphism leading to over-trust [1, 91], a potential path for uncertainty expression to backfire.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [91]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Our approach followed prior scoping reviews in HCI literature [74, 223], in alignment with the extension of the PRISMA checklist [133], the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [220].”
MethodScoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 5×
“We employed a descriptive-analytical method for charting data – a process of “synthesizing and interpreting qualitative data by sifting, charting and sorting material according to key issues and themes" [11, p. 26].”
BackgroundMethodInfluentialBlack Feminist Thought: Knowledge, Consciousness, and the Politics of Empowerment.
Brewer, R. M., & Collins, P. H. (1992) · Contemporary Sociology · doi:10.2307/2074808 · Cited by 19,445
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 2×
“Thus, relying on scoping reviews’ iterative characteristic [168], we used theoretical saturation as a signal to stop sourcing new papers.”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 2×
“systems make incorrect health inferences [158].”
Background
Research works printed but not linked: 40
- 10.1093/cybsec · doi:10.1093/cybsec
- 10.18653/v1 · DOI
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. In Ethics of Data and Analytics. Auerbach Publications, Boca Raton, FL, USA, 254–264.
- Jane Bailey, Jacquelyn Burkell, Suzie Dunn, Chandell Gosse, and Valerie Steeves. 2021. AI and Technology-Facilitated Violence and Abuse. In Artificial Intelligence and the Law in Canada, Florian Martin-Bariteau and Teresa Scassa (Eds.). LexisNexis, Toronto, Canada, Chapter 10, 1–15.
- Jane Bailey, Nicola Henry, and Asher Flynn. 2021. Technology-Facilitated Violence and Abuse: International Perspectives and Experiences. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse, Bailey Jane, Flynn Asher, and Henry Nicola (Eds.). Emerald Publishing Limited, Bingley, UK, 1–17.
- 10.18653/v1 · DOI
- Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The Problem with Bias: Allocative Versus Representational Harms in Machine Learning. In 9th Annual Conference of the Special Interest Group for Computing, Information and Society. Society for the History of Technology, Philadelphia, PA, USA.
- Samy Bengio Alina Beygelzimer Kate Crawford Jeanne Fromer Iason Gabriel Amanda Levendowski Deborah Raji and Marc’Aurelio Ranzato. 2022. Provisional Draft of the NeurIPS Code of Ethics. https://openreview.net/pdf?id=zVoy8kAFKPr
- 10.1177/205630511667248 · doi:10.1177/205630511667248
- 10.18653/v1 · DOI
- 10.5555/380681 · doi:10.5555/380681
- Virginia Braun and Victoria Clarke. 2021. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative research in psychology 18, 3 (2021), 328–352.
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. https://proceedings.mlr.press/v81/buolamwini18a.html
- Jacquelyn Burkell and Jane Bailey. 2018. Unlawful Distinctions? Canadian Human Rights Law and Algorithmic Bias. Vol. 2016/2018. Human Rights Research and Education Centre Ottawa, Ottawa, Canada, 217–230.
- Kate Crawford. 2017. Keynote: The Trouble with Bias. 2017 Conference on Neural Information Processing Systems, invited speaker.
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Boston, MA, USA.
- Batya Friedman and David G Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Boston, MA, USA.
- Steve Fuller. 1993. Helen E. Longino Science As Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton: Princeton University Press (1990), xi+ 262 pp., 19.95. Philosophy of Science 60, 2 (1993), 360–362.
- Jan Hadja. 1961. Alienation and Integration of Student Intellectualss. American Sociological Review 26, 5 (1961), 19.
- 10.1177/104973231666534 · doi:10.1177/104973231666534
- 10.1177/146144482095872 · doi:10.1177/146144482095872
- Shawn Janzen, Caroline Orr, and Sara-Jayne Terp. 2022. Cognitive Security and Resilience: A Social Ecological Model of Disinformation and Other Harms with Applications to COVID-19 Vaccine Information Behaviors. In 2nd Workshop Reducing Online Misinformation through Credible Information Retrieval. ROMCIR 2022, Stavanger, Norway, 48–88.
- Jared Katzman, Solon Barocas, Su Lin Blodgett, Kristen Laird, Morgan Klaus Scheuerman, and Hanna Wallach. 2021. Representational Harms in Image Tagging. Beyond Fair Computer Vision Workshop at CVPR 2021 (2021).
- Hank Liao, Golan Pundak, Olivier Siohan, Melissa Carroll, Noah Coccaro, Qi-Ming Jiang, Tara N Sainath, Andrew Senior, Françoise Beaufays, and Michiel Bacchiani. 2015. Large Vocabulary Automatic Speech Recognition for Children. In Interspeech 2015. International Speech Communication Association, Dresden, Germany, 1–5.
- 10.1093/ojls · doi:10.1093/ojls
- Emanuel Moss and Jacob Metcalf. 2020. Ethics Owners: A New Model of Organizational Responsibility in Data-Driven Technology Companies. https://datasociety.net/wp-content/uploads/2020/09/Ethics-Owners_20200923-DataSociety.pdf
- Emmanuel Moss and Jacob Metcalf. 2022. Data and Society Workshop: The Social Life of Algorithmic Harms. (March 2022).
- Aik Kwang Ng, David YF Ho, Shyh Shin Wong, and Ian Smith. 2003. In Search of the Good Life: A Cultural Odyssey in the East and West. Genetic, Social, and General Psychology Monographs 129, 4 (2003), 317.
- Safiya Umoja Noble. 2016. A Future for Intersectional Black Feminist Technology Studies. Scholar & Feminist Online 13, 3 (2016), 1–8.
- Cathy O’Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books, New York, NY, USA.
- Eva PenzeyMoog and Danielle C Slakoff. 2021. As Technology Evolves, So Does Domestic Violence: Modern-Day Tech Abuse and Possible Solutions. In The Emerald International Handbook of Technology-Facilitated Violence and Abuse. Emerald Publishing Limited, Bingley, UK, 643–662.
- Jasbir K Puar. 2020. “I Would Rather be a Cyborg than a Boddess”: Becoming Intersectional in Assemblage Theory. In Feminist Theory Reader. Routledge, New York, NY, USA, 405–415.
- Henrik Skaug Sætra. 2021. Artificial Intelligence and its Contexts. Springer, Cham, Switzerland, Chapter A Typology of AI Applications in Politics, 27–43.
- Katie Shilton. 2015. "That’s Not An Architecture Problem!": Techniques and Challenges for Practicing Anticipatory Technology Ethics. In iConference 2015 Proceedings. iSchools Urbana-Champaign Illinois USA 1–7.
- Rebecca Kelly Slaughter, Janice Kopec, and Mohamad Batal. 2020. Algorithms and Economic Justice: A Taxonomy of Harms and a Path Forward for the Federal Trade Commission. Yale Journal of Law & Tech. 23 (2020), 1.
- 10.1177/0002716222108470 · doi:10.1177/0002716222108470
- 10.18653/v1 · DOI
- Thi Tran, Rohit Valecha, Paul Rad, and H Raghav Rao. 2019. An Investigation of Misinformation Harms Related to Social Media During Humanitarian Crises. In International Conference on Secure Knowledge Management in Artificial Intelligence Era. Springer, Goa, India, 167–181.
- Zeynep Tufekci. 2015. Algorithmic Harms Beyond Facebook and Google: Emergent Challenges of Computational Agency. Colo. Tech. LJ 13 (2015), 203.
- Claire Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policymaking.
Cited by
Items 201–300 of 625
Scenario-based sociotechnical envisioning (SSE): an approach to enhance systemic risk assessments
Kieslich, K., Helberger, N., & Diakopoulos, N. A. (2026) · AI and Ethics · doi:10.1007/s43681-026-01084-5 · Cited by 12
“Indeed, we can observe this happening in AI risk and impact assessments, be it that the definition of risk and impact categories rely either on literature review on scholarly literature [62, 63], direct corporate authored reports [73, 74], or expert judgements [16, 65].”
Context-specific certification of AI systems: a pilot in the financial industry
Brogle, K., Kallina, E., Sargeant, H., Shankar, V., Weller, A., Casovan, A., & Bhatt, U. (2025) · AI and Ethics · doi:10.1007/s43681-025-00720-w · Cited by 12
Focal points and blind spots of human-centered AI: AI risks in written online media
Sebestyen, M. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04814-y · Cited by 12
“…guidelines (Turchin et al. 2019; Bécue et al. 2021; Bommasani et al. 2021 Kaminski 2022; Hendrycks and Mazeika 2022; Weidinger et al. 2022; Hendrycks et al. 2023; Shelby et al. 2023; Crabtree et al. 2024) not to mention the categorization outlined in the EU AI Act itself (European Commission 2021).”
User Willingness to Engage with AI-Generated Influencer Content
Sew, C., Schömbs, S., Kelly, R., & Gonçalves, J. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719916 · Cited by 12
“Such measures are critical to pre-emptively address potential harms associated with emerging technologies [7, 31].”
Artificial Intelligence in Food Bank and Pantry Services: A Systematic Review
Yang, Y.-Y., An, R.-P., Fang, C., & Ferris, D. (2025) · Nutrients · doi:10.3390/nu17091461 · Cited by 9
Emotion AI in Job Interviews: Injustice, Emotional Labor, Identity, and Privacy
Ingber, A. S., & Andalibi, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732002 · Cited by 12
A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health
Zhou, J., Chen, A. Z., Shah, D., Schwab‐Reese, L. M., & Choudhury, M. D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757544 · Cited by 12
Foundational challenges in assuring alignment and safety of large language models
Anwar, U., Saparov, A., Rando, J., Paleka, D., Turpin, M., Hase, P., Lubana, E., Jenner, E., Casper, S., Sourbut, O., et al. (2024) · Oxford University Research Archive (ORA) (University of Oxford) · Cited by 12
Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp
Hong, R., Agnew, W., Kohno, T., & Morgenstern, J. (2024) · Proceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3689904.3694702 · Cited by 11
“Different demographic groups being filtered at different rates implies a form of representational harm [114].”
Towards Interactive Evaluations for Interaction Harms in Human-AI Systems
Ibrahim, L., Huang, S., Ahmad, L., Bhatt, U., & Anderljung, M. (2025) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v8i2.36631 · Cited by 11
“We follow existing work in adopting a wide definition for “safety” which encompasses model behaviors associated with various taxonomized harms (Weidinger et al. 2022; Shelby et al. 2023).”
Equality Engine: Fostering Critical Machine Learning Bias Literacy Through a Transformational Game
Showkat, D., Wang, L., Chan, L., & To, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710966 · Cited by 11
Barnett, J., Kieslich, K., Helberger, N., & Diakopoulos, N. A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732096 · Cited by 13
Amplifying Trans and Nonbinary Voices: A Community-Centred Harm Taxonomy for LLMs
Ungless, E. L., Dev, S., Bennett, C. L., Gulotta, R., Bastings, J., & Denton, E. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1001 · Cited by 11
“We synthesised all of the expert harm taxonomies into a single final taxonomy, organised under the higher-level categories from Shelby et al. (2023).”
InfluentialCautious optimism: public voices on medical AI and sociotechnical harm
Townsend, B., Hodge, J., Richardson, H., Călinescu, R., & Arvind, T. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1625747 · Cited by 11
“…“sociotechnical harm” with regard to medical AI broadly as any adverse, negative, or ill effect or impact experienced by a person or the broader society as a result of medical AI activity in the real world, lived experience of the person, member of the community, sub-group, or wider society [9].”
InfluentialVernacularizing Taxonomies of Harm is Essential for Operationalizing Holistic AI Safety
Kennedy, W. M., & Campos, D. V. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31672 · Cited by 11
Machine Learning practices and infrastructures
Berman, G. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604689 · Cited by 11
Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact AssessmentPreprint
Allaham, M., & Diakopoulos, N. A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.18028 · Cited by 11
“The categories of impacts in our sample capture many of the impact categories outlined by recent research on the harms, as well as social and ethical impacts of AI (Shelby et al. 2023; Solaiman et al. 2023).”
BackgroundAspirational Affordances of AIPreprint
Fazelpour, S., & Magnani, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.15469 · Cited by 11
Steenstra, I., Pedrelli, P., Shi, W., Marsella, S., & Bickmore, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.19948 · Cited by 12
Keeping an Eye on AI: A Framework for Effective Human Oversight of AI SystemsPreprint
Gaube, S., Langer, M., Miller, T., Baum, K., Dachselt, R., Feit, A. M., Gadiraju, U., Kaur, H., Keane, M. T., Landers, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.16278 · Cited by 12
“AI-enabled technologies can and will deliver many positive impacts, but their benefits also come with risks (Cummings, 2024; Olteanu et al., 2025; Shelby et al., 2023).”
Towards interactive evaluations for interaction harms in human-AI systems
Ibrahim, L., Huang, S., Bhatt, U., Ahmad, L., & Anderljung, M. (2024) · arXiv · doi:10.48550/arxiv.2405.10632 · Cited by 11
“We follow existing work in adopting a wide definition for “safety” which encompasses model behaviors associated with various taxonomized harms (Weidinger et al. 2022; Shelby et al. 2023).”
Exploring the values underlying machine learning research in medical image analysis
Baxter, J. S. H., & Eagleson, R. A. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103494 · Cited by 10
LLMs Homogenize Values in Constructive Arguments on Value-Laden Topics
Shahid, F., Zhang, S., & Vashistha, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791624 · Cited by 10
“Theseasymmetriescancontributetoquality ofserviceharms[86], as models may systematically underserve users with Conservative value systems, potentially deepening mistrust, exclusion, and alienation in digital spaces.”
Fairness in Federated Learning: Fairness for Whom?
Taïk, A., Chehbouni, K., & Farnadi, G. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36730 · Cited by 10
Lau, G. R., Low, W. Y., Koh, S. M., Nah, F. F.-H., & Hartanto, A. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2755127 · Cited by 10
"Grillz on a hijabi": Intersectional Identities in Fostering Critical AI Literacy
Solyst, J., Fong, C., Nurdin, F., Landesman, R., & Shapiro, R. B. (2025) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3769994.3770037 · Cited by 10
“However, AI has been well-documented to cause harm, such as through the reproduction and amplification of problematic societal biases [43].”
The role of generative AI in facilitating social interactions: A scoping review
Arets, T., Perugia, G., Houben, M., & IJsselsteijn, W. A. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101300 · Cited by 10
Evaluating the Social Impact of Generative AI Systems
Solaiman, I., Talat, Z., Agnew, W. S., Ahmad, L., Baker, D., Blodgett, S. L., Chen, C., Daumé, H., Dodge, J., Duan, I., et al. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198940272.013.0025 · Cited by 10
Conceptualising Fatness within HCI: A Call for Fat Liberation
Sobey, A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642199 · Cited by 10
Position Paper: Data-Centric AI in the Age of Large Language Models
Xu, X., Wu, Z., Qiao, R., Verma, A., Shu, Y., Wang, J., Niu, X., He, Z., Chen, J., Zhou, Z., et al. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.695 · Cited by 10
GUARD-D-LLM: An LLM-Based Risk Assessment Engine for the Downstream uses of LLMsPreprint
Narayanan, S., & Vishwakarma, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.11851 · Cited by 10
“The paper has leveraged several works regarding risk and harms taxonomy including [50] , [49] , [12] , [25], [26] , [43], [38] and [10] to compile the list of broad risks and sub-risks.”
BackgroundA Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms
Abercrombie, G., Benbouzid, D., Giudici, P., Golpayegani, D., Hernandez, J., Noro, P., Pandit, H., Paraschou, E., Pownall, C., Prajapati, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.01294 · Cited by 9
“Specific harm type: Other taxonomies focus on specific types of harms, include one focusing on the socio-technical harms of algorithmic systems [28] based on surveying 172 papers.”
BackgroundSolyst, J., Wilcox, L. G., & Madaio, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714144 · Cited by 9
“Artificial intelligence (AI) systems 1 have had inequitable impacts on people and society [e.g., 58, 71], such as in hiring [26], healthcare [65], and education [e.g., 8, 44, 52].”
Axelsson, M., Cheong, J., Nyrup, R., & Güneş, H. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36546 · Cited by 10
EuroGEST: Investigating gender stereotypes in multilingual language models
Rowe, J., Klimaszewski, M., Guillou, L., Vallor, S., & Birch, A. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1632 · Cited by 9
"Social Media Killed Our Generation": Teenagers' Felt Experiences of Harm on Social Media
Gairola, R., Gray, C. M., Dong, J., Jeong, K. J., Otenen, E., & Sarria, J. J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791519 · Cited by 10
“Scholars have cautioned against reducing harm to narrow technical definitions, calling instead for approaches that map its complexities across social, legal, and technical domains [67].”
AI’s Regimes of Representation: A Community-Centered Study of Text-to-Image Models in South Asia
Qadri, R., Shelby, R. M., Bennett, C. L., & Denton, E. (2024) · doi:10.21428/2c646de5.2b73d5c2 · Cited by 9
Self-citationMamak, K. (2024) · Routledge eBooks · doi:10.1201/9781032671024 · Cited by 9
Bridging Research and Practice Through Conversation: Reflecting on Our Experience
Russo, M., Jorgensen, M., Scott, K. M., Xu, W., Nguyen, D. H., Finocchiaro, J., & Olckers, M. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694705 · Cited by 9
“…experiences with conversations with practitioners have had on our perspectives on working with marginalized groups, the challenges we foresee in approaching that kind of work, and finally, consider potential roles for researchers such as ourselves when approaching work on sociotechnical problems.”
Managing cyber harm: a survey of challenges, practices, and opportunities
Islam, E., Rudolph, C., & Oliver, G. (2025) · Information Security Journal A Global Perspective · doi:10.1080/19393555.2025.2484348 · Cited by 9
“…2020; Phillips et al., 2022; Tran et al., 2019), exploring socio-technical aspects influencing cyber harm (Michel & King, 2019; Pfanstiel, 2022; Shelby et al., 2023), formulating methods to measure direct and indirect harm (Erola et al., 2022; Institute, 2023; Spiewak, 2022; von Skarczinski et…”
Cross-cultural challenges in generative AI: Addressing homophobia in diverse sociocultural contexts
Vicsek, L., Zajko, M., Vancsó, A., Takács, J., & Annus, S. (2025) · Big Data & Society · doi:10.1177/20539517251396069 · Cited by 9
“Practices that mitigate generative AI bias, as part of AI ethics or AI safety, mainly approach this as a technical puzzle, through the development of datasets, benchmarks, clas-si fi cation algorithms, and methods that orient AI outputs toward some desired ends and away from others.”
EvalCards: A Framework for Standardized Evaluation ReportingPreprint
Dhar, R., Villegas, D. S., Karamolegkou, A., Schiavone, A., Yuan, Y., Chen, X., Li, J., Frank, S., Grazia, L. D., Swain, M., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.21695 · Cited by 10
“1 https://openai.com/index/gpt-4o-system-card/ Lack of visibility While earlier works have talked about model documentation, not many have emphasized the need for visibility.”
OneShield -- the Next Generation of LLM GuardrailsPreprint
DeLuca, C., Gentile, A. L., Asthana, S., Zhang, B., Chowdhary, P., Cheng, K., Shbita, B., Li, P., Ren, G.-J., & Gopisetty, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.21170 · Cited by 9
“…taxonomy of risks by Weidinger et al. [25], which clustered the risk under the macro categories that represent Discrimination, Disinformation, Misinformation, Security, Human-Computer Inter-action Harms, and Environmental and Socioeconomic harms, and the categories of harm by Shelby et al. [21].”
Imagining the Far East: Exploring Perceived Biases in AI-Generated Images of East Asian Women
Lan, X., An, J., Guo, Y., Chiyou, T., Cai, X., & Zhang, J. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3719678 · Cited by 8
“With the advent of AI, the imperative to develop trustworthy and responsible AI systems and to minimize AI-related harm has become increasingly pressing [10, 22, 23, 41].”
Opaque Transparency: Gaps and Discrepancies in the Report of Social Media Harms
Chang, T., Trybala, J. J., Bassan, S., & Razi, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719829 · Cited by 8
What Is the Point of Equality in Machine Learning Fairness? Beyond Equality of Opportunity
Kong, Y. (2026) · ACM Journal on Responsible Computing · doi:10.1145/3766539 · Cited by 8
“When prompted to generate a story involving terms like “unsolved murder case,” “culprit,” “a Pakistani,” and “a Canadian,” the model s consistently portrayed the Pakistani character as the culprit.”
InfluentialHerrera, F., García, S., del Jesús, M. J., Sánchez, L., & de Prado, M. L. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8030069 · Cited by 8
“As Shelby et al. (2023) [1] remind us, algorithmic harms rarely arise from isolated failures of logic or code; rather, they are relational, institutional, and cumulative.”
Toward Fair Speech Technologies: A Comprehensive Survey of Bias and Fairness in Speech AI
Lin, Y.-C., Tsai, Y.-T., Chen, K.-Y., Huang, H.-Y., Chou, H.-C., Narayanan, S., Tsao, Y., Ding, J.-J., & Lee, H.-Y. (2026) · Transactions on machine learning research · doi:10.48550/arxiv.2605.01597 · Cited by 9
“Table II instantiates this taxonomy for speech, integrating harm categories from [47], [48], [106]–[108].”
Senft, N., Gaysynsky, A., Iles, I. A., Schrader, K. E., & Chou, W. S. (2025) · Journal of Cancer Survivorship · doi:10.1007/s11764-025-01760-1 · Cited by 8
“Furthermore, a lack of demographically varied AI-generated images of cancer survivors may be an example of erasure— a type of representational harm where certain groups are systematically absent or underrepresented in AI systems, which can lead to their further marginalization [31, 32].”
Assessing AI Impact Assessments: A Classroom StudyPreprint
Johnson, N., & Heidari, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.11193 · Cited by 8
A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public HealthPreprint
Zhou, J., Chen, A. Z., Shah, D., Schwab‐Reese, L. M., & Choudhury, M. D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.02594 · Cited by 8
Scopes of AlignmentPreprint
Varshney, K. R., Ashktorab, Z., Bouneffouf, D., Riemer, M., & Weisz, J. D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.12405 · Cited by 8
Ethics-based auditing of automated decision-making systems: considerations, challenges, na
Mökander, J. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-z5qakao0p · Cited by 12
Systemic Risks of Interacting AIPreprint
Darius, P., Hoppe, T., & Aleksandrov, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.17793 · Cited by 8
Gautam, S., Chandra, M., De, A., Chakravorti, T., Malik, G., & De Choudhury, M. (2025) · arXiv · doi:10.48550/arxiv.2508.06849 · Cited by 7
“Building on prior research examining bias and harm in AI systems (Shelby et al. 2023), we offer a lens for organizing and understanding how lived experiences manifest in relation to AI design and use.”
Venkatasubramanian, K., Hardie, H., & Ranalli, T.-M. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746359 · Cited by 7
“…models [15]; identifying personalized risks specific to LLMs, based on user feedback [64]; identifying potential harm from algorithmic systems [35, 118]; identifying the various definitions of fairness used to reduce bias, as experienced by end-users in AI-driven systems [80, 111]; identifying…”
Winecoff, A., & Klyman, K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791775 · Cited by 8
“Because data filtering and other risk mitigation approaches remain imperfect, deployed systems can still facilitate harms, including discrimination, erasure, leakage of sensitive information, over-reliance, scams and fraud, and environmental burdens [111, 125].”
Introducing AI to an online petition platform changed outputs but not outcomes
Corpus, I., Gilbert, E., Koenecke, A., & Naaman, M. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02580-8 · Cited by 8
Wang, L., Gao, Y., Anyi, C. L., & Goel, A. K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790279 · Cited by 7
Ahrweiler, P. (2025) · Artificial intelligence, simulation and society · doi:10.1007/978-3-031-71678-2 · Cited by 7
Wong, R. Y. (2025) · Decennial Aarhus Conference · doi:10.1145/3744169.3744171 · Cited by 7
“Emerging (generative) AI systems pose a range of new risks to human (and non-human) actors [5, 120].”
Rethinking Optimization: A Systems-Based Approach to Social Externalities
Nokhiz, P., Ruwanpathirana, A. K., & Nissenbaum, H. F. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i2.36684 · Cited by 7
Exposure to content written by large language models can reduce stigma around opioid use disorder
Mittal, S., Shah, D., Do, S. W., ElSherief, M., Mitra, T., & Choudhury, M. D. (2025) · npj Artificial Intelligence · doi:10.1038/s44387-025-00049-z · Cited by 7
“Thoughpromising,asour fi ndings suggest, LLMs can cause informational 64 and representational 65 harms.”
Morosoli, S., Kieslich, K., Reséndez, V., & van Drunen, M. Z. (2025) · Journal of Information Technology & Politics · doi:10.1080/19331681.2025.2504519 · Cited by 7
Global Approaches to Auditing Artificial Intelligence: A Literature Review
(IPIE), I. P. O. T. I. E., Sylvester, P., Chun, W. H. K., Hannák, A., Mendoza, M., Broussard, M., Сергеевич, Е. Р., Nelson, A., Sandvig, C., Sesan, G., et al. (2024) · doi:10.61452/bwym7397 · Cited by 7
Walkthrough of Anthropomorphic Features in AI Assistant ToolsPreprint
Maeda, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.16345 · Cited by 8
“Users may also instigate or suffer from certain socio-technical harms when interacting with anthropomorphized chatbots—such as stereotyping and social inequalities [8, 13, 78].”
Taxonomizing Representational Harms using Speech Act TheoryPreprint
Corvi, E., Washington, H., Reed, S., Atalla, C., Chouldechova, A., Dow, P. A., Garcia-Gathright, J. I., Pangakis, N., Sheng, E., Vann, D., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.00928 · Cited by 7
“…sometimes to other broader societal impacts arising from either the development or the deployment of these generative language systems (e.g., Banko et al., 2020; Weidinger et al., 2022; Shelby et al., 2023; Abercrombie et al., 2024; Hutiri et al., 2024; Slattery et al., 2024; Zeng et al., 2024).”
More of the Same: Persistent Representational Harms Under Increased RepresentationPreprint
Mickel, J., De‐Arteaga, M., Liu, L., & Tian, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.00333 · Cited by 7
“representational harm taxonomies [24, 52, 92].”
Creative ML Assemblages: The Interactive Politics of People, Processes, and Products
Shelby, R., Srinivasan, R., Burgdorf, K., Lena, J. C., & Rostamzadeh, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637315 · Cited by 6
“The patterns ML models learn shape the system’s performance and can lead to system outputs that enact a range of representational and cultural harms [134, 152].”
BackgroundSelf-citationHutiri, W. T., Patel, T. B., Ding, A. Y., & Scharenborg, O. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1158 · Cited by 6
“In these social-security and safety-critical applications, prediction errors can lead to technology failures that cause harms to individuals [3].”
Characterizing the Flaws of Image-Based AI-Generated Content
Vasir, G., & Huh, J. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720004 · Cited by 6
“To better understand, communicate, and investigate fairness and related conceptualizations, researchers created taxonomy, classifications, and categories that characterize observed as well as hypothesized biases, potential harm, and fairness [1, 46, 47, 53].”
Foundational approaches to post-hoc explainability for image classification
Santis, A. D., Campi, R., Bianchi, M., Tocchetti, A., & Brambilla, M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-340553-2.00008-3 · Cited by 6
Wu, M., Zhao, Y., Han, S., Liu, M. X., & Shen, H. Y. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816897 · Cited by 6
“AI Development Plan: {{stage name}: {stage description} for all stages}”
Allaham, M., Kieslich, K., & Diakopoulos, N. A. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36533 · Cited by 6
Moharana, S., Bennett, C. L., Buehler, E., Madaio, M., Tibdewal, V., & Kane, S. K. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i2.36669 · Cited by 6
“Recent work has explored the emerging job roles around RAI (Rismani and Moon 2023).”
The AI Model Risk Catalog: What Developers and Researchers Miss About Real-World AI Harms
Rao, P. S. B., Šćepanović, S., Jayagopi, D. B., Cherubini, M., & Quercia, D. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36702 · Cited by 6
Hwang, A. H., Wong, S. P., Chen, B., He, J., & Do, H. J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791920 · Cited by 6
“Perceived AI use, the perception that someone has used AI to produce content or complete work, can make a significant impact in both professional and social contexts [29, 46].”
Foriest, J. C., Ajmani, L., & Choudhury, M. D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791548 · Cited by 6
“[87] capture this hermeneutical injustice as “representational harms,” such as bias propagation and erasure.”
InfluentialHow Generative AI Empowers Attackers and Defenders Across the Trust & Safety Landscape
Kelley, P. G., Rousso-Schindler, S., Shelby, R. M., Thomas, K., & Woodruff, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791363 · Cited by 6
“While prior research has focused on technical safeguards to minimize misuse of AI models and systems [3, 95, 113, 123, 133, 135], these studies fall short of detailing how the uneasy sociotechnical balance between attackers and defenders will evolve alongside GenAI.”
Self-citationAlgorithmic Status Inequality: An Integrative Perspective on AI‐Driven Social Stratification
Wu, J. (2026) · Journal of Management Studies · doi:10.1111/joms.70134 · Cited by 6
A Taxonomy of Real-World Defeaters in Safety Assurance Cases
Gohar, U., Hunter, M. C., Cohen, M. B., & Lutz, R. R. (2025) · doi:10.1109/mo2re66661.2025.00007 · Cited by 6
“To address conceptual overlaps among codes [31], [35], the most comprehensive term was selected as the primary category covering related concepts.”
Hidden risks of predictive models in healthcare
Alderman, J. E., Riley, R. D., Parekh, D., Summers, C., Liu, X., & Denniston, A. K. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-113730 · Cited by 6
“22 This approach also helps uncover other harms that extend beyond physical injury and might otherwise be masked from view (eg, economic loss, loss of agency, privacy violations or denial of the opportunity to self-identify through automatic group allocation).”
The backfiring effect of weak AI safety regulation
Laufer, B., Kleinberg, J. M., & Heidari, H. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2509768123 · Cited by 6
“Each player will choose whether and how to contribute to the technology at a certain point in the development of the technology, and some revenue is received depending on the ultimate attributes of the technology.”
Crowding Out the Noise: Algorithmic Collective Action Under Differential Privacy
Solanki, R., Bhange, M., Aïvodji, U., & Creager, E. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806475 · Cited by 6
“As algorithmic systems become part of high-stakes decision-making, they can also cause socio-technical harms that reinforce existing social inequalities, marginalize vulnerable groups, or create an inequitable environment [Shelby et al., 2022].”
Revisión sistemática de taxonomías de riesgos asociados a la Inteligencia Artificial
Graells, G. B., Tinoco, R., Leyva, C. S., & Sevilla, J. (2024) · Analecta política · doi:10.18566/apolit.v14n26.a08 · Cited by 6
Data-Centric AI in the Age of Large Language ModelsPreprint
Xu, X., Wu, Z., Qiao, R., Verma, A., Shu, Y., Wang, J., Niu, X., He, Z., Chen, J., Zhou, Z., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.14473 · Cited by 6
“While our exposition is not exhaustive, we hope our “first cut” at a holistic viewpoint of data-centric research can generate more discussion and inspire innovation.”
The Generative AI Ethics PlaybookPreprint
Smith, J. J., Deng, W. H., Smith, W. H., Sap, M., DeCario, N., & Dodge, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.10383 · Cited by 6
Allaham, M., Kieslich, K., & Diakopoulos, N. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.14040 · Cited by 6
Towards A Global AI Auditing Framework: Assessment and Recommendations
(IPIE), I. P. O. T. I. E., Faveri, B., Johnson-León, M., Sylvester, P., Chun, W. H. K., Hannák, A., Mendoza, M., Broussard, M., Сергеевич, Е. Р., Nelson, A., et al. (2025) · doi:10.61452/zwed1485 · Cited by 6
Dacon, J. (2023) · arXiv (Cornell University) · doi:10.13140/rg.2.2.15966.82243 · Cited by 6
Risk of What? Defining Harm in the Context of AI SafetyPreprint
Fearnley, L., Cairns, E., Stoneham, T., Ryan, P. M., Chubb, J., Iacovides, I., Iglesias Urrutia, C. P., Morgan, P. D. J., McDermid, J. A., & Habli, I. (2025) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 6
Introducing v0.5 of the AI Safety Benchmark from MLCommons
Vidgen, B., Agrawal, A., Ahmed, A. M., Akinwande, V., Al-Nuaimi, N., Alfaraj, N., Alhajjar, E., Aroyo, L., Bavalatti, T., Bartolo, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.12241 · Cited by 5
Datasets for Navigating Sensitive Topics in Recommendation Systems
Kovacs, A., Chee, J., & Dean, S. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3715294 · Cited by 5
“[40] propose a taxonomy of sociotechnical harms based on an extensive literature review.”
Critical AI Literacy through Exploring Generative AI Limitations
Solyst, J., Pan, M. Y., Andam, A., Poblete, I. P., Eslami, M., Hammer, J., Ogan, A., & Stewart, A. (2025) · Proceedings. · doi:10.22318/icls2025.547433 · Cited by 5
Towards an Ontology-Driven Approach to Document Bias
Russo, M., & Vidal, M.-E. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.19388 · Cited by 5
“Critical data studies [47, 59] maintain that for bias detection tasks to be meaningful, practitioners must reflect on possible harms that can emerge upon the deployment of an ML system in dynamic societal and cultural contexts.”
BackgroundAfter Harm: A Plea for Moral Repair after Algorithms Have Failed
Wong, P., & Rieder, G. (2025) · Science and Engineering Ethics · doi:10.1007/s11948-025-00555-y · Cited by 5
“First, as demonstrated by numerous real-world cases, harm through algorithmic processes is not an abstract concern, but a well-documented, well-researched, and increasingly pervasive threat in today’s data-driven society (see McGregor, 2021; Shelby et al., 2023).”
Timaite, G., & Castelle, M. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36733 · Cited by 5
Truong, K. L., Zimmermann, A., & Heidari, H. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36736 · Cited by 5
The spread of mind: psychological contagion in theory and critique
Houran, J., Dagnall, N., Sapkota, R. P., & Lange, R. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1631927 · Cited by 5
Wang, K., Clarke, L., Dreue, C.-C. J., Zhou, G., & Jacques, J. T. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3799442 · Cited by 5
“However, the open nature of these platforms exposes users to sociotechnical harms, which are the risks that emerge from both platform design and social interactions [105].”
Metadata
- Authors
- Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., & Virk, G.
- Affiliations
- Google (United States) (US)
- McGill University (CA)
- Australian National University (AU)
- Google, USA
- ORCID
- Venue
- Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2023-08-08
- Pages
- 723-741
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4386249234
- Cited by
- 279
- References
- 191
- Citations by year
- 2026: 97 · 2025: 101 · 2024: 65 · 2023: 15
- FWCI
- 69.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic harms, harm reduction, algorithmic systems, representational harm, interpersonal harm, social harm, sociocultural dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.