The Values Encoded in Machine Learning Research
Open accessThe DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Machine learning currently exerts an outsized influence on the world, increasingly affecting institutional practices and impacted communities. It is therefore critical that we question vague conceptions of the field as value-neutral or universally beneficial, and investigate what specific values the field is advancing. In this paper, we first introduce a method and annotation scheme for studying the values encoded in documents such as research papers. Applying the scheme, we analyze 100 highly cited machine learning papers published at premier machine learning conferences, ICML and NeurIPS. We annotate key features of papers which reveal their values: their justification for their choice of project, which attributes of their project they uplift, their consideration of potential negative consequences, and their institutional affiliations and funding sources. We find that few of the papers justify how their project connects to a societal need (15%) and far fewer discuss negative potential (1%). Through line-by-line content analysis, we identify 59 values that are uplifted in ML research, and, of these, we find that the papers most frequently justify and assess themselves based on Performance, Generalization, Quantitative evidence, Efficiency, Building on past work, and Novelty. We present extensive textual evidence and identify key themes in the definitions and operationalization of these values. Notably, we find systematic textual evidence that these top values are being defined and applied with assumptions and implications generally supporting the centralization of power. Finally, we find increasingly close ties between these highly cited papers and tech companies and elite universities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In a study on the values encoded in the ML research literature, Birhane et al. identified a number of ethical values [45], from which the papers would draw motivation.”
From The Robots Are Here: Navigating the Generative AI Revolution in Computing Education (2023) · cites this paper as [45]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we start from the premise that these AI writing tools are both flawed and fallible, due to their algorithmic biases and technical shortcomings [9], but that they also have powerful affordances, including the ability to assist the large numbers of scientists and engineers around the world who need to publish and present their work in English but are not native speakers of the language.”
From Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Benchmarks set the agenda and orient progress: we should aspire for holistic, pluralistic, and democratic benchmarks.3”
From Holistic Evaluation of Language Models (2023) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“In a total of 100 highly cited papers, the study found that performance was clearly the most frequent value and pointed out that performance is not a neutral term but comes with ethical implications.”
From The Robots Are Here: Navigating the Generative AI Revolution in Computing Education (2023) · cites this paper as [45]
The cited source says what the claim attributes to it.
In the citing paper
“They note that most of these focus on endogenous notions of technical performance and novelty, and leave out considerations of broader context and impact that are necessary to shaping a governance effort.”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [18]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Qualitative evaluation and research methods
Ellis, D. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,943
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
(2005) · PubMed · Cited by 7,011
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Sorting Things Out: Classification and Its Consequences
(2000) · The Journal of Academic Librarianship · doi:10.1016/s0099-1333(00)00155-5 · Cited by 5,210
How to plan and perform a qualitative study using content analysis
Bengtsson, M. (2016) · NursingPlus Open · doi:10.1016/j.npls.2016.01.001 · Cited by 4,616 · cited 3×
“, LWPR [8], standard GPR [1], sparse online Gaussian process regression (OGP) [5] and υ-support vector regression (υ-SVR) [11],”
BackgroundMethodRigor in Qualitative Research: The Assessment of Trustworthiness
Krefting, L. (1991) · American Journal of Occupational Therapy · doi:10.5014/ajot.45.3.214 · Cited by 4,174 · cited 1×
“We adhere to a number of best practices to establish reliability: We practice prolonged engagement, conducting long-term orientation to and analysis of data over more than a year (in lieu of short-term analysis that is dominated by preconceptions) [40]; We triangulate across researchers (six researchers) and points in…”
Method
Research works printed but not linked: 10
- 7. Samy Bengio and Deborah Raji. 2021. A Retrospective on the NeurIPS 2021 Ethics Review Process. https://blog.neurips.cc/2021/12/03/a-retrospective-on-the- neurips-2021-ethics-review-process/
- 10. Bruce L. Berg and Howard Lune. 2017. Qualitative research methods for the social sciences (ninth edition ed.). Pearson.
- 16. Kate Crawford. 2017. The Trouble with Bias. (2017). NeurIPS Keynote.
- 18. Catherine D'Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press.
- 23. Barney G. Glaser and Anselm L. Strauss. 1999. The discovery of grounded theory: strategies for grounded research. Aldine de Gruyter.
- 24. Ben Green. 2019. 'Good' isn't Good Enough. In NeurIPS Joint Workshop on AI for Social Good.
- 33. Maurice G Kendall and B Babington Smith. 1939. The problem of m rankings. The annals of mathematical statistics 10, 3 (1939), 275-287.
- 40. Yvonna S. Lincoln and Egon G. Guba. 2006. Naturalistic inquiry. Sage Publ.
- 51. Frank Pasquale. 2015. The black box society. Harvard University Press.
- 57. Anna Rogers. 2019. Peer review in NLP: reject-if-not-SOTA. Hacking Semantics blog (2019). https://hackingsemantics.xyz/2020/reviewing-models/#everything- wrong-with-reject-if-not-sota
Cited by
Items 201–300 of 622
A systematic map of machine learning for urban climate change mitigation
Hintz, M. J., Milojevic-Dupont, N., Creutzig, F., Repke, T., & Kaack, L. H. (2025) · Nature Cities · doi:10.1038/s44284-025-00328-5 · Cited by 16
Martin, K. E. (2022) · Business Ethics Quarterly · doi:10.1017/beq.2022.34 · Cited by 16
Characterizing Delusional Spirals through Human-LLM Chat Logs
Moore, J., Mehta, A., Agnew, W., Anthis, J. R., Louie, R., Mai, Y., Yin, P., Cheng, M., Paech, S. J., Klyman, K., et al. (2026) · Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3805689.3806443 · Cited by 15
“Following other work [10, 48], we designed these codes inductively, based on emergent themes after reading through the logs ourselves with an eye toward understanding both user’s delusional spirals with LLM chatbots and other mental health harms in general (§§3.2).”
InfluentialSelf-citationWho Controls the Conversation? User Perspectives on Generative AI (LLM) System Prompts
Neumann, A., Pi, Y., & Singh, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791726 · Cited by 15
Trustworthy AI: African Perspectives
Eke, D., Wakunuma, K., Akintoye, S., & Ogoh, G. (2025) · Springer eBooks · doi:10.1007/978-3-031-75674-0 · Cited by 18
Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning
Wang, A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732033 · Cited by 16
Mussgnug, A. M. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00938-w · Cited by 15
Bommasani, R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.522 · Cited by 15
Ecosystem Graphs: The Social Footprint of Foundation Models
Bommasani, R., Soylu, D., Liao, T., Creel, K., & Liang, P. (2023) · doi:10.21203/rs.3.rs-2961271/v1 · Cited by 14
Tate, T. P., Harnick-Shapiro, B., Ritchie, D. R., Tseng, W., Dennin, M., & Warschauer, M. (2025) · Discover Computing · doi:10.1007/s10791-025-09563-9 · Cited by 14
“…we start from the premise that these AI writing tools are both flawed and fallible, due to their algorithmic biases and technical shortcomings [9], but that they also have powerful affordances, including the ability to assist the large numbers of scientists and engineers around the world who…”
Tan, M., Lee, H., Wang, D., & Subramonyam, H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637358 · Cited by 14
“Furthermore, traditional engineering processes limit engagement with domain experts and end-users, separating the work of technical development and understanding end-user requirements [85], and prioritizing technical affordances over the problems of practitioners and real-world contexts [8, 38].”
BackgroundDhungel, A.-K. (2025) · Digital Government Research and Practice · doi:10.1145/3696319 · Cited by 14
Revisiting Technical Bias Mitigation Strategies
Mahamadou, A. J. D., & Trotsyuk, A. A. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095737 · Cited by 14
“All that Glitters”: Techniques for Evaluations with Unreliable Model and Human Annotations
Hardy, M. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.120 · Cited by 14
Transphobia Is in the Eye of the Prompter: Trans-Centered Perspectives on Large Language Models
Scheuerman, M. K., Weathington, K., Petterson, A., Doyle, D. T., Das, D., DeVito, M. A., & Brubaker, J. R. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3743676 · Cited by 14
Hong, R. S., Hutson, J. A., Agnew, W., Huda, I., Kohno, T., & Morgenstern, J. (2026) · ACM Symposium on Computer Science and Law (CSLAW) · doi:10.1145/3788646.3789521 · Cited by 14
Self-citationA toolkit of dilemmas: Beyond debiasing and fairness formulas for responsible AI/ML
Hernández, A. D., & Galanos, V. (2022) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas55053.2022.10227133 · Cited by 14
From Empirical Problem-Solving to Theoretical Problem-Finding Perspectives on the Cognitive Sciences
Adolfi, F., van de Braak, L., & Woensdregt, M. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00216-6 · Cited by 14
Experimental Standards for Deep Learning in Natural Language Processing ResearchPreprint
Ulmer, D., Bassignana, E., Müller-Eberstein, M., Varab, D., Zhang, M., van der Goot, R., Hardmeier, C., & Plank, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.06251 · Cited by 14
Fairness and Sequential Decision Making: Limits, Lessons, and OpportunitiesPreprint
Nashed, S. B., Svegliato, J., & Blodgett, S. L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.05753 · Cited by 14
On Uncertainty In Natural Language ProcessingPreprint
Ulmer, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.03446 · Cited by 14
Time for a Pause: Without Effective Public Oversight, AI in Schools Will Do More Harm Than Good.
Williamson, B., Molnar, A., & Boninger, F. (2024) · University of North Texas Digital Library (University of North Texas) · Cited by 14
The Routledge Handbook of Artificial Intelligence and Philanthropy
Ugazio, G., & Maricic, M. (2024) · Routledge eBooks · doi:10.4324/9781003468615 · Cited by 13
A Qualitative Study on Cultural Hegemony and the Impacts of AI
Brown, V., Larasati, R., Third, A., & Farrell, T. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31632 · Cited by 13
Wolfe, R., & Mitra, T. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31750 · Cited by 13
A Conceptual Framework for Ethical Evaluation of Machine Learning Systems
Gupta, N. R., Hullman, J. R., & Subramonyam, H. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31656 · Cited by 13
Valdivia, A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732027 · Cited by 13
Ghosh, S., & Wilson, K. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i2.36613 · Cited by 13
On the Dynamics of Gender Learning in Speech Translation
Savoldi, B., Gaido, M., Bentivogli, L., Negri, M., & Turchi, M. (2022) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2022.gebnlp-1.12 · Cited by 13
Ethics Whitepaper: Whitepaper on Ethical Research into Large Language ModelsPreprint
Ungless, E. L., Vitsakis, N., Talat, Z., Garforth, J., Roß, B., Onken, A., Kasirzadeh, A., & Birch, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.19812 · Cited by 13
Articulation Work and Tinkering for Fairness in Machine Learning
Fahimi, M., Russo, M., Scott, K. M., Vidal, M.-E., Berendt, B., & Kinder-Kurlanda, K. E. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686973 · Cited by 12
What Knowledge Do We Produce from Social Media Data and How?
Garcia, A. A., Yang, T., & Miceli, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3701216 · Cited by 12
Croskey, P., Offert, F., Jacobs, J., & Thaler, K. M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732058 · Cited by 12
Hutchinson, B., Louro, C. R., Collard, G. D., & Cooper, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732010 · Cited by 13
Resource Asymmetry in Multilingual NLP: A Comprehensive Review and Critique
Akindotuni, D. (2025) · Journal of Computer and Communications · doi:10.4236/jcc.2025.137002 · Cited by 12
Bridging the Communication Gap: Evaluating AI Labeling Practices for Trustworthy AI Development
Fischer, R., Wischnewski, M., van der Staay, A., Poitz, K., Janiesch, C., & Liebig, T. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i1.36601 · Cited by 12
Prompting as Scientific Inquiry
Holtzman, A., & Tan, C. (2025) · neural information processing systems · doi:10.52202/085713-2215 · Cited by 12
Explainable AI for Hate Speech Moderation: A Stakeholder‐Centered and Sociotechnical Review
Qureshi, M. D. M., Qureshi, M. A., & Rashwan, W. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70076 · Cited by 12
Sato, M., & McKinney, J. (2022) · Artificial Life · doi:10.1162/artl_a_00376 · Cited by 12
Okolo, C. T., & Lin, H. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651080 · Cited by 12
Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp
Hong, R., Agnew, W., Kohno, T., & Morgenstern, J. (2024) · Proceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3689904.3694702 · Cited by 11
Self-citationAlgorithmic discrimination: a grounded conceptualization
Bui, M., McIlwain, C. D., Olojo, S., & Chang, H.-C. H. (2025) · Information Communication & Society · doi:10.1080/1369118x.2025.2516544 · Cited by 12
Mendonça, S., Silva, E., & Damásio, B. (2025) · Telecommunications Policy · doi:10.1016/j.telpol.2025.102908 · Cited by 11
Visions of a Discipline: Analyzing Introductory AI Courses on YouTube
Engelmann, S., Choksi, M. Z., Wang, A., & Fiesler, C. L. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659045 · Cited by 11
A Taxonomy of Challenges to Curating Fair Datasets
Zhao, D., Scheuerman, M. K., Chitre, P., Andrews, J. T. A., Panagiotidou, G., Walker, S., Pine, K. H., & Xiang, A. (2024) · neural information processing systems · doi:10.52202/079017-3103 · Cited by 11
Decentralized Infrastructure for (Neuro)sciencePreprint
Saunders, J. L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.07493 · Cited by 11
Msekelwa, P. Z. (2023) · Journal of Knowledge Learning and Science Technology · doi:10.60087/jklst.vol2.n2.p142 · Cited by 10
Exploring the values underlying machine learning research in medical image analysis
Baxter, J. S. H., & Eagleson, R. A. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103494 · Cited by 10
Costa, J. L. D. P. F. N. D. J. L. C. C. É. G. D. P. O. J. L. C. D. M. J. M. R. D. F. L. C., Jesus, F. N. D., Costa, L. C., Oliveira, É. G. D. P., Junior, J. L. C. D. M., Farias, M. R. D., & Costa, L. C. (2026) · OWL Journal · doi:10.5281/zenodo.18916706 · Cited by 10
A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents
Beyene, F. S., & Dancy, C. L. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806442 · Cited by 10
Aquino, A., Gumbula, I. M., Bidwell, N. J., & Bird, S. (2024) · Participatory Design Conference · doi:10.1145/3661455.3669886 · Cited by 10
Public Computing Intellectuals in the Age of AI Crisis
Connolly, R. W. (2024) · ACM Transactions on Computing Education · doi:10.1145/3703162 · Cited by 10
To Improve Literacy, Improve Equality in Education, Not Large Language Models
Forbes, S. H., & Guest, O. (2025) · Cognitive Science · doi:10.1111/cogs.70058 · Cited by 10
Recommendations for the Recommenders: Reflections on Prioritizing Diversity in the RecSys Challenge
Heitz, L., Vrijenhoek, S., & Inel, O. (2024) · ACM Recommender Systems Challenge (RecSys Challenge) · doi:10.1145/3687151.3687155 · Cited by 10
AI for Just Work: Constructing Diverse Imaginations of AI beyond "Replacing Humans"Preprint
Jin, W., Vincent, N., & Hamarneh, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.08720 · Cited by 10
The Robots are Here: Navigating the Generative AI Revolution in Computing Education
Prather, J., Denny, P., Leinonen, J., Becker, B. A., Albluwi, I., Craig, M., Keuning, H., Kiesler, N., Kohn, T., Luxton-Reilly, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.00658 · Cited by 9
An exploration in digital techniques to read Ainu textile patterns
Meza, X. V., Zhang, Z., & Ochiai, Y. (2025) · Journal of Cultural Heritage Management and Sustainable Development · doi:10.1108/jchmsd-05-2022-0083 · Cited by 9
Artificial Intelligence in Educational Research and Scholarship: Seven Framings
Costello, E., Ferreira, G. G. T., Hrastinski, S., McDonald, J. K., Tlili, A., Veletsianos, G., Marín, V. I., Huijser, H., & Altena, S. (2025) · Journal of University Teaching and Learning Practice · doi:10.53761/xs5e3834 · Cited by 9
Challenges to incorporate accountability into artificial intelligence
Baldi, V., & Oliveira, L. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.08.063 · Cited by 9
The Automated Future: How AI and Automation Are Revolutionizing Online Services
Desmal, A. J., Alsaeed, M., Hamid, S. B., & Zolait, A. H. (2023) · IEEE International Conference on Engineering Technologies and Applied Sciences (ICETAS) · doi:10.1109/icetas59148.2023.10346472 · Cited by 9
Unlearning Descartes: Sentient AI is a Political Problem
Hull, G. (2023) · Journal of Social Computing · doi:10.23919/jsc.2023.0020 · Cited by 9
Geo-political bias in fake news detection AI: the case of affect
Deepak, P., Bhadra, S., Jurek, A., Kumar, G. S., & Kumar, S. (2024) · AI and Ethics · doi:10.1007/s43681-024-00494-7 · Cited by 9
Ak, O. (2025) · Social Studies of Science · doi:10.1177/03063127251321826 · Cited by 9
Preprint of What's wrong with "AI ethics" narratives
Tafani, D. (2022) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.6977133 · Cited by 9
The Games We Play: Critical Complexity Improves Machine Learning
Birhane, A., & Sumpter, D. J. T. (2022) · Frontiers in artificial intelligence and applications · doi:10.3233/faia220186 · Cited by 9
Self-citationRAI4IoE: Responsible AI for Enabling the Internet of Energy
Xue, M., Nepal, ., Liu, L., Sethuvenkatraman, S., Yuan, X., Rudolph, C., Sun, R., & Eisenhauer, G. (2023) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa58951.2023.00012 · Cited by 9
Voices of Her: Analyzing Gender Differences in the AI Publication World
Ding, Y., Liu, J., Lyu, Z., Zhang, K., Schölkopf, B., Jin, Z., & Mihalcea, R. F. (2025) · Workshop on NLP for Positive Impact (NLP4PI) · doi:10.18653/v1/2025.nlp4pi-1.17 · Cited by 9
Deep Learning and EthicsPreprint
LaCroix, T., & Prince, S. J. D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.15239 · Cited by 9
The Quo Vadis of the Relationship between Language and Large Language ModelsPreprint
Leivada, E., Dentella, V., & Murphy, E. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11146 · Cited by 9
Position: Stop Making Unscientific AGI Performance ClaimsPreprint
Altmeyer, P., Demetriou, A. M., Bartlett, A., & Liem, C. C. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.03962 · Cited by 9
OECD (2025) · OECD eBooks · doi:10.1787/dc00e56a-es · Cited by 8
Zhou, K., Gligorić, K., Cheng, M., Lam, M. S., Raman, V., Aminu, B., Woo, C., Brockman, M., Cha, H., & Jurafsky, D. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.67 · Cited by 8
Tracing Class and Capital in Critical AI Research
Ericson, P., Dobbe, R., & Lindgren, S. (2024) · tripleC Communication Capitalism & Critique Open Access Journal for a Global Sustainable Information Society · doi:10.31269/triplec.v22i1.1464 · Cited by 8
Just Because We Camp, Doesn't Mean We Should: The Ethics of Modelling Queer Voices.
Sigurgeirsson, A., & Ungless, E. L. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1982 · Cited by 8
Tensions Between the Proxies of Human Values in AI
Datta, T., Nissani, D., Cembalest, M., Khanna, A., Massa, H., & Dickerson, J. P. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00049 · Cited by 8
Towards Reliable Assessments of Demographic Disparities in Multi-Label Image ClassifiersPreprint
Hall, M. A., Chern, B., Gustafson, L., Ventura, D., Kulkarni, H., Ross, C., & Usunier, N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.08572 · Cited by 8
Towards Equitable Agile Research and Development of AI and RoboticsPreprint
Hundt, A., Schuller, J., & Kacianka, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.08242 · Cited by 8
Walker, L. (2024) · reposiTUm (TU Wien) · doi:10.34726/hss.2024.85320 · Cited by 8
The Making of Performative Accuracy in AI Training: Precision Labor and Its Consequences
Zhang, B. Z., Yang, T., Miceli, M., Haimson, O. L., & Thomas, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713112 · Cited by 7
“In line with previous literature that examines and questions the values in ML studies [5, 28, 45, 70], we examine how accuracy and precision shape data production and AI training practices.”
Against AI Jurisprudence: Large Language Models and the False Promises of Empirical Judging
Pruss, D., & Allen, J. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36695 · Cited by 7
Winecoff, A., & Klyman, K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791775 · Cited by 8
Not the Intended User: Queer Perspectives on Identity, Risk, and Trust in Robot Companions
Nam, K., Yee, J., Jinnat, R. A., Rigual, K. K., Thylane, A., & Korpan, R. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3785581 · Cited by 7
Kou, T. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658951 · Cited by 7
Eclipse Assessment Using Distributed Gradient Boosted Decision Tree-Specific Machine Learning Model
Modi, P., Sinha, A., Verma, T., Mishra, S., Arora, C., & Rathore, R. S. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-6318-4_5 · Cited by 7
Mythos der Maschine? Künstliche Intelligenz und Gesellschaftskritik
Heiland, H., Schütt, M., Sieron, S., & Syrovatka, F. (2024) · PROKLA Zeitschrift für kritische Sozialwissenschaft · doi:10.32387/prokla.v54i217.2167 · Cited by 8
Data Governance and Policy in Africa
Ndemo, B., Ndung’u, N., Odhiambo, S. A., & Shimeles, A. (2023) · Springer eBooks · doi:10.1007/978-3-031-24498-8 · Cited by 7
Lammerts, P., Lippmann, P., Hsu, Y.-C., Casati, F., & Yang, J. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604655 · Cited by 7
Practical and Ethical Perspectives on AI-Based Employee Performance EvaluationPreprint
Pletcher, S. N. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/29yej · Cited by 7
Algorithmic Fairness and Color-blind Racism: Navigating the IntersectionPreprint
Watson-Daniels, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.07778 · Cited by 7
Considering the ethics of large machine learning models in the chemical sciences
Spotte-Smith, E. W. C. (2025) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/adec3c · Cited by 6
Havens, L., Bach, B., Terras, M., & Alex, B. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713217 · Cited by 6
Understanding Conversational AI: Philosophy, Ethics, and Social Impact of Large Language Models
Poibeau, T. (2025) · Ubiquity Press eBooks · doi:10.5334/bde · Cited by 6
Johnson, R. L., Duran, L. D. D., Panai, E., González, N. M., Pistilli, G., Kalpokienė, J., & Bertulfo, D. J. (2026) · AI and Ethics · doi:10.1007/s43681-026-01038-x · Cited by 6
Algorithmic Status Inequality: An Integrative Perspective on AI‐Driven Social Stratification
Wu, J. (2026) · Journal of Management Studies · doi:10.1111/joms.70134 · Cited by 6
Levine, M. (2025) · British Journal of Social Psychology · doi:10.1111/bjso.12896 · Cited by 6
Antisubordinación y discriminación algorítmica
Ricart, A. C. I. (2024) · Teoría & Derecho Revista de pensamiento jurídico · doi:10.36151/td.2024.112 · Cited by 6
Building Trustworthy Machine Learning Models for AstronomyPreprint
Ntampaka, M., Ho, M., & Nord, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.14566 · Cited by 6
Back to the Future: On Potential Histories in NLPPreprint
Talat, Z., & Lauscher, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.06245 · Cited by 6
Metadata
- Authors
- Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M.
- Affiliations
- University College Dublin (IE)
- Stanford University (US)
- University of Michigan (US)
- University of Washington (US)
- University of Pittsburgh (US)
- Venue
- 2022 ACM Conference on Fairness Accountability and Transparency
- Publisher
- ACM
- Published
- 2022-06-20
- Pages
- 173-184
- OpenAlex
- W3174220540
- Cited by
- 317
- References
- 69
- Citations by year
- 2026: 72 · 2025: 66 · 2024: 63 · 2023: 70 · 2022: 36
- FWCI
- 58.38
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by-nc-sa)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Science Foundation Ireland (13/RC/2094-2)
- National Defense Science and Engineering Graduate
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- value neutrality, research ethics, research funding sources, institutional affiliation, societal impact of AI, novelty, centralization of power, NeurIPS
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.