Lessons from archives: strategies for collecting sociocultural data in machine learning
Open accessThe DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
A growing body of work shows that many problems in fairness, accountability, transparency, and ethics in machine learning systems are rooted in decisions surrounding the data collection and annotation process. In spite of its fundamental nature however, data collection remains an overlooked part of the machine learning (ML) pipeline. In this paper, we argue that a new specialization should be formed within ML that is focused on methodologies for data collection and annotation: efforts that require institutional frameworks and procedures. Specifically for sociocultural data, parallels can be drawn from archives and libraries. Archives are the longest standing communal effort to gather human information and archive scholars have already developed the language and procedures to address and discuss many challenges pertaining to data collection such as consent, power, inclusivity, transparency, and ethics & privacy. We discuss these five key approaches in document collection practices in archives that can inform data collection in sociocultural ML. By showing data collection practices from another field, we encourage ML research to be more cognizant and systematic in data collection and draw from interdisciplinary expertise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Data provenance frameworks developed in the context of AI and ML have incorporated perspectives from libraries and archives, feminist ethics and even the food industry (Holland et al. 2020;Jo and Gebru 2020;Luccioni et al. 2022).”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Jo and Gebru 2020
The cited source says what the claim attributes to it.
In the citing paper
“Through the work of AI bias scholars who have drawn on frameworks from archives to develop these concepts (e.g., Jo and Gebru 2020), provenance in AI has emerged as a reflective and communicative practice, if not necessarily a foundational one for the broader AI field.”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Jo and Gebru 2020
The cited source says what the claim attributes to it.
In the citing paper
“In dealing with the emerging ethical and legal challenges posed by AI developments, computer scientists have already turned, in one case at least, to archives for an example of ethical conduct in information management.”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Jo and Gebru [ 35 ] write that archives provide an example of a thoughtful approach to fraught issues of”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Since training AI on imbalanced datasets data can fuel inequalities”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [154]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Self-citationFairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Word embeddings quantify 100 years of gender and ethnic stereotypes
Garg, N., Schiebinger, L., Jurafsky, D., & Zou, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1720347115 · Cited by 1,065 · cited 1×
“For instance, [19] shows trained word embeddings replicating Asian stereotypes in language data from historical Google Books and the Corpus of Historical American English (COHA).”
BackgroundHovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614064 · Cited by 806 · cited 1×
“ears as the standard for Part-of-Speech tags [45]. Others include OntoNotes for coreference resolution and named entity recognition (NER) and the EuroParl parallel corpus for machine translation (MT) [30, 40]. Sometimes, researchers and practitioners build on top of existing datasets motivated by availability and conv…”
BackgroundImproving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
The Penn Treebank: annotating predicate argument structure
Marcus, M., Kim, G., Marcinkiewicz, M. A., MacIntyre, R., Bies, A., Ferguson, M., Katz, K., & Schasberger, B. (1994) · Proceedings of the workshop on Human Language Technology - HLT '94 · doi:10.3115/1075812.1075835 · Cited by 742
Community Histories, Community Archives: Some Opportunities and Challenges1
Flinn, A. (2007) · Journal of the Society of Archivists · doi:10.1080/00379810701611936 · Cited by 279
Hamidi, F., Scheuerman, M. K., & Branham, S. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173582 · Cited by 222
Widespread underprovision on Reddit
Gilbert, E. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441866 · Cited by 173
Research works printed but not linked: 26
- ALA. 2008. Code of Ethics of the American Library Association . American Library Association . http://www.ala.org/tools/ethics ALA. 2008. Code of Ethics of the American Library Association. American Library Association. http://www.ala.org/tools/ethics
- ARA. 2018. Code of Ethics . Archives & Records Association (U.K. & Ireland) . https://www.archives.org.uk/membership/code-of-ethics.html ARA. 2018. Code of Ethics. Archives & Records Association (U.K. & Ireland). https://www.archives.org.uk/membership/code-of-ethics.html
- Richard Breitman and Norman J.W . Goda . 2010 . Hitler's Shadow: Nazi War Criminals, U.S. Intelligence, and the Cold War. National Archives . Richard Breitman and Norman J.W. Goda. 2010. Hitler's Shadow: Nazi War Criminals, U.S. Intelligence, and the Cold War. National Archives.
- Caroline Brown . 2014. Archives and Recordkeeping: Theory into Practices . Facet Publishing . Caroline Brown. 2014. Archives and Recordkeeping: Theory into Practices. Facet Publishing.
- Joy Buolamwini and Timnit Gebru . 2018 . Gender shades: Intersectional accuracy disparities in commercial gender classification . In Conference on Fairness, Accountability and Transparency. 77--91 . Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency. 77--91.
- Maygene F. Daniels and Timothy Walch . 1984 . A Modern Archives Reader: Basic Readings on Archival Theory and Practice. National Archives and Records Service . Maygene F. Daniels and Timothy Walch. 1984. A Modern Archives Reader: Basic Readings on Archival Theory and Practice. National Archives and Records Service.
- Nancy Freeman and Holly Geist . 2014. FOIA Request . Case Studies in Archival Ethics ( 2014 ). Nancy Freeman and Holly Geist. 2014. FOIA Request. Case Studies in Archival Ethics (2014).
- Clare Garvie , Bedoya Alvaro , and Jonathan Frankle . 2016. The perpetual line-up: Unregulated police face recognition in America. Georgetown Law , Center on Privacy & Technology. Clare Garvie, Bedoya Alvaro, and Jonathan Frankle. 2016. The perpetual line-up: Unregulated police face recognition in America. Georgetown Law, Center on Privacy & Technology.
- Timnit Gebru , Jamie Morgenstern , Briana Vecchione , Jennifer Wortman Vaughan , Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018 . Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). · arXiv
- Tracy B. Grimm and Chon A. Noriega . 2013 . Documenting Regional Latino Arts and Culture: Case Studies for a Collaborative , Community-Oriented Approach. The American Archivist 76 (2013), 95 -- 112 . Tracy B. Grimm and Chon A. Noriega. 2013. Documenting Regional Latino Arts and Culture: Case Studies for a Collaborative, Community-Oriented Approach. The American Archivist 76 (2013), 95--112.
- Ailsa C. Holland and Elizabeth Mullins . 2013 . Archives and Archivists 2: Current Trends, New Voices. Four Courts Press . Ailsa C. Holland and Elizabeth Mullins. 2013. Archives and Archivists 2: Current Trends, New Voices. Four Courts Press.
- Valerie Horton and Greg Pronevitz . 2015 . Library Consortia: Models for Collaboration and Sustainability. ALA Editions. Valerie Horton and Greg Pronevitz. 2015. Library Consortia: Models for Collaboration and Sustainability. ALA Editions.
- ICRM. 2016. Code of Ethics . Institute of Certified Records Managers. https ://www.icrm.org/code-of-ethics ICRM. 2016. Code of Ethics. Institute of Certified Records Managers. https://www.icrm.org/code-of-ethics
- Os Keyes , Nikki Stevens , and Jacqueline Wernimont . 2019. The Government Is Using the Most Vulnerable People to Test Facial Recognition Software. Slate Magazine ( 2019 ). Os Keyes, Nikki Stevens, and Jacqueline Wernimont. 2019. The Government Is Using the Most Vulnerable People to Test Facial Recognition Software. Slate Magazine (2019).
- Christopher Kitching and Ian Hart . 1995. Collection Policy Statements. Journal of the Society of Archivists 16 ( 1995 ). http://www.nationalarchives.gov.uk/documents/archives/archive-collection-policy.pdf Christopher Kitching and Ian Hart. 1995. Collection Policy Statements. Journal of the Society of Archivists 16 (1995). http://www.nationalarchives.gov.uk/documents/archives/archive-collection-policy.pdf
- Philipp Koehn . 2005 . Europarl: A parallel corpus for statistical machine translation. In MT summit , Vol. 5 . 79--86. Philipp Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. In MT summit, Vol. 5. 79--86.
- Katherine McCardwell . 2014. Intellectual Propoerty Concerns in Undocumented Corporate Collections. Case Studies in Archival Ethics ( 2014 ). Katherine McCardwell. 2014. Intellectual Propoerty Concerns in Undocumented Corporate Collections. Case Studies in Archival Ethics (2014).
- Paul Mozur . 2019. One Month , 500,000 Face Scans : How China Is Using A.I. to Profile a Minority. The New York Times ( 2019 ). Paul Mozur. 2019. One Month, 500,000 Face Scans: How China Is Using A.I. to Profile a Minority. The New York Times (2019).
- MS. 1999. The Manuscript Society of Code of Ethics Adopted by the Board of Trustees May 26, 1999 . The Manuscript Society . manuscript.org/about/code-of-ethics MS. 1999. The Manuscript Society of Code of Ethics Adopted by the Board of Trustees May 26, 1999. The Manuscript Society. manuscript.org/about/code-of-ethics
- Timothy D. Pyatt . 2015. The Harding Affair Letters: How One Archivist Took Every Measure Possible To Ensure Their Preservation. Case Studies in Archival Ethics ( 2015 ). Timothy D. Pyatt. 2015. The Harding Affair Letters: How One Archivist Took Every Measure Possible To Ensure Their Preservation. Case Studies in Archival Ethics (2015).
- Alec Radford , Jeffrey Wu , Rewon Child , David Luan , Dario Amodei , and Ilya Sutskever . 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 ( 2019 ). Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019).
- Ellen M. Ryan . 2014. Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution. Case Studies in Archival Ethics ( 2014 ). Ellen M. Ryan. 2014. Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution. Case Studies in Archival Ethics (2014).
- SAA. 2011. SAA Core Values Statement and Code of Ethics . Society of American Archivists . https://www2.archivists.org/statements/saa-core-values-statement-and-code-of-ethics SAA. 2011. SAA Core Values Statement and Code of Ethics. Society of American Archivists. https://www2.archivists.org/statements/saa-core-values-statement-and-code-of-ethics
- SAA. 2013 . Describing Archives: A Content Standard ( second ed.). Society of American Archivists . SAA. 2013. Describing Archives: A Content Standard (second ed.). Society of American Archivists.
- Harini Suresh and John V . Guttag . 2019 . A Framework for Understanding Unintended Consequences of Machine Learning. ArXiv abs/1901.10002 (2019). Harini Suresh and John V. Guttag. 2019. A Framework for Understanding Unintended Consequences of Machine Learning. ArXiv abs/1901.10002 (2019). · arXiv
- Aditya Tripathi and Jawahar Lal . 2016 . Library Consortia: Practical Guide for Library Managers . Chandos Publishing . Aditya Tripathi and Jawahar Lal. 2016. Library Consortia: Practical Guide for Library Managers. Chandos Publishing.
Cited by
Items 101–200 of 381
Smallset Timelines: A Visual Representation of Data Preprocessing Decisions
Lucchesi, L. R., Kuhnert, P., Davis, J. L., & Xie, L. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533175 · Cited by 33
Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia
Kuo, T.-S., Halfaker, A., Cheng, Z., Kim, J., Wu, M.-H., Wu, T., Holstein, K., & Zhu, H. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642278 · Cited by 54
Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Papers
Peng, K., Mathur, A., & Narayanan, A. (2021) · arXiv · doi:10.48550/arxiv.2108.02922 · Cited by 31
“Other researchers have proposed guidelines for ethical data collection [43], drawing from “interventionist” approaches modeled on archives [51] or focusing on specific principles, such as requiring informed consent from data subjects [70].”
BackgroundDeep learning methods for poultry disease prediction using images
Chidziwisano, G. H., Samikwa, E., & Daka, C. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109765 · Cited by 31
What Question Answering can Learn from Trivia Nerds
Boyd-Graber, J. L., & Börschinger, B. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.662 · Cited by 31
Know(ing) Infrastructure: The Wayback Machine as object and instrument of digital research
Ogden, J., Summers, E., & Walker, S. (2023) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565231164759 · Cited by 34
Epistemic Power in AI Ethics Labor: Legitimizing Located Complaints
Widder, D. G. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658973 · Cited by 45
The agency of computer vision models as optical instruments
Smits, T., & Wevers, M. (2021) · Visual Communication · doi:10.1177/1470357221992097 · Cited by 33
The ROOTS Search Tool: Data Transparency for LLMs
Piktus, A., Akiki, C., Villegas, P., Laurençon, H., Dupont, G., Luccioni, A. S., Jernite, Y., & Rogers, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-demo.29 · Cited by 59
Huda, M., Serour, R. O. H., Musolin, M. H., Azman, M., Yauri, A. M., Bakar, A., Zuhri, M. I., Mujahidin, & Hasanah, U. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-53549-9_32 · Cited by 29
Managing Bias When Library Collections Become Data
Coleman, C. (2020) · International Journal of Librarianship · doi:10.23974/ijol.2020.vol5.1.162 · Cited by 32
A Novel Auto-Annotation Technique for Aspect Level Sentiment Analysis
Qureshi, M. A., Asif, M., Hassan, M. F., Mustafa, G., Ehsan, M. K., Ali, A., & Sajid, U. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.020544 · Cited by 32
Documenting Data Production Processes: A Participatory Approach for Data Work
Miceli, M., Yang, T., Alvarado Garcia, A., Posada, J., Wang, S. M., Pohl, M., & Hanna, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555623 · Cited by 28
An archival perspective on pretraining data
Desai, M. A., Pasquetto, I. V., Jacobs, A. Z., & Card, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100966 · Cited by 35
Reinforcing data bias in crisis information management: The case of the Yemen humanitarian response
Paulus, D., de Vries, G., Janssen, M., & de Walle, B. V. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102663 · Cited by 28
Tseng, E., Bellini, R. F., Lee, Y., Ramjit, A., Ristenpart, T., & Dell, N. L. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637316 · Cited by 33
Cordella, C., Marte, M. J., Liu, H., & Kiran, S. (2024) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2024_persp-24-00037 · Cited by 32
AI with Museums and Cultural Heritage
Caramiaux, B. (2023) · Edition Museum · doi:10.14361/9783839467107-011 · Cited by 38
Comparative Evaluation of Label-Agnostic Selection Bias in Multilingual Hate Speech Datasets
Ousidhoum, N. D., Song, Y., & Yeung, D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.199 · Cited by 36
Cameron, S., Franks, P., & Hamidzadeh, B. (2023) · Journal on Computing and Cultural Heritage · doi:10.1145/3594728 · Cited by 25
Kraft, A., & Soulier, E. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658981 · Cited by 25
Conceptualizing Algorithmic Stigmatization
Andalibi, N., Pyle, C., Barta, K., Xian, L., Jacobs, A. Z., & Ackerman, M. S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580970 · Cited by 33
Barrett, T., Chen, Q. Z., & Zhang, A. X. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594114 · Cited by 37
Survey on the Evaluation of Generative Models in Music
Lerch, A., Arthur, C., Bryan–Kinns, N., Ford, C., Sun, Q., & Vinay, A. (2025) · ACM Computing Surveys · doi:10.1145/3769106 · Cited by 39
Fairness by “Where”: A Statistically-Robust and Model-Agnostic Bi-level Learning Framework
Xie, Y., He, E., Jia, X., Chen, W., Skakun, S. V., Bao, H., Jiang, Z., Ghosh, R., & Ravirathinam, P. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21481 · Cited by 41
Machine learning data practices through a data curation lens: An evaluation framework
Bhardwaj, E., Gujral, H., Wu, S., Zogheib, C., Maharaj, T., & Becker, C. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658955 · Cited by 44
Machine learning in biological research: key algorithms, applications, and future directions
Alam, M. N. U., Basava, K., Chitransh, A., Fattah, H. M. A., Garcia‐Verdugo, H. D., Lo, S.-H., Lohchab, T., Martinet, K. M., Román‐Palacios, C., Salazar, J. C., et al. (2025) · BMC Biology · doi:10.1186/s12915-025-02424-3 · Cited by 29
From Documents to Data: A Framework for Total Corpus Quality
Bodell, M. H., Magnusson, M., & Mützel, S. (2022) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231221135523 · Cited by 24
Confound-leakage: confound removal in machine learning leads to leakage
Hamdan, S., Love, B. C., von Polier, G. G., Weis, S., Schwender, H. R., Eickhoff, S. B., & Patil, K. R. (2022) · GigaScience · doi:10.1093/gigascience/giad071 · Cited by 24
Ain, Q. U., Nazir, R., Nawaz, A., Shahbaz, H., Dilshad, A., Mufti, I. U., & Iftikhar, M. (2024) · Journal of Clinical and Translational Pathology · doi:10.14218/jctp.2023.00061 · Cited by 27
Creative AI: From Expressive Mimicry to Critical Inquiry
Forbes, A. G. (2020) · Artnodes · doi:10.7238/a.v0i26.3370 · Cited by 32
“Democratizing AI” and the Concern of Algorithmic Injustice
Lin, T.-A. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00792-2 · Cited by 26
Generative Artificial Intelligence
Rios-Campos, C. A., Viteri, J. D. C. L., Batalla, E. A. P., Castro, J. F. C., Núñez, J. B., Calderón, E. V., Nicacio, F. J. G., & Tello, M. Y. P. (2023) · South Florida Journal of Development · doi:10.46932/sfjdv4n6-008 · Cited by 25
Agreements ‘in the wild’: Standards and alignment in machine learning benchmark dataset construction
Engdahl, I. (2024) · Big Data & Society · doi:10.1177/20539517241242457 · Cited by 25
Automating Procedurally Fair Feature Selection in Machine Learning
Belitz, C., Jiang, L., & Bosch, N. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462585 · Cited by 27
PEFT-as-an-Attack! Jailbreaking Language Models during Federated Parameter-Efficient Fine-TuningPreprint
Li, S., Ngai, E. C. ‐., Ye, F., & Voigt, T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.19335 · Cited by 24
Halterman, A., Keith, K. A., Sarwar, S. M., & O’Connor, B. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.371 · Cited by 30
Contributing to Accessibility Datasets: Reflections on Sharing Study Data by Blind People
Kamikubo, R., Lee, K., & Kacorri, H. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581337 · Cited by 26
Why we need biased AI: How including cognitive biases can enhance AI systems
Hagendorff, T., & Fabi, S. (2024) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2023.2178517 · Cited by 20
Scheuerman, M. K., Weathington, K., Mugunthan, T., Denton, E., & Fiesler, C. L. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579488 · Cited by 27
Physics Guided Neural Networks for Time-Aware Fairness: An Application in Crop Yield Prediction
He, E., Xie, Y., Liu, L., Chen, W., Jin, Z., & Jia, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26664 · Cited by 20
Hate Speech Classifiers are Culturally Insensitive
Lee, N., Jung, C., & Oh, A. H. (2023) · Workshop on Cross-Cultural Considerations in NLP (C3NLP) · doi:10.18653/v1/2023.c3nlp-1.5 · Cited by 20
Pitfalls in Machine Learning Research: Reexamining the Development CyclePreprint
Biderman, S., & Scheirer, W. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02832 · Cited by 25
Adaptive Sampling for Minimax Fair ClassificationPreprint
Shekhar, S., Fields, G., Ghavamzadeh, M., & Javidi, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00755 · Cited by 44
Heyn, H.-M., Habibullah, K. M., Knauss, E., Horkoff, J., Borg, M., Knauss, A., & Li, P. J. (2023) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain58948.2023.00011 · Cited by 23
Fairness and bias in AI: a sociotechnical perspective
Mimouni, S. E., & Bouhdadi, M. (2025) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-12-2024-0182 · Cited by 19
Detecting discriminatory risk through data annotation based on Bayesian inferences
Beretta, E., Vetrò, A., Lepri, B., & Martin, J. C. D. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445940 · Cited by 18
Representation Matters: Assessing the Importance of Subgroup Allocations in Training DataPreprint
Rolf, E., Worledge, T., Recht, B., & Jordan, M. I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03399 · Cited by 25
What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus
Luccioni, A. S., & Viviano, J. D. (2021) · arXiv · doi:10.48550/arxiv.2105.02732 · Cited by 17
Benchmark Data Repositories for Better Benchmarking
Longjohn, R., Kelly, M., Singh, S., & Smyth, P. (2024) · neural information processing systems · doi:10.52202/079017-2744 · Cited by 33
Fatahi, S., Mousavifar, S. M., & Vassileva, J. (2023) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3565472.3592958 · Cited by 17
Listening to Affected Communities to Define Extreme Speech: Dataset and Experiments
Maronikolakis, A., Wisiorek, A., Nann, L., Jabbar, H., Udupa, S., & Schuetze, H. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.87 · Cited by 33
Steele, L., Tan, X. L., Olabi, B., Gao, J., Tanaka, R. J., & Williams, H. C. (2022) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.18814 · Cited by 17
Creative Writers' Attitudes on Writing as Training Data for Large Language Models
Gero, K. I., Desai, M., Schnitzler, C., Eom, N., Cushman, J., & Glassman, E. L. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713287 · Cited by 16
“Jo and Gebru (2020)outlinefive importantaspectsof data collection from archival and library sciences, and how they may be applied in the machine learning setting, such as actively collecting underrepresented data and allowing participants to denote sensitivity and access levels for their data.”
A Polyvocal and Contextualised Semantic Web
van Erp, M., & de Boer, V. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77385-4_30 · Cited by 16
Chiodo, M., & Müller, D. (2023) · arXiv (Cornell University) · doi:10.5281/zenodo.16729482 · Cited by 16
Data-Centric Factors in Algorithmic Fairness
Li, N., Goel, N., & Ash, E. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534147 · Cited by 25
Wevers, M., Vriend, N., & Bruin, A. D. (2022) · TMG Journal for Media History · doi:10.18146/tmg.815 · Cited by 17
Citizens’ data afterlives: Practices of dataset inclusion in machine learning for public welfare
Ratner, H., & Thylstrup, N. B. (2024) · AI & Society · doi:10.1007/s00146-024-01920-4 · Cited by 14
The Power of Absence: Thinking with Archival Theory in Algorithmic Design
Sherman, J., Morrison, R. R., Klein, L. F., & Rosner, D. K. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660690 · Cited by 34
On Political Theory and Large Language Models
Rodman, E. (2023) · Political Theory · doi:10.1177/00905917231200826 · Cited by 17
Sharing Practices for Datasets Related to Accessibility and Aging
Kamikubo, R., Dwivedi, U., & Kacorri, H. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471208 · Cited by 13
Migliorini, S. (2024) · European Journal of Risk Regulation · doi:10.1017/err.2024.4 · Cited by 13
Moshood, T. D., Rotimi, J. O. B., & Shahzad, W. M. (2025) · Management Research Review · doi:10.1108/mrr-06-2024-0422 · Cited by 13
Sailing in the location-based fairness-bias sphere
He, E., Xie, Y., Jia, X., Chen, W., Bao, H., Zhou, X. S., Jiang, Z., Ghosh, R., & Ravirathinam, P. (2022) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/3557915.3560976 · Cited by 17
Putting humans back in the loop of machine learning in Canadian smart cities
Zheng, Z., & Sieber, R. E. (2021) · Transactions in GIS · doi:10.1111/tgis.12869 · Cited by 13
Gomes, L. I. E. (2022) · Revista Ibero-Americana de Ciência da Informação · doi:10.26512/rici.v15.n1.2022.41490 · Cited by 12
htmldate: A Python package to extract publication dates from web pages
Barbaresi, A. (2020) · The Journal of Open Source Software · doi:10.21105/joss.02439 · Cited by 12
Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp
Hong, R., Agnew, W., Kohno, T., & Morgenstern, J. (2024) · Proceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3689904.3694702 · Cited by 11
Leka, E., Aliti, A., Lamani, L., & Hoxha, E. (2025) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro65660.2025.11132035 · Cited by 11
Datta, S., Saleem, T. J., Barati, M., López, M. V., Furgala, M., Vanegas, D. C., Santucci, G., Khargonekar, P. P., & McLamore, E. S. (2021) · Wiley eBooks · doi:10.1002/9781119740780.ch2 · Cited by 14
Managing and accessing web archives: Irish practitioners’ perspectives
Ryan, M., Keating, D., & Finegan, J. (2022) · AI & Society · doi:10.1007/s00146-021-01364-0 · Cited by 12
A Simulator for Human-Robot Interaction in Virtual Reality
Murnane, M., Higgins, P., Saraf, M., Ferraro, F., Matuszek, C., & Engel, D. (2021) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw52623.2021.00117 · Cited by 17
Bak, G. (2024) · Archival Science · doi:10.1007/s10502-024-09462-w · Cited by 4
Croskey, P., Offert, F., Jacobs, J., & Thaler, K. M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732058 · Cited by 12
Boykin, C. M., Dasch, S. T., Rice, V., Lakshminarayanan, V. R., Togun, T. A., & Brown, S. M. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483302 · Cited by 11
From archive to dataset. Visualizing the latency of big data
Voto, C. (2022) · Punctum International Journal of Semiotics · doi:10.18680/hss.2022.0004 · Cited by 10
Sendak, M., Sirdeshmukh, G., Ochoa, T., Premo, H., Tang, L., Niederhoffer, K., Reed, S., Deshpande, K., Sterrett, E., Bauer, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2208.02670 · Cited by 10
Decentralized Infrastructure for (Neuro)sciencePreprint
Saunders, J. L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.07493 · Cited by 11
Gallano, G., Giglio, A., & Ferre, A. (2025) · Journal of Voice · doi:10.1016/j.jvoice.2025.04.010 · Cited by 9
Tracing the Past, Predicting the Future: A Systematic Review of AI in Archival Science
Shinde, G., Kirstein, T., Ghosh, S., & Franks, P. C. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1286 · Cited by 9
Algorithmic Art and Cultural Sustainability in the Museum Sector
Taurino, G. (2023) · Philosophical studies series · doi:10.1007/978-3-031-21147-8_18 · Cited by 10
Havens, L., Alex, B., Bach, B., & Terras, M. (2022) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2022.gebnlp-1.4 · Cited by 19
Handle with Care: Lessons for Data Science from Black Female Scholars
Raji, I. D. (2020) · Patterns · doi:10.1016/j.patter.2020.100150 · Cited by 13
AccessShare: Co-designing Data Access and Sharing with Blind People
Kamikubo, R., Zeraati, F. Z., Lee, K., & Kacorri, H. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3675612 · Cited by 11
Bhardwaj, E., Gujral, H., Wu, S., Zogheib, C., Maharaj, T., & Becker, C. (2024) · neural information processing systems · doi:10.52202/079017-1698 · Cited by 13
HR in the Era of AI Paradoxes: Balancing Automation and Human Touch
Suneetha, S., Sudheer, A. K., Shankar, C., & Metta, S. (2024) · Advances in economics, business and management research/Advances in Economics, Business and Management Research · doi:10.2991/978-94-6463-433-4_40 · Cited by 11
Gebru, T., & Denton, E. (2024) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000102 · Cited by 16
Self-citationChallenges and Perspectives of Hate Speech Research
Strippel, C., Paasch‐Colberg, S., Emmer, M., & Trebbe, J. (2023) · Weizenbaum Library (Weizenbaum Institute) · doi:10.48541/dcr.v12.0 · Cited by 25
Algorithmic fairness in social context
Huang, Y., Liu, W., Gao, W., Lu, X., Liang, X., Yang, Z., Li, H., Ma, L., & Tang, S. (2023) · BenchCouncil Transactions on Benchmarks Standards and Evaluations · doi:10.1016/j.tbench.2023.100137 · Cited by 8
Spacerini: Plug-and-play Search Engines with Pyserini and Hugging Face
Akiki, C., Ogundepo, O., Piktus, A., Zhang, X., Oladipo, A., Lin, J., & Potthast, M. (2023) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2023.emnlp-demo.12 · Cited by 8
Towards A Fairer Landmark Recognition DatasetPreprint
Kim, Z., Araújo, A. D. M., Cao, B., Askew, C., Sim, J., Green, M., Yilla, N. F., & Weyand, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08874 · Cited by 8
PARTICUL: Part Identification with Confidence Measure Using Unsupervised Learning
Xu-Darme, R., Quenot, G. M., Chihani, Z., & Rousset, M.-C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-37731-0_14 · Cited by 7
Stereotypical nationality representations in HRI: perspectives from international young adults
Cumbal, R., Axelsson, A. J., Mehta, S., & Engwall, O. (2023) · Frontiers in Robotics and AI · doi:10.3389/frobt.2023.1264614 · Cited by 9
The Idealized Machine Learning Pipeline (IMLP) for Advancing Reproducibility in Machine Learning
Zheng, Y., & Stodden, V. (2024) · ACM Conference on Reproducibility and Replicability (ACM REP) · doi:10.1145/3641525.3663630 · Cited by 7
AI and the Future of Work: Bridging Divides for Marginalised Workers
Kyriakidou, O., Goumas, B., Manteli, M., & Tasoula, E. (2025) · International perspectives on equality, diversity and inclusion · doi:10.1108/s2051-233320250000012023 · Cited by 7
Algorithms in the Stacks: Investigating automated, for-profit diversity audits in public libraries
Walsh, M., Rey, C. F., Ge, C., Nowak, T., & Tomkins, S. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732140 · Cited by 7
Chávez, V. M., Martínez-Sánchez, M. E., Winocur, J. Y., & Nateras, G. S. (2021) · Iberoforum Revista de Ciencias Sociales · doi:10.48102/if.2021.v1.n1.149 · Cited by 7
Alexa, Is This a Historical Record?
Venkata, S. K., Young, P., Bell, M. R., & Green, A. (2021) · Journal on Computing and Cultural Heritage · doi:10.1145/3479008 · Cited by 8
Tensions Between the Proxies of Human Values in AI
Datta, T., Nissani, D., Cembalest, M., Khanna, A., Massa, H., & Dickerson, J. P. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00049 · Cited by 8
Metadata
- Authors
- Jo, E. S., & Gebru, T.
- Affiliations
- Stanford University (US)
- Google (United States) (US)
- ORCID
- Gebru, Timnit
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 306-316
- OpenAlex
- W4288083800
- Semantic Scholar
- 3dea5fbc7b4b304d57881f8d50c1c0438aef6996
- Cited by
- 240
- References
- 19
- Citations by year
- 2026: 26 · 2025: 37 · 2024: 43 · 2023: 49 · 2022: 44 · 2021: 37 · 2020: 4
- FWCI
- 34.75
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Social Sciences › Arts and Humanities › Conservation › Digital and Traditional Archives Management
- Keywords
- data collection, data annotation, archives, libraries, machine learning ethics, consent, inclusivity, transparency, privacy, fairness and accountability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.