The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Lessons from archives: strategies for collecting sociocultural data in machine learning
Open accessAbstract
A growing body of work shows that many problems in fairness, accountability, transparency, and ethics in machine learning systems are rooted in decisions surrounding the data collection and annotation process. In spite of its fundamental nature however, data collection remains an overlooked part of the machine learning (ML) pipeline. In this paper, we argue that a new specialization should be formed within ML that is focused on methodologies for data collection and annotation: efforts that require institutional frameworks and procedures. Specifically for sociocultural data, parallels can be drawn from archives and libraries. Archives are the longest standing communal effort to gather human information and archive scholars have already developed the language and procedures to address and discuss many challenges pertaining to data collection such as consent, power, inclusivity, transparency, and ethics & privacy. We discuss these five key approaches in document collection practices in archives that can inform data collection in sociocultural ML. By showing data collection practices from another field, we encourage ML research to be more cognizant and systematic in data collection and draw from interdisciplinary expertise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Data provenance frameworks developed in the context of AI and ML have incorporated perspectives from libraries and archives, feminist ethics and even the food industry (Holland et al. 2020;Jo and Gebru 2020;Luccioni et al. 2022).”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Jo and Gebru 2020
The cited source says what the claim attributes to it.
In the citing paper
“Through the work of AI bias scholars who have drawn on frameworks from archives to develop these concepts (e.g., Jo and Gebru 2020), provenance in AI has emerged as a reflective and communicative practice, if not necessarily a foundational one for the broader AI field.”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Jo and Gebru 2020
The cited source says what the claim attributes to it.
In the citing paper
“In dealing with the emerging ethical and legal challenges posed by AI developments, computer scientists have already turned, in one case at least, to archives for an example of ethical conduct in information management.”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Jo and Gebru [ 35 ] write that archives provide an example of a thoughtful approach to fraught issues of”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [35]
The cited source says what the claim attributes to it.
In the citing paper
“Since training AI on imbalanced datasets data can fuel inequalities”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [154]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Self-citationFairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Word embeddings quantify 100 years of gender and ethnic stereotypes
Garg, N., Schiebinger, L., Jurafsky, D., & Zou, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1720347115 · Cited by 1,065 · cited 1×
“For instance, [19] shows trained word embeddings replicating Asian stereotypes in language data from historical Google Books and the Corpus of Historical American English (COHA).”
BackgroundHovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614064 · Cited by 806 · cited 1×
“ears as the standard for Part-of-Speech tags [45]. Others include OntoNotes for coreference resolution and named entity recognition (NER) and the EuroParl parallel corpus for machine translation (MT) [30, 40]. Sometimes, researchers and practitioners build on top of existing datasets motivated by availability and conv…”
BackgroundImproving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
The Penn Treebank: annotating predicate argument structure
Marcus, M., Kim, G., Marcinkiewicz, M. A., MacIntyre, R., Bies, A., Ferguson, M., Katz, K., & Schasberger, B. (1994) · Proceedings of the workshop on Human Language Technology - HLT '94 · doi:10.3115/1075812.1075835 · Cited by 742
Community Histories, Community Archives: Some Opportunities and Challenges1
Flinn, A. (2007) · Journal of the Society of Archivists · doi:10.1080/00379810701611936 · Cited by 279
Hamidi, F., Scheuerman, M. K., & Branham, S. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173582 · Cited by 222
Widespread underprovision on Reddit
Gilbert, E. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441866 · Cited by 173
Research works printed but not linked: 26
- ALA. 2008. Code of Ethics of the American Library Association . American Library Association . http://www.ala.org/tools/ethics ALA. 2008. Code of Ethics of the American Library Association. American Library Association. http://www.ala.org/tools/ethics
- ARA. 2018. Code of Ethics . Archives & Records Association (U.K. & Ireland) . https://www.archives.org.uk/membership/code-of-ethics.html ARA. 2018. Code of Ethics. Archives & Records Association (U.K. & Ireland). https://www.archives.org.uk/membership/code-of-ethics.html
- Richard Breitman and Norman J.W . Goda . 2010 . Hitler's Shadow: Nazi War Criminals, U.S. Intelligence, and the Cold War. National Archives . Richard Breitman and Norman J.W. Goda. 2010. Hitler's Shadow: Nazi War Criminals, U.S. Intelligence, and the Cold War. National Archives.
- Caroline Brown . 2014. Archives and Recordkeeping: Theory into Practices . Facet Publishing . Caroline Brown. 2014. Archives and Recordkeeping: Theory into Practices. Facet Publishing.
- Joy Buolamwini and Timnit Gebru . 2018 . Gender shades: Intersectional accuracy disparities in commercial gender classification . In Conference on Fairness, Accountability and Transparency. 77--91 . Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency. 77--91.
- Maygene F. Daniels and Timothy Walch . 1984 . A Modern Archives Reader: Basic Readings on Archival Theory and Practice. National Archives and Records Service . Maygene F. Daniels and Timothy Walch. 1984. A Modern Archives Reader: Basic Readings on Archival Theory and Practice. National Archives and Records Service.
- Nancy Freeman and Holly Geist . 2014. FOIA Request . Case Studies in Archival Ethics ( 2014 ). Nancy Freeman and Holly Geist. 2014. FOIA Request. Case Studies in Archival Ethics (2014).
- Clare Garvie , Bedoya Alvaro , and Jonathan Frankle . 2016. The perpetual line-up: Unregulated police face recognition in America. Georgetown Law , Center on Privacy & Technology. Clare Garvie, Bedoya Alvaro, and Jonathan Frankle. 2016. The perpetual line-up: Unregulated police face recognition in America. Georgetown Law, Center on Privacy & Technology.
- Timnit Gebru , Jamie Morgenstern , Briana Vecchione , Jennifer Wortman Vaughan , Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018 . Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). · arXiv
- Tracy B. Grimm and Chon A. Noriega . 2013 . Documenting Regional Latino Arts and Culture: Case Studies for a Collaborative , Community-Oriented Approach. The American Archivist 76 (2013), 95 -- 112 . Tracy B. Grimm and Chon A. Noriega. 2013. Documenting Regional Latino Arts and Culture: Case Studies for a Collaborative, Community-Oriented Approach. The American Archivist 76 (2013), 95--112.
- Ailsa C. Holland and Elizabeth Mullins . 2013 . Archives and Archivists 2: Current Trends, New Voices. Four Courts Press . Ailsa C. Holland and Elizabeth Mullins. 2013. Archives and Archivists 2: Current Trends, New Voices. Four Courts Press.
- Valerie Horton and Greg Pronevitz . 2015 . Library Consortia: Models for Collaboration and Sustainability. ALA Editions. Valerie Horton and Greg Pronevitz. 2015. Library Consortia: Models for Collaboration and Sustainability. ALA Editions.
- ICRM. 2016. Code of Ethics . Institute of Certified Records Managers. https ://www.icrm.org/code-of-ethics ICRM. 2016. Code of Ethics. Institute of Certified Records Managers. https://www.icrm.org/code-of-ethics
- Os Keyes , Nikki Stevens , and Jacqueline Wernimont . 2019. The Government Is Using the Most Vulnerable People to Test Facial Recognition Software. Slate Magazine ( 2019 ). Os Keyes, Nikki Stevens, and Jacqueline Wernimont. 2019. The Government Is Using the Most Vulnerable People to Test Facial Recognition Software. Slate Magazine (2019).
- Christopher Kitching and Ian Hart . 1995. Collection Policy Statements. Journal of the Society of Archivists 16 ( 1995 ). http://www.nationalarchives.gov.uk/documents/archives/archive-collection-policy.pdf Christopher Kitching and Ian Hart. 1995. Collection Policy Statements. Journal of the Society of Archivists 16 (1995). http://www.nationalarchives.gov.uk/documents/archives/archive-collection-policy.pdf
- Philipp Koehn . 2005 . Europarl: A parallel corpus for statistical machine translation. In MT summit , Vol. 5 . 79--86. Philipp Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. In MT summit, Vol. 5. 79--86.
- Katherine McCardwell . 2014. Intellectual Propoerty Concerns in Undocumented Corporate Collections. Case Studies in Archival Ethics ( 2014 ). Katherine McCardwell. 2014. Intellectual Propoerty Concerns in Undocumented Corporate Collections. Case Studies in Archival Ethics (2014).
- Paul Mozur . 2019. One Month , 500,000 Face Scans : How China Is Using A.I. to Profile a Minority. The New York Times ( 2019 ). Paul Mozur. 2019. One Month, 500,000 Face Scans: How China Is Using A.I. to Profile a Minority. The New York Times (2019).
- MS. 1999. The Manuscript Society of Code of Ethics Adopted by the Board of Trustees May 26, 1999 . The Manuscript Society . manuscript.org/about/code-of-ethics MS. 1999. The Manuscript Society of Code of Ethics Adopted by the Board of Trustees May 26, 1999. The Manuscript Society. manuscript.org/about/code-of-ethics
- Timothy D. Pyatt . 2015. The Harding Affair Letters: How One Archivist Took Every Measure Possible To Ensure Their Preservation. Case Studies in Archival Ethics ( 2015 ). Timothy D. Pyatt. 2015. The Harding Affair Letters: How One Archivist Took Every Measure Possible To Ensure Their Preservation. Case Studies in Archival Ethics (2015).
- Alec Radford , Jeffrey Wu , Rewon Child , David Luan , Dario Amodei , and Ilya Sutskever . 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 ( 2019 ). Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019).
- Ellen M. Ryan . 2014. Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution. Case Studies in Archival Ethics ( 2014 ). Ellen M. Ryan. 2014. Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution. Case Studies in Archival Ethics (2014).
- SAA. 2011. SAA Core Values Statement and Code of Ethics . Society of American Archivists . https://www2.archivists.org/statements/saa-core-values-statement-and-code-of-ethics SAA. 2011. SAA Core Values Statement and Code of Ethics. Society of American Archivists. https://www2.archivists.org/statements/saa-core-values-statement-and-code-of-ethics
- SAA. 2013 . Describing Archives: A Content Standard ( second ed.). Society of American Archivists . SAA. 2013. Describing Archives: A Content Standard (second ed.). Society of American Archivists.
- Harini Suresh and John V . Guttag . 2019 . A Framework for Understanding Unintended Consequences of Machine Learning. ArXiv abs/1901.10002 (2019). Harini Suresh and John V. Guttag. 2019. A Framework for Understanding Unintended Consequences of Machine Learning. ArXiv abs/1901.10002 (2019). · arXiv
- Aditya Tripathi and Jawahar Lal . 2016 . Library Consortia: Practical Guide for Library Managers . Chandos Publishing . Aditya Tripathi and Jawahar Lal. 2016. Library Consortia: Practical Guide for Library Managers. Chandos Publishing.
Cited by
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Self-citationOn the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Taxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models
Gehman, S., Gururangan, S., Sap, M., Choi, Y., & Smith, N. A. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.301 · Cited by 693
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548
Metadata
- Authors
- Jo, E. S., & Gebru, T.
- Affiliations
- Stanford University (US)
- Google (United States) (US)
- ORCID
- Gebru, Timnit
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 306-316
- OpenAlex
- W4288083800
- Semantic Scholar
- 3dea5fbc7b4b304d57881f8d50c1c0438aef6996
- Cited by
- 240
- References
- 19
- Citations by year
- 2026: 26 · 2025: 37 · 2024: 43 · 2023: 49 · 2022: 44 · 2021: 37 · 2020: 4
- FWCI
- 34.75
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Social Sciences › Arts and Humanities › Conservation › Digital and Traditional Archives Management
- Keywords
- data collection, data annotation, archives, libraries, machine learning ethics, consent, inclusivity, transparency, privacy, fairness and accountability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Lessons from archives: strategies for collecting sociocultural data in machine learning. https://app.cochat.ai/papers/10.1145/3351095.3372829
- The paper
- Jo, E. S., & Gebru, T. (2020). Lessons from archives: strategies for collecting sociocultural data in machine learning. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3351095.3372829
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.