CoChat

Lessons from archives: strategies for collecting sociocultural data in machine learning

Open access
Jo, Eun Seo, Gebru, Timnit · 2020 · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency

The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.

Abstract

A growing body of work shows that many problems in fairness, accountability, transparency, and ethics in machine learning systems are rooted in decisions surrounding the data collection and annotation process. In spite of its fundamental nature however, data collection remains an overlooked part of the machine learning (ML) pipeline. In this paper, we argue that a new specialization should be formed within ML that is focused on methodologies for data collection and annotation: efforts that require institutional frameworks and procedures. Specifically for sociocultural data, parallels can be drawn from archives and libraries. Archives are the longest standing communal effort to gather human information and archive scholars have already developed the language and procedures to address and discuss many challenges pertaining to data collection such as consent, power, inclusivity, transparency, and ethics & privacy. We discuss these five key approaches in document collection practices in archives that can inform data collection in sociocultural ML. By showing data collection practices from another field, we encourage ML research to be more cognizant and systematic in data collection and draw from interdisciplinary expertise.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3351095.3372829

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Article from LIFE magazine (Dec. 1941) with two images advising identifiable phenotype differences between Japanese and Chinese ("allies") groups with the intention to spite Japanese Americans following the Japanese bombing of Pearl Harbor.
Figure 1 Article from LIFE magazine (Dec. 1941) with two images advising identifiable phenotype differences between Japanese and Chinese ("allies") groups with the intention to spite Japanese Americans following the Japanese bombing of Pearl Harbor.CC-BY · From the PDF
Figure 3 Image of traditional Catawba dance taken in 1993 at the Catawba Indian reservation. ©Catawba Cultural Preservation Project
Figure 3 Image of traditional Catawba dance taken in 1993 at the Catawba Indian reservation. ©Catawba Cultural Preservation ProjectCC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 26

  1. ALA. 2008. Code of Ethics of the American Library Association . American Library Association . http://www.ala.org/tools/ethics ALA. 2008. Code of Ethics of the American Library Association. American Library Association. http://www.ala.org/tools/ethics
  2. ARA. 2018. Code of Ethics . Archives & Records Association (U.K. & Ireland) . https://www.archives.org.uk/membership/code-of-ethics.html ARA. 2018. Code of Ethics. Archives & Records Association (U.K. & Ireland). https://www.archives.org.uk/membership/code-of-ethics.html
  3. Richard Breitman and Norman J.W . Goda . 2010 . Hitler's Shadow: Nazi War Criminals, U.S. Intelligence, and the Cold War. National Archives . Richard Breitman and Norman J.W. Goda. 2010. Hitler's Shadow: Nazi War Criminals, U.S. Intelligence, and the Cold War. National Archives.
  4. Caroline Brown . 2014. Archives and Recordkeeping: Theory into Practices . Facet Publishing . Caroline Brown. 2014. Archives and Recordkeeping: Theory into Practices. Facet Publishing.
  5. Joy Buolamwini and Timnit Gebru . 2018 . Gender shades: Intersectional accuracy disparities in commercial gender classification . In Conference on Fairness, Accountability and Transparency. 77--91 . Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency. 77--91.
  6. Maygene F. Daniels and Timothy Walch . 1984 . A Modern Archives Reader: Basic Readings on Archival Theory and Practice. National Archives and Records Service . Maygene F. Daniels and Timothy Walch. 1984. A Modern Archives Reader: Basic Readings on Archival Theory and Practice. National Archives and Records Service.
  7. Nancy Freeman and Holly Geist . 2014. FOIA Request . Case Studies in Archival Ethics ( 2014 ). Nancy Freeman and Holly Geist. 2014. FOIA Request. Case Studies in Archival Ethics (2014).
  8. Clare Garvie , Bedoya Alvaro , and Jonathan Frankle . 2016. The perpetual line-up: Unregulated police face recognition in America. Georgetown Law , Center on Privacy & Technology. Clare Garvie, Bedoya Alvaro, and Jonathan Frankle. 2016. The perpetual line-up: Unregulated police face recognition in America. Georgetown Law, Center on Privacy & Technology.
  9. Timnit Gebru , Jamie Morgenstern , Briana Vecchione , Jennifer Wortman Vaughan , Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018 . Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). · arXiv
  10. Tracy B. Grimm and Chon A. Noriega . 2013 . Documenting Regional Latino Arts and Culture: Case Studies for a Collaborative , Community-Oriented Approach. The American Archivist 76 (2013), 95 -- 112 . Tracy B. Grimm and Chon A. Noriega. 2013. Documenting Regional Latino Arts and Culture: Case Studies for a Collaborative, Community-Oriented Approach. The American Archivist 76 (2013), 95--112.
  11. Ailsa C. Holland and Elizabeth Mullins . 2013 . Archives and Archivists 2: Current Trends, New Voices. Four Courts Press . Ailsa C. Holland and Elizabeth Mullins. 2013. Archives and Archivists 2: Current Trends, New Voices. Four Courts Press.
  12. Valerie Horton and Greg Pronevitz . 2015 . Library Consortia: Models for Collaboration and Sustainability. ALA Editions. Valerie Horton and Greg Pronevitz. 2015. Library Consortia: Models for Collaboration and Sustainability. ALA Editions.
  13. ICRM. 2016. Code of Ethics . Institute of Certified Records Managers. https ://www.icrm.org/code-of-ethics ICRM. 2016. Code of Ethics. Institute of Certified Records Managers. https://www.icrm.org/code-of-ethics
  14. Os Keyes , Nikki Stevens , and Jacqueline Wernimont . 2019. The Government Is Using the Most Vulnerable People to Test Facial Recognition Software. Slate Magazine ( 2019 ). Os Keyes, Nikki Stevens, and Jacqueline Wernimont. 2019. The Government Is Using the Most Vulnerable People to Test Facial Recognition Software. Slate Magazine (2019).
  15. Christopher Kitching and Ian Hart . 1995. Collection Policy Statements. Journal of the Society of Archivists 16 ( 1995 ). http://www.nationalarchives.gov.uk/documents/archives/archive-collection-policy.pdf Christopher Kitching and Ian Hart. 1995. Collection Policy Statements. Journal of the Society of Archivists 16 (1995). http://www.nationalarchives.gov.uk/documents/archives/archive-collection-policy.pdf
  16. Philipp Koehn . 2005 . Europarl: A parallel corpus for statistical machine translation. In MT summit , Vol. 5 . 79--86. Philipp Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. In MT summit, Vol. 5. 79--86.
  17. Katherine McCardwell . 2014. Intellectual Propoerty Concerns in Undocumented Corporate Collections. Case Studies in Archival Ethics ( 2014 ). Katherine McCardwell. 2014. Intellectual Propoerty Concerns in Undocumented Corporate Collections. Case Studies in Archival Ethics (2014).
  18. Paul Mozur . 2019. One Month , 500,000 Face Scans : How China Is Using A.I. to Profile a Minority. The New York Times ( 2019 ). Paul Mozur. 2019. One Month, 500,000 Face Scans: How China Is Using A.I. to Profile a Minority. The New York Times (2019).
  19. MS. 1999. The Manuscript Society of Code of Ethics Adopted by the Board of Trustees May 26, 1999 . The Manuscript Society . manuscript.org/about/code-of-ethics MS. 1999. The Manuscript Society of Code of Ethics Adopted by the Board of Trustees May 26, 1999. The Manuscript Society. manuscript.org/about/code-of-ethics
  20. Timothy D. Pyatt . 2015. The Harding Affair Letters: How One Archivist Took Every Measure Possible To Ensure Their Preservation. Case Studies in Archival Ethics ( 2015 ). Timothy D. Pyatt. 2015. The Harding Affair Letters: How One Archivist Took Every Measure Possible To Ensure Their Preservation. Case Studies in Archival Ethics (2015).
  21. Alec Radford , Jeffrey Wu , Rewon Child , David Luan , Dario Amodei , and Ilya Sutskever . 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 ( 2019 ). Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019).
  22. Ellen M. Ryan . 2014. Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution. Case Studies in Archival Ethics ( 2014 ). Ellen M. Ryan. 2014. Identifying Culturally Sensitive American Indian Material in a Non-tribal Institution. Case Studies in Archival Ethics (2014).
  23. SAA. 2011. SAA Core Values Statement and Code of Ethics . Society of American Archivists . https://www2.archivists.org/statements/saa-core-values-statement-and-code-of-ethics SAA. 2011. SAA Core Values Statement and Code of Ethics. Society of American Archivists. https://www2.archivists.org/statements/saa-core-values-statement-and-code-of-ethics
  24. SAA. 2013 . Describing Archives: A Content Standard ( second ed.). Society of American Archivists . SAA. 2013. Describing Archives: A Content Standard (second ed.). Society of American Archivists.
  25. Harini Suresh and John V . Guttag . 2019 . A Framework for Understanding Unintended Consequences of Machine Learning. ArXiv abs/1901.10002 (2019). Harini Suresh and John V. Guttag. 2019. A Framework for Understanding Unintended Consequences of Machine Learning. ArXiv abs/1901.10002 (2019). · arXiv
  26. Aditya Tripathi and Jawahar Lal . 2016 . Library Consortia: Practical Guide for Library Managers . Chandos Publishing . Aditya Tripathi and Jawahar Lal. 2016. Library Consortia: Practical Guide for Library Managers. Chandos Publishing.

Cited by

See all 381

Metadata

Authors
Jo, E. S., & Gebru, T.
Affiliations
  • Stanford University (US)
  • Google (United States) (US)
Venue
Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2020-01-27
Pages
306-316
OpenAlex
W4288083800
Cited by
240
References
19
Citations by year
2026: 26 · 2025: 37 · 2024: 43 · 2023: 49 · 2022: 44 · 2021: 37 · 2020: 4
FWCI
34.75
Type
conference paper
Language
en
Open access
Locations
ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Sociology and Political Science › Data Analysis and Archiving
  • Social Sciences › Arts and Humanities › Conservation › Digital and Traditional Archives Management
Keywords
data collection, data annotation, archives, libraries, machine learning ethics, consent, inclusivity, transparency, privacy, fairness and accountability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.