CoChat

Data Governance in the Age of Large-Scale Data-Driven Language Technology

Open access

The DOI matches its Crossref record; 152 of the 153 references it cites were found in a registry or an index, and 1 are not checked yet; 62 of the 158 sources its claims cite were checked for support.

Abstract

The recent emergence and adoption of Machine Learning technology, and specifically of Large Language Models, has drawn attention to the need for systematic and transparent management of language data. This work proposes an approach to global language data governance that attempts to organize data management amongst stakeholders, values, and rights. Our proposal is informed by prior work on distributed governance that accounts for human values and grounded by an international research collaboration that brings together researchers and practitioners from 60 countries. The framework we present is a multi-party international governance structure focused on language data, and incorporating technical and organizational tools needed to support its work.

Verified 2026-11-19 · 1 reference not checked yet

Overview

CoChat Summary

TL;DR

This paper proposes a multi-party Data Stewardship Organization (DSO) for governing large-scale language data, grounded in eight values and six actor roles. It is a conceptual governance framework developed through a year-long workshop with over 1000 participants from 60 countries, informed by distributed governance, legal, sociolinguistic, and ML data-management literature.

Key findings

  • The proposed DSO organizes language-data governance around six actor roles: Data Rights-holders, Data Providers, Data Hosts, Data Modelers, Data Stewardship Organization, and Data Helpers (Table 4).
  • The framework is guided by eight values: inclusion/representation/non-discrimination, autonomy/consent/contestation, privacy, just rewards, licensing/attribution, local knowledge, participation, and beneficence (Table 1).
  • The paper argues existing ML data management is insufficient: centralized repositories give the governing organization full say; public repositories rely on self-governance by submitters; open data initiatives conflict with removal/update needs; Wikimedia offers a relevant distributed-governance example.
  • It proposes contractual flow-down, non-dissemination clauses, contestation/removal processes, a license taxonomy, and a DSO standard Data Provider-Host agreement (Appendix B) as mechanisms to support the values.

Methods

  • Conceptual/position paper developed through a year-long, distributed collaborative workshop on Large Language Models with over 1000 participants from 60 countries; the data governance working group grew from around 10 to 50+ participants.
  • The analysis reviews prior work on distributed governance, sociolinguistics, legal frameworks (property, privacy, user rights), ML/NLP data management, and Wikimedia, then synthesizes a proposed governance structure.
  • No empirical experiment or quantitative analysis is reported; the work is qualitative synthesis and design, with appendices documenting value-crafting and a standard Data Provider-Host agreement.

Limitations

  • Paper-stated: values expressed by workshop participants may prioritize their interests and exclude other language users; Human Rights grounding is limited by diverse philosophical foundations and its historical individual-state focus; governance faces a trade-off between harmonization and independence; legal agreements are difficult to develop.
  • Paper-stated: the DSO is not a direct party to agreements and relies on fallback/default licenses and interoperability; contestation and deletion depend on non-dissemination and technical/legal maturity.
  • Evident from the text: the proposal is not implemented or empirically evaluated, so no outcome data on effectiveness or adoption are provided.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3531146.3534637

Cites

152 of 153 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Overview of the Data Stewardship Organization and Actors
Figure 1 Overview of the Data Stewardship Organization and ActorsFrom the PDF
Figure 2 Collaborative governance mechanisms rely on interacting pillars.
Figure 2 Collaborative governance mechanisms rely on interacting pillars.From the PDF
Figure 3 Machine Learning Data Triad
Figure 3 Machine Learning Data TriadFrom the PDF
Image 4
From the PDF
Figure 7 Screenshot of a revised draft of values and definitions discussed live.
Figure 7 Screenshot of a revised draft of values and definitions discussed live.From the PDF

Verification

Claims the paper makes

31 Valid · 11 Not valid · 34 Not checked · 57 Own results and interpretations

19 more claims · 5 with their cited sources checked

Create a free account to see all 133 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 88
  • It may state two separate claims as one. 45

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 153 references

Research works printed but not linked: 15

  1. The Ada Lovelace Institute, The AI Now Institute, and The Open Government Partnership. 2021. Algorithmic accountability for the public sector. http://www.opengovpartnership.org/documents/
  2. United Nations. General Assembly. 1949. Universal declaration of human rights. Vol. 3381. Department of State United States of America.
  3. Amber Berson, Monika Sengul-Jones, and Melissa Tamani. 2021. Unreliable Guidelines: Reliable sources and marginalized communities in French, English, and Spanish Wikipedias. https://artandfeminism.org/wp-content/uploads/2021/06/Unrealiable-Guidelines_Final.pdf
  4. Alina Beygelzimer Yann Dauphin Percy Liang and Jennifer Wortman Vaughan. 2021. Introducing the NeurIPS 2021 Paper Checklist. https://neuripsconf.medium.com/introducing-the-neurips-2021-paper-checklist-3220d6df500b
  5. Abeba Birhane Vinay Uday Prabhu and Emmanuel Kahembwe. 2021. Multimodal datasets: misogyny pornography and malignant stereotypes. ArXiv abs/2110.01963(2021). · arXiv
  6. 10.18653/v1 · doi:10.18653/v1
  7. David Freeman Engstrom, Daniel E Ho, and Cristina Isabel Ceballos. 2021. Disparate Limbo: How Administrative Law Erased Antidiscrimination. Yale Law Journal, Forthcoming(2021).
  8. William Labov. 1994. Principles of Linguistic Change, Volume 1: Internal Factors. John Wiley & Sons.
  9. Claudia Mitchell-Kernan. 1971. Language Behavior in a Black Urban Community. Monograph of the Language-Behavior Research Laboratory, No. 2 (1971).
  10. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
  11. Cornelia Roux and Petro Du Preez. 2013. Human rights literacy: A quest for meaning. Retrieved 20(2013), 2017.
  12. 10.1093/idpl · doi:10.1093/idpl
  13. Samson Tan. 2022. Linguistically-Inclusive Natural Language Processing. Ph. D. Dissertation. National University of Singapore.
  14. 10.18653/v1 · doi:10.18653/v1
  15. 10.18653/v1 · doi:10.18653/v1

Cited by

  • The future landscape of large language models in medicine

    Clusmann, J., Kolbinger, F. R., Muti, H. S., Carrero, Z. I., Eckardt, J.-N., Laleh, N. G., Löffler, C. M. L., Schwarzkopf, S.-C., Unger, M., Veldhuizen, G. P., et al. (2023) · Communications Medicine · doi:10.1038/s43856-023-00370-1 · Cited by 1,045

    “For example, they can break down complex concepts to an amateur level (Box 2, Supplementary Data, example 8, 9) and provide individualized feedback on academic topics with reasonable explanations (Supplementary Data, example 9) 6 .”
    Background
  • Bias and Fairness in Large Language Models: A Survey

    Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00524 · Cited by 1,245

  • Auditing large language models: a three-layered approach

    Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00289-2 · Cited by 289

    “, interactive model cards [183] and information about the initial training dataset [184], [185], to help downstream developers adapt the model appropriately.”
    Background
  • Harms from Increasingly Agentic Algorithmic Systems

    Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149

    “[97] highlight the imbalance of power between AI developers and the rest of society, and propose frameworks and”
    Background
  • Machine culture

    Brinkmann, L., Baumann, F., Bonnefon, J.-F., Derex, M., Müller, T. F., Nussberger, A.-M., Czaplicka, A., Acerbi, A., Griffiths, T. L., Henrich, J., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01742-2 · Cited by 132

    “One approach is to care-fully curate the dataset on which the model is trained 187,188 .”
    Background

See all 75

Metadata

Authors
Jernite, Y., Nguyen, H., Biderman, S., Rogers, A., Masoud, M., Danchev, V., Tan, S., Luccioni, A. S., Subramani, N., Johnson, I., Dupont, G., Dodge, J., Lo, K., Talat, Z., Radev, D., Gokaslan, A., Nikpoor, S., Henderson, P., Bommasani, R., & Mitchell, M.
Affiliations
  • Hugging Face (US)
  • Ontocord, USA
  • EleutherAI, USA
  • University of Copenhagen (DK)
  • Independent researcher, Ireland
  • University of Essex (GB)
  • Amazon (United States) (US)
  • Allen Institute for Artificial Intelligence (US)
  • Wikimedia Foundation (US)
  • Independent, France
  • Simon Fraser University (CA)
  • Yale University (US)
  • Cornell University (US)
  • CAIDP, Canada
  • Stanford University (US)
Venue
2022 ACM Conference on Fairness Accountability and Transparency
Publisher
ACM
Published
2022-06-20
Pages
2206-2222
OpenAlex
W4283167130
Cited by
75
References
139
Citations by year
2026: 12 · 2025: 16 · 2024: 17 · 2023: 25 · 2022: 5
FWCI
6.73
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
  • Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, cc-by-nc)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • IT University Of Copenhagen (IT University of Copenhagen) (submittedVersion, cc-by)
  • Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
Keywords
large language models, distributed governance, data management, stakeholder management, human values, data rights, international research collaboration, data transparency, language technology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Data Governance in the Age of Large-Scale Data-Driven Language Technology. https://app.cochat.ai/papers/10.1145/3531146.3534637
The paper
Jernite, Y., Nguyen, H., Biderman, S., Rogers, A., Masoud, M., Danchev, V., Tan, S., Luccioni, A. S., Subramani, N., Johnson, I., Dupont, G., Dodge, J., Lo, K., Talat, Z., Radev, D., Gokaslan, A., Nikpoor, S., Henderson, P., Bommasani, R., & Mitchell, M. (2022). Data Governance in the Age of Large-Scale Data-Driven Language Technology. 2022 ACM Conference on Fairness Accountability and Transparency. https://doi.org/10.1145/3531146.3534637

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.