The DOI matches its Crossref record; 152 of the 153 references it cites were found in a registry or an index, and 1 are not checked yet; 62 of the 158 sources its claims cite were checked for support.
Data Governance in the Age of Large-Scale Data-Driven Language Technology
Open accessAbstract
The recent emergence and adoption of Machine Learning technology, and specifically of Large Language Models, has drawn attention to the need for systematic and transparent management of language data. This work proposes an approach to global language data governance that attempts to organize data management amongst stakeholders, values, and rights. Our proposal is informed by prior work on distributed governance that accounts for human values and grounded by an international research collaboration that brings together researchers and practitioners from 60 countries. The framework we present is a multi-party international governance structure focused on language data, and incorporating technical and organizational tools needed to support its work.
Verified 2026-10-06 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This paper proposes a multi-party Data Stewardship Organization (DSO) for governing large-scale language data, grounded in eight values and six actor roles. It is a conceptual governance framework developed through a year-long workshop with over 1000 participants from 60 countries, informed by distributed governance, legal, sociolinguistic, and ML data-management literature.
Key findings
- The proposed DSO organizes language-data governance around six actor roles: Data Rights-holders, Data Providers, Data Hosts, Data Modelers, Data Stewardship Organization, and Data Helpers (Table 4).
- The framework is guided by eight values: inclusion/representation/non-discrimination, autonomy/consent/contestation, privacy, just rewards, licensing/attribution, local knowledge, participation, and beneficence (Table 1).
- The paper argues existing ML data management is insufficient: centralized repositories give the governing organization full say; public repositories rely on self-governance by submitters; open data initiatives conflict with removal/update needs; Wikimedia offers a relevant distributed-governance example.
- It proposes contractual flow-down, non-dissemination clauses, contestation/removal processes, a license taxonomy, and a DSO standard Data Provider-Host agreement (Appendix B) as mechanisms to support the values.
Methods
- Conceptual/position paper developed through a year-long, distributed collaborative workshop on Large Language Models with over 1000 participants from 60 countries; the data governance working group grew from around 10 to 50+ participants.
- The analysis reviews prior work on distributed governance, sociolinguistics, legal frameworks (property, privacy, user rights), ML/NLP data management, and Wikimedia, then synthesizes a proposed governance structure.
- No empirical experiment or quantitative analysis is reported; the work is qualitative synthesis and design, with appendices documenting value-crafting and a standard Data Provider-Host agreement.
Limitations
- Paper-stated: values expressed by workshop participants may prioritize their interests and exclude other language users; Human Rights grounding is limited by diverse philosophical foundations and its historical individual-state focus; governance faces a trade-off between harmonization and independence; legal agreements are difficult to develop.
- Paper-stated: the DSO is not a direct party to agreements and relies on fallback/default licenses and interoperability; contestation and deletion depend on non-dissemination and technical/legal maturity.
- Evident from the text: the proposal is not implemented or empirically evaluated, so no outcome data on effectiveness or adoption are provided.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
31 Valid · 11 Not valid · 34 Not checked · 57 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, whereas recent advances in modeling and hardware have increased the data training capacity of LLMs, increasing from Wikipedia-scale corpora to close to three orders of magnitude more”
What the sources say
- Partly supportedcites Hoffmann et al. [71] [71] Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Jack W. Rae, Oriol Vinyals, and L. Sifre. 2022. Training Compute-Optimal Large Language Models. ArXiv abs/2203.15556 (2022). - sourceExperimental — accuracy not yet measured
The Introduction (p. 2) reports LLMs trained on roughly 300 billion tokens and Chinchilla on 1.4 trillion, supporting the point that LLMs can train on very large datasets. Appendix A (p. 22) lists Wikipedia as one small component of Chinchilla’s dataset, but the paper does not establish a historical increase from Wikipedia-scale corpora to nearly three orders of magnitude more data, or attribute such an increase to advances in modeling and hardware. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These practical applications of language technology are increasingly reliant on approaches based on trained Large Language Models (LLMs) [23, 41, 104, 111], whereby models are first exposed to as large and varied a collection of language data as possible with the aim of extracting 'general' properties of a language of interest.”
What the sources say
- Supportedcites [23] [23] Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165 (2020). - source
Section 2.2 (p. 8) describes training on a very large mixture of text datasets and adding corpora to increase its diversity. The Introduction (p. 3) says unsupervised pre-training develops broad skills and pattern-recognition abilities, supporting the claim's account of learning general language capabilities. The paper also emphasizes data quality rather than simply maximizing quantity. (LLM, conf=0.90)
- Not checked — no full text of the sourcecites [41] [41] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers) , Jill Burstein, Christy Doran, and Thamar Solorio (Eds.). Association for Computational Linguistics, 4171-4186. https://doi.org/10.18653/v1/n19-1423 - source
- Partly supportedcites [104] [104] Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep Contextualized Word Representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers) , Marilyn A. Walker, Heng Ji, and Amanda Stent (Eds.). Association for Computational Linguistics, 2227-2237. https://doi.org/10.18653/v1/n18-1202 - sourceExperimental — accuracy not yet measured
The Introduction describes a bidirectional language model trained on a large text corpus and says its representations capture aspects of syntax and meaning. Related work specifies a corpus of approximately 30 million sentences. The paper does not establish that training data should be as large and varied as possible, or make that claim about LLM approaches generally. (LLM, conf=0.84)
- Not matchedcites [111] [111] Alec Radford and Karthik Narasimhan. 2018. Improving Language Understanding by Generative Pre-Training. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“As such, devising a governance structure based solely on values expressed by our participants runs the risk of prioritizing their interests and excluding visions that may be more relevant to other language users [65].”
What the sources say
- Supportedcites [65] [65] Daniel Greene, Anna Lauren Hoffmann, and Luke Stark. 2019. Better, Nicer, Clearer, Fairer: A Critical Assessment of the Movement for Ethical Artificial Intelligence and Machine Learning. In HICSS . - source
Section 5.2, “Expert oversight” (page not provided), says ethical-AI statements give experts a narrow role in deciding whose concerns count while treating users and the public differently. Section 3.1, “Values in technology design” (page not provided), stresses considering alternative courses of action and who counts in design. The citing authors apply that critique to their own participants and other language users; the source supports the underlying risk, not a finding about those particular groups. (LLM, conf=0.86)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“They note that most of these focus on endogenous notions of technical performance and novelty, and leave out considerations of broader context and impact that are necessary to shaping a governance effort.”
What the sources say
- Supportedcites [18] [18] Abeba Birhane, Pratyusha Kalluri, Dallas Card, William Agnew, Ravit Dotan, and Michelle Bao. 2021. The values encoded in machine learning research. arXiv preprint arXiv:2106.15590 (2021). - source
The Abstract reports that the 100 highly cited ML papers most frequently emphasized values including performance and novelty, while few connected their projects to societal needs or discussed negative consequences. The Conclusion likewise says these papers prioritized technical values while neglecting broader social needs and potential harms. The reference to shaping a governance effort is the citing authors’ framing, rather than a separate finding attributed to the source. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141]”
What the sources say
- Partly supportedcites [37] [37] Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu. 2019. Plug and play language models: Asimple approach to controlled text generation. arXiv preprint arXiv:1912.02164 (2019). - sourceExperimental — accuracy not yet measured
Section 4.4, “Language Detoxification” (page unavailable), says language models reflect biases and reports racist GPT-2 output and toxicity measurements for prompts referring to racial or ethnic groups. It does not document gender disparities or disparities across a number of language technologies, so it supports only part of the cited claim. (LLM, conf=0.85)
- Supportedcites [79] [79] Allison Koenecke, Andrew Nam, Emily Lake, Joe Nudell, Minnie Quartey, Zion Mengesha, Connor Toups, John R Rickford, Dan Jurafsky, and Sharad Goel. 2020. Racial disparities in automated speech recognition. Proceedings of the National Academy of Sciences 117, 14 (2020), 7684-7689. - source
The Results report racial differences in word error rates across five commercial speech-recognition systems and higher error rates for male than female speakers in the sample. This supports the cited statement as an example of gendered and racial disparities in language technologies, specifically speech recognition; the paper does not establish disparities across all types of language technology. (LLM, conf=0.89)
- Partly supportedcites [141] [141] Jing Xu, Da Ju, Margaret Li, Y-Lan Boureau, Jason Weston, and Emily Dinan. 2021. Bot-Adversarial Dialogue for Safe Conversational Agents. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies . Association for Computational Linguistics, Online, 2950-2968. https://doi.org/10.18653/v1/2021.naacl-main.235 - sourceExperimental — accuracy not yet measured
The Introduction says dialogue models can learn biased language, and §7 Ethical Considerations reports racial bias in hate-speech datasets. The paper does not document gendered disparities or establish disparities across a number of language technologies; its mention of gender in Appendix A.2 defines a hate-speech category, not a measured disparity. (LLM, conf=0.83)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
19 more claims · 5 with their cited sources checked
Create a free account to see all 133 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 88
- It may state two separate claims as one. 45
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, these models also raise concerns about misinformation, privacy, biases in the training data, and potential for misuse3,7–10.”
From The future landscape of large language models in medicine (2023) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One approach is to carefully curate the dataset on which the model is trained 187,188 .”
From Machine culture (2023) · cites this paper as [188]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Each stakeholder brings perspectives that may specify different fairness constraints for the same application and setting.”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Jernite et al. (2022)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ 3. PURPOSE, RIGHTS GRANTED & SCOPE · p. 19
“The Data Provider grants to the Data Host a non-exclusive, non-transferable, non-sublicensable, irrevocable, perpetual, royalty-free and worldwide license to use (that is access, store, prepare, process, label and/or share) the agreed upon Data”
§ 9. TERM AND TERMINATION · p. 22
“Upon termination of this Agreement for any reason, the Data Host and Data Provider cease to use the Data and Processed Datasets and for the purposes set out in this Agreement within 14 days and upon that delete the Data and Processed Datasets immediately”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 15. SURVIVAL · p. 22
“10 (Term and Termination)”
§ 10. FORCE MAJEURE · p. 22
“## 10. FORCE MAJEURE”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 15. SURVIVAL · p. 22
“15 (Governing Law)”
§ 15. SURVIVAL · p. 22
“## 15. SURVIVAL”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 15. SURVIVAL · p. 22
“16 (Survival)”
§ 16. SEVERABILITY · p. 22
“## 16. SEVERABILITY”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 15. SURVIVAL · p. 22
“12 (Confidentiality)”
§ 12. ENTIRE AGREEMENT · p. 22
“## 12. ENTIRE AGREEMENT”
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 2×
“These practical applications of language technology are increasingly reliant on approaches based on trained Large Language Models (LLMs) [23, 41, 104, 111], whereby models are first exposed to as large and varied a collection of language data as possible with the aim of extracting “general” properties of a language of…”
BackgroundUCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
An Integrative Framework for Collaborative Governance
Emerson, K., Nabatchi, T., & Balogh, S. (2012) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mur011 · Cited by 3,637 · cited 1×
“[46]’s proposed framework considers principled engagement and shared motivation between all the participants in a governance structure (their shared values) as the basis for resolving tensions.”
BackgroundModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“One approach put forward in recent years to foster more accountability of these data practices has been documentation standards for data and models in natural language processing [11, 59] and ML in general [93].”
BackgroundSelf-citationPrinciples of Linguistic Change: Cognitive and Cultural Factors
Labov, W. (2010) · Wiley eBooks · doi:10.1002/9781444327496 · Cited by 2,644
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 2×
“In practice, compliance is hard to enforce, and while datasets are increasingly accompanied by datasheets [59] and similar documentation, navigating the legal structures involved is not always straightforward.”
BackgroundZhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264
The Regime Complex for Climate Change
Keohane, R. O., & Victor, D. G. (2011) · Perspectives on Politics · doi:10.1017/s1537592710004068 · Cited by 2,047 · cited 3×
“Keohane and Victor [77] study the case of the regime complex for climate change, whose global governance happens at the intersection of e.g., UN and local legal regimes and bilateral agreements and spans topics such as trade regulation, technology, or geoengineering.”
BackgroundInfluentialPurity and Danger: An Analysis of Concepts of Pollution and Taboo
Kunz, P. R., & Douglas, M. (1969) · Review of Religious Research · doi:10.2307/3510915 · Cited by 2,010
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 2×
““Clean” text additionally has been misrepresented as being “unbiased” against any community—a notion that has been strongly contested [22, 73, 130].”
BackgroundThe CARE Principles for Indigenous Data Governance
Carroll, S. R., Garba, I., Figueroa-Rodríguez, O. L., Holbrook, J., Lovett, R., Materechera, S., Parsons, M., Raseroka, K., Rodriguez-Lonebear, D., Rowe, R., et al. (2020) · Data Science Journal · doi:10.5334/dsj-2020-043 · Cited by 1,408 · cited 2×
“, in the case of indigenous communities that are generally underrepresented on Wikipedia but have concerns about how their knowledge might be exploited if shared [28, 29].”
BackgroundFjeld, J., Achten, N., Hilligoss, H., Nagy, A., & Srikumar, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3518482 · Cited by 998 · cited 2×
“[55] Jessica Fjeld, Nele Achten, Hannah Hilligoss, Adam Nagy, and Madhulika Srikumar.”
BackgroundTraining Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2176 · Cited by 932
Technology Ecosystem Governance
Wareham, J., Fox, P. B., & Cano Giner, J. L. (2014) · Organization Science · doi:10.1287/orsc.2014.0895 · Cited by 931 · cited 1×
“[137] examine the case of governance of software platforms (specifically the tools they rely on) through the lens of striking a”
BackgroundTraining Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.15556 · Cited by 929 · cited 1×
“[71] Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Ja…”
BackgroundDecolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00405-8 · Cited by 912 · cited 3×
“[95] Shakir Mohamed, Marie-Thérèse Png, and William S.”
BackgroundInfluentialBender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854
Barnett, M., & Duvall, R. (2004) · Power in Global Governance · doi:10.1017/cbo9780511491207.001 · Cited by 831
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829 · cited 2×
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141], and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
Background“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781 · cited 4×
“Second, research addressing dataset choices, creation, and curation, is systematically “under-valued and de-glamorised” [3, 123]16.”
BackgroundInfluentialRacial disparities in automated speech recognition
Koenecke, A., Nam, A., Lake, E., Nudell, J., Quartey, M., Mengesha, Z., Toups, C., Rickford, J. R., Jurafsky, D., & Goel, S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915768117 · Cited by 765 · cited 1×
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141], and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
BackgroundExtracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727
Algorithmic injustice: A relational ethics approach
Birhane, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100205 · Cited by 707 · cited 1×
“acknowledging both the need for respecting local expertise and conceptualization of human rights [5] and for more relational and community-oriented notions of justice [17, 98], we complement our initial set of values as outlined in Table 1 to explicitly include the prioritization of local knowledge when realizing shar…”
MethodThe Institutional Collective Action Framework
Feiock, R. C. (2013) · Policy Studies Journal · doi:10.1111/psj.12023 · Cited by 691 · cited 1×
“The approach of Feiock [52] addresses dilemmas stemming from different externalities, such as different local regulations of the object of governance.”
Background(1949) · American Journal of International Law · doi:10.2307/2213979 · Cited by 664
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548 · cited 5×
“Very recent research — most published within the last year — has begun to analyze dataset values [18, 40], question assumptions around dataset use [100], unpack what is represented in ML datasets [43, 88, 124] and establish basics of how an organized dataset lifecycle might proceed [74].”
BackgroundMethodInfluential“Participant” Perceptions of Twitter Research Ethics
Fiesler, C., & Proferes, N. (2018) · Social Media + Society · doi:10.1177/2056305118763366 · Cited by 528 · cited 1×
“Since that author may not be aware of the visibility of their language data and conceptions of the social benefits (or lack thereof) of various research practices [54], privacy legislation such as GDPR may require that data be used with (revocable) consent, and for the specific purposes that are clearly explained to t…”
BackgroundMeaningful information and the right to explanation
Selbst, A. D., & Powles, J. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx022 · Cited by 516 · cited 1×
“14GDPR [49] does not explicitly guarantee it, but it it does require the data processor to provide ‘meaningful information about the logic involved’ in fully automated decisions, which could be interpreted that way [126].”
BackgroundA Framework for Assessing Power in Collaborative Governance Processes
Purdy, J. M. (2012) · Public Administration Review · doi:10.1111/j.1540-6210.2011.02525.x · Cited by 510 · cited 1×
“Barnett and Duvall [10] and Purdy [108] examine how authority, resources, and discursive legitimacy can lead to exclusion within collaborative governance efforts.”
BackgroundPlug and Play Language Models: A Simple Approach to Controlled Text Generation
Dathathri, S., Madotto, A., Lan, J., Hung, J., Frank, E., Molino, P., Yosinski, J., & Liu, R. (2019) · arXiv · doi:10.48550/arxiv.1912.02164 · Cited by 508
Corporations and Human Rights: A Theory of Legal Responsibility
Ratner, S. R. (2001) · The Yale Law Journal · doi:10.2307/797542 · Cited by 504
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Gao, L., Biderman, S., Black, S., Golding, L., Hoppe, T., Foster, C., Phang, J., He, H., Thite, A., Nabeshima, N., et al. (2021) · arXiv · doi:10.48550/arxiv.2101.00027 · Cited by 492 · cited 4×
“include significant curation efforts for the sake of improving models [57, 113] focus on definitions of quality that prioritize technical performance over the agency of data and algorithm subjects, which can result in widespread data that proliferates misogyny, pornography without consent, and malignant stereotypes [1…”
BackgroundInfluentialSelf-citation(2004) · doi:10.1017/cbo9780511491207 · Cited by 461
META‐GOVERNANCE: VALUES, NORMS AND PRINCIPLES, AND THE MAKING OF HARD CHOICES
KOOIMAN, J., & JENTOFT, S. (2009) · Public Administration · doi:10.1111/j.1467-9299.2009.01780.x · Cited by 418 · cited 2×
“norms & values [80] in governance efforts.”
BackgroundRacial Bias in Hate Speech and Abusive Language Detection Datasets
Davidson, T., Bhattacharya, D., & Weber, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3504 · Cited by 414 · cited 2×
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141], and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
BackgroundRegime Complexes: A Buzz, a Boom, or a Boost for Global Governance?
Orsini, A., Morin, J.-F., & Young, O. (2013) · Global Governance: A Review of Multilateralism and International Organizations · doi:10.1163/19426720-01901003 · Cited by 410 · cited 1×
“world, a phenomenon studied under the name of regime complexes [99].”
BackgroundCorporations and Human Rights: A Theory of Legal Responsibility
Ratner, S. R. (2001) · doi:10.4324/9781315252964-8 · Cited by 390
Greene, D., Hoffmann, A. L., & Stark, L. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.258 · Cited by 386 · cited 2×
“As such, devising a governance structure based solely on values expressed by our participants runs the risk of prioritizing their interests and excluding visions that may be more relevant to other language users [65].”
BackgroundRickford, J. R., & King, S. (2016) · Language · doi:10.1353/lan.2016.0078 · Cited by 374 · cited 1×
“To this effect, we should be cognizant of the existing linguistic discrimination present in our societies [118] and be”
BackgroundLAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs
Schuhmann, C., Vencu, R., Beaumont, R., Kaczmarczyk, R., Mullis, C., Katta, A., Coombes, T., Jitsev, J., & Komatsuzaki, A. (2021) · arXiv · doi:10.48550/arxiv.2111.02114 · Cited by 358 · cited 2×
“[125] Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, and Aran Komatsuzaki.”
BackgroundDatasets: A Community Library for Natural Language Processing
Lhoest, Q., Villanova del Moral, A., Jernite, Y., Thakur, A., von Platen, P., Patil, S., Chaumond, J., Drame, M., Plu, J., Tunstall, L., et al. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2021.emnlp-demo.21 · Cited by 343 · cited 2×
“of datasets, like the UCI ML Repository [45] and the Hugging Face Dataset Repository [86], have become popular.”
MethodSelf-citationZelli, F., & van Asselt, H. (2013) · Global Environmental Politics · doi:10.1162/glep_a_00180 · Cited by 335 · cited 2×
“Consequently, governance efforts need to account for fragmentation when organizations in inter-connected areas make choices that have bearing on each other; by examining these connections and positioning any decision within a dense network of issues and entities [143].”
BackgroundThe Values Encoded in Machine Learning Research
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533083 · Cited by 317 · cited 3×
“[18] review recent literature in ML to identify values that are typically put forward to motivate work in that field.”
BackgroundThe Values Encoded in Machine Learning Research
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2021) · arXiv · doi:10.48550/arxiv.2106.15590 · Cited by 317
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus
Dodge, J., Sap, M., Marasović, A., Agnew, W., Ilharco, G., Groeneveld, D., Mitchell, M., & Gardner, M. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.98 · Cited by 306
Self-citationDecentralization in wikipedia governance.
Forte, A., Larco, V., & Bruckman, A. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222260103 · Cited by 300 · cited 2×
“The Wikimedia projects offer a wealth of experience in highly collaborative and largely self-regulated data curation [56], similar to the goals in the proposed governance structure.”
BackgroundOur Global Neighbourhood. The report of the commission on global governance
Soják, V. (1996) · Sociologicky Casopis-czech Sociological Review · Cited by 296
Hutchinson, B., Smart, A., Hanna, A., Denton, R., Greer, C., Kjartansson, O., Barnes, P., & Mitchell, M. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445918 · Cited by 279
Self-citationSocial Biases in NLP Models as Barriers for Persons with Disabilities
Hutchinson, B., Prabhakaran, V., Denton, E., Webster, K., Zhong, Y., & Denuyl, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.487 · Cited by 274 · cited 1×
““Clean” text additionally has been misrepresented as being “unbiased” against any community—a notion that has been strongly contested [22, 73, 130].”
BackgroundSocial Biases in NLP Models as Barriers for Persons with Disabilities
Hutchinson, B., Prabhakaran, V., Denton, E., Webster, K., Zhong, Y., & Denuyl, S. (2020) · arXiv · doi:10.48550/arxiv.2005.00813 · Cited by 274
Strengthening legal protection against discrimination by algorithms and artificial intelligence
Zuiderveen Borgesius, F. J. (2020) · The International Journal of Human Rights · doi:10.1080/13642987.2020.1743976 · Cited by 267
Large image datasets: A pyrrhic win for computer vision?
Birhane, A., & Prabhu, V. U. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00158 · Cited by 257 · cited 2×
“[107] Vinay Uday Prabhu and Abeba Birhane.”
BackgroundThe work of sustaining order in wikipedia: the banning of a vandal
Geiger, R. S., & Ribes, D. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718941 · Cited by 245
Butler, B., Joyce, E., & Pike, J. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357227 · Cited by 235
Show Your Work: Improved Reporting of Experimental Results
Dodge, J., Gururangan, S., Card, D., Schwartz, R., & Smith, N. A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1224 · Cited by 233 · cited 2×
“18653/v1/n19-1423 [42] Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, and Noah A.”
BackgroundSelf-citationPineau, J., Vincent-Lamarre, P., Sinha, K., Larivière, V., Beygelzimer, A., d'Alché-Buc, F., Fox, E., & Larochelle, H. (2020) · arXiv · doi:10.48550/arxiv.2003.12206 · Cited by 232
On the genealogy of machine learning datasets: A critical history of ImageNet
Denton, E., Hanna, A., Amironesei, R., Smart, A., & Nicole, H. (2021) · Big Data & Society · doi:10.1177/20539517211035955 · Cited by 221 · cited 1×
“Very recent research — most published within the last year — has begun to analyze dataset values [18, 40], question assumptions around dataset use [100], unpack what is represented in ML datasets [43, 88, 124] and establish basics of how an organized dataset lifecycle might proceed [74].”
BackgroundDo Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development
Scheuerman, M. K., Hanna, A., & Denton, R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476058 · Cited by 216 · cited 1×
“Very recent research — most published within the last year — has begun to analyze dataset values [18, 40], question assumptions around dataset use [100], unpack what is represented in ML datasets [43, 88, 124] and establish basics of how an organized dataset lifecycle might proceed [74].”
BackgroundSystematic Inequalities in Language Technology Performance across the World’s Languages
Blasí, D. E., Anastasopoulos, A., & Neubig, G. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.376 · Cited by 205
Toward Gender-Inclusive Coreference Resolution
Cao, Y. T., & Daumé, H., III (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.418 · Cited by 180
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., Tapo, A., Subramani, N., Sokolov, A., Sikasote, C., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00447 · Cited by 179 · cited 2×
“There has also been an increased focus on analyzing other dimensions of data quality and stewardship [102, 107, 121, 123], with several noteworthy initiatives aiming to document both existing [9, 20, 30, 43], and newly developed [16, 60, 136] resources.”
BackgroundSelf-citationQuality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., Tapo, A., Subramani, N., Sokolov, A., Sikasote, C., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.12028 · Cited by 179
Self-citationAn Army of Me: Sockpuppets in Online Discussion Communities
Kumar, S., Cheng, J., Leskovec, J., & Subrahmanian, V. S. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052677 · Cited by 178
A Survey of Race, Racism, and Anti-Racism in NLP
Field, A., Blodgett, S. L., Talat, Z., & Tsvetkov, Y. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.149 · Cited by 174 · cited 1×
“[53] Anjalie Field, Su Lin Blodgett, Zeerak Waseem, and Yulia Tsvetkov.”
BackgroundSelf-citationMultimodal datasets: misogyny, pornography, and malignant stereotypes
Birhane, A., Prabhu, V. U., & Kahembwe, E. (2021) · arXiv · doi:10.48550/arxiv.2110.01963 · Cited by 160 · cited 2×
“There has also been an increased focus on analyzing other dimensions of data quality and stewardship [102, 107, 121, 123], with several noteworthy initiatives aiming to document both existing [9, 20, 30, 43], and newly developed [16, 60, 136] resources.”
BackgroundThe GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Gehrmann, S., Adewumi, T., Aggarwal, K., Ammanamanchi, P. S., Aremu, A., Bosselut, A., Chandu, K. R., Clinciu, M.-A., Das, D., Dhole, K., et al. (2021) · Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) · doi:10.18653/v1/2021.gem-1.10 · Cited by 159 · cited 1×
“existing [9, 20, 30, 43], and newly developed [16, 60, 136] resources.”
Self-citationDatasets: A Community Library for Natural Language ProcessingPreprint
Lhoest, Q., del Moral, A. V., Jernite, Y., Thakur, A., von Platen, P., Patil, S. S., Chaumond, J., Drame, M., Plu, J., Tunstall, L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02846 · Cited by 157
Self-citationOn the Coloniality of Human Rights
Maldonado-Torres, N. (2017) · Revista Crítica de Ciências Sociais · doi:10.4000/rccs.6793 · Cited by 153 · cited 2×
“Section 2.1 identifies norms and values as main pillars of governance, (see Section 1.1) , and found that notions of inclusivity and non-discrimination regularly appeared. respecting privacy and promoting the agency of data and algo-rithm subjects . a concern for respecting rights of the text creators (e.g., copy-righ…”
BackgroundInfluentialThe N Word: Its History and Use in the African American Community
Rahman, J. (2012) · Journal of English Linguistics · doi:10.1177/0075424211414807 · Cited by 142
It’s Morphin’ Time! Combating Linguistic Discrimination with Inflectional Perturbations
Tan, S., Joty, S., Kan, M., & Socher, R. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.263 · Cited by 139 · cited 1×
“To this effect, we should be cognizant of the existing linguistic discrimination present in our societies [118] and be careful not to inadvertently replicate them [132, 133].”
BackgroundSelf-citationGlobal soil science research collaboration in the 21st century: Time to end helicopter research
Minasny, B., Fiantis, D., Mulyanto, B., Sulaeman, Y., & Widyatmanti, W. (2020) · Geoderma · doi:10.1016/j.geoderma.2020.114299 · Cited by 137
2018 Reform Of Eu Data Protection Rules
Viorescu, R. (2017) · European Journal of Law and Public Administration · doi:10.18662/eljpa/11 · Cited by 131
AI and the Everything in the Whole Wide World Benchmark
Raji, I. D., Bender, E. M., Paullada, A., Denton, E., & Hanna, A. (2021) · arXiv · doi:10.48550/arxiv.2111.15366 · Cited by 127 · cited 2×
“For LLMs in particular, the data used to train them are one further step removed from the task-specific models built from them, so the link between data and ML progress is even more abstracted [87, 116].”
MethodA Human Rights-Based Approach to Responsible AIPreprint
Prabhakaran, V., Mitchell, M., Gebru, T., & Gabriel, I. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.02667 · Cited by 121
Self-citationLehtonen, M., Sébastien, L., & Bauler, T. (2016) · Current Opinion in Environmental Sustainability · doi:10.1016/j.cosust.2015.05.009 · Cited by 118 · cited 1×
“In addition to the laws & regulations in their various regimes, previous work has focused on the specific role of tools & implementation (such as indicators [83] or ICT tools [103]) and on the importance of Figure 2: Collaborative governance mechanisms rely on in-”
BackgroundA Relational Theory of Data Governance
Viljoen, S. (2020) · doi:10.2139/ssrn.3727562 · Cited by 109 · cited 2×
“In the ML world, data refers to any digital representation of acts, facts or other information in forms that include text, images, video, or audio recordings [2, 100, 134], which may be collated or formed into more complex information [13].”
BackgroundThe development of attitudes toward dialect in Italian children
Cremona, C., & Bates, E. (1977) · Journal of Psycholinguistic Research · doi:10.1007/bf01068021 · Cited by 108
(2009) · Medical Entomology and Zoology · Cited by 103
Intellectual Property and Human Rights
Helfer, L. R. (2017) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198758457.013.9 · Cited by 94
International Covenant on Economic, Social and Cultural Rights
(2014) · Oxford University Press eBooks · doi:10.1093/law/9780199640300.005.0002 · Cited by 91
Large image datasets: A pyrrhic win for computer vision?
Prabhu, V. U., & Birhane, A. (2020) · arXiv · doi:10.48550/arxiv.2006.16923 · Cited by 91
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
Wang, B., Xu, C., Wang, S., Gan, Z., Cheng, Y., Gao, J., Awadallah, A. H., & Li, B. (2021) · arXiv · doi:10.48550/arxiv.2111.02840 · Cited by 88 · cited 2×
“There has also been an increased focus on analyzing other dimensions of data quality and stewardship [102, 107, 121, 123], with several noteworthy initiatives aiming to document both existing [9, 20, 30, 43], and newly developed [16, 60, 136] resources.”
BackgroundORES: Lowering Barriers with Participatory Machine Learning in Wikipedia
Halfaker, A., & Geiger, R. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415219 · Cited by 82
2 The Disintegration of Property
Grey, T. C. (2014) · Formalism and Pragmatism in American Law · doi:10.1163/9789004272897_004 · Cited by 77
What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus
Luccioni, A., & Viviano, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.18653/v1/2021.acl-short.24 · Cited by 69 · cited 2×
“[88] Alexandra Sasha Luccioni and Joseph D Viviano.”
BackgroundSelf-citationPereira, Â. G., Rinaudo, J.-D., Jeffrey, P., Blasques, J., Quintana, S. C., Courtois, N., Funtowicz, S., & Petit, V. (2003) · Journal of Environmental Assessment Policy and Management · doi:10.1142/s1464333203001383 · Cited by 66 · cited 2×
“[103] Ângela Guimarães Pereira, Jean Daniel Rinaudo, Paul Jeffrey, J E M Blasques, Serafin Corral Quintana, Nathalie Courtois, Silvio Funtowicz, and V.”
BackgroundData Is the New What? Popular Metaphors & Professional Ethics in Emerging Data Culture
Stark, L., & Hoffmann, A. L. (2019) · Journal of Cultural Analytics · doi:10.22148/16.036 · Cited by 65
Bot-Adversarial Dialogue for Safe Conversational Agents
Xu, J., Ju, D., Li, M., Boureau, Y.-L., Weston, J., & Dinan, E. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.235 · Cited by 64 · cited 2×
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141], and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
BackgroundTechnology Ecosystem GovernancePreprint
Wareham, J. D., Fox, P. B., & Giner, J. L. C. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2201688 · Cited by 62
Work-to-rule: the emergence of algorithmic governance in Wikipedia
Müller-Birn, C., Dobusch, L., & Herbsleb, J. D. (2013) · Proceedings of the 6th International Conference on Communities and Technologies · doi:10.1145/2482991.2482999 · Cited by 61
MasakhaNER: Named entity recognition for African languages
(2021) · HAL · doi:10.1162/tacl · Cited by 61
Human rights for more than one voice: rethinking political space beyond the global/local divide
Adami, R. (2014) · Ethics & Global Politics · doi:10.3402/egp.v7.24454 · Cited by 60 · cited 1×
“acknowledging both the need for respecting local expertise and conceptualization of human rights [5] and for more relational and community-oriented notions of justice [17, 98], we complement our initial set of values as outlined in Table 1 to explicitly include the prioritization of local knowledge when realizing shar…”
Method(2020) · bepress Legal Repository · Cited by 54
Documenting the English Colossal Clean Crawled Corpus
Dodge, J., Sap, M., Marasović, A., Agnew, W., Ilharco, G., Groeneveld, D., & Gardner, M. (2021) · arXiv.org · doi:10.48550/arxiv.2104.08758 · Cited by 54
Self-citation‘Just What do You Think You’re Doing, Dave?’ A Checklist for Responsible Data Use in NLP
Rogers, A., Baldwin, T., & Leins, K. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.414 · Cited by 53 · cited 17×
“PREAMBLE BigScience is an open research collaboration involving over 1000 participants from 60 countries, focusing its collaborative research efforts in the study and development of natural language processing systems (hereinafter NLP).”
BackgroundInfluentialSelf-citationMIDDLE-CLASS AFRICAN AMERICANS: REACTIONS AND ATTITUDES TOWARD AFRICAN AMERICAN ENGLISH
Rahman, J. (2008) · American Speech · doi:10.1215/00031283-2008-009 · Cited by 52 · cited 2×
“boundaries between languages, each with only a single grammar, lexicon, and orthography, and this has resulted in the stigmatization of the language varieties not associated with status and power [58, 62, 94, 114], negatively impacting speakers’s access to social”
BackgroundChanging the World by Changing the Data
Rogers, A. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.170 · Cited by 51 · cited 1×
“Indeed, in order to support such ambitions of generality, this collection would need to include language data from a great diversity of carefully curated sources to minimize harms in downstream applications [12, 120], with international rights holders spanning multiple jurisdictions, and extend to multiple languages b…”
BackgroundSelf-citationMasakhane -- Machine Translation For Africa
Orife, I., Kreutzer, J., Sibanda, B., Whitenack, D., Siminyu, K., Martinus, L., Ali, J. T., Abbott, J., Marivate, V., Kabongo, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.11529 · Cited by 51
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Gehrmann, S., Adewumi, T., Aggarwal, K., Ammanamanchi, P. S., Anuoluwapo, A., Bosselut, A., Chandu, K. R., Clinciu, M., Das, D., Dhole, K. D., et al. (2021) · arXiv · doi:10.48550/arxiv.2102.01672 · Cited by 49
Self-citation(2018) · Duke Law Scholarship Repository (Duke University) · Cited by 48
Cao, Y. T., & Daumé, H. (2021) · Computational Linguistics · doi:10.1162/coli_a_00413 · Cited by 47 · cited 1×
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141], and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
BackgroundArtificial Intelligence’s Fair Use Crisis
Sobel, B. L. W. (2017) · Columbia University · doi:10.7916/d8ww90t7 · Cited by 44 · cited 1×
“1093/idpl/ipx022 [127] Benjamin LW Sobel.”
Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLP
Rogers, A., Baldwin, T., & Leins, K. (2021) · arXiv · doi:10.48550/arxiv.2109.06598 · Cited by 42
Self-citationIntroducing a property right over data in the EU: the data producer’s right – an evaluation
Stepanov, I. (2020) · International Review of Law, Computers & Technology · doi:10.1080/13600869.2019.1631621 · Cited by 40 · cited 1×
“The view of privacy protection based on data as property [75, 119, 129] has been criticized as placing a substantial burden on the free flow of information, while potentially not improving privacy protections [78].”
BackgroundDetecting ‘Dirt’ and ‘Toxicity’: Rethinking Content Moderation as Pollution BehaviourPreprint
Thylstrup, N. B., & Talat, Z. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3709719 · Cited by 40 · cited 2×
“To this effect, we should be cognizant of the existing linguistic discrimination present in our societies [118] and be careful not to inadvertently replicate them [132, 133].”
BackgroundSelf-citationBest Practices and Admissibility of Forensic Author Identification
(2013) · bepress Legal Repository · Cited by 39
McMillan-Major, A., Osei, S., Rodriguez, J. D., Ammanamanchi, P. S., Gehrmann, S., & Jernite, Y. (2021) · Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) · doi:10.18653/v1/2021.gem-1.11 · Cited by 37 · cited 1×
“Public repositories do present a unique opportunity to help harmonize emerging standards around documentation [91] mentioned in Section 3.”
BackgroundSelf-citation(2021) · neural information processing systems · Cited by 37
Bandy, J., & Vincent, N. (2021) · arXiv · doi:10.48550/arxiv.2105.05241 · Cited by 36 · cited 2×
“There has also been an increased focus on analyzing other dimensions of data quality and stewardship [102, 107, 121, 123], with several noteworthy initiatives aiming to document both existing [9, 20, 30, 43], and newly developed [16, 60, 136] resources.”
BackgroundDisembodied Machine Learning: On the Illusion of Objectivity in NLP
Waseem, Z., Lulz, S., Bingel, J., & Augenstein, I. (2021) · arXiv · doi:10.48550/arxiv.2101.11974 · Cited by 34
Lemley, M. A., & Casey, B. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3528447 · Cited by 34
Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Papers
Peng, K., Mathur, A., & Narayanan, A. (2021) · arXiv · doi:10.48550/arxiv.2108.02922 · Cited by 31
(2021) · eYLS (Yale Law School) · Cited by 27
Towards Standardization of Data Licenses: The Montreal Data License
Benjamin, M., Gagnon, P., Rostamzadeh, N., Pal, C., Bengio, Y., & Shee, A. (2019) · arXiv · doi:10.48550/arxiv.1903.12262 · Cited by 26 · cited 3×
“3445922 [13] Misha Benjamin, Paul Gagnon, Negar Rostamzadeh, Chris Pal, Yoshua Bengio, and Alex Shee.”
BackgroundMethodORES: Lowering Barriers with Participatory Machine Learning in WikipediaPreprint
Halfaker, A., & Geiger, R. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05189 · Cited by 22
Show Your Work: Improved Reporting of Experimental Results
Dodge, J., Gururangan, S., Card, D., Schwartz, R., & Smith, N. A. (2019) · arXiv · doi:10.48550/arxiv.1909.03004 · Cited by 22
Self-citationA Framework for Deprecating Datasets: Standardizing Documentation, Identification, and Communication
Luccioni, A. S., Corry, F., Sridharan, H., Ananny, M., Schultz, J., & Crawford, K. (2021) · arXiv · doi:10.48550/arxiv.2111.04424 · Cited by 22
Self-citation(2021) · arXiv (Cornell University) · Cited by 21
Self-citationConstitutional Rights in the Machine Learning State
Huq, A. Z. (2020) · doi:10.2139/ssrn.3613282 · Cited by 21 · cited 1×
“-centric perspective, have connected ML to legal frameworks for human rights, especially antidiscrimination [47, 48, 64, 70, 72, 140, 142, 146].”
BackgroundInternational covenant on civil and political rights
(2005) · Human rights, fact sheet · doi:10.18356/9789210059190c006 · Cited by 21
OECD (2018) · OECD Science, Technology and Innovation Outlook · doi:10.1787/sti_in_outlook-2018-15-en · Cited by 20 · cited 2×
“Topics such as technology governance have received increasing attention in the last few decades as the digital transformation of the late 20th and early 21st century has increased the speed at which technological innovation changes people’s lives around the world [139], leading to extensive analyses of the processes,…”
BackgroundOwnership of User-Held Data: Why Property Law Is the Right Approach
Jurcys, P., Donewald, C., Fenwick, M., Lampinen, M., & Smaliukas, A. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3711017 · Cited by 20 · cited 2×
“The view of privacy protection based on data as property [75, 119, 129] has been criticized as placing a substantial burden on the free flow of information, while potentially not improving privacy protections [78].”
BackgroundOn the Coloniality of Human Rights
Maldonado-Torres, N. G. E. (2021) · Routledge eBooks · doi:10.4324/9781003177722-5 · Cited by 17
McMillan-Major, A., Alyafeai, Z., Biderman, S., Chen, K., Toni, F. D., Dupont, G., Elsahar, H., Emezue, C. C., Aji, A. F., Ilić, S., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.10066 · Cited by 17 · cited 2×
“[90] Angelina McMillan-Major, Zaid Alyafeai, Stella Biderman, Kimbo Chen, Francesco De Toni, Gerard Dupont, Hady Elsahar, Chris Emezue, Alham Fikri Aji, Suzana Ilic, Nurulaqilla Khamis, Colin Leong, Maraim Masoud, Aitor Soroa, Pedro Ortiz Suarez, Zeerak Talat, Daniel van Strien, and Yacine Jernite.”
BackgroundSelf-citationWhat's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus
Luccioni, A. S., & Viviano, J. D. (2021) · arXiv · doi:10.48550/arxiv.2105.02732 · Cited by 17
Self-citationAffirmative Algorithms: The Legal Grounds for Fairness as AwarenessPreprint
Ho, D. E., & Xiang, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14285 · Cited by 16 · cited 1×
“-centric perspective, have connected ML to legal frameworks for human rights, especially anti-discrimination [47, 48, 64, 70, 72, 140, 142, 146].”
BackgroundPublic artworks and the freedom of panorama controversy: a case of Wikimedia influence
Dulong de Rosnay, M., & Langlais, P.-C. (2017) · Internet Policy Review · doi:10.14763/2017.1.447 · Cited by 15
Formalism and Pragmatism in American Law
Grey, T. C. (2014) · BRILL eBooks · doi:10.1163/9789004272897 · Cited by 14
Biderman, S., Bicheno, K., & Gao, L. (2022) · arXiv · doi:10.48550/arxiv.2201.07311 · Cited by 12 · cited 1×
“There has also been an increased focus on analyzing other dimensions of data quality and stewardship [102, 107, 121, 123], with several noteworthy initiatives aiming to document both existing [9, 20, 30, 43], and newly developed [16, 60, 136] resources.”
BackgroundSelf-citationMachine Learning Technologies and Their Inherent Human Rights Issues in Criminal Justice Contexts
Grace, J. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3487454 · Cited by 8
No Intruder, no Validity: Evaluation Criteria for Privacy-Preserving Text Anonymization
Mozes, M., & Kleinberg, B. (2021) · arXiv · doi:10.48550/arxiv.2103.09263 · Cited by 8 · cited 2×
“[96] Maximilian Mozes and Bennett Kleinberg.”
BackgroundToward a Wikipedia For and From Us All
Vrana, A. G., Sengupta, A., & Bouterse, S. (2020) · Wikipedia @ 20 · doi:10.7551/mitpress/12366.003.0021 · Cited by 7 · cited 2×
“The Wikimedia projects face many of the same tensions that would face governance of global digital language data, such as diverse needs and goals of editors [109], the need to navigate varying local laws such as “freedom of panorama” [138] when determining whether an image can be hosted [39], and how they are situated…”
BackgroundLemley, M. A. (2020) · doi:10.2139/ssrn.3715133 · Cited by 6
(2019) · EspaceINRS (National Institute for Scientific Research (Canada)) · Cited by 3
The Problem of Zombie Datasets: A Framework For Deprecating Datasets.
Corry, F., Sridharan, H., Luccioni, A. S., Ananny, M., Schultz, J., & Crawford, K. (2021) · Cited by 2
Self-citationSystematic Inequalities in Language Technology Performance across the World's LanguagesPreprint
Blasi, D. E., Anastasopoulos, A., & Neubig, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.06733 · Cited by 2
(1982) · Cited by 1
(2015) · Gredos (University of Salamanca) · Cited by 1
Implementation of an Open Science Policy in the context of management of CLARIN language resources
Kelli, A., Lindén, K., Vider, K., et al. (2018) · Cited by 1
Chapter Two Machine-learning Technologies and Human Rights in Criminal Justice Contexts
Grace, J. (2022) · State University of New York Press eBooks · doi:10.2307/jj.18254622.7 · Cited by 1
Black Skin, White Masks: Frantz Fanon 20 July 1925–6 December 1961
(2021) · My Black Stars · doi:10.2307/j.ctv1pfqnct.38
Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · arXiv · doi:10.48550/arxiv.2007.04068
A Survey of Race, Racism, and Anti-Racism in NLP
Field, A., Blodgett, S. L., Waseem, Z., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.11410
Research works printed but not linked: 15
- The Ada Lovelace Institute, The AI Now Institute, and The Open Government Partnership. 2021. Algorithmic accountability for the public sector. http://www.opengovpartnership.org/documents/
- United Nations. General Assembly. 1949. Universal declaration of human rights. Vol. 3381. Department of State United States of America.
- Amber Berson, Monika Sengul-Jones, and Melissa Tamani. 2021. Unreliable Guidelines: Reliable sources and marginalized communities in French, English, and Spanish Wikipedias. https://artandfeminism.org/wp-content/uploads/2021/06/Unrealiable-Guidelines_Final.pdf
- Alina Beygelzimer Yann Dauphin Percy Liang and Jennifer Wortman Vaughan. 2021. Introducing the NeurIPS 2021 Paper Checklist. https://neuripsconf.medium.com/introducing-the-neurips-2021-paper-checklist-3220d6df500b
- Abeba Birhane Vinay Uday Prabhu and Emmanuel Kahembwe. 2021. Multimodal datasets: misogyny pornography and malignant stereotypes. ArXiv abs/2110.01963(2021). · arXiv
- 10.18653/v1 · doi:10.18653/v1
- David Freeman Engstrom, Daniel E Ho, and Cristina Isabel Ceballos. 2021. Disparate Limbo: How Administrative Law Erased Antidiscrimination. Yale Law Journal, Forthcoming(2021).
- William Labov. 1994. Principles of Linguistic Change, Volume 1: Internal Factors. John Wiley & Sons.
- Claudia Mitchell-Kernan. 1971. Language Behavior in a Black Urban Community. Monograph of the Language-Behavior Research Laboratory, No. 2 (1971).
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- Cornelia Roux and Petro Du Preez. 2013. Human rights literacy: A quest for meaning. Retrieved 20(2013), 2017.
- 10.1093/idpl · doi:10.1093/idpl
- Samson Tan. 2022. Linguistically-Inclusive Natural Language Processing. Ph. D. Dissertation. National University of Singapore.
- 10.18653/v1 · doi:10.18653/v1
- 10.18653/v1 · doi:10.18653/v1
Cited by
The future landscape of large language models in medicine
Clusmann, J., Kolbinger, F. R., Muti, H. S., Carrero, Z. I., Eckardt, J.-N., Laleh, N. G., Löffler, C. M. L., Schwarzkopf, S.-C., Unger, M., Veldhuizen, G. P., et al. (2023) · Communications Medicine · doi:10.1038/s43856-023-00370-1 · Cited by 1,045
“For example, they can break down complex concepts to an amateur level (Box 2, Supplementary Data, example 8, 9) and provide individualized feedback on academic topics with reasonable explanations (Supplementary Data, example 9) 6 .”
BackgroundBias and Fairness in Large Language Models: A Survey
Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00524 · Cited by 1,245
Auditing large language models: a three-layered approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00289-2 · Cited by 289
“, interactive model cards [183] and information about the initial training dataset [184], [185], to help downstream developers adapt the model appropriately.”
BackgroundHarms from Increasingly Agentic Algorithmic Systems
Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149
“[97] highlight the imbalance of power between AI developers and the rest of society, and propose frameworks and”
BackgroundBrinkmann, L., Baumann, F., Bonnefon, J.-F., Derex, M., Müller, T. F., Nussberger, A.-M., Czaplicka, A., Acerbi, A., Griffiths, T. L., Henrich, J., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01742-2 · Cited by 132
“One approach is to care-fully curate the dataset on which the model is trained 187,188 .”
Background
Metadata
- Authors
- Jernite, Y., Nguyen, H., Biderman, S., Rogers, A., Masoud, M., Danchev, V., Tan, S., Luccioni, A. S., Subramani, N., Johnson, I., Dupont, G., Dodge, J., Lo, K., Talat, Z., Radev, D., Gokaslan, A., Nikpoor, S., Henderson, P., Bommasani, R., & Mitchell, M.
- Affiliations
- Hugging Face (US)
- Ontocord, USA
- EleutherAI, USA
- University of Copenhagen (DK)
- Independent researcher, Ireland
- University of Essex (GB)
- Amazon (United States) (US)
- Allen Institute for Artificial Intelligence (US)
- Wikimedia Foundation (US)
- Independent, France
- Simon Fraser University (CA)
- Yale University (US)
- Cornell University (US)
- CAIDP, Canada
- Stanford University (US)
- ORCID
- Venue
- 2022 ACM Conference on Fairness Accountability and Transparency
- Publisher
- ACM
- Published
- 2022-06-20
- Pages
- 2206-2222
- OpenAlex
- W4283167130
- Cited by
- 75
- References
- 139
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 17 · 2023: 25 · 2022: 5
- FWCI
- 6.73
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, cc-by-nc)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- IT University Of Copenhagen (IT University of Copenhagen) (submittedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- large language models, distributed governance, data management, stakeholder management, human values, data rights, international research collaboration, data transparency, language technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.