The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science
Open accessAbstract
In this paper, we propose data statements as a design solution and professional practice for natural language processing technologists, in both research and development. Through the adoption and widespread use of data statements, the field can begin to address critical scientific and ethical issues that result from the use of data from certain populations in the development of technology for other populations. We present a form that data statements can take and explore the implications of adopting them as part of regular practice. We argue that data statements will help alleviate issues related to exclusion and bias in language technology, lead to better precision in claims about how natural language processing research can generalize and thus better engineering results, protect companies from public embarrassment, and ultimately lead to language technology that meets its users in their own preferred linguistic style and furthermore does not misrepresent them to others.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“or lead to adverse effects from deploying suboptimal or harmful models (Bender and Friedman, 2018) on tasks for which they are ill-suited (Raji et al., 2022).”
From Lessons from the Trenches on Reproducible Evaluation of Language Models (2024) · cites this paper as Bender and Friedman, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Numerous authors have observed that ML systems perform better for users whose demographic characteristics match those represented in the training data [9,36].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024 · cited 1×
“Here, our focus is on linguistic data. the review (e.g., Pang et al., 2002) or the hashtag #sarcasm used to identify sarcastic language (e.g., Kreuz and Caucci, 2007).”
BackgroundThe Study of Second Language Acquisition
Brown, C., & Ellis, R. (1996) · The Modern Language Journal · doi:10.2307/329065 · Cited by 4,199
Publication Manual of the American Psychological Association
DeCleene, K. E., & Fogo, J. (2012) · Occupational Therapy In Health Care · doi:10.3109/07380577.2011.629024 · Cited by 3,167
The Social Stratification of English in New York City.
Crockett, H. J., & Labov, W. (1968) · American Sociological Review · doi:10.2307/2092899 · Cited by 3,084
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655 · cited 4×
“Waseem and Hovy (2016) provide the following complete list of terms used in their initial scrape: MKR, asian drive, feminazi, immigrant, nigger, sjw, WomenAgainstFeminism, blameonenotall, islam terrorism, notallmen, victimcard, victim card, arab terror, gamergate, jsil, racecard, race card. dataset…”
BackgroundMethodInfluentialMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615
Style and Sociolinguistic Variation
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511613258 · Cited by 1,541 · cited 1×
“S PEAKER D EMOGRAPHIC Sociolinguis-tics has found that variation (in pronunciation, prosody, word choice, and grammar) correlates with speaker demographic characteristics (Labov, 1966), as speakers use linguistic variation to construct and project identities (Eckert and Rickford, 2001).”
BackgroundFriedman, B., & Nissenbaum, H. (1996) · ACM Transactions on Information Systems · doi:10.1145/230538.230561 · Cited by 1,203 · cited 2×
“Friedman and Nissenbaum (1996) show that in some cases, system bias reflects biases in society; these are pre-existing biases with roots in social institutions, practices and attitudes.”
BackgroundMethodSelf-citationValue Sensitive Design and Information Systems
Friedman, B., Kahn, P. H., & Borning, A. (2008) · The Handbook of Information and Computer Ethics · doi:10.1002/9780470281819.ch4 · Cited by 1,136
Self-citationMen Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829 · cited 1×
“Zhao et al. (2017) show that beyond picking up such biases, machine learning algorithms can amplify them.”
BackgroundAccountability in algorithmic decision making
Diakopoulos, N. (2016) · Communications of the ACM · doi:10.1145/2844110 · Cited by 763
Dimensions of Register Variation: A Cross-Linguistic Comparison
Nunnally, T. E., & Biber, D. (1999) · Language · doi:10.2307/417491 · Cited by 716
Guidelines for electronic text encoding and interchange
Sperberg-McQueen, C. M., Burnard, L., & Computing, L. (1994) · Medical Entomology and Zoology · Cited by 601
Sarcasm as Contrast between a Positive Sentiment and Negative Situation
Riloff, E., Qadir, A., Surve, P., De Silva, L., Gilbert, N., & Huang, R. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1066 · Cited by 587 · cited 1×
“The latter includes annotations for sentiment (Liu, 2012) and for figurative language or sarcasm (e.g., Riloff et al., 2013; Ptáˇcek et al., 2014).”
BackgroundAre You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter
Waseem, Z. (2016) · Proceedings of the First Workshop on NLP and Computational Social Science · doi:10.18653/v1/w16-5618 · Cited by 569 · cited 5×
“experts) on the effectiveness of models trained on the annotations, Waseem and Hovy (2016) performed a scrape of Twitter data using contentious terms and topics.”
BackgroundMethodInfluentialExamining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2005 · Cited by 384 · cited 1×
“(See also Kiritchenko and Mohammad, 2018.)”
Gender and Dialect Bias in YouTube’s Automatic Captions
Tatman, R. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1606 · Cited by 338
The social impact of natural language processing
Hovy, D., & Spruit, S. L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2096 · Cited by 329 · cited 3×
“, 2017) and papers (Hovy and Spruit, 2016) in NLP, as well as workshops in related fields, notably the FATML series (http://www.”
BackgroundInfluentialArtificial Intelligence Illuminated
Coppin, B. (2004) · Cited by 309
Lexical influences on the perception of sarcasm
Kreuz, R. J., & Caucci, G. M. (2007) · Proceedings of the Workshop on Computational Approaches to Figurative Language - FigLanguages '07 · doi:10.3115/1611528.1611529 · Cited by 244 · cited 1×
“Here, our focus is on linguistic data. the review (e.g., Pang et al., 2002) or the hashtag #sarcasm used to identify sarcastic language (e.g., Kreuz and Caucci, 2007).”
BackgroundAn Analysis of the Interaction of Language, Topic, and Listener
ERVIN‐TRIPP, S. (1964) · American Anthropologist · doi:10.1525/aa.1964.66.suppl_3.02a00050 · Cited by 244
Sarcasm Detection on Czech and English Twitter
Ptáċek, T., Habernal, I., & Hong, J. S. (2014) · Research Portal (Queen's University Belfast) · Cited by 170
A Survey of Value Sensitive Design Methods
Friedman, B., Hendry, D. G., & Borning, A. H. (2017) · now publishers, Inc. eBooks · doi:10.1561/9781680832914 · Cited by 164
Self-citationOn Achieving and Evaluating Language-Independence in NLP
Bender, E. M. (2011) · Linguistic Issues in Language Technology · doi:10.33011/lilt.v6i.1239 · Cited by 153
Self-citationCzeskis, A., Dermendjieva, I., Yapit, H., Borning, A. H., Friedman, B., Gill, B. T., & Kohno, T. (2010) · Symposium On Usable Privacy and Security · doi:10.1145/1837110.1837130 · Cited by 134 · cited 2×
“We do this with value scenarios (Nathan et al., 2007; Czeskis et al., 2010).”
BackgroundSelf-citationLinguistic Issues in Language Technology
(2021) · Linguistic Issues in Language Technology · doi:10.33011/lilt · Cited by 117
Nathan, L. P., Klasnja, P., & Friedman, B. (2007) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1240866.1241046 · Cited by 115 · cited 1×
“We do this with value scenarios (Nathan et al., 2007; Czeskis et al., 2010).”
Self-citationTagging Performance Correlates with Author Age
Hovy, D., & Søgaard, A. (2015) · Annual Meeting of the Association for Computational Linguistics · doi:10.3115/v1/p15-2079 · Cited by 110 · cited 1×
“There are other studies showing that systems from part of speech taggers (Hovy and Søgaard, 2015; Jørgensen et al., 2015) to speech recognition engines (Tatman, 2017) perform better for speakers whose demographic characteristics better match those represented in the training data.”
BackgroundIncorporating Dialectal Variability for Socially Equitable Language Identification
Jurgens, D., Tsvetkov, Y., & Jurafsky, D. (2017) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p17-2009 · Cited by 108 · cited 3×
“The NLP community has recognized critical limitations in the field’s existing data catalog, leaving many language communities underserved (Bender, 2011; Munro, 2015; Jurgens et al., 2017).”
BackgroundA Nutritional Label for Rankings
Yang, K., Stoyanovich, J., Asudeh, A., Howe, B., Jagadish, H., & Miklau, G. (2018) · Proceedings of the 2018 International Conference on Management of Data · doi:10.1145/3183713.3193568 · Cited by 103 · cited 1×
“…“datasheets for datasets,” looking at AI more broadly (but including NLP); Chmielinski and colleagues at the MIT Media Lab propose “dataset nutrition labels”; 19 and Yang et al. (2018) describe “Ranking Facts,” a series of widgets that allow a user to explore how attributes influence a ranking.”
BackgroundMulti-lifespan information system design: a research initiative for the hci community
Friedman, B., & Nathan, L. P. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753665 · Cited by 100 · cited 1×
“funded by the United States National Science Foundation, is part of a research program on developing multi-lifespan design knowledge (Friedman and Nathan, 2010).”
BackgroundSelf-citationBroad Twitter Corpus: A Diverse Named Entity Recognition Resource
Derczynski, L., Bontcheva, K., & Roberts, I. G. (2016) · International Conference on Computational Linguistics · Cited by 81
Considerations and guidance in designing equity-relevant clinical trials
Mbuagbaw, L. C. E., Aves, T., Shea, B., Jull, J., Welch, V. A., Taljaard, M., Yoganathan, M., Greer-Smith, R., Wells, G. A., & Tugwell, P. (2017) · International Journal for Equity in Health · doi:10.1186/s12939-017-0591-1 · Cited by 74
The dangers of faulty, biased, or malicious algorithms requires independent oversight
Shneiderman, B. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618211113 · Cited by 73 · cited 2×
“…point to the need to clarify information about the data: “Algorithm impact statements would document [. . . ] data quality control for input sources” (Shneiderman, 2016, page 13539); “One avenue for transparency here is to communicate the quality of the data, including its accuracy, completeness,…”
BackgroundFurler, J., Magin, P. J., Pirotta, M. V., & van Driel, M. (2012) · International Journal for Equity in Health · doi:10.1186/1475-9276-11-14 · Cited by 64 · cited 2×
“In developing this practice, we draw on analogous practices from the fields of psychology and medicine that require some standardized information about the populations studied (e.g., APA, 2009; Moher et al., 2010; Furler et al., 2012; Mbuagbaw et al., 2017).”
MethodChallenges of studying and processing dialects in social media
Jørgensen, A., Hovy, D., & Søgaard, A. (2015) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/w15-4302 · Cited by 64 · cited 1×
“There are other studies showing that systems from part of speech taggers (Hovy and Søgaard, 2015; Jørgensen et al., 2015) to speech recognition engines (Tatman, 2017) perform better for speakers whose demographic characteristics better match those represented in the training data.”
BackgroundFriedman, B., Nathan, L. P., & Yoo, D. (2016) · Interacting with Computers · doi:10.1093/iwc/iwv045 · Cited by 29 · cited 2×
“Criminal Tribunal for Rwanda (ICTR) comprising 50–60 hours of material with high quality transcription throughout (Nathan et al., 2011; Nilsen et al., 2012; Friedman et al., 2016).”
BackgroundSelf-citationMulti-lifespan information system design
Nathan, L. P., Lake, M., Grey, N. C., Nilsen, T. T., Utter, R. F., Utter, E. J., Ring, M., Kahn, Z., & Friedman, B. (2011) · iConference · doi:10.1145/1940761.1940841 · Cited by 20
Self-citationSubword Variation in Text Message Classification
Munro, R., & Manning, C. D. (2010) · Cited by 16
White paper on establishing an infrastructure for open language archiving
Bird, S., & Simons, G. (2000) · Cited by 7
Public curation of a historic collection
Nilsen, T. T., Grey, N. C., & Friedman, B. (2012) · doi:10.1145/2141512.2141601 · Cited by 4 · cited 1×
“Criminal Tribunal for Rwanda (ICTR) comprising 50–60 hours of material with high quality transcription throughout (Nathan et al., 2011; Nilsen et al., 2012; Friedman et al., 2016).”
BackgroundSelf-citation
Cited by
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
“While documentation allows for potential accountability [13, 52, 86], undocumented training data perpetuates harm without recourse.”
BackgroundSelf-citationA Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
“ces while using data, such as having datasheets that would act like a supporting document for the data reporting the dataset creation method, its characteristics, motivations, and its skews [12, 48]. [11] proposes a similar approach for the NLP applications. A similar suggestion has been proposed for models in [90]. A…”
MethodLarge language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
“As another example, Bender and Friedman [2] outline a proposal similar to datasheets for datasets specifically intended for language-based datasets.”
Metadata
- Authors
- Bender, E. M., & Friedman, B.
- Affiliations
- University of Washington (US)
- Corresponding author
- Bender, Emily M.
- Friedman, Batya
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2018-12
- Volume
- 6
- Pages
- 587-604
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2911227954
- Semantic Scholar
- 97bfa89addc6e5d76361e4c1e296949cad887b86
- Cited by
- 854
- References
- 46
- Citations by year
- 2026: 108 · 2025: 96 · 2024: 102 · 2023: 154 · 2022: 127 · 2021: 177 · 2020: 68 · 2019: 20 · 2018: 1
- FWCI
- 132.62
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Science Foundation (1302709)
- University of Washington
- York University
- Macquarie University
- University of California, San Diego
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- natural language processing, algorithmic bias, underrepresented groups, ethical practice, linguistic diversity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.