Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
In this paper, we propose data statements as a design solution and professional practice for natural language processing technologists, in both research and development. Through the adoption and widespread use of data statements, the field can begin to address critical scientific and ethical issues that result from the use of data from certain populations in the development of technology for other populations. We present a form that data statements can take and explore the implications of adopting them as part of regular practice. We argue that data statements will help alleviate issues related to exclusion and bias in language technology, lead to better precision in claims about how natural language processing research can generalize and thus better engineering results, protect companies from public embarrassment, and ultimately lead to language technology that meets its users in their own preferred linguistic style and furthermore does not misrepresent them to others.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“or lead to adverse effects from deploying suboptimal or harmful models (Bender and Friedman, 2018) on tasks for which they are ill-suited (Raji et al., 2022).”
From Lessons from the Trenches on Reproducible Evaluation of Language Models (2024) · cites this paper as Bender and Friedman, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Numerous authors have observed that ML systems perform better for users whose demographic characteristics match those represented in the training data [9,36].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024 · cited 1×
“Here, our focus is on linguistic data. the review (e.g., Pang et al., 2002) or the hashtag #sarcasm used to identify sarcastic language (e.g., Kreuz and Caucci, 2007).”
BackgroundThe Study of Second Language Acquisition
Brown, C., & Ellis, R. (1996) · The Modern Language Journal · doi:10.2307/329065 · Cited by 4,199
Publication Manual of the American Psychological Association
DeCleene, K. E., & Fogo, J. (2012) · Occupational Therapy In Health Care · doi:10.3109/07380577.2011.629024 · Cited by 3,167
The Social Stratification of English in New York City.
Crockett, H. J., & Labov, W. (1968) · American Sociological Review · doi:10.2307/2092899 · Cited by 3,084
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Waseem, Z., & Hovy, D. (2016) · Proceedings of the NAACL Student Research Workshop · doi:10.18653/v1/n16-2013 · Cited by 1,655 · cited 4×
“Waseem and Hovy (2016) provide the following complete list of terms used in their initial scrape: MKR, asian drive, feminazi, immigrant, nigger, sjw, WomenAgainstFeminism, blameonenotall, islam terrorism, notallmen, victimcard, victim card, arab terror, gamergate, jsil, racecard, race card. dataset…”
BackgroundMethodInfluential
Cited by
Items 701–800 of 865
Modeling Discolsive Transparency in NLP Application DescriptionsPreprint
Saxon, M., Levy, S., Wang, X., Albalak, A., & Wang, W. Y. (2021) · arXiv (Cornell University)
DaN+: Danish Nested Named Entities and Lexical Normalization
Plank, B., Jensen, K. N., & van der Goot, R. (2021) · IT University Of Copenhagen (IT University of Copenhagen) · doi:10.48550/arxiv.2105.11301
“Following (Bender and Friedman, 2018), the following outlines the data statement for DAN+: A.”
BackgroundSome practical considerations for using audio stimuli in acceptability judgment experimentsPreprint
Sedarous, Y., & Namboodiripad, S. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hdy4z
On factuality in neural language models
Nadeem, M. (2021)
IndoNLI: A Natural Language Inference Dataset for IndonesianPreprint
Mahendra, R., Aji, A. F., Louvan, S., Rahman, F., & Vania, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14566
“I NDO NLI data characteristics is described in the Appendix A (Bender and Friedman, 2018) The resulting corpus statistic is presented in Table 4.”
MethodFactoring Ethics in Technology, Policy Making, Regulation and AI
Hessami, A. G., & Shaw, P. (2021) · IntechOpen eBooks · doi:10.5772/intechopen.92952 · Cited by 2
Hupont, I., Tolan, S., Güneş, H., & Gómez, E. (2022) · Research Square · doi:10.21203/rs.3.rs-1306704/v1
Lerch, L., Wich, M., Eder, T., & Groh, G. (2022) · Ethik in mediatisierten Welten · doi:10.1007/978-3-658-36446-5_17
Xiao, Y., Fu, J., Ng, S.-K., & Liu, P. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.213 · Cited by 3
Sen, I., Fröhling, L., & Weller, K. (2022) · ACM Web Science Conference (WebSci) · doi:10.1145/3501247.3539504
“They often target specific parts of the research pipeline, such as Datasheets [3] or Data Statements [2] for the documentation of datasets, or Model Cards [5] for the documentation of (Machine Learning) model development and deployment.”
BackgroundA Novel Study on Tools and Frameworks for Mitigating Bias in Multimodal Datasets
Mandhala, V. N., Bhattacharyya, D., & Midhunchakkaravarthy, D. (2023) · Cognitive science and technology · doi:10.1007/978-981-19-2358-6_27
Analyzing learner language: the case of the Hebrew essay corpusPreprint
Gafni, C., Sheinfux, L. H., Klunover, H., Prior, A., & Wintner, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2433887/v1
Don’t Blindly Use Data: Towards a Data Statement for Computational Financial Research
Taylor, S., & Kešelj, V. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020681
“Bender and Friedman argued that in order to address bias and avoid misrepresentation, authors should provide information on how the underlying attributes of the data such as the speaker, the annotator, the speech situation, and potential biases could be part of data [4].”
BackgroundMethodInfluentialA Commonsense-Enhanced Document-Grounded Conversational Agent: A Case Study on Task-Based Dialogue
Strathearn, C., & Gkatzia, D. (2022) · Signals and communication technology · doi:10.1007/978-3-031-11035-1_6 · Cited by 1
Birkenmaier, L., Lechner, C. M., & Wagner, C. (2023) · doi:10.31235/osf.io/kgn6f
Ahmed, S. (2023) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · doi:10.21248/gups.74395
Resource papers as registered reports: a proposal
van Miltenburg, E. (2023) · Northern European Journal of Language Technology · doi:10.3384/nejlt.2000-1533.2023.4884
Corpus Modeling and the Geometries of Text: Meaning Spaces as Metaphor and MethodPreprint
Stoltz, D. S., Taylor, M. A., & Combs, M. A. (2023) · doi:10.31235/osf.io/z4eyw
Unveiling the Potential of ChatGPT: Applications, Challenges, and Future Directions
Mohsin, H., & Masood, S. (2023) · International Journal of Computer Applications · doi:10.5120/ijca2023922945 · Cited by 1
Kuznetsov, I., & Gurevych, I. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.633
NaturalAdversaries: Can Naturalistic Adversaries Be as Effective as Artificial Adversaries?
Gabriel, S., Palangi, H., & Choi, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.413 · Cited by 1
An insulin pump? Identifying figurative links in the construction of the drug lexicon
Reyes, A., & Saldivar, R. (2022) · Workshop on Figurative Language Processing (FigLang) · doi:10.18653/v1/2022.flp-1.16
Advances in Natural Language Processing A Thorough Examination
Deepender, D., & Walia, T. S. (2023) · IJARCCE · doi:10.17148/ijarcce.2023.12822
ShadowbansPreprint
Jaidka, K. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4567743
Beinborn, L., & Hollenstein, N. (2023) · Synthesis lectures on human language technologies · doi:10.1007/978-3-031-43260-6_4
Cognitive Signals of Language Processing
Beinborn, L., & Hollenstein, N. (2023) · Synthesis lectures on human language technologies · doi:10.1007/978-3-031-43260-6_3
Nasarian, E., Alizadehsani, R., Acharya, U. R., & Tsui, K. (2023) · Research Square · doi:10.21203/rs.3.rs-3626164/v1
Hirsch, D. D., Bartley, T., Chandrasekaran, A., Norris, D., Parthasarathy, S., & Turner, P. N. (2023) · SpringerBriefs in law · doi:10.1007/978-3-031-21491-2_9
TalkUp: Paving the Way for Understanding Empowering Language
Njoo, L., Park, C., Stappart, O., Thielk, M., Yi, C., & Tsvetkov, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.625 · Cited by 10
“In constructing our study, we took precautions to ensure the task design, data collection and handling are done ethically and according to current recommended practices and guidelines (Townsend and Wallace, 2016; Mislove and Wilson, 2018; Gebru et al., 2018; Bender and Friedman, 2018).”
MethodCorpus Modeling and the Geometries of Text: Meaning Spaces as Metaphor and Method
Stoltz, D. S., Combs, M. A., & Taylor, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197653609.013.1 · Cited by 2
FairLabel: Correcting Bias in Labels
Sengamedu, S. H., & Hien, P. T. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00039 · Cited by 3
Assessing and implementing trustworthy AI across multiple dimensions
Goldsteen, A., Farkash, A., & Hind, M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-18851-0.00001-9 · Cited by 2
Training AI, Computation, and the Environment
Marabelli, M. (2024) · Palgrave studies in equity, diversity, inclusion, and indigenization in business · doi:10.1007/978-3-031-53919-0_3
New Frontiers of AI and Algorithms
Marabelli, M. (2024) · Palgrave studies in equity, diversity, inclusion, and indigenization in business · doi:10.1007/978-3-031-53919-0_6
Data Extractions and Extractors
Marabelli, M. (2024) · Palgrave studies in equity, diversity, inclusion, and indigenization in business · doi:10.1007/978-3-031-53919-0_2
Challenges and Future Prospects of Intelligent Decision Making
Shaikh, H. I., & Mirza, I. B. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-5276-2.ch011 · Cited by 1
Analyzing learner language: the case of the Hebrew Learner Essay Corpus
Gafni, C., Sheinfux, L. H., Klunover, H., Bar-Siman-Tov, A., Prior, A., & Wintner, S. (2024) · Language Resources and Evaluation · doi:10.1007/s10579-023-09712-w · Cited by 1
Applications of Predictive Models in FinTech
Arnone, G. (2024) · Contributions to finance and accounting · doi:10.1007/978-3-031-55536-7_8
Ethical Leadership in the Age of AI
(2024) · Advances in logistics, operations, and management science book series · doi:10.4018/979-8-3693-2695-4.ch008
A Way of Making Smart Health Through Collaborating Machine Learning with the Bibliometrics
Vignesh, T., Sruthi, P. S., Mohanraj, T., Kumar, G., Varkale, A., & Sheela, M. S. (2024) · International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) · doi:10.1109/icacite60783.2024.10617395
“We examine dataset accounts at three different points in time: before to, during, and after the labelling and gathering of data [16-20].”
Machine Learning and Neural NLG
Reiter, E. (2024) · Natural Language Generation · doi:10.1007/978-3-031-68582-8_3
History of Ethics in Linguistics
Thomas, M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95504-1.00128-9
Teaching Dataset Creation in a Classroom Environment
Fantozzi, P., Laura, L., & Naldi, M. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-73538-7_19
Rishik, P. (2025) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit251112142
Extracting Possessions and Their Attributes
Chinnappa, D. (2020) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1703436
Tarsia, L., Mastropasqua, N., Bisso, I. C., Heras, M. L., Burgos, V. L., Risk, M. R., Courtois, M. F., Ceballos, I. F., Lockhart, C., Acevedo, D. G., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-80366-6_12
Ethics in Natural Language Processing: Addressing Bias, Privacy, and Misinformation
Joshi, H. S., & Taherdoost, H. (2025) · International Conference on Pervasive Computational Technologies (ICPCT) · doi:10.1109/icpct64145.2025.10941029 · Cited by 1
“Ethical curation of data is crucial in stemming the flow of the existing biases in the data to the NLP models [28].”
Modelling implicit bias in gender–career associations: A systematic comparison of language models
Porshnev, A., Kiy, K. D., O'Donoghue, D., Singh, M., Wingfield, C., & Lynott, D. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104840
Yung, Y. C., Lin, Y.-J., & Kao, H. (2025) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3744341
“In addition, the dataset’s building process [Gebru et al. 2021], composition [Holland et al. 2018], and characteristics may cause bias [Bender and Friedman 2018].”
Pratibha, Sharma, B., Bharti, S., Hooda, S., & Harnal, S. (2025) · Wiley eBooks · doi:10.1002/9781394302734.ch17
Data Privacy and Ethics in Occupational Health and Screening Systems
Gadhiya, Y. (2019) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit19522101 · Cited by 24
FTC probe of OpenAI: Consumer protection is the opening salvo of US AI regulation
Susarla, A. (2023) · The Conversation · doi:10.64628/aai.5pa4kwcw3
Language Input for Data & Society (LIDS): Licensing Data for CollectivesPreprint
Kgomo, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5401475
Publish‐Review‐Curate Modelling for Data Paper and Dataset: A Collaborative Approach
Jung, Y., & Ahn, R. (2025) · Learned Publishing · doi:10.1002/leap.2024
“Ross-Hellauer (2017) argues that open peer review reduces bias; Bender and Friedman (2018) note that post-publication feedback enhances rigour.”
Ufniarski, T., Ufniarska, M., Piech, A., Pasierb, K., Poplicha, K., Grodzińska, M., Siuzdak, B., Moszkowicz, J., Sobkiewicz, P., Kardasz, P., et al. (2025) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.3(47).2025.3809
“The data include social media content that inherently contains a wide spectrum of, at times, unfavourable opinions and behaviours (Bender & Friedman, 2018).”
Croce, A., Ugo, F., Roveta, A., Bertolina, C., Rinaudo, C., Maconi, A., & Bertolotti, M. (2025) · Geosciences · doi:10.3390/geosciences15100395 · Cited by 1
“Consequently, the use of generative AI in scientific research must be accompanied by an explicit and shared methodological framework that allows the integration of AI-generated data into validated knowledge systems [65,66].”
Uzun, C. (2025) · Open Research Europe · doi:10.12688/openreseurope.20871.1 · Cited by 2
Knowledge prompting: How knowledge engineers use generative AI
Koutsiana, E., Walker, J., Nwachukwu, M., Zhang, B., Meroño-Peñuela, A., & Simperl, E. P. B. (2025) · Journal of Web Semantics · doi:10.1016/j.websem.2025.100873 · Cited by 13
“Specifically for NLP systems, [15] suggested Data Statements to provide context about datasets, specifically to make NLP users of the dataset aware of issues related to exclusion and biases in the data, or that might emerge with the use of the data.”
InfluentialHuang, P., & Yang, Y. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1443
“Well-known frameworks include Datasheets for Datasets (Gebru et al., 2018), FactSheets (Arnold et al., 2019), Data Cards (Pushkarna et al., 2022), Data Statements (Bender & Friedman, 2018), and Data Nutrition Labels (Holland et al., 2018), serving as five seed articles in this study.”
Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting
Zhou, E., & Lü, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3349-7_17 · Cited by 3
Roldán-Palacios, M., & López‐López, A. (2025) · Brain Sciences · doi:10.3390/brainsci15111239
“Particular attention was given to key factors influencing the problem, as their effects directly impact the study’s results [22]—and, by extension, any conclusions drawn from them.”
Sikasote, C., Suleman, H., & Buys, J. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-11733-5_9
Ethics and Bias in Natural Language Processing
Talat, Z., & Blodgett, S. L. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95504-1.01226-6 · Cited by 1
Evaluation of AI ethics tools in language models: a developers’ perspective case study
Silva, J., Moreira, D. A. B., dos Santos, G. O., Ferreira, A., Maia, H., Avila, S., & Pedrini, H. (2026) · AI and Ethics · doi:10.1007/s43681-025-00914-2 · Cited by 2
Ahangaran, M., Zhu, H., Li, R., Yin, L., Jang, J., Chaudhry, A. P., Farrer, L. A., Au, R., & Kolachalama, V. B. (2024) · Figshare · doi:10.6084/m9.figshare.25963326
Ahangaran, M., Zhu, H., Li, R., Yin, L., Jang, J., Chaudhry, A. P., Farrer, L. A., Au, R., & Kolachalama, V. B. (2024) · Figshare · doi:10.6084/m9.figshare.26729467
Ahangaran, M., Zhu, H., Li, R., Yin, L., Jang, J., Chaudhry, A. P., Farrer, L. A., Au, R., & Kolachalama, V. B. (2024) · Figshare · doi:10.6084/m9.figshare.25963064
Embracing Training Dataset Bias for Automated Harmful Detection
Schöpke-Gonzalez, A., Kim, N., & Hemphill, L. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1282
“Bender and Friedman’s data statement s (Bender & Friedman, 2018) include annotator demographics in the proposed data schema but do not include factors related to moral systems.”
Generative artificial intelligence in Christian parenting education: the Polish context
Zellma, A., & Kostorz, J. (2025) · Family Forum · doi:10.25167/ff/5968
Ayienda, A. O. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.5810602
Mitigating Bias in Arabic NLP: A Framework for Ethical and Inclusive Data Preparation
Al-Shammari, E. T. (2025) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa66935.2025.11315271
“This practice allows the broader research community to evaluate and improve datasets [13,14].”
InfluentialLeveraging Artificial Intelligence to enable interoperability in EOSC
Gonzalez, E., & Tykhonov, V. (2025) · KNAW Research Portal (The Royal Netherlands Academy of Arts and Sciences) · doi:10.5281/zenodo.14729679
OpenITI Tabanlı RAG Sistemi ile Doğal Dil İşleme
Tay, M. (2026) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.4033
AI Bias in Marketing: Challenges, DEI Concerns, and Mechanisms for Ethical Innovation
Haridasan, A. C., & Xavier, N. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6731-6.ch002
Tran, D. T. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1013235
MoghadasNian, S., Dehaqani, M. J., Taheri, J. M. H., Haghighi, N. J., Esfeh, S. K., Karami, F., & MoghadasNian, A. (2026) · doi:10.24108/preprints-3114477
Seth, A. (2025) · ACM SIGCAS Computers and Society · doi:10.1145/3798139.3798145
Personalized Persuasion for AI Job Replacement Anxiety Using Fine-tuned LLMPreprint
Li, H., Han, N., Wang, Y., Liu, T., & Zhu, T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6381890
Mapping Research on Social Cognitive Bias in Large Language Models
Zhang, S., Li, J., Gao, Y., Li, Y., Zhang, X., & Li, X. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00159
“Ethical data collection frameworks should balance privacy protection with inclusive sourcing, obtaining informed consent and avoiding exploitative practices when incorporating vulnerable community narratives [32].”
Ethics, Authorship, and Transparency: Responsible AI Use in Research and Writing
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9340-7.ch004
Harada, Y. (2026) · Qeios · doi:10.32388/tmc25f
Generative AI for climate governance and acceptability-constrained policy design
Manivannan, A., Spaiser, V., Cann, T. J. B., Evans, J. A., Everall, J., Falkenberg, M., García, D., Guo, W., Herzog, R., Otto, I. M., et al. (2026) · npj Climate Action · doi:10.1038/s44168-026-00362-6 · Cited by 4
“…andcommunicationforms,trainingregion-speci fi c models to re fl ect local contexts more accurately, encouraging the publication of data statements 71 , and working with communities through participatory design to include their own narratives and experiences.”
A Data-driven Approach to Natural Language Processing for Contemporary and Historical French
Suárez, P. O. (2022) · theses.fr (ABES) · doi:10.70675/9b4a07fdza641z489fza523zddeee03a6544 · Cited by 1
Neural Approaches to Historical Words Reconstruction
Fourrier, C. (2022) · theses.fr (ABES) · doi:10.70675/647b8a58zeea0z48cdz8229zf1d7ee8b0742 · Cited by 7
De la complexité de l'annotation manuelle : méthodologie, biais et recommandations
Baledent, A. (2022) · theses.fr (ABES) · doi:10.70675/0cd58283zd4d9z471bza157z20e9f7ba2a9f · Cited by 3
Jawale, P. K., & Jawale, S. (2026) · International Conference on Communication, Computing and Emerging Technologies (IC3ET) · doi:10.1109/ic3et64989.2026.11467148
Riabi, A. (2025) · theses.fr (ABES) · doi:10.70675/5a649ef5za082z43d8z906azd8051be91d15 · Cited by 4
Tasnim, F., & Sharmin, S. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00614-6
Zhang, A., & Lee, M. K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791306
“These roles directly correspond to dataset creators and dataset consumers , stakeholders highlighted in data documentation resources as important for enabling responsible data use and who should be able to answer questions about these contexts [9, 58, 117].”
Hamna, H., Bhat, G., Mukherjee, S., Lalani, F. M., Hadfield, E., Siddarth, D., Bali, K., & Sitaram, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791172 · Cited by 10
Text as Data and Causal Inference in Sociology
Schwitter, N., Bach, R. L., & Klamm, C. (2026) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-026-01071-y · Cited by 2
“Finally, transparent documentation (Bender and Friedman 2018; Mitchell et al. 2019; Gebru et al. 2021; Klamm et al. 2025) of all prompts, model versions, and generation parameters enables critical evaluation and replication attempts.”
Himelboim, I., & Baid, M. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10050143
“…recruitment, and qualifications to assess dataset-level construct validity and the operationalization of “hate,” “offense,” and “inci-vility” [11,12,22,23], and it foregrounds inter-annotator agreement by comparing reported reliability metrics to align ML practice with established communication…”
InfluentialHow to (Un)Link the Bias: Linked Data to Counteract Dataset Bias
Cimitan, A., Alves-Pinto, A., & Geierhos, M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-25308-8_8
Designing Inclusive Learning Experiences With Generative AI
Sriharshaa, S., Ramakrishnan, A. B., Srijanani, S., Manikandan, R., & Magesh, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6063-8.ch004
Metadata
- Authors
- Bender, E. M., & Friedman, B.
- Affiliations
- University of Washington (US)
- Corresponding author
- Bender, Emily M.
- Friedman, Batya
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2018-12
- Volume
- 6
- Pages
- 587-604
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2911227954
- Semantic Scholar
- 97bfa89addc6e5d76361e4c1e296949cad887b86
- Cited by
- 854
- References
- 46
- Citations by year
- 2026: 108 · 2025: 96 · 2024: 102 · 2023: 154 · 2022: 127 · 2021: 177 · 2020: 68 · 2019: 20 · 2018: 1
- FWCI
- 132.62
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Science Foundation (1302709)
- University of Washington
- York University
- Macquarie University
- University of California, San Diego
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- natural language processing, algorithmic bias, underrepresented groups, ethical practice, linguistic diversity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.