Datasheets for datasets
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
Documentation to facilitate communication between dataset creators and consumers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Paradata needs may include the preservation of novel forms of information, such as datasheets explaining training datasets or model cards documenting an AI tool, and of these documents' relation to archival collections processed using them [ 26 ].”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Significant critiques of LLMs have been raised, including concerns about bias and fairness, misinformation, opaqueness due to a lack of interpretability and explainability, and environmental impact (Bender et al., 2021; Gebru et al., 2021; Strubell et al., 2019).”
From Using ChatGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments (2023) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ML driven algorithms are considered as epistemic resources that help us to improve understanding and/or make better predictions, then the statistical nature of ML de facto prevents groups underrepresented in the data from contributing to this epistemic resource on an equal ground to dominant groups (Gebru et al., 2021)”
From Algorithmic profiling as a source of hermeneutical injustice (2025) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The authors found that providing examples of what the requirements can look like helps to guide practitioners in clarifying their own rules.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“I show how archival theories have been animated in documenting data in the context of AI and ML, including through documentation frameworks like Datasheets for Datasets”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Gebru et al. 2021
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
(2018) · Cited by 3,510
Self-citationA sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Researchers at Google published follow-up work on model cards that document machine learning models [20] and released a data card (a lightweight version of a datasheet) along with the Open Images dataset [17].”
BackgroundSelf-citationMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 2×
“Of particular concern are recent examples showing that machine learning models can reproduce or amplify unwanted societal biases reflected in training data [4, 5, 9].”
BackgroundThe Effects of Automobile Safety Regulation
Peltzman, S. (1975) · Journal of Political Economy · doi:10.1086/260352 · Cited by 1,531
The Recent Past and Near Future of Risk and/or Need Assessment
Andrews, D. A., Bonta, J., & Wormith, J. S. (2006) · Crime & Delinquency · doi:10.1177/0011128705281756 · Cited by 1,507 · cited 1×
“Domains such as criminal justice (Garvie et al., 2016; Systems, 2017; Andrews et al., 2006), hiring and employment (Mann & O’Neil, 2016), critical infrastructure (O’Connor, 2017; Chui, 2017), and finance (Lin, 2012) all increasingly depend on machine learning methods.”
Background
Research works printed but not linked: 7
- Chui, G. Project will use AI to prevent or minimize electric grid failures, 2017.
- Garvie, C., Bedoya, A., and Frankle, J. The Perpetual Line-Up: Unregulated Police Face Recognition in America. Georgetown Law, Center on Privacy & Technology, Washington, D.C., 2016.
- Holstein, K., Vaughan, J., Daumé, H, Dudík, M., and Wallach, H. Improving fairness in machine learning systems: What do industry practitioners need? In Proceedings of 2019 ACM CHI Conf. on Human Factors in Computing Systems.
- Krasin, I. et al. OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017.
- O'Connor, M. How AI Could Smarten Up Our Water System, 2017.
- Doha Supply Systems. Facial Recognition, 2017.
- Yagcioglu, S., Erdem, A., Erdem, E., and Ikizler-Cinbis, N. RecipeQA: A challenge dataset for multimodal comprehension of cooking recipes. In Proceedings of the 2018 Conf. on Empirical Methods in Natural Language Processing.
Cited by
Items 901–1,000 of 1,039
Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation
Liu, Z., & Prud’hommeaux, E. T. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00467 · Cited by 13
“Following recently proposed scientific practices for computational linguistics and NLP (Bender and Friedman, 2018; Gebru et al., 2018), we would like to introduce these languages and their data sets explored in our study (Table 1).”
MethodThe Weak Supervision Landscape
Poyiadzi, R., Bacaicoa-Barber, D., Cid‐Sueiro, J., Perelló-Nieto, M., Flach, P. A., & Santos‐Rodríguez, R. (2022) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops53856.2022.9767420 · Cited by 11
Documenting use cases in the affective computing domain using Unified Modeling Language
Hupont, I., & Gómez, E. (2022) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii55700.2022.9953809 · Cited by 14
“Several methodologies have been proposed for AI documentation, but their focus is rather on data [3] and models [4] than AI systems as a whole, limiting at most the documentation of use cases to a brief textual description.”
BackgroundMethodA Decentralized Approach towards Responsible AI in Social Ecosystems
Chu, W. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19274 · Cited by 12
Recommender Systems and Autonomy: A Role for Regulation of Design, Rights, and Transparency
Djeffal, C., Hitrova, C., & Magrani, E. (2021) · Indian Journal of Law and Technology · doi:10.55496/jgdn9214 · Cited by 10
Fast Facts: Platforms From Personalization to Centralization
Iliadis, A., & Ford, H. (2023) · Social Media + Society · doi:10.1177/20563051231195546 · Cited by 12
“Studies on fast facts will also become important as large language models and knowledge graphs are increasingly used in search engines and virtual assistants, which will likewise require proper data labeling and annotation for verifiability and provenance (Bender et al., 2021; Gebru et al., 2021).”
BEING PROFILED: COGITAS ERGO SUM: 10 Years of Profiling the European Citizen
Bayamiloglu, E., Baraliuc, I., Janssens, L., & Hildebrandt, M. (2018) · Amsterdam University Press eBooks · doi:10.2307/j.ctvhrd092 · Cited by 24
Fair Dimensionality Reduction and Iterative Rounding for SDPsPreprint
Morgenstern, J., Samadi, S., Singh, M., Tantipongpipat, U. T., & Vempala, S. (2019) · arXiv (Cornell University) · Cited by 9
Self-citationComponent Mismatches Are a Critical Bottleneck to Fielding AI-Enabled Systems in the Public Sector
Lewis, G. A., Bellomo, S., & Galyardt, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06136 · Cited by 8
“While there is existing, recent work in creating descriptors for data sets (Gebru et al. 2018), models (Mitchell et al. 2019), and online AI services (Hind et al. 2018), there are two main limitations in this work: (1) they do not address the software engineer and operations perspectives, and (2)…”
MethodThemisto: Towards Automated Documentation Generation in Computational Notebooks.Preprint
Wang, A. Y., Wang, D., Drozdal, J., Muller, M. J., Park, S., Weisz, J. D., Liu, X., Wu, L., & Dugan, C. (2021) · arXiv (Cornell University) · Cited by 8
Datasets: A Community Library for Natural Language ProcessingPreprint
Lhoest, Q., del Moral, A. V., Jernite, Y., Thakur, A., von Platen, P., Patil, S. S., Chaumond, J., Drame, M., Plu, J., Tunstall, L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02846 · Cited by 210
“…are being created with a variety of different procedures, from crowd-sourcing to scraping to synthetic generation, which need to be taken into account when evaluating which is most appropriate for a given purpose and ought to be immediately apparent to prospective users (Gebru et al., 2018).”
BackgroundGUANinE v1.0: Benchmark Datasets for Genomic AI Sequence-to-Function ModelsPreprint
Robson, E. S., & Ioannidis, N. M. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.10.12.562113 · Cited by 10
“These sequences may in fact contain biological meaning, but our goal for this benchmark was reducing spurious factors [25], rather maximizing biological meaning.”
BackgroundTransparency in Music-Generative AI: A Systematic Literature ReviewPreprint
Batlle-Roca, R., Gómez, E., Liao, W., Serra, X., & Mitsufuji, Y. (2023) · Research Square · doi:10.21203/rs.3.rs-3708077/v1 · Cited by 18
The Cambridge Law Corpus: A Dataset for Legal AI Research
Östling, A., Sargeant, H., Xie, H., Bull, L., Terenin, A., Jonsson, L., Magnusson, M., & Steffek, F. (2024) · doi:10.2139/ssrn.4763429 · Cited by 8
Razi, A., Bouzoubaa, L. A., Pessianzadeh, A., Seberger, J. S., & Rezapour, R. (2025) · Research Square · doi:10.21203/rs.3.rs-5686084/v1 · Cited by 14
On the Readiness of Scientific Data Papers for a Fair and Transparent Use in Machine Learning
Giner-Miguelez, J., Gómez, A., & Cabot, J. (2025) · Scientific Data · doi:10.1038/s41597-025-04402-4 · Cited by 14
Olthof, S. B. H., & Davis, J. J. (2025) · Science and Medicine in Football · doi:10.1080/24733938.2025.2533784 · Cited by 15
“What constitutes transparency in AI is an open question, but current research focuses on issues such as providing (meta) information about data collection (Gebru et al. 2021) and model building (Mitchell et al. 2019).”
Tung, H.-Y., Ding, M., Chen, Z., Bear, D., Gan, C., Tenenbaum, J., Yamins, D., Fan, J., & Smith, K. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2929 · Cited by 8
Benway, N. R., & Preston, J. L. (2025) · Language, Speech, and Hearing Services in Schools · doi:10.1044/2025_lshss-24-00085 · Cited by 12
Automatic transparency evaluation for open knowledge extraction systems
Basereh, M., Caputo, A., & Brennan, R. (2023) · Journal of Biomedical Semantics · doi:10.1186/s13326-023-00293-9 · Cited by 15
“Source data transformation/preprocessing [15, 45] 7.”
BackgroundMethodInfluentialBertrand, A., Eagan, J., Maxwell, W., & Brand, J. L. M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642326 · Cited by 10
A multimodal database for the collection of interdisciplinary audiological research data in Spain
Callejón-Leblic, M. A., Blanco-Trejo, S., Villarreal-Garza, B., Picazo-Reina, A. M., Tena-García, B., Lara-Delgado, A., Lazo-Maestre, M., López-Benítez, F., Escobar-Reyero, F., Álvarez-Cendrero, M., et al. (2024) · Auditio · doi:10.51445/sja.auditio.vol8.2024.109 · Cited by 7
“…organizations in multicenter studies by comply - ing with regulations, security and confidentiality issues outlined in international guidelines on data protection, datasets for datasheets specifications ( Gebru et al. , 2021) and FAIR principles for effective data reuse ( Wilkinson et al. , 2016).”
BackgroundMethodGebru, T., & Denton, E. (2024) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000102 · Cited by 16
Self-citationTrustworthy human computation: a survey
Kashima, H., Oyama, S., Arai, H., & Mori, J. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10974-1 · Cited by 11
“Data explanation Bender & Friedman [22] Dataset description for natural language processing Gebru et al. [68] Dataset description for machine learning Evaluation of interpretability Doshi-Velez & Kim [55] Classification of crowdsourced evaluation schemes Hutton et al. [80] Worker preference of…”
Analyzing Collaborative Challenges and Needs of UX Practitioners when Designing with AI/ML
Muralikumar, M. D., & McDonald, D. W. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686986 · Cited by 12
“Examples include model cards, datasheets, and data cards [25, 45, 55].”
An Emerging Design Space of How Tools Support Collaborations in AI Design and Development
Muralikumar, M. D., & McDonald, D. W. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3701181 · Cited by 11
“A similar idea has also been applied to datasets used in model training to propose Datasheets for Datasets [45].”
The Making of Performative Accuracy in AI Training: Precision Labor and Its Consequences
Zhang, B. Z., Yang, T., Miceli, M., Haimson, O. L., & Thomas, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713112 · Cited by 7
“Previous work has underscored the importance of systematically documenting not only datasets but also data production contexts [4, 17, 24, 32, 34].”
RiskRAG: A Data-Driven Solution for Improved AI Model Risk Reporting
Rao, P. S. B., Šćepanović, S., Zhou, K., Bogucka, E. P., & Quercia, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713979 · Cited by 24
“…to support responsible AI (RAI) practices: from model documentation (e.g., model cards [48]), dataset documentation (e.g., datasheets for datasets [24], data statements for NLP [3]), documentation for the purpose of us-ing AI (i.e., ethics sheets for AI tasks [49]), to recent documentation for AI…”
Emerging Data Practices: Data Work in the Era of Large Language Models
Garcia, A. A., Candello, H. C. D. S. P., Badillo-Urquiola, K. A., & Wong-Villacrés, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714069 · Cited by 22
“One strategy has been the development of documentation tools, such as data statements and datasheets for datasets, that elicit an in-depth reflection of the data creation process as a critical component of ethical AI development [38, 83, 132].”
Future Illiteracies—Architectural Epistemology and Artificial Intelligence
Moussaoui, M. E. (2025) · Architecture · doi:10.3390/architecture5030053 · Cited by 15
“Training datasets reflect specific aesthetic, cultural, and historical biases that shape AI’s outputs [18].”
East, A., Campolongo, E., Meyers, L., Rayeed, S. M., Stevens, S., Zarubiieva, I., Fluck, I. E., Girón, J. C., Jousse, M., Lowe, S., et al. (2025) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.70140 · Cited by 17
“This information can be included in a file (e.g., a dataset card) (Gebru et al., 2021) or a general write-up of the data.”
The politics of artificial intelligence supply chains
Muldoon, J., Valdivia, A., & Badger, A. (2025) · AI & Society · doi:10.1007/s00146-025-02625-y · Cited by 23
Street review: A participatory AI-based framework for assessing streetscape inclusivity
Mushkani, R. A., & Koseki, S. A. (2025) · Cities · doi:10.1016/j.cities.2025.106602 · Cited by 17
“The approach allows negotiative group evaluations, which are then visualized in heatmaps for broader decision-making.”
Impact Assessment Card: Communicating Risks and Benefits of AI Uses
Bogucka, E. P., Constantinides, M., Šćepanović, S., & Quercia, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757482 · Cited by 18
“Moreover, Kawakami et al. [49] identified additional challenges in ensuring that Responsible AI artifacts such as “datasheets for datasets” [34], effectively serve non-technical stakeholders, including regulators and civil society organizations.”
Joseph, M. M., & Areepattamannil, S. (2025) · Sustainability · doi:10.3390/su172210381 · Cited by 8
The AI-powered soft skills renaissance: cultivating human abilities in the digital era
Muthukumar, M., Sitharaj, A., Sundaram, M. M., & Dhananjeiyan, B. (2025) · AI and Ethics · doi:10.1007/s43681-025-00912-4 · Cited by 9
“The efficacy and dependability of artificial intelligence systems are significantly influenced by the quality and rep - resentativeness of the data used in their development and training [88].”
Winslow, B. D., Garibay, Ö. Ö., Goyal, T., Koon, S., Margetis, G., Salvendy, G., Shneiderman, B., Tayebi, A., & Vardoulakis, L. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2641703 · Cited by 16
Exploring the Intersection of AI, Language, and Law: A Bibliometric Analysis
Lan, Z., & Zhang, X. (2026) · SAGE Open · doi:10.1177/21582440261431000 · Cited by 9
“…model cards with disaggregated performance reporting across jurisdictions and languages, and end-to-end internal algorithmic auditing that links design choices to harm hypotheses and remediation plans (Bender & Friedman, 2018; Gebru et al., 2021; Mitchell et al., 2019; Raji et al., 2020).”
Translating the Public Service Media Remit into Metrics and Algorithms
Grün, A., & Neufeld, X. (2022) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3523227.3547380 · Cited by 12
Artificial Intelligence, Machine Learning, and Natural Language Processing
Shoenbill, K. A., Kasthurirathne, S. N., & Mendonça, E. A. (2023) · Springer eBooks · doi:10.1007/978-3-031-29171-5_36 · Cited by 14
Beyond the ML Model: Applying Safety Engineering Frameworks to Text-to-Image Development
Rismani, S., Shelby, R. M., Smart, A., Santos, R. D., Moon, A., & Rostamzadeh, N. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604685 · Cited by 27
Human-Sensing Platforms and Ethical Considerations Throughout Their Data Life-Cycles
Lee, S. U., Paik, H.-Y., & Kanhere, S. S. (2024) · IEEE Internet of Things Magazine · doi:10.1109/iotm.001.2300148 · Cited by 7
Behind every good research there are data. What are they and their importance to forensic science
Hackman, L., Mack, P., & Ménard, H. (2024) · Forensic Science International Synergy · doi:10.1016/j.fsisyn.2024.100456 · Cited by 7
“Gebru et al. [13] take the data management plan a step further and advocate the inclusion of an accompanying datasheet, that details the composition, collection process, pre-processing/cleaning/labelling, uses, distribution and maintenance plan associated with each dataset.”
BackgroundAINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients
Kim, D. H., Shin, H., Yadgarova, S., Son, J., Subramonyam, H., & Kim, J. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661577 · Cited by 11
“Dataset Collection & Labeling.”
MethodInfluentialDesigning with Data, Data-Enabled and Data-Driven Design
Funk, M., Lövei, P., & Noortman, R. (2024) · Springer eBooks · doi:10.1007/978-3-319-27648-9_40-1 · Cited by 9
Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teams
Hanschke, V. A., Rees, D., Alanyali, M., Hopkinson, D., & Marshall, P. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642402 · Cited by 13
“…example, the DEED could respond to the question Is there anything about the composition of the dataset or the way it was collected and preprocessed/cleaned/labeled that might impact future uses? in datasheets for data sets [22] or to the section on Caveats and recommendations in model cards [39].”
Theme-Driven Keyphrase Extraction to Analyze Social Media Discourse
Romano, W., Sharif, O., Basak, M., Gatto, J., & Preum, S. M. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31391 · Cited by 10
Nahar, N., Rowlett, J., Bray, M., Omar, Z. A., Papademetris, X., Menon, A. V., & Kästner, C. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659028 · Cited by 12
“This also reflects the state of research and practice in HCI: there are more established documentation standards for fairness and data [3, 35, 69] than for explainability.”
BackgroundRacial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent
Mickel, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659050 · Cited by 21
“Our work is motivated by previous scholarship on racial categories in algorithmic and AI fairness [1, 9, 25] as well as by existing documentation frameworks for datasets and models [8, 15, 17, 19, 24, 28, 30, 43, 56].”
MethodComplexity as Design Material Position Paper
Windhager, F., Abdul‐Rahman, A., Bludau, M.-J., Hengesbach, N., Lamqaddam, H., Meirelles, I., Speckmann, B., & Correll, M. (2024) · IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV) · doi:10.1109/beliv64461.2024.00013 · Cited by 15
“Descriptions of datasets, such as datasheets [50], can therefore contain a myriad of factors, from sourcing to metadata to an assessment of potential biases and limitations of the data that have been collected.”
BackgroundHandle with Care: Lessons for Data Science from Black Female Scholars
Raji, I. D. (2020) · Patterns · doi:10.1016/j.patter.2020.100150 · Cited by 13
Steele, L., Velazquez-Pimentel, D., & Thomas, B. (2021) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.17517 · Cited by 8
Claver, A., & van de Meeberg, H. M. (2021) · Intelligence & National Security · doi:10.1080/02684527.2021.1946951 · Cited by 11
Boykin, C. M., Dasch, S. T., Rice, V., Lakshminarayanan, V. R., Togun, T. A., & Brown, S. M. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483302 · Cited by 11
Fishman, N., & Hancox-Li, L. (2022) · Conference on Fairness, Accountability and Transparency · doi:10.1145/3531146.3533206 · Cited by 12
“This is the “many eyeballs” model of security, and it has certain additional advantages when considering ML systems [4, 35].”
BackgroundTowards Pedagogy Supporting Ethics in Modelling
Oldfield, M. (2022) · Journal of Humanistic Mathematics · doi:10.5642/jhummath.xvsp3245 · Cited by 8
“The link between academia and industry must be a closer collaboration as development moves forwards [13, 3, 55, 2, 20, 30].”
BackgroundAccountability in Algorithmic Systems: From Principles to Practice
Wilkinson, D., Crawford, K., Wallach, H., Raji, I. D., Rakova, B., Singh, R., Strohmayer, A., & Zuckerman, E. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3583747 · Cited by 8
Self-citationTechnical Debt Management in Industrial ML - State of Practice and Management Model Proposal
Wang, X., Schuster, H., Borrison, R., & Klöpper, B. (2023) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin51400.2023.10217843 · Cited by 15
“Data Sheet for datasets have been proposed in [24] to increase the transparency and accountability in the ML community, to mitigate unwanted biases and facilitate greater reproducability.”
BackgroundFeedbackLogs: Recording and Incorporating Stakeholder Feedback into Machine Learning Pipelines
Barker, M., Kallina, E., Ashok, D., Collins, K. M., Casovan, A., Weller, A., Talwalkar, A., Chen, V., & Bhatt, U. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623239 · Cited by 15
Centering Policy and Practice: Research Gaps Around Usable Differential Privacy
Cummings, R., & Sarathy, J. (2023) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa58951.2023.00024 · Cited by 19
“Just as data curators should annotate datasets (e.g., using the framework of Gebru et al. [44]) prior to a DP release, organizations should also make public the justifications for their use of DP, alternative options that were considered and discarded, any relevant risks regarding privacy or data…”
MethodCreating Evolving Project Data Sets in Software Engineering
Lewowski, T., & Madeyski, L. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-26574-8_1 · Cited by 11
Casacuberta, D., Guersenzvaig, A., & Moyano-Fernández, C. (2022) · AI & Society · doi:10.1007/s00146-022-01389-z · Cited by 7
“As Gebru et al. (2021) show, the way datasets are defined is critical to assure a useful and ethical behaviour when using a model in the wild.”
BackgroundOrdun, C. Y., Raff, E., & Purushotham, S. (2020) · arXiv (Cornell University) · doi:10.13016/m2blek-cjvs · Cited by 26
Gender Bias in Multilingual Neural Machine Translation: The Architecture MattersPreprint
Costa‐jussà, M. R., Escolano, C., Basta, C., Ferrando, J., Batlle, R., & Kharitonova, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.13176 · Cited by 22
“In parallel, other initiatives focus on documenting our datasets (Gebru et al., 2018) to prioritize transparency.”
BackgroundSubramaniam, P., Ma, Y., Li, C., Mohanty, I., & Fernandez, R. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07532 · Cited by 31
“Second, metadata needs change in organizations [4], [14]–[16], so catalogs must evolve to accommodate such changing requirements.”
BackgroundAn Information Retrieval Approach to Building Datasets for Hate Speech DetectionPreprint
Rahman, M. M., Balakrishnan, D., Murthy, D., Kutlu, M., & Lease, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09775 · Cited by 23
Gautam, S., Chandra, M., De, A., Chakravorti, T., Malik, G., & De Choudhury, M. (2025) · arXiv · doi:10.48550/arxiv.2508.06849 · Cited by 7
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack
Kuratov, Y., Bulatov, A., Anokhin, P., Rodkin, I., Sorokin, D., Sorokin, A., & Burtsev, M. (2024) · arXiv · doi:10.48550/arxiv.2406.10149 · Cited by 19
Benchmarking Benchmark Leakage in Large Language Models
Xu, R., Wang, Z., Fan, R.-Z., & Liu, P. (2024) · arXiv · doi:10.48550/arxiv.2404.18824 · Cited by 210
“To this end, we introduce Benchmark Transparency Card (cf. Table 19), which serves as the supplement of the Data Card (Pushkarna et al., 2022; Gebru et al., 2021) and Model Card (Mitchell et al., 2019), aiming to document the utilization of benchmarks (such as whether any benchmark sets are used…”
Pandiani, D. S. M. (2024) · Future Humanities · doi:10.1002/fhu2.11 · Cited by 10
Ethical Dilemmas and Collaborative Resolutions in Machine Learning Research for Health Care
Zilberstein, S. (2024) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231241259671 · Cited by 6
“Within both academic and corporate communities, scholars seek to encourage the evaluation of the broader impacts of new tools (Gebru et al. 2021; Mitchell et al. 2019; Wang et al. 2022).”
AI Over-Hype: A Dangerous Threat (and How to Fix It)
Johnson, B., & Menzies, T. (2024) · IEEE Software · doi:10.1109/ms.2024.3439138 · Cited by 9
Toward collaborative artificial intelligence development for animal well-being
Sun, J. (2025) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.24.10.0650 · Cited by 9
Modise, L. M., Avanaki, M. A., Ameen, S., Celi, L. A., Chen, V. X. Y., Cordes, A., Elmore, M., Fiske, A., Gallifant, J., Hayes, M., et al. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000495 · Cited by 6
“Successive waves of self-regulation have seen the adoption of Datasheets for Datasets [78], which improves communication between dataset creators and users.”
Füßl, A., & Nissen, V. (2025) · Requirements Engineering · doi:10.1007/s00766-025-00437-6 · Cited by 8
“The disadvantage here is that users need to be highly motivated to read the documentation and setting up the XUI is time-consuming [39].”
Harmful Algae Forecasting through an Ocean Data Justice Lens
Record, N. R., Tupper, B., Douyon, K., Drakopulos, L., Vera, L. A., & Evanilla, J. (2025) · Environmental Science & Technology · doi:10.1021/acs.est.4c10838 · Cited by 7
Croskey, P., Offert, F., Jacobs, J., & Thaler, K. M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732058 · Cited by 12
“In response to calls and proposed solutions for increased transparency [52, 92, 115], some AI developers have released more (though still severely limited [144]) details about their training processes [104, 107].”
Generative artificial intelligence and the risk of technodigital colonialism
Cambraia, L., & Pyrrho, M. (2025) · Frontiers in Political Science · doi:10.3389/fpos.2025.1628139 · Cited by 9
Resource Asymmetry in Multilingual NLP: A Comprehensive Review and Critique
Akindotuni, D. (2025) · Journal of Computer and Communications · doi:10.4236/jcc.2025.137002 · Cited by 12
A Guide to Misinformation Detection Data and Evaluation
Thibault, C., Tian, J.-J., Péloquin-Skulski, G., Curtis, T. L., Zhou, J., Laflamme, F., Guan, L. Y., Rabbany, R., Godbout, J., & Pelrine, K. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737437 · Cited by 37
A community-based approach to ethical decision-making in artificial intelligence for health care
Senghor, A. S., Bright, T. J., Kakim, S., Norris, K. C., Antwi, H. A., Cooper, J. K., Mullins, C. D., & Baquet, C. R. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf076 · Cited by 7
Rethinking AI inclusion: a systems thinking framework for policy, education, and participation
Sarkar, A. (2025) · AI and Ethics · doi:10.1007/s43681-025-00810-9 · Cited by 9
“Open datasets should reflect cultural and linguistic diversity, and tools must be designed for local conditions [20, 52].”
InfluentialBaeyaert, J. (2025) · Sustainable Futures · doi:10.1016/j.sftr.2025.101126 · Cited by 9
Sivakaminathan, S. S., & Musi, E. (2025) · AI & Society · doi:10.1007/s00146-025-02564-8 · Cited by 21
Model Cards Revisited: Bridging the Gap Between Theory and Practice for Ethical AI Requirements
Puhlfürß, T., Butzke, J., & Maalej, W. (2025) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re63999.2025.00034 · Cited by 12
“Data-centric frameworks include data statements [28], dataset nutrition labels [27], data cards [26], and datasheets [25], some of which, unlike the model card framework, pose more explicit ethical questions to the documentation authors.”
Beyond Big Tech: Advocacy Technologists within Mission-Driven Civil Society Organizations
Chambers, L. M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757559 · Cited by 7
“Popular and innovative interventions such as datasheets for datasets [55], model cards for model reporting [92], or dataset nutritional labels [62] are generally intended for development contexts within tech companies.”
AI and Diversity: Ensuring Fairness in Automated Decision-Making
Subrahmanyam, S., & Baz, B. E. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3104-1.ch002 · Cited by 6
Evolving from Rules to Learning in Urban Modeling and Planning Support Systems
Cai, Z. (2025) · Urban Science · doi:10.3390/urbansci9120508 · Cited by 9
Leveraging small datasets for ethical and responsible AI music making
Bryan–Kinns, N., Wszeborowska, A., Sutskova, O., Wilson, E., Perry, P., Fiebrink, R., Vigliensoni, G., Lindell, R., Coronel, A., & Correia, N. N. (2025) · Audio Mostly Conference (AM) · doi:10.1145/3771594.3771601 · Cited by 8
Huckelberry, J., Zhang, Y., Sansone, A., Mickens, J. W., Beerel, P. A., & Reddi, V. J. (2026) · ACM Computing Surveys · doi:10.1145/3793197 · Cited by 29
Artificial Truth: Algorithmic Power, Epistemic Authority, and the Crisis of Democratic Knowledge
Palese, R. (2026) · Societies · doi:10.3390/soc16030102 · Cited by 21
Coleman, B. (2021) · Catalyst Feminism Theory Technoscience · doi:10.28968/cftt.v7i2.35973 · Cited by 7
“Practically speaking, particularly in regard to the dominant paradigm of supervised learning, the need to audit persists—the “datasheets for datasets” must still be produced—as there is no context for trust and experimentation and there might never be (Gebru et al. 2018).”
BackgroundChinese medical entity recognition based on the dual-branch TENER model
Peng, H., Zhang, Z., Liu, D., & Qin, X. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02243-y · Cited by 6
A Datasheet for the INSIGHT University Hospitals Birmingham Retinal Vein Occlusion Data Set
Bilton, E. J., Guggenheim, E. J., Baranyi, B., Radovanovic, C., Williams, R. L., Bradlow, W. M., Denniston, A. K., & Mollan, S. P. (2023) · Ophthalmology Science · doi:10.1016/j.xops.2023.100388 · Cited by 6
“This datasheet was designed to outline the data set in a transparent and standardized manner to enhance its utility to researchers employing machine learning.(11) The datasheet contains an excerpt of the data set, covering a”
BackgroundMethodLarge Language Models as SocioTechnical Systems
Dhole, K. (2023) · doi:10.18653/v1/2023.bigpicture-1.6 · Cited by 25
“…the form of – i) data statements and model cards and ii) through pre-prompting (or providing instruction) Documenting datasets and the training data (Gebru et al., 2021; Bender and Friedman, 2018; Stoyanovich and Howe, 2019; Papakyriakopoulos et al., 2023) used could be at least the bare minimum…”
BackgroundPotential of artificial intelligence in injury prevention research and practice
Quistberg, D. A. (2024) · Injury Prevention · doi:10.1136/ip-2023-045203 · Cited by 8
“48 50–52 53–58 In conclusion, AI via deep learning has the potential to improve our efforts as injury prevention researchers, practitioners and policy-makers by improving efficiency in data collection and analysis, as well as increasing our reach and many other uses not described here.”
BackgroundTest-Driven Ethics for Machine Learning
Berente, N., Kormylo, C., & Rosenkranz, C. (2024) · Communications of the ACM · doi:10.1145/3633455 · Cited by 11
“14 There are approaches for generating deliberative discourse around datasets used in practice (for example, Gebru et al. 3 ).”
MethodEmploying Hybrid AI Systems to Trace and Document Bias in ML Pipelines
Russo, M., Chudasama, Y., Purohit, D., Sawischa, S. F., & Vidal, M.-E. (2024) · IEEE Access · doi:10.1109/access.2024.3427388 · Cited by 11
“Existing methods for the production of documentation and benchmarks for datasets and ML models, such as [12], [18], [19], and [20], propose value-sensitive, human-readable documentation frameworks, while the works of [21] and [22], propose domain-specific and task-oriented, respectively, for…”
BackgroundMethodInfluentialSoftware Systems Compliance with the AI Act: Lessons Learned from an International Challenge
Scantamburlo, T., Falcarin, P., Veneri, A., Fabris, A., Gallese, C., Billa, V., Rotolo, F., & Marcuzzi, F. (2024) · doi:10.1145/3643691.3648589 · Cited by 14
The Role of Paradata in Algorithmic Accountability
Trace, C. B., & Hodges, J. A. (2024) · Knowledge management and organizational learning · doi:10.1007/978-3-031-53946-6_11 · Cited by 8
Metadata
- Authors
- Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K.
- Affiliations
- DAIR Institute (US)
- University of Washington (US)
- Cornell University (US)
- Microsoft Research New York City (United States) (US)
- University of Maryland, College Park, MD
- University of Southern California (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2021-11-19
- Volume
- 64
- Issue
- 12
- Pages
- 86-92
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2795038878
- Semantic Scholar
- 0df347f5e3118fac7c351917e3a497899b071d1e
- Cited by
- 2,469
- References
- 37
- Citations by year
- 2026: 788 · 2025: 402 · 2024: 298 · 2023: 379 · 2022: 221 · 2021: 217
- FWCI
- 252.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- Alfred P. Sloan Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- dataset documentation, data provenance, data sharing, data reuse, metadata
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.