Datasheets for datasets
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
Documentation to facilitate communication between dataset creators and consumers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Paradata needs may include the preservation of novel forms of information, such as datasheets explaining training datasets or model cards documenting an AI tool, and of these documents' relation to archival collections processed using them [ 26 ].”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Significant critiques of LLMs have been raised, including concerns about bias and fairness, misinformation, opaqueness due to a lack of interpretability and explainability, and environmental impact (Bender et al., 2021; Gebru et al., 2021; Strubell et al., 2019).”
From Using ChatGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments (2023) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ML driven algorithms are considered as epistemic resources that help us to improve understanding and/or make better predictions, then the statistical nature of ML de facto prevents groups underrepresented in the data from contributing to this epistemic resource on an equal ground to dominant groups (Gebru et al., 2021)”
From Algorithmic profiling as a source of hermeneutical injustice (2025) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The authors found that providing examples of what the requirements can look like helps to guide practitioners in clarifying their own rules.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“I show how archival theories have been animated in documenting data in the context of AI and ML, including through documentation frameworks like Datasheets for Datasets”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Gebru et al. 2021
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
(2018) · Cited by 3,510
Self-citationA sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Researchers at Google published follow-up work on model cards that document machine learning models [20] and released a data card (a lightweight version of a datasheet) along with the Open Images dataset [17].”
BackgroundSelf-citationMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 2×
“Of particular concern are recent examples showing that machine learning models can reproduce or amplify unwanted societal biases reflected in training data [4, 5, 9].”
BackgroundThe Effects of Automobile Safety Regulation
Peltzman, S. (1975) · Journal of Political Economy · doi:10.1086/260352 · Cited by 1,531
The Recent Past and Near Future of Risk and/or Need Assessment
Andrews, D. A., Bonta, J., & Wormith, J. S. (2006) · Crime & Delinquency · doi:10.1177/0011128705281756 · Cited by 1,507 · cited 1×
“Domains such as criminal justice (Garvie et al., 2016; Systems, 2017; Andrews et al., 2006), hiring and employment (Mann & O’Neil, 2016), critical infrastructure (O’Connor, 2017; Chui, 2017), and finance (Lin, 2012) all increasingly depend on machine learning methods.”
Background
Research works printed but not linked: 7
- Chui, G. Project will use AI to prevent or minimize electric grid failures, 2017.
- Garvie, C., Bedoya, A., and Frankle, J. The Perpetual Line-Up: Unregulated Police Face Recognition in America. Georgetown Law, Center on Privacy & Technology, Washington, D.C., 2016.
- Holstein, K., Vaughan, J., Daumé, H, Dudík, M., and Wallach, H. Improving fairness in machine learning systems: What do industry practitioners need? In Proceedings of 2019 ACM CHI Conf. on Human Factors in Computing Systems.
- Krasin, I. et al. OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017.
- O'Connor, M. How AI Could Smarten Up Our Water System, 2017.
- Doha Supply Systems. Facial Recognition, 2017.
- Yagcioglu, S., Erdem, A., Erdem, E., and Ikizler-Cinbis, N. RecipeQA: A challenge dataset for multimodal comprehension of cooking recipes. In Proceedings of the 2018 Conf. on Empirical Methods in Natural Language Processing.
Cited by
Items 501–600 of 1,039
Kraft, A., & Soulier, E. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658981 · Cited by 25
“Besides aforementioned efforts to facilitate more diverse contribution, we also need transparent documentation practices that allow scrutiny of knowledge bases and their original knowers [7, 27].”
BackgroundSystematic analysis of 32,111 AI model cards characterizes documentation practice in AI
Liang, W., Rajani, N. F., Yang, X., Ozoani, E., Wu, E., Chen, Y. T., Smith, D. S., & Zou, J. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00857-z · Cited by 100
“Model cards, inspired by the concept of food nutrition labels 17 and datasheets 18 in the electronics industry, have emerged as the standard approach to document AI models 7,19 .”
Artificial intelligence enhances food testing process: A comprehensive review
Ding, H., Xie, Z., Yu, W., Cui, X., & Wilson, D. I. (2025) · Food Bioscience · doi:10.1016/j.fbio.2025.106404 · Cited by 31
Afzal, S., Rajmohan, C., Kesarwani, M., Mehta, S., & Patel, H. (2021) · IEEE International Conference on Smart Data Services (SMDS) · doi:10.1109/smds53860.2021.00016 · Cited by 50
The Machine Learning Life Cycle in Chemical Operations – Status and Open Challenges
Gärtler, M., Khaydarov, V., Klöpper, B., & Urbas, L. (2021) · Chemie Ingenieur Technik · doi:10.1002/cite.202100134 · Cited by 32
Responsible Data Integration: Next-generation Challenges
Nargesian, F., Asudeh, A., & Jagadish, H. V. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3522567 · Cited by 45
“countability and facilitate reproducibility [26].”
Seeing without Looking: Analysis Pipeline for Child Sexual Abuse Datasets
Laranjeira, C., Macedo, J., Avila, S., & Santos, J. D. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3534636 · Cited by 54
What People Think AI Should Infer From Faces
Engelmann, S., Ullstein, C., Papakyriakopoulos, O., & Großklags, J. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533080 · Cited by 35
“…science (broadly speaking) highlights challenges re-lated to accountability and transparency gaps resulting from the near-unbounded power of computer vision AI companies and AI research institutes (i.e, requesters) to determine the interpretative potential of visual content [33, 68–70, 85, 87].”
D’Arcy, A., & Bender, E. M. (2022) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-031120-015324 · Cited by 43
Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AI
Zając, H. D., Avlona, N.-R., Kensing, F., Andersen, T. O., & Shklovski, I. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604766 · Cited by 49
“Some of these tools [17, 20, 31] include a query for the origin of the labels, but most do not pay much attention to the pre-labelling activities involved in annotation schema creation.”
BackgroundMethodOlsen, H. P., Hildebrandt, T., Wiesener, C., Larsen, M. S., & Flügge, A. W. A. (2023) · Digital Government Research and Practice · doi:10.1145/3632753 · Cited by 53
“First steps have been taken towards providing standards for documenting machine-learning datasets [ 31 ] and AI algorithms [ 32 ].”
MethodWatkins, E. A., & Chen, J. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658938 · Cited by 25
Towards a Responsible AI Metrics Catalogue: A Collection of Metrics for AI Accountability
Xia, B., Lu, Q., Zhu, L., Lee, S. U., Liu, Y., & Xing, Z. (2024) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3644815.3644959 · Cited by 74
“This aspect of design is indispensable for continuous operation, effective problem detection, and the rectification of errors or system failures, safeguarding against potential disruptions and upholding the integrity of AI systems.”
BackgroundA Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions
Urbanek, J., Bordes, F., Astolfi, P., Williamson, M., Sharma, V., & Romero, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02521 · Cited by 131
Studying Up Machine Learning Data: Why Talk About Bias When We Mean Power?Preprint
Miceli, M., Posada, J., & Yang, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08131 · Cited by 25
“In line with previous research [38, 59, 63], we argue that documentation frameworks should be grounded on the needs of workers, be integrated into existing workflows and organizational infrastructure, and have the flexibility to accommodate specific work scenarios.”
BackgroundData Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
The quiet transformation of higher education in the AI era
Sejdiu, N. P., & Sejdiu, S. (2025) · Open Research Europe · doi:10.12688/openreseurope.20715.1 · Cited by 35
Managing Bias When Library Collections Become Data
Coleman, C. (2020) · International Journal of Librarianship · doi:10.23974/ijol.2020.vol5.1.162 · Cited by 32
Jinhua, T., Xie, H., Hu, S., & Liu, J. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.620281 · Cited by 25
Reliability Testing for Natural Language Processing Systems
Tan, S., Joty, S., Baxter, K., Taeihagh, A., Bennett, G. A., & Kan, M. (2021) · doi:10.18653/v1/2021.acl-long.321 · Cited by 49
“Research is also emerging on best practices for productizing ML: from detailed dataset documentation (Bender and Friedman, 2018; Gebru et al., 2018), model”
BackgroundMethodTheory-Grounded Measurement of U.S. Social Stereotypes in English Language Models
Cao, Y., Sotnikova, A., Daumé III, H., Rudinger, R., & Zou, L. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.92 · Cited by 24
Schoene, A. M., Bojanić, L., Nghiem, M.-Q., Hunt, I. M., & Ananiadou, S. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3221683 · Cited by 32
“We utilise the ‘Datasheets for datasets’ framework [31] to out-”
MethodHurdles to Artificial Intelligence Deployment: Noise in Schemas and “Gold” Labels
Abdalla, M., & Fine, B. (2023) · Radiology: Artificial Intelligence · doi:10.1148/ryai.220056 · Cited by 24
“Provide a datasheet for the schema and the dataset Gebru et al’s datasheets for datasets proposes the introduction of a standardized process for documenting dataset (30).”
BackgroundMethodInfluentialDon’t Look at the Data! How Differential Privacy Reconfigures the Practices of Data Science
Sarathy, J., Song, S., Haque, A., Schlatter, T., & Vadhan, S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580791 · Cited by 46
Overwriting Pretrained Bias with Finetuning Data
Wang, A., & Russakovsky, O. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00366 · Cited by 77
“For those creating pretrained models, responsibility needs to be taken to clearly document the data the model was trained on, as well as known biases it may have [13, 33].”
BackgroundGender Artifacts in Visual Datasets
Meister, N., Zhao, D., Wang, A., Ramaswamy, V., Fong, R., & Russakovsky, O. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00446 · Cited by 55
“One focus has been on improving transparency, including creating public datasheets and tools to guide researcher intervention [10, 26, 32].”
BackgroundCan Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML
Weerts, H., Pfisterer, F., Feurer, M., Eggensperger, K., Bergman, E., Awad, N. H., Vanschoren, J., Pechenizkiy, M., Bischl, B., & Hutter, F. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14747 · Cited by 53
“Additionally, future systems could incorporate requests for meta-data in the user interface (e.g., in the form of datasheets; Gebru et al., 2021) that help practitioners identify potential issues with their data and facilitate documentation for audits.”
BackgroundSun, Y., & Xu, C. (2026) · Journal of Knowledge Management · doi:10.1108/jkm-02-2025-0252 · Cited by 23
Corti, L., Oltmans, R., Jung, J., Balayn, A., Wijsenbeek, M. S., & Yang, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642551 · Cited by 43
“Das et al. [39] highlighted the potential benefts for pulmonologists of using an XAI system to assist in the diagnostic interpretation of pulmonary function tests.”
InfluentialWillem, T., Fritzsche, M.-C., Zimmermann, B. M., Sierawska, A. K., Breuer, S., Braun, M., Ruess, A. K., Bak, M., Schönweitz, F. B., Meier, L. J., et al. (2024) · Science and Engineering Ethics · doi:10.1007/s11948-024-00523-y · Cited by 47
“For example, in the DR-AI project, we developed workshops based on the ideas of model cards (Mitchell et al., 2019) and data sheets (Gebru et al., 2021) to facilitate structured, transdisciplinary dialogues to assess information on different aspects of trained models and databases, such as their…”
Towards a Better Understanding of Evaluating Trustworthiness in AI Systems
Kemmerzell, N., Schreiner, A., Khalid, H., Schalk, M., & Bordoli, L. (2025) · ACM Computing Surveys · doi:10.1145/3721976 · Cited by 45
“Various approaches have been proposed for documentation, such as model cards that provide essential information about the model’s performance and limitations [174] and datasheets for datasets that describe the dataset’s content, collection process, and intended use [82].”
Software documentation is not enough! Requirements for the documentation of AI
Königstorfer, F., & Thalmann, S. (2021) · Digital Policy Regulation and Governance · doi:10.1108/dprg-03-2021-0047 · Cited by 35
Gevaert, C. M., & Belgiu, M. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.103054 · Cited by 25
Sharma, T., Stangl, A., Zhang, L., Tseng, Y.-Y., Xu, I., Findlater, L., Gurari, D., & Wang, Y. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580922 · Cited by 23
“In response, recent work increasingly has afrmed the importance of conscientious data stewardship practices [17, 26, 46, 74] and proposed recommendations for ethical dataset creation in a number of aspects, including: (1) analyzing taxonomies that a dataset is based on to examine potential dataset…”
BackgroundInfluentialPistilli, G., Ferrandis, C. M., Jernite, Y., & Mitchell, M. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594002 · Cited by 36
I beg to differ: how disagreement is handled in the annotation of legal machine learning data sets
Braun, D. (2023) · Artificial Intelligence and Law · doi:10.1007/s10506-023-09369-4 · Cited by 34
“Although, a number of different schemata have emerged for the description of data sets, e.g. from Gebru et al. (2021) and Holland et al. (2020), only one of the analysed data sets followed such a schema to provide a structured representation of the data set introduced.”
Heuristics for Supporting Cooperative Dashboard Design
Setlur, V., Correll, M., Satyanarayan, A., & Tory, M. K. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327158 · Cited by 42
“Or, as Gebru et al. [33], a “datasheet” or important context and metadata could be provided to a user prior to any analysis.”
BackgroundMultiBench: Multiscale Benchmarks for Multimodal Representation Learning
Liang, P. P., Lyu, Y., Fan, X., Wu, Z., Cheng, Y., Wu, J., Chen, L., Wu, P., Lee, M. A., Zhu, Y., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.07502 · Cited by 85
Stark, T., Wurm, M., Zhu, X. X., & Taubenböck, H. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3359636 · Cited by 22
“Quality datasets, free from biases and errors, are essential for creating algorithms that are generalizable and trustworthy for decision-making processes [4], [5], [6].”
BackgroundData Authenticity, Consent, and Provenance for AI Are All Broken: What Will It Take to Fix Them?
Longpre, S., Mahari, R., Obeng-Marnu, N., Brannon, W., South, T., Kabbara, J., & Pentland, A. (2024) · doi:10.21428/e4baedd9.a650f77d · Cited by 40
Golpayegani, D., Hupont, I., Panigutti, C., Pandit, H. J., Schade, S., O’Sullivan, D., & Lewis, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-68024-3_3 · Cited by 57
Toward open science in marketing research
Deer, L., Adler, S. J., Datta, H., Mizik, N., & Sarstedt, M. (2024) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2024.12.005 · Cited by 28
Butcher, B., Huang, V., Robinson, C., Reffin, J., Sgaier, S. K., Charles, G., & Quadrianto, N. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.612551 · Cited by 25
“…given dataset with a full description of the data, its collection context, operating characteristics (i.e., the characteristics of the data to which a machine learning algorithms is applied), and test results (i.e., the expected performance of the machine learning algorithm) (Gebru et al., 2018).”
Pfohl, S. R., Zhang, H., Xu, Y., Foryciarz, A., Ghassemi, M., & Shah, N. H. (2022) · Scientific Reports · doi:10.1038/s41598-022-07167-7 · Cited by 43
“[17] Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III, and Kate Crawford.”
BackgroundStammbach, D., Antoniak, M., & Ash, E. (2022) · doi:10.18653/v1/2022.wnu-1.6 · Cited by 74
Stix, C. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00041-5 · Cited by 39
“…the following concerns have deeply impacted various groups in recent times: algorithmic bias [6, 8, 18],transparency and explainability [26, 40],the safety of autonomous vehicles [5, 69], privacy concerns in the face of widespread surveillance [14, 39], and the economic and political…”
BackgroundNew Vistas on Responsible Learning Analytics: A Data Feminist Perspective
Pargman, T. C., McGrath, C., Viberg, O., & Knight, S. (2023) · Journal of Learning Analytics · doi:10.18608/jla.2023.7781 · Cited by 35
Good practices for clinical data warehouse implementation: A case study in France
Doutreligne, M., Degrémont, A., Jachiet, P.-A., Lamer, A., & Tannier, X. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000298 · Cited by 35
“Open publication of data schemas is considered an indispensable prerequisite for all data science and artificial intelligence uses [58].”
BackgroundMethodThe landscape of data and AI documentation approaches in the European policy context
Micheli, M., Hupont, I., Delipetrev, B., & Soler-Garrido, J. (2023) · Ethics and Information Technology · doi:10.1007/s10676-023-09725-7 · Cited by 42
“…keyword search, we based our review on a cluster of six highly influential papers, namely: Datasheets for datasets (first published in 2018) (Gebru et al., 2021), Data statements for Natural Language Processing (NLP) (Bender & Fried-man,2018), Thedatasetnutritionlabel (Hollandetal.,2018),…”
BackgroundMethodInfluentialShow Your Work: Improved Reporting of Experimental Results
Dodge, J., Gururangan, S., Card, D., Schwartz, R., & Smith, N. A. (2019) · arXiv · doi:10.48550/arxiv.1909.03004 · Cited by 22
“Similar to other calls for improved reporting in machine learning (Mitchell et al., 2019; Gebru et al., 2018), we recommend pairing experimental results with the information from this checklist in a structured format (see examples provided in Appendix A).”
MethodORES: Lowering Barriers with Participatory Machine Learning in WikipediaPreprint
Halfaker, A., & Geiger, R. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05189 · Cited by 22
“Given such issues, many have called for public policy solutions, such as requiring public sector ML systems to have source code and training data released, or at least a structured transparency report (e.g. [31, 75]).”
Data Statements: From Technical Concept to Community Practice
McMillan-Major, A., Bender, E. M., & Friedman, B. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3594737 · Cited by 21
“Of the documentation toolkits described in Section 2.1, datasheets for datasets [13] (we used v7 of the paper on arXiv [15]) is the most similar to data statements.”
MethodInfluentialChassanoff, A., & Altman, M. (2019) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24244 · Cited by 21
Losing Confidence in Quality: Unspoken Evolution of Computer Vision Services
Cummaudo, A., Vasa, R., Grundy, J., Abdelrazek, M., & Cain, A. (2019) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2019.00051 · Cited by 25
“Early work into model cards and datasheets [36, 37] suggests more can be done to document attributes about ML systems, however at a minimum from our work, we recommend including a reference point via the form of an additional identifier.”
Backgroundvan Miltenburg, E., van der Lee, C., & Krahmer, E. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.51 · Cited by 55
Adaptive Sampling Strategies to Construct Equitable Training Datasets
Cai, W., Encarnación, R., Chern, B., Corbett‐Davies, S., Bogen, M., Bergman, S., & Goel, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533203 · Cited by 43
Ethical Chatbot Design for Reducing Negative Effects of Biased Data and Unethical Conversations
Bang, J., Kim, S., Nam, J. W., & Yang, D.-G. (2021) · 2021 International Conference on Platform Technology and Service (PlatCon) · doi:10.1109/platcon53246.2021.9680760 · Cited by 21
From compute to care: Lessons learned from deploying an early warning system into clinical practice
Pou-Prom, C., Murray, J., Kuzulugil, S. S., Mamdani, M., & Verma, A. A. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.932123 · Cited by 26
“Recent work has looked at assessing the quality of the data that goes into model through the creation of “ Datasheets for Datasets ” (8).”
BackgroundFairness Without Demographic Data: A Survey of Approaches
Ashurst, C., & Weller, A. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623234 · Cited by 21
“Mechanisms to improve documentation and transparency (e.g. datasheets [47] and model cards [90]) can be a starting point for uncovering issues.”
BackgroundA survey of energy concerns for software engineering
Lee, S. U., Fernando, N., Lee, K., & Schneider, J.-G. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111944 · Cited by 37
(2021) · arXiv (Cornell University) · Cited by 21
An archival perspective on pretraining data
Desai, M. A., Pasquetto, I. V., Jacobs, A. Z., & Card, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100966 · Cited by 35
“109 Even when the data itself cannot be shared, documenting and reporting on such decisions can be valuable, for example in helping those who use LLMs understand the limitations of these models (see, e.g., Davidson and Freire, 110 Gebru et al., 111 and Hills et al. 112 ).”
BackgroundArtificial Intelligence–Assisted Speech Therapy for /ɹ/: A Single-Case Experimental Study
Benway, N. R., & Preston, J. L. (2024) · American Journal of Speech-Language Pathology · doi:10.1044/2024_ajslp-23-00448 · Cited by 33
“…learning models (Kapoor & Narayanan, 2022; Mitchell et al., 2019), and datasheets , which document the data that the model were trained upon (Gebru et al., 2018), were published by Benway, Preston, Hitchcock, et al. (2023) and Benway et al. Overall, the PERCEPT-R Classifier represents one…”
Kuehnert, B., Kim, R., Forlizzi, J., & Heidari, H. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732191 · Cited by 47
“Among those that were validated, validation methods include a hypothetical case study [e.g. 29, 88, 131], testing code [e.g. 46, 113, 127], or a real-world pilot [e.g. 12, 49, 60].”
Rideshare Transparency: Translating Gig Worker Insights on AI Platform Design to Policy
Rao, V. N., Dalal, S., Agarwal, E., Calacci, D., & Monroy‐Hernández, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711059 · Cited by 39
“Meanwhile, for AI models, datasheets[41], model cards[70], and transparency indices[11] have been proposed, though no legal mandates exist yet aside from draft provisions in regulations like the EU AI Act and US AI Foundation Model Transparency Act.”
Atreja, S., Ashkinaze, J., Li, L., Mendelsohn, J., & Hemphill, L. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35807 · Cited by 80
Artificial Intelligence in Endurance Sports: Metabolic, Recovery, and Nutritional Perspectives
Grivas, G. V., & Safari, K. (2025) · Nutrients · doi:10.3390/nu17203209 · Cited by 34
“Bias can also be introduced during data selection, labeling, and preprocessing, especially when most data come from high-performance environments thereby reproducing existing inequalities in access to sports science and technology [86,87].”
The AI-policy-governance nexus: How regulation and AI shift corporate governance toward stakeholders
Cordeiro, C. M., Adomaitis, L., & Huang, L. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.103117 · Cited by 37
Bias in AI systems: integrating formal and socio-technical approaches
Ahmad, A., Vallès, Y., & Idaghdour, Y. (2026) · Frontiers in Big Data · doi:10.3389/fdata.2025.1686452 · Cited by 33
Barclay, I., Taylor, H., Preece, A. D., Taylor, I., Verma, D. C., & de Mel, G. R. (2020) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6129 · Cited by 20
“Highlighting the intended use cases for a model and quantifying the limitations and biases in the model as it is used outside of its design constraints brings potential benefit to a number of different stakeholders.”
BackgroundMethodExploring the experience of ethical tensions and the role of community in UX practice
Pillai, A. G., Sachathep, T., & Ahmadpour, N. (2022) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3546155.3546683 · Cited by 23
From Invisible to Visible: Impacts of Metadata in Communicative Data Visualization
Burns, A., Lee, C., On, T., Xiong, C., Peck, E. M., & Mahyar, N. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3231716 · Cited by 29
“This practice has also been argued to be beneficial for prospective users by helping them interpret data [18], judge whether it is appropriate to apply a dataset to a problem [25], and determine what kinds of conclusions can be responsibly inferred from data [26].”
BackgroundIntegrating Fairness in the Software Design Process: An Interview Study With HCI and ML Experts
Ryan, S., Nadal, C., & Doherty, G. J. (2023) · IEEE Access · doi:10.1109/access.2023.3260639 · Cited by 32
Lyons, J. B., Hobbs, K. L., Rogers, S. C., & Clouse, H. S. (2023) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2023.1201777 · Cited by 28
“, and the recommended uses of the dataset (Gebru et al., 2021).”
BackgroundInfluentialParticipant flow diagrams for health equity in AI
Ellen, J., de Matos, J. C. R. G., Viola, M., Gallifant, J., Quion, J., Celi, L. A., & Hussein, N. S. A. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104631 · Cited by 23
End-to-end reproducible AI pipelines in radiology using the cloud
Bontempi, D., Nürnberg, L., Pai, S., Krishnaswamy, D., Thiriveedhi, V., Hosny, A., Mak, R. H., Farahani, K., Kikinis, R., Fedorov, A., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-51202-2 · Cited by 31
Language Tasks and Language Games: On Methodology in Current Natural Language Processing ResearchPreprint
Schlangen, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.10747 · Cited by 31
“The recent initiative of formulating “Data Sheets” (Gebru et al., 2018), although developed for different purposes, would be a good step also in this direction.”
BackgroundThe Sanction of Authority: Promoting Public Trust in AIPreprint
Knowles, B., & Richards, J. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04221 · Cited by 20
“…related to the safety and performance testing an AI has undergone [3, 22], performance characteristics and intended use cases of algorithms [37, 42] and details of algorithms’ training datasets [6, 15, 23] that are relevant to determining the contexts within which the AI can be responsibly applied.”
BackgroundGenovesi, S., Mönig, J. M., Schmitz, A., Poretschkin, M., Akila, M., Kahdan, M., Kleiner, R., Krieger, L., & Zimmermann, A. (2024) · AI and Ethics · doi:10.1007/s43681-023-00291-8 · Cited by 19
“In addition to algorithmic methods, documentation guidelines have been developed to support adherence to good standards, e.g., in data selection [36].”
Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia
Kuo, T.-S., Halfaker, A., Cheng, Z., Kim, J., Wu, M.-H., Wu, T., Holstein, K., & Zhu, H. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642278 · Cited by 54
“In addition to the table, the campaign page serves as a living datasheet [36] that provides comprehensive information about the data curation campaign, such as label defnitions and data statements, as outlined in Figure 7 on the left.”
BackgroundHaghish, E. F., Czajkowski, N. O., Walby, F. A., Qin, P., & Laeng, B. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.03.133 · Cited by 23
Documenting Ethical Considerations in Open Source AI Models
Gao, H., Zahedi, M., Treude, C., Rosenstock, S., & Cheong, M. (2024) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/3674805.3686679 · Cited by 33
Galanty, M., Luitse, D. M. R., Noteboom, S. H., Croon, P. M., Vlaar, A. P. J., Poell, T., Sánchez, C. I., Blanke, T., & Išgum, I. (2024) · Scientific Reports · doi:10.1038/s41598-024-83218-5 · Cited by 26
“This tool specifically draws from existing dataset documentation tools and guidelines, including Datasheets for Datasets 15 , BIAS 18 , and the Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) checklist 10 .”
InfluentialThe Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 21
Mohammad, S. M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.573 · Cited by 53
Making Online Communities ‘Better’: A Taxonomy of Community Values on Reddit
Weld, G., Zhang, A. X., & Althoff, T. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31413 · Cited by 70
Aligning to Social Norms and Values in Interactive Narratives
Ammanabrolu, P., Jiang, L., Sap, M., Hajishirzi, H., & Choi, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.439 · Cited by 53
Introducing contextual transparency for automated decision systems
Sloane, M., Solano-Kamaiko, I. R., Yuan, J., Dasgupta, A., & Stoyanovich, J. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00623-7 · Cited by 22
“To ensure scalability of transparency while accounting for the flow of data as well as shifting contexts 67 we suggest that this label be automatically generated rather than hand-drawn 68 , building on respective approaches that have been proposed for privacy labels 69,70 .”
BackgroundSrivastava, S., & Sinha, K. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.49990 · Cited by 26
Showkat, D., Smith, A. D. R., Wang, L., & To, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581010 · Cited by 30
Reclaiming the Digital Commons: A Public Data Trust for Training Data
Chan, A., Bradley, H., & Rajkumar, N. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604658 · Cited by 43
Warden, P., Stewart, M. P., Plancher, B., Katti, S., & Reddi, V. J. (2023) · Communications of the ACM · doi:10.1145/3586991 · Cited by 35
Temple, S., & Rowbottom, C. G. (2024) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.14273 · Cited by 18
“More specifically, datasheets containing comprehensive information about the dataset used to produce a DL model should be provided, 36 and such information could be used by healthcare professionals to guide the limits of clinical use and to devise appropriately targeted quality assurance methods.”
MethodBLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologies
Pang, R. Y., Santy, S., Just, R., & Reinecke, K. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642054 · Cited by 30
“Additionally, there are calls for researchers within different computing communities to accurately report the design considerations of their datasets [9, 38], models [67, 89], and tasks [56, 68] as well as evaluate and de-bias their products [4, 8, 104, 111].”
BackgroundConstantinides, M., Tahaei, M., Quercia, D., Stumpf, S., Madaio, M., Kennedy, S., Wilcox, L. G., Vitak, J., Cramer, H. S. M., Bogucka, E. P., et al. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3643979 · Cited by 32
“For example, tools and frameworks have been proposed to assist developers in mitigating biases [9, 17], explaining algorithmic decisions [5], and ensuring privacy-preserving AI systems [14].”
Fair Allocation through Selective Information Acquisition
Cai, W., Gaebler, J., Garg, N., & Goel, S. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375823 · Cited by 42
Towards Generating Consumer Labels for Machine Learning Models
Seifert, C., Scherzinger, S., & Wiese, L. (2019) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi48466.2019.00033 · Cited by 31
“based on Data Sheets [2]) and integrated in a consumer label.”
BackgroundMethodInfluentialHapticGen: Generative Text-to-Vibration Model for Streamlining Haptic Design
Sung, Y., John, K., Yoon, S. H., & Seifi, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713609 · Cited by 35
In the Picture: Medical Imaging Datasets, Artifacts, and their Living Review
Jiménez-Sánchez, A., Avlona, N.-R., de Boer, S., Campello, V. M., Feragen, A., Ferrante, E., Ganz, M., Gichoya, J. W., González, C., Groefsema, S., et al. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732035 · Cited by 36
“For example, the CheXpert dataset [76] was initially published without the recommended datasheet [49].”
Fair human-centric image dataset for ethical AI benchmarking
Xiang, A., Andrews, J. T. A., Bourke, R. L., Thong, W. E., LaChance, J., Georgievski, T., Modas, A., Rahmattalabbi, A., Ba, Y., Nagpal, S., et al. (2025) · Nature · doi:10.1038/s41586-025-09716-2 · Cited by 34
“In developing FHIBE, we sought to implement best practices for ethical data collection recommended in the literature 2,3,44 .”
Metadata
- Authors
- Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K.
- Affiliations
- DAIR Institute (US)
- University of Washington (US)
- Cornell University (US)
- Microsoft Research New York City (United States) (US)
- University of Maryland, College Park, MD
- University of Southern California (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2021-11-19
- Volume
- 64
- Issue
- 12
- Pages
- 86-92
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2795038878
- Semantic Scholar
- 0df347f5e3118fac7c351917e3a497899b071d1e
- Cited by
- 2,469
- References
- 37
- Citations by year
- 2026: 788 · 2025: 402 · 2024: 298 · 2023: 379 · 2022: 221 · 2021: 217
- FWCI
- 252.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- Alfred P. Sloan Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- dataset documentation, data provenance, data sharing, data reuse, metadata
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.