Datasheets for datasets
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
Documentation to facilitate communication between dataset creators and consumers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Paradata needs may include the preservation of novel forms of information, such as datasheets explaining training datasets or model cards documenting an AI tool, and of these documents' relation to archival collections processed using them [ 26 ].”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Significant critiques of LLMs have been raised, including concerns about bias and fairness, misinformation, opaqueness due to a lack of interpretability and explainability, and environmental impact (Bender et al., 2021; Gebru et al., 2021; Strubell et al., 2019).”
From Using ChatGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments (2023) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ML driven algorithms are considered as epistemic resources that help us to improve understanding and/or make better predictions, then the statistical nature of ML de facto prevents groups underrepresented in the data from contributing to this epistemic resource on an equal ground to dominant groups (Gebru et al., 2021)”
From Algorithmic profiling as a source of hermeneutical injustice (2025) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The authors found that providing examples of what the requirements can look like helps to guide practitioners in clarifying their own rules.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“I show how archival theories have been animated in documenting data in the context of AI and ML, including through documentation frameworks like Datasheets for Datasets”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Gebru et al. 2021
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
(2018) · Cited by 3,510
Self-citationA sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Researchers at Google published follow-up work on model cards that document machine learning models [20] and released a data card (a lightweight version of a datasheet) along with the Open Images dataset [17].”
BackgroundSelf-citationMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 2×
“Of particular concern are recent examples showing that machine learning models can reproduce or amplify unwanted societal biases reflected in training data [4, 5, 9].”
BackgroundThe Effects of Automobile Safety Regulation
Peltzman, S. (1975) · Journal of Political Economy · doi:10.1086/260352 · Cited by 1,531
The Recent Past and Near Future of Risk and/or Need Assessment
Andrews, D. A., Bonta, J., & Wormith, J. S. (2006) · Crime & Delinquency · doi:10.1177/0011128705281756 · Cited by 1,507 · cited 1×
“Domains such as criminal justice (Garvie et al., 2016; Systems, 2017; Andrews et al., 2006), hiring and employment (Mann & O’Neil, 2016), critical infrastructure (O’Connor, 2017; Chui, 2017), and finance (Lin, 2012) all increasingly depend on machine learning methods.”
Background
Research works printed but not linked: 7
- Chui, G. Project will use AI to prevent or minimize electric grid failures, 2017.
- Garvie, C., Bedoya, A., and Frankle, J. The Perpetual Line-Up: Unregulated Police Face Recognition in America. Georgetown Law, Center on Privacy & Technology, Washington, D.C., 2016.
- Holstein, K., Vaughan, J., Daumé, H, Dudík, M., and Wallach, H. Improving fairness in machine learning systems: What do industry practitioners need? In Proceedings of 2019 ACM CHI Conf. on Human Factors in Computing Systems.
- Krasin, I. et al. OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017.
- O'Connor, M. How AI Could Smarten Up Our Water System, 2017.
- Doha Supply Systems. Facial Recognition, 2017.
- Yagcioglu, S., Erdem, A., Erdem, E., and Ikizler-Cinbis, N. RecipeQA: A challenge dataset for multimodal comprehension of cooking recipes. In Proceedings of the 2018 Conf. on Empirical Methods in Natural Language Processing.
Cited by
Items 601–700 of 1,039
Applications of Artificial Intelligence in Fisheries: From Data to Decisions
Haque, S. A., & Jufaili, S. M. A. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10010019 · Cited by 18
Benchmarking Machine Reading Comprehension: A Psychological Perspective
Sugawara, S., Stenetorp, P., & Aizawa, A. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.137 · Cited by 29
“The rubric is in a similar motivation with dataset statements (Bender and Friedman, 2018; Gebru et al., 2018); however, taking the validity aspects into account would improve its substance.”
MethodBarclay, I., Preece, A. D., Taylor, I., Radha, S. K., & Nabrzyski, J. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6997 · Cited by 24
DescribeML: a tool for describing machine learning datasets
Giner-Miguelez, J., Gómez, A., & Cabot, J. (2022) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C) · doi:10.1145/3550356.3559087 · Cited by 30
AI Accountability: Approaches, Affecting Factors, and Challenges
Raja, A. K., & Zhou, J. J. (2023) · Computer · doi:10.1109/mc.2023.3238390 · Cited by 35
Assessing Outcomes in Stratospheric Aerosol Injection Scenarios Shortly After Deployment
Hueholt, D. M., Barnes, E. A., Hurrell, J. W., Richter, J. H., & Sun, L. (2023) · Earth s Future · doi:10.1029/2023ef003488 · Cited by 20
Challenges of a Data Ecosystem for scientific data
Ramalli, E., & Pernici, B. (2023) · Data & Knowledge Engineering · doi:10.1016/j.datak.2023.102236 · Cited by 25
The Potential of a Visual Dialogue Agent In a Tandem Automated Audio Description System for Videos
Stangl, A. J., Ihorn, S. M., Siu, Y.-T., Bodi, A., Castanon, M., Narins, L. D., & Yoon, I. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3608402 · Cited by 31
An intentional approach to managing bias in general purpose embedding models
Weng, W., Sellergen, A., Kiraly, A. P., D’Amour, A., Park, J., Pilgrim, R., Pfohl, S., Lau, C. T., Natarajan, V., Azizi, S., et al. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00227-3 · Cited by 29
Nair, V. C., Guo, W., Wang, R., O’Brien, J. F., Rosenberg, L. B., & Song, D. X. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3372087 · Cited by 33
“Documentation for our dataset is offered according to widely-recognized open standards, including Datasheets for Datasets [12] and Dataset Nutrition Labels [14].”
MethodInfluentialHow to Regulate Large Language Models for Responsible AI
Berengueres, J. O. L. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3403681 · Cited by 30
“However, ML training datasets are often collected with little curation or supervision and without factoring in perspectives from communities who may be underrepresented [61]... ” [62].”
BackgroundChanging Lanes Toward Open Science: Openness and Transparency in Automotive User Research
Ebel, P., Bazilinskyy, P., Colley, M., Goodridge, C. M., Höck, P., Janssen, C. P., Sandhaus, H., Srinivasan, A. R., & Wintersberger, P. (2024) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3640792.3675730 · Cited by 25
Stroud, A. M., Anzabi, M. D., Wise, J. L., Barry, B. A., Malik, M. M., McGowan, M. L., & Sharp, R. R. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.100189 · Cited by 27
“8,9 Public alarm over AI has mounted because of the potential risks these technologies pose to society, ranging from more fantastical and ideo-logical claims of arti fi cial superintelligence 10 to more relevant considerations of enabling coercive and exploitative labor practices.”
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 22
Identifying Bias in AI using SimulationPreprint
McDuff, D., Cheng, R., & Kapoor, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00471 · Cited by 31
Dulhanty, C., & Wong, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01347 · Cited by 47
“Datasheets for Datasets , proposed by Gebru et al. [10], calls for a standardized method of disclosing this information such that transparency and accountability are prioritized from the start of a machine learning project.”
MethodA Total Error Framework for Digital Traces of HumansPreprint
Sen, I., Flöck, F., Weller, K., Weiß, B., & Wagner, C. (2019) · arXiv (Cornell University) · Cited by 26
Question-Driven Design Process for Explainable AI User Experiences
Liao, Q. V., Pribić, M., Han, J., Miller, S., & Sow, D. (2021) · arXiv · doi:10.48550/arxiv.2104.03483 · Cited by 18
“The corresponding links (FactsSheets [6], Model Cards [2] and Datasheets [27]) provide exemplars of industry standards for model documentation.”
Mind The Gap: Designers and Standards on Algorithmic System Transparency for Users
Schor, B. G. S., Norval, C., Charlesworth, E., & Singh, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642531 · Cited by 17
“Prominent mechanisms include datasheets for datasets [24], model cards [50] and fact sheets [67], which provide information about the models employed.”
Stangl, A., Sadjo, E., Emami-Naeini, P., Wang, Y., Gurari, D., & Findlater, L. (2023) · 20th International Web for All Conference · doi:10.1145/3587281.3587296 · Cited by 15
“This is akin to datasheets for datasets [45] but would be available to individual users and for single images/videos.”
BackgroundWhat is research data “misuse”? And how can it be prevented or mitigated?
Pasquetto, I. V., Cullen, Z., Thomer, A. K., & Wofford, M. F. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24944 · Cited by 24
“Such cards resemble, to some extent, Bender et al.'s idea of “ data statements ” (2018) — which they define as a characterization of a dataset that provides context to allow developers and users to better understand how experimental results might generalize, how software might be appropriately deployed, and what biase…”
InfluentialGenerative Artificial Intelligence in Marketing: The Invisible Danger of AI Hallucinations
Yaprak, B. (2024) · Journal of Economy Business and Management · doi:10.7596/jebm.1588897 · Cited by 19
Fiske, A., Blacker, S., Geneviève, L. D., Willem, T., Fritzsche, M.-C., Buyx, A., Celi, L. A., & McLennan, S. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.01.003 · Cited by 26
Balayn, A., Yurrita, M., Rancourt, F., Casati, F., & Gadiraju, U. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713787 · Cited by 50
“To share trustworthiness cues, prior research on AI transparency and documentation [46, 89] could be revisited to incorporate the breadth of trustworthiness factors relevant to the different trust relations that impact trust towards the technical artifact, instead of solely focusing on the ability…”
Detecting Fine-Grained Cross-Lingual Semantic Divergences without Supervision by Learning to Rank
Briakou, E., & Carpuat, M. J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.121 · Cited by 33
“It’s Like the Value System in the Loop”: Domain Experts’ Values Expectations for NLP Automation
Showkat, D., & Baumer, E. P. S. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533483 · Cited by 25
Nanosensor Location Estimation in the Human Circulatory System Using Machine Learning
Gómez, J. T., Kuestner, A., Simonjan, J., Unluturk, B. D., & Dressler, F. (2022) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2022.3217653 · Cited by 23
“(cid:2) Following the recomendation from [18], we provide data and documented it for the training of the machine learning model, 1 (cid:2) and results illustrating the concentration level of nanosen-sors along the vessels.”
MethodPinney, C., Raj, A., Hanna, A., & Ekstrand, M. D. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578316 · Cited by 33
Scheuerman, M. K., Weathington, K., Mugunthan, T., Denton, E., & Fiesler, C. L. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579488 · Cited by 27
“[30]) ask dataset authors to clearly document licensing details and consent processes.”
BackgroundInfluentialWe are the Data: Challenges and Opportunities for Creating Demographically Diverse Anthropographics
Dhawka, P., He, H. A., & Willett, W. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581086 · Cited by 17
Representation in AI Evaluations
Bergman, A. S., Hendricks, L. A., Rauh, M., Wú, B., Agnew, W. S., Kunesch, M., Duan, I., Gabriel, I., & Isaac, W. S. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594019 · Cited by 35
“Inthe mathematically-focused machine learning literature, one encounters related topics such as: representation theory, sampling of larger populations to match the distribution [55, 100], and representation learning and embeddings.”
BackgroundExamining How Students Code with Socioscientific Data to Tell Stories About Climate Change
Sanei, H., Kahn, J. B., Yalcinkaya, R., Jiang, S., & Wang, C. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10054-z · Cited by 22
“Another possible solution to help students better understand a given dataset, its context, and comprised variables is to employ what Gebru et al. (2021) call datasheets for datasets .”
Havrda, M., & Rakova, B. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9283137 · Cited by 27
“Prior research efforts have primarily been focused on assessment during two stages of the A/IS life-cycle [25] - (1) evaluations of the data on which the system is operating on [26], [27] and (2) evaluations of the A/IS outcomes [28].”
MethodGetting into the engine room: a blueprint to investigate the shadowy steps of AI ethics
Rochel, J., & Évéquoz, F. (2020) · AI & Society · doi:10.1007/s00146-020-01069-w · Cited by 23
“The categories which we use reflect certain presuppositions about the world and the relative importance of potential perspectives on the world (Gebru et al. 2018).”
BackgroundMachine Learning Model Cards Transparency Review : Using model card toolkit
Wadhwani, A., & Jain, P. (2020) · IEEE Pune Section International Conference (PuneCon) · doi:10.1109/punecon50868.2020.9362382 · Cited by 19
“Normalized structures have been proposed by specialists for correspondence of datasets attributes utilized in AI [2,1,3] to help clients in understanding the setting in which the datasets should be utilized.”
BackgroundBoenisch, F., Battis, V., Buchmann, N., & Poikela, M. E. (2021) · Mensch und Computer (MuC) · doi:10.1145/3473856.3473869 · Cited by 37
“These parts consist of, for example, tracking the provenance of the data (manually or automatically) [33], restricting access to the models [53],”
BackgroundAn Algorithmic Framework for Bias Bounties
Globus-Harris, I., Kearns, M. J., & Roth, A. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533172 · Cited by 43
What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus
Luccioni, A. S., & Viviano, J. D. (2021) · arXiv · doi:10.48550/arxiv.2105.02732 · Cited by 17
“…language models will likely require the community to adopt more mindful data collection practices (Gehman et al., 2020; Bender and Friedman, 2018; Gebru et al., 2018; Jo and Gebru, 2020; Paullada et al., 2020; Bender et al., 2021), establish standardized filtering pipelines for corpora (Roziewski…”
BackgroundChoCo: a Chord Corpus and a Data Transformation Workflow for Musical Harmony Knowledge Graphs
de Berardinis, J., Meroño-Peñuela, A., Poltronieri, A., & Valentina Presutti, A. (2023) · Scientific Data · doi:10.1038/s41597-023-02410-w · Cited by 17
“This organisation varies as the datasets vary – a consequence of the lack of a standard “datasheet for datasets” in the music domain 55 .”
BackgroundEthical considerations in the early detection of Alzheimer's disease using speech and AI
Petti, U., Nyrup, R., Skopek, J. M., & Korhonen, A. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594063 · Cited by 16
Chen, C., Liao, M., & Sundar, S. S. (2024) · International Symposium on Trustworthy Autonomous Systems (TAS) · doi:10.1145/3686038.3686066 · Cited by 28
Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking
Warren, G., Shklovski, I., & Augenstein, I. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713277 · Cited by 66
“— P1 , Investigative Journalist, Ukraine The demand for disclosure of training data is an ongoing debate in the AI community, with proposals such as data sheets for datasets [46] and model cards [83], creating structured ways such information could be disclosed.”
Creative Writers' Attitudes on Writing as Training Data for Large Language Models
Gero, K. I., Desai, M., Schnitzler, C., Eom, N., Cushman, J., & Glassman, E. L. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713287 · Cited by 16
“While some advocate for more attention and care to be put into data collection [32], it has been documented that incentivizing data work is difficult in research and industry communities [34, 78].”
Larsen, B. C. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462591 · Cited by 23
“For data, these include “data statements” [59], “datasheets for data sets” [60], and “nutrition labels for data sets” [61], which seek to evaluate the data that goes into a model across training, testing,”
BackgroundToward a taxonomy of trust for probabilistic machine learning
Broderick, T., Gelman, A., Meager, R., Smith, A. L., & Zheng, T. (2023) · Science Advances · doi:10.1126/sciadv.abn3999 · Cited by 25
Naja, I., Marković, M., Edwards, P. J., Pang, W., Cottrill, C., & Williams, R. A. (2022) · IEEE Access · doi:10.1109/access.2022.3188967 · Cited by 33
“2) Dataset information (D&I): characteristics of the dataset (e.g., size, composition of instances, number of features) [19], [31], [38], [39], [48], [50]; collection method [38], [40], [49]; any associated pre-processing (e.g., sampling, aggregation) [19], [38]–[40], [48]; tasks for which it…”
BackgroundMethodInfluentialContributing to Accessibility Datasets: Reflections on Sharing Study Data by Blind People
Kamikubo, R., Lee, K., & Kacorri, H. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581337 · Cited by 26
“[49] This needs to be addressed and communicated with individuals or communities who could be most affected, adopting many other guided questions related to the collection and distribution of datasets.”
BackgroundHernández, A. D., Owen, R., Nielsen, D. S., & McConville, R. (2023) · Journal of Responsible Innovation · doi:10.1080/23299460.2023.2222514 · Cited by 17
Grusky, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.107 · Cited by 50
“Improving required reporting for models (Mitchell et al., 2019), datasets (Gebru et al., 2021), and research practices (Rogers et al., 2021; Pineau et al., 2021) are necessary for identifying and preventing future research errors.”
BackgroundFairness and Bias in Robot Learning
Londoño, L., Hurtado, J. V., Hertz, N., Kellmeyer, P., Vöeneky, S., & Valada, A. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3403898 · Cited by 60
“In this direction, a previous work provides datasheets with a helpful protocol to follow when creating a dataset at the collection time [103].”
MethodA Data-Centric AI Paradigm for Socio-Industrial and Global Challenges
Majeed, A., & Hwang, S. O. (2024) · Electronics · doi:10.3390/electronics13112156 · Cited by 24
Li, J., Hu, X., Lucic, A., Wu, Y., Condotta, I. C. F. D. S., Dilger, R. N., Ahuja, N., & Green-Miller, A. R. (2024) · Journal of Integrative Agriculture · doi:10.1016/j.jia.2024.08.014 · Cited by 21
Chen, C., & Sundar, S. S. (2024) · Human-Computer Interaction · doi:10.1080/07370024.2024.2392494 · Cited by 25
Hadar‐Shoval, D., Haber, Y., Tal, A., Simon, T., Elyoseph, T., & Elyoseph, Z. (2024) · JMIR Neurotechnology · doi:10.2196/64182 · Cited by 25
“…incorporate vast datasets populated from the internet, traditional methods of addressing biases through direct data manipulation, such as the “datasheets” approach proposed by Gebru et al [39], while still valuable in certain contexts, have become more challenging to implement comprehensively.”
Masader: Metadata Sourcing for Arabic Text and Speech Data Resources
Alyafeai, Z., Masoud, M., Ghaleb, M., & Al-shaibani, M. S. (2022) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3rot2sy5uudb · Cited by 24
Method cards for prescriptive machine-learning transparency
Adkins, D., Alsallakh, B., Cheema, A., Kokhlikyan, N., McReynolds, E., Mishra, P., Procope, C., Sawruk, J., Wang, E., & Zvyagina, P. (2022) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3522664.3528600 · Cited by 29
“For example, Datasheets for Datasets [16] focus on providing key details about the datasets used to develop ML models.”
BackgroundMix & Match Machine Learning: An Ideation Toolkit to Design Machine Learning-Enabled Solutions
Jansen, A., & Colombo, S. (2023) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3569009.3572739 · Cited by 26
“Given the increasing attention to this matter, in the near future we expect dataset/model repositories to feature a label [9], datasheet [19] or model card [36] to help users evaluate them for fairness criteria.”
BackgroundA Word on Machine Ethics: A Response to Jiang et al. (2021)Preprint
Talat, Z., Blix, H., Valvoda, J., Ganesh, M. I., Cotterell, R., & Williams, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.04158 · Cited by 49
“Even with extensive tracking of annotator demographic information through data sheets (Gebru et al., 2018), it is not trivial to de-”
BackgroundDuolingo English Test Responsible AI Standards
Burstein, J. C. (2023) · doi:10.46999/vcae5025 · Cited by 36
Kelan, E. (2024) · Routledge eBooks · doi:10.4324/9781003427100 · Cited by 24
HCI and Older Adults: The Critical Turn and What Comes Next
Lazar, A., Brewer, R. N., & Knowles, B. (2025) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000094 · Cited by 20
Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models
Palla, K., Redondo-García, J. L., Hauff, C., Fabbri, F., Damianou, A., Lindström, H., Taber, D., & Lalmas, M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732054 · Cited by 82
#PraCegoVer: A Large Dataset for Image Captioning in Portuguese
dos Santos, G. O., Colombini, E. L., & Avila, S. (2022) · Data · doi:10.3390/data7020013 · Cited by 23
Chen, J., Lin, W.-C., Yang, S., Chiang, M. F., & Hribar, M. R. (2022) · Translational Vision Science & Technology · doi:10.1167/tvst.11.11.20 · Cited by 22
Steele, L., Tan, X. L., Olabi, B., Gao, J., Tanaka, R. J., & Williams, H. C. (2022) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.18814 · Cited by 17
“…as data are of such relevance to training ML models and attaining sufficient coverage of different skin phototypes and rarer skin cancers, 10,20 we sought to graphically representing the training datasets used by current ML models for skin cancer recognition, including their size,…”
The Ethics of Computational Social Science
Leslie, D. (2023) · Springer eBooks · doi:10.1007/978-3-031-16624-2_4 · Cited by 20
Fairness metrics for health AI: we have a long way to go
Mbakwe, A. B., Lourentzou, I., Celi, L. A., & Wu, J. T.-Y. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104525 · Cited by 24
Face Work: A Human-Centered Investigation into Facial Verification in Gig Work
Watkins, E. A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579485 · Cited by 21
“Recognition technologies have become a locus for identifying how such systems wield substantial disparities in their accuracy of classifying people in different groups, due to the societal biases woven into their datasets, benchmarks, confidence thresholds, and models [8,14,30,56,64,68].”
BackgroundSaliency Cards: A Framework to Characterize and Compare Saliency Methods
Boggust, A., Suresh, H., Strobelt, H., Guttag, J. V., & Satyanarayan, A. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593997 · Cited by 30
Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harms
Dennler, N. S., Ovalle, A., Singh, A., Soldaini, L., Subramonian, A., Tu, H., Agnew, W. S., Ghosh, A., Yee, K., Peradejordi, I. F., et al. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604682 · Cited by 36
“To assess AI harms, companies have used bias evaluation benchmarks [6, 21, 46], dataset and model documentation [4, 25, 42], and other auditing processes [41, 50, 51].”
MethodAI research ethics is in its infancy: the EU’s AI Act can make it a grown-up
Rességuier, A., & Ufert, F. (2023) · Research Ethics · doi:10.1177/17470161231220946 · Cited by 29
“Furthermore, this is in line with the growing recognition of the importance of documentation related to the data used to train the system and to the design choices made in building the model (Gebru et al., 2021; Mitchell et al., 2019).”
BackgroundReconfiguring Participatory Design to Resist AI Realism
Gautam, A. (2024) · Participatory Design Conference · doi:10.1145/3661455.3669867 · Cited by 21
Katirai, A., García, N., Ide, K., Nakashima, Y., & Kishimoto, A. (2024) · AI and Ethics · doi:10.1007/s43681-024-00517-3 · Cited by 26
Auditing and Generating Synthetic Data with Controllable Trust Trade-offs
Belgodere, B. M., Dognin, P., Ivankay, A., Melnyk, I., Mroueh, Y., Mojsilović, A., Navrátil, J., Nitsure, A., Padhi, I., Rigotti, M., et al. (2024) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2024.3477976 · Cited by 41
“Finally, several governance mechanisms have been proposed to ensure transparency in communicating the risks of data and models via fact sheets [9], model cards [76], data sheets [43], and system and method cards [3].”
BackgroundAlderman, J. E., Palmer, J., Laws, E., McCradden, M. D., Ordish, J., Ghassemi, M., Pfohl, S. R., Rostamzadeh, N., Cole-Lewis, H. J., Glocker, B., et al. (2024) · NEJM AI · doi:10.1056/aip2401088 · Cited by 19
A Review on Vision-Language-Based Approaches: Challenges and Applications
Pham, M.-T., Pham, Q.-H., Tran, Q.-D., Ho, H.-T., Nguyen, L. V., Huy, D. N. M., & Nguyen, T. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.060363 · Cited by 20
“The future of VLP lies in the collective efforts of researchers, developers, and stakeholders to address the remaining challenges, explore novel architectures and learning paradigms [102], and ensure the ethical and responsible development of these powerful technologies [103].”
Fifty Shades of Grey: In Praise of a Nuanced Approach Towards Trustworthy Design
Thornton, L., Knowles, B., & Blair, G. S. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445871 · Cited by 26
“Transparency in particular is leaned on heavily in the trusted AI community, increasingly instantiated through forms of documentation [1, 11, 52, 70, 109].”
BackgroundTowards an accountable Internet of Things: a call for reviewability
Norval, C., Cobbe, J., & Singh, J. (2021) · Institution of Engineering and Technology eBooks · doi:10.1049/pbse014e_ch5 · Cited by 18
How Data Scientists Review the Scholarly Literature
Mysore, S., Jasim, M., Song, H., Akbar, S., Randall, A. K. C., & Mahyar, N. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578309 · Cited by 24
“More broadly, the challenges arising from unclear documentation for models and data have led the data science community to pursue initiatives intended to document these artifacts [34, 84], sometimes incentivizing them at publication.”
BackgroundKlinische Entscheidungsfindung mit Künstlicher Intelligenz: Ein interdisziplinärer Governance-Ansatz
Samhammer, D., Beck, S., Budde, K., Burchardt, A., Faber, M., Gerndt, S., Möller, S., Osmanodja, B., Roller, R., & Dabrock, P. (2023) · Essentials · doi:10.1007/978-3-662-67008-8 · Cited by 18
FAT Forensics: A Python toolbox for algorithmic fairness, accountability and transparency
Sokol, K., Santos‐Rodríguez, R., & Flach, P. A. (2022) · Software Impacts · doi:10.1016/j.simpa.2022.100406 · Cited by 59
“For example, multiple researchers have proposed approaches to document data sets [13, 18] to ensure their high quality and reliability.”
Confounding Tradeoffs for Neural Network QuantizationPreprint
Garg, S., Jain, A., Lou, J., & Nahmias, M. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06366 · Cited by 25
“Quantization cards are a structure for reporting design decisions, analogous to datasheets for hardware, and more recently, datasheets for datasets [15] or model cards for machine learning models [28].”
BackgroundWhat Would Jiminy Cricket Do? Towards Agents That Behave MorallyPreprint
Hendrycks, D., Mazeika, M., Zou, A., Patel, S., Zhu, C., Navarro, J., Song, D. X., Li, B., & Steinhardt, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13136 · Cited by 78
Learning visual language models for video understanding
Yang, A. (2023) · theses.fr (ABES) · doi:10.70675/802872a7z8092z4556za1fdz2c7af45f0e72 · Cited by 26
Forks over knives: Predictive inconsistency in criminal justice algorithmic risk assessment tools
Greene, T., Shmueli, G., Fell, J., Lin, C.-F., & Liu, H.-W. (2022) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12966 · Cited by 15
“Model-level ‘predictive multiplicity’ metrics (Marx et al., 2020) can be combined with auditing tools such as data sheets (Gebru et al., 2021) and model cards (Mitchell et al., 2019) to help document data and modelling choices relevant to a specific prediction.”
BackgroundFrom Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditing
Cen, S. H., & Alur, R. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694711 · Cited by 55
“…a strict set of property requirements does not generally have the intended effect (most bright-line rules are easily circumvented due to the underspecification phenomenon mentioned above), data disclosure audits can encourage responsible developer practices and prevent downstream harms [54, 95, 105].”
BackgroundOpenML: Insights from 10 years and more than a thousand papers
Bischl, B., Casalicchio, G., Das, T., Feurer, M., Fischer, S., Gijsbers, P., Mukherjee, S., Müller, A., Németh, L., Oala, L., et al. (2025) · Patterns · doi:10.1016/j.patter.2025.101317 · Cited by 32
“More concretely, this encompasses several aspects, including better documentation support (e.g., data-sheets 115 and model cards 116 ); increasing support for datasets of different modalities; code integrations such as callbacks in popular ML libraries, especially facilitating the integration of…”
Harrath, Y., Adohinzin, O., Kaabi, J., & Saathoff, M. (2025) · Computers · doi:10.3390/computers14090374 · Cited by 23
Key Information Influencing Patient Decision-Making About AI in Health Care: Survey Experiment Study
Zhu, X., Stroud, A. M., Minteer, S. A., Yoo, D. W., Ridgeway, J. L., Mooghali, M., Miller, J. E., & Barry, B. A. (2025) · Journal of Medical Internet Research · doi:10.2196/75615 · Cited by 20
LaCroix, T., & Mohseni, A. (2022) · Synthese · doi:10.1007/s11229-022-03763-2 · Cited by 25
“[48] Gebru, Timnit, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé, III, and Kate Crawford (2020).”
BackgroundPeace and Prosperity for the Digital Age? The Colonial Political Economy of European AI Governance
Carmel, E., & Paul, R. (2022) · IEEE Technology and Society Magazine · doi:10.1109/mts.2022.3173340 · Cited by 25
The Challenge of Ethical Interoperability
Danks, D. J., & Trusilo, D. (2022) · Digital Society · doi:10.1007/s44206-022-00014-2 · Cited by 20
“This approach is highly appealing as it would enable the establishment of ethical interoperability using observable or behavioral measures that can be documented in standard formats such as datasheets (Gebru et al., 2021) or model cards (Mitchell et al., 2019).”
BackgroundUnsilencing colonial archives via automated entity recognition
Luthra, M., Todorov, K., Jeurgens, C., & Colavizza, G. (2023) · Journal of Documentation · doi:10.1108/jd-02-2022-0038 · Cited by 46
Majeed, A., & Hwang, S. O. (2023) · Computer · doi:10.1109/mc.2023.3240450 · Cited by 14
Balagopalan, A., Madras, D., Yang, D., Hadfield-Menell, D., Hadfield, G. K., & Ghassemi, M. (2023) · Science Advances · doi:10.1126/sciadv.abq0701 · Cited by 33
Reproducibility in NLP: What Have We Learned from the Checklist?
Magnusson, I., Smith, N. A., & Dodge, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.809 · Cited by 22
Understanding and evaluating harms of AI-generated image captions in political images
Sarhan, H., & Hegelich, S. (2023) · Frontiers in Political Science · doi:10.3389/fpos.2023.1245684 · Cited by 20
From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent
Nguyen, V. B., Schlötterer, J., & Seifert, C. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44070-0_4 · Cited by 39
“34 Output What kind of output does the system give? 3 Data/Model Generation ModelCards [32], DataSheets [14]”
BackgroundInfluentialA unified and practical user-centric framework for explainable artificial intelligence
Kaplan, S., Uusitalo, H. M. T., & Lensu, L. T. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111107 · Cited by 31
ChatGPT Giving Relationship Advice – How Reliable Is It?
Hou, H., Leach, K., & Huang, Y. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31338 · Cited by 14
Metadata
- Authors
- Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K.
- Affiliations
- DAIR Institute (US)
- University of Washington (US)
- Cornell University (US)
- Microsoft Research New York City (United States) (US)
- University of Maryland, College Park, MD
- University of Southern California (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2021-11-19
- Volume
- 64
- Issue
- 12
- Pages
- 86-92
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2795038878
- Semantic Scholar
- 0df347f5e3118fac7c351917e3a497899b071d1e
- Cited by
- 2,469
- References
- 37
- Citations by year
- 2026: 788 · 2025: 402 · 2024: 298 · 2023: 379 · 2022: 221 · 2021: 217
- FWCI
- 252.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- Alfred P. Sloan Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- dataset documentation, data provenance, data sharing, data reuse, metadata
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.