Datasheets for datasets
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
Documentation to facilitate communication between dataset creators and consumers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Paradata needs may include the preservation of novel forms of information, such as datasheets explaining training datasets or model cards documenting an AI tool, and of these documents' relation to archival collections processed using them [ 26 ].”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Significant critiques of LLMs have been raised, including concerns about bias and fairness, misinformation, opaqueness due to a lack of interpretability and explainability, and environmental impact (Bender et al., 2021; Gebru et al., 2021; Strubell et al., 2019).”
From Using ChatGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments (2023) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ML driven algorithms are considered as epistemic resources that help us to improve understanding and/or make better predictions, then the statistical nature of ML de facto prevents groups underrepresented in the data from contributing to this epistemic resource on an equal ground to dominant groups (Gebru et al., 2021)”
From Algorithmic profiling as a source of hermeneutical injustice (2025) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The authors found that providing examples of what the requirements can look like helps to guide practitioners in clarifying their own rules.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“I show how archival theories have been animated in documenting data in the context of AI and ML, including through documentation frameworks like Datasheets for Datasets”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Gebru et al. 2021
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
(2018) · Cited by 3,510
Self-citationA sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Researchers at Google published follow-up work on model cards that document machine learning models [20] and released a data card (a lightweight version of a datasheet) along with the Open Images dataset [17].”
BackgroundSelf-citationMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 2×
“Of particular concern are recent examples showing that machine learning models can reproduce or amplify unwanted societal biases reflected in training data [4, 5, 9].”
BackgroundThe Effects of Automobile Safety Regulation
Peltzman, S. (1975) · Journal of Political Economy · doi:10.1086/260352 · Cited by 1,531
The Recent Past and Near Future of Risk and/or Need Assessment
Andrews, D. A., Bonta, J., & Wormith, J. S. (2006) · Crime & Delinquency · doi:10.1177/0011128705281756 · Cited by 1,507 · cited 1×
“Domains such as criminal justice (Garvie et al., 2016; Systems, 2017; Andrews et al., 2006), hiring and employment (Mann & O’Neil, 2016), critical infrastructure (O’Connor, 2017; Chui, 2017), and finance (Lin, 2012) all increasingly depend on machine learning methods.”
Background
Research works printed but not linked: 7
- Chui, G. Project will use AI to prevent or minimize electric grid failures, 2017.
- Garvie, C., Bedoya, A., and Frankle, J. The Perpetual Line-Up: Unregulated Police Face Recognition in America. Georgetown Law, Center on Privacy & Technology, Washington, D.C., 2016.
- Holstein, K., Vaughan, J., Daumé, H, Dudík, M., and Wallach, H. Improving fairness in machine learning systems: What do industry practitioners need? In Proceedings of 2019 ACM CHI Conf. on Human Factors in Computing Systems.
- Krasin, I. et al. OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017.
- O'Connor, M. How AI Could Smarten Up Our Water System, 2017.
- Doha Supply Systems. Facial Recognition, 2017.
- Yagcioglu, S., Erdem, A., Erdem, E., and Ikizler-Cinbis, N. RecipeQA: A challenge dataset for multimodal comprehension of cooking recipes. In Proceedings of the 2018 Conf. on Empirical Methods in Natural Language Processing.
Cited by
Items 401–500 of 1,039
feminist data ethics of care for machine learning: The what, why, who and how
Gray, J. E., & Witt, A. (2021) · First Monday · doi:10.5210/fm.v26i12.11833 · Cited by 53
ir_metadata: An Extensible Metadata Schema for IR Experiments
Breuer, T., Keller, J., & Schaer, P. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531738 · Cited by 42
Rismani, S., Shelby, R. M., Smart, A., Jatho, E. W., Kroll, J. A., Moon, A., & Rostamzadeh, N. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581407 · Cited by 78
Wu, Q., Wang, J., He, Y., Liu, Y., & Jiang, Q. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107929 · Cited by 35
A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithms
Coston, A., Kawakami, A., Zhu, H., Holstein, K., & Heidari, H. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00050 · Cited by 79
“This work has frequently considered questions of value-alignment, such as how to promote fairness and establish transparency and accountability [18, 19, 20, 21, 22].”
BackgroundDatasheets for Digital Cultural Heritage Datasets
Alkemade, H., Claeyssens, S., Colavizza, G., Freire, N., Lehmann, J., Neudecker, C., Osti, G., & van Strien, D. (2023) · Journal of Open Humanities Data · doi:10.5334/johd.124 · Cited by 69
FATE in AI: Towards Algorithmic Inclusivity and Accessibility
Inuwa-Dutse, I. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623233 · Cited by 52
“For a successful national AI strategy, there is a need to ensure algorithmic accountability, data protection, and explainability of decision-making by AI models.”
BackgroundA checklist to publish collections as data in GLAM institutions
Candela, G., Gabriëls, N., Chambers, S., Dobreva, M., Ames, S., Ferriter, M., Fitzgerald, N., Johnston, V. H., Hofmann, K., Hołownia, O., et al. (2023) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-06-2023-0195 · Cited by 34
“Best practices [3, 7, 12, 15, 25, 26, 28, 40, 47–49, 51, 53, 54] Data quality [10, 13, 30, 56] Checklist definition [1, 18, 27, 34, 50] Strategy & data plan [5, 6, 19, 23, 36, 37, 42, 43, 46, 55] Examples & experiments [2, 8, 9, 17, 20, 21, 24, 29, 31, 35, 38, 39, 41, 44, 45, 52] The items…”
Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
Yildirim, N., Zlotnikov, S., Sayar, D., Kahn, J. M., Bukowski, L. A., Amin, S. S., Riman, K. A., Davis, B. S., Minturn, J. S., King, A. J., et al. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641896 · Cited by 55
“We reflected that capturing these dimensions in a more nuanced manner can inform the future iterations of the Do-Know-Reason worksheet (e.g., similar to datasheets [43, 105], a comprehensive ‘AI concept template’ for concept proposals).”
MethodStroud, A. M., Minteer, S. A., Zhu, X., Ridgeway, J. L., Miller, J. E., & Barry, B. A. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000826 · Cited by 48
CounterFAccTual: How FAccT Undermines Its Organizing Principles
Gansky, B., & McDonald, S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533241 · Cited by 34
Twitter Corpus of the #BlackLivesMatter Movement and Counter Protests: 2013 to 2021
Giorgi, S., Guntuku, S. C., Himelein-Wachowiak, M., Kwarteng, A. E., Hwang, S., Rahman, M., & Curtis, B. L. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19373 · Cited by 42
“Here we consider the ethical questions outlined in Datasheets for Datasets (Gebru et al. 2021).”
Reproducibility in Machine Learning for Health
McDermott, M. B. A., Wang, S., Marinsek, N., Ranganath, R., Ghassemi, M., & Foschini, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01463 · Cited by 32
“Increasing the use of “specs” or “datasheets” describing datasets would help allay these concerns—efforts in the broader machine learning community are also approaching this goal [10] and we should vigorously adopt these practices in ML4H.”
MethodIt's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness BenchmarksPreprint
Bao, M., Zhou, A., Zottola, S. A., Brubach, B., Desmarais, S. L., Horowitz, A., Lum, K., & Venkatasubramanian, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05498 · Cited by 136
“Within the broader discussions around algorithmic fairness, our work is situated within a growing body of scholarship that emphasizes the importance of understanding training data provenance and context [19, 20] as a part of the model building process.”
BackgroundMethodTech Worker Organizing for Power and Accountability
Boag, W., Suresh, H., Lepe, B., & D'Ignazio, C. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533111 · Cited by 34
“introduce Datasheets for Datasets [24] and Model Cards for Model Reporting [46], respectively, for standardizing the transparency of algorithmic system development.”
MethodMccradden, M., Odusi, O., Joshi, S., Akrout, I., Ndlovu, K., Glocker, B., Maicas, G., Liu, X., Mazwi, M., Garnett, T., et al. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594096 · Cited by 33
“These have included practices ranging from algorithmic audits [11] [12] [13], documentation practices [14] [15], impact assessments to direct algorithmic designs and amendments intended to address and implement fairness [16] [17] [18].”
BackgroundORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition
Massiceti, D., Zintgraf, L., Bronskill, J., Theodorou, L., Harris, M. T., Cutrell, E., Morrison, C., Hofmann, K., & Stumpf, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01064 · Cited by 33
“1 and a datasheet [10] for the dataset is included in Appendix E.”
BackgroundMy Face My Choice: Privacy Enhancing Deepfakes for Social Media Anonymization
Çiftçi, U. A., Yuksek, G., & Demir, İ. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00142 · Cited by 49
“As these systems become more popular, privacy implications [47, 26] and impacts on critical populations [8, 19, 74] of such have also been analyzed closely.”
Backgroundvan Es, K. F., Wieringa, M., & Schäfer, M. T. (2018) · International Conference on Web Studies (WS) · doi:10.1145/3240431.3240436 · Cited by 33
Aspirations and Practice of ML Model Documentation: Moving the Needle with Nudging and Traceability
Bhat, A., Coursey, A., Hu, G., Li, S., Nahar, N., Zhou, S., Kästner, C., & Guo, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581518 · Cited by 68
“As a reaction to observed problems in ML model reuse and accountability, signifcant eforts towards documenting models [4, 45] and data [24] have been proposed.”
Kozak, J., & Fel, S. (2024) · Religions · doi:10.3390/rel15030331 · Cited by 39
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties
Sorensen, T., Jiang, L., Hwang, J. D., Levine, S., Pyatkin, V., West, P., Dziri, N., Lu, X., Rao, K., Bhagavatula, C., et al. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i18.29970 · Cited by 266
“Additionally, we show that K ALEIDO can help explain ambiguity and variability underlying human decision-making in nuanced 1 Datasheet for Datasets (Gebru et al. 2018) situations by generating contrasting values.”
BackgroundTransparency for AI systems: a value-based approach
Buijsman, S. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09770-w · Cited by 52
“There are the more practically oriented datasheets and model cards (Gebru et al., 2021; Mitchell et al., 2019) as well as the more philosophical account called design publicity (Loi et al., 2021).”
Applied artificial intelligence for global child health: Addressing biases and barriers
Muralidharan, V., Schamroth, J., Youssef, A., Celi, L. A., & Daneshjou, R. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000583 · Cited by 37
“…such as provision of data sheets and model cards, mechanisms for community engagement, and open multi-stakeholder dialogue at each step of the AI lifecycle can provide vital safety components of the AI pipeline to ensure those who are disproportionately burdened by disease benefit the most [63,64].”
BackgroundThe ethics of data mining in healthcare: challenges, frameworks, and future directions
Ahmed, M. M., Okesanya, O. J., Oweidat, M. H., Othman, Z. K., Musa, S. S., & Lucero‐Prisno, D. E. (2025) · BioData Mining · doi:10.1186/s13040-025-00461-w · Cited by 54
Yi, P. H., Kim, T. K., Siegel, E. L., & Yahyavi‐Firouz‐Abadi, N. (2022) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2021.08.018 · Cited by 37
NUBIA: NeUral Based Interchangeability Assessor for Text Generation
Kane, H., Kocyigit, M. Y., Abdalla, A., Ajanoh, P., & Coulibali, M. (2020) · arXiv · doi:10.48550/arxiv.2004.14667 · Cited by 32
“Data statements (Bender and Friedman, 2018) or data sheets for datasets (Gebru et al., 2018) on individual components and the NUBIA metric can help design more transparent/trustworthy system.”
BackgroundDERM12345: A Large, Multisource Dermatoscopic Skin Lesion Dataset with 40 Subclasses
Yılmaz, A., Yaşar, Ş. P., Gençoğlan, G., & Temelkuran, B. (2024) · Scientific Data · doi:10.1038/s41597-024-04104-3 · Cited by 56
NLPositionality: Characterizing Design Biases of Datasets and Models
Santy, S., Liang, J. T., Bras, R. J. L., Reinecke, K., & Sap, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.505 · Cited by 165
Nielbo, K. L., Karsdorp, F., Wevers, M., Lassche, A., Baglini, R., Kestemont, M., & Tahmasebi, N. (2024) · Nature Reviews Methods Primers · doi:10.1038/s43586-024-00302-w · Cited by 49
“Similarly, datasheets or data cards can be used to promote transparency for data used in QTA 87 .”
Learning about Responsible AI On-The-Job: Learning Pathways, Orientations, and Aspirations
Madaio, M., Kapania, S., Qadri, R., Wang, D., Zaldivar, A., Denton, E., & Wilcox, L. G. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658988 · Cited by 56
“…civil society organizations, and many others have developed principles [70], toolkits [29, 42, 91, 141], play-books [100, 133], documentation tools [32, 50, 90, 100, 105, 106, 122], and other interventions to lead to more responsible AI (RAI) development practices [23, 37, 54, 93, 130].”
BackgroundMethodOlá, Bonjour, Salve! XFORMAL: A Benchmark for Multilingual Formality Style Transfer
Briakou, E., Lu, D., Zhang, K., & Tetreault, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.256 · Cited by 89
The Craft and Coordination of Data Curation: Complicating Workflow Views of Data Science
Thomer, A. K., Akmon, D., York, J., Tyler, A. R. B., Polasek, F., Lafia, S., Hemphill, L., & Yakel, E. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555139 · Cited by 44
“[28]] argue for a key aspect of curating data for reuse: that data used in machine learning should carry documentation that describes its collection processes and transformations.”
BackgroundPhysion: Evaluating Physical Prediction from Vision in Humans and MachinesPreprint
Bear, D. M., Wang, E., Mrowca, D., Binder, F. J., Tung, H.-Y. F., Pramod, R. T., Holdaway, C., Tao, S., Smith, K. A., Sun, F.-Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08261 · Cited by 228
Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Papers
Peng, K., Mathur, A., & Narayanan, A. (2021) · arXiv · doi:10.48550/arxiv.2108.02922 · Cited by 31
“…make sense of ethical considerations involved in dataset creation [43, 69, 32], have proposed ways to identify and mitigate biases in datasets [11, 82], have developed means to protect the privacy of individuals in datasets [70, 91], and have improved methods to document datasets [35, 47, 12, 65].”
BackgroundMethodIconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language ReasoningPreprint
Lu, P., Qiu, L., Chen, J., Xia, T., Zhao, Y., Zhang, W., Zhou, Y., Liang, X., & Zhu, S. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13214 · Cited by 361
BEND: Benchmarking DNA Language Models on biologically meaningful tasks
Marin, F. I., Teufel, F., Horlacher, M., Madsen, D., Pultz, D., Winther, O., & Boomsma, W. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2311.12570 · Cited by 73
Lewicki, K., Lee, M. S. A., Cobbe, J., & Singh, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581463 · Cited by 30
DeAR: Debiasing Vision-Language Models with Additive Residuals
Seth, A., Hemani, M., & Agarwal, C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00659 · Cited by 34
“Prior work in language [4, 20, 31], computer vision [17, 51], and graphs [1, 27, 40, 54] has primarily focused on debiasing models trained on unimodal data and are limited in scope as they only investigate gender bias, racial bias, or their intersections.”
BackgroundDifferential privacy for medical deep learning: methods, tradeoffs, and deployment implications
Mohammadi, M., Vejdanihemmat, M., Lotfinia, M., Rusu, M., Truhn, D., Maier, A., & Arasteh, S. T. (2026) · npj Digital Medicine · doi:10.1038/s41746-025-02280-z · Cited by 74
“Second, benchmark datasets with demographic annotations and support for intersectional subgrouping are needed to enable comparable fairness audits under DP constraints [140, 141].”
Neto, E. J. D. M., & Clementino, M. B. M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272287 · Cited by 56
“We release the dataset with this paper, naming it the "Brazilian Courts Appeals Dataset for the 5th Regional Federal Court—BrCAD-5" along with its datasheet [21].”
MethodReward Reports for Reinforcement Learning
Gilbert, T. K., Lambert, N., Dean, S., Zick, T., Snoswell, A., & Mehta, S. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604698 · Cited by 63
“For evaluation on static datasets, considering referring to associated documentation (e.g. Datasheets [Gebru et al.(2021)]).”
MethodHPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOPreprint
Eggensperger, K., Muller, P., Mallik, N., Feurer, M., Sass, R., Klein, A., Awad, N. H., Lindauer, M., & Hutter, F. (2021) · NeurIPS Datasets and Benchmarks · doi:10.48550/arxiv.2109.06716 · Cited by 173
“In this section we present a maintenance plan that is adapted from the datasheets for datasets [100].”
MethodBandyopadhyay, A., Oks, M., Sun, H., Prasad, B., Rusk, S., Jefferson, F., Malkani, R. G., Haghayegh, S., Sachdeva, R. C., Hwang, D., et al. (2024) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.11132 · Cited by 33
Machine learning for healthcare that matters: Reorienting from technical novelty to equitable impact
Balagopalan, A., Baldini, I., Celi, L. A., Gichoya, J. W., McCoy, L. G., Naumann, T., Shalit, U., van der Schaar, M., & Wagstaff, K. L. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000474 · Cited by 42
Competing narratives in AI ethics: a defense of sociotechnical pragmatism
Watson, D., Mökander, J., & Floridi, L. (2024) · AI & Society · doi:10.1007/s00146-024-02128-2 · Cited by 56
“Consider the functions of data-sheets (Gebru et al. 2021) and model cards (Mitchell 2019).”
Ramezani, E. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129862 · Cited by 40
Fairness issues in AI systems that augment sensory abilities
Findlater, L., Goodman, S. M., Zhao, Y., Azenkot, S., & Hanley, M. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3386296.3386304 · Cited by 30
A Semantic Framework to Support AI System Accountability and Audit
Naja, I., Marković, M., Edwards, P. J., & Cottrill, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77385-4_10 · Cited by 34
“Human decision making and approvals : who is accountable for the creation of various specifications including the dataset [11, 13], model [20] and supporting infrastructure specifications; who assessed the fitness of the dataset [8, 24], model, and supporting infrastructure specifications against the…”
BackgroundMethodInfluentialData distribution debugging in machine learning pipelines
Grafberger, S., Groth, P., Stoyanovich, J., & Schelter, S. (2022) · The VLDB Journal · doi:10.1007/s00778-021-00726-w · Cited by 55
“[16,32] propose manually curated information in the form of datasheets and model cards to accompany them.”
Social Inclusion in Curated Contexts: Insights from Museum Practices
Huang, H.-Y., & Liem, C. C. S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533095 · Cited by 56
“As already argued by Jo and Gebru [24], more transparency on the policies and criteria behind machine learning datasets can be achieved through more explicit policy documentation, and existing proposals on datasheets for datasets [16] and model cards for model reporting [28] can naturally complement this.”
BackgroundThe Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning
Hessel, J., Hwang, J. D., Park, J. S., Zellers, R., Bhagavatula, C., Rohrbach, A., Saenko, K., & Choi, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20059-5_32 · Cited by 76
Evaluation of computational phage detection tools for metagenomic datasets
Schackart, K., Graham, J. B., Ponsero, A. J., & Hurwitz, B. L. (2023) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1078760 · Cited by 36
“In addition to README files for each dataset, datasheets based on Datasheets for Datasets (Gebru et al., 2021) are deposited in Zenodo.”
MethodAI Maintenance: A Robustness Perspective
Chen, P.-Y., & Das, P. (2023) · Computer · doi:10.1109/mc.2022.3218005 · Cited by 29
Hays, C., Schutzman, Z., Raghavan, M., Walk, E., & Zimmer, P. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583214 · Cited by 54
A domain-specific language for describing machine learning datasets
Giner-Miguelez, J., Gómez, A., & Cabot, J. (2023) · Journal of Computer Languages · doi:10.1016/j.cola.2023.101209 · Cited by 45
Dirty Data Labeled Dirt Cheap: Epistemic Injustice in Machine Learning Systems
Hull, G. (2022) · Ethics and Information Technology · doi:10.1007/s10676-023-09712-y · Cited by 35
“These sorts of critique suggest the importance of reforms like requiring documentation of dataset construction and design (Gebru et al., 2020).”
BackgroundSeedat, N., Imrie, F., & van der Schaar, M. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3345805 · Cited by 65
“Mature industries involve standard methods to benchmark and provide characterizations of components under a variety of testing and/or operating conditions [32].”
BackgroundMethodDocumenting Data Production Processes: A Participatory Approach for Data Work
Miceli, M., Yang, T., Alvarado Garcia, A., Posada, J., Wang, S. M., Pohl, M., & Hanna, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555623 · Cited by 28
“Frameworks such as Datasheets for Datasets [37], Dataset Nutrition Label [46], and Data Statements [10] have become increasingly influential.”
BackgroundMethodInfluentialBigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Zhuo, T. Y., Vu, M. C., Chim, J., Hu, H., Yu, W., Widyasari, R., Yusuf, I. N. B., Zhan, H., He, J., Paul, I., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.15877 · Cited by 29
“Besides the provided Datacard, we follow the documentation frameworks provided by [21].”
MethodSmallset Timelines: A Visual Representation of Data Preprocessing Decisions
Lucchesi, L. R., Kuhnert, P., Davis, J. L., & Xie, L. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533175 · Cited by 33
Lecture Presentations Multimodal Dataset: Towards Understanding Multimodality in Educational Videos
Lee, D. W., Ahuja, C., Liang, P. P., Natu, S., & Morency, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01838 · Cited by 55
“To increase the transparency of our dataset, we share a Datasheet for Datasets [16] in the supplementary.”
MethodShankar, S., Garcia, R., Hellerstein, J. M., & Parameswaran, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3653697 · Cited by 153
“Documentation solutions for deployed models and datasets have been proposed [23, 60], but we see an opportunity for tools to help document experiments —particularly, failed ones.”
BackgroundOrr, W., & Crawford, K. (2024) · New Media & Society · doi:10.1177/14614448241251797 · Cited by 50
“Without standardized practices of dataset development, or clear and enforceable documentation practices, accountability for datasets remains limited (Gebru et al., 2021; Luccioni et al., 2022).”
Self-citationKim, Y. K., Seo, W.-D., Lee, S. J., Koo, J. H., Kim, G. C., Song, H. S., & Lee, M. (2024) · Journal of Medical Internet Research · doi:10.2196/62890 · Cited by 37
“Key factors contributing to algorithmic bias are label bias and cohort bias [28,29].”
BackgroundConstantinides, M., Bogucka, E. P., Quercia, D., Kallio, S., & Tahaei, M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686927 · Cited by 59
“In total, we formulated a set of 16 techniques based on relevant literature sources [5, 10, 19, 24, 31, 34, 41, 42, 44, 54, 59, 66, 67, 84, 93, 94].”
InfluentialPreventing Racial Bias in Federal AI
Livingston, M. (2020) · Journal of Science Policy & Governance · doi:10.38126/jspg160205 · Cited by 38
“The assessment must include an audit of the data (Gebru et al. 2018), the programming, and any prior testing (European Commission 2020).”
BackgroundMethodOpenHSI: A Complete Open-Source Hyperspectral Imaging Solution for Everyone
Mao, Y., Betters, C. H., Evans, B., Artlett, C., Leon-Saval, S. G., Garske, S., Cairns, I. H., Cocks, T., Winter, R., & Dell, T. (2022) · Remote Sensing · doi:10.3390/rs14092244 · Cited by 33
“As suggested in [28], we believe that each dataset should be accompanied by a datasheet that documents its motivation, composition, collection process, and recommended uses.”
BackgroundREAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research
Smith, J. J., Amershi, S., Barocas, S., Wallach, H., & Vaughan, J. W. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533122 · Cited by 52
Self-citationInterpretability and Transparency in Artificial Intelligence
Mittelstadt, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.20 · Cited by 41
All That’s Happening behind the Scenes: Putting the Spotlight on Volunteer Moderator Labor in Reddit
Li, H., Hecht, B. J., & Chancellor, S. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19317 · Cited by 64
Pumplun, L., Peters, F., Gawlitza, J. F., & Buxmann, P. (2023) · Journal of the Association for Information Systems · doi:10.17705/1jais.00820 · Cited by 59
The Scientific Method in the Science of Machine LearningPreprint
Forde, J. Z., & Paganini, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10922 · Cited by 50
“Many have identified various social factors within the research ecosystem that contribute to these challenges (Lipton & Steinhardt, 2018; Sculley et al., 2018a;b; Henderson & Brunskill, 2018; Gebru et al., 2018; Mitchell et al., 2019).”
BackgroundA Methodology for Creating AI FactSheets
Richards, J., Piorkowski, D., Hind, M., Houde, S., & Mojsilović, A. (2020) · arXiv · doi:10.48550/arxiv.2006.13796 · Cited by 28
“Our mechanism for transparent AI documentation, called FactSheets [1], takes a more general approach to AI transparency than previous work [2, 5, 7, 11, 14] in several ways.”
BackgroundMethodAlgorithmic profiling as a source of hermeneutical injustice
Milano, S., & Prunkl, C. (2025) · Philosophical Studies · doi:10.1007/s11098-023-02095-2 · Cited by 38
“…of ML de facto prevents groups underrepresented in the data from contributing to this epistemic resource on an equal ground to dominant groups (Gebru et al., 2021), simply because they are not equally captured in the data sets used to train the predictive algorithms, or because the quality of…”
Physical reservoir computing: a tutorial
Stepney, S. (2024) · Natural Computing · doi:10.1007/s11047-024-09997-y · Cited by 44
“A great variety of datasets that can be used for benchmark tasks, although not yet common in the RC literature, can be found in Gilpin (2021)’s database of chaotic dynamical systems, all specified according to guidelines proposed by Gebru et al. (2021).”
Montesano, G., Chen, A., Lu, R. Y., Lee, C. S., & Lee, A. (2022) · Translational Vision Science & Technology · doi:10.1167/tvst.11.1.1 · Cited by 27
Towards Implementing Responsible AI
Sanderson, C., Lu, Q., Douglas, D., Xu, X., Zhu, L., & Whittle, J. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10021121 · Cited by 28
“Two main approaches were often identified related to traceability, provenance and reproducibility: (i) tracking the use of AI systems, and (ii) keeping track of information related to model provenance (eg. code and training data) [10], [16].”
BackgroundAugmented Datasheets for Speech Datasets and Ethical Decision-Making
Papakyriakopoulos, O., Choi, A. S. G., Thong, W. E., Zhao, D., Andrews, J. T. A., Bourke, R., Xiang, A., & Koenecke, A. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594049 · Cited by 58
Haghish, E. F., Czajkowski, N. O., & von Soest, T. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1216791 · Cited by 33
“Therefore, suicidal behavior is often not measured in population-based studies (12, 14, 15).”
BackgroundTowards Evaluation and Understanding of Large Language Models for Cyber Operation Automation
Sultana, M., Taylor, A., Li, L., & Majumdar, S. (2023) · IEEE Conference on Communications and Network Security · doi:10.1109/cns59707.2023.10288677 · Cited by 42
“[39] should be followed as much as possible.”
BackgroundMethodAllison, J. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251377430 · Cited by 36
“Meanwhile, initiatives like Datasheets for Datasets (Gebru et al., 2021) have emerged to increase transparency and accountability within the machine learning community.”
Shanley, D., Hogenboom, J., Lysen, F., Wee, L., Gomes, A. L., Dekker, A. L. A. J., & Meacham, D. (2024) · EMBO Reports · doi:10.1038/s44319-024-00101-0 · Cited by 33
“…for documenting how a speci fi c set of (synthetic) data has been created and used are being developed, such as standardised forms for recording metadata (such as a ‘ datasheet ’ that captures how a dataset was created) (Gebru et al, 2021), or ‘ watermarks ’ for medical images (Qasim et al, 2018).”
Unlocking the Potential of Web Data for Retailing Research
Guyt, J. Y., Datta, H., & Boegershausen, J. (2024) · Journal of Retailing · doi:10.1016/j.jretai.2024.02.002 · Cited by 34
Use case cards: a use case reporting framework inspired by the European AI Act
Hupont, I., Llorca, D. F., Baldassarri, S., & Gómez, E. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09757-7 · Cited by 48
“First, an AI system intended to be used as a safety component of a product, or that is itself a product, covered by Union harmonisation legislation listed in Annex II (e.g. machinery, toys, medical devices regulations) if it requires undergoing a third-party conformity assessment.”
Torkamaan, H., Tahaei, M., Buijsman, S., Xiao, Z., Wilkinson, D., & Knijnenburg, B. P. (2024) · Human-computer interaction series · doi:10.1007/978-3-031-55109-3_2 · Cited by 40
Sloane, M., & Wüllhorst, E. (2025) · Data & Policy · doi:10.1017/dap.2024.54 · Cited by 33
Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making
Robinson, J. P., Shao, M., & Fu, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3063078 · Cited by 36
“For instance, the latest version of RFIW, supplemental to this survey, available online, FIW is now supported with a datasheet : “datasheets for datasets” [124].”
MethodShimorina, A., & Belz, A. (2022) · Proceedings of the 2nd Workshop on Human Evaluation of NLP Systems (HumEval) · doi:10.18653/v1/2022.humeval-1.6 · Cited by 26
Garbin, C., & Marques, O. (2022) · Radiology Artificial Intelligence · doi:10.1148/ryai.210127 · Cited by 31
“As a practical illustration of auditing methods that focus on the early stages of the ML lifecycle, we apply two of them—datasheets for datasets (4) and model cards (5)—to a well-known medical imaging analysis dataset called ChestX-ray8 (6) and a well-known model based on it called CheXNet (7),…”
BackgroundMethodInfluentialOn learning and representing social meaning in NLP: a sociolinguistic perspective
Nguyen, D., Rosseel, L., & Grieve, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.50 · Cited by 56
“One key step is documenting the datasets (Bender and Friedman, 2018; Gebru et al., 2018).”
BackgroundArchivist in the machine: paradata for AI-based automation in the archives
Davet, J., Hamidzadeh, B., & Franks, P. (2023) · Archival Science · doi:10.1007/s10502-023-09408-8 · Cited by 26
“For instance, a firm may employ datasheets for datasets (Gebru et al. 2021) at the initial development stage, formulated according to the underlying AI development strategy, e.g., supervised ML.”
MethodWiCE: Real-world entailment for claims in Wikipedia
Kamoi, R., Goyal, T., Rodriguez, J., & Durrett, G. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.470 · Cited by 26
Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color
Thong, W. E., Joniak, P., & Xiang, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00452 · Cited by 49
“In the context of this paper, and following previous works [25, 57, 58], we focus on commercial systems, as well as publicly available models, to predict the gender and the presence of a smile.”
BackgroundMethodBetween Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer VisionPreprint
Miceli, M., Schuessler, M., & Yang, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.14886 · Cited by 26
Multisource AI Scorecard Table for System EvaluationPreprint
Blasch, E., Sung, J., & Nguyen, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03985 · Cited by 39
“These efforts include: Betting understanding the data that underlies a machine learning system through Datasheets [36], data statements [37], and “nutrition labels”[38]; Clarifying the intended use cases of machine learning algorithms and minimizing their usage in contexts for which they are…”
BackgroundGlinka, K., & Müller-Birn, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610054 · Cited by 26
“Emphasizing the situatedness of data could build on approaches such as Gebru et al.’s suggestion to include “Datasheets for Datasets” [42] or take inspiration from Holland et al.’s “Dataset Nutrition Label” [44].”
MethodCameron, S., Franks, P., & Hamidzadeh, B. (2023) · Journal on Computing and Cultural Heritage · doi:10.1145/3594728 · Cited by 25
“Paradata needs may include the preservation of novel forms of information, such as datasheets explaining training datasets or model cards documenting an AI tool, and of these documents relation to archival collections processed using them [26].”
BackgroundFeffer, M., Martelaro, N., & Heidari, H. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623223 · Cited by 37
“We asked students about how they gathered AI-related news before encountering AIID and whether they would use AIID in the future.”
BackgroundCroissant: A Metadata Format for ML-Ready Datasets
Akhtar, M., Benjelloun, O., Conforti, C., Gijsbers, P., Giner-Miguelez, J., Jain, N., Kuchnik, M., Lhoest, Q., Marcenac, P., Maskey, M., et al. (2024) · Workshop on Data Management for End-to-End Machine Learning (DEEM) · doi:10.1145/3650203.3663326 · Cited by 103
Metadata
- Authors
- Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K.
- Affiliations
- DAIR Institute (US)
- University of Washington (US)
- Cornell University (US)
- Microsoft Research New York City (United States) (US)
- University of Maryland, College Park, MD
- University of Southern California (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2021-11-19
- Volume
- 64
- Issue
- 12
- Pages
- 86-92
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2795038878
- Semantic Scholar
- 0df347f5e3118fac7c351917e3a497899b071d1e
- Cited by
- 2,469
- References
- 37
- Citations by year
- 2026: 788 · 2025: 402 · 2024: 298 · 2023: 379 · 2022: 221 · 2021: 217
- FWCI
- 252.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- Alfred P. Sloan Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- dataset documentation, data provenance, data sharing, data reuse, metadata
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.