The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Datasheets for datasets
Open accessAbstract
Documentation to facilitate communication between dataset creators and consumers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Paradata needs may include the preservation of novel forms of information, such as datasheets explaining training datasets or model cards documenting an AI tool, and of these documents' relation to archival collections processed using them [ 26 ].”
From Positioning Paradata: A Conceptual Frame for AI Processual Documentation in Archives and Recordkeeping Contexts (2023) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Significant critiques of LLMs have been raised, including concerns about bias and fairness, misinformation, opaqueness due to a lack of interpretability and explainability, and environmental impact (Bender et al., 2021; Gebru et al., 2021; Strubell et al., 2019).”
From Using ChatGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments (2023) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“If ML driven algorithms are considered as epistemic resources that help us to improve understanding and/or make better predictions, then the statistical nature of ML de facto prevents groups underrepresented in the data from contributing to this epistemic resource on an equal ground to dominant groups (Gebru et al., 2021)”
From Algorithmic profiling as a source of hermeneutical injustice (2025) · cites this paper as Gebru et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The authors found that providing examples of what the requirements can look like helps to guide practitioners in clarifying their own rules.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“I show how archival theories have been animated in documenting data in the context of AI and ML, including through documentation frameworks like Datasheets for Datasets”
From Can AI provenance inform archival provenance? (2026) · cites this paper as Gebru et al. 2021
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Minimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109
(2018) · Cited by 3,510
Self-citationA sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Researchers at Google published follow-up work on model cards that document machine learning models [20] and released a data card (a lightweight version of a datasheet) along with the Open Images dataset [17].”
BackgroundSelf-citationMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 2×
“Of particular concern are recent examples showing that machine learning models can reproduce or amplify unwanted societal biases reflected in training data [4, 5, 9].”
BackgroundThe Effects of Automobile Safety Regulation
Peltzman, S. (1975) · Journal of Political Economy · doi:10.1086/260352 · Cited by 1,531
The Recent Past and Near Future of Risk and/or Need Assessment
Andrews, D. A., Bonta, J., & Wormith, J. S. (2006) · Crime & Delinquency · doi:10.1177/0011128705281756 · Cited by 1,507 · cited 1×
“Domains such as criminal justice (Garvie et al., 2016; Systems, 2017; Andrews et al., 2006), hiring and employment (Mann & O’Neil, 2016), critical infrastructure (O’Connor, 2017; Chui, 2017), and finance (Lin, 2012) all increasingly depend on machine learning methods.”
BackgroundAmazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
Bender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854 · cited 1×
“As another example, Bender and Friedman [2] outline a proposal similar to datasheets for datasets specifically intended for language-based datasets.”
QuAC: Question Answering in Context
Choi, E., He, H., Iyyer, M., Yatskar, M., Yih, W.-T., Choi, Y., Liang, P., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1241 · Cited by 714 · cited 1×
“Academic researchers have adopted our proposal and released datasets with accompanying datasheets [e.g., 7, 10, 23, 26].”
Provenance in Databases: Why, How, and Where
Cheney, J., Chiticariu, L., & Tan, W.-C. (2009) · Foundations and Trends in Databases · doi:10.1561/1900000006 · Cited by 547 · cited 1×
“But while provenance has been extensively studied in the database literature (Cheney et al., 2009; Bhardwaj et al., 2014), it has received relatively little attention in machine learning.”
BackgroundPower distribution system design methodology and capacitor selection for modern CMOS technology
Smith, L. D., Anderson, R. E., Forehand, D. W., Pelc, T. J., & Roy, T. (1999) · IEEE Transactions on Advanced Packaging · doi:10.1109/6040.784476 · Cited by 498 · cited 1×
“As an example, having a low equivalent series resistance is important in certain power supply and radio frequency applications, while this parameter is lower priority in most other designs (Smith et al., 1999).”
BackgroundWomen’s involvement in clinical trials: historical perspective and future implications
Liu, K. A., & DiPietro Mager, N. A. (2016) · Pharmacy Practice · doi:10.18549/pharmpract.2016.01.708 · Cited by 476
Gunter, T. D., & Terry, N. P. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e3 · Cited by 439
Undue risk: secret state experiments on humans
(2000) · Choice Reviews Online · doi:10.5860/choice.37-3928 · Cited by 252
Bose, D., Segui-Gomez, S., & Crandall, J. R. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300275 · Cited by 207 · cited 1×
“This practice led to problems similar to the “biased dataset” problems currently faced by the machine learning community: almost all crash-test dummies were designed with prototypical male physiology; only in 2011 did US safety standards require frontal crash tests with “female” crash-test dummies (National Highway Tr…”
Curran, W. J. (1973) · New England Journal of Medicine · doi:10.1056/nejm197310042891406 · Cited by 190
Toward Gender-Inclusive Coreference Resolution
Cao, Y. T., & Daumé, H., III (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.418 · Cited by 180
Self-citationThe Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards
Holland, S., Hosny, A., Newman, S., Joseph, J., & Chmielinski, K. (2018) · arXiv · doi:10.48550/arxiv.1805.03677 · Cited by 175 · cited 1×
“We are heartened to see other groups working on projects similar to datasheets for datasets (Holland et al., 2018).”
BackgroundToward Gender-Inclusive Coreference Resolution
Cao, Y. T., & Daumé, H. (2019) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.1910.13913 · Cited by 162 · cited 1×
“Academic researchers have adopted our proposal and released datasets with accompanying datasheets [e.g., 7, 10, 23, 26].”
DataHub: Collaborative Data Science & Dataset Version Management at ScalePreprint
Bhardwaj, A., Bhattacherjee, S., Chavan, A., Deshpande, A., Elmore, A. J., Madden, S. R., & Parameswaran, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.0798 · Cited by 138 · cited 2×
“Although data provenance has been studied extensively in the databases community [3, 6], it is rarely discussed in the machine learning community, and documenting the creation and use of datasets has received even less attention.”
BackgroundIncreasing Trust in AI Services through Supplier's Declarations of Conformity
Hind, M., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv.org · doi:10.48550/arxiv.1808.07261 · Cited by 134 · cited 2×
“[12] Michael Hind, Sameep Mehta, Aleksandra Mojsilovic, Ravi Nair, Karthikeyan Natesan Ramamurthy, Alexandra Olteanu, and Kush R.”
BackgroundChmielinski, K., Newman, S., Taylor, M., Joseph, J., Thomas, K., Yurkofsky, J., & Qiu, Y. C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.03954 · Cited by 87 · cited 2×
“[9] Kasia Chmielinski, Sarah Newman, Matt Taylor, Josh Joseph, Kemi Thomas, Jessica Yurkofsky, and Yue Chelsea Qiu.”
BackgroundMethodFaden, R. (1996) · JAMA · doi:10.1001/jama.1996.03540200053031 · Cited by 68 · cited 1×
“For example, the US government ran experiments on citizens without their consent, including a study of patients with syphilis who were not told they were sick (Curran, 1973) and radiation experiments (Faden et al., 1996; Moreno, 2013).”
BackgroundExploring Willingness to Participate in Clinical Trials by Ethnicity
Pariera, K. L., Murphy, S. T., Meng, J., & McLaughlin, M. L. (2016) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-016-0280-6 · Cited by 57
(2018) · arXiv (Cornell University) · Cited by 41
The New InvestorPreprint
Lin, T. C. W. (2012) · SSRN Electronic Journal · Cited by 20
Baselines and a datasheet for the Cerema AWP datasetPreprint
Seck, I., Dahmane, K., Duthon, P., & Loosli, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04016 · Cited by 15 · cited 1×
“[21] Ismaïla Seck, Khouloud Dahmane, Pierre Duthon, and Gaëlle Loosli.”
BackgroundThe emergence of the cooperative clinical trial.
Hf, D. (1975) · PubMed · Cited by 14
Humanities Data in the Library: Integrity, Form, Access
Padilla, T. G. (2016) · D-Lib Magazine · doi:10.1045/march2016-padilla · Cited by 13
Nolan, M. R., & Nguyen, T.-L. (2013) · Journal of Women s Health · doi:10.1089/jwh.2013.4400 · Cited by 10
Issues with Federal Motor Vehicle Safety Standards
Canis (2017) · Cited by 3
DataSheets: Making Geoscience Data Easier to Find and Use
Manduca, C. A., Fox, S., & Rissler, H. (2006) · AGUFM · Cited by 1
Research works printed but not linked: 7
- Chui, G. Project will use AI to prevent or minimize electric grid failures, 2017.
- Garvie, C., Bedoya, A., and Frankle, J. The Perpetual Line-Up: Unregulated Police Face Recognition in America. Georgetown Law, Center on Privacy & Technology, Washington, D.C., 2016.
- Holstein, K., Vaughan, J., Daumé, H, Dudík, M., and Wallach, H. Improving fairness in machine learning systems: What do industry practitioners need? In Proceedings of 2019 ACM CHI Conf. on Human Factors in Computing Systems.
- Krasin, I. et al. OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017.
- O'Connor, M. How AI Could Smarten Up Our Water System, 2017.
- Doha Supply Systems. Facial Recognition, 2017.
- Yagcioglu, S., Erdem, A., Erdem, E., and Ikizler-Cinbis, N. RecipeQA: A challenge dataset for multimodal comprehension of cooking recipes. In Proceedings of the 2018 Conf. on Empirical Methods in Natural Language Processing.
Cited by
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00371 · Cited by 11,953
“In §F.1 we provide a Dataset Card for SA-1B, following [39], in a list of questions and answers.”
MethodLarge language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Metadata
- Authors
- Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K.
- Affiliations
- DAIR Institute (US)
- University of Washington (US)
- Cornell University (US)
- Microsoft Research New York City (United States) (US)
- University of Maryland, College Park, MD
- University of Southern California (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2021-11-19
- Volume
- 64
- Issue
- 12
- Pages
- 86-92
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2795038878
- Semantic Scholar
- 0df347f5e3118fac7c351917e3a497899b071d1e
- Cited by
- 2,469
- References
- 37
- Citations by year
- 2026: 788 · 2025: 402 · 2024: 298 · 2023: 379 · 2022: 221 · 2021: 217
- FWCI
- 252.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- Alfred P. Sloan Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Keywords
- dataset documentation, data provenance, data sharing, data reuse, metadata
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.