The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Data excellence for AI: why should you care?
Open accessAbstract
This forum provides a space to engage with the challenges of designing for intelligent algorithmic experiences. We invite articles that tackle the tensions between research and practice when integrating AI and UX design. We welcome interdisciplinary debate, artful critique, forward-looking research, case studies of AI in practice, and speculative design explorations. --- Juho Kim and Henriette Cramer, Editors
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The UK government has recently published an Algorithmic Transparency Standard 3 alongside templates designed to help public sector organisations to document the datasets that underlie their ML tools.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [3]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Software Engineering for Machine Learning: A Case Study
Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., & Zimmermann, T. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00042 · Cited by 1,135
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781
Self-citationMachine learning training to support diversity of opinionPreprint
Christensen, J., & Watson, B. A. (2021) · doi:10.31219/osf.io/m6fdg · Cited by 1
Reducing Annotation Artifacts in Crowdsourcing Datasets for Natural Language Processing
Anonymous, A. (2020) · Figshare · doi:10.6084/m9.figshare.12962480.v1 · Cited by 1
Reducing Annotation Artifacts in Crowdsourcing Datasets for Natural Language Processing
Anonymous, A. (2020) · Figshare · doi:10.6084/m9.figshare.12962480 · Cited by 1
Research works printed but not linked: 2
- Aroyo , L. and Paritosh , P . Uncovering unknown unknowns in machine learning. Google AI blog . Feb. 11, 2021 ; https://ai.googleblog.com/2021/02/uncovering-unknown-unknowns-in-machine.html Aroyo, L. and Paritosh, P. Uncovering unknown unknowns in machine learning. Google AI blog. Feb. 11, 2021; https://ai.googleblog.com/2021/02/uncovering-unknown-unknowns-in-machine.html
- Kapania , S. , Sambasivan , N. , Olson , K. , Highfill , H. , Akrong , D. , Paritosh , P. , and Aroyo , L . Data desiderata: Reliability and fidelity in high-stakes AI . 1st Data Excellence Workshop at HCOMP 2020 . Kapania, S., Sambasivan, N., Olson, K., Highfill, H., Akrong, D., Paritosh, P., and Aroyo, L. Data desiderata: Reliability and fidelity in high-stakes AI. 1st Data Excellence Workshop at HCOMP 2020.
Cited by
Data-centric Artificial Intelligence: A Survey
Zha, D., Bhat, Z. P., Lai, K.-H., Yang, F., Jiang, Z., Zhong, S., & Hu, X. (2025) · ACM Computing Surveys · doi:10.1145/3711118 · Cited by 334
The Principles of Data-Centric AI
Jarrahi, M. H., Memariani, A., & Guha, S. (2023) · Communications of the ACM · doi:10.1145/3571724 · Cited by 204
DataPerf: Benchmarks for Data-Centric AI Development
Mazumder, M., Banbury, C., Yao, X., Karlaš, B., Rojas, W. G., Diamos, S., Diamos, G., He, L., Parrish, A., Kirk, H. R., et al. (2022) · TU/e Research Portal · doi:10.48550/arxiv.2207.10062 · Cited by 138
Self-citationA Survey of Data Quality Requirements That Matter in ML Development Pipelines
Priestley, M., O’donnell, F., & Simperl, E. (2023) · Journal of Data and Information Quality · doi:10.1145/3592616 · Cited by 86
Better, Not Just More: Data-centric machine learning for Earth observation
Roscher, R., Rußwurm, M., Gevaert, C. M., Kampffmeyer, M., dos Santos, J. A., Vakalopoulou, M., Hänsch, R., Hansen, S., Nogueira, K., Prexl, J., et al. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3470986 · Cited by 65
Metadata
- Authors
- Aroyo, L., Lease, M., Paritosh, P., & Schaekermann, M.
- Affiliations
- Google (United States) (US)
- The University of Texas at Austin (US)
- Amazon (United States) (US)
- Venue
- Interactions
- Published
- 2022-02-25
- Volume
- 29
- Issue
- 2
- Pages
- 66-69
- ISSN
- 1072-5520 (ISSN-L)
- 1558-3449
- OpenAlex
- W4214634229
- Cited by
- 31
- References
- 4
- Citations by year
- 2026: 8 · 2025: 5 · 2024: 7 · 2023: 10 · 2022: 1
- FWCI
- 2.84
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- interactions (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- speculative design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.