Cited by 354Data Quality and ManagementMachine Learning and Data ClassificationResearch Data Management Practices

A survey on dataset quality in machine learning

Open access
Gong, Youdi, Liu, Guangzhen, Xue, Yunzhi, Li, Rui, Meng, Lingzhong·2023·Information and Software Technology

Abstract

With the rise of big data, the quality of datasets has become a crucial factor affecting the performance of machine learning models. High-quality datasets are essential for the realization of data value. This survey article summarizes the research direction of dataset quality in machine learning, including the definition of related concepts, analysis of quality issues and risks, and a review of dataset quality dimensions and metrics throughout the dataset lifecycle and a review of dataset quality metrics analyzed from a dataset lifecycle perspective and summarized in literatures. Furthermore, this article introduces a comprehensive quality evaluation process, which includes a framework for dataset quality evaluation with dimensions and metrics, computation methods for quality metrics, and assessment models. These studies provide valuable guidance for evaluating dataset quality in the field of machine learning, which can help improve the accuracy, efficiency, and generalization ability of machine learning models, and promote the development and application of artificial intelligence technology.

Integrity signals

Registry

Crossref · 10.1016/j.infsof.2023.107268

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

3 of the 60 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Gong, Y., Liu, G., Xue, Y., Li, R., & Meng, L.
Affiliations
Chinese Academy of Sciences (CN)
Corresponding author
Meng, Lingzhong
Venue
Information and Software Technology
Publisher
Elsevier BV
Published
2023-10
Volume
162
Pages
107268
ISSN
0950-5849 (ISSN-L)
OpenAlex
W4378978494
Cited by
354
References
60
Citations by year
2026: 136 · 2025: 145 · 2024: 67 · 2023: 6
FWCI
65.17
Type
journal article
Language
en
Open access
Locations
Information and Software Technology (publishedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
Keywords
dataset quality, quality assessment framework, quality dimensions, quality risk, big data, machine learning data

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review