The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Data Cleaning for Accurate, Fair, and Robust Models: A Big Data - AI Integration Approach
Abstract
The wide use of machine learning is fundamentally changing the software development paradigm (a.k.a. Software 2.0) where data becomes a first-class citizen, on par with code. As machine learning is used in sensitive applications, it becomes imperative that the trained model is accurate, fair, and robust to attacks. While many techniques have been proposed to improve the model training process (in-processing approach) or the trained model itself (post-processing), we argue that the most effective method is to clean the root cause of error: the data the model is trained on (pre-processing). Historically, there are at least three research communities that have been separately studying this problem: data management, machine learning (model fairness), and security. Although a significant amount of research has been done by each community, ultimately the same datasets must be preprocessed, and there is little understanding how the techniques relate to each other and can possibly be integrated. We contend that it is time to extend the notion of data cleaning for modern machine learning needs. We identify dependencies among the data preprocessing techniques and propose MLClean, a unified data cleaning framework that integrates the techniques and helps train accurate and fair models. This work is part of a broader trend of Big data -- Artificial Intelligence (AI) integration.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Methods to automatically identify the appropriate data cleaning activities for an incomplete or biased dataset are still emerging, but could be achieved with the use of frameworks such as MLClean (that removes data poisoning to help training accurate and fair models [100]) and tools such as like HoloClean, Activeclean [98,99] and Universal Cleanser [160].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [100]
Citations
Cites
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581 · cited 4×
“More recently, there are mitigation techniques for fixing unfairness, which can be done before (pre-processing), during (in-processing), or after (post-processing) model training [2].”
BackgroundMethodInfluentialUnderstanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514 · cited 1×
“In order to distinguish the two cases, we may want to use a previous model and techniques such as influence functions [8] to estimate whether the model’s accuracy drastically changes when the example is removed.”
MethodAI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884
Data Cleaning: Overview and Emerging Challenges
Chu, X., Ilyas, I. F., Krishnan, S., & Wang, J. (2016) · Proceedings of the 2016 International Conference on Management of Data · doi:10.1145/2882903.2912574 · Cited by 488
HoloClean: holistic data repairs with probabilistic inference
Rekatsinas, T., Chu, X., Ilyas, I. F., & Ré, C. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137631 · Cited by 480 · cited 1×
“mework can be extended to more general combinations of data sanitization, data cleaning, and unfairness mitigation. Beyond removing duplicates, data cleaning can be any general process like HoloClean [11]. Data sanitization can also employ more sophisticated defenses [9]. Of course, one should carefully analyze the po…”
BackgroundTFX: A TensorFlow-Based Production-Scale Machine Learning Platform
Baylor, D., Breck, E., Cheng, H.-T., Fiedel, N., Foo, C. Y., Haque, Z., Haykal, S., Ispir, M., Jain, V., Koc, L., et al. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098021 · Cited by 350
Self-citationThe Frontiers of Fairness in Machine Learning
Chouldechova, A., & Roth, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08810 · Cited by 219 · cited 2×
“, reweighed [3]) to maximize fairness.”
BackgroundData Management Challenges in Production Machine Learning
Polyzotis, N., Roy, S., Whang, S. E., & Zinkevich, M. (2017) · Proceedings of the 2017 ACM International Conference on Management of Data · doi:10.1145/3035918.3054782 · Cited by 208 · cited 2×
“More recently, there are efforts to improve machine learning accuracy [5] and data validation techniques for machine learning pipelines [10].”
BackgroundMethodSelf-citationStronger Data Poisoning Attacks Break Data Sanitization Defenses
Koh, P. W., Steinhardt, J., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1811.00741 · Cited by 189 · cited 2×
“ing spam filtering, autonomous driving, and cybersecurity. A major problem is that the training data is often collected from external data sources, which are vulnerable to attacks by malicious actors [9]. A popular solution is to make the model training more robust. Another approach that is gaining interest is sanitiz…”
BackgroundMethodStronger data poisoning attacks break data sanitization defenses
Koh, P. W., Steinhardt, J., & Liang, P. (2022) · Machine Learning · doi:10.1007/s10994-021-06119-y · Cited by 187
Cited by
A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective
Roh, Y., Heo, G., & Whang, S. E. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2946162 · Cited by 968
“More recently, MLCLEAN [166] has been proposed to integrate three data operations: traditional data cleaning, model unfairness mitigation where the goal is to remove data bias that causes model fairness, and data sanitization where the goal is to remove data poisoning.”
BackgroundSelf-citationTrustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“Data Preprocessing Anomaly Detection [70, 81, 257, 316] Data Anonymozation [14, 37, 232, 232] Differential Privacy [107, 110, 177]”
BackgroundOperationalising ethics in artificial intelligence for healthcare: a framework for AI developers
Solanki, P., Grundy, J., & Hussain, W. (2023) · AI and Ethics · doi:10.1007/s43681-022-00195-z · Cited by 157
A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration PerspectivePreprint
Roh, Y., Heo, G., & Whang, S. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.03402 · Cited by 150
“More recently, MLCLEAN [166] has been proposed to integrate three data operations: traditional data cleaning, model unfairness mitigation where the goal is to remove data bias that causes model fairness, and data sanitization where the goal is to remove data poisoning.”
BackgroundSelf-citationTime Series Data Cleaning: A Survey
Wang, X., & Wang, C. (2019) · IEEE Access · doi:10.1109/access.2019.2962152 · Cited by 143
“time series cleaning because they [64], [75], [84], [98] are originally used to solve traditional database cleaning problems.”
Background
Metadata
- Authors
- Tae, K. H., Roh, Y., Oh, Y. H., Kim, H., & Whang, S. E.
- Affiliations
- Korea Advanced Institute of Science and Technology (KR)
- Venue
- Proceedings of the 3rd International Workshop on Data Management for End-to-End Machine Learning
- Publisher
- ACM
- Published
- 2019-06-30
- Pages
- 1-4
- OpenAlex
- W2962863665
- Cited by
- 62
- References
- 10
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 13 · 2023: 8 · 2022: 11 · 2021: 13 · 2020: 2 · 2019: 2
- FWCI
- 10.11
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Engineering Research Center Program through the National Research Foundation of Korea (NRF-2018R1A5A1059921)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- data cleaning, data preprocessing, model fairness, model robustness, data quality, data management, machine learning security, post-processing, in-processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data Cleaning for Accurate, Fair, and Robust Models: A Big Data - AI Integration Approach. https://app.cochat.ai/papers/10.1145/3329486.3329493
- The paper
- Tae, K. H., Roh, Y., Oh, Y. H., Kim, H., & Whang, S. E. (2019). Data Cleaning for Accurate, Fair, and Robust Models: A Big Data - AI Integration Approach. Proceedings of the 3rd International Workshop on Data Management for End-to-End Machine Learning. https://doi.org/10.1145/3329486.3329493
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.