Learn2Clean: Optimizing the Sequence of Tasks for Web Data Preparation
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Data cleaning and preparation has been a long-standing challenge in data science to avoid incorrect results and misleading conclusions obtained from dirty data. For a given dataset and a given machine learning-based task, a plethora of data preprocessing techniques and alternative data curation strategies may lead to dramatically different outputs with unequal quality performance. Most current work on data cleaning and automated machine learning, however, focus on developing either cleaning algorithms or user-guided systems or
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The first of these relates to data iteration, where the steps of model building and testing are frequently followed by the need to collect new data, or enriching the existing dataset [5,11,31,34].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [11]
In the citing paper
“As mentioned during the pre-processing stage, automated techniques can be used to select the optimal sequence of data preprocessing tasks that maximise the performance of the ML model [11].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [11]
Citations
Cites
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“Four imputation methods were used to im-pute missing values: two distance-based imputation methods: Expectation-Maximization (EM), K-NN [1], Multiple Imputation by Chained Equations ( MICE ) [5], and replacement by the most frequent value (MF); • Outlier detection .”
MethodWrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947 · cited 1×
“Four methods were tested to select an optimal set of features, namely: based on a user-defined acceptable ratio of missing values (MR), removing collinear features (LC), using a wrapper subset evaluator (WR) [8], and a tree-based classifier for feature selection (TB); • Imputation .”
MethodWatkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
(2015) · neural information processing systems · Cited by 1,305
OpenML: networked science in machine learning
Vanschoren, J., van Rijn, J. N., Bischl, B., & Torgo, L. (2014) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2641190.2641198 · Cited by 1,141
Data Cleaning: Overview and Emerging Challenges
Chu, X., Ilyas, I. F., Krishnan, S., & Wang, J. (2016) · Proceedings of the 2016 International Conference on Management of Data · doi:10.1145/2882903.2912574 · Cited by 488 · cited 1×
“…the information presented on Web There are several methods that optimize single data cleaning operations based on downstream accuracy metrics (see [18] for a survey) and also recent approaches such as [17], data transformation learning [22], and AutoML line of work [19, 20] in the area of…”
MethodMultivariate outlier detection in exploration geochemistry
Filzmoser, P., Garrett, R. G., & Reimann, C. (2005) · Computers & Geosciences · doi:10.1016/j.cageo.2004.11.013 · Cited by 460 · cited 1×
“Outliers were detected using three meth-ods including: a statistic-based approach, Inter Quartile Range (IQR), the Z-score-based method (ZSB) [7], and a density-based approach (Local Outlier Factor, LOF) [4].”
MethodA Study of K-Nearest Neighbour as an Imputation Method.
Batista, G. E. A. P. A., & Monard, M. C. (2002) · Cited by 329
Discovery of complex glitch patterns: A novel approach to Quantitative Data Cleaning
Berti-Equille, L., Dasu, T., & Srivastava, D. (2011) · 2011 IEEE 27th International Conference on Data Engineering · doi:10.1109/icde.2011.5767864 · Cited by 63 · cited 2×
“In particular, we plan further experiments with semi-synthetic data where noise injection is carefully controlled in order to study more complex and intricate distributions of various glitch types and patterns [3] (combining duplicates, inconsistencies, missing and outlying values) and their impact on the robustness o…”
BackgroundMethod
Research works printed but not linked: 3
- Berti-Equille L. , Scannapieco M. ( 2016 ). Quality of Web Data (Chapter). In the 2 nd Edition of the book Data Quality : Concepts, Methodologies and Techniques, Springer , 2016. Berti-Equille L., Scannapieco M. (2016). Quality of Web Data (Chapter). In the 2nd Edition of the book Data Quality: Concepts, Methodologies and Techniques, Springer, 2016.
- Bilalli B. , Abelló A. ( 2018 ). PRESISTANT: Learning based assistant for data preprocessing , Arxiv CoRR abs/1803.01024. Bilalli B., Abelló A. (2018). PRESISTANT: Learning based assistant for data preprocessing, Arxiv CoRR abs/1803.01024. · arXiv
- Feurer M. , Hutter F. ( 2018 ). Towards Further Automation in AutoML , Proc. of ICML 2018 AutoML Workshop. Feurer M., Hutter F. (2018). Towards Further Automation in AutoML, Proc. of ICML 2018 AutoML Workshop.
Cited by
Overview and Importance of Data Quality for Machine Learning Tasks
Jain, A., Patel, H., Nagalapatti, L., Gupta, N., Mehta, S., Guttula, S., Mujumdar, S., Afzal, S., Sharma Mittal, R., & Munigala, V. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3406477 · Cited by 293
“We further plan to discuss few automated data cleaning approaches proposed in the literature [1] and finally end the topic by illustrating a real life use-case of deployed data cleaning system in Google [2] and its benefits.”
MethodData Quality for Machine Learning Tasks
Gupta, N., Mujumdar, S., Patel, H., Masuda, S., Panwar, N., Bandyopadhyay, S., Mehta, S., Guttula, S., Afzal, S., Sharma Mittal, R., et al. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3470817 · Cited by 127
“This raises some interesting questions: what should be the guiding factors by which such a sequence can be chosen, how an we quantitatively measure these factors, and, is it possible to find an optimal sequence that allows us to maximize the ML classifier performance [5].”
BackgroundData cleaning and machine learning: a systematic literature review
Côté, P.-O., Nikanjam, A., Ahmed, N., Humeniuk, D. V., & Khomh, F. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00453-w · Cited by 162
“For example, Berti-Equille (2019) designed an RL agent that learns to clean a dataset using a set of data cleaning tools that can clean different types of errors.”
BackgroundMethodInfluentialA Survey of Data Quality Requirements That Matter in ML Development Pipelines
Priestley, M., O’donnell, F., & Simperl, E. (2023) · Journal of Data and Information Quality · doi:10.1145/3592616 · Cited by 86
“The first of these relates to data iteration, where the steps of model building and testing are frequently followed by the need to collect new data, or enriching the existing dataset [5, 11, 31, 34].”
BackgroundMethodInfluentialCollaborative Edge Server Placement for Maximizing QoS With Distributed Data Cleaning
Liang, Y., Yin, M., Wang, W., Liu, Q., Wang, L., Zheng, X., & Wang, T. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3552337 · Cited by 30
“(cid:2) Learn2clean [30]: This strategy employs a model-independent reinforcement learning approach designed to determine the most effective sequence of preprocessing tasks for a specific dataset, machine learning model, and quality performance metric.”
Metadata
- Authors
- Berti-Equille, L.
- Affiliations
- Institute of Research for Development (IRD), France, France
- Venue
- The World Wide Web Conference
- Publisher
- ACM
- Published
- 2019-05-13
- Pages
- 2580-2586
- OpenAlex
- W2914436728
- Cited by
- 54
- References
- 21
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 8 · 2023: 10 · 2022: 6 · 2021: 6 · 2020: 6 · 2019: 2
- FWCI
- 7.16
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- International World Wide Web Conference (WWW) (publishedVersion, cc-by)
- HAL AMU (submittedVersion)
- Funders
- Agence Nationale de la Recherche (ANR-18-CE23-0002)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Keywords
- data cleaning, task sequencing, data preprocessing, automated machine learning, data curation, data quality, web data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learn2Clean: Optimizing the Sequence of Tasks for Web Data Preparation. https://app.cochat.ai/papers/10.1145/3308558.3313602
- The paper
- Berti-Equille, L. (2019). Learn2Clean: Optimizing the Sequence of Tasks for Web Data Preparation. The World Wide Web Conference. https://doi.org/10.1145/3308558.3313602
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.