Time Series Data Cleaning: A Survey
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Errors are prevalent in time series data, which is particularly common in the industrial field. Data with errors could not be stored in the database, which results in the loss of data assets. At present, to deal with these time series containing errors, besides keeping original erroneous data, discarding erroneous data and manually checking erroneous data, we can also use the cleaning algorithm widely used in the database to automatically clean the time series data. This survey provides a classification of time series data cleaning techniques and comprehensively reviews the state-of-the-art methods of each type. Besides we summarize data cleaning tools, systems and evaluation criteria from research and industry. Finally, we highlight possible directions time series data cleaning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149 · cited 3×
“Diao et al. [29] design LOF [14] based online anomaly detection and cleaning algorithm.”
MethodAn online algorithm for segmenting time series
Keogh, E., Chu, S., Hart, D., & Pazzani, M. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989531 · Cited by 1,149 · cited 2×
“As shown in Table 2, there are many methods based on smoothing, such as the state-space model [56], [68], [87] and Interpolation [59], [95].”
MethodLSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819 · cited 1×
“[110] provide recurrent neural networks by providing network time series data.”
BackgroundData Quality in Internet of Things: A state-of-the-art survey
Karkouch, A., Mousannif, H., Al Moatassime, H., & Noel, T. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.08.002 · Cited by 378 · cited 3×
“[58] also explain in detail the IoT data errors generated by various complex environments.”
BackgroundMethodInfluentialFilonov, P., Lavrentyev, A., & Vorontsov, A. (2016) · arXiv · doi:10.48550/arxiv.1612.06676 · Cited by 140
Data Cleaning for Accurate, Fair, and Robust Models: A Big Data - AI Integration Approach
Tae, K. H., Roh, Y., Oh, Y. H., Kim, H., & Whang, S. E. (2019) · Proceedings of the 3rd International Workshop on Data Management for End-to-End Machine Learning · doi:10.1145/3329486.3329493 · Cited by 62 · cited 1×
“time series cleaning because they [64], [75], [84], [98] are originally used to solve traditional database cleaning problems.”
Background
Cited by
Digital Twin of City: Concept Overview
Ivanov, S., Nikolskaya, K., Radchenko, G., Sokolinsky, L., & Zymbler, M. (2020) · 2020 Global Smart Industry Conference (GloSIC) · doi:10.1109/glosic50886.2020.9267879 · Cited by 138
“Thus, for use in the digital twin of the city, the sensor data need to be cleaned [39], [47].”
BackgroundA Systematic Review of Data Quality in CPS and IoT for Industry 4.0
Goknil, A., Nguyen, P., Sen, S., Politaki, D., Niavis, H., Pedersen, K. J., Suyuthi, A., Anand, A., & Ziegenbein, A. (2023) · ACM Computing Surveys · doi:10.1145/3593043 · Cited by 84
Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach
Bayram, F., & Ahmed, B. S. (2025) · ACM Computing Surveys · doi:10.1145/3708497 · Cited by 48
“Furthermore, the implementation of a well-defined validation mechanism not only leads to more reproducible solutions [83] but also helps mitigate the risks associated with ML models in general, such as security concerns [111], adversarial attacks [148], and risks related to algorithms and data…”
IoT data cleaning techniques: A survey
Ding, X., Wang, H., Li, G., Li, H., Li, Y., & Liu, Y. (2022) · Intelligent and Converged Networks · doi:10.23919/icn.2022.0026 · Cited by 35
Metadata
- Authors
- Wang, X., & Wang, C.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 1866-1881
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2998531464
- Cited by
- 132
- References
- 6
- FWCI
- 7.23
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.