An Incorrect Data Detection Method for Big Data Cleaning of Machinery Condition Monitoring
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The presence of incorrect data leads to the decrease of condition-monitoring big data quality. As a result, unreliable or misleading results are probably obtained by analyzing these poor-quality data. In this paper, to improve the data quality, an incorrect data detection method based on an improved local outlier factor (LOF) is proposed for data cleaning. First, a sliding window technique is used to divide data into different segments. These segments are considered as different objects and their attributes consist of time-domain statistical features extracted from each segment, such as mean, maximum and peak-to-peak value. Second, a kernel-based LOF (KLOF) is calculated using these attributes to evaluate the degree of each segment being incorrect data. Third, according to these KLOF values and a threshold value, incorrect data are detected. Finally, a simulation of vibration data generated by a defective rolling element bearing and three real cases concerning a fixed-axle gearbox, a wind turbine, and a planetary gearbox are used to verify the effectiveness of the proposed method, respectively. The results demonstrate that the proposed method is able to detect both missing segments and abnormal segments, which are two typical incorrect data, effectively, and thus is helpful for big data cleaning of machinery condition monitoring.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“Specifically, the characteristics of high-quality data are considered as contextual attributes [15].”
BackgroundLOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149 · cited 2×
“Being a classical-density based method, a local outlier factor (LOF) method was first proposed in [29].”
BackgroundMethodA Survey of Outlier Detection Methodologies
Hodge, V., & Austin, J. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-4304-y · Cited by 3,596
Hawkins, D. M. (1980) · doi:10.1007/978-94-015-3994-4 · Cited by 2,982 · cited 1×
“Outlier detection [19], which is also heavily used and known as anomaly detection, is widely studied in many fields such as credit card fraud detection, cyber-security, traffic, and medical field [20].”
BackgroundChen, M., Mao, S., & Liu, Y. (2014) · Mobile Networks and Applications · doi:10.1007/s11036-013-0489-0 · Cited by 2,913
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
A new convolutional neural network-based data-driven fault diagnosis method
Wen, L., Li, X., Gao, L., & Zhang, Y. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2774777 · Cited by 2,222 · cited 1×
“ferent intelligent diagnosis methods have been proposed based on deep belief networks [5], recurrent neural networks [6], and convolutional neural networks [7] to extract fault features from condition-monitoring data, more effectively.”
BackgroundService Innovation and Smart Analytics for Industry 4.0 and Big Data Environment
Lee, J., Kao, H.-A., & Yang, S. (2014) · Procedia CIRP · doi:10.1016/j.procir.2014.02.001 · Cited by 1,965
A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings
Wang, B., Lei, Y., Li, N., & Li, N. (2020) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2882682 · Cited by 1,917
Self-citation
Cited by
Applications of machine learning to machine fault diagnosis: A review and roadmap
Lei, Y., Yang, B., Jiang, X., Jia, F., Li, N., & Nandi, A. K. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2019.106587 · Cited by 2,997
Self-citationBig data analytics for smart factories of the future
Gao, R. X., Wang, L., Helu, M., & Teti, R. (2020) · CIRP Annals · doi:10.1016/j.cirp.2020.05.002 · Cited by 170
Artificial Intelligence to Power the Future of Materials Science and Engineering
Sha, W., Guo, Y., Yuan, Q. M., Tang, S., Zhang, X., Lu, S., Guo, X., Cao, Y., & Cheng, S. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.201900143 · Cited by 171
A Comprehensive Survey on Imputation of Missing Data in Internet of Things
Adhikari, D., Jiang, W., Zhan, J., He, Z., Rawat, D. B., Aickelin, U., & Khorshidi, H. A. (2022) · ACM Computing Surveys · doi:10.1145/3533381 · Cited by 196
Wang, Z., Zhao, W., Du, W., Li, N., & Wang, J. (2021) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2021.03.016 · Cited by 147
Metadata
- Authors
- Xu, X., Lei, Y., & Li, Z.
- Affiliations
- Xi'an Jiaotong University (CN)
- Venue
- IEEE Transactions on Industrial Electronics
- Published
- 2020-03
- Volume
- 67
- Issue
- 3
- Pages
- 2326-2336
- ISSN
- 0278-0046 (ISSN-L)
- 1557-9948
- OpenAlex
- W2921480582
- Cited by
- 134
- References
- 40
- Citations by year
- 2026: 8 · 2025: 17 · 2024: 16 · 2023: 26 · 2022: 28 · 2021: 21 · 2020: 16
- FWCI
- 9.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Industrial Electronics (publishedVersion)
- Funders
- National Natural Science Foundation of China (61673311)
- NSFC-Zhejiang Joint Fund for the Integration of Industrialization and Informatization (U1709208)
- National Program for Support of Top-Notch Young Professionals
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
- Keywords
- machine condition monitoring, local outlier factor, sliding window segmentation, time-domain statistical features, vibration data, gearbox condition monitoring, wind turbine condition monitoring, planetary gearbox, data quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Incorrect Data Detection Method for Big Data Cleaning of Machinery Condition Monitoring. https://app.cochat.ai/papers/10.1109/tie.2019.2903774
- The paper
- Xu, X., Lei, Y., & Li, Z. (2020). An Incorrect Data Detection Method for Big Data Cleaning of Machinery Condition Monitoring. IEEE Transactions on Industrial Electronics. https://doi.org/10.1109/tie.2019.2903774
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.