An Incorrect Data Detection Method for Big Data Cleaning of Machinery Condition Monitoring
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The presence of incorrect data leads to the decrease of condition-monitoring big data quality. As a result, unreliable or misleading results are probably obtained by analyzing these poor-quality data. In this paper, to improve the data quality, an incorrect data detection method based on an improved local outlier factor (LOF) is proposed for data cleaning. First, a sliding window technique is used to divide data into different segments. These segments are considered as different objects and their attributes consist of time-domain statistical features extracted from each segment, such as mean, maximum and peak-to-peak value. Second, a kernel-based LOF (KLOF) is calculated using these attributes to evaluate the degree of each segment being incorrect data. Third, according to these KLOF values and a threshold value, incorrect data are detected. Finally, a simulation of vibration data generated by a defective rolling element bearing and three real cases concerning a fixed-axle gearbox, a wind turbine, and a planetary gearbox are used to verify the effectiveness of the proposed method, respectively. The results demonstrate that the proposed method is able to detect both missing segments and abnormal segments, which are two typical incorrect data, effectively, and thus is helpful for big data cleaning of machinery condition monitoring.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“Specifically, the characteristics of high-quality data are considered as contextual attributes [15].”
BackgroundLOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149 · cited 2×
“Being a classical-density based method, a local outlier factor (LOF) method was first proposed in [29].”
BackgroundMethodA Survey of Outlier Detection Methodologies
Hodge, V., & Austin, J. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-4304-y · Cited by 3,596
Hawkins, D. M. (1980) · doi:10.1007/978-94-015-3994-4 · Cited by 2,982 · cited 1×
“Outlier detection [19], which is also heavily used and known as anomaly detection, is widely studied in many fields such as credit card fraud detection, cyber-security, traffic, and medical field [20].”
BackgroundChen, M., Mao, S., & Liu, Y. (2014) · Mobile Networks and Applications · doi:10.1007/s11036-013-0489-0 · Cited by 2,913
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
A new convolutional neural network-based data-driven fault diagnosis method
Wen, L., Li, X., Gao, L., & Zhang, Y. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2774777 · Cited by 2,222 · cited 1×
“ferent intelligent diagnosis methods have been proposed based on deep belief networks [5], recurrent neural networks [6], and convolutional neural networks [7] to extract fault features from condition-monitoring data, more effectively.”
BackgroundService Innovation and Smart Analytics for Industry 4.0 and Big Data Environment
Lee, J., Kao, H.-A., & Yang, S. (2014) · Procedia CIRP · doi:10.1016/j.procir.2014.02.001 · Cited by 1,965
A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings
Wang, B., Lei, Y., Li, N., & Li, N. (2020) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2882682 · Cited by 1,917
Self-citation
Cited by
Items 101–137 of 137
Mahawar, K., & Rattan, P. (2023) · International Conference on Advanced Computing & Communication Technologies (ICACCTech) · doi:10.1109/icacctech61146.2023.00014 · Cited by 2
Industrial anomaly detection via a knowledge-informed density-aware reconstruction framework
Bai, X., Wang, Y., Liu, Z., & Tan, J. (2026) · Computers in Industry · doi:10.1016/j.compind.2026.104500 · Cited by 1
Overview of Intelligent Fault Diagnosis and Maintenance for Rotating Machinery
Wen, G., Lei, Z., Chen, X., & Huang, X. (2024) · Smart sensors, measurement and instrumentation · doi:10.1007/978-981-97-1176-5_1 · Cited by 1
Xie, Q., Wang, J., Dong, G.-S., Tao, G., Xie, C., & Wen, Z. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129407 · Cited by 1
Induction Motor Bearing Fault Diagnosis Using Taylor-Fourier Filters on Stray Flux Signals
Aguayo-Tapia, S., Avalos-Almazan, G., Rangel‐Magdaleno, J., Daviu, J. A. A., Ruiz-Sarrio, J. E., & Dunai, L. (2025) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie62713.2025.11124643 · Cited by 1
Xie, Q., Wang, J., Liu, F., Yang, J., Tao, G., & Wen, Z. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3616106 · Cited by 1
Huang, X., Ding, C., Du, G., Cheng, D., Wang, B., Que, H., & Zhu, Z. (2026) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2026.3655930 · Cited by 1
Xu, X., Hu, P., Ge, L., Qiao, Z., Shi, P., & Karimi, H. R. (2026) · Structural Health Monitoring · doi:10.1177/14759217261433260 · Cited by 1
Self-citationMulti-agent data cleaning framework of solid-state batteries using large language models
Wang, Z., Ma, Y., Peng, S., Gao, J., Khajorntraidet, C., Huang, Y., & Chen, H. (2026) · Green Energy and Intelligent Transportation · doi:10.1016/j.geits.2026.100401 · Cited by 1
A New Index for Detecting Frequency of Unknown Underwater Weak Signals with Genetic Algorithm
Yu, W., & Li, X. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130290 · Cited by 1
Xiao-li, W., Liu, Y., Chen, L., & Zhang, Y. (2022) · SAGE Open · doi:10.1177/21582440221141299 · Cited by 1
Optimizing Data Extraction with UiPath: A Web Scraping Conclusion
K, P. G., Tejaswini, G., & Sindhu, P. S. (2024) · International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS) · doi:10.1109/csitss64042.2024.10816741 · Cited by 1
Study of Data Repetitive Record Cleaning Technology of MES System in High-Tech Process
Chang, K., Chu, K.-C., Lin, Y.-C., Chang, F.-H., Wang, H.-C., Hsu, T.-L., Nguyen, T.-T., & Sung, T. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-69717-4_102 · Cited by 1
Choudhary, T., Shaikh, M., Khedekar, S., Sirwani, R., & Thalor, M. A. (2021) · International Journal of Scientific Research in Science and Technology · doi:10.32628/ijsrst21825
Deep Transfer Learning-Based Intelligent Fault Diagnosis
Lei, Y., Li, N., & Li, X. (2022) · Springer eBooks · doi:10.1007/978-981-16-9131-7_4
Self-citationA Diagnosis Method of Cleanliness Defect in Rolling Element Bearing Manufacturing
Wang, W., Lei, Y., Chen, Z., Yang, B., He, P., & Li, X. (2022) · Global Reliability and Prognostics and Health Management Conference (PHM) · doi:10.1109/phm-yantai55411.2022.9941807
Self-citationComprehensive Evaluation of Suppliers Based on Analytic Hierarchy Process
Jiang, J., Fei, X., Yin, X., Cheng, X., Kuang, P., & Zhang, Z. (2022) · International Conference on Data Analytics, Computing and Artificial Intelligence (ICDACAI) · doi:10.1109/icdacai57211.2022.00016
A Data Analytics Approach for Solving Vehicle Routing Problem Using Real Time Data
soliman, M. (2023) · Bulletin of Faculty of Science Zagazig University · doi:10.21608/bfszu.2023.160904.1180
Industrial Anomaly Detection Via Knowledge-Informed Density-Aware Reconstruction FrameworkPreprint
Bai, X., Wang, Y., Liu, Z., & Tan, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4815746
Chen, H., Chen, J., Luo, Y., Chen, H., Wang, C., & Guo, L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4829703
A Dirty Data Detection Method for Stream Data Cleaning of Online Machinery Condition Monitoring
Xu, X., Yang, X., Li, B., Bao, S., & Shi, P. (2024) · Mechanisms and machine science · doi:10.1007/978-3-031-49421-5_56
Self-citationUr, R. K., Mian, Z., & Yasir, A. (2024) · Research Square · doi:10.21203/rs.3.rs-3053231/v2
Pressure Equipment Status Data Cleaning Method Based on LSTM-VAE-GAIN
Yin, C., Wang, R., Zhang, Y., & Peng, H. M. (2024) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea62105.2024.10603579
Data Validity Determination of HVDC Audible Noise Using Temporal and Spatial Correlation Features
Zhao, P., Yuan, H., Lv, J., Deng, Y., Wang, Z., & Liu, A. (2024) · IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea61579.2024.10665128
Conclusion, Challenges, and Future Work
Wen, G., Lei, Z., Chen, X., & Huang, X. (2024) · Smart sensors, measurement and instrumentation · doi:10.1007/978-981-97-1176-5_15
Zhang, Z. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-2794-3_25 · Cited by 1
Transformer Data Correction Approaches Based on GMM and BiGRU
Lu, B., Yang, G., Jia, J., Li, K., Wang, K., & Yang, L. (2024) · Asia-Pacific Power and Energy Engineering Conference (APPEEC) · doi:10.1109/appeec61255.2024.10922574
Chen, H., Chen, J., Luo, Y., Li, C., Chen, H., & Tian, C. (2025) · Measurement Science and Technology · doi:10.1088/1361-6501/ade611
Lv, J., Wang, J., Lou, Z., & Lu, S. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3645845
RAGAVAN, A. J. (2024) · ScholarWorks (Walden University) · Cited by 2
Data Transformation Model For Addressing Incomplete And Inconsistent Quality Issues Of Big Data
Onyeabor, G. A. (2024) · UUM Electronic Theses and Dissertation [eTheses] (Northern University of Malaysia)
Quetez, M. F. D. O., Oliveira, M. N. D., Filho, M. N. B., Waldmann, A. T. A., Scheid, C. M., & Calçada, L. A. (2026) · SPE Journal · doi:10.2118/231848-pa
Transformer-Based Missing Data Imputation in Time Series With Application to Flight Test Data
Li, J., Li, L., Dong, Y., Xie, H., & Qin, S. J. (2026) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2026.3672736 · Cited by 1
Synchronized Acquisition and Intelligent Cleaning of Multi-Source Monitoring Data in CNC Machining
Wang, J., Yang, B., Li, X., Si, X., Zhang, J., & Lei, Y. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11487224
Self-citationLabel-Consistent Input Structuring Based on Second-Stage Sliding Window for PMSM Fault Diagnosis
NGUYEN, T. S., Khunkitti, P., Siritaratiwat, A., & Seangwong, P. (2026) · IEEE Open Journal of the Industrial Electronics Society · doi:10.1109/ojies.2026.3699362
Chen, D., Chen, X., Wang, Z., Wang, J., Shi, L., & Zhou, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-9284-5_3
Liao, Z., Yan, Z., Jia, B., & Song, X. (2026) · iScience · doi:10.1016/j.isci.2026.117955
Metadata
- Authors
- Xu, X., Lei, Y., & Li, Z.
- Affiliations
- Xi'an Jiaotong University (CN)
- Venue
- IEEE Transactions on Industrial Electronics
- Published
- 2020-03
- Volume
- 67
- Issue
- 3
- Pages
- 2326-2336
- ISSN
- 0278-0046 (ISSN-L)
- 1557-9948
- OpenAlex
- W2921480582
- Cited by
- 134
- References
- 40
- Citations by year
- 2026: 8 · 2025: 17 · 2024: 16 · 2023: 26 · 2022: 28 · 2021: 21 · 2020: 16
- FWCI
- 9.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Industrial Electronics (publishedVersion)
- Funders
- National Natural Science Foundation of China (61673311)
- NSFC-Zhejiang Joint Fund for the Integration of Industrialization and Informatization (U1709208)
- National Program for Support of Top-Notch Young Professionals
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
- Keywords
- machine condition monitoring, local outlier factor, sliding window segmentation, time-domain statistical features, vibration data, gearbox condition monitoring, wind turbine condition monitoring, planetary gearbox, data quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.