A novel fusion diagnosis method for rotor system fault based on deep learning and multi-sourced heterogeneous monitoring data
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Deep learning-based fault diagnosis has been acclaimed for its superiority in adaptively mining salient features. The monitoring data used as the input of deep learning typically includes only structured data (e.g. vibration signals, voltage signals, and acoustic emission signals), not unstructured data (e.g. infrared images), which provides another perspective on the mechanical health condition. To apply multi-sourced heterogeneous monitoring data fully, this paper presents a novel fusion diagnosis method integrating structured and unstructured data for rotor system faults. A novel multi-mode convolutional neural network (M-CNN) is first proposed to automatically learn fault-sensitive features from raw multisensory data composed of vibration signals and infrared images. M-CNN equipped with adjustable filter banks can identify data types and adaptively adopt the appropriate convolution mode. Then, t -distributed stochastic neighbor embedding (t-SNE) is introduced to fuse the deep features to further improve the quality of the learned features. Finally, the fused features are employed to conduct fault classification tasks. The effectiveness of the scheme is verified by fault diagnosis experiments in a rotor system, where it achieves a remarkable classification rate of 98.97%. Compared with similar methods, the proposed method exhibits outstanding performance, indicating the feasibility of using multi-sourced heterogeneous data for rotor system fault-diagnosis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2008) · Journal of Machine Learning Research · Cited by 33,051
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“The node number of the first hidden layer is set to be larger than the point number of input data, to ensure that more knowledge can be learned [38].”
BackgroundDeep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894 · cited 2×
“Despite its well-known benefits, the application of deep learning to fault diagnosis faults is limited; presently, there is not a mature and systematic method to determine an appropriate model [8, 16].”
BackgroundMethodMultisensor data fusion: A review of the state-of-the-art
Khaleghi, B., Khamis, A., Karray, F. O., & Razavi, S. N. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.001 · Cited by 2,074 · cited 1×
“Therefore, analyzing multivariate data together leads to vastly superior diagnostic results than monitoring a single aspect [19, 20].”
BackgroundDeep learning for smart manufacturing: Methods and applications
Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2018.01.003 · Cited by 1,740
Self-citationJia, F., Lei, Y., Lin, J., Zhou, X., & Lu, N. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2015.10.025 · Cited by 1,710 · cited 3×
“Accordingly, for bearings and gear-boxes (which are prominent components in a broad spectrum of machines), frequency spectra were entered into SAE [6], DBN [17], and CNN [18] for defect recognition.”
BackgroundMethodZhang, W., Li, C., Peng, G., Chen, Y., & Zhang, Z. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.06.022 · Cited by 1,421 · cited 2×
“Some studies [14, 23] have found that large filter kernels have advantages over small ones in capturing more fault information and suppressing high-frequency noise.”
BackgroundMethodInfrared thermography for condition monitoring – A review
Bagavathiappan, S., Lahiri, B. B., Saravanan, T., Philip, J., & Jayakumar, T. (2013) · Infrared Physics & Technology · doi:10.1016/j.infrared.2013.03.006 · Cited by 979
Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis
Guo, X., Chen, L., & Shen, C. (2016) · Measurement · doi:10.1016/j.measurement.2016.07.054 · Cited by 782 · cited 2×
“Moreover, complex hierarchical structures require a long training time to become a well-trained model [15, 36, 37], and this results in significantly increased computational costs and delays in real-time diagnosis of mechanical failures.”
BackgroundMethod
Cited by
Applications of machine learning to machine fault diagnosis: A review and roadmap
Lei, Y., Yang, B., Jiang, X., Jia, F., Li, N., & Nandi, A. K. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2019.106587 · Cited by 2,997
A comprehensive review on convolutional neural network in machine fault diagnosis
Jiao, J., Zhao, M., Lin, J., & Liang, K. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.088 · Cited by 575
Fault Diagnosis Method Based on Principal Component Analysis and Broad Learning System
Zhao, H., Zheng, J., Xu, J., & Deng, W. (2019) · IEEE Access · doi:10.1109/access.2019.2929094 · Cited by 221
“[38] proposed a novel fusion diagnosis method based on multi-mode convolutional neural network and t-distributed stochastic neighbor embedding.”
MethodRole of artificial intelligence in rotor fault diagnosis: a comprehensive review
Nath, A. G., Udmale, S. S., & Singh, S. K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09910-w · Cited by 172
Li, X., Cheng, J., Shao, H., Liu, K., & Cai, B. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3125385 · Cited by 135
Prognostics and Health Management of Industrial Assets: Current Progress and Road Ahead
Biggio, L., & Kastanis, I. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.578613 · Cited by 127
“Yuan et al. (2018) propose a method that fuses features extracted from different data structures, including infrared images, for CNNbased fault classification of a rotor system.”
MethodFault Diagnosis Methods Based on Machine Learning and its Applications for Wind Turbines: A Review
Sun, T., Yu, G., Gao, M., Zhao, L., Bai, C., & Yang, W. (2021) · IEEE Access · doi:10.1109/access.2021.3124025 · Cited by 100
Vibration and infrared thermography based multiple fault diagnosis of bearing using deep learning
Mian, T., Choudhary, A., & Fatima, S. (2022) · Nondestructive Testing And Evaluation · doi:10.1080/10589759.2022.2118747 · Cited by 88
“This phenomenon encourages the use of IRT as a prominent condition monitoring tool for faults in the components of rotating machines, such as bearing faults, misalignment [10,11] and faults in various electrical rotating machinery [12–14].”
MethodKnowledge-informed deep networks for robust fault diagnosis of rolling bearings
Su, Y., Shi, L., Zhou, K., Bai, G., & Wang, Z. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109863 · Cited by 93
Wang, S., Zheng, C., Ma, T., Wang, T., Gao, S., Dai, Q., Han, Q., & Chu, F. (2024) · Nano Energy · doi:10.1016/j.nanoen.2024.109429 · Cited by 78
Wang, R., Chen, H., Guan, C., Gong, W., & Zhang, Z. (2021) · Applied Ocean Research · doi:10.1016/j.apor.2021.102681 · Cited by 72
Xiong, X., Jiang, H., Li, X., & Niu, M. (2019) · Measurement Science and Technology · doi:10.1088/1361-6501/ab47df · Cited by 64
Structural Rotor Fault Diagnosis Using Attention-Based Sensor Fusion and Transformers
Nath, A. G., Udmale, S. S., Raghuwanshi, D., & Singh, S. K. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3130183 · Cited by 70
A Systematic Review of Multisensor Information Fusion for Equipment Fault Diagnosis
Lin, T., Ren, Z., Zhu, L., Zhu, Y., Feng, K., Ding, W., Yan, K. L., & Beer, M. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3529577 · Cited by 119
Nath, A. G., Udmale, S. S., Raghuwanshi, D., & Singh, S. K. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3079366 · Cited by 51
Vashishtha, G., & Kumar, R. (2021) · Measurement Science and Technology · doi:10.1088/1361-6501/ac2cf2 · Cited by 51
A hybrid deep-learning model for fault diagnosis of rolling bearings in strong noise environments
Zhang, K., Fan, C., Zhang, X., Shi, H., & Li, S. (2022) · Measurement Science and Technology · doi:10.1088/1361-6501/ac4a18 · Cited by 53
Deep feature interactive network for machinery fault diagnosis using multi-source heterogeneous data
Miao, M., & Yu, J. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109795 · Cited by 56
A self-Adaptive CNN with PSO for bearing fault diagnosis
Chen, J., Jiang, J., Guo, X., & Tan, L. (2020) · Systems Science & Control Engineering · doi:10.1080/21642583.2020.1860153 · Cited by 37
“In signal-based methods, there are many kinds of signals such as vibration and acoustic signals (Liu et al., 2016), electric current (Boudinar et al., 2016), temperature (Yuan et al., 2018), and wear debris.”
BackgroundExplainable fault diagnosis of oil-gas treatment station based on transfer learning
Liu, J., Hou, L., Zhang, R., Sun, X., Yu, Q., Yang, K., & Zhang, X. (2022) · Energy · doi:10.1016/j.energy.2022.125258 · Cited by 31
Fault Diagnosis of Shaft Misalignment and Crack in Rotor System Based on MI-CNN
Zhao, W., Hua, C., Wang, D., & Dong, D. (2019) · Lecture notes in mechanical engineering · doi:10.1007/978-981-13-8331-1_39 · Cited by 23
Lv, Y., Hao, J., Tang, M., & Wu, J. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111767 · Cited by 29
Yang, J., Bai, Y., Wang, J., & Zhao, Y. Y. (2019) · Measurement Science and Technology · doi:10.1088/1361-6501/ab2296 · Cited by 22
Condition Monitoring of Drive Trains by Data Fusion of Acoustic Emission and Vibration Sensors
Mey, O., Schneider, A. F., Enge‐Rosenblatt, O., Mayer, D., Schmidt, C., Klein, S., & Herrmann, H. (2021) · Processes · doi:10.3390/pr9071108 · Cited by 24
“, [3,34,37]), which only work when all sensor information is available.”
BackgroundMethodHong, X., Duan, L., & Zhang, L. (2021) · Measurement Science and Technology · doi:10.1088/1361-6501/ac05f6 · Cited by 21
Self-citationBrusa, E. G. M., Delprete, C., & Maggio, L. G. D. (2022) · Mechanics of Advanced Materials and Structures · doi:10.1080/15376494.2022.2102274 · Cited by 21
“A remarkable research was performed in this field, using vibration data and infrared images in CNNs for rotor systems monitoring [52, 53], whereas images and CNNs were employed also in the health monitoring of balancing tail ropes by Zhou et al.”
MethodAn Experimental Setup to Detect the Crack Fault of Asymmetric Rotors Based on a Deep Learning Method
Wang, C., Zheng, Z., Guo, D., Liu, T., Xie, Y., & Zhang, D. (2023) · Applied Sciences · doi:10.3390/app13031327 · Cited by 18
A Taxonomy and Archetypes of Business Analytics in Smart Manufacturing
Wanner, J., Wissuchek, C., Welsch, G., & Janiesch, C. (2023) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3583581.3583584 · Cited by 30
A survey on industrial image anomaly detection: methods, benchmarks and rethinks
Yu, M., Chen, Z., Liu, Y., Dong, C., & Song, K. (2025) · Measurement · doi:10.1016/j.measurement.2025.118377 · Cited by 23
Liu, B., Xu, Q., Chen, J., Li, J., & Wang, M. (2022) · Buildings · doi:10.3390/buildings12081286 · Cited by 13
Pre-classified reservoir computing for the fault diagnosis of 3D printers
Zhang, S., Duan, X., Li, C., & Liang, M. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.106961 · Cited by 17
Sigma- z random forest, classification and confidence
Fornaser, A., Cecco, M. D., Bosetti, P., Mizumoto, T., & Yasumoto, K. (2018) · Measurement Science and Technology · doi:10.1088/1361-6501/aaf466 · Cited by 13
Guo, J., Chen, G., Ma, H., & Qi, H. (2022) · Measurement Science and Technology · doi:10.1088/1361-6501/ac8a65 · Cited by 11
Tang, H., Liao, Z., Ozaki, Y., & Chen, P. (2020) · Applied Sciences · doi:10.3390/app10072477 · Cited by 8
“Deep learning—including convolutional neural network (CNN) [17], deep neural network (DNN), [18] and SAE [19]—can effectively overcome deficiencies above in current intelligent diagnosis methods.”
BackgroundWang, S., Ma, T., Kong, Y., Wang, T., Gao, S., Chu, F., & Han, Q. (2024) · Nano Energy · doi:10.1016/j.nanoen.2024.109655 · Cited by 7
Study on Gearbox Fault Warning Based on the Improved M-IALO-GRU Model
Wang, Y., Sun, W., Liu, H., Wang, S., & Zhou, Q. (2025) · Applied Sciences · doi:10.3390/app15063175 · Cited by 7
Wang, P., Song, L., Wang, H., Han, C., Guo, X., & Cui, L. (2022) · Measurement Science and Technology · doi:10.1088/1361-6501/ac4ce6 · Cited by 7
“Nonetheless, the typical 1D-CNN has a pooling layer [26, 27].”
Multimodal Machine Learning in Prognostics and Health Management of Manufacturing Systems
Jose, S., Nguyen, K. T. P., & Medjaher, K. (2023) · Springer series in reliability engineering · doi:10.1007/978-3-031-30510-8_9 · Cited by 7
Cao, J., Zhang, X., Runsheng, Y., & Zhi-chun, M. (2024) · Proceedings of the Institution of Mechanical Engineers Part C Journal of Mechanical Engineering Science · doi:10.1177/09544062241283331 · Cited by 5
“23 T-distributed stochastic neighbor embedding (t-SNE) 24 can effectively eliminate the redundant information and fuse the fault features as a feature fusion method.”
Yi, Q., Xu, Y., Li, C., Li, C., & Cao, H. (2025) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-025-00730-3 · Cited by 4
Compound Faults Diagnosis in Wind Turbine Gearbox Based on Deep Learning Methods: A Review
Shao, Z., Zhang, T., & Kosasih, B. (2024) · Global Reliability and Prognostics and Health Management Conference (PHM) · doi:10.1109/phm-beijing63284.2024.10874503 · Cited by 4
“Based on the ANN methods, researchers have introduced deep learning (DL) methods for fault diagnosis of wind turbine gearboxes, including convolutional neural networks (CNN) [28-31], deep belief networks (DBN) [32-34], autoencoder (AE) [35-38], and recurrent neural networks (RNN) [39-40].”
Rub-impact fault diagnosis of rotor systems based on EMD and dynamic CNN
Shi, J., Zhang, R., & Wang, Q. (2025) · Mechanical sciences · doi:10.5194/ms-16-579-2025 · Cited by 4
“Additionally, based on the basic mechanism of CNNs, many other modified CNN algorithms have been proposed, such as multi-mode CNN (Yuan et al., 2018) and residual network (Chen et al., 2024 Yuan et al. (2018) proposed a multi-mode CNN for feature learning and rotor fault diagnosis based on the raw…”
InfluentialWang, S., Ma, T., Liang, X., Gao, S., & Han, Q. (2025) · Advanced Materials Technologies · doi:10.1002/admt.202500303 · Cited by 7
Design and Implementation of Intelligent Rolling Bearing Based on Variable Reluctance Generator
Wang, S., Zheng, C., Ma, T., Wang, T., Gao, S., Dai, Q., Han, Q., & Chu, F. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3470982 · Cited by 7
“Moreover, t -distributed stochastic neighbor embedding ( t - SNE) is utilized to visually analyze the original spectral features and the features learned by the C-BL models [27], [28], [29].”
Intelligent Fault Diagnosis of 3D Printers based on Reservoir Computing
Duan, X., Jianyu, L., Li, C., Cabrera, D. R., & Zhang, S. (2019) · International Journal of Performability Engineering · doi:10.23940/ijpe.19.12.p8.31713178 · Cited by 3
“Recently, with the wide application of machine learning in computer vision and speech recognition, machine learning has begun to be applied in the field of fault diagnosis [15].”
BackgroundLiu, D., Song, S., Shan, X., Zhang, X., Shen, S., Wei, S., Shi, B., & Gong, J. (2025) · SPE Journal · doi:10.2118/230286-pa · Cited by 2
Ma, L., Yang, Q., & Peng, K. (2026) · Journal of Process Control · doi:10.1016/j.jprocont.2026.103730 · Cited by 1
Huang, Z., Li, Y., Cai, W., & Huang, H. (2023) · European Safety and Reliability Conference (ESREL) · doi:10.3850/978-981-18-8071-1_p273-cd · Cited by 1
Condition Monitoring of Drive Trains by Data Fusion of Acoustic Emission and Vibration Sensors
Mey, O., Schneider, A. F., Enge‐Rosenblatt, O., Mayer, D., Schmidt, C., Klein, S., & Herrmann, H. (2021) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · doi:10.24406/fordatis/132
Study on Crack Fault Detection of Asymmetric Shafting Based on Experimental and Deep Learning MethodPreprint
Wang, C., Zheng, Z., Guo, D., Liu, T., Xie, Y., & Zhang, D. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.3989650
A Self-Attention and GRU based Method for Operational State Assessment of Hydrocyclone
Liang, T., Wang, F., Wang, S., Wang, Y., Lu, D., & Xiao, Y. (2022) · China Automation Congress (CAC) · doi:10.1109/cac57257.2022.10054879
Adaptive Multimodal Feature Interactive Network for Machinery Fault Diagnosis Under Small SamplesPreprint
Jiang, Z., & Yu, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5390383
Yang, X. (2025) · Journal of Vibroengineering · doi:10.21595/jve.2025.25194
“Reference [14] proposed a multimodal convolutional neural network that can learn fault related sensitive features from vibration signals and infrared images automatically, and fuse these deep features using T-SNE (T-Distributed Stochastic Neighbor Embedding, T-SNE).”
Multimodal Feature Interactive Network for Machinery Fault Diagnosis Under Small Samples
Jiang, Z., Li, R., & Yu, J. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3660745
“Yuan et al. [39] proposed a multimodal convolutional neural network (MMCNN) for rotor fault diagnosis.”
Zhuoqun, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6571464
Li, J., Yan, W., Ngan, C.-K., Krastev, S., Ammartayakun, A., Mishra, K. J., Koduri, H., Schuman, E., Morris, D., Feng, Y., et al. (2026) · Studies in computational intelligence · doi:10.1007/978-3-032-22633-4_14
Dai, Q., Wang, J., Xiu, H., Wang, S., Kong, Y., & Han, Q. (2026) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2026.118382
Liu, W., Xiao, Y., 童立元, Li, H., Qiu, T., & Wu, H. (2026) · AI in Civil Engineering · doi:10.1007/s43503-026-00113-w
“Previous studies (Ong et al., 2019; Shankar et al., 2019) and recent advances in DL-based multi-source information fusion (Yuan et al., 2018; Zhang et al., 2022) demonstrate that integrating heterogeneous data can substantially enhance inference accuracy.”
Metadata
- Authors
- Yuan, Z., Zhang, L., & Duan, L.
- Affiliations
- China University of Petroleum, Beijing (CN)
- Corresponding author
- Duan, Lixiang
- Venue
- Measurement Science and Technology
- Publisher
- IOP Publishing
- Published
- 2018-10-04
- Volume
- 29
- Issue
- 11
- Pages
- 115005
- ISSN
- 0957-0233 (ISSN-L)
- 1361-6501
- OpenAlex
- W2891841764
- Cited by
- 57
- References
- 39
- Citations by year
- 2026: 5 · 2025: 10 · 2024: 5 · 2023: 6 · 2022: 9 · 2021: 9 · 2020: 7 · 2019: 5 · 2018: 1
- FWCI
- 3.40
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- publishingsupport.iopscience.iop.org/iop-standard/v1 (vor)
- iopscience.iop.org/info/page/text-and-data-mining (tdm)
- Locations
- Measurement Science and Technology (publishedVersion)
- Funders
- National Key Research and Development Program of China (2017YFC0805803)
- National Natural Science Foundation of China (51674277)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Physical Sciences › Engineering › Civil and Structural Engineering › Structural Health Monitoring Techniques
- Keywords
- sensor fusion, vibration signals, infrared images, fault classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.