The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis
Abstract
Fault diagnosis plays an important role in modern industry. With the development of smart manufacturing, the data-driven fault diagnosis becomes hot. However, traditional methods have two shortcomings: 1) their performances depend on the good design of handcrafted features of data, but it is difficult to predesign these features and 2) they work well under a general assumption: the training data and testing data should be drawn from the same distribution, but this assumption fails in many engineering applications. Since deep learning (DL) can extract the hierarchical representation features of raw data, and transfer learning provides a good way to perform a learning task on the different but related distribution datasets, deep transfer learning (DTL) has been developed for fault diagnosis. In this paper, a new DTL method is proposed. It uses a three-layer sparse auto-encoder to extract the features of raw data, and applies the maximum mean discrepancy term to minimizing the discrepancy penalty between the features from training data and testing data. The proposed DTL is tested on the famous motor bearing dataset from the Case Western Reserve University. The results show a good improvement, and DTL achieves higher prediction accuracies on most experiments than DL. The prediction accuracy of DTL, which is as high as 99.82%, is better than the results of other algorithms, including deep belief network, sparse filter, artificial neural network, support vector machine and some other traditional methods. What is more, two additional analytical experiments are conducted. The results show that a good unlabeled third dataset may be helpful to DTL, and a good linear relationship between the final prediction accuracies and their standard deviations have been observed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Gao, Z., Cecati, C., & Ding, S. X. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2417501 · Cited by 3,135
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
Smith, W. A., & Randall, R. B. (2015) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2015.04.021 · Cited by 2,719
A Kernel Method for the Two-Sample-Problem
Gretton, A., Borgwardt, K. M., Rasch, M., Schölkopf, B., & Smola, A. J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0069 · Cited by 2,167
Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach
Glorot, X., Bordes, A., & Bengio, Y. (2011) · HAL · Cited by 2,019
Jia, F., Lei, Y., Lin, J., Zhou, X., & Lu, N. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2015.10.025 · Cited by 1,710
Deep Learning of Representations for Unsupervised and Transfer Learning.
Bengio, Y. (2011) · Cited by 1,670
Contractive Auto-Encoders: Explicit Invariance During Feature Extraction
Rifai, S., Vincent, P., Muller, X., Glorot, X., & Bengio, Y. (2011) · International Conference on Machine Learning · Cited by 1,600
Lei, Y., Jia, F., Lin, J., Xing, S., & Ding, S. X. (2016) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2519325 · Cited by 1,191
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106
Transfer learning using computational intelligence: A survey
Lu, J., Behbood, V., Hao, P., Zuo, H., Xue, S., & Zhang, G. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.01.010 · Cited by 968
Gao, Z., Cecati, C., & Ding, S. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2419013 · Cited by 776
Lu, C., Wang, Z.-Y., Qin, W.-L., & Ma, J. (2017) · Signal Processing · doi:10.1016/j.sigpro.2016.07.028 · Cited by 775
Deep Model Based Domain Adaptation for Fault Diagnosis
Lu, W., Liang, B., Cheng, Y., Meng, D., Yang, J., & Zhang, T. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2627020 · Cited by 761
From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis
Dai, X., & Gao, Z. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2013.2243743 · Cited by 728
A sparse auto-encoder-based deep neural network approach for induction motor faults classification
Sun, W., Shao, S., Zhao, R., Yan, R., Zhang, X., & Chen, X. (2016) · Measurement · doi:10.1016/j.measurement.2016.04.007 · Cited by 698
Failure diagnosis using deep belief learning based health state classification
Tamilselvan, P., & Wang, P. (2013) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2013.02.022 · Cited by 630
Big Data for Modern Industry: Challenges and Trends [Point of View]
Yin, S., & Kaynak, O. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2388958 · Cited by 565
Gan, M., Wang, C., & Zhu, C. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2015.11.014 · Cited by 550
Rolling bearing fault diagnosis using an optimization deep belief network
Shao, H., Jiang, H., Zhang, X., & Niu, M. (2015) · Measurement Science and Technology · doi:10.1088/0957-0233/26/11/115002 · Cited by 517
Yin, Z., & Hou, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.081 · Cited by 345
Natural computing for mechanical systems research: A tutorial overview
Worden, K., Staszewski, W. J., & Hensman, J. J. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2010.07.013 · Cited by 288
Deep Learning and Its Applications to Machine Health Monitoring: A SurveyPreprint
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P. E., & Gao, R. X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07640 · Cited by 154
Fault Diagnosis in Internal Combustion Engines Using Extension Neural Network
Shatnawi, Y., & Al-khassaweneh, M. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2261033 · Cited by 135
Sliding Window-Based Fault Detection From High-Dimensional Data Streams
Zhang, L., Lin, J., & Karim, R. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2585566 · Cited by 133
Cho, H. C., Knowles, J., Fadali, M. S., & Lee, K. S. (2009) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2009.2020863 · Cited by 103
Autoencoder With Invertible Functions for Dimension Reduction and Image Reconstruction
Yang, Y., Wu, Q. M. J., & Wang, Y. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2637279 · Cited by 101
Deep Learning-Based Model Reduction for Distributed Parameter Systems
Wang, M., Li, H., Chen, X., & Chen, Y. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2605159 · Cited by 97
Wang, D., & Tse, P. W.-T. (2014) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2014.10.010 · Cited by 81
Intelligent Automatic Fault Detection for Actuator Failures in Aircraft
Lo, C. H., Fung, E., & Wong, Y. K. (2009) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2008.2008642 · Cited by 50
Deep transfer learning for classification of time-delayed Gaussian networks
Chaturvedi, I., Ong, Y.-S., & Arumugam, R. V. (2014) · Signal Processing · doi:10.1016/j.sigpro.2014.09.009 · Cited by 41
Improving transfer learning accuracy by reusing Stacked Denoising Autoencoders
Kandaswamy, C., Silva, L. M., Alexandre, L. A., Sousa, R., Santos, J. M., & de Sá, J. M. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6974107 · Cited by 40
Multi-source deep transfer learning for cross-sensor biometrics
Kandaswamy, C., Monteiro, J. C., Silva, L. M., & Cardoso, J. S. (2016) · Neural Computing and Applications · doi:10.1007/s00521-016-2325-5 · Cited by 27
Transfer Latent SVM for Joint Recognition and Localization of Actions in Videos
Liu, C., Wu, X., & Jia, Y. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2482970 · Cited by 15
Research works printed but not linked: 2
- henley, 1984, Application of expert systems to fault diagnosis, Proc AIChE Annu Meeting
- 10.1109/TIE.2015.2417501 · DOI · Paper page
Cited by
Applications of machine learning to machine fault diagnosis: A review and roadmap
Lei, Y., Yang, B., Jiang, X., Jia, F., Li, N., & Nandi, A. K. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2019.106587 · Cited by 2,997
A new convolutional neural network-based data-driven fault diagnosis method
Wen, L., Li, X., Gao, L., & Zhang, Y. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2774777 · Cited by 2,222
Self-citationHighly Accurate Machine Fault Diagnosis Using Deep Transfer Learning
Shao, S., McAleer, S., Yan, R., & Baldi, P. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2864759 · Cited by 1,635
Guo, L., Lei, Y., Xing, S., Yan, T., & Li, N. (2019) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2018.2877090 · Cited by 1,234
Yang, B., Lei, Y., Jia, F., & Xing, S. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.12.051 · Cited by 879
Metadata
- Authors
- Wen, L., Gao, L., & Li, X.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Published
- 2019-01
- Volume
- 49
- Issue
- 1
- Pages
- 136-144
- ISSN
- 2168-2216 (ISSN-L)
- 2168-2232
- OpenAlex
- W2763583057
- Cited by
- 1,095
- References
- 41
- FWCI
- 47.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Natural Science Foundation of China (51435009, 51775216, 51711530038)
- 111 Project (B16019)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.