The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Dual-Aspect Self-Attention Based on Transformer for Remaining Useful Life Prediction
Open accessAbstract
Remaining useful life (RUL) prediction is one of the key technologies of condition-based maintenance (CBM), which is important to maintain the reliability and safety of industrial equipment. Massive industrial measurement data has effectively improved the performance of the data-driven-based RUL prediction method. While deep learning has achieved great success in RUL prediction, existing methods have difficulties in processing long sequences and extracting information from the sensor and time step aspects. In this article, we propose dual-aspect self-attention based on transformer (DAST), a novel deep RUL prediction method, which is an encoder–decoder structure purely based on self-attention without any recurrent neural network (RNN)/convolution neural network (CNN) module. DAST consists of two encoders, which work in parallel to simultaneously extract features of different sensors and time steps. Solely based on self-attention, the DAST encoders are more effective in processing long data sequences and are capable of adaptively learning to focus on more important parts of the input. Moreover, the parallel feature extraction design avoids the mutual influence of information from two aspects. Experiments on two widely used turbofan engines datasets show that our method significantly outperforms the state-of-the-art RUL prediction methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752
Longformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281
Damage propagation modeling for aircraft engine run-to-failure simulation
Saxena, A., Goebel, K., Simon, D., & Eklund, N. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711414 · Cited by 1,954
Remaining useful life estimation in prognostics using deep convolution neural networks
Li, X., Ding, Q., & Sun, J.-Q. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2017.11.021 · Cited by 1,755
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422
Boehning, D., & Snyder, S. H. (2003) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131047 · Cited by 1,225
Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life
Sateesh Babu, G., Zhao, P., & Li, X.-L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-32025-0_14 · Cited by 962
Long Short-Term Memory Network for Remaining Useful Life estimation
Zheng, S., Ristovski, K., Farahat, A., & Gupta, C. (2017) · 2017 IEEE International Conference on Prognostics and Health Management (ICPHM) · doi:10.1109/icphm.2017.7998311 · Cited by 882
Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics
Zhang, C., Lim, P., Qin, A. K., & Tan, K. C. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582798 · Cited by 870
Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network
Zhu, J., Chen, N., & Peng, W. (2019) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2018.2844856 · Cited by 704
Machine Remaining Useful Life Prediction via an Attention-Based Deep Learning Approach
Chen, Z., Wu, M., Zhao, R., Guretno, F., Yan, R., & Li, X. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.2972443 · Cited by 618
Liao, L., & Kottig, F. (2014) · IEEE Transactions on Reliability · doi:10.1109/tr.2014.2299152 · Cited by 563
Chen, J., Jing, H., Chang, Y., & Liu, Q. (2019) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2019.01.006 · Cited by 497
Remaining useful life prediction using multi-scale deep convolutional neural network
Li, H., Zhao, W., Zhang, Y., & Zio, E. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106113 · Cited by 390
A review on prognostics and health management (PHM) methods of lithium-ion batteries
Meng, H., & Li, Y.-F. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.109405 · Cited by 389
RUL Prediction of Deteriorating Products Using an Adaptive Wiener Process Model
Zhai, Q., & Ye, Z.-S. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2684821 · Cited by 363
Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case
Wu, N., Green, B., Ben, X., & O’Banion, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08317 · Cited by 335
Mao, W., He, J., & Zuo, M. J. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2917735 · Cited by 330
Remaining Useful Life Prediction Using a Novel Feature-Attention-Based End-to-End Approach
Liu, H., Liu, Z., Jia, W., & Lin, X. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2983760 · Cited by 324
Prognosis of Defect Propagation Based on Recurrent Neural Networks
Malhi, A., Yan, R., & Gao, R. X. (2011) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2010.2078296 · Cited by 314
Loutas, T. H., Roulias, D., & Georgoulas, G. (2013) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2285318 · Cited by 302
Gated Dual Attention Unit Neural Networks for Remaining Useful Life Prediction of Rolling Bearings
Qin, Y., Chen, D., Xiang, S., & Zhu, C. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2999442 · Cited by 271
Remaining Useful Life Estimation in Prognostics Using Deep Bidirectional LSTM Neural Network
Wang, J., Wen, G., Yang, S., & Liu, Y. (2018) · 2018 Prognostics and System Health Management Conference (PHM-Chongqing) · doi:10.1109/phm-chongqing.2018.00184 · Cited by 237
Cui, L., Wang, X., Wang, H., & Ma, J. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2924509 · Cited by 236
Feature Extraction for Data-Driven Remaining Useful Life Prediction of Rolling Bearings
Zhao, H., Liu, H., Jin, Y., Dang, X., & Deng, W. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3059500 · Cited by 196
A New Multivariate Approach for Prognostics Based on Extreme Learning Machine and Fuzzy Clustering
Javed, K., Gouriveau, R., & Zerhouni, N. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2378056 · Cited by 189
Remaining Useful Life Prediction of Rolling Bearings Using an Enhanced Particle Filter
Qian, Y., & Yan, R. (2015) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2015.2427891 · Cited by 188
A Review on Prognostics Methods for Engineering Systems
Guo, J., Li, Z., & Li, M. (2020) · IEEE Transactions on Reliability · doi:10.1109/tr.2019.2957965 · Cited by 188
Distributed Attention-Based Temporal Convolutional Network for Remaining Useful Life Prediction
Song, Y., Gao, S., Li, Y., Jia, L., Li, Q., & Pang, F. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3004452 · Cited by 172
Self-citationKong, Z., Cui, Y., Xia, Z., & Lv, H. (2019) · Applied Sciences · doi:10.3390/app9194156 · Cited by 170
Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder
Malhotra, P., Tv, V., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.06154 · Cited by 159
Prediction of remaining useful life of multi-stage aero-engine based on clustering and LSTM fusion
Liu, J., Lei, F., Chunlu, P., Hu, D., & Zuo, H. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107807 · Cited by 150
Remaining Useful Life Prognosis Based on Ensemble Long Short-Term Memory Neural Network
Cheng, Y., Wu, J., Zhu, H., Or, S. W., & Shao, X. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3031113 · Cited by 141
Kim, T. S., & Sohn, S. Y. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01630-w · Cited by 131
LSTM networks based on attention ordered neurons for gear remaining life prediction
Xiang, S., Qin, Y., Zhu, C., Wang, Y., & Chen, H. (2020) · ISA Transactions · doi:10.1016/j.isatra.2020.06.023 · Cited by 113
A deep attention residual neural network-based remaining useful life prediction of machinery
Zeng, F., Li, Y., Jiang, Y., & Song, G. (2021) · Measurement · doi:10.1016/j.measurement.2021.109642 · Cited by 78
Model-Based Fault Diagnosis of a Planetary Gear: A Novel Approach Using Transmission Error
Park, J., Ha, J. M., Oh, H., Youn, B. D., Choi, J.-H., & Kim, N. H. (2016) · IEEE Transactions on Reliability · doi:10.1109/tr.2016.2590997 · Cited by 74
Nguyen, K. T. P., & Medjaher, K. (2020) · ISA Transactions · doi:10.1016/j.isatra.2020.03.017 · Cited by 60
Cited by
An integrated multi-head dual sparse self-attention network for remaining useful life prediction
Zhang, J., Li, X., Tian, J., Luo, H., & Yin, S. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109096 · Cited by 263
Zhao, J., Feng, X., Wang, J., Lian, Y., Ouyang, M., & Burke, A. F. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121949 · Cited by 152
Metadata
- Authors
- Zhang, Z., Song, W., & Li, Q.
- Venue
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2022
- Volume
- 71
- Pages
- 1-11
- ISSN
- 0018-9456 (ISSN-L)
- 1557-9662
- OpenAlex
- W3173407600
- Cited by
- 269
- References
- 43
- FWCI
- 23.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.