The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics
Abstract
In numerous industrial applications where safety, efficiency, and reliability are among primary concerns, condition-based maintenance (CBM) is often the most effective and reliable maintenance policy. Prognostics, as one of the key enablers of CBM, involves the core task of estimating the remaining useful life (RUL) of the system. Neural networks-based approaches have produced promising results on RUL estimation, although their performances are influenced by handcrafted features and manually specified parameters. In this paper, we propose a multiobjective deep belief networks ensemble (MODBNE) method. MODBNE employs a multiobjective evolutionary algorithm integrated with the traditional DBN training technique to evolve multiple DBNs simultaneously subject to accuracy and diversity as two conflicting objectives. The eventually evolved DBNs are combined to establish an ensemble model used for RUL estimation, where combination weights are optimized via a single-objective differential evolution algorithm using a task-oriented objective function. We evaluate the proposed method on several prognostic benchmarking data sets and also compare it with some existing approaches. Experimental results demonstrate the superiority of our proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Storn, R., & Price, K. (1997) · Journal of Global Optimization · doi:10.1023/a:1008202821328 · Cited by 29,569
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
Zhang, Q., & Li, H. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.892759 · Cited by 10,069
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization
Qin, A. K., Huang, V. L., & Suganthan, P. N. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2008.927706 · Cited by 3,614
Self-citationPopular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953 · cited 1×
“Opitz and Maclin [43] had shown that”
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852
Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II
Li, H., & Zhang, Q. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2008.925798 · Cited by 2,543
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Damage propagation modeling for aircraft engine run-to-failure simulation
Saxena, A., Goebel, K., Simon, D., & Eklund, N. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711414 · Cited by 1,954
Extended Kalman filtering for battery management systems of LiPB-based HEV battery packs
Plett, G. L. (2004) · Journal of Power Sources · doi:10.1016/j.jpowsour.2004.02.032 · Cited by 1,923
Neural Network Ensembles, Cross Validation, and Active Learning
Krogh, A., & Vedelsby, J. (1994) · Cited by 1,838
Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms
White, B. W., & Rosenblatt, F. (1963) · The American Journal of Psychology · doi:10.2307/1419730 · Cited by 1,792
Extended Kalman filtering for battery management systems of LiPB-based HEV battery packs
Plett, G. L. (2004) · Journal of Power Sources · doi:10.1016/j.jpowsour.2004.02.033 · Cited by 1,768 · cited 3×
“is encoded as a decision variable optimized by MOEA/D, which has range [10, 50].”
BackgroundMethodAcoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS
ROSENBLATT, F. (1961) · doi:10.21236/ad0256582 · Cited by 1,691
Rotating machinery prognostics: State of the art, challenges and opportunities
Heng, A., Zhang, S., Tan, A. C. C., & Mathew, J. (2009) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2008.06.009 · Cited by 1,207
Diversity creation methods: a survey and categorisation
Brown, G., Wyatt, J., Harris, R., & Yao, X. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.004 · Cited by 985
Ensemble learning via negative correlation
Liu, Y., & Yao, X. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00073-8 · Cited by 712
Recurrent neural networks for remaining useful life estimation
Heimes, F. O. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711422 · Cited by 644
Failure diagnosis using deep belief learning based health state classification
Tamilselvan, P., & Wang, P. (2013) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2013.02.022 · Cited by 630
Residual Life Predictions From Vibration-Based Degradation Signals: A Neural Network Approach
Gebraeel, N., Lawley, M., Liu, R., & Parmeshwaran, V. (2004) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2004.824875 · Cited by 557
An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization
Zhang, X., Tian, Y., Cheng, R., & Jin, Y. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2308305 · Cited by 531
Time series forecasting using a deep belief network with restricted Boltzmann machines
Kuremoto, T., Kimura, S., Kobayashi, K., & Obayashi, M. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.03.047 · Cited by 527
Huang, R., Xi, L., Li, X., Liu, C., Qiu, H., & Lee, J. (2006) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2005.11.008 · Cited by 523
Ma, X., Liu, F., Qi, Y., Wang, X., Li, L., Jiao, L., Yin, M., & Gong, M. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2455812 · Cited by 523
Metrics for evaluating performance of prognostic techniques
Saxena, A., Celaya, J., Balaban, E., Goebel, K., Saha, B., Saha, S., & Schwabacher, M. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711436 · Cited by 518
A similarity-based prognostics approach for Remaining Useful Life estimation of engineered systems
Wang, T., Yu, J., Siegel, D., & Lee, J. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711421 · Cited by 474
Evolutionary ensembles with negative correlation learning
Higuchi, T., Yao, X., & Liu, Y. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.887237 · Cited by 445
Comparison of prognostic algorithms for estimating remaining useful life of batteries
Saha, B., Goebel, K., & Christophersen, J. (2009) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331208092030 · Cited by 423
Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers
Yuan, Y., Xu, H., Wang, B., Zhang, B., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2443001 · Cited by 400
Ensemble of data-driven prognostic algorithms for robust prediction of remaining useful life
Hu, C., Youn, B. D., Wang, P., & Taek Yoon, J. (2012) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2012.03.008 · Cited by 361
Zio, E., & Di Maio, F. (2010) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2009.08.001 · Cited by 331
Deep Belief Networks using discriminative features for phone recognition
Mohamed, A.-R., Sainath, T. N., Dahl, G., Ramabhadran, B., Hinton, G. E., & Picheny, M. A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947494 · Cited by 286
A Survey of Data-Driven Prognostics
Schwabacher, M. (2005) · Infotech@Aerospace · doi:10.2514/6.2005-7002 · Cited by 280
Two problems with backpropagation and other steepest-descent learning procedures for networks
Sutton, R. S. (1986) · eScholarship (California Digital Library) · Cited by 264
Niu, G., Yang, B.-S., & Pecht, M. (2010) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2010.02.016 · Cited by 257
Machine Condition Prediction Based on Adaptive Neuro–Fuzzy and High-Order Particle Filtering
Chen, C., Zhang, B., Vachtsevanos, G., & Orchard, M. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2010.2098369 · Cited by 250
Tian, Z., Wong, L., & Safaei, N. (2010) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2009.11.005 · Cited by 241
Physics-of-failure-based prognostics for electronic products
Pecht, M., & Gu, J. (2009) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331208092031 · Cited by 230
Ensemble of data-driven prognostic algorithms for robust prediction of remaining useful life
Hu, C., Youn, B. D., & Wang, P. (2011) · 2011 IEEE Conference on Prognostics and Health Management · doi:10.1109/icphm.2011.6024361 · Cited by 205
Resilience-Driven System Design of Complex Engineered Systems
Youn, B. D., Hu, C., & Wang, P. (2011) · Journal of Mechanical Design · doi:10.1115/1.4004981 · Cited by 193
A New Multivariate Approach for Prognostics Based on Extreme Learning Machine and Fuzzy Clustering
Javed, K., Gouriveau, R., & Zerhouni, N. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2378056 · Cited by 189
Ensemble Learning Using Multi-Objective Evolutionary Algorithms
Chandra, A., & Yao, X. (2006) · Journal of Mathematical Modelling and Algorithms · doi:10.1007/s10852-005-9020-3 · Cited by 179
A New Local Search-Based Multiobjective Optimization Algorithm
Chen, B., Zeng, W., Lin, Y., & Zhang, D. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2301794 · Cited by 175
A generic probabilistic framework for structural health prognostics and uncertainty management
Wang, P., Youn, B. D., & Hu, C. (2012) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2011.10.019 · Cited by 168
Data driven prognostics using a Kalman filter ensemble of neural network models
Peel, L. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711423 · Cited by 163
Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
Chen, H., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.26 · Cited by 162
PHM-Oriented Integrated Fusion Prognostics for Aircraft Engines Based on Sensor Data
Xu, J., Wang, Y., & Xu, L. (2014) · IEEE Sensors Journal · doi:10.1109/jsen.2013.2293517 · Cited by 160
A Memetic Pareto Evolutionary Approach to Artificial Neural Networks
Abbass, H. A. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45656-2_1 · Cited by 133
Pareto neuro-evolution: constructing ensemble of neural networks using multi-objective optimization
Abbass, H. A. (2004) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2003.1299928 · Cited by 121
Resilience-Driven System Design of Complex Engineered Systems
Youn, B. D., Hu, C., & Wang, P. (2011) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2011-48314 · Cited by 117
Effective Neural Network Ensemble Approach for Improving Generalization Performance
Yang, J., Zeng, X., Zhong, S., & Wu, S. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2246578 · Cited by 115
Prognostic algorithm categorization with PHM Challenge application
Coble, J. B., & Hines, J. W. (2008) · International Conference on Prognostics and Health Management (PHM) · doi:10.1109/phm.2008.4711456 · Cited by 111
Adaptive Cross-Generation Differential Evolution Operators for Multiobjective Optimization
Qiu, X., Xu, J., Tan, K. C., & Abbass, H. A. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2433672 · Cited by 105
Self-citationEnsemble neural network-based particle filtering for prognostics
Baraldi, P., Compare, M., Sauco, S., & Zio, E. (2013) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2013.07.010 · Cited by 100
How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier
Hu, J., Tang, H., Tan, K. C., & Li, H. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2016.2532268 · Cited by 76
Self-citationChen, Z., Yang, Y., & Hu, Z. F. (2012) · IEEE Transactions on Reliability · doi:10.1109/tr.2012.2196171 · Cited by 71
Multimodal Degradation Prognostics Based on Switching Kalman Filter Ensemble
Lim, P., Goh, C.-K., Tan, K. C., & Dutta, P. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2504389 · Cited by 69
Self-citationDistributed prognostic health management with gaussian process regression
Saha, S., Saha, B., Saxena, A., & Goebel, K. (2010) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2010.5446841 · Cited by 68
Ensemble Learning in Fixed Expansion Layer Networks for Mitigating Catastrophic Forgetting
Coop, R., Mishtal, A., & Arel, I. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2264952 · Cited by 64
Deep Belief Network based state classification for structural health diagnosis
Tamilselvan, P., Wang, Y., & Wang, P. (2012) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2012.6187366 · Cited by 59
Uncertainty analysis of a neural network used for fatigue lifetime prediction
Pierce, G., Worden, K., & Bezazi, A. (2008) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2007.12.004 · Cited by 53
Differential evolution on the CEC-2013 single-objective continuous optimization testbed
Qin, A. K., & Li, X. (2013) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2013.6557689 · Cited by 52
Self-citationDeep Belief Networks Ensemble with Multi-objective Optimization for Failure Diagnosis
Zhang, C., Sun, J. H., & Tan, K. C. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.19 · Cited by 42
Self-citationDeep Networks are Effective Encoders of Periodicity
Szymanski, L., & McCane, B. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2296046 · Cited by 41
Estimation of Remaining Useful Life Based on Switching Kalman Filter Neural Network Ensemble
Lim, P., Goh, C.-K., Tan, K. C., & Dutta, P. (2014) · Annual Conference of the PHM Society · doi:10.36001/phmconf.2014.v6i1.2348 · Cited by 40
Self-citationNegative Correlation Ensemble Learning for Ordinal Regression
Fernández‐Navarro, F., Gutiérrez, P. A., Hervás‐Martínez, C., & Yao, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2268279 · Cited by 36
GFRBS-PHM: A Genetic Fuzzy Rule-Based System for PHM with improved interpretability
Ishibashi, R., & Nascimento, C. L. (2013) · IEEE Conference on Prognostics and Health Management · doi:10.1109/icphm.2013.6621419 · Cited by 25
Semi-supervised learning with co-training for data-driven prognostics
Hu, C. K., Youn, B. D., & Kim, T. (2012) · IEEE Conference on Prognostics and Health Management · doi:10.1109/icphm.2012.6299526 · Cited by 19
Cited by
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings
Wang, B., Lei, Y., Li, N., & Li, N. (2020) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2882682 · Cited by 1,917
Remaining useful life estimation in prognostics using deep convolution neural networks
Li, X., Ding, Q., & Sun, J.-Q. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2017.11.021 · Cited by 1,755
A review on the application of deep learning in system health management
Khan, S., & Yairi, T. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.11.024 · Cited by 1,133
A Survey on Evolutionary Neural Architecture Search
Liu, Y., Sun, Y., Xue, B., Zhang, M., Yen, G. G., & Tan, K. C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3100554 · Cited by 644
Self-citation
Metadata
- Authors
- Zhang, C., Lim, P., Qin, A. K., & Tan, K. C.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2017-10
- Volume
- 28
- Issue
- 10
- Pages
- 2306-2318
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2471161958
- Cited by
- 870
- References
- 76
- FWCI
- 35.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.