Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
In modern industrial processes, soft sensors have played an important role for effective process control, optimization, and monitoring. Feature representation is one of the core factors to construct accurate soft sensors. Recently, deep learning techniques have been developed for high-level abstract feature extraction in pattern recognition areas, which also have great potential for soft sensing applications. Hence, deep stacked autoencoder (SAE) is introduced for soft sensor in this paper. As for output prediction purpose, traditional deep learning algorithms cannot extract high-level output-related features. Thus, a novel variable-wise weighted stacked autoencoder (VW-SAE) is proposed for hierarchical output-related feature representation layer by layer. By correlation analysis with the output variable, important variables are identified from other ones in the input layer of each autoencoder. The variables are assigned with different weights accordingly. Then, variable-wise weighted autoencoders are designed and stacked to form deep networks. An industrial application shows that the proposed VW-SAE can give better prediction performance than the traditional multilayer neural networks and SAE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“The difficult situation was circumvented by Hinton in 2006, who proposed an unsupervised layer-wise pretraining algorithm to solve the optimization problems of deep neural networks [28].”
BackgroundData-driven Soft Sensors in the process industry
Kadlec, P., Gabrys, B., & Strandt, S. (2009) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2008.12.012 · Cited by 1,845 · cited 1×
“Usually, soft sensors can be classified into two main categories, which are first-principle models (FPM) [9] (white-box models) and data-driven models [2] (black-box models).”
BackgroundEvaluating the Visualization of What a Deep Neural Network Has Learned
Samek, W., Binder, A., Montavon, G., Lapuschkin, S., & Muller, K.-R. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2599820 · Cited by 1,164
Kernel partial least squares regression in reproducing kernel hilbert space
Rosipal, R., & Trejo, L. J. (2002) · doi:10.5555/944790.944806 · Cited by 873
Soft Sensors for Monitoring and Control of Industrial Processes
(2007) · Advances in Industrial Control · doi:10.1007/978-1-84628-480-9 · Cited by 710
Cited by
A Data-Driven Auto-CNN-LSTM Prediction Model for Lithium-Ion Battery Remaining Useful Life
Ren, L., Dong, J., Wang, X., Meng, Z., Zhao, L., & Deen, M. J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3008223 · Cited by 690
A Survey on Deep Learning for Data-Driven Soft Sensors
Sun, Q., & Ge, Z. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3053128 · Cited by 665
Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network
Yuan, X., Li, L., & Wang, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2902129 · Cited by 550
Self-citationDeep Learning With Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development
Yuan, X., Li, L., Shardt, Y. A. W., Wang, Y., & Yang, C. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.2984443 · Cited by 524
Self-citationWang, Y., Pan, Z., Yuan, X., Yang, C., & Gui, W. (2020) · ISA Transactions · doi:10.1016/j.isatra.2019.07.001 · Cited by 407
Self-citationArtificial Intelligence Forecasting of Covid-19 in China
Hu, Z., Ge, Q., Li, S., & Xiong, M. (2020) · International Journal of Educational Excellence · doi:10.18562/ijee.054 · Cited by 351
Automatic fruit classification using deep learning for industrial applications
Hossain, M. S., Al-Hammadi, M., & Muhammad, G. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2875149 · Cited by 347
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 318
An unsupervised fault diagnosis method for rolling bearing using STFT and generative neural networks
Tao, H., Wang, P., Chen, Y., Stojanovic, V., & Yang, H. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2020.04.024 · Cited by 315
A Two-Stage Approach for the Remaining Useful Life Prediction of Bearings Using Deep Neural Networks
Xia, M., Li, T., Shu, T., Wan, J., de Silva, C. W., & Wang, Z. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2868687 · Cited by 291
Yuan, X., Zhou, J., Huang, B., Wang, Y., Yang, C., & Gui, W. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2938890 · Cited by 289
Self-citationAdly, A. S., Adly, A. S., & Adly, M. S. (2020) · Journal of Medical Internet Research · doi:10.2196/19104 · Cited by 138
Yu, H., Zhang, L., Wang, W., Li, S., Chen, S., Yang, S., Li, J., & Liu, X. (2023) · Energy · doi:10.1016/j.energy.2023.127846 · Cited by 96
Guo, R., Liu, H., & Liu, D. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3297663 · Cited by 79
Xie, J., Du, G., Shen, C., Chen, N., Chen, L., & Zhu, Z. (2018) · IEEE Access · doi:10.1109/access.2018.2877447 · Cited by 78
“Some typical deep-learning networks include stacked auto-encoder [14], convolutional neural network (CNN) [15], and deep belief network (DBN) [16].”
Background
Metadata
- Authors
- Yuan, X., Huang, B., Wang, Y., Yang, C., & Gui, W.
- Venue
- IEEE Transactions on Industrial Informatics
- Published
- 2018-07
- Volume
- 14
- Issue
- 7
- Pages
- 3235-3243
- ISSN
- 1551-3203 (ISSN-L)
- 1941-0050
- OpenAlex
- W2788805965
- Cited by
- 635
- References
- 30
- FWCI
- 47.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.