The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Deep Learning With Spatiotemporal Attention-Based LSTM for Industrial Soft Sensor Model Development
Abstract
Industrial process data are naturally complex time series with high nonlinearities and dynamics. To model nonlinear dynamic processes, a long short-term memory (LSTM) network is very suitable for soft sensor model development. However, the original LSTM does not consider variable and sample relevance for quality prediction. In order to overcome this problem, a spatiotemporal attention-based LSTM network is proposed for soft sensor modeling, which can, not only identify important input variables that are related to the quality variable at each time step, but also adaptively discover quality-related hidden states across all time steps. By taking the spatiotemporal quality-relevant interactions into consideration, the prediction performance can be improved for the soft sensor model. The effectiveness and flexibility of the proposed model is demonstrated on an industrial hydrocracking process to predict the initial boiling points of heavy naphtha and aviation kerosene.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“To handlethisissue,alongshort-termmemory(LSTM)network wasproposedbyHochreiterandSchmidhuber[33],inwhich memory cells and three nonlinear gates are used to replace the basic activation unit in RNN. LSTM can not only forget the useless information in the past, but also judge the current information…”
MethodSequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“However, it is difficult for standard RNNs to model long sequences, since they also suffer from the gradient vanishing problem [32].”
BackgroundOn the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Hybrid speech recognition with Deep Bidirectional LSTM
Graves, A., Jaitly, N., & Mohamed, A.-R. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707742 · Cited by 1,736
A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., & Cottrell, G. W. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/366 · Cited by 1,585
Learning multiple layers of representation
Hinton, G. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.004 · Cited by 1,011
Yuan, X., Huang, B., Wang, Y., Yang, C., & Gui, W. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2809730 · Cited by 635
Self-citationNonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network
Yuan, X., Li, L., & Wang, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2902129 · Cited by 550
Self-citationData-driven soft sensor development based on deep learning technique
Shang, C., Yang, F., Huang, D., & Lyu, W. (2014) · Journal of Process Control · doi:10.1016/j.jprocont.2014.01.012 · Cited by 549
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2_2 · Cited by 545
Correlation based model validity tests for non-linear models
BlLLINGS, S. A., & Voon, W. S. (1986) · International Journal of Control · doi:10.1080/00207178608933593 · Cited by 421
Wang, Y., Pan, Z., Yuan, X., Yang, C., & Gui, W. (2020) · ISA Transactions · doi:10.1016/j.isatra.2019.07.001 · Cited by 407
Self-citationApplying LSTM to Time Series Predictable through Time-Window Approaches
Gers, F. A., Eck, D., & Schmidhuber, J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44668-0_93 · Cited by 334
A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application
Yan, W., Tang, D., & Lin, Y. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2622668 · Cited by 294
Yao, L., & Ge, Z. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2733448 · Cited by 289
Yuan, X., Zhou, J., Huang, B., Wang, Y., Yang, C., & Gui, W. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2938890 · Cited by 289
Self-citationDesign of inferential sensors in the process industry: A review of Bayesian methods
Khatibisepehr, S., Huang, B., & Khare, S. (2013) · Journal of Process Control · doi:10.1016/j.jprocont.2013.05.007 · Cited by 262
Applying LSTM to Time Series Predictable Through Time-Window Approaches
Gers, F. A., Eck, D., & Schmidhuber, J. (2002) · Perspectives in Neural Computing · doi:10.1007/978-1-4471-0219-9_20 · Cited by 247
Yuan, X., Wang, Y., Yang, C., Ge, Z., Song, Z., & Gui, W. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2733443 · Cited by 183
Self-citationYuan, X., Ge, Z., Huang, B., Song, Z., & Wang, Y. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2610839 · Cited by 176
Self-citationYuan, X., Ou, C., Wang, Y., Yang, C., & Gui, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2951708 · Cited by 175
Self-citationA Deep Supervised Learning Framework for Data-Driven Soft Sensor Modeling of Industrial Processes
Yuan, X., Gu, Y., Wang, Y., Yang, C., & Gui, W. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2957366 · Cited by 151
Self-citationShao, W., & Tian, X. (2015) · Process Safety and Environmental Protection · doi:10.1016/j.cherd.2015.01.006 · Cited by 145
Yuan, X., Li, L., Wang, Y., Yang, C., & Gui, W. (2019) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.23665 · Cited by 132
Self-citationYuan, X., Ou, C., Wang, Y., Yang, C., & Gui, W. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.11.107 · Cited by 128
Self-citationA Probabilistic Just-in-Time Learning Framework for Soft Sensor Development With Missing Data
Yuan, X., Ge, Z., Huang, B., & Song, Z. (2016) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2016.2579609 · Cited by 126
Self-citationYuan, X., Ou, C., Wang, Y., Yang, C., & Gui, W. (2020) · Chemical Engineering Science · doi:10.1016/j.ces.2020.115509 · Cited by 125
Self-citationDeep Learning of Complex Batch Process Data and Its Application on Quality Prediction
Wang, K., Gopaluni, R. B., Chen, J., & Song, Z. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2880968 · Cited by 116
Stacked Enhanced Auto-Encoder for Data-Driven Soft Sensing of Quality Variable
Yuan, X., Qi, S., & Wang, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2985614 · Cited by 110
Self-citationStacked isomorphic autoencoder based soft analyzer and its application to sulfur recovery unit
Yuan, X., Wang, Y., Yang, C., & Gui, W. (2020) · Information Sciences · doi:10.1016/j.ins.2020.03.018 · Cited by 96
Self-citationProbabilistic learning of partial least squares regression model: Theory and industrial applications
Zheng, J., Song, Z., & Ge, Z. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.08.014 · Cited by 75
Yuan, X., Zhou, J., Wang, Y., & Yang, C. (2018) · Journal of Chemometrics · doi:10.1002/cem.3040 · Cited by 72
Self-citationMixture Bayesian Regularization of PCR Model and Soft Sensing Application
Ge, Z. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2385042 · Cited by 67
Dam, M., & Saraf, D. N. (2006) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2005.12.001 · Cited by 60
Yuan, X., Zhou, J., & Wang, Y. (2020) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2019.103921 · Cited by 47
Self-citationLanguage modeling with highway LSTM
Kurata, G., Ramabhadran, B., Saon, G., & Sethy, A. (2017) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2017.8268942 · Cited by 44
Wang, Y., Wu, D., & Yuan, X. (2019) · Journal of Chemometrics · doi:10.1002/cem.3185 · Cited by 44
Self-citationYuan, X., Zhou, J., & Wang, Y. (2018) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls.2018.8516025 · Cited by 18
Self-citationA deep learning based soft sensor for a sour water stripping plant
Graziani, S., & Xibilia, M. G. (2017) · IEEE International Instrumentation and Measurement Technology Conference · doi:10.1109/i2mtc.2017.7969924 · Cited by 17
Cited by
Ma, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
Xu, G., Xu, J., & Zhu, Y. (2024) · PLOS ONE · doi:10.1371/journal.pone.0312856 · Cited by 33
Metadata
- Authors
- Yuan, X., Li, L., Shardt, Y. A. W., Wang, Y., & Yang, C.
- Venue
- IEEE Transactions on Industrial Electronics
- Published
- 2021-05
- Volume
- 68
- Issue
- 5
- Pages
- 4404-4414
- ISSN
- 0278-0046 (ISSN-L)
- 1557-9948
- OpenAlex
- W3015966228
- Cited by
- 524
- References
- 43
- FWCI
- 32.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.