The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
LSTM Learning With Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT
Open accessAbstract
The data generated by millions of sensors in the industrial Internet of Things (IIoT) are extremely dynamic, heterogeneous, and large scale and pose great challenges on the real-time analysis and decision making for anomaly detection in the IIoT. In this article, we propose a long short-term memory (LSTM)-Gauss-NBayes method, which is a synergy of the long short-term memory neural network (LSTM-NN) and the Gaussian Bayes model for outlier detection in the IIoT. In a nutshell, the LSTM-NN builds a model on normal time series. It detects outliers by utilizing the predictive error for the Gaussian Naive Bayes model. Our method exploits advantages of both LSTM and Gaussian Naive Bayes models, which not only has strong prediction capability of LSTM for future time point data, but also achieves an excellent classification performance of the Gaussian Naive Bayes model through the predictive error. We evaluate our approaches on three real-life datasets that involve both long-term and short-term time dependence. Empirical studies demonstrate that our proposed techniques outperform the best-known competitors, which is a preferable choice for detecting anomalies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
(2010) · Cited by 8,261
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Time Series Analysis: Forecasting and Control.
Anderson, O. D., Box, G. E. P., & Jenkins, G. M. (1978) · The Statistician · doi:10.2307/2988198 · Cited by 5,298
Internet of Things in industries: A survey
Xu, L. D., He, W., & Li, S. (2014) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2014.2300753 · Cited by 5,172 · cited 1×
“THE INDUSTRIAL Internet of Things (IIoT) has been popularized and developed over the past few years [1], such as food processing industry, smart cities, and urban informatics.”
BackgroundOn the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Detection of Abrupt Changes: Theory and Application
Riedel, K. S. (1994) · Technometrics · doi:10.1080/00401706.1994.10485821 · Cited by 3,518
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Introduction to Bayesian Networks
(2019) · Operational Risk Modelling in Financial Services · doi:10.1002/9781119508557.ch12 · Cited by 2,569
Kalman Filtering and Neural Networks
(2001) · Wiley eBooks · doi:10.1002/0471221546 · Cited by 2,386
25 years of time series forecasting
De Gooijer, J. G., & Hyndman, R. J. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.01.001 · Cited by 1,587
An Introduction to Bayesian Networks.
Richardson, T., & Jensen, F. V. (1997) · Journal of the American Statistical Association · doi:10.2307/2965591 · Cited by 1,153
Big IoT data analytics: Architecture, opportunities, and open research challenges
(2017) · IEEE Access · doi:10.1109/access.2017.2689040 · Cited by 980
Time Series Analysis Forecasting and Control.
Chakravarti, I. M., Box, G. E. P., & Jenkins, G. M. (1973) · Journal of the American Statistical Association · doi:10.2307/2284112 · Cited by 972
Generalization of backpropagation with application to a recurrent gas market model
Werbos, P. J. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90007-x · Cited by 944
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
A Comparative Study of Anomaly Detection Schemes in Network Intrusion Detection
Lazarevic, A., Ertoz, L., Kumar, V., Ozgur, A., & Srivastava, J. (2003) · Proceedings of the 2003 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972733.3 · Cited by 865
Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning
Sajjadi, M. S. M., Javanmardi, M., & Taşdizen, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04586 · Cited by 532
PANFIS: A Novel Incremental Learning Machine
Pratama, M., Anavatti, S. G., Angelov, P. P., & Lughofer, E. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271933 · Cited by 260
Big Data Analytics for User-Activity Analysis and User-Anomaly Detection in Mobile Wireless Network
Parwez, M. S., Rawat, D. B., & Garuba, M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2650206 · Cited by 211
Behavior-Rule Based Intrusion Detection Systems for Safety Critical Smart Grid Applications
Mitchell, R., & Chen, I.-R. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2258948 · Cited by 184
Time series forecasting using neural networks
Kolarik, T., & Rudorfer, G. (1994) · Proceedings of the international conference on APL : the language and its applications: the language and its applications · doi:10.1145/190271.190290 · Cited by 175
Distributed Real-Time Anomaly Detection in Networked Industrial Sensing Systems
Chen, P.-Y., Yang, S., & McCann, J. A. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2350451 · Cited by 148 · cited 1×
“[29] introduced a decentralized general outlier detection method.”
MethodADDSEN: Adaptive Data Processing and Dissemination for Drone Swarms in Urban Sensing
Wu, D., Arkhipov, D. I., Kim, M., Talcott, C., Regan, A., McCann, J. A., & Venkatasubramanian, N. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2584061 · Cited by 108
Self-citationSupervised Anomaly Detection in Uncertain Pseudoperiodic Data Streams
Ma, J., Sun, L., Wang, H., Zhang, Y., & Aickelin, U. (2016) · ACM Transactions on Internet Technology · doi:10.1145/2806890 · Cited by 107
Detecting Malicious Data Injections in Wireless Sensor Networks: A Survey
Illiano, V. P., & Lupu, E. (2015) · ACM Computing Surveys · doi:10.1145/2818184 · Cited by 83
Delay-Tolerant Online Convex Optimization: Unified Analysis and Adaptive-Gradient Algorithms
Joulani, P., György, A., & Szepesvári, C. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10320 · Cited by 71
Fuzzy Time Series Forecasting With a Probabilistic Smoothing Hidden Markov Model
Cheng, Y., & Li, S.-T. (2011) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2011.2173583 · Cited by 64
Qin, Z., Wu, D., Xiao, Z. Q., Fu, B., & Qin, Z. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2846687 · Cited by 45
Self-citationEfficient distance-based outlier detection on uncertain datasets of Gaussian distribution
Shaikh, S. A., & Kitagawa, H. (2013) · World Wide Web · doi:10.1007/s11280-013-0211-y · Cited by 27
Extending the Modelling Capacity of Gaussian Conditional Random Fields while Learning Faster
Glass, J., Ghalwash, M. F., Vukičević, M., & Zoran Obradovic, A. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10301 · Cited by 17
Preheating Quantification for Smart Hybrid Heat Pumps Considering Uncertainty
Sun, M., Štrbac, G., Djapić, P., & Pudjianto, D. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2891089 · Cited by 14
Cited by
Research on particle swarm optimization in LSTM neural networks for rainfall-runoff simulation
Xu, Y., Hu, C., Wu, Q., Jian, S., Li, Z., Chen, Y., Zhang, G., Zhang, Z., & Wang, S. (2022) · Journal of Hydrology · doi:10.1016/j.jhydrol.2022.127553 · Cited by 364
Li, G., & Jung, J. J. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.10.008 · Cited by 361
IoT anomaly detection methods and applications: A survey
Chatterjee, A., & Ahmed, B. S. (2022) · Internet of Things · doi:10.1016/j.iot.2022.100568 · Cited by 323
“The algorithms attempt to distinguish between normal and anomalous behavior by establishing a decision boundary, such as with the support vector machine (SVM) classifier [15] or future forecasting values in streaming data [16] with LSTM networks [17].”
BackgroundLSTM-Autoencoder-Based Anomaly Detection for Indoor Air Quality Time-Series Data
Wei, Y., Jang-Jaccard, J., Xu, W., Sabrina, F., Camtepe, S., & Boulic, M. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3230361 · Cited by 269
Wang, X., Garg, S., Lin, H., Hu, J., Kaddoum, G., Jalil Piran, M., & Hossain, M. S. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3074382 · Cited by 268
Metadata
- Authors
- Wu, D., Jiang, Z., Xie, X., Wei, X., Yu, W., & Li, R.
- Venue
- IEEE Transactions on Industrial Informatics
- Published
- 2020-08
- Volume
- 16
- Issue
- 8
- Pages
- 5244-5253
- ISSN
- 1551-3203 (ISSN-L)
- 1941-0050
- OpenAlex
- W2987793235
- Cited by
- 290
- References
- 32
- FWCI
- 13.12
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.