LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Open accessAbstract
Mechanical devices such as engines, vehicles, aircrafts, etc., are typically instrumented with numerous sensors to capture the behavior and health of the machine. However, there are often external factors or variables which are not captured by sensors leading to time-series which are inherently unpredictable. For instance, manual controls and/or unmonitored environmental conditions or load may lead to inherently unpredictable time-series. Detecting anomalies in such scenarios becomes challenging using standard approaches based on mathematical models that rely on stationarity, or prediction models that utilize prediction errors to detect anomalies. We propose a Long Short Term Memory Networks based Encoder-Decoder scheme for Anomaly Detection (EncDec-AD) that learns to reconstruct 'normal' time-series behavior, and thereafter uses reconstruction error to detect anomalies. We experiment with three publicly available quasi predictable time-series datasets: power demand, space shuttle, and ECG, and two real-world engine datasets with both predictive and unpredictable behavior. We show that EncDec-AD is robust and can detect anomalies from predictable, unpredictable, periodic, aperiodic, and quasi-periodic time-series. Further, we show that EncDec-AD is able to detect anomalies from short time-series (length as small as 30) as well as long time-series (length as large as 500).
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Input data can be reconstructed using the encoder-decoder structure and insider threat behaviors can be effectively detected with the help of reconstruction errors.
“Input data can be reconstructed using the encoderdecoder structure and insider threat behaviors can be effectively detected with the help of reconstruction errors (Malhotra et al. 2016).”
From BRITD: behavior rhythm insider threat detection with time awareness and user adaptation (2024) · cites this paper as Malhotra et al. 2016
The Introduction (p. 1) says the encoder-decoder reconstructs input time-series and uses reconstruction error to assess anomalies. The paper studies multi-sensor time-series, not insider threat behavior, so it does not support the claim that this method effectively detects insider threats. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Semi-Supervised Anomaly Detection for EEG Waveforms Using Deep Belief Nets
Wulsin, D., Blanco, J., Mani, R., & Litt, B. (2010) · 2010 Ninth International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.71 · Cited by 98 · cited 1× · see citing works
“Non-temporal reconstruction models such as denoising au-toencoders for anomaly detection (Sakurada & Yairi, 2014) and Deep Belief Nets (Wulsin et al., 2010) have been proposed.”
Method
Flagged first, then by citations
Research works printed but not linked: 15
- Bengio, Samy, Vinyals, Oriol, Jaitly, Navdeep, and Shazeer, Noam. Scheduled sampling for sequence prediction with recurrent neural networks. In Advances in Neural Information Processing Systems , pp. 1171-1179, 2015.
- Cho, Kyunghyun, Van Merri¨ enboer, Bart, Gulcehre, Caglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, and Bengio, Yoshua. Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 , 2014. · arXiv
- Hayton, Paul, Utete, Simukai, King, Dennis, King, Steve, Anuzis, Paul, and Tarassenko, Lionel. Static and dynamic novelty detection methods for jet engine health monitoring. Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences , 365(1851):493-514, 2007.
- Hochreiter, Sepp and Schmidhuber, J¨ urgen. Long shortterm memory. Neural computation , 9(8):1735-1780, 1997.
- Jolliffe, Ian. Principal component analysis . Wiley Online Library, 2002.
- Keogh, Eamonn, Lin, Jessica, and Fu, Ada. Hot sax: Efficiently finding the most unusual time series subsequence. In Data mining, Fifth IEEE International Conference on , pp. 8-pp. IEEE, 2005.
- Kingma, Diederik P. and Ba, Jimmy. Adam: A method for stochastic optimization. CoRR , abs/1412.6980, 2014. URL http://arxiv.org/abs/1412.6980 . · arXiv
- Li, Jiwei, Luong, Minh-Thang, and Jurafsky, Dan. A hierarchical neural autoencoder for paragraphs and documents. arXiv preprint arXiv:1506.01057 , 2015. · arXiv
- Ma, Junshui and Perkins, Simon. Online novelty detection on temporal sequences. In Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining , pp. 613-618. ACM, 2003.
- Malhotra, Pankaj, Vig, Lovekesh, Shroff, Gautam, and Agarwal, Puneet. Long short term memory networks for anomaly detection in time series. In ESANN, 23rd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning , 2015.
- Sakurada, Mayu and Yairi, Takehisa. Anomaly detection using autoencoders with nonlinear dimensionality reduction. In Proceedings of the MLSDA 2014 2Nd Workshop on Machine Learning for Sensory Data Analysis , MLSDA'14, pp. 4:4-4:11, New York, NY, USA, 2014. ACM.
- Sutskever, Ilya, Vinyals, Oriol, and Le, Quoc V. Sequence to sequence learning with neural networks. In Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N. D., and Weinberger, K. Q. (eds.), Advances in Neural Information Processing Systems 27 , pp. 3104-3112. Curran Associates, Inc., 2014.
- Vinyals, Oriol, Kaiser, Łukasz, Koo, Terry, Petrov, Slav, Sutskever, Ilya, and Hinton, Geoffrey. Grammar as a foreign language. In Advances in Neural Information Processing Systems , pp. 2755-2763, 2015.
- Yadav, Mohit, Malhotra, Pankaj, Vig, Lovekesh, Sriram, K, and Shroff, Gautam. Ode-augmented training improves anomaly detection in sensor data from machines. In NIPS Time Series Workshop 2015 . URL http: //arxiv.org/abs/1605.01534 .
- Ye, Nong et al. A markov chain model of temporal behavior for anomaly detection. In Proceedings of the 2000 IEEE Systems, Man, and Cybernetics Information Assurance and Security Workshop , volume 166, pp. 169. West Point, NY, 2000.
Cited by
Sorted by citations
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · see citing works
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · see citing works
Advanced Intrusion Detection Combining Signature-Based and Behavior-Based Detection Methods
Kwon, H.-Y., Kim, T., & Lee, M.-K. (2022) · Electronics · doi:10.3390/electronics11060867 · Cited by 85 · see citing works
Langone, R., Cuzzocrea, A., & Skantzos, N. (2020) · Data & Knowledge Engineering · doi:10.1016/j.datak.2020.101850 · Cited by 81 · see citing works
Deep Learning Based Attribute Classification Insider Threat Detection for Data Security
Meng, F., Lou, F., Fu, Y., & Tian, Z. (2018) · 2018 IEEE Third International Conference on Data Science in Cyberspace (DSC) · doi:10.1109/dsc.2018.00092 · Cited by 74 · see citing works
Modeling Quality of IoT Experience in Autonomous Vehicles
Minovski, D., Ahlund, C., & Mitra, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2975418 · Cited by 59 · see citing works
Li, Z., Duan, M., Xiao, B., & Yang, S. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3231923 · Cited by 45 · see citing works
BRITD: behavior rhythm insider threat detection with time awareness and user adaptation
Song, S., Gao, N., Zhang, Y., & Ma, C. (2024) · Cybersecurity · doi:10.1186/s42400-023-00190-9 · Cited by 45 · see citing works
Adversarial Autoencoder for Unsupervised Time Series Anomaly Detection and Interpretation
Chen, X., Deng, L., Zhao, Y., & Zheng, K. (2023) · Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3539597.3570371 · Cited by 36 · see citing works
Personalized relapse prediction in patients with major depressive disorder using digital biomarkers
Vairavan, S., Rashidisabet, H., Li, Q. S., Ness, S., Morrison, R. L., Soares, C. N., Uher, R., Frey, B. N., Lam, R. W., Kennedy, S. H., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-44592-8 · Cited by 14 · see citing works
Auto-Validate by-History: Auto-Program Data Quality Constraints to Validate Recurring Data Pipelines
Tu, D., He, Y., Cui, W., Ge, S., Zhang, H., Han, S., Zhang, D., & Chaudhuri, S. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599776 · Cited by 14 · see citing works
Anomaly Detection in Spacecraft Telemetry Data Based on Transformer-LSTM
Jiang, S., Jiang, Y., Wang, Y., Zhang, X., & Zhang, Z. (2023) · 2023 International Conference on Intelligent Communication and Networking (ICN) · doi:10.1109/icn60549.2023.10426290 · Cited by 8 · see citing works
Abnormal Activity Detection for the Elderly People using ConvLSTM Autoencoder
Nazerfard, E., Atashgahy, Z., & Nadali, A. (2021) · doi:10.21203/rs.3.rs-693084/v1 · Cited by 5 · see citing works
- Authors
- Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G.
- Affiliations
- Tata Consultancy Services (India) (IN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1607.00148
- OpenAlex
- W2474046725
- Cited by
- 819
- References
- 2
- Citations by year
- 2026: 20 · 2025: 54 · 2024: 144 · 2023: 150 · 2022: 118 · 2021: 119 · 2020: 100 · 2019: 66 · 2018: 35 · 2017: 10 · 2016: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
- Keywords
- anomaly detection, multi-sensor time series, LSTM encoder-decoder, reconstruction error, engine condition monitoring, short time series, power demand, Space Shuttle, ECG
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
