The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Multi-head CNN–RNN for multi-time series anomaly detection: An industrial case study
Open accessAbstract
Abstract Detecting anomalies in time series data is becoming mainstream in a wide variety of industrial applications in which sensors monitor expensive machinery. The complexity of this task increases when multiple heterogeneous sensors provide information of different nature, scales and frequencies from the same machine. Traditionally, machine learning techniques require a separate data pre-processing before training, which tends to be very time-consuming and often requires domain knowledge. Recent deep learning approaches have shown to perform well on raw time series data, eliminating the need for pre-processing. In this work, we propose a deep learning based approach for supervised multi-time series anomaly detection that combines a Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) in different ways. Unlike other approaches, we use independent CNNs, so-called convolutional heads, to deal with anomaly detection in multi-sensor systems. We address each sensor individually avoiding the need for data pre-processing and allowing for a more tailored architecture for each type of sensor. We refer to this architecture as Multi-head CNN–RNN. The proposed architecture is assessed against a real industrial case study, provided by an industrial partner, where a service elevator is monitored. Within this case study, three type of anomalies are considered: point, context-specific, and collective.The experimental results show that the proposed architecture is suitable for multi-time series anomaly detection as it obtained promising results on the real industrial scenario.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
Handbook of Parametric and Nonparametric Statistical Procedures
(2004) · Technometrics · doi:10.1198/tech.2004.s209 · Cited by 4,661
Intelligent Manufacturing in the Context of Industry 4.0: A Review
Zhong, R. Y., Xu, X., Klotz, E., & Newman, S. T. (2017) · Engineering · doi:10.1016/j.eng.2017.05.015 · Cited by 2,913
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 4×
“As described, time series are processed in a window-based way [29].”
BackgroundMethodInfluentialGarcía, S., Fernández, A., Luengo, J., & Herrera, F. (2010) · Information Sciences · doi:10.1016/j.ins.2009.12.010 · Cited by 2,229
Gate-variants of Gated Recurrent Unit (GRU) neural networks
Dey, R., & Salem, F. M. (2017) · 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2017.8053243 · Cited by 2,186
A review on time series data mining
Fu, T.-C. (2011) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2010.09.007 · Cited by 1,500
Learning from Imbalanced Data Sets
Fernández, A., García, S., Galar, M., Prati, R. C., Krawczyk, B., & Herrera, F. (2018) · doi:10.1007/978-3-319-98074-4 · Cited by 1,349
García, S., & Herrera, F. (2008) · Cited by 1,277
Long Short Term Memory Networks for Anomaly Detection in Time Series.
Malhotra, P., Vig, L., Shroff, G. M., & Agarwal, P. (2015) · The European Symposium on Artificial Neural Networks · Cited by 1,259
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data
Goldstein, M., & Uchida, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152173 · Cited by 1,032
Unsupervised real-time anomaly detection for streaming data
Ahmad, S., Lavin, A., Purdy, S., & Agha, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.070 · Cited by 995
Convolutional neural networks for time series classification
College of Electronic Science and Engineering, N. U. O. D. T., Zhao, B., Lu, H., College of Electronic Science and Engineering, N. U. O. D. T., Chen, S., College of Electronic Science and Engineering, N. U. O. D. T., Liu, J., College of Electronic Science and Engineering, N. U. O. D. T., Wu, D., & College of Electronic Science and Engineering, N. U. O. D. T. (2017) · Journal of Systems Engineering and Electronics · doi:10.21629/jsee.2017.01.18 · Cited by 881
LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819
Real-time human activity recognition from accelerometer data using Convolutional Neural Networks
Ignatov, A. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2017.09.027 · Cited by 814
García, S., Fernández, A., Luengo, J., & Herrera, F. (2009) · Soft Computing · doi:10.1007/s00500-008-0392-y · Cited by 682
Internet of Things Architecture: Recent Advances, Taxonomy, Requirements, and Open Challenges
Yaqoob, I., Ahmed, E., Hashem, I. A. T., Ahmed, A. I. A., Gani, A., Imran, M., & Guizani, M. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1600421 · Cited by 668
Bao, Y., Tang, Z., Li, H., & Zhang, Y. (2019) · Structural Health Monitoring · doi:10.1177/1475921718757405 · Cited by 616
Scime, L., & Beuth, J. (2018) · Additive Manufacturing · doi:10.1016/j.addma.2017.11.009 · Cited by 489
Real-time big data processing for anomaly detection: A survey
Ariyaluran Habeeb, R. A., Nasaruddin, F., Gani, A., Targio Hashem, I. A., Ahmed, E., & Imran, M. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.08.006 · Cited by 487
Yan, J., Meng, Y., Lu, L., & Li, L. (2017) · IEEE Access · doi:10.1109/access.2017.2765544 · Cited by 479
To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques
Abdi, L., & Hashemi, S. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2458858 · Cited by 411
Pourbabaee, B., Roshtkhari, M. J., & Khorasani, K. (2018) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2017.2705582 · Cited by 411
Anomaly detection in ECG time signals via deep long short-term memory networks
Chauhan, S., & Vig, L. (2015) · 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344872 · Cited by 405
Zheng, J., Pan, H., & Cheng, J. (2017) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2016.09.010 · Cited by 379
State-of-the-Art Predictive Maintenance Techniques*
Hashemian, H. M., & Bean, W. C. (2011) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2036347 · Cited by 348
Liu, R., Meng, G., Yang, B., Sun, C., & Chen, X. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2645238 · Cited by 345
Very Deep Convolutional Neural Networks for Noise Robust Speech Recognition
Qian, Y., Bi, M., Tan, T., & Yu, K. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2602884 · Cited by 343
Web traffic anomaly detection using C-LSTM neural networks
Kim, T.-Y., & Cho, S.-B. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.04.004 · Cited by 340
Kanjo, E., Younis, E. M. G., & Ang, C. S. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.001 · Cited by 293
Network Anomaly Detection System using Genetic Algorithm and Fuzzy Logic
Hamamoto, A. H., Carvalho, L. F., Sampaio, L. D. H., Abrão, T., & Proença, M. L. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.013 · Cited by 259
Tsironi, E., Barros, P., Weber, C., & Wermter, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.088 · Cited by 248
Collective Anomaly Detection Based on Long Short-Term Memory Recurrent Neural Networks
Bontemps, L., Cao, V. L., McDermott, J., & Le-Khac, N.-A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48057-2_9 · Cited by 245
Camps, J., Samà, A., Martín, M., Rodríguez-Martín, D., Pérez-López, C., Moreno Arostegui, J. M., Cabestany, J., Català, A., Alcaine, S., Mestre, B., et al. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.10.017 · Cited by 224
Cross-entropy vs. squared error training: a theoretical and experimental comparison
Golik, P., Doetsch, P., & Ney, H. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-436 · Cited by 220
Triguero, I., García‐Gil, D., Maillo, J., Luengo, J., García, S., & Herrera, F. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1289 · Cited by 215
Self-citationProceedings of the European Symposium on Artificial Neural Networks
Tang, T. B., & Murray, A. T. (2006) · Cited by 206
Learning from Imbalanced Data Sets
ndez, A. F., ́a, S. G., Galar, M., & Ronaldo, C. (2018) · Cited by 186
Detecting known and unknown faults in automotive systems using ensemble-based anomaly detection
Theissler, A. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.02.023 · Cited by 160
A CNN–RNN architecture for multi-label weather recognition
Zhao, B., Li, X., Lu, X., & Wang, Z. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.048 · Cited by 154
Knowledge Guided Disambiguation for Large-Scale Scene Classification With Multi-Resolution CNNs
Wang, L., Guo, S., Huang, W., Xiong, Y., & Qiao, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2675339 · Cited by 153
Spatial anomaly detection in sensor networks using neighborhood information
Bosman, H. H. W. J., Iacca, G., Tejada, A., Wörtche, H. J., & Liotta, A. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.04.007 · Cited by 149
Dealing with the evaluation of supervised classification algorithms
Santafé, G., Inza, I., & Lozano, J. A. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-015-9433-y · Cited by 148
Shipmon, D. T., Gurevitch, J. M., Piselli, P. M., & Edwards, S. T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.03665 · Cited by 141
Filonov, P., Lavrentyev, A., & Vorontsov, A. (2016) · arXiv · doi:10.48550/arxiv.1612.06676 · Cited by 140
Integrated Oversampling for Imbalanced Time Series Classification
Cao, H., Li, X., Woon, D. Y.-K., & Ng, S.-K. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.37 · Cited by 130
Unsupervised Sequential Outlier Detection With Deep Architectures
Lu, W., Cheng, Y., Xiao, C., Chang, S., Huang, S., Liang, B., & Huang, T. S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713048 · Cited by 127
Multi-view stacking for activity recognition with sound and accelerometer data
Garcia-Ceja, E., Galvan-Tejada, C. E., & Brena, R. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.06.004 · Cited by 125
Kanarachos, S., Christopoulos, S.-R. G., Chroneos, A., & Fitzpatrick, M. E. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.028 · Cited by 120
Cauteruccio, F., Fortino, G., Guerrieri, A., Liotta, A., Mocanu, D. C., Perra, C., Terracina, G., & Vega, M. T. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.11.010 · Cited by 118
Scenario-Based Insider Threat Detection From Cyber Activities
Chattopadhyay, P., Wang, L., & Tan, Y.-P. (2018) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2018.2857473 · Cited by 115
Survey on time series motif discovery
Torkamani, S., & Lohweg, V. (2017) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1199 · Cited by 110
Qian, W., Li, S., & Wang, J. (2018) · IEEE Access · doi:10.1109/access.2018.2880770 · Cited by 91
Detecting Anomalies in Time Series Data via a Meta-Feature Based Approach
Hu, M., Ji, Z., Yan, K., Guo, Y. C., Feng, X., Gong, J., Zhao, X., & Dong, L. (2018) · IEEE Access · doi:10.1109/access.2018.2840086 · Cited by 87
Geometric means and medians with applications to target detection
Hua, X., Cheng, Y., Wang, H., Qin, Y., & Li, Y. (2017) · IET Signal Processing · doi:10.1049/iet-spr.2016.0547 · Cited by 75
Resampling strategies for imbalanced time series forecasting
Moniz, N., Branco, P., & Torgo, L. (2017) · International Journal of Data Science and Analytics · doi:10.1007/s41060-017-0044-3 · Cited by 74
An unsupervised spatiotemporal graphical modeling approach for wind turbine condition monitoring
Yang, W., Liu, C., & Jiang, D. (2018) · Renewable Energy · doi:10.1016/j.renene.2018.04.059 · Cited by 73
Unsupervised outlier detection for time series by entropy and dynamic time warping
Benkabou, S.-E., Benabdeslem, K., & Canitia, B. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1067-8 · Cited by 72
Optimizing multi-sensor deployment via ensemble pruning for wearable activity recognition
Cao, J., Li, W., Ma, C., & Tao, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.08.002 · Cited by 72
Heterogeneous Sensor Data Fusion By Deep Multimodal Encoding
Liu, Z., Zhang, W., Lin, S., & Quek, T. Q. S. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2679538 · Cited by 65
Distributed Clustering Strategies in Industrial Wireless Sensor Networks
Cenedese, A., Luvisotto, M., & Michieletto, G. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2628409 · Cited by 59
Diez-Olivan, A., Pagan, J. A., Sanz, R., & Sierra, B. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.024 · Cited by 59
Gait Anomaly Detection of Subjects With Parkinson’s Disease Using a Deep Time Series-Based Approach
Paragliola, G., & Coronato, A. (2018) · IEEE Access · doi:10.1109/access.2018.2882245 · Cited by 51
Anomaly detection based on uncertainty fusion for univariate monitoring series
Pang, J., Liu, D., Peng, Y., & Peng, X. (2016) · Measurement · doi:10.1016/j.measurement.2016.10.031 · Cited by 45
Principled Sampling for Anomaly Detection
Juba, B., Musco, C., Long, F., Sidiroglou, S., & Rinard, M. (2015) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2015.23268 · Cited by 33
One-Class Collective Anomaly Detection Based on LSTM-RNNs
Thi, N. N., Cao, V. L., & Le‐Khac, N. (2017) · Lecture notes in computer science · doi:10.1007/978-3-662-56266-6_4 · Cited by 32
Collaborative Multi-Sensor Classification Via Sparsity-Based Representation
Dao, M., Nguyen, N. H., Nasrabadi, N. M., & Tran, T. D. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2521605 · Cited by 30
Spatial pyramid deep hashing for large-scale image retrieval
Zhao, W., Luo, H., Peng, J., & Jianping Fan, B. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.021 · Cited by 23
A Signal-Level Transfer Learning Framework for Autonomous Reconfiguration of Wearable Systems
Saeedi, R., & Gebremedhin, A. H. (2018) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2878673 · Cited by 17
Brain activation detection by modified neighborhood one-class SVM on fMRI data
Tang, X., Zeng, W., Shi, Y., & Zhao, L. (2017) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.08.021 · Cited by 13
Cited by
Deep Learning for Time Series Forecasting: A Survey
Torres, J. F., Hadjout, D., Sebaa, A., Martínez-Álvarez, F., & Troncoso, A. (2021) · Big Data · doi:10.1089/big.2020.0159 · Cited by 818
Fink, O., Wang, Q., Svensén, M., Dersin, P., Lee, W.-J., & Ducoffe, M. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103678 · Cited by 549
A survey on anomaly detection for technical systems using LSTM networks
Lindemann, B., Maschler, B., Sahlab, N., & Weyrich, M. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103498 · Cited by 445
Multi-input CNN-GRU based human activity recognition using wearable sensors
Dua, N., Singh, S. N., & Semwal, V. B. (2021) · Computing · doi:10.1007/s00607-021-00928-8 · Cited by 432
DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection
Yang, Y., Zhang, C., Zhou, T., Wen, Q., & Sun, L. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599295 · Cited by 387
Metadata
- Authors
- Canizo, M., Triguero, I., Conde, A., & Onieva, E.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 363
- Pages
- 246-260
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W2964336507
- Cited by
- 420
- References
- 82
- FWCI
- 17.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.