The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Deep Anomaly Detection for Time-Series Data in Industrial IoT: A Communication-Efficient On-Device Federated Learning Approach
Open accessAbstract
Since edge device failures (i.e., anomalies) seriously affect the production of industrial products in Industrial IoT (IIoT), accurately and timely detecting anomalies are becoming increasingly important. Furthermore, data collected by the edge device contain massive user's private data, which is challenging current detection approaches as user privacy has attracted more and more public concerns. With this focus, this article proposes a new communication-efficient on-device federated learning (FL)-based deep anomaly detection framework for sensing time-series data in IIoT. Specifically, we first introduce an FL framework to enable decentralized edge devices to collaboratively train an anomaly detection model, which can improve its generalization ability. Second, we propose an attention mechanism-based convolutional neural network-long short-term memory (AMCNN-LSTM) model to accurately detect anomalies. The AMCNN-LSTM model uses attention mechanism-based convolutional neural network units to capture important fine-grained features, thereby preventing memory loss and gradient dispersion problems. Furthermore, this model retains the advantages of the long short-term memory unit in predicting time-series data. Third, to adapt the proposed framework to the timeliness of industrial anomaly detection, we propose a gradient compression mechanism based on Top- k selection to improve communication efficiency. Extensive experimental studies on four real-world data sets demonstrate that our framework accurately and timely detects anomalies and also reduces the communication overhead by 50% compared to the FL framework that does not use the gradient compression scheme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 4×
“In statistics, anomalies (also called outliers and abnormalities) are the data points that are significantly different from other observations [11].”
BackgroundResultInfluentialHigh-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning
Erfani, S. M., Rajasegarar, S., Karunasekera, S., & Leckie, C. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.03.028 · Cited by 1,162
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134
LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819 · cited 3×
“that of CNN-LSTM [41], LSTM [5], gate recurrent unit (GRU) [42], stacked autoencoders (SAEs) [43], and SVM [21] method with an identical simulation configuration.”
BackgroundMethodPrivacy-Preserving Traffic Flow Prediction: A Federated Learning Approach
Liu, Y., Yu, J. J. Q., Kang, J., Niyato, D., & Zhang, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991401 · Cited by 712 · cited 3×
“lenges, a collaboratively distributed deep learning paradigm, called federated deep learning, was proposed for edge devices to train a global model while keeping the training data sets locally without sharing raw training data [18].”
BackgroundInfluentialSelf-citationDeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series
Munir, M., Siddiqui, S. A., Dengel, A., & Ahmed, S. (2019) · IEEE Access · doi:10.1109/access.2018.2886457 · Cited by 696
DÏoT: A Federated Self-learning Anomaly Detection System for IoT
Nguyen, T. D., Marchal, S., Miettinen, M., Fereidooni, H., Asokan, N., & Sadeghi, A.-R. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00080 · Cited by 663
Deep Fuzzy Hashing Network for Efficient Image Retrieval
Lu, H., Zhang, M., Xu, X., Li, Y., & Shen, H. T. (2021) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2020.2984991 · Cited by 340 · cited 1×
“[14] proposed a long short-term memory (LSTM) networks-based deep learning model to achieve anomaly detection in sensing time-series”
BackgroundWeb traffic anomaly detection using C-LSTM neural networks
Kim, T.-Y., & Cho, S.-B. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.04.004 · Cited by 340
A generic framework for privacy preserving deep learning
Ryffel, T., Trask, A., Dahl, M., Wagner, B., Mancuso, J., Rueckert, D., & Passerat-Palmbach, J. (2018) · arXiv · doi:10.48550/arxiv.1811.04017 · Cited by 335
A Hybrid Deep Learning-Based Model for Anomaly Detection in Cloud Datacenter Networks
Garg, S., Kaur, K., Kumar, N., Kaddoum, G., Zomaya, A. Y., & Ranjan, R. (2019) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2019.2927886 · Cited by 287
Self-citationPeng, H., & Shen, X. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.2978856 · Cited by 222
Wulsin, D. F., Gupta, J. R., Mani, R., Blanco, J. A., & Litt, B. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/3/036015 · Cited by 185
Distributed Anomaly Detection Using Autoencoder Neural Networks in WSN for IoT
Luo, T., & Nagarajan, S. G. (2018) · 2018 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2018.8422402 · Cited by 171
Chouhan, N., Khan, A., & Khan, H.-U.-R. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105612 · Cited by 128
A multi-stage anomaly detection scheme for augmenting the security in IoT-enabled applications
Garg, S., Kaur, K., Batra, S., Kaddoum, G., Kumar, N., & Boukerche, A. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.09.038 · Cited by 124
Self-citationEn-ABC: An ensemble artificial bee colony based anomaly detection scheme for cloud environment
Garg, S., Kaur, K., Batra, S., Aujla, G. S., Morgan, G., Kumar, N., Zomaya, A. Y., & Ranjan, R. K. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.09.013 · Cited by 114
Self-citationAnomaly detection and privacy preservation in cloud-centric Internet of Things
Bütün, İ., Kantarcı, B., & Erol‐Kantarci, M. (2015) · IEEE International Conference on Communications workshops · doi:10.1109/iccw.2015.7247572 · Cited by 67
Deep hierarchical encoding model for sentence semantic matching
Lü, W., Zhang, X., Lu, H., & Li, F. (2020) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2020.102794 · Cited by 67
Anomaly-based intrusion detection: privacy concerns and other problems
Lundin, E., & Jonsson, E. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00134-1 · Cited by 66
Wu, Y., Liu, Y., Ahmed, S. H., Peng, J., & El-Latif, A. A. A. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2946753 · Cited by 66
Self-citationKang, J., Xiong, Z., Jiang, C., Liu, Y., Guo, S., Zhang, Y., Niyato, D. T., Leung, C., & Miao, C. (2020) · Communications in computer and information science · doi:10.1007/978-981-15-9213-3_12 · Cited by 61
Self-citationPeng, Y., Tan, A., Wu, J., & Bi, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2930627 · Cited by 58
Research works printed but not linked: 16
- vaswani, 2017, Attention is all you need, Proc Adv Neural Inf Process Syst, 5998
- zhao, 2019, Shielding collaborative learning Mitigating poisoning attacks through client-side detection
- wangni, 2018, Gradient sparsification for communication-efficient distributed optimization, Proc Adv Neural Inf Process Syst, 1299
- mnih, 2014, Recurrent models of visual attention, Proc Adv Neural Inf Process Syst, 2204
- alistarh, 2017, QSGD: Communication-efficient SGD via gradient quantization and encoding, Proc Adv Neural Inf Process Syst, 1709
- malhotra, 2015, Long short term memory networks for anomaly detection in time series, Proc ESANN, 89, 89
- ito, 2020, An on-device federated learning approach for cooperative anomaly detection
- reisizadeh, 2019, FedPAQ A communication-efficient federated learning method with periodic averaging and quantization
- 10.1109/JSAC.2016.2621618 · doi:10.1109/jsac.2016.2621618
- agarwal, 2018, CPSGD: Communication-efficient and differentially private distributed SGD, Proc Adv Neural Inf Process Syst, 7564
- jeong, 2018, Communication-efficient on-device machine learning Federated distillation and augmentation under non-iid private data
- tsukada, 2019, A neural network based on-device learning anomaly detector for edge devices
- buda, 2018, DeepAD: A generic framework based on deep learning for time series anomaly detection, Proc Pac –Asia Conf Knowl Disc Data Min, 577
- guo, 2018, Multidimensional time series anomaly detection: A GRU-based Gaussian mixture variational autoencoder approach, Proc Asian Conf Mach Learn, 97
- zong, 2018, Deep autoencoding Gaussian mixture model for unsupervised anomaly detection, Proc ICLR, 1
- kone?nc, 2016, Federated learning Strategies for improving communication efficiency
Cited by
A Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774
Federated-Learning-Based Anomaly Detection for IoT Security Attacks
Mothukuri, V., Khare, P., Parizi, R. M., Pouriyeh, S., Dehghantanha, A., & Srivastava, G. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3077803 · Cited by 722
Industrial Internet of Things and its Applications in Industry 4.0: State of The Art
Malik, P. K., Sharma, R., Singh, R., Gehlot, A., Satapathy, S. C., Alnumay, W. S., Pelusi, D., Ghosh, U., & Nayak, J. (2021) · Computer Communications · doi:10.1016/j.comcom.2020.11.016 · Cited by 523
Detection of False Data Injection Attacks in Smart Grid: A Secure Federated Deep Learning Approach
Li, Y., Wei, X., Li, Y., Dong, Z., & Shahidehpour, M. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3204796 · Cited by 393
Privacy-preserving blockchain-based federated learning for traffic flow prediction
Qi, Y., Hossain, M. S., Nie, J., & Li, X. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.12.003 · Cited by 339
Self-citation
Metadata
- Authors
- Liu, Y., Garg, S., Nie, J., Zhang, Y., Xiong, Z., Kang, J., & Hossain, M. S.
- Venue
- IEEE Internet of Things Journal
- Published
- 2021-04-15
- Volume
- 8
- Issue
- 8
- Pages
- 6348-6358
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3044515030
- Cited by
- 541
- References
- 26
- FWCI
- 22.54
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Alibaba Group through the Alibaba Innovative Research (AIR) Program and the Alibaba-NTU Singapore Joint Research Institute (JRI), NTU, Singapore
- Open Research Project of the State Key Laboratory of Industrial Control Technology, Zhejiang University, China (ICT20044)
- National Natural Science Foundation of China (51806157)
- Young Innovation Talents Project in Higher Education of Guangdong Province, China (2018KQNCX333)
- Researchers Supporting Project (RSP-2020/32)
- King Saud University, Riyadh, Saudi Arabia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.