CoChat

Effectively Detecting Operational Anomalies In Large-Scale IoT Data Infrastructures By Using A GAN-Based Predictive Model

The DOI matches its Crossref record; 44 of the 47 references it cites were found in a registry or an index.

Abstract

Quality of data services is crucial for operational large-scale internet-of-things (IoT) research data infrastructure, in particular when serving large amounts of distributed users. Effectively detecting runtime anomalies and diagnosing their root cause helps to defend against adversarial attacks, thereby essentially boosting system security and robustness of the IoT infrastructure services. However, conventional anomaly detection methods are inadequate when facing the dynamic complexities of these systems. In contrast, supervised machine learning methods are unable to exploit large amounts of data due to the unavailability of labeled data. This paper leverages popular GAN-based generative models and end-to-end one-class classification to improve unsupervised anomaly detection. A novel heterogeneous BiGAN-based anomaly detection model Heterogeneous Temporal Anomaly-reconstruction GAN (HTA-GAN) is proposed to make better use of a one-class classifier and a novel anomaly scoring function. The Generator-Encoder-Discriminator BiGAN structure can lead to practical anomaly score computation and temporal feature capturing. We empirically compare the proposed approach with several state-of-the-art anomaly detection methods on real-world datasets, anomaly benchmarks and synthetic datasets. The results show that HTA-GAN outperforms its competitors and demonstrates better robustness.

Overview

Integrity signals

Registry

Crossref · 10.1093/comjnl/bxac085

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 15

  1. Aggarwal, An introduction to outlier analysis. Outlier analysis, pp. 1–34
  2. Angiulli, European conference on principles of data mining and knowledge discovery, 15
  3. Zong, Deep autoencoding gaussian mixture model for unsupervised anomaly detection, International conference on learning representations
  4. Zhang, Proceedings of the AAAI conference on artificial intelligence, 1409
  5. Luo, 2017 IEEE International Conference on Multimedia and Expo (ICME), 439
  6. Knorr, Vldb, 211
  7. Ramaswamy, Proceedings of the 2000 ACM SIGMOD international conference on Management of data, 427
  8. Zhang, Pacific-Asia Conference on Knowledge Discovery and Data Mining, 813
  9. Liao, Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 537
  10. Gao, IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
  11. Schlegl, International conference on information processing in medical imaging, 146
  12. Akcay, Asian conference on computer vision, 622
  13. Arjovsky, International conference on machine learning, 214
  14. Sabokrou, Proceedings of the IEEE conference on computer vision and pattern recognition, 3379
  15. Zheng, Proceedings of the AAAI Conference on Artificial Intelligence, 1286

Cited by

See all 132

Metadata

Authors
Chen, P., Liu, H., Xin, R., Carval, T., Zhao, J., Xia, Y., & Zhao, Z.
Affiliations
  • Xihua University (CN)
  • University of Amsterdam (NL)
  • Euro-Argo ERIC (FR)
  • Chongqing University (CN)
Corresponding author
  • Xia, Yunni
  • Zhao, Zhiming
Venue
The Computer Journal
Published
2022-10-01
Volume
65
Issue
11
Pages
2909-2925
ISSN
  • 0010-4620 (ISSN-L)
  • 1460-2067
OpenAlex
W4293586385
Cited by
128
References
47
Citations by year
2026: 11 · 2025: 21 · 2024: 29 · 2023: 60 · 2022: 7
FWCI
9.62
Type
journal article
Language
en
Open access
closed
Locations
  • The Computer Journal (publishedVersion)
  • UvA-DARE (University of Amsterdam) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
Keywords
unsupervised anomaly detection, generative adversarial networks, one-class classification, temporal feature extraction, root cause diagnosis, adversarial attacks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.