Agent based dynamic thresholding for adaptive anomaly detection using reinforcement learning
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Reinforcement learning approaches to dynamic thresholding [22] and adaptive cost policies have been proposed conceptually but lack empirical validation inside live systems.”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
In the citing paper
“Earlier ANN-based alert triage experiments hinted at SIEM alignment [5], yet no study has documented a calibrated CNN-based insider detector operating live within the SIEM loop.”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
In the citing paper
“(iv) SIEM-integrated, calibrated evaluation remains rare [5,22,32].”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
In the citing paper
“Despite this, nearly all prior CNN-based insider detectors stop at offline evaluation.”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 2×
“Specifically, we apply the popular DRL algorithm DQN [25] to solve the MDP given its efficiency in the anomaly detection task.”
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 2×
“The application of anomaly detection has been explored extensively across a variety of research fields and application domains including data mining, network intrusion detection, medical and public health, and energy management [4].”
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Isolation-Based Anomaly Detection
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2012) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/2133360.2133363 · Cited by 2,063 · cited 1×
“Anomalies are often characterized by their rarity and distinctiveness, while simultaneously providing critical information [2].”
Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · cited 1×
“[20] presented an unsupervised and nonparametric thresholding approach for spacecraft anomaly detection without statistical assumptions about prediction errors.”
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., et al. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.2007.02500 · Cited by 1,718
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 4×
“They have difficulty adapting to non-stationary and evolving time series data [1].”
InfluentialUSAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · cited 5×
“In the literature, many existing anomaly detection approaches use static or expert-defined thresholds [3, 5, 6].”
InfluentialA Dataset to Support Research in the Design of Secure Water Treatment Systems
Goh, J., Adepu, S., Junejo, K. N., & Mathur, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71368-7_8 · Cited by 1,045 · cited 1×
“It consists of 11-day continuous operations where 7 days are under normal scenarios and 4 days are under attack scenarios [32].”
Research works printed but not linked: 3
- Yang X, Howley E, Schukat M (2023) Adt: agent-based dynamic thresholding for anomaly detection. Adaptive and learning agents workshop
- Ma J, Perkins S (2003) Time-series novelty detection using one-class support vector machines. Proceed Int Joint Conf Neural Netw 3:1741–1745
- Zong B, Song Q, Min MR, Cheng W, Lumezanu C, Cho D, Chen H (2018) Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In: International conference on learning representations
Cited by
Putrada, A. G., & Ilhami, D. A. S. (2024) · IEEE Student Conference on Research and Development (SCOReD) · doi:10.1109/scored64708.2024.10872727 · Cited by 8
A Federated Learning Approach for Efficient Anomaly Detection in Electric Power Steering Systems
Kea, K., Han, Y., & Min, Y.-J. (2024) · IEEE Access · doi:10.1109/access.2024.3397000 · Cited by 12
Raja, P., Dhanalakshmi, B., Rajan, T., Ravi, V., & Alghamdi, N. S. (2025) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-025-02134-1 · Cited by 5
Early Detection of DMA-Level Leaks in Water Networks Using Robust Regression Ensemble Framework
Chatterjee, S., Ghumkar, S., Ahbab, M. M., Ramachandran, A., Tenbrinck, D., Maier, A., Semmelmann, K., & Bayer, S. (2026) · Water · doi:10.3390/w18050563 · Cited by 4
Automated Machine Learning Configuration to Learn Intrusion Detectors on Attack-Free Datasets
Anser, O., François, J., & Chrisment, I. (2024) · Conference on Local Computer Networks · doi:10.1109/lcn60385.2024.10639690 · Cited by 6
Metadata
- Authors
- Yang, X., Howley, E., & Schukat, M.
- Affiliations
- Ollscoil na Gaillimhe – University of Galway (IE)
- Venue
- Neural Computing and Applications
- Published
- 2024-12-03
- Volume
- 37
- Issue
- 23
- Pages
- 18775-18791
- ISSN
- 0941-0643 (ISSN-L)
- 1433-3058
- OpenAlex
- W4404949567
- Cited by
- 11
- References
- 32
- Citations by year
- 2026: 7 · 2025: 3 · 2024: 1
- FWCI
- 1.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Neural Computing and Applications (publishedVersion)
- Funders
- College of Science and Engineering Postgraduate Research Scholarship of the University of Galway
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Keywords
- anomaly detection, dynamic thresholding, adaptive anomaly detection, reinforcement learning, deep Q-network, Markov decision process, binary thresholding, time series anomaly detection, non-stationary data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Agent based dynamic thresholding for adaptive anomaly detection using reinforcement learning. https://app.cochat.ai/papers/10.1007/s00521-024-10536-0
- The paper
- Yang, X., Howley, E., & Schukat, M. (2025). Agent based dynamic thresholding for adaptive anomaly detection using reinforcement learning. Neural Computing and Applications. https://doi.org/10.1007/s00521-024-10536-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.