Agent based dynamic thresholding for adaptive anomaly detection using reinforcement learning
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Reinforcement learning approaches to dynamic thresholding [22] and adaptive cost policies have been proposed conceptually but lack empirical validation inside live systems.”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
In the citing paper
“Earlier ANN-based alert triage experiments hinted at SIEM alignment [5], yet no study has documented a calibrated CNN-based insider detector operating live within the SIEM loop.”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
In the citing paper
“(iv) SIEM-integrated, calibrated evaluation remains rare [5,22,32].”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
In the citing paper
“Despite this, nearly all prior CNN-based insider detectors stop at offline evaluation.”
From A SIEM-Integrated Cybersecurity Prototype for Insider Threat Anomaly Detection Using Enterprise Logs and Behavioural Biometrics (2025) · cites this paper as [18]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 2×
“Specifically, we apply the popular DRL algorithm DQN [25] to solve the MDP given its efficiency in the anomaly detection task.”
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 2×
“The application of anomaly detection has been explored extensively across a variety of research fields and application domains including data mining, network intrusion detection, medical and public health, and energy management [4].”
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Isolation-Based Anomaly Detection
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2012) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/2133360.2133363 · Cited by 2,063 · cited 1×
“Anomalies are often characterized by their rarity and distinctiveness, while simultaneously providing critical information [2].”
Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · cited 1×
“[20] presented an unsupervised and nonparametric thresholding approach for spacecraft anomaly detection without statistical assumptions about prediction errors.”
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., et al. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.2007.02500 · Cited by 1,718
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 4×
“They have difficulty adapting to non-stationary and evolving time series data [1].”
InfluentialUSAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · cited 5×
“In the literature, many existing anomaly detection approaches use static or expert-defined thresholds [3, 5, 6].”
InfluentialA Dataset to Support Research in the Design of Secure Water Treatment Systems
Goh, J., Adepu, S., Junejo, K. N., & Mathur, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71368-7_8 · Cited by 1,045 · cited 1×
“It consists of 11-day continuous operations where 7 days are under normal scenarios and 4 days are under attack scenarios [32].”
Research works printed but not linked: 3
- Yang X, Howley E, Schukat M (2023) Adt: agent-based dynamic thresholding for anomaly detection. Adaptive and learning agents workshop
- Ma J, Perkins S (2003) Time-series novelty detection using one-class support vector machines. Proceed Int Joint Conf Neural Netw 3:1741–1745
- Zong B, Song Q, Min MR, Cheng W, Lumezanu C, Cho D, Chen H (2018) Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In: International conference on learning representations
Cited by
Putrada, A. G., & Ilhami, D. A. S. (2024) · IEEE Student Conference on Research and Development (SCOReD) · doi:10.1109/scored64708.2024.10872727 · Cited by 8
A Federated Learning Approach for Efficient Anomaly Detection in Electric Power Steering Systems
Kea, K., Han, Y., & Min, Y.-J. (2024) · IEEE Access · doi:10.1109/access.2024.3397000 · Cited by 12
Raja, P., Dhanalakshmi, B., Rajan, T., Ravi, V., & Alghamdi, N. S. (2025) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-025-02134-1 · Cited by 5
Early Detection of DMA-Level Leaks in Water Networks Using Robust Regression Ensemble Framework
Chatterjee, S., Ghumkar, S., Ahbab, M. M., Ramachandran, A., Tenbrinck, D., Maier, A., Semmelmann, K., & Bayer, S. (2026) · Water · doi:10.3390/w18050563 · Cited by 4
Automated Machine Learning Configuration to Learn Intrusion Detectors on Attack-Free Datasets
Anser, O., François, J., & Chrisment, I. (2024) · Conference on Local Computer Networks · doi:10.1109/lcn60385.2024.10639690 · Cited by 7
Mohamed, M. S. M., & Arabo, A. (2025) · doi:10.20944/preprints202511.1003.v1 · Cited by 3
“Reinforcement learning approaches to dynamic thresholding [18] and adaptive cost policies have been proposed conceptually but lack empirical validation inside live systems.”
Liu, Y., Chen, P., Oh, Y.-J., & Lim, C. G. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.061196 · Cited by 3
“In addition, reconstruction error and prediction error methods are fragile in the face of noise data, and the generalization ability is weak, which affects the practical application effect [30].”
Mi, J. (2025) · International Symposium on Computer and Information Processing Technology (ISCIPT) · doi:10.1109/iscipt67144.2025.11264893
“While effective against non-stationary time-series data in real-world datasets [2], current dynamic defenses remain siloed, lacking comprehensive protection against multi-dimensional threats in cloud-native environments.”
Multi-robot Collaborative Mapping and Localization Based on Cross-Validation Global Matching
Zhang, H., Pang, B., Zhang, D. Y., Xu, W., Xie, F., & Chen, J. (2025) · International Conference on Computer, Internet of Things and Smart City (CIoTSC) · doi:10.1109/ciotsc67482.2025.11413143
“The C-SLAM system consists of front-end, back-end and system-level components, with the front-end being responsible for landmark estimation, odometer measurement and loopback detection [9] .”
Suspicious Movement Detection: A Systematic Review of Challenges and Future WorkPreprint
Mahmood, M., & Naktal Moaid, E. D. A. N. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6497862
Dendritic Cell Algorithm with Reinforcement Learning for Adaptive Signal Categorization
Abudaqqa, Y., Othman, Z. A., & Bakar, A. A. (2026) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2026.079034
Threshold-Based Fault Detection in Industrial Cyber-Physical Systems: A Comparative Study
Aldrini, J., & Chihi, I. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-22795-9_19
Crichton, K., Reddy, A., & Ji, J. (2026) · doi:10.51593/20250002
Pari, S. N., Varshini, S. S., & Ramesha, M. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-21164-4_42
Zhu, X., Zhu, J., & Li, R. (2026) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2026.100706
“Yang et al. (2025) investigated the use of DQN for adaptive anomaly thresholding in streaming sensor data, showing improved performance in non-stationary environments where the characteristics of normal and anomalous data evolve over time.”
A Carbon Accounting Deviation Identification Method for Green Parks
Li, R., Cao, W., Di, Y., Shi, B., Yang, X., & Qiu, W. (2026) · International Conference on Energy Systems and Electrical Engineering (ESEE) · doi:10.1109/esee69148.2026.11601582
“Reinforcement learning-based methods have also been introduced to update thresholds in real time, improving performance in complex systems such as network security and CPS [16], [17].”
Self-citation
Metadata
- Authors
- Yang, X., Howley, E., & Schukat, M.
- Affiliations
- Ollscoil na Gaillimhe – University of Galway (IE)
- Venue
- Neural Computing and Applications
- Published
- 2024-12-03
- Volume
- 37
- Issue
- 23
- Pages
- 18775-18791
- ISSN
- 0941-0643 (ISSN-L)
- 1433-3058
- OpenAlex
- W4404949567
- Cited by
- 11
- References
- 32
- Citations by year
- 2026: 7 · 2025: 3 · 2024: 1
- FWCI
- 1.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Neural Computing and Applications (publishedVersion)
- Funders
- College of Science and Engineering Postgraduate Research Scholarship of the University of Galway
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Keywords
- anomaly detection, dynamic thresholding, adaptive anomaly detection, reinforcement learning, deep Q-network, Markov decision process, binary thresholding, time series anomaly detection, non-stationary data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.