The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
TranAD: deep transformer networks for anomaly detection in multivariate time series data
Open accessAbstract
Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a challenging problem. This is due to the lack of anomaly labels, high data volatility and the demands of ultra-low inference times in modern applications. Despite the recent developments of deep learning approaches for anomaly detection, only a few of them can address all of these challenges. In this paper, we propose TranAD, a deep transformer network based anomaly detection and diagnosis model which uses attention-based sequence encoders to swiftly perform inference with the knowledge of the broader temporal trends in the data. TranAD uses focus score-based self-conditioning to enable robust multi-modal feature extraction and adversarial training to gain stability. Additionally, model-agnostic meta learning (MAML) allows us to train the model using limited data. Extensive empirical studies on six publicly available datasets demonstrate that TranAD can outperform state-of-the-art baseline methods in detection and diagnosis performance with data and time-efficient training. Specifically, TranAD increases F1 scores by up to 17%, reducing training times by up to 99% compared to the baselines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
The impact of the MIT-BIH Arrhythmia Database
Moody, G. B., & Mark, R. G. (2001) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/51.932724 · Cited by 4,812
Proceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · cited 18×
“The OmniAnomaly, CAE-M and MSCRED models use sequential observations as input, allowing these methods to retain the temporal information.”
BackgroundMethodInfluentialDetecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · cited 12×
“The LSTM-NDT [20] method relies on an LSTM based deep neural network model that uses the input sequence as training data and, for each input timestamp, forecasts data for the next timestamp.”
MethodInfluentialAutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 1×
“Moreover, the lack of labeled data and anomaly diversity makes the problem challenging as we cannot use supervised learning models, which have shown to be effective in other areas of data mining [12].”
BackgroundMAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S.-K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_56 · Cited by 1,185
A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder
Park, D., Hoshi, Y., & Kemp, C. C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801475 · Cited by 1,115
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094
Unsupervised real-time anomaly detection for streaming data
Ahmad, S., Lavin, A., Purdy, S., & Agha, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.070 · Cited by 995
SWaT: a water treatment testbed for research and training on ICS security
Mathur, A. P., & Tippenhauer, N. O. (2016) · 2016 International Workshop on Cyber-physical Systems for Smart Water Networks (CySWater) · doi:10.1109/cyswater.2016.7469060 · Cited by 878
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
Multivariate Time-Series Anomaly Detection via Graph Attention Network
Zhao, H., Wang, Y., Duan, J., Huang, C., Cao, D., Tong, Y., Xu, B., Bai, J., Tong, J., & Zhang, Q. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00093 · Cited by 743
Proceedings of the VLDB Endowment
Alonso, G., Freire, J., Saçan, A., & Tatbul, N. (2011) · Cited by 653
Anomaly Detection in Streams with Extreme Value Theory
Siffer, A., Fouque, P.-A., Termier, A., & Largouet, C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098144 · Cited by 553
WADI: a water distribution testbed for research in the design of secure cyber physical systems
Ahmed, C. M., Palleti, V. R., & Mathur, A. P. (2017) · Proceedings of the 3rd International Workshop on Cyber-Physical Systems for Smart Water Networks · doi:10.1145/3055366.3055375 · Cited by 550
A comprehensive survey of anomaly detection techniques for high dimensional big data
Thudumu, S., Branch, P., Jin, J., & Singh, J. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00320-x · Cited by 425
Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Zhang, Y., Chen, Y., Wang, J., & Pan, Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102110 · Cited by 312
HitAnomaly: Hierarchical Transformers for Anomaly Detection in System Log
Huang, S., Liu, Y., Fung, C., He, R., Zhao, Y., Yang, H., & Luan, Z. (2020) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2020.3034647 · Cited by 228
Anomalous Example Detection in Deep Learning: A Survey
Bulusu, S., Kailkhura, B., Li, B., Varshney, P. K., & Song, D. (2020) · IEEE Access · doi:10.1109/access.2020.3010274 · Cited by 186
Real-Time Sensor Anomaly Detection and Recovery in Connected Automated Vehicle Sensors
Wang, Y., Masoud, N., & Khojandi, A. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2970295 · Cited by 177
ARIMA Based Network Anomaly Detection
Yaacob, A. H., Tan, I. K. T., Chien, S. F., & Tan, H. K. (2010) · 2010 Second International Conference on Communication Software and Networks · doi:10.1109/iccsn.2010.55 · Cited by 168
Matrix Profile XI: SCRIMP++: Time Series Motif Discovery at Interactive Speeds
Zhu, Y., Yeh, C. M., Zimmerman, Z., Kamgar, K., & Keogh, E. (2018) · Proceedings · doi:10.1109/icdm.2018.00099 · Cited by 160
SAND: streaming subsequence anomaly detection
Boniol, P., Paparrizos, J., Palpanas, T., & Franklin, M. J. M. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3467861.3467863 · Cited by 131
Anomaly Detection in Medical Wireless Sensor Networks using SVM and Linear Regression Models
Salem, O., Guerassimov, A., Mehaoua, A., Marcus, A. M., & Furht, B. (2014) · International Journal of E-Health and Medical Communications · doi:10.4018/ijehmc.2014010102 · Cited by 115
Classification of optimization problems in fog computing
Bellendorf, J., & Mann, Z. Á. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.036 · Cited by 113
openGauss: an autonomous database system
Li, G., Zhou, X., Sun, J., Yu, X., Han, Y., Jin, L., Li, W., Wang, T., & Li, S. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476311.3476380 · Cited by 112
Diverse Image Generation via Self-Conditioned GANs
Liu, S., Wang, T., Bau, D., Zhu, J.-Y., & Torralba, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01429 · Cited by 91
Efficient Anomaly Detection by Isolation Using Nearest Neighbour Ensemble
Bandaragoda, T., Ting, K. M., Albrecht, D. W., Liu, F. T., & Wells, J. R. (2014) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2014.70 · Cited by 84
Real-time distance-based outlier detection in data streams
Tran, L., Mun, M., & Shahabi, C. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3425879.3425885 · Cited by 70
Gharghabi, S., Imani, S., Bagnall, A. J., Darvishzadeh, A., & Keogh, E. (2018) · Proceedings · doi:10.1109/icdm.2018.00119 · Cited by 69
Automated Anomaly Detection in Large Sequences
Boniol, P., Linardi, M., Roncallo, F., & Palpanas, T. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00182 · Cited by 69
Multi-source Distributed System Data for AI-Powered Analytics
Nedelkoski, S., Bogatinovski, J., Mandapati, A. K., Becker, S., Cardoso, J., & Kao, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-44769-4_13 · Cited by 63
GraphAn: graph-based subsequence anomaly detection
Boniol, P., Palpanas, T., Meftah, M., & Rémy, E. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3415478.3415514 · Cited by 46
Matrix Profile XIII: Time Series Snippets: A New Primitive for Time Series Data Mining
Imani, S., Madrid, F., Ding, W., et al. (2018) · IEEE International Conference on Big Knowledge (ICBK) · doi:10.1109/icbk.2018.00058 · Cited by 43
Kanarachos, S. A., Mathew, J., Chroneos, A., & Fitzpatrick, M. E. (2015) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa.2015.7388055 · Cited by 29
Zimmerman, Z., Senobari, N. S., Funning, G. J., Papalexakis, E. E., Oymak, S., Brisk, P., & Keogh, E. (2019) · Proceedings · doi:10.1109/icdm.2019.00104 · Cited by 18
Disk aware discord discovery: finding unusual time series in terabyte sized datasets
YankovDragomir, KeoghEamonn, & RebbapragadaUmaa (2008) · Knowledge and Information Systems · doi:10.5555/1473147.1473152 · Cited by 9
Cited by
Deep Isolation Forest for Anomaly Detection
Xu, H., Pang, G., Wang, Y., & Wang, Y. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3270293 · Cited by 556
ImDiffusion: Imputed Diffusion Models for Multivariate Time Series Anomaly Detection
Chen, Y., Zhang, C., Ma, M., Liu, Y., Ding, R., Li, B., He, S., Rajmohan, S., Lin, Q., & Zhang, D. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3632093.3632101 · Cited by 139
Wang, F., Jiang, Y., Zhang, R., Wei, A., Xie, J., & Pang, X. (2025) · Sensors · doi:10.3390/s25010190 · Cited by 119
Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention
Lee, C., Yang, T., Chen, Z., Su, Y., Yang, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00148 · Cited by 68
Twin Graph-Based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System
Huang, J., Yang, Y., Yu, H., Li, J., & Zheng, X. (2023) · 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00138 · Cited by 50
“Before delving into the details of our model, we first introduce different attention mechanisms used in the following sections.”
Method
Metadata
- Authors
- Tuli, S., Casale, G., & Jennings, N. R.
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2022-02
- Volume
- 15
- Issue
- 6
- Pages
- 1201-1214
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W4283318673
- Cited by
- 1,063
- References
- 42
- FWCI
- 56.39
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.