Vehicular Trajectory Classification and Traffic Anomaly Detection in Videos Using a Hybrid CNN-VAE Architecture
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Visual surveillance has become indispensable in the evolution of Intelligent Transportation Systems (ITS). Video object trajectories are key to many of the visual surveillance applications. Classifying varying length time series data such as video object trajectories using conventional neural networks, can be challenging. In this paper, we propose trajectory classification and anomaly detection using a hybrid Convolutional Neural Network (CNN) and Variational Autoencoder (VAE) architecture. First, we introduce a high level features for varying length object trajectories using color gradient representation. In the next stage, a semi-supervised way to annotate moving object trajectories extracted using Temporally Incremental Gravitational Model (TIGM) is used for class labeling. For training, anomalous trajectories are identified using t-Distributed Stochastic Neighbor Embedding (t-SNE). Finally, a hybrid CNN-VAE architecture has been proposed for trajectory classification and anomaly detection. The results obtained using publicly available surveillance video datasets reveal that the proposed method can successfully identify traffic anomalies such as violations in lane driving, sudden speed variations, abrupt termination of vehicle during movement, and vehicles moving in wrong directions. The accuracy of trajectory classification improves by a margin of 1-6% against popular neural networks-based classifiers across various datasets using the proposed high-level features. The gradient representation also improves the anomaly detection accuracy significantly (30-35%). Code and dataset can be found athttps://github.com/santhoshkelathodi/CNN-VAE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Argoverse: 3D Tracking and Forecasting With Rich Maps
Chang, M.-F., Lambert, J., Sangkloy, P., Singh, J., Bak, S., Hartnett, A., Wang, D., Carr, P., Lucey, S., Ramanan, D., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00895 · Cited by 1,474
Recent advances in deep learning for speech research at Microsoft
Deng, L., Li, J., Huang, J.-T., Yao, K., Yu, D., Seide, F., Seltzer, M., Zweig, G., He, X., Williams, J., et al. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639345 · Cited by 801
Stable multi-target tracking in real-time surveillance video
Benfold, B., & Reid, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995667 · Cited by 651
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Feature Learning for Activity Recognition in Ubiquitous Computing
Plötz, T., Hammerla, N., & Olivier, P. (2011) · Newcastle University · doi:10.25405/ncl.34175319 · Cited by 337
Research works printed but not linked: 38
- 10.1109/TITS.2014.2340701 · DOI
- 10.1109/TITS.2018.2835308 · DOI · Paper page
- Yang, Deep convolutional neural networks on multichannel time series for human activity recognition, 3995
- 10.1109/ITSC.2016.7795922 · DOI
- 10.1145/3417989 · DOI · Paper page
- Loy, From local temporal correlation to global anomaly detection
- 10.1145/882082.882086 · DOI · Paper page
- 10.1145/1390156.1390290 · DOI · Paper page
- Krizhevsky, ImageNet classification with deep convolutional neural networks, 1
- 10.1007/978-3-319-10590-1_53 · DOI · Paper page
- 10.1109/ITSC.2017.8317618 · DOI · Paper page
- 10.1109/CVPR.2015.7299101 · DOI · Paper page
- 10.1109/CVPR.2015.7298878 · DOI · Paper page
- 10.1145/2733373.2806222 · DOI · Paper page
- 10.1109/TMM.2017.2666540 · DOI · Paper page
- 10.1007/s41060-016-0014-1 · DOI
- 10.1109/CVPR.2011.5995407 · DOI · Paper page
- 10.1109/CVPR.2015.7299178 · DOI · Paper page
- 10.1109/TPAMI.2017.2691769 · DOI · Paper page
- 10.1609/aaai.v33i01.33019428 · DOI · Paper page
- 10.1145/3097983.3098052 · DOI · Paper page
- 10.1109/ICC.2018.8422402 · DOI · Paper page
- Zimmerer, 2018, Context-encoding variational autoencoder for unsupervised anomaly detection, arXiv:1812.05941 · arXiv
- 10.1109/ICMLA.2018.00207 · DOI
- 10.1109/TCYB.2018.2838668 · DOI · Paper page
- 10.1109/ACPR.2015.7486592 · DOI
- 10.1109/TITS.2018.2834958 · DOI
- 10.1109/TCYB.2019.2931139 · DOI
- 10.1109/CISP-BMEI.2016.7852681 · DOI
- 10.1007/s10479-011-0841-3 · DOI · Paper page
- Goodfellow, 2016, Deep Learning, 1
- Kingma, Adam: A method for stochastic optimization, 600
- Kingma, Auto-encoding variational Bayes, 2672
- 10.1109/ICCV.2015.492 · DOI
- 10.1109/CVPR.2011.5995733 · DOI · Paper page
- 10.1109/ICCV.2013.338 · DOI · Paper page
- 10.1007/978-3-319-59081-3_23 · DOI · Paper page
- 10.1109/CVPR.2013.392 · DOI
Cited by
Wang, X., Liu, W., Lin, H., Hu, J., Kaur, K., & Hossain, M. S. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3209903 · Cited by 63
Vision transformer embedded video anomaly detection using attention driven recurrence
Muna, U. M., Biswas, S., Zarif, S. A. A. M., Deori, P. J., Tajwar, T., & Shatabda, S. (2025) · Array · doi:10.1016/j.array.2025.100471 · Cited by 15
Huang, L., & Lu, H. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1799 · Cited by 10
Metadata
- Authors
- Kumaran Santhosh, K., Dogra, D. P., Roy, P. P., & Mitra, A.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2022-08
- Volume
- 23
- Issue
- 8
- Pages
- 11891-11902
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W3199436088
- Cited by
- 80
- References
- 9
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Vehicular Trajectory Classification and Traffic Anomaly Detection in Videos Using a Hybrid CNN-VAE Architecture. https://app.cochat.ai/papers/10.1109/tits.2021.3108504
- The paper
- Kumaran Santhosh, K., Dogra, D. P., Roy, P. P., & Mitra, A. (2022). Vehicular Trajectory Classification and Traffic Anomaly Detection in Videos Using a Hybrid CNN-VAE Architecture. IEEE Transactions on Intelligent Transportation Systems. https://doi.org/10.1109/tits.2021.3108504
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.