The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index, and 1 are not checked yet.
Spatiotemporal Anomaly Detection Using Deep Learning for Real-Time Video Surveillance
Abstract
Rapid developments in urbanization and autonomous industrial environments have augmented and expedited the need for intelligent real-time video surveillance. Recent developments in artificial intelligence for anomaly detection in video surveillance only address some of the challenges, largely overlooking the evolving nature of anomalous behaviors over time. Tightly coupled dependence on a known normality training dataset and sparse evaluation based on reconstruction error are further limitations. In this article, we propose the incremental spatiotemporal learner (ISTL) to address challenges and limitations of anomaly detection and localization for real-time video surveillance. ISTL is an unsupervised deep-learning approach that utilizes active learning with fuzzy aggregation, to continuously update and distinguish between new anomalies and normality that evolve over time. ISTL is demonstrated and evaluated on accuracy, robustness, computational overhead as well as contextual indicators, using three benchmark datasets. Results of these experiments validate our contribution and confirm its suitability for real-time video surveillance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“On the other hand, when considering the UCSD Ped1 dataset, the Conv-AE approach achieved the highest accuracy of 81%.”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [126]
In the citing paper
“By using unsupervised deep learning techniques, the ISTL system can learn and adapt to new instances without relying on pre-labeled training data.”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [126]
In the citing paper
“This ability to dynamically incorporate new objects enables the system to process a wider range of objects and adapt to evolving environments.”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [126]
In the citing paper
“ISTL is capable of detecting anomalies in real-time video surveillance with an accuracy of 91.1%”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [126]
In the citing paper
“For instance, on the UCSD Ped2 dataset, the ISTL method exhibited the highest accuracy at 91.8%.”
From A Survey of Video Surveillance Systems in Smart City (2023) · cites this paper as [126]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
Abnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
(2011) · Cited by 1,258
Kim, J., & Grauman, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206569 · Cited by 768
Matsugu, M., Mori, K., Mitari, Y., & Kaneda, Y. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00115-1 · Cited by 715
Abnormal Event Detection in Videos Using Spatiotemporal Autoencoder
Chong, Y. S., & Tay, Y. H. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59081-3_23 · Cited by 596
Remembering history with convolutional LSTM for anomaly detection
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019325 · Cited by 582
Kiran, B. R., Thomas, D. M., & Parakkal, R. (2018) · Journal of Imaging · doi:10.3390/jimaging4020036 · Cited by 554
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes
Wu, S., Moore, B. E., & Shah, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539882 · Cited by 525
Detecting anomalous events in videos by learning deep representations of appearance and motion
Xu, D., Yan, Y., Ricci, E., & Sebe, N. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.10.010 · Cited by 474
Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes
Sabokrou, M., Fayyaz, M., Fathy, M., Moayed, Z., & Klette, R. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.006 · Cited by 470
Unmasking the Abnormal Events in Video
Ionescu, R. T., Smeureanu, S., Alexe, B., & Popescu, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.315 · Cited by 335
Secure Surveillance Framework for IoT Systems Using Probabilistic Image Encryption
Muhammad, K., Hamza, R., Ahmad, J., Lloret, J., Wang, H., & Baik, S. W. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2791944 · Cited by 299
Intelligent Video Systems and Analytics: A Survey
Liu, H., Chen, S., & Kubota, N. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2013.2255616 · Cited by 210
Sargano, A., Angelov, P., & Habib, Z. (2017) · Applied Sciences · doi:10.3390/app7010110 · Cited by 181
Video Anomaly Detection With Compact Feature Sets for Online Performance
Leyva, R., Sanchez, V., & Li, C.-T. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2695105 · Cited by 166
Image processing techniques for object tracking in video surveillance- A survey
Ojha, S., & Sakhare, S. (2015) · 2015 International Conference on Pervasive Computing (ICPC) · doi:10.1109/pervasive.2015.7087180 · Cited by 161
Automated human behavior analysis from surveillance videos: a survey
Gowsikhaa, D., Abirami, S., & Baskaran, R. (2012) · Artificial Intelligence Review · doi:10.1007/s10462-012-9341-3 · Cited by 126
Zaharescu, A., & Wildes, R. P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_41 · Cited by 97
Chacon-Murguia, M. I., & Gonzalez-Duarte, S. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2011.2106093 · Cited by 90
An Effective Video Summarization Framework Toward Handheld Devices
Zhang, L., Xia, Y., Mao, K., Ma, H., & Shan, Z. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2336639 · Cited by 79
Self-evolving intelligent algorithms for facilitating data interoperability in IoT environments
Nawaratne, R., Alahakoon, D., Silva, D. D., Chhetri, P., & Chilamkurti, N. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.02.049 · Cited by 62
Self-citationAdaptive real-time anomaly detection with incremental clustering
Burbeck, K. R., & Nadjm‐Tehrani, S. (2007) · Information Security Technical Report · doi:10.1016/j.istr.2007.02.004 · Cited by 60
Wahyono, W., Filonenko, A., & Jo, K.-H. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2605582 · Cited by 59
Incremental knowledge acquisition and self learning from text
Silva, D. D., & Alahakoon, D. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596612 · Cited by 37
Self-citationA System for Multicamera Task Recognition and Summarization for Structured Environments
Kosmopoulos, D., Voulodimos, A. S., & Doulamis, A. D. (2012) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2012.2212712 · Cited by 33
Incremental knowledge acquisition and self-learning for autonomous video surveillance
Nawaratne, R., Bandaragoda, T., Adikari, A., Alahakoon, D., Silva, D. D., & Yu, X. (2017) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2017.8216826 · Cited by 33
Self-citationSilva, D. D., Yu, X., Alahakoon, D., & Holmes, G. (2011) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2011.5984262 · Cited by 28
Self-citationVision based surveillance system for detection of human fall
Basavaraj, G. M., & Kusagur, A. (2017) · IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology · doi:10.1109/rteict.2017.8256851 · Cited by 20
Motion instability based unsupervised online abnormal behaviors detection
Xie, S., & Guan, Y. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2664-8 · Cited by 15
Deep Abnormality Detection in Video Data
Vu, H. T. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/768 · Cited by 14
Multiple View Oriented Matching Algorithm for People Reidentification
García, J., Gardel, A., Bravo, I., & Galilea, J. L. L. (2014) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2014.2330976 · Cited by 13
Cited by
DETRs Beat YOLOs on Real-time Object Detection
Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., & Chen, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01605 · Cited by 5,020
“Real-time object detection is an important area of research and has a wide range of applications, such as object tracking [40], video surveillance [26], and autonomous driving [2], etc. Existing real-time detectors generally adopt the CNN-based architecture, the most famous of which is the YOLO…”
MethodA comprehensive review on deep learning-based methods for video anomaly detection
Nayak, R., Pati, U. C., & Das, S. K. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104078 · Cited by 324
Network Anomaly Detection Using LSTM Based Autoencoder
Said Elsayed, M., Le-Khac, N.-A., Dev, S., & Jurcut, A. D. (2020) · Proceedings of the 16th ACM Symposium on QoS and Security for Wireless and Mobile Networks · doi:10.1145/3416013.3426457 · Cited by 285
Yun, W. J., Park, S., Kim, J., Shin, M., Jung, S., Mohaisen, D. A., & Kim, J.-H. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3143175 · Cited by 252
A Review of Machine Learning and Deep Learning Techniques for Anomaly Detection in IoT Data
Al-amri, R., Murugesan, R. K., Man, M., Abdulateef, A. F., Al-Sharafi, M. A., & Alkahtani, A. A. (2021) · Applied Sciences · doi:10.3390/app11125320 · Cited by 205
Metadata
- Authors
- Nawaratne, R., Alahakoon, D., De Silva, D., & Yu, X.
- Affiliations
- La Trobe University (AU)
- RMIT University (AU)
- Venue
- IEEE Transactions on Industrial Informatics
- Published
- 2020-01
- Volume
- 16
- Issue
- 1
- Pages
- 393-402
- ISSN
- 1551-3203 (ISSN-L)
- 1941-0050
- OpenAlex
- W2970724283
- Cited by
- 318
- References
- 42
- Citations by year
- 2026: 18 · 2025: 42 · 2024: 66 · 2023: 76 · 2022: 59 · 2021: 35 · 2020: 20
- FWCI
- 13.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Industrial Informatics (publishedVersion)
- RMIT Research Repository (RMIT University Library) (submittedVersion)
- Figshare (submittedVersion)
- Funders
- La Trobe University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- spatio-temporal anomaly detection, real-time video surveillance, unsupervised anomaly detection, active learning (machine learning), fuzzy aggregation, anomaly localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.