SVAS: Surveillance Video Analysis System
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
This paper introduces a Surveillance Video Analysis System, called SVAS, for surveillance domain, in which the semantic rules and the definition of event models can be learned or defined by the user for automatic detection and inference of complex video events. In the scope of SVAS, an event model method named Interval-Based Spatio-Temporal Model (IBSTM) is proposed. SVAS can learn action models and event models without any predefined threshold values and generates understandable and manageable IBSTM event models. Hybrid machine learning methods are proposed and used. A set of feature models named Threshold Model, which reflects the spatio-temporal motion analysis of an event, is kept as the first model. As the second model, Bag of Actions (BoA) model is used in order to reduce the search space in the detection phase. Markov Logic Network (MLN) model, which provides understandable and manageable logic predicates for users, is kept as the third model. SVAS has high performance event detection capability due to its interval-based hierarchical manner. It determines related candidate intervals for each main model of IBSTM and uses the related main model when needed rather than using all models as a whole. The main contribution of this study is to fill the semantic gap between humans and video computer systems such that, on the one hand it decreases human intervention through its learning capabilities, but on the other hand it also enables human intervention when necessary through its manageable event model method. The study achieves all of them in the most efficient way through its machine learning methods. The proposed system is applied to different event datasets from CAVIAR, BEHAVE and our synthetic datasets. The experimental results show that our approach improves the event recognition performance and precision as compared to the current state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676
Fine-Grained Activity Recognition by Aggregating Abstract Object Usage
Patterson, D. J., Fox, D., Kautz, H., & Philipose, M. (2005) · Ninth IEEE International Symposium on Wearable Computers (ISWC'05) · doi:10.1109/iswc.2005.22 · Cited by 452
Layered representations for human activity recognition
Oliver, N., Horvitz, E., & Garg, A. (2003) · Proceedings. Fourth IEEE International Conference on Multimodal Interfaces · doi:10.1109/icmi.2002.1166960 · Cited by 312
A survey on behavior analysis in video surveillance for homeland security applications
Ko, T. (2008) · 2008 37th IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr.2008.4906450 · Cited by 209
Research works printed but not linked: 31
- Allen, 1994, Actions and events in interval temporal logic, Journal of Logic and Computation, 4, 531, 10.1093/logcom/4.5.531 · DOI · Paper page
- Artikis, 2015, An event calculus for event recognition, IEEE Transactions on Knowledge and Data Engineering, 27, 895, 10.1109/TKDE.2014.2356476 · DOI
- Ayers, 2001, Monitoring human behavior from video taken in an office environment, Image and Vision Computing, 19, 833, 10.1016/S0262-8856(01)00047-6 · DOI
- Ballan, 2011, Event detection and recognition for semantic annotation of video, Multimedia Tools and Applications, 51, 279, 10.1007/s11042-010-0643-7 · DOI
- Bhargava, 2009, Detection of object abandonment using temporal logic, Machine Vision and Applications, 20, 271, 10.1007/s00138-008-0181-8 · doi:10.1007/s00138-008-0181-8
- Biswas, 2007, Recognizing activities with multiple cues, Vol. 4814, 255
- Blunsden, 2010, The BEHAVE video dataset: Ground truthed video for multi-person behavior classification, Annals of the BMVA, 4, 1
- Chong, 2015, Modeling Representation of videos for anomaly detection using deep learning: A review, 10.1007/978-1-4471-6714-3 · DOI
- Cuntoor, 2005, Interpretation of state sequences in hmm for activity representation, Vol. 2, 709
- Elhamod, 2013, Automated real-time detection of potentially suspicious behavior in public transport areas, IEEE Transactions on Intelligent Transportation Systems, 14, 688, 10.1109/TITS.2012.2228640 · DOI
- Fusier, 2007, Video understanding for complex activity recognition, Machine Vision and Applications, 18, 167, 10.1007/s00138-006-0054-y · DOI
- Hakeem, 2007, Learning, detection and representation of multi-agent events in videos, Artificial Intelligence, 171, 586, 10.1016/j.artint.2007.04.002 · DOI
- Hongeng, 2004, Video-based event recognition: Activity representation and probabilistic recognition methods, Computer Vision and Image Understanding, 96, 129, 10.1016/j.cviu.2004.02.005 · DOI · Paper page
- Jiang, 2011, Anomalous video event detection using spatiotemporal context, Computer Vision and Image Understanding, 115, 323, 10.1016/j.cviu.2010.10.008 · DOI · Paper page
- Kembhavi, A., Yeh, T., & Davis, L. S. (2010). Why did the person cross the road (there)? Scene understanding using probabilistic logic models and common sense reasoning. · DOI
- Lavee, 2009, Understanding video events: A survey of methods for automatic interpretation of semantic occurrences in video, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 39, 489, 10.1109/TSMCC.2009.2023380 · DOI · Paper page
- Martinez-Tomas, 2008, On the correspondence between objects and events for the diagnosis of situations in visual surveillance tasks, Pattern Recognition Letter, 29, 1117, 10.1016/j.patrec.2007.10.020 · DOI
- Oliver, 2005, A comparison of HMMs and dynamic bayesian networks for recognizing office activities, Vol. 3538, 199
- Perez, 2007, Comparison of classifiers for human activity recognition, Vol. 4528, 192
- Reddy, 2009, Vol. 5535, 415
- Robertson, 2008, Automatic human behaviour recognition and explanation for CCTV video surveillance, Security Journal, 21, 173, 10.1057/palgrave.sj.8350053 · doi:10.1057/palgrave.sj.8350053
- SanMiguel, J. C., & Martínez, J. M. (2012). A semantic-based probabilistic approach for real-time video event recognition. · doi:10.1016/j.cviu.2012.04.005
- Simon, 2010, Visual event recognition using decision trees, Multimedia Tools and Applications, 50, 95, 10.1007/s11042-009-0364-y · DOI
- Skarlatidis, 2015, A probabilistic logic programming event calculus, Theory and Practice of Logic Programming, 15, 213, 10.1017/S1471068413000690 · DOI
- Tian, Y., Feris, R., Liu, H., Humpapur, A., & Sun, M. (2010). Robust detection of abandoned and removed objects in complex surveillance videos. · DOI · Paper page
- Town, 2006, Ontological inference for image and video analysis, Machine Vision and Applications, 17, 94, 10.1007/s00138-006-0017-3 · DOI
- Vishwakarma, 2013, A survey on activity recognition and behavior understanding in video surveillance, The Visual Computer, 29, 983, 10.1007/s00371-012-0752-6 · DOI · Paper page
- Yildirim, 2013, Automatic semantic content extraction in videos using a fuzzy ontology and rule-based model, IEEE Transactions on Knowledge and Data Engineering, 25, 47, 10.1109/TKDE.2011.189 · DOI
- Zhang, 2012, Recognizing human group behaviors with multi-group causalities, Vol. 3, 44
- Zhang, 2013, Modeling temporal interactions with interval temporal bayesian networks for complex activity recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2468, 10.1109/TPAMI.2013.33 · DOI
- Zhao, 2004, Tracking multiple humans in complex situations, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 1208, 10.1109/TPAMI.2004.73 · DOI · Paper page
Cited by
Intelligent video surveillance: A review through deep learning techniques for crowd analysis
Sreenu, G., & Saleem Durai, M. A. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0212-5 · Cited by 460
A Systematic Review of Intelligence Video Surveillance: Trends, Techniques, Frameworks, and Datasets
Shidik, G. F., Noersasongko, E., Nugraha, A., Andono, P. N., Jumanto, J., & Kusuma, E. J. (2019) · IEEE Access · doi:10.1109/access.2019.2955387 · Cited by 114
Race Recognition Using Deep Convolutional Neural Networks
Vo, T., Nguyen, T., & Le, C. T. (2018) · Symmetry · doi:10.3390/sym10110564 · Cited by 59
Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification
AlBdairi, A. J. A., Xiao, Z., Alkhayyat, A., Humaidi, A. J., Fadhel, M. A., Taher, B. H., Alzubaidi, L., Santamaría, J., & Al-Shamma, O. (2022) · Applied Sciences · doi:10.3390/app12052605 · Cited by 54
Metadata
- Authors
- Kardas, K., & Cicekli, N. K.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2017-12
- Volume
- 89
- Pages
- 343-361
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2741711032
- Cited by
- 40
- References
- 4
- FWCI
- 1.24
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Funders
- Ministry of Science, Industry and Technology of Turkey
- Havelsan Inc (SANTEZ 00896.STZ.2011-1)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: SVAS: Surveillance Video Analysis System. https://app.cochat.ai/papers/10.1016/j.eswa.2017.07.051
- The paper
- Kardas, K., & Cicekli, N. K. (2017). SVAS: Surveillance Video Analysis System. Expert Systems with Applications. https://doi.org/10.1016/j.eswa.2017.07.051
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.