The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Video Behavior Profiling for Anomaly Detection
Abstract
This paper aims to address the problem of modelling video behaviour captured in surveillancevideos for the applications of online normal behaviour recognition and anomaly detection. A novelframework is developed for automatic behaviour profiling and online anomaly sampling/detectionwithout any manual labelling of the training dataset. The framework consists of the followingkey components: (1) A compact and effective behaviour representation method is developed basedon discrete scene event detection. The similarity between behaviour patterns are measured basedon modelling each pattern using a Dynamic Bayesian Network (DBN). (2) Natural grouping ofbehaviour patterns is discovered through a novel spectral clustering algorithm with unsupervisedmodel selection and feature selection on the eigenvectors of a normalised affinity matrix. (3) Acomposite generative behaviour model is constructed which is capable of generalising from asmall training set to accommodate variations in unseen normal behaviour patterns. (4) A run-timeaccumulative anomaly measure is introduced to detect abnormal behaviour while normal behaviourpatterns are recognised when sufficient visual evidence has become available based on an onlineLikelihood Ratio Test (LRT) method. This ensures robust and reliable anomaly detection and normalbehaviour recognition at the shortest possible time. The effectiveness and robustness of our approachis demonstrated through experiments using noisy and sparse datasets collected from both indoorand outdoor surveillance scenarios. In particular, it is shown that a behaviour model trained usingan unlabelled dataset is superior to those trained using the same but labelled dataset in detectinganomaly from an unseen video. The experiments also suggest that our online LRT based behaviourrecognition approach is advantageous over the commonly used Maximum Likelihood (ML) methodin differentiating ambiguities among different behaviour classes observed online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
On Spectral Clustering: Analysis and an algorithm
Ng, A. Y., Jordan, M. I., & Weiss, Y. (2001) · Cited by 8,159
Learning patterns of activity using real-time tracking
Stauffer, C., & Grimson, W. E. L. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868677 · Cited by 3,248
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
Self-Tuning Spectral Clustering
Zelnik‐Manor, L., & Perona, P. (2004) · CaltechAUTHORS (California Institute of Technology) · Cited by 1,942
A Bayesian computer vision system for modeling human interactions
Oliver, N. M., Rosario, B., & Pentland, A. P. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868684 · Cited by 1,578
Multiclass spectral clustering
Yu, & Shi (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238361 · Cited by 947
Segmentation using eigenvectors: a unifying view
Weiss, Y. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790354 · Cited by 729
Simultaneous feature selection and clustering using mixture models
Law, M. H. C., Figueiredo, M. A. T., & Jain, A. K. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.71 · Cited by 664
Learning dynamic Bayesian networks
Ghahramani, Z. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0053999 · Cited by 543
Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model
Duong, T. V., Bui, H. H., Phung, D. Q., & Venkatesh, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.61 · Cited by 535 · cited 1×
“Much work on abnormal behavior detection 1 took a supervised learning approach [16], [14], [8], [5], [3] based on the assumption that there exist well-defined and known a priori behavior classes (both normal and abnormal).”
BackgroundDetecting unusual activity in video
Zhong, H., Shi, J., & Visontai, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315249 · Cited by 495
Detecting Irregularities in Images and in Video
Boiman, O., & Irani, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0009-9 · Cited by 439
Automatic recognition of keywords in unconstrained speech using hidden Markov models
Wilpon, J. G., Rabiner, L. R., Lee, C.-H., & Goldman, E. R. (1990) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.103088 · Cited by 394
Zelnik-Manor, L., & Irani, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990935 · Cited by 391
Bayesian approaches to Gaussian mixture modeling
Roberts, S. J., Husmeier, D., Rezek, I., & Penny, W. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730550 · Cited by 317
Semi-Supervised Adapted HMMs for Unusual Event Detection
Zhang, D., Gatica-Perez, D., Bengio, S., & McCowan, I. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.316 · Cited by 277
Recognition of group activities using dynamic probabilistic networks
Gong, S., & Xiang, T. (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238423 · Cited by 261
Self-citationUnsupervised feature selection applied to content-based retrieval of lung images
Dy, J. G., Brodley, C. E., Kak, A., Broderick, L. S., & Aisen, A. M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1182100 · Cited by 255
Detecting irregularities in images and in video
Boiman, O., & Irani, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.70 · Cited by 237
Speaker verification using randomized phrase prompting
Higgins, A., Bahler, L., & Porter, J. (1991) · Digital Signal Processing · doi:10.1016/1051-2004(91)90098-6 · Cited by 190
Detection and Explanation of Anomalous Activities: Representing Activities as Bags of Event n-Grams
Hamid, R., Johnson, A., Batta, S., Bobick, A., Isbell, C. L., & Coleman, G. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.127 · Cited by 130
A Hidden Markov Model-Based Approach to Sequential Data Clustering
Panuccio, A., Bicego, M., & Murino, V. (2002) · Lecture notes in computer science · doi:10.1007/3-540-70659-3_77 · Cited by 127
Zelnik‐Manor, L., & Irani, M. (2001) · Cited by 88
Trajectory Distance Metric Using Hidden Markov Model Based Representation
Porikli, F. (2004) · Cited by 79
Statistical Models of Object Interaction
Morris, R. J., & Hogg, D. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008159822101 · Cited by 47
Activity Based Video Content Trajectory Representation and Segmentation
Xiang, T., & Gong, S. (2004) · British Machine Vision Conference (BMVC) · doi:10.5244/c.18.20 · Cited by 19
Self-citation
Cited by
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017
Video-Based Abnormal Human Behavior Recognition—A Review
Popoola, O. P., & Wang, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2178594 · Cited by 505
A survey on activity recognition and behavior understanding in video surveillance
Vishwakarma, S., & Agrawal, A. (2013) · The Visual Computer · doi:10.1007/s00371-012-0752-6 · Cited by 418
Morris, B. T., & Trivedi, M. M. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.64 · Cited by 349
Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms
Candamo, J., Shreve, M., Goldgof, D. B., Sapper, D. B., & Kasturi, R. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2030963 · Cited by 298
Metadata
- Authors
- Xiang, T., & Gong, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2008-05
- Volume
- 30
- Issue
- 5
- Pages
- 893-908
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2112680570
- Cited by
- 283
- References
- 30
- FWCI
- 45.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.