The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video
Abstract
Understanding video events, i.e., the translation of low-level content in video sequences into high-level semantic concepts, is a research topic that has received much interest in recent years. Important applications of this paper include smart surveillance systems, semantic video database indexing, and interactive systems. This technology can be applied to several video domains including airport terminal, parking lot, traffic, subway stations, aerial surveillance, and sign language data. In this paper, we identify the two main components of the event understanding process: abstraction and event modeling. Abstraction is the process of molding the data into informative units to be used as input to the event model. Due to space restrictions, we will limit the discussion on the topic of abstraction. See the study byLaveeetal.(Understanding video events: A survey of methods for automatic interpretation of semantic occurrences in video, Technion-Israel Inst. Technol., Haifa, Israel, Tech. Rep. CIS-2009-06, 2009) for a more complete discussion. Event modeling is devoted to describing events of interest formally and enabling recognition of these events as they occur in the video sequence. Event modeling can be further decomposed in the categories of pattern-recognition methods, state event models, and semantic event models. In this survey, we discuss this proposed taxonomy of the literature, offer a unifying terminology, and discuss popular event modeling formalisms (e.g., hidden Markov model) and their use in video event understanding using extensive examples from the literature. Finally, we consider the application domain of video event understanding in light of the proposed taxonomy, and propose future directions for research in this field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Chomsky, N. (1957) · doi:10.1515/9783112316009 · Cited by 7,885
Introduction to Statistical Relational Learning
(2007) · doi:10.7551/mitpress/7432.001.0001 · Cited by 1,643
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273
The hierarchical hidden Markov model: Analysis and applications
Fine, S., Singer, Y., & Tishby, N. (1998) · Machine Learning · doi:10.1023/a:1007469218079 · Cited by 906
Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model
Duong, T. V., Bui, H. H., Phung, D. Q., & Venkatesh, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.61 · Cited by 535 · cited 3×
“Similarly, other works, emphasizing event modeling, choose straightforward abstraction schemes [17], [24], [52], [86].”
BackgroundMethodLayered representations for human activity recognition
Oliver, N., Horvitz, E., & Garg, A. (2003) · Proceedings. Fourth IEEE International Conference on Multimodal Interfaces · doi:10.1109/icmi.2002.1166960 · Cited by 312
Coupled Hidden Semi Markov Models for Activity Recognition
Natarajan, P., & Nevatia, R. (2007) · 2007 IEEE Workshop on Motion and Video Computing (WMVC'07) · doi:10.1109/wmvc.2007.12 · Cited by 144
Research works printed but not linked: 143
- 10.1109/ICCV.2007.4409049 · DOI
- 10.1007/978-3-540-70994-7_40 · DOI
- 10.1145/1178677.1178704 · doi:10.1145/1178677.1178704
- 10.1109/ICIAP.1999.797565 · DOI
- 10.1109/CVPR.2005.328 · DOI · Paper page
- gong, 2001, learning pixel-wise signal energy for understanding semantics, Proc Br Mach Vis Conf, 1183
- 10.1109/ICCV.2007.4409105 · DOI · Paper page
- 10.1109/AVSS.2005.1577240 · doi:10.1109/avss.2005.1577240
- 10.1109/CVPR.2007.383226 · DOI
- 10.1109/ROBOT.2004.1307403 · DOI
- siskind, 2000, visual event classification via force dynamics, Proc 17th Nat Conf Artif Intell and 12th Ann Conf Innov Appl Artif Intell, 149
- 10.1109/ICPR.2004.1334462 · DOI · Paper page
- 10.1007/3-540-45004-1_14 · DOI
- 10.1109/34.910878 · DOI · Paper page
- 10.1109/CVPR.2004.430 · DOI
- 10.1109/TPAMI.2006.194 · DOI
- 10.1109/WIAMIS.2007.79 · doi:10.1109/wiamis.2007.79
- tran, 2008, event modeling and recognition using markov logic networks, Proc Eur Conf Comput Vis, 610
- 10.1109/CVPR.2007.383299 · DOI · Paper page
- 10.1109/ICCV.2005.28 · DOI · Paper page
- 10.1109/CVPR.2007.383298 · DOI · Paper page
- 10.1109/34.868684 · DOI · Paper page
- 10.1109/AFGR.2000.840667 · DOI · Paper page
- park, 2003, video retrieval of human interactions using model-based motion tracking and multi-layer finite state automata, Proc Int Conf Image and Video Retrieval, 394, 10.1007/3-540-45113-7_39 · doi:10.1007/3-540-45113-7_39
- 10.1109/CVPR.2004.413 · doi:10.1109/cvpr.2004.413
- ribeiro, 0, human activities recognition from video: modeling, feature selection and classification architecture, Proc Int Workshop Human Activity Recognition and Modeling, 61
- gong, 2003, scene event recognition without tracking, Acta Autom Sinica, 29, 321
- toshev, 2006, Proc 4th IEEE Int Conf Comput Vis Syst (ICVS), 10
- shanahan, 1990, representing continuous change in the event calculus, Proc Eur Conf Artif Intell, 598
- shet, 2006, multivalued default logic for identity maintenance in visual surveillance, Proc Eur Conf Comput Vis, 119
- 10.1109/AVSS.2005.1577271 · doi:10.1109/avss.2005.1577271
- terzic, 2007, division of work during behaviour recognitionthe scenic approach, Proc Workshop Behav Monitoring Interpretation, 144
- 10.1016/j.imavis.2007.08.013 · DOI · Paper page
- 10.1109/ICMLA.2007.53 · doi:10.1109/icmla.2007.53
- 10.1016/S0743-1066(99)00077-1 · doi:10.1016/s0743-1066(99)00077-1
- 10.1016/S0262-8856(98)00099-7 · DOI
- lv, 2006, left-luggage detection using bayesian inference, Proc IEEE Int Workshop Perform Eval Tracking Surveillance, 83
- 10.1109/MILCOM.2005.1605920 · DOI
- 10.1016/0004-3702(95)00041-0 · DOI
- 10.1007/978-94-011-5014-9 · DOI · Paper page
- pearl, 1988, Probabilistic Reasoning in Intelligent Systems Networks of Plausible Inference
- 10.1007/978-0-387-68282-2 · DOI · Paper page
- mahajan, 2004, a framework for activity recognition and detection of unusual activities, Proc Indian Conf Comput Vis Graph Image Process, 1
- 10.1109/ICCV.2005.234 · DOI
- 10.1007/s00530-004-0148-1 · DOI · Paper page
- 10.3758/BF03192795 · DOI
- 10.1016/j.patcog.2004.11.024 · doi:10.1016/j.patcog.2004.11.024
- 10.1016/S0262-8856(03)00068-4 · DOI
- 10.1006/cviu.1998.0744 · DOI · Paper page
- 10.1109/CVPR.2007.383131 · DOI · Paper page
- jo, 1998, Proc 3rd IEEE Int Conf Autom Face Gesture Recog (FG), 468
- bremond, 0, analysis of human activities described by image sequences, Proc Int Florida Artif Intell Res Symp (FLAIRS 1997)
- 10.1109/34.946990 · DOI · Paper page
- canotilho, 2007, detecting luggage related behaviors using a new temporal boost algorithm, Proc IEEE Int Workshop Perform Eval Tracking Surveillance, 1
- 10.1007/978-3-540-76858-6_46 · doi:10.1007/978-3-540-76858-6_46
- gill, 1962, Introduction to the Theory of Finite State Machines
- vassilakis, 2002, Revised Papers From the International Gesture Workshop on Gesture and Sign Languages in HumanComputer Interaction (GW), 317
- kartson, 1994, Modelling with Generalized Stochastic Petri Nets
- petri, 1962, Kommunikation mut automaten
- 10.1109/WMVC.2007.34 · doi:10.1109/wmvc.2007.34
- filho, 2006, learning parallel grammar systems for a human activity language, Comput Sci Dept Univ Maryland
- ogale, 2004, view-invariant identification of pose sequences for action recognition, Video Anal Content Extraction Workshop (VACE)
- 10.1109/ACV.1994.341308 · DOI
- 10.1007/b97265 · DOI · Paper page
- 10.1109/ISCV.1995.477012 · DOI · Paper page
- 10.1109/5.24143 · DOI · Paper page
- brand, 1997, IEEE Comput Society Conf Comput Vis Pattern Recog, 994, 10.1109/CVPR.1997.609450 · DOI · Paper page
- 10.1007/978-3-540-76858-6_44 · doi:10.1007/978-3-540-76858-6_44
- brand, 1997, the inverse hollywood problem: from video to scripts and storyboards via causal analysis, Proc Nat Conf Artif Intell and Conf Innovative Appl Artif Intell, 132
- 10.1109/34.868685 · DOI · Paper page
- 10.1006/cviu.2000.0895 · DOI · Paper page
- 10.1109/TMM.2008.2001369 · doi:10.1109/tmm.2008.2001369
- 10.1109/3468.784178 · doi:10.1109/3468.784178
- ghanem, 2007, Petri net models for event recognition in surveillance videos
- 10.1109/34.868684 · DOI · Paper page
- castel, 1996, what is going on? a high level interpretation of sequences of images, Eur Conf Comput Vis
- 10.1109/ICCV.2003.1238423 · DOI · Paper page
- dousson, 1993, situation recognition: representation and algorithms, Proc Int Joint Conf Artif Intell, 166
- ghanem, 2004, mining tools for surveillance video, Proc SPIE 16th Int Symp Electron Imag, 5307, 259
- pinhanez, 1998, Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit (CVPR), 898
- ghallab, 1996, on chronicles: representation, on-line recognition and learning, Proc Int l Conf Principles of Knowledge Representation and Reasoning, 597
- intille, 1999, a framework for recognizing multi-agent action from visual evidence, Proc 16th Nat Conf Artif Intell 11th Innovative Appl Artif Intell Conf Innovative Appl Artif Intell, 518
- 10.1109/ISBI.2012.6235614 · doi:10.1109/isbi.2012.6235614
- 10.5244/C.20.127 · DOI · Paper page
- 10.1016/j.cviu.2004.02.005 · DOI · Paper page
- 10.1109/CVPR.2007.383332 · DOI · Paper page
- 10.1109/CVPR.2007.383072 · DOI · Paper page
- 10.1007/s00138-006-0054-y · DOI
- 10.1145/312624.312649 · DOI · Paper page
- zouba, 0, monitoring activities of daily living (adls) of elderly based on 3d key human postures, 4th Int Cognit Vis Workshop (ICVW 2008)
- 10.1109/VSPETS.2005.1570899 · DOI · Paper page
- vu, 2004, Temporal scenarios for automatic video interpretation
- chelq, 0, real-time image sequence interpretation for video-surveillance applications, Proc 1996 Int Conf Image Process (ICIP)
- ghahramani, 1995, Proc Conf Advances in Neural Information Processing Systems NIPS, 8, 472
- rota, 0, activity recognition from video sequences using declarative models, 14th Eur Conf Artif Intell (ECAI 2000)
- gong, 1992, Proc 10th Eur Conf Artificial Intell, 781
- 10.1109/VS.2000.856858 · doi:10.1109/vs.2000.856858
- 10.1109/AFGR.1996.557249 · doi:10.1109/afgr.1996.557249
- shi, 2006, Proc 2006 IEEE Comput Soc Conf Comput Vis Pattern Recognit (CVPR), 1631
- 10.1145/362007.362035 · DOI
- 10.1109/WMVC.2007.5 · DOI
- oliver, 2005, a comparison of hmms and dynamic bayesian networks for recognizing office activities, Proc User Model, 199
- chanda, 2004, grammatical methods in computer vision: an overview, Georgia Inst Technology
- 10.1109/CVPRW.2003.10037 · DOI
- jelinek, 1998, Statistical Methods for Speech Recognition
- shi, 2004, propagation networks for recognition of partially ordered sequential action, Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit, 2, 862
- aho, 1972, The Theory of Parsing Translation and Compiling
- 10.1109/CVPR.2007.383074 · DOI
- vu, 2003, automatic video interpretation: a recognition algorithm for temporal scenarios based on pre-compiled scenario models, Proc Int Conf Comput Vis Syst, 523, 10.1007/3-540-36592-3_50 · doi:10.1007/3-540-36592-3_50
- ning, 2008, latent pose estimator for continuous action recognition, Proc Eur Conf Comput Vis, 419
- stolcke, 1995, an efficient probabilistic context-free parsing algorithm that computes prefix probabilities, Comput Linguistics, 21, 165
- 10.1109/34.868686 · DOI · Paper page
- ryoo, 2006, IEEE Comput Society Conf Comput Vis Pattern Recog, 1709
- 10.1109/ICCV.2005.59 · DOI · Paper page
- 10.1109/CVPRW.2006.190 · doi:10.1109/cvprw.2006.190
- lafferty, 2001, Proc 18th Int Conf Mach Learn, 282
- buxton, 2002, generative models for learning and understanding dynamic scene activity, Proc ECCV Workshop on Generative Model Based Vision
- 10.1109/TCSVT.2008.2005594 · DOI · Paper page
- 10.1109/TSMCC.2004.829274 · DOI · Paper page
- 10.1016/0262-8856(88)90001-7 · DOI · Paper page
- 10.1098/rstb.1997.0108 · DOI · Paper page
- bremond, 2007, Scene understanding Perception multi-sensor fusion spatio-temporal reasoning and activity recognition
- ogale, 2005, view-invariant modeling and recognition of human actions using grammars, Proc IEEE Workshop Dynam Vis, 115
- 10.1007/3-540-45004-1_14 · DOI
- 10.1109/ICCV.2003.1238661 · DOI
- zhang, 2008, multi-thread parsing for recognizing complex events in videos, Proc Eur Conf Comput Vis, 738
- 10.1109/ICCV.2001.937608 · doi:10.1109/iccv.2001.937608
- galata, 2002, modeling interaction using learnt qualitative spatio-temporal relations and variable length markov models, Conf Artif Intell Lyon
- 10.1016/S0262-8856(99)00025-6 · DOI
- nguyen, 2005, IEEE Comput Society Conf Comput Vis Pattern Recog, 955
- 10.1007/BF01692511 · DOI · Paper page
- 10.1007/s11263-006-4329-6 · DOI · Paper page
- 10.1109/FGR.2006.28 · DOI
- moore, 2001, recognizing multitasked activities using stochastic context-free grammar, Proc CVPR Workshop Models vs Exemplars Comput Vis, 770
- 10.1145/1127777.1127817 · doi:10.1145/1127777.1127817
- 10.1006/cviu.2000.0894 · DOI · Paper page
- 10.1109/CVPR.2003.1211525 · DOI · Paper page
- joo, 2006, Proc 2006 Conf Comput Vision Pattern Recognit Workshop (CVPRW 2006), 107
- moenne-loccoz, 2003, recurrent bayesian network for the recognition of human behaviors from video, Proc Int Conf Comput Vis Syst, 68, 10.1007/3-540-36592-3_7 · DOI
- 10.1007/11612032_16 · doi:10.1007/11612032_16
- 10.1007/978-3-540-27868-9_41 · doi:10.1007/978-3-540-27868-9_41
- 10.1007/11867661_18 · doi:10.1007/11867661_18
- natarajan, 2007, Proc Int Joint Conf Artif Intell, 2562
Cited by
A Survey on Visual Content-Based Video Indexing and Retrieval
Hu, W., Xie, N., Li, L., Zeng, X., & Maybank, S. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2109710 · Cited by 585
Video-Based Abnormal Human Behavior Recognition—A Review
Popoola, O. P., & Wang, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2178594 · Cited by 505
A Review of Anomaly Detection in Automated Surveillance
Sodemann, A. A., Ross, M. P., & Borghetti, B. J. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2215319 · Cited by 253
Li, B., Tian, B., Li, Y., & Xiong, G. (2013) · Proceedings of 2013 IEEE International Conference on Service Operations and Logistics, and Informatics · doi:10.1109/soli.2013.6611397 · Cited by 4
Metadata
- Authors
- Lavee, G., Rivlin, E., & Rudzsky, M.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews)
- Published
- 2009-09
- Volume
- 39
- Issue
- 5
- Pages
- 489-504
- ISSN
- 1094-6977 (ISSN-L)
- 1558-2442
- OpenAlex
- W2128951574
- Cited by
- 218
- References
- 9
- FWCI
- 24.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video. https://app.cochat.ai/papers/10.1109/tsmcc.2009.2023380
- The paper
- Lavee, G., Rivlin, E., & Rudzsky, M. (2009). Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). https://doi.org/10.1109/tsmcc.2009.2023380
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.