The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Machine Recognition of Human Activities: A Survey
Abstract
The past decade has witnessed a rapid proliferation of video cameras in all walks of life and has resulted in a tremendous explosion of video content. Several applications such as content-based video annotation and retrieval, highlight extraction and video summarization require recognition of the activities occurring in the video. The analysis of human activities in videos is an area with increasingly important consequences from security and surveillance to entertainment and personal archiving. Several challenges at various levels of processing-robustness against errors in low-level processing, view and rate-invariant representations at midlevel processing and semantic representation of human activities at higher level processing-make this problem hard to solve. In this review paper, we present a comprehensive survey of efforts in the past couple of decades to address the problems of representation, recognition, and learning of human activities from video and related applications. We discuss the problem at two major levels of complexity: 1) "actions" and 2) "activities." "Actions" are characterized by simple motion patterns typically executed by a single human. "Activities" are more complex and involve coordinated actions among a small number of humans. We will discuss several approaches and classify them according to their ability to handle varying degrees of complexity as interpreted above. We begin with a discussion of approaches to model the simplest of action classes known as atomic or primitive actions that do not require sophisticated dynamical modeling. Then, methods to model actions with more complex dynamics are discussed. The discussion then leads naturally to methods for higher level representation of complex activities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273
The humanID gait challenge problem: data sets, performance, and analysis
Sarkar, S., Phillips, P. J., Liu, Z., Vega, I. R., Grother, P., & Bowyer, K. W. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.39 · Cited by 1,133
Research works printed but not linked: 141
- 10.1109/CVPR.2004.1315230 · DOI · Paper page
- 10.1006/cviu.1998.0726 · DOI · Paper page
- 10.1109/CVPR.2005.58 · DOI · Paper page
- 10.1109/EVENT.2001.938868 · DOI
- 10.1098/rstb.1997.0108 · DOI · Paper page
- 10.1109/34.910878 · DOI · Paper page
- belkin, 2001, Advances in neural information processing systems, 585
- roweis, 2000, nonlinear dimensionality reduction by locally linear embedding, Science, 290, 2323, 10.1126/science.290.5500.2323 · DOI · Paper page
- 10.1109/TPAMI.2007.70711 · DOI · Paper page
- 10.1109/VSPETS.2005.1570899 · DOI · Paper page
- 10.1007/s11263-005-1838-7 · DOI · Paper page
- 10.1023/A:1007975200487 · DOI
- roy-chowdhury, 2003, a factorization approach to activity recognition, Proc CVPR Workshop Event Mining, 41
- 10.1109/TIT.1962.1057692 · DOI · Paper page
- elgammal, 2000, non-parametric model for background subtraction, Proc IEEE Eur Conf Comput Vis, 751
- 10.1112/blms/16.2.81 · DOI · Paper page
- 10.1109/TEC.1961.5219197 · DOI
- 10.1007/978-94-011-5014-9 · DOI · Paper page
- bissacco, 2004, gait recognition using dynamic affine invariants, Int Symp Math Theory Netw Syst
- 10.1109/CVPR.2007.383331 · DOI
- 10.1016/0031-3203(78)90025-0 · DOI
- 10.1007/s11263-006-0009-9 · DOI · Paper page
- 10.1109/CVPR.2007.383332 · DOI
- 10.1109/CVPR.2007.383137 · DOI · Paper page
- 10.1109/ICPR.2002.1047975 · DOI
- 10.1109/CVPR.2007.383512 · DOI
- 10.1109/ICCV.2005.85 · DOI · Paper page
- 10.1023/B:VISI.0000013087.49260.fb · DOI · Paper page
- 10.1109/CVPR.2005.328 · DOI · Paper page
- 10.1109/CVPR.2007.383132 · DOI · Paper page
- 10.1109/TPAMI.2003.1206511 · DOI
- 10.1109/ICCV.2003.1238658 · DOI
- 10.1006/cviu.1998.0716 · DOI · Paper page
- 10.1016/0262-8856(95)93154-K · DOI · Paper page
- 10.1145/1177352.1177355 · DOI · Paper page
- 10.1016/j.cviu.2006.08.002 · DOI · Paper page
- georis, 2004, a video interpretation platform applied to bank agency monitoring, Intelligent Distributed Surveillance Systems (IDSS-04), 46, 10.1049/ic:20040097 · DOI
- 10.1109/ICCV.2007.4409049 · DOI
- 10.1109/TPAMI.2005.246 · DOI · Paper page
- 10.1109/TIP.2005.852197 · DOI
- 10.5244/C.20.127 · DOI · Paper page
- 10.1109/CVPR.2001.990935 · DOI · Paper page
- 10.1109/WMVC.2008.4544068 · DOI
- 10.1109/ICPR.2004.1334462 · DOI · Paper page
- 10.1163/156856801753253582 · DOI
- 10.1364/JOSAA.7.000923 · DOI · Paper page
- 10.1109/CVPR.1999.784616 · DOI
- 10.1109/ICCV.2007.4408988 · DOI · Paper page
- 10.1109/ICPR.2004.1333743 · DOI
- 10.1145/1026711.1026757 · DOI
- tran, 2008, visual event modeling and recognition using markov logic networks, IEEE Eur Conf Comput Vis
- 10.1109/AVSS.2005.1577271 · DOI
- 10.1109/TPAMI.2005.210 · DOI
- 10.1109/CVPR.2001.990924 · DOI
- hobbs, 2004, an ontology for video event representation, Proc IEEE Workshop Event Detect Recog, 119
- 10.1155/2007/65989 · DOI
- guler, 0, An ontology of video events in the physical security and surveillance domain
- 10.1109/ICCV.2003.1238661 · DOI
- 10.1109/CVPR.2007.382996 · DOI
- 10.1109/MMUL.2005.87 · DOI
- 10.1111/j.1467-9892.1982.tb00349.x · DOI · Paper page
- 10.1109/CVPR.2007.383135 · DOI
- 10.1109/CVPR.2001.990925 · DOI · Paper page
- 10.1109/ICCV.2005.90 · DOI
- 10.1109/34.546259 · DOI
- 10.1109/34.868681 · DOI · Paper page
- 10.1016/0005-1098(93)90061-W · DOI
- 10.1109/ICCV.2003.1238420 · DOI · Paper page
- ghahramani, 1996, Parameter Estimation for Linear Dynamical Systems
- 10.1023/A:1020350100748 · DOI · Paper page
- 10.1023/A:1007928103394 · DOI
- 10.1016/j.cviu.2006.07.013 · DOI · Paper page
- 10.1007/s11263-005-3671-4 · DOI
- 10.1109/CVPR.2007.383099 · DOI
- 10.1109/MNRAO.1994.346259 · DOI
- 10.1109/5.18626 · DOI · Paper page
- 10.1109/ACV.1994.341308 · DOI
- 10.1109/ISCV.1995.477006 · DOI
- 10.1023/A:1008118801668 · DOI
- 10.1109/34.735811 · DOI · Paper page
- 10.1109/CVPR.2006.304 · DOI
- 10.1109/TIP.2004.832865 · DOI · Paper page
- 10.1109/ICPR.2004.1334410 · DOI
- 10.1109/TPAMI.2006.122 · DOI · Paper page
- 10.1109/CVPR.2001.990977 · DOI
- 10.1109/CVPR.1997.609450 · DOI · Paper page
- 10.1109/TMM.2007.893340 · DOI
- 10.1006/cviu.1998.0744 · DOI · Paper page
- 10.1109/ICCV.1999.791201 · DOI · Paper page
- 10.3758/BF03212378 · DOI · Paper page
- 10.1109/CVPR.1998.698711 · DOI
- 10.1007/s00530-004-0148-1 · DOI
- 10.1109/TMM.2008.2001369 · DOI
- 10.1109/ICCV.1998.710817 · DOI
- 10.1109/CVPR.2004.430 · DOI
- 10.1016/0004-3702(95)00041-0 · DOI
- castel, 1996, what is going on? a high-level interpretation of a sequence of images, Proc ECCV Workshop Conceptual Descriptions Images, 13
- pearl, 1988, Probabilistic Reasoning in Intelligent Systems Networks of Plausible Inference
- 10.1109/5.24143 · DOI · Paper page
- oh, 2005, data-driven mcmc for learning and inference in switching linear dynamic systems, Proc Nat Conf Artif Intell, 944
- david, 1994, petri nets for modeling of dynamic systems a survey, Automatica, 30, 175, 10.1016/0005-1098(94)90024-8 · DOI
- 10.1109/CVPR.2000.855901 · DOI
- petri, 1966, Communication with automata
- 10.1023/A:1020249912095 · DOI · Paper page
- 10.1109/CVPR.2006.174 · DOI
- 10.1109/ICCV.2007.4408894 · DOI
- shi, 2004, propagation networks for recognizing partially ordered sequential action, Proc IEEE Conf Comput Vis Pattern Recognit, 2, 862
- 10.1109/TAC.1977.1101594 · DOI
- 10.1214/aos/1176344136 · DOI · Paper page
- intille, 1999, a framework for recognizing multi-agent action from visual evidence, Proc Nat Conf Artif Intell, 518
- gong, 2003, recognition of group activities using dynamic probabilistic networks, Proc IEEE Int Conf Comput Vis, 742, 10.1109/ICCV.2003.1238423 · DOI · Paper page
- 10.1006/jvci.1999.0413 · DOI · Paper page
- 10.1109/93.998041 · DOI
- zhong, 2004, detecting unusual activity in video, Proc IEEE Conf Comput Vis Pattern Recognit, 819
- 10.1109/34.868677 · DOI · Paper page
- 10.1109/TSMCB.2004.826829 · DOI
- 10.1109/34.868686 · DOI · Paper page
- 10.1109/ICPR.1998.711845 · DOI
- 10.1109/ICCV.2007.4408847 · DOI
- higuera, 2000, current trends in grammatical inference, Proc Joint IAPR Int Workshops Adv Pattern Recognit, 28
- 10.1561/0600000005 · DOI
- 10.1109/78.827549 · DOI
- 10.1145/212094.212141 · DOI · Paper page
- 10.1109/CVPR.2007.383333 · DOI
- moore, 2002, recognizing multitasked activities from video using stochastic context-free grammar, Proc 18th Nat Conf Artif Intell, 770
- huang, 1994, automatic symbolic traffic scene analysis using belief networks, Proc Nat Conf Artif Intell, 966
- 10.1007/s11263-006-9352-0 · DOI
- 10.1109/CVPR.2006.242 · DOI
- 10.1109/AFGR.1996.557249 · DOI
- aho, 1972, The Theory of Parsing Translation and Compiling Volume 1 Parsing
- 10.1016/S0167-6911(02)00135-4 · DOI
- 10.1145/362007.362035 · DOI
- 10.1109/ICIP.2006.313035 · DOI
- pavlovic, 2000, Advances in neural information processing systems, 981
- rota, 2000, activity recognition from video sequences using declarative models, Proc 14th Eur Conf Artif Intell, 673
- 10.1109/34.946990 · DOI · Paper page
- 10.1016/j.cviu.2004.02.005 · DOI · Paper page
- 10.1109/CVPR.2008.4587733 · DOI
- 10.1023/A:1021669406132 · DOI · Paper page
- 10.1109/CVPR.1997.609382 · DOI · Paper page
- 10.1109/34.877523 · DOI
Cited by
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Sensor-Based Activity Recognition
Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., & Yu, Z. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2198883 · Cited by 1,074
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors
Zhang, M., & Sawchuk, A. A. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370438 · Cited by 554
From action to activity: Sensor-based activity recognition
Liu, Y., Nie, L., Liu, L., & Rosenblum, D. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.096 · Cited by 486
Bianchi, V., Bassoli, M., Lombardo, G., Fornacciari, P., Mordonini, M., & De Munari, I. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2920283 · Cited by 466
A survey of video datasets for human action and activity recognition
Chaquet, J. M., Carmona, E. J., & Fernández-Caballero, A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.01.013 · Cited by 455
A review of Convolutional-Neural-Network-based action recognition
Yao, G., Lei, T., & Zhong, J. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.05.018 · Cited by 437
Understanding egocentric activities
Fathi, A., Farhadi, A., & Rehg, J. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126269 · Cited by 384
Slow feature analysis for human action recognition
Zhang, Z., & Tao, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.157 · Cited by 307
Hierarchical and Networked Vehicle Surveillance in ITS: A Survey
Tian, B., Morris, B. T., Tang, M., Liu, Y., Yao, Y., Gou, C., Shen, D., & Tang, S. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2552778 · Cited by 160
Modeling Actions through State Changes
Fathi, A., & Rehg, J. M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.333 · Cited by 145
Driver-Activity Recognition in the Context of Conditionally Autonomous Driving
Braunagel, C., Kasneci, E., Stolzmann, W., & Rosenstiel, W. (2015) · 2015 IEEE 18th International Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2015.268 · Cited by 109
Video based technology for ambient assisted living: A review of the literature
Cardinaux, F., Bhowmik, D., Abhayaratne, C., & Hawley, M. S. (2011) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2011-0110 · Cited by 98
Remote Health Monitoring Systems for Elderly People: A Survey
Ahmed, S., Irfan, S., Kiran, N., Masood, N., Anjum, N., & Ramzan, N. (2023) · Sensors · doi:10.3390/s23167095 · Cited by 52
Forecasting occurrences of activities
Minor, B., & Cook, D. J. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.09.010 · Cited by 45
Activity-Aware Energy-Efficient Automation of Smart Buildings
Thomas, B., & Cook, D. (2016) · Energies · doi:10.3390/en9080624 · Cited by 42
Towards skill recognition using eye-hand coordination in industrial production
Haslgrübler, M., Gollan, B., Thomay, C., Ferscha, A., & Heftberger, J. (2019) · Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments · doi:10.1145/3316782.3316784 · Cited by 9
Metadata
- Authors
- Turaga, P., Chellappa, R., Subrahmanian, V. S., & Udrea, O.
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2008-11
- Volume
- 18
- Issue
- 11
- Pages
- 1473-1488
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2155268664
- Cited by
- 1,333
- References
- 4
- FWCI
- 107.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.