The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Human activity analysis: A review
Abstract
Human activity recognition is an important area of computer vision research. Its applications include surveillance systems, patient monitoring systems, and a variety of systems that involve interactions between persons and electronic devices such as human-computer interfaces. Most of these applications require an automated recognition of high-level activities, composed of multiple simple (or atomic) actions of persons. This article provides a detailed overview of various state-of-the-art research papers on human activity recognition. We discuss both the methodologies developed for simple human actions and those for high-level activities. An approach-based taxonomy is chosen that compares the advantages and limitations of each approach. Recognition methodologies for an analysis of the simple actions of a single person are first presented in the article. Space-time volume approaches and sequential approaches that represent and recognize activities directly from input images are discussed. Next, hierarchical recognition methodologies for high-level activities are presented and compared. Statistical approaches, syntactic approaches, and description-based approaches for hierarchical recognition are discussed in the article. In addition, we further discuss the papers on the recognition of human-object interactions and group activities. Public datasets designed for the evaluation of the recognition methodologies are illustrated in our article as well, comparing the methodologies' performances. This review will provide the impetus for future research in more productive areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
Maintaining knowledge about temporal intervals
Allen, J. F. (1983) · Communications of the ACM · doi:10.1145/182.358434 · Cited by 7,593
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273
Research works printed but not linked: 101
- 10.1006/cviu.1998.0744 · DOI · Paper page
- 10.1109/T-C.1975.224102 · DOI
- 10.1093/logcom/4.5.531 · DOI · Paper page
- 10.1109/AVSS.2007.4425322 · DOI
- 10.1109/ICCV.2005.28 · DOI · Paper page
- 10.1109/34.910878 · DOI · Paper page
- 10.1109/34.643892 · DOI · Paper page
- Bregonzio M., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Los Alamitos, CA.
- Campbell L. W., Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE Los Alamitos, CA, 624--630
- 10.1016/0262-8856(95)93154-K · DOI · Paper page
- Chomat O., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)., 2
- Cupillard F., Proceedings of the IEEE Workshop on Applications of Computer Vision (WACV). IEEE
- 10.1109/TSMCB.2007.909939 · DOI
- Damen D., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Darrell T., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Dollar P., Proceedings of the 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS). IEEE
- Efros A., Proceedings of the IEEE International Conference on Computer Vision (ICCV)., 2
- Gavrila D., Proceedings of the International Workshop on Face and Gesture Recognition. 272--277
- 10.1006/cviu.1998.0716 · DOI · Paper page
- Ghanem N., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW). IEEE
- Gong S., Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE
- Gupta A., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Gupta A., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Hakeem A., Proceedings of the 20th National Conference on Artificial Intelligence (AAAI). 263--268
- Harris C., Proceedings of the Alvey Vision Conference. 147--152
- 10.1016/j.cviu.2004.02.005 · DOI · Paper page
- Intille S. S., Proceedings of the AAAI Conference on Innovative Applications of Artificial Intelligence. AAAI/IAAI. 518--525
- 10.1109/34.868686 · DOI · Paper page
- Jhuang H., Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE
- 10.1109/CVPR.2006.297 · DOI
- Johansson G., 1975, Visual motion perception. Sci, Amer., 232, 76
- 10.1109/CVPRW.2006.32 · DOI
- Ke Y., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- 10.1145/1101149.1101237 · DOI
- Kim T.-K., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Kitani K. M., Proceedings of the Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS). IEEE
- 10.1109/WMVC.2007.34 · DOI
- 10.1163/156855307782148578 · DOI
- la Torre Frade F. D., Proceedings of the International Conference on Computer Vision Theory and Applications. 110--115
- Laptev I., Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE
- Laptev I., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Laptev I., Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE
- 10.1145/1459359.1459456 · DOI
- Liu J., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Liu J., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- 10.5555/850924.851523 · doi:10.5555/850924.851523
- 10.1109/ICPR.2006.210 · DOI
- Lv F., Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS). IEEE
- Lv F., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Minnen D., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)., 2
- Moore D. J., Proceedings of the AAAI Conference on Innovative Applications of Artificial Intelligence. 770--776
- Moore D. J., Proceedings of the IEEE International Conference on Computer Vision (ICCV)., 1
- 10.1109/3468.784178 · DOI
- 10.1109/WMVC.2007.12 · DOI · Paper page
- Nevatia R., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW)., 7
- Nevatia R., Proceedings of the IEEE Workshop on Event Mining. IEEE
- 10.1109/CVPR.2005.203 · DOI · Paper page
- Niebles J. C., Proceedings of the British Machine Vision Conference (BMVC).
- 10.1007/s11263-007-0122-4 · DOI · Paper page
- Niyogi S., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- 10.1109/ICMI.2002.1166960 · DOI · Paper page
- 10.1109/34.868684 · DOI · Paper page
- 10.1007/s00530-004-0148-1 · DOI
- 10.1109/ICCV.2005.57 · DOI
- Pinhanez C. S., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Rao C., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)., 2
- Rapantzikos K., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Ribeiro P. C., Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS). IEEE
- Rodriguez M. D., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- Rofouei M., Proceedings of the IEEE/ACM/IFIP Workshop on Embedded Systems for Real-Time Multimedia (ESTImedia). ACM
- 10.1007/s11263-008-0181-1 · DOI
- Ryoo M. S., Proceedings of the IEEE International Conference on Computer Vision (ICCV), IEEE
- 10.1109/WMVC.2008.4544065 · DOI
- Ryoo M. S., Proceedings of the 2nd International Workshop on Semantic Learning Applications in Multimedia (SLAM).
- 10.1109/CVPR.2006.242 · DOI
- 10.1109/ICPR.2006.1043 · DOI
- 10.1109/WMVC.2008.4544068 · DOI
- 10.5555/1018429.1020906 · doi:10.5555/1018429.1020906
- 10.1145/1291233.1291311 · DOI · Paper page
- 10.1109/CVPR.2005.328 · DOI · Paper page
- 10.1109/ICCV.2005.90 · DOI
- Shi Y., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)., 2
- 10.1613/jair.790 · DOI
- Starner T., Proceedings of the International Symposium on Computer Vision. 265
- 10.1007/978-3-540-88688-4_45 · DOI
- 10.1109/TCSVT.2008.2005594 · DOI · Paper page
- Vaswani N., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)., 2
- 10.1109/CVPR.2006.304 · DOI
- 10.1109/AVSS.2007.4425317 · DOI
- Vu V.-T., Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). 1295--1302
- 10.1016/0004-3702(82)90023-6 · DOI
- Wong S.-F., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
- Yacoob Y., Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE
- Yamato J., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE
- 10.1109/MMSP.2006.285263 · DOI
- 10.1109/CVPR.2005.58 · DOI · Paper page
- 10.1109/ICCV.2005.201 · DOI
- 10.1109/ICPR.2006.440 · DOI
- 10.1109/3468.759269 · DOI
- Zelnik-Manor L., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE
- 10.1109/TMM.2006.870735 · DOI
Cited by
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Action recognition with trajectory-pooled deep-convolutional descriptors
Wang, L., Qiao, Y., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299059 · Cited by 1,194
A survey on ambient-assisted living tools for older adults
Rashidi, P., & Mihailidis, A. (2013) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2012.2234129 · Cited by 1,128
Understanding and Modeling of WiFi Signal Based Human Activity Recognition
Wang, W., Liu, A. X., Shahzad, M., Ling, K., & Lu, S. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790093 · Cited by 1,110
Sensor-Based Activity Recognition
Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., & Yu, Z. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2198883 · Cited by 1,074
Roh, E., Hwang, B.-U., Kim, D., Kim, B.-Y., & Lee, N.-E. (2015) · ACS Nano · doi:10.1021/acsnano.5b01613 · Cited by 927
Transition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740
JAABA: Interactive machine learning for automatic annotation of animal behavior
Kabra, M., Robie, A. A., Rivera-Alba, M., Branson, S., & Branson, K. (2013) · Nature Methods · doi:10.1038/nmeth.2281 · Cited by 644
Anticipating Human Activities Using Object Affordances for Reactive Robotic Response
Koppula, H. S., & Saxena, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2430335 · Cited by 596
A database for fine grained activity detection of cooking activities
Rohrbach, M., Amin, S., Andriluka, M., & Schiele, B. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247801 · Cited by 521
A Comprehensive Survey of Vision-Based Human Action Recognition Methods
Zhang, H.-B., Zhang, Y.-X., Zhong, B., Lei, Q., Yang, L., Du, J.-X., & Chen, D.-S. (2019) · Sensors · doi:10.3390/s19051005 · Cited by 503
“Human action recognition has a wide range of applications, such as intelligent video surveillance and environmental home monitoring [1,2], video storage and retrieval [3,4], intelligent human–machine interfaces [5,6], and identity recognition [7].”
BackgroundFrom action to activity: Sensor-based activity recognition
Liu, Y., Nie, L., Liu, L., & Rosenblum, D. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.096 · Cited by 486
A survey of video datasets for human action and activity recognition
Chaquet, J. M., Carmona, E. J., & Fernández-Caballero, A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.01.013 · Cited by 455
Combining embedded accelerometers with computer vision for recognizing food preparation activities
Stein, S., & McKenna, S. J. (2013) · Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing · doi:10.1145/2493432.2493482 · Cited by 448
Computer vision techniques in construction: A critical review
Xu, S., Wang, J., Shou, W., Ngo, T., Sadick, A.-M., & Wang, X. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-020-09504-3 · Cited by 409
Skeleton-based action recognition via spatial and temporal transformer networks
Plizzari, C., Cannici, M., & Matteucci, M. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103219 · Cited by 409
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356
Context-Aware Online Adaptation of Mixed Reality Interfaces
Lindlbauer, D., Feit, A. M., & Hilliges, O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347945 · Cited by 254
Alleviating Over-segmentation Errors by Detecting Action Boundaries
Ishikawa, Y., Kasai, S., Aoki, Y., & Kataoka, H. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00237 · Cited by 171
Analyzing Activity Behavior and Movement in a Naturalistic Environment Using Smart Home Techniques
Cook, D. J., Schmitter-Edgecombe, M., & Dawadi, P. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2461659 · Cited by 123
Context-Aware Activity Recognition and Anomaly Detection in Video
Zhu, Y., Nayak, N. M., & Roy-Chowdhury, A. K. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2234722 · Cited by 121
Multimodal emotional state recognition using sequence-dependent deep hierarchical features
Barros, P., Jirak, D., Weber, C., & Wermter, S. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.09.009 · Cited by 86
Forecasting occurrences of activities
Minor, B., & Cook, D. J. (2017) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.09.010 · Cited by 45
Activity-Aware Energy-Efficient Automation of Smart Buildings
Thomas, B., & Cook, D. (2016) · Energies · doi:10.3390/en9080624 · Cited by 42
AGENT: A Benchmark for Core Psychological Reasoning
Shu, T., Bhandwaldar, A., Gan, C., Smith, K. A., Liu, S., Gutfreund, D., Spelke, E., Tenenbaum, J. B., & Ullman, T. D. (2021) · arXiv · doi:10.48550/arxiv.2102.12321 · Cited by 34
Hiremath, S. K., & Ploetz, T. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3478825 · Cited by 4
Ding, B., Liu, Z., & Sun, Y. (2018) · 2018 Eighth International Conference on Instrumentation & Measurement, Computer, Communication and Control (IMCCC) · doi:10.1109/imccc.2018.00211 · Cited by 4
Metadata
- Authors
- Aggarwal, J. K., & Ryoo, M. S.
- Venue
- ACM Computing Surveys
- Published
- 2011-04
- Volume
- 43
- Issue
- 3
- Pages
- 1-43
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W1983705368
- Cited by
- 2,056
- References
- 4
- FWCI
- 177.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Texas Higher Education Coordinating Board (003658-0140-2007)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.