The DOI matches its Crossref record; 256 of the 256 references it cites were found in a registry or an index.
A Review of Human Activity Recognition Methods
Open accessAbstract
Recognizing human activities from video sequences or still images is a challenging task due to problems such as background clutter, partial occlusion, changes in scale, viewpoint, lighting, and appearance. Many applications, including video surveillance systems, human-computer interaction, and robotics for human behavior characterization, require a multiple activity recognition system. In this work, we provide a detailed review of recent and state-of-the-art research advances in the field of human activity classification. We propose a categorization of human activity methodologies and discuss their advantages and limitations. In particular, we divide human activity classification methods into two large categories according to whether they use data from different modalities or not. Then, each of these categories is further analyzed into sub-categories, which reflect how they model human activities and what type of activities they are interested in. Moreover, we provide a comprehensive analysis of the existing, publicly available human activity classification datasets and examine the requirements for an ideal human activity recognition dataset. Finally, we report the characteristics of future research directions and present some open issues on human activity recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–256 of 256
Learning a discriminative hidden part model for human action recognition
Wang, Y., & Mori, G. (2008) · Cited by 67
Identifying players in broadcast sports videos using conditional random fields
Lu, W.-L., Ting, J.-A., Murphy, K. P., & Little, J. J. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995562 · Cited by 65
Efficient Pose-Based Action Recognition
Eweiwi, A., Cheema, M. S., Bauckhage, C., & Gall, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16814-2_28 · Cited by 64
A Probabilistic Multimedia Retrieval Model and Its Evaluation
Westerveld, T., de Vries, A. P., van Ballegooij, A., de Jong, F. M. G., & Hiemstra, D. (2003) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s111086570321101x · Cited by 63
Continuous Action Recognition Based on Sequence Alignment
Kulkarni, K., Evangelidis, G., Cech, J., & Horaud, R. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0758-9 · Cited by 62
Holte, M. B., Chakraborty, B., Gonzàlez, J., & Moeslund, T. B. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2193556 · Cited by 59
Multiple Granularity Analysis for Fine-Grained Action Detection
Ni, B., Paramathayalan, V. R., & Moulin, P. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.102 · Cited by 59
Learning Discriminative Space–Time Action Parts from Weakly Labelled Videos
Sapienza, M., Fabio Cuzzolin, A., & Torr, P. H. S. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0662-8 · Cited by 58
Modeling hidden dynamics of multimodal cues for spontaneous agreement and disagreement recognition
Bousmalis, K., Morency, L., & Pantić, M. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771341 · Cited by 58
Gao, Z., Zhang, H., Xu, G., & Xue, Y. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.06.085 · Cited by 55
Tran, K. N., Gala, A., Kakadiaris, I. A., & Shah, S. K. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.09.015 · Cited by 54
Self-citationPart-based motion descriptor image for human action recognition
Tran, K. N., Kakadiaris, I. A., & Shah, S. K. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.12.028 · Cited by 54
Self-citationProbabilistic approach to detecting dependencies between data sets
Arto Klami, A., & Samuel Kaski, A. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.12.044 · Cited by 53
Dynamic Probabilistic CCA for Analysis of Affective Behavior and Fusion of Continuous Annotations
Nicolaou, M. A., Pavlović, V., & Pantić, M. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.16 · Cited by 52
Video Event Understanding Using Natural Language Descriptions
Ramanathan, V., Liang, P., & Fei-Fei, L. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.117 · Cited by 50
Event Recognition in Videos by Learning from Heterogeneous Web Sources
Chen, L., Duan, L., & Xu, D. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.344 · Cited by 49
Decision Level Fusion of Domain Specific Regions for Facial Action Recognition
Jiang, B., Martínez, B., Valstar, M., & Pantić, M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.312 · Cited by 48
Human activity recognition in videos using a single example
Javan, M., & Levine, M. D. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2013.08.005 · Cited by 44
Action recognition by exploring data distribution and feature correlation
Wang, S., Yang, Y., Ma, Z., Li, X., Pang, C., & Hauptmann, A. G. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247823 · Cited by 44
Attribute Regularization Based Human Action Recognition
Zhang, Z., Wang, C., Xiao, B., Zhou, W., & Liu, S. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2258152 · Cited by 43
Matching mixtures of curves for human action recognition
Vrigkas, M., Karavasilis, V., Nikou, C., & Kakadiaris, I. A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.11.007 · Cited by 43
Self-citationInfinite Hidden Conditional Random Fields for Human Behavior Analysis
Bousmalis, K., Zafeiriou, S. P., Morency, L., & Pantić, M. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2224882 · Cited by 43
Space-time tree ensemble for action recognition
Ma, S., Sigal, L., & Sclaroff, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299137 · Cited by 43
3D model-based continuous emotion recognition
Chen, H., Li, J., Zhang, F., Li, Y., & Wang, H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298793 · Cited by 42
Space-time Facet Model for Human Activity Classification
Samanta, S., & Chanda, B. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2326734 · Cited by 42
Associating Textual Features with Visual Ones to Improve Affective Image Classification
Liu, N., Dellandréa, E., Tellez, B., & Chen, L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_23 · Cited by 41
Online action recognition using covariance of shape and motion
Kviatkovsky, I., Rivlin, E., & Shimshoni, I. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.08.001 · Cited by 40
Recording Affect in the Field: Towards Methods and Metrics for Improving Ground Truth Labels
Healey, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_14 · Cited by 38
Yan, X., & Luo, Y. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.02.002 · Cited by 38
A flow model for joint action recognition and identity maintenance
Khamis, S., Morariu, V. I., & Davis, L. S. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247804 · Cited by 38
Improved Spatio-temporal Salient Feature Detection for Action Recognition
Shabani, A.-H., Clausi, D. A., & Zelek, J. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.100 · Cited by 37
Action recognition in cluttered dynamic scenes using Pose-Specific Part Models
Singh, V. K., & Nevatia, R. (2011) · International Conference on Computer Vision · doi:10.1109/iccv.2011.6126232 · Cited by 37
Cost-effective solution to synchronised audio-visual data capture using multiple sensors
Lichtenauer, J. F., Shen, J., Valstar, M., & Pantić, M. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2011.07.004 · Cited by 36
Modeling local behavior for predicting social interactions towards human tracking
Yan, X., Kakadiaris, I. A., & Shah, S. K. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.10.019 · Cited by 34
Self-citationSparse B-spline polynomial descriptors for human activity recognition
Oikonomopoulos, A., Pantić, M., & Patras, I. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.05.010 · Cited by 34
Substructure and boundary modeling for continuous action recognition
Wang, Z., Wang, J., Xiao, J., Lin, K.-H., & Huang, T. S. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247818 · Cited by 33
Hybrid Fusion Approach for Detecting Affects from Multichannel Physiology
Hussain, M. S., Calvo, R. A., & Pour, P. A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_60 · Cited by 31
Robust relative attributes for human action recognition
Zhang, Z., Wang, C., Xiao, B., Zhou, W., & Liu, S. (2013) · Pattern Analysis and Applications · doi:10.1007/s10044-013-0349-3 · Cited by 31
A Gaussian Process Guided Particle Filter for Tracking 3D Human Pose in Video
Sedai, S., Bennamoun, M., & Huynh, D. Q. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2271850 · Cited by 31
Audiovisual Detection of Behavioural Mimicry
Bilakhia, S., Petridis, S., & Pantić, M. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.27 · Cited by 29
Yang, Z., Metallinou, A., & Narayanan, S. S. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2328311 · Cited by 27
Human attributes from 3D pose tracking
Livne, M., Sigal, L., Troje, N. F., & Fleet, D. J. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.01.003 · Cited by 27
Human interaction categorization by using audio-visual cues
Marín-Jiménez, M. J., Muñoz‐Salinas, R., Yeguas-Bolívar, E., et al. (2013) · Machine Vision and Applications · doi:10.1007/s00138-013-0521-1 · Cited by 23
Human behaviour recognition in data-scarce domains
Baxter, R. H., Robertson, N. M., & Lane, D. M. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.02.019 · Cited by 22
Discriminative fusion of shape and appearance features for human pose estimation
Sedai, S., Bennamoun, M., & Huynh, D. Q. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.019 · Cited by 19
Atomic Action Features: A New Feature for Action Recognition
Zhou, Q., & Wang, G. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33863-2_29 · Cited by 18
A unified tree-based framework for joint action localization, recognition and segmentation
Jiang, Z., Lin, Z., & Davis, L. S. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.09.008 · Cited by 18
Realistic Human Action Recognition with Audio Context
Wu, Q., Wang, Z., Deng, F., & Feng, D. D. (2010) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2010.57 · Cited by 17
Action Recognition Robust to Background Clutter by Using Stereo Vision
Sànchez-Riera, J., Čech, J., & Horaud, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33863-2_33 · Cited by 15
Affect analysis in natural human interaction using Joint Hidden Conditional Random Fields
Siddiquie, B., Khan, S. M., Divakaran, A., & Sawhney, H. (2013) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2013.6607590 · Cited by 15
Human Action Recognition With Multiple-Instance Markov Model
Zhou, W., & Zhang, Z. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2344448 · Cited by 14
Human Context: Modeling Human-Human Interactions for Monocular 3D Pose Estimation
Andriluka, M., & Sigal, L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31567-1_26 · Cited by 12
Human Activity as a Manifold-Valued Random Process
Yi, S., Krim, H., & Norris, L. K. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2197008 · Cited by 10
Affect Detection and Classification from the Non-stationary Physiological Data
AlZoubi, O., Fossati, D., D’Mello, S. K., & Calvo, R. A. (2013) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2013.49 · Cited by 7
Latent Boosting for Action Recognition
Huang, Z. F., Yang, W., Wang, Y., et al. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.132 · Cited by 6
Transfer learning via attributes for improved on-the-fly classification
Kulkarni, P., Sharma, G., Zepeda, J., & Chevallier, L. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836097 · Cited by 5
Cited by
Temporal Convolutional Networks: A Unified Approach to Action Segmentation
Lea, C., Vidal, R., Reiter, A., & Hager, G. D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_7 · Cited by 924
Outlook on human-centric manufacturing towards Industry 5.0
Lu, Y., Zheng, H., Chand, S., Xia, W., Liu, Z., Xu, X., Wang, L., Qin, Z., & Bao, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.02.001 · Cited by 671
Vision-based human activity recognition: a survey
Beddiar, D. R., Nini, B., Sabokrou, M., & Hadid, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09004-3 · Cited by 505
Pareek, P., & Thakkar, A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09904-8 · Cited by 455
Górriz, J. M., Ramírez, J., Ortíz, A., Martínez-Murcia, F. J., Segovia, F., Suckling, J., Leming, M., Zhang, Y.-D., Álvarez-Sánchez, J. R., Bologna, G., et al. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.078 · Cited by 319
Metadata
- Authors
- Vrigkas, M., Nikou, C., & Kakadiaris, I. A.
- Venue
- Frontiers in Robotics and AI
- Publisher
- Frontiers Media SA
- Published
- 2015-11-16
- Volume
- 2
- ISSN
- 2296-9144 (ISSN-L)
- OpenAlex
- W2180635266
- Cited by
- 566
- References
- 256
- FWCI
- 23.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.