Human Action Recognition With Video Data: Research and Evaluation Challenges
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Given a video sequence, the task of action recognition is to identify the most similar action among the action sequences learned by the system. Such human action recognition is based on evidence gathered from videos. It has wide application including surveillance, video indexing, biometrics, telehealth, and human-computer interaction. Vision-based human action recognition is affected by several challenges due to view changes, occlusion, variation in execution rate, anthropometry, camera motion, and background clutter. In this survey, we provide an overview of the existing methods based on their ability to handle these challenges as well as how these methods can be generalized and their ability to detect abnormal actions. Such systematic classification will help researchers to identify the suitable methods available to address each of the challenges faced and their limitations. In addition, we also identify the publicly available datasets and the challenges posed by them. From this survey, we draw conclusions regarding how well a challenge has been solved, and we identify potential research areas that require further work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
W/sup 4/: real-time surveillance of people and their activities
Haritaoglu, I., Harwood, D., & Davis, L. S. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868683 · Cited by 2,523
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Recognizing human action in time-sequential images using hidden Markov model
Yamato, J., Ohya, J., & Ishii, K. (2003) · Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1992.223161 · Cited by 1,273
Slow feature analysis for human action recognition
Zhang, Z., & Tao, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.157 · Cited by 307
Coupled Hidden Semi Markov Models for Activity Recognition
Natarajan, P., & Nevatia, R. (2007) · 2007 IEEE Workshop on Motion and Video Computing (WMVC'07) · doi:10.1109/wmvc.2007.12 · Cited by 144 · cited 2×
“[104] × × S × × × × √ [81], [85], [91]–[97], [108], [113], [127], [153], [154] × × I I × × √ ×”
Cited by
Artificial intelligence for the metaverse: A survey
Huynh-The, T., Pham, Q.-V., Pham, X.-Q., Nguyen, T. T., Han, Z., & Kim, D.-S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105581 · Cited by 710
Vision-based human activity recognition: a survey
Beddiar, D. R., Nini, B., Sabokrou, M., & Hadid, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09004-3 · Cited by 505
A review of Convolutional-Neural-Network-based action recognition
Yao, G., Lei, T., & Zhong, J. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.05.018 · Cited by 437
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356
“The popularity of human action recognition based on RGB cameras has led to several survey articles that have appeared in [1, 50, 51, 66].”
BackgroundA Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial Settings
Mukherjee, D., Gupta, K., Chang, L. H., & Najjaran, H. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102231 · Cited by 344
Metadata
- Authors
- Ramanathan, M., Yau, W.-Y., & Teoh, E. K.
- Venue
- IEEE Transactions on Human-Machine Systems
- Published
- 2014-10
- Volume
- 44
- Issue
- 5
- Pages
- 650-663
- ISSN
- 2168-2291 (ISSN-L)
- 2168-2305
- OpenAlex
- W2164760349
- Cited by
- 110
- References
- 5
- FWCI
- 7.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Human Action Recognition With Video Data: Research and Evaluation Challenges. https://app.cochat.ai/papers/10.1109/thms.2014.2325871
- The paper
- Ramanathan, M., Yau, W.-Y., & Teoh, E. K. (2014). Human Action Recognition With Video Data: Research and Evaluation Challenges. IEEE Transactions on Human-Machine Systems. https://doi.org/10.1109/thms.2014.2325871
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.