The DOI matches its Crossref record; 302 of the 302 references it cites were found in a registry or an index.
Human Action Recognition and Prediction: A Survey
Open accessAbstract
Derived from rapid advances in computer vision and machine learning, video analysis tasks have been moving from inferring the present state to predicting the future state. Vision-based action recognition and prediction from videos are such tasks, where action recognition is to infer human actions (present state) based upon complete action executions, and action prediction to predict human actions (future state) based upon incomplete action executions. These two tasks have become particularly prevalent topics recently because of their explosively emerging real-world applications, such as visual surveillance, autonomous driving vehicle, entertainment, and video retrieval, etc. Many attempts have been devoted in the last a few decades in order to build a robust and effective framework for action recognition and prediction. In this paper, we survey the complete state-of-the-art techniques in action recognition and prediction. Existing models, popular algorithms, technical difficulties, popular action databases, evaluation protocols, and promising future directions are also provided with systematic discussions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–302 of 302
Weakly Supervised Action Labeling in Videos under Ordering Constraints
Bojanowski, P., Lajugie, R., Bach, F., Laptev, I., Ponce, J., Schmid, C., & Sivic, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_41 · Cited by 191
Hidden Part Models for Human Action Recognition: Probabilistic versus Max Margin
Wang, Y., & Mori, G. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.214 · Cited by 190
Conditional Generative Neural System for Probabilistic Trajectory Prediction
Li, J., Ma, H., & Tomizuka, M. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967822 · Cited by 187
MANTRA: Memory Augmented Networks for Multiple Trajectory Prediction
Marchetti, F., Becattini, F., Seidenari, L., & Bimbo, A. D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00717 · Cited by 186
MuHAVi: A Multicamera Human Action Video Dataset for the Evaluation of Action Recognition Methods
Singh, S., Velastin, S. A., & Ragheb, H. (2010) · 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance · doi:10.1109/avss.2010.63 · Cited by 184
TARN: Temporal Attentive Relation Network for Few-Shot and Zero-Shot Action RecognitionPreprint
Bishay, M., Zoumpourlis, G., & Patras, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09021 · Cited by 183
3C-Net: Category Count and Center Loss for Weakly-Supervised Action Localization
Narayan, S., Cholakkal, H., Khan, F. S., & Shao, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00877 · Cited by 183
Patch to the Future: Unsupervised Visual Prediction
Walker, J., Gupta, A., & Hebert, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.416 · Cited by 179
Few-Shot Action Recognition with Permutation-Invariant Attention
Zhang, H., Zhang, L., Qi, X., Li, H., Torr, P. H. S., & Koniusz, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_31 · Cited by 179
Structured Learning of Human Interactions in TV Shows
Patron-Perez, A., Marszalek, M., Reid, I., & Zisserman, A. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.24 · Cited by 174
Evidential Deep Learning for Open Set Action Recognition
Bao, W., Yu, Q., & Kong, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01310 · Cited by 174
Self-citationDiscriminative Video Pattern Search for Efficient Action Detection
Yuan, J., Liu, Z., & Wu, Y. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.38 · Cited by 172
Gaussian process regression flow for analysis of motion trajectories
Kim, K., Lee, D., & Essa, I. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126365 · Cited by 171
Parsing video events with goal inference and intent prediction
Pei, M., Jia, Y., & Zhu, S. C. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126279 · Cited by 170
Learning Spatio-Temporal Structure from RGB-D Videos for Human Activity Detection and Anticipation
Koppula, H. S., & Saxena, A. (2013) · International Conference on Machine Learning · Cited by 169
Deep Sequential Context Networks for Action Prediction
Kong, Y., Tao, Z., & Fu, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.390 · Cited by 169
Self-citationTransitive Invariance for Self-Supervised Visual Representation Learning
Wang, X., He, K., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.149 · Cited by 168
Kar, A., Rai, N., Sikka, K., & Sharma, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.604 · Cited by 165
A Generative Approach to Zero-Shot and Few-Shot Action Recognition
Mishra, A. K., Verma, V. K., Reddy, M. S. K., Arulkumar, S., Rai, P., & Mittal, A. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00047 · Cited by 164
Open-set human activity recognition based on micro-Doppler signatures
Yang, Y., Hou, C., Lang, Y., Guan, D., Huang, D., & Xu, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.030 · Cited by 164
STEP: Spatio-Temporal Progressive Learning for Video Action Detection
Yang, X., Yang, X., Liu, M.-Y., Xiao, F., Davis, L. S., & Kautz, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00035 · Cited by 163
Discriminative Orderlet Mining for Real-Time Recognition of Human-Object Interaction
Yu, G., Liu, Z., & Yuan, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16814-2_4 · Cited by 161
Random field topic model for semantic region analysis in crowded scenes from tracklets
Zhou, B., Wang, X., & Tang, X. (2011) · doi:10.1109/cvpr.2011.5995459 · Cited by 151
Social NCE: Contrastive Learning of Socially-aware Motion Representations
Liu, Y., Yan, Q., & Alahi, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01484 · Cited by 148
Tracklet Descriptors for Action Modeling and Video Analysis
Raptis, M., & Soatto, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_42 · Cited by 147
Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning
Gan, C., Gong, B., Liu, K., Su, H., & Guibas, L. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00586 · Cited by 142
Real-time Action Recognition by Spatiotemporal Semantic and Structural Forests
Yu, T.-H., Kim, T., & Cipolla, R. (2010) · British Machine Vision Conference (BMVC) · doi:10.5244/c.24.52 · Cited by 141
Max-margin early event detectors
Hoai, M., & la Torre, F. D. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248012 · Cited by 139
Human Action Segmentation and Recognition Using Discriminative Semi-Markov Models
Shi, Q., Cheng, L., Wang, L., & Smola, A. J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-010-0384-0 · Cited by 138
Mainprice, J., Hayne, R., & Berenson, D. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2581216 · Cited by 138
ProtoGAN: Towards Few Shot Learning for Action Recognition
Dwivedi, S. K., Gupta, V., Mitra, R., Ahmed, S., & Jain, A. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00166 · Cited by 135
High Five: Recognising human interactions in TV shows
Patron-Perez, A., Marszałek, M., Zisserman, A., & Reid, I. D. (2010) · British Machine Vision Conference (BMVC) · doi:10.5244/c.24.50 · Cited by 134
DL-SFA: Deeply-Learned Slow Feature Analysis for Action Recognition
Sun, L., Jia, K., Chan, T., Fang, Y., Wang, G., & Yan, S. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.336 · Cited by 130
Stochastic Representation and Recognition of High-Level Group Activities
Ryoo, M. S., & Aggarwal, J. K. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-010-0355-5 · Cited by 128
Interactive Phrases: Semantic Descriptionsfor Human Interaction Recognition
Kong, Y., Jia, Y., & Fu, Y. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2303090 · Cited by 125
Self-citationThe Action Similarity Labeling Challenge
Kliper-Gross, O., Hassner, T., & Wolf, L. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.209 · Cited by 125
Action-Reaction: Forecasting the Dynamics of Human Interaction
Huang, D.-A., & Kitani, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_32 · Cited by 125
Uncertainty Guided Collaborative Training for Weakly Supervised Temporal Action Detection
Yang, W., Zhang, T., Yu, X., Tian, Q. C., Zhang, Y., & FengWu, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00012 · Cited by 125
3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks
Wang, K., Wang, X., Lin, L., Wang, M., & Zuo, W. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654912 · Cited by 123
Improving Spatiotemporal Self-supervision by Deep Reinforcement Learning
Büchler, U., Brattoli, B., & Ommer, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_47 · Cited by 123
Range-Sample Depth Feature for Action Recognition
Lu, C., Jia, J., & Tang, C. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.104 · Cited by 122
LOKI: Long Term and Key Intentions for Trajectory Prediction
Girase, H., Gang, H., Malla, S., Li, J., Kanehara, A., Mangalam, K., & Choi, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00966 · Cited by 122
Modeling the Temporal Extent of Actions
Satkin, S., & Hebert, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_39 · Cited by 118
Neural Graph Matching Networks for Fewshot 3D Action Recognition
Guo, M., Chou, E., Huang, D.-A., Song, S., Yeung, S. Y., & Fei-Fei, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_40 · Cited by 118
Watch this: Scalable cost-function learning for path planning in urban environments
Wulfmeier, M., Wang, D. Z., & Posner, I. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759328 · Cited by 116
Knowledge Transfer for Scene-Specific Motion Prediction
Ballan, L., Castaldo, F., Alahi, A., Palmieri, F., & Savarese, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_42 · Cited by 116
Bifold and Semantic Reasoning for Pedestrian Behavior Prediction
Rasouli, A., Rohani, M., & Luo, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01531 · Cited by 114
TACNet: Transition-Aware Context Network for Spatio-Temporal Action Detection
Song, L., Zhang, S., Yu, G., & Sun, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01226 · Cited by 113
Graph Distillation for Action Detection with Privileged Modalities
Luo, Z., Hsieh, J.-T., Jiang, L., Niebles, J. C., & Fei-Fei, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_11 · Cited by 111
Efficient Human Pose Estimation from Single Depth Images
Shotton, J., Girshick, R., Fitzgibbon, A. W., Sharp, T., Cook, M., Finocchio, M., Moore, R., Kohli, P., Criminisi, A., Kipman, A., et al. (2013) · Advances in computer vision and pattern recognition · doi:10.1007/978-1-4471-4929-3_13 · Cited by 103
Action Recognition with Exemplar Based 2.5D Graph Matching
Yao, B., & Fei-Fei, L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_13 · Cited by 102
Anticipating human activities for reactive robotic response
Koppula, H. S., & Saxena, A. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696634 · Cited by 101
Robot-Centric Activity Prediction from First-Person Videos
Ryoo, M. S., Fuchs, T. J., Xia, L., Aggarwal, J. K., & Matthies, L. H. (2015) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2696454.2696462 · Cited by 99
Charades-Ego: A Large-Scale Dataset of Paired Third and First Person VideosPreprint
Sigurdsson, G. A., Gupta, A. K., Schmid, C., Farhadi, A., & Alahari, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09626 · Cited by 99
Action Detection and Recognition in Continuous Action Streams by Deep Learning-Based Sensing Fusion
Dawar, N., & Kehtarnavaz, N. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2872862 · Cited by 99
Searching Video for Complex Activities with Finite State Models
İkizler-Cinbiş, N., & Forsyth, D. A. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383168 · Cited by 98
Hybrid Models for Human Motion Recognition
Fanti, C., Zelnik‐Manor, L., & Perona, P. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.179 · Cited by 97
Temporal Structure Mining for Weakly Supervised Action Detection
Yu, T., Ren, Z., Li, Y., Yan, E., Xu, N., & Yuan, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00562 · Cited by 96
Learning the Predictability of the Future
Surís, D., Liu, R., & Vondrick, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01242 · Cited by 96
Hollywood 3D: Recognizing Actions in 3D Natural Scenes
Hadfield, S., & Bowden, R. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.436 · Cited by 92
Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction
Narayanan, S., Moslemi, R., Pittaluga, F., Liu, B., & Chandraker, M. K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01554 · Cited by 92
A discriminative key pose sequence model for recognizing human interactions
Vahdat, A., Gao, B., Ranjbar, M., & Mori, G. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130458 · Cited by 89
Bilinear heterogeneous information machine for RGB-D action recognition
Kong, Y., & Fu, Y. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298708 · Cited by 88
Self-citationMovement Pattern Histogram for Action Recognition and Retrieval
Ciptadi, A., Goodwin, M. S., & Rehg, J. M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10605-2_45 · Cited by 86
Where are you heading? Dynamic Trajectory Prediction with Expert Goal Examples
Zhao, H., & Wildes, R. P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00753 · Cited by 84
Manipulation planning with goal sets using constrained trajectory optimization
Dragan, A. D., Ratliff, N., & Srinivasa, S. S. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980538 · Cited by 83
Human action recognition using Local Spatio-Temporal Discriminant Embedding
Jia, K., & Yeung, D. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587732 · Cited by 82
Evaluation of video activity localizations integrating quality and quantity measurements
Wolf, C., Lombardi, E., Mille, J., Çeliktutan, O., Jiu, M., Doğan, E., Eren, G., Baccouche, M., Dellandréa, E., Bichot, C., et al. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.06.014 · Cited by 80
Spatio-Temporal Vector of Locally Max Pooled Features for Action Recognition in Videos
Duţă, I. C., Ionescu, B. E., Aizawa, K., & Sebe, N. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.341 · Cited by 78
Learning to predict trajectories of cooperatively navigating agents
Kretzschmar, H., Kuderer, M., & Burgard, W. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907442 · Cited by 76
Anticipating human actions by correlating past with the future with Jaccard similarity measures
Fernando, B., & Herath, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01302 · Cited by 76
HAA500: Human-Centric Atomic Action Dataset with Curated Videos
Chung, J., Wuu, C.-H., Yang, H.-R., Tai, Y., & Tang, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01321 · Cited by 75
Predicting Object Dynamics in Scenes
Fouhey, D. F., & Zitnick, C. L. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.260 · Cited by 73
Forecast the Plausible Paths in Crowd Scenes
Su, H., Zhu, J., Dong, Y., & Zhang, B. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/386 · Cited by 72
Action Prediction From Videos via Memorizing Hard-to-Predict Samples
Kong, Y., Gao, S., Sun, B., & Fu, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12324 · Cited by 72
Self-citationModeling Complex Temporal Composition of Actionlets for Activity Prediction
Li, K., Hu, J., & Fu, Y. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33718-5_21 · Cited by 69
Self-citationWatch Only Once: An End-to-End Video Action Detection Framework
Chen, S., Sun, P., Xie, E., Ge, C., Wu, J., Ma, L., Shen, J., & Luo, P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00807 · Cited by 69
Learning a discriminative hidden part model for human action recognition
Wang, Y., & Mori, G. (2008) · Cited by 67
WOAD: Weakly Supervised Online Action Detection in Untrimmed Videos
Gao, M., Zhou, Y., Xu, R., Socher, R., & Xiong, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00195 · Cited by 65
Continuous Learning of Human Activity Models Using Deep Nets
Hasan, M., & Roy–Chowdhury, A. K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10578-9_46 · Cited by 61
ODN: Opening the Deep Network for Open-Set Action Recognition
Shu, Y., Shi, Y., Wang, Y., Zou, Y., Yuan, Q., & Tian, Y. (2018) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2018.8486601 · Cited by 59
Complex Events Detection Using Data-Driven Concepts
Yang, Y., & Shah, M. A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_52 · Cited by 58
A review on human action analysis in videos for retrieval applications
Ramezani, M., & Yaghmaee, F. (2016) · Artificial Intelligence Review · doi:10.1007/s10462-016-9473-y · Cited by 57
Real-time Gesture Recognition with Minimal Training Requirements and On-line Learning
Rajko, S., Qian, G., Ingalls, T., & James, J. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383330 · Cited by 55
Two-Stream Region Convolutional 3D Network for Temporal Activity Detection
Xu, H., Das, A., & Saenko, K. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2921539 · Cited by 54
One-Shot Action Localization by Learning Sequence Matching Network
Yang, H., He, X., & Porikli, F. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00157 · Cited by 52
A Variational Auto-Encoder Model for Stochastic Point Processes
Mehrasa, N., Jyothi, A. A., Durand, T., He, J., Sigal, L., & Mori, G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00328 · Cited by 52
Case Studies in Interdisciplinary Research
Keestra, M. (2011) · Cited by 49
Unsupervised Learning of Functional Categories in Video Scenes
Turek, M. W., Hoogs, A. J., & Collins, R. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15552-9_48 · Cited by 45
Multi-task Sparse Learning with Beta Process Prior for Action Recognition
Yuan, C., Hu, W., Tian, G., Yang, S., & Wang, H. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.61 · Cited by 44
Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centers
Bhattacharyya, A., Reino, D. O., Fritz, M., & Schiele, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00634 · Cited by 43
Substructure and boundary modeling for continuous action recognition
Wang, Z., Wang, J., Xiao, J., Lin, K.-H., & Huang, T. S. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247818 · Cited by 38
Temporal Action Localization in Untrimmed Videos Using Action Pattern Trees
Song, H., Wu, X., Zhu, B., Wu, Y., Chen, M., & Jia, Y. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2866370 · Cited by 37
Global-Local Temporal Saliency Action Prediction
Lai, S., Zheng, W., Hu, J., & Zhang, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2751145 · Cited by 34
Open Set Driver Activity Recognition
Roitberg, A., Ma, C., Haurilet, M., & Stiefelhagen, R. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304605 · Cited by 34
Learning Human Actions by Combining Global Dynamics and Local Appearance
Luo, G., Yang, S., Tian, G., Yuan, C., Hu, W., & Maybank, S. J. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2329301 · Cited by 32
Depth and Skeleton Associated Action Recognition without Online Accessible RGB-D Cameras
Lin, Y., Hua, J.-H., Tang, N. C., Chen, M.-H., & Liao, H.-Y. M. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.335 · Cited by 26
Max-Margin Heterogeneous Information Machine for RGB-D Action Recognition
Kong, Y., & Fu, Y. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0982-6 · Cited by 26
Self-citationModeling Geometric-Temporal Context With Directional Pyramid Co-Occurrence for Action Recognition
Yuan, C., Li, X., Hu, W., Ling, H., & Maybank, S. J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2291319 · Cited by 21
Three Birds with One Stone: Multi-Task Temporal Action Detection via Recycling Temporal Annotations
Li, Z., & Yao, L. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00472 · Cited by 19
SLAC: A Sparsely Labeled Dataset for Action Classification and LocalizationPreprint
Zhao, H., Yan, Z., Wang, H., Torresani, L., & Torralba, A. B. (2017) · arXiv (Cornell University) · Cited by 17
Yuan, C., Wu, B., Li, X., Hu, W., Maybank, S. J., & Wang, F. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0867-0 · Cited by 11
Research works printed but not linked: 37
- Bendale, A., & Boult, T.E. (2016). Towards open set deep networks. In: CVPR.
- Chunhui, L., Yueyu, H., Yanghao, L., Sijie, S., & Jiaying, L. (2017). Pku-mmd: A large scale benchmark for continuous multi-modal human action understanding. arXiv preprint arXiv:1703.07475. · arXiv
- Geng, C., Huang, S.j., & Chen, S. (2020). Recent advances in open set recognition: A survey. IEEE transactions on pattern analysis and machine intelligence.
- Gu, C., Sun, C., Vijayanarasimhan, S., Pantofaru, C., Ross, D.A., Toderici, G., Li, Y., Ricco, S., Sukthankar, R., Schmid, C., et al. (2017). Ava: A video dataset of spatio-temporally localized atomic visual actions. arXiv preprint arXiv:1705.08421. · DOI · Paper page
- Heilbron, F.C., Escorcia, V., Ghanem, B., & Niebles, J.C. (2015). ActivityNet: A large-scale video benchmark for human activity understanding. In: CVPR. · DOI · Paper page
- Jain, M., van Gemert, J., Jegou, H., Bouthemy, P., & Snoek, C.G. (2014). Action localization with tubelets from motion. In: CVPR.
- Ji, S., Xu, W., Yang, M., & Yu, K. (2010). 3d convolutional neural networks for human action recognition. In: ICML.
- Jia, C., Kong, Y., Ding, Z., & Fu, Y. (2014). Latent tensor transfer learning for rgb-d action recognition. In: ACM Multimedia. · doi:10.1145/2647868.2654928
- Jingen Liu, J.L., & Shah, M. (2009). Recognizing realistic actions from videos “in the wild”. In: CVPR.
- Karaman, S., Seidenari, L., & Bimbo, A.D. (2014). Fast saliency based pooling of fisher encoded dense trajectories. In: ECCV THUMOS Workshop.
- Ke, Q., Fritz, M., & Schiele, B. (2019). Time-conditioned action anticipation in one shot. In: CVPR.
- Ke, Q., Fritz, M., & Schiele, B. (2021). Future moment assessment for action query. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision.
- Keestra, M. (2015). Understanding human action. integraiting meanings, mechanisms, causes, and contexts. TRANSDISCIPLINARITY IN PHILOSOPHY AND SCIENCE: APPROACHES, PROBLEMS, PROSPECTS pp. 201–235.
- Kong, Y., & Fu, Y. (2014). Modeling supporting regions for close human interaction recognition. In: ECCV workshop.
- Kong, Y., & Fu, Y. (2016). Max-margin action prediction machine. TPAMI, 38(9), 1844–1858. · doi:10.1109/tpami.2015.2491928
- Kong, Y., Jia, Y., & Fu, Y. (2012). Learning human interaction by interactive phrases. In: Proceedings of European conference on computer vision. · doi:10.1007/978-3-642-33718-5_22
- Kong, Y., Kit, D., & Fu, Y. (2014). A discriminative model with multiple temporal scales for action prediction. In: ECCV. · doi:10.1007/978-3-319-10602-1_39
- Kong, Y., Tao, Z., & Fu, Y. (2018). Adversarial action prediction networks. IEEE TPAMI.
- Kosaraju, V., Sadeghian, A., Martín-Martín, R., Reid, I., Rezatofighi, S.H., & Savarese, S. (2019). Social-bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks. arXiv preprint arXiv:1907.03395. · arXiv
- Lan, T., Sigal, L., & Mori, G. (2012). Social roles in hierarchical models for human activity. In: CVPR.
- Laptev, I., Marszałek, M., Schmid, C., & Rozenfeld, B. (2008). Learning realistic human actions from movies. · DOI · Paper page
- Lee, N., & Kitani, K.M. (2016). Predicting wide receiver trajectories in american football. In: WACV2016. · DOI
- Liu, X., Pintea, S.L., Nejadasl, F.K., Booij, O., & van Gemert, J.C. (2021). No frame left behind: Full video action recognition. In: CVPR.
- Purushwalkam, S., & Gupta, A. (2016). Pose from action: Unsupervised learning of pose features based on motion. arXiv preprint arXiv:1609.05420. · arXiv
- Ramanathan, V., Yao, B., & Fei-Fei, L. (2013). Social role discovery in human events. In: CVPR. · doi:10.1109/cvpr.2013.320
- Ricoeur, P. (1992). Oneself as another (K. Blamey, Trans.). Chicago: University of Chicago Press.
- Rohit, G., & Kristen, G. (2021). Anticipative video transformer. In: ICCV.
- Ryoo, M., & Aggarwal, J. (2006). Recognition of composite human activities through context-free grammar based representation. CVPR, 2, 1709–1718.
- Shahroudy, A., Liu, J., Ng, T.T., & Wang, G. (2016). Ntu rgb+d: A large scale dataset for 3d human activity analysis. In: CVPR. · DOI · Paper page
- Singh, S., Velastin, S.A., & Ragheb, H. (2010). Muhavi: A multicamera human action video dataset for the evaluation of action recognition methods. In: Advanced Video and Signal Based Surveillance (AVSS), 2010 Seventh IEEE international conference on, pp. 48–55. IEEE. · DOI · Paper page
- Sumi, S. (2000). Perception of point-light walker produced by eight lights attached to the back of the walker. Swiss Journal of Psychology, 59, 126–32. · doi:10.1024//1421-0185.59.2.126
- Wang, C., Wang, Y., Xu, M., & Crandall, D.J. (2021). Stepwise goal-driven networks for trajectory prediction. arXiv preprint arXiv:2103.14107. · arXiv
- Wang, L., Qiao, Y., & Tang, X. (2014). Action recognition and detection by combining motion and appearance features. In: ECCV THUMOS Workshop.
- Wu, B., Yuan, C., & Hu, W. (2014). Human action recognition based on context-dependent graph kernels. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2609–2616. · doi:10.1109/cvpr.2014.334
- Yang, S., Yuan, C., Wu, B., Hu, W., & Wang, F. (2015). Multi-feature max-margin hierarchical bayesian model for action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1610–1618. · doi:10.1109/cvpr.2015.7298769
- Yuan, C., Li, X., Hu, W., Ling, H., & Maybank, S.J. (2013). 3d r transform on spatio-temporal interest points for action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 724–730. · doi:10.1109/cvpr.2013.99
- Zhai, X., Peng, Y., & Xiao, J. (2013). Cross-media retrieval by intra-media and inter-media correlation mining. Multimedia Systems, 19(5), 395–406. · doi:10.1007/s00530-012-0297-6
Cited by
Dimitriadou, E., & Lanitis, A. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00231-3 · Cited by 370
“Human action recognition is a vision-based technique that can identify a complete action performed by a human in a video sequence (Kong & Fu, 2022).”
BackgroundA Review on Deep Learning Techniques for Video Prediction
Oprea, S., Martinez-Gonzalez, P., Garcia-Garcia, A., Castro-Vargas, J. A., Orts-Escolano, S., Garcia-Rodriguez, J., & Argyros, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045007 · Cited by 301
UAV-Human: A Large Benchmark for Human Behavior Understanding with Unmanned Aerial Vehicles
Li, T., Liu, J., Zhang, W., Ni, Y., Wang, W., & Li, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01600 · Cited by 283
Rules of the Road: Predicting Driving Behavior With a Convolutional Model of Semantic Interactions
Hong, J., Sapp, B., & Philbin, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00865 · Cited by 277
Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
Metadata
- Authors
- Kong, Y., & Fu, Y.
- Venue
- International Journal of Computer Vision
- Published
- 2022-03-28
- Volume
- 130
- Issue
- 5
- Pages
- 1366-1401
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2810685774
- Cited by
- 780
- References
- 302
- FWCI
- 44.19
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.