Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 780

The DOI matches its Crossref record; 302 of the 302 references it cites were found in a registry or an index.

Human Action Recognition and Prediction: A Survey

Open access
Kong, Yu, Fu, Yun·2022·International Journal of Computer Vision

Abstract

Derived from rapid advances in computer vision and machine learning, video analysis tasks have been moving from inferring the present state to predicting the future state. Vision-based action recognition and prediction from videos are such tasks, where action recognition is to infer human actions (present state) based upon complete action executions, and action prediction to predict human actions (future state) based upon incomplete action executions. These two tasks have become particularly prevalent topics recently because of their explosively emerging real-world applications, such as visual surveillance, autonomous driving vehicle, entertainment, and video retrieval, etc. Many attempts have been devoted in the last a few decades in order to build a robust and effective framework for action recognition and prediction. In this paper, we survey the complete state-of-the-art techniques in action recognition and prediction. Existing models, popular algorithms, technical difficulties, popular action databases, evaluation protocols, and promising future directions are also provided with systematic discussions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11263-022-01594-9

Cites

302 of 302 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 302 references

Research works printed but not linked: 37

  1. Bendale, A., & Boult, T.E. (2016). Towards open set deep networks. In: CVPR.
  2. Chunhui, L., Yueyu, H., Yanghao, L., Sijie, S., & Jiaying, L. (2017). Pku-mmd: A large scale benchmark for continuous multi-modal human action understanding. arXiv preprint arXiv:1703.07475. · arXiv
  3. Geng, C., Huang, S.j., & Chen, S. (2020). Recent advances in open set recognition: A survey. IEEE transactions on pattern analysis and machine intelligence.
  4. Gu, C., Sun, C., Vijayanarasimhan, S., Pantofaru, C., Ross, D.A., Toderici, G., Li, Y., Ricco, S., Sukthankar, R., Schmid, C., et al. (2017). Ava: A video dataset of spatio-temporally localized atomic visual actions. arXiv preprint arXiv:1705.08421. · DOI · Paper page
  5. Heilbron, F.C., Escorcia, V., Ghanem, B., & Niebles, J.C. (2015). ActivityNet: A large-scale video benchmark for human activity understanding. In: CVPR. · DOI · Paper page
  6. Jain, M., van Gemert, J., Jegou, H., Bouthemy, P., & Snoek, C.G. (2014). Action localization with tubelets from motion. In: CVPR.
  7. Ji, S., Xu, W., Yang, M., & Yu, K. (2010). 3d convolutional neural networks for human action recognition. In: ICML.
  8. Jia, C., Kong, Y., Ding, Z., & Fu, Y. (2014). Latent tensor transfer learning for rgb-d action recognition. In: ACM Multimedia. · doi:10.1145/2647868.2654928
  9. Jingen Liu, J.L., & Shah, M. (2009). Recognizing realistic actions from videos “in the wild”. In: CVPR.
  10. Karaman, S., Seidenari, L., & Bimbo, A.D. (2014). Fast saliency based pooling of fisher encoded dense trajectories. In: ECCV THUMOS Workshop.
  11. Ke, Q., Fritz, M., & Schiele, B. (2019). Time-conditioned action anticipation in one shot. In: CVPR.
  12. Ke, Q., Fritz, M., & Schiele, B. (2021). Future moment assessment for action query. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision.
  13. Keestra, M. (2015). Understanding human action. integraiting meanings, mechanisms, causes, and contexts. TRANSDISCIPLINARITY IN PHILOSOPHY AND SCIENCE: APPROACHES, PROBLEMS, PROSPECTS pp. 201–235.
  14. Kong, Y., & Fu, Y. (2014). Modeling supporting regions for close human interaction recognition. In: ECCV workshop.
  15. Kong, Y., & Fu, Y. (2016). Max-margin action prediction machine. TPAMI, 38(9), 1844–1858. · doi:10.1109/tpami.2015.2491928
  16. Kong, Y., Jia, Y., & Fu, Y. (2012). Learning human interaction by interactive phrases. In: Proceedings of European conference on computer vision. · doi:10.1007/978-3-642-33718-5_22
  17. Kong, Y., Kit, D., & Fu, Y. (2014). A discriminative model with multiple temporal scales for action prediction. In: ECCV. · doi:10.1007/978-3-319-10602-1_39
  18. Kong, Y., Tao, Z., & Fu, Y. (2018). Adversarial action prediction networks. IEEE TPAMI.
  19. Kosaraju, V., Sadeghian, A., Martín-Martín, R., Reid, I., Rezatofighi, S.H., & Savarese, S. (2019). Social-bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks. arXiv preprint arXiv:1907.03395. · arXiv
  20. Lan, T., Sigal, L., & Mori, G. (2012). Social roles in hierarchical models for human activity. In: CVPR.
  21. Laptev, I., Marszałek, M., Schmid, C., & Rozenfeld, B. (2008). Learning realistic human actions from movies. · DOI · Paper page
  22. Lee, N., & Kitani, K.M. (2016). Predicting wide receiver trajectories in american football. In: WACV2016. · doi:10.1109/wacv.2016.7477732
  23. Liu, X., Pintea, S.L., Nejadasl, F.K., Booij, O., & van Gemert, J.C. (2021). No frame left behind: Full video action recognition. In: CVPR.
  24. Purushwalkam, S., & Gupta, A. (2016). Pose from action: Unsupervised learning of pose features based on motion. arXiv preprint arXiv:1609.05420. · arXiv
  25. Ramanathan, V., Yao, B., & Fei-Fei, L. (2013). Social role discovery in human events. In: CVPR. · doi:10.1109/cvpr.2013.320
  26. Ricoeur, P. (1992). Oneself as another (K. Blamey, Trans.). Chicago: University of Chicago Press.
  27. Rohit, G., & Kristen, G. (2021). Anticipative video transformer. In: ICCV.
  28. Ryoo, M., & Aggarwal, J. (2006). Recognition of composite human activities through context-free grammar based representation. CVPR, 2, 1709–1718.
  29. Shahroudy, A., Liu, J., Ng, T.T., & Wang, G. (2016). Ntu rgb+d: A large scale dataset for 3d human activity analysis. In: CVPR. · DOI · Paper page
  30. Singh, S., Velastin, S.A., & Ragheb, H. (2010). Muhavi: A multicamera human action video dataset for the evaluation of action recognition methods. In: Advanced Video and Signal Based Surveillance (AVSS), 2010 Seventh IEEE international conference on, pp. 48–55. IEEE. · DOI · Paper page
  31. Sumi, S. (2000). Perception of point-light walker produced by eight lights attached to the back of the walker. Swiss Journal of Psychology, 59, 126–32. · doi:10.1024//1421-0185.59.2.126
  32. Wang, C., Wang, Y., Xu, M., & Crandall, D.J. (2021). Stepwise goal-driven networks for trajectory prediction. arXiv preprint arXiv:2103.14107. · arXiv
  33. Wang, L., Qiao, Y., & Tang, X. (2014). Action recognition and detection by combining motion and appearance features. In: ECCV THUMOS Workshop.
  34. Wu, B., Yuan, C., & Hu, W. (2014). Human action recognition based on context-dependent graph kernels. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2609–2616. · doi:10.1109/cvpr.2014.334
  35. Yang, S., Yuan, C., Wu, B., Hu, W., & Wang, F. (2015). Multi-feature max-margin hierarchical bayesian model for action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1610–1618. · doi:10.1109/cvpr.2015.7298769
  36. Yuan, C., Li, X., Hu, W., Ling, H., & Maybank, S.J. (2013). 3d r transform on spatio-temporal interest points for action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 724–730. · doi:10.1109/cvpr.2013.99
  37. Zhai, X., Peng, Y., & Xiao, J. (2013). Cross-media retrieval by intra-media and inter-media correlation mining. Multimedia Systems, 19(5), 395–406. · doi:10.1007/s00530-012-0297-6

Cited by

See all 780

Metadata

Authors
Kong, Y., & Fu, Y.
Venue
International Journal of Computer Vision
Published
2022-03-28
Volume
130
Issue
5
Pages
1366-1401
ISSN
  • 0920-5691 (ISSN-L)
  • 1573-1405
OpenAlex
W2810685774
Cited by
780
References
302
FWCI
44.19
Type
journal article
Language
en
Open access
green
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Human Action Recognition and Prediction: A Survey. https://app.cochat.ai/papers/10.1007/s11263-022-01594-9
The paper
Kong, Y., & Fu, Y. (2022). Human Action Recognition and Prediction: A Survey. International Journal of Computer Vision. https://doi.org/10.1007/s11263-022-01594-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.