The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Open accessAbstract
The paucity of videos in current action classification datasets (UCF-101 and HMDB-51) has made it difficult to identify good video architectures, as most methods obtain similar performance on existing small-scale benchmarks. This paper re-evaluates state-of-the-art architectures in light of the new Kinetics Human Action Video dataset. Kinetics has two orders of magnitude more data, with 400 human action classes and over 400 clips per class, and is collected from realistic, challenging YouTube videos. We provide an analysis on how current architectures fare on the task of action classification on this dataset and how much performance improves on the smaller benchmark datasets after pre-training on Kinetics. We also introduce a new Two-Stream Inflated 3D ConvNet (I3D) that is based on 2D ConvNet inflation: filters and pooling kernels of very deep image classification ConvNets are expanded into 3D, making it possible to learn seamless spatio-temporal feature extractors from video while leveraging successful ImageNet architecture designs and even their parameters. We show that, after pre-training on Kinetics, I3D models considerably improve upon the state-of-the-art in action classification, reaching 80.2% on HMDB-51 and 97.9% on UCF-101.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although I3D [4] and R3D [19] achieve better performance than vanilla ResNet50 [20] and EfficientNet [50], the computation costs are huge, such as R3D50 with 296G FLOPs.”
From TALL: Thumbnail Layout for Deepfake Video Detection (2023) · cites this paper as [4]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“(e) Non-local vs . 3D Conv : A 5-block non-local C2D vs . inflated 3D ConvNet (I3D) [7]. All entries are with ResNet-101. The numbers of parameters and FLOPs are relative to the C2D baseline (43.2M and 34.2B).”
From Non-local Neural Networks (2018) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“With a few non-local blocks, our architecures called non-local neural networks are more accurate for video classification than 2D and 3D convolutional networks [48] (including the inflated variant [7]).”
From Non-local Neural Networks (2018) · cites this paper as [7]
In the citing paper
“many of the deep-learning architectures mentioned in this review have similarities to ones used in analysis of digital media that try to combine multiple modalities to improve predictive performance of video content (Carreira and Zisserman, 2017; Afouras et al., 2019).”
From Missing data in multi-omics integration: Recent advances through artificial intelligence (2023) · cites this paper as Carreira and Zisserman, 2017
In the citing paper
“Compared to RNN-based architectures, Transformers [137] have significant advantages in long-term dependency and parallel computation.”
From Deep learning for visual speech analysis: A survey (2024) · cites this paper as [137]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Self-citationFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Items 901–1,000 of 1,055
Multi-Moments in Time: Learning and Interpreting Models for Multi-Action Video Understanding
Monfort, M., Pan, B., Ramakrishnan, K., Andonian, A., McNamara, B., Lascelles, A., Fan, Q., Gutfreund, D., Feris, R., & Oliva, A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3126682 · Cited by 83
Beyond Short-Term Snippet: Video Relation Detection With Spatio-Temporal Global Context
Liu, C., Yang, J., Xu, K., Gong, G., & Mu, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01085 · Cited by 75
Markerless tracking of an entire honey bee colony
Bożek, K., Hebert, L., Portugal, Y., Mikheyev, A. S., & Stephens, G. J. (2021) · Nature Communications · doi:10.1038/s41467-021-21769-1 · Cited by 70
Global2Local: Efficient Structure Search for Video Action Segmentation
Gao, S., Han, Q., Li, Z., Peng, P., Wang, L., & Cheng, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01653 · Cited by 75
Action Quality Assessment with Temporal Parsing Transformer
Bai, Y., Zhou, D., Zhang, S., Wang, J., Ding, E., Guan, Y., Long, Y., & Wang, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19772-7_25 · Cited by 73
Multi-View Action Recognition using Contrastive Learning
Shah, K., Shah, A., Lau, C. P., de Melo, C. M., & Chellapp, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00338 · Cited by 73
TEVAD: Improved video anomaly detection with captions
Chen, W., Ma, K. T., Yew, Z. J., Hur, M., & Khoo, D. A.-A. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00587 · Cited by 82
Xiao, L., Cao, Y., Gai, Y., Khezri, E., Liu, J., & Yang, M. (2023) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-023-00552-1 · Cited by 73
Dynamic gesture recognition by using CNNs and star RGB: A temporal information condensation
Canuto, C., Samatelo, J. L. A., & Vassallo, R. F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.038 · Cited by 75
Tavakolian, M., & Hadid, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01191-3 · Cited by 75
End-to-end Prediction of Driver Intention using 3D Convolutional Neural Networks
Gebert, P., Roitberg, A., Haurilet, M., & Stiefelhagen, R. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814249 · Cited by 76
Mimetics: Towards Understanding Human Actions Out of Context
Weinzaepfel, P., & Rogez, G. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01446-y · Cited by 74
Learning Temporal Co-Attention Models for Unsupervised Video Action Localization
Gong, G., Wang, X., Mu, Y., & Tian, Q. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00984 · Cited by 71
Cioppa, A., Deliège, A., Magera, F., Giancola, S., Barnich, O., Ghanem, B., & Droogenbroeck, M. V. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00511 · Cited by 78
Fine-grained action recognition using dynamic kernels
Yenduri, S., Perveen, N., Chalavadi, V., & Mohan, C. K. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108282 · Cited by 72
DCAN: Improving Temporal Action Detection via Dual Context Aggregation
Chen, G., Zheng, Y.-D., Wang, L., & Lü, T. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19900 · Cited by 73
Detection of Deepfake Videos Using Long-Distance Attention
Lu, W., Liu, L., Zhang, B., Luo, J., Zhao, X., Zhou, Y., & Huang, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3233063 · Cited by 78
Video-Based Human Activity Recognition Using Deep Learning Approaches
Surek, G. A. S., Seman, L. O., Stefenon, S. F., Mariani, V. C., & Coelho, L. D. S. (2023) · Sensors · doi:10.3390/s23146384 · Cited by 80
Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning
Piergiovanni, A., Kuo, W., & Angelova, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00220 · Cited by 72
Temporal Action Localization in the Deep Learning Era: A Survey
Wang, B., Zhao, Y., Yang, L., Long, T., & Li, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330794 · Cited by 79
Target Adaptive Context Aggregation for Video Scene Graph Generation
Teng, Y., Wang, L., Li, Z., & Wu, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01343 · Cited by 74
Cadena, P. R. G., Yang, M. Z., Qian, Y., & Wang, C. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917118 · Cited by 72
SCT: Set Constrained Temporal Transformer for Set Supervised Action Segmentation
Fayyaz, M., & Gall, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00058 · Cited by 70
Fine grained sport action recognition with Twin spatio-temporal convolutional neural networks
Martin, P.-E., Benois‐Pineau, J., Péteri, R., & Morlier, J. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08917-3 · Cited by 75
Improved two-stream model for human action recognition
Zhao, Y., Man, K. L., Smith, J. S., Siddique, K., & Guan, S.-U. (2020) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-020-00501-x · Cited by 73
Conditional Entropy Coding for Efficient Video Compression
Liu, J. T., Wang, S., Ma, W.-C., Shah, M., Hu, R. M., Dhawan, P., & Urtasun, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_27 · Cited by 74
Lin, X., Ma, L., Liu, W., & Chang, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_41 · Cited by 71
Self-Supervised Learning for Semi-Supervised Temporal Action Proposal
Wang, X., Zhang, S., Qing, Z., Shao, Y., Gao, C., & Sang, N. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00194 · Cited by 72
Sketch, Ground, and Refine: Top-Down Dense Video Captioning
Deng, C., Chen, S., Chen, D., He, Y., & Wu, Q. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00030 · Cited by 72
Memory-Guided Semantic Learning Network for Temporal Sentence Grounding
Liu, D., Qu, X., Di, X., Cheng, Y., Xu, Z., & Zhou, P. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20058 · Cited by 71
Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning
Li, J., Xie, J., Qian, L., Zhu, L., Tang, S., Wu, F. Q., Yang, Y., Zhuang, Y., & Wang, X. E. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00304 · Cited by 72
Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentation
Ding, Z., Hui, T., Huang, J., Wei, X., Han, J., & Liu, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00491 · Cited by 77
SMG: A Micro-gesture Dataset Towards Spontaneous Body Gestures for Emotional Stress State Analysis
Chen, H., Shi, H., Liu, X., Li, X., & Zhao, G. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01761-6 · Cited by 79
TrEP: Transformer-Based Evidential Prediction for Pedestrian Intention with Uncertainty
Zhang, Z.-M., Tian, R., & Ding, Z. (2023) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25463 · Cited by 100
Neuron Structure Modeling for Generalizable Remote Physiological Measurement
Lu, H. F., Yu, Z., Niu, X., & Chen, Y.-C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01783 · Cited by 73
Delving into CLIP latent space for Video Anomaly Recognition
Zanella, L., Liberatori, B., Menapace, W., Poiesi, F., Wang, Y., & Ricci, E. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104163 · Cited by 71
End-to-End Video Captioning With Multitask Reinforcement Learning
Li, L., & Gong, B. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00042 · Cited by 72
A Vision-Based System for Monitoring Elderly People at Home
Buzzelli, M., Albé, A., & Ciocca, G. (2020) · Applied Sciences · doi:10.3390/app10010374 · Cited by 71
Positional NormalizationPreprint
Li, B., Wu, F., Weinberger, K. Q., & Belongie, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04312 · Cited by 74
Wu, C., Wu, X., & Kittler, J. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00216 · Cited by 71
Temporal Reasoning Graph for Activity Recognition
Zhang, J., Shen, F., Xu, X., & Shen, H. T. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2985219 · Cited by 70
Probabilistic Future Prediction for Video Scene Understanding
Hu, A., Cotter, F., Mohan, N. C., Gurău, C., & Kendall, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_45 · Cited by 79
Vanneste, P., Jose Oramas, M., Verelst, T., Tuytelaars, T., Raes, A., Depaepe, F., & Noortgate, W. V. D. (2021) · Mathematics · doi:10.3390/math9030287 · Cited by 72
Koay, H. V., Chuah, J. H., Chow, C., & Chang, Y.-L. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105309 · Cited by 72
Yu, J., Liu, J., Cheng, Y., Feng, R., & Zhang, Y. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547868 · Cited by 70
Exploring Rich Semantics for Open-Set Action Recognition
Hu, Y., Gao, J., Dong, J., Fan, B., & Liu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3333206 · Cited by 71
Knowing Where to Focus: Event-aware Transformer for Video Grounding
Jang, J., Park, J., Kim, J., Kwon, H., & Sohn, K. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01273 · Cited by 73
Intra- and Inter-Action Understanding via Temporal Action Parsing
Shao, D., Zhao, Y., Dai, B., & Lin, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00081 · Cited by 66
Video-Based Person Re-identification via 3D Convolutional Networks and Non-local Attention
Liao, X., He, L., Yang, Z., & Zhang, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20876-9_39 · Cited by 69
A Simple Baseline for Audio-Visual Scene-Aware Dialog
Schwartz, I., Schwing, A. G., & Hazan, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01283 · Cited by 71
Soccer Video Summarization Using Deep Learning
Agyeman, R., Rafiq, M. T., & Choi, G. S. (2019) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00055 · Cited by 69
Video Representation Learning Using Discriminative Pooling
Wang, J., Cherian, A., Porikli, F., & Gould, S. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00126 · Cited by 69
Symbiotic Attention with Privileged Information for Egocentric Action Recognition
Wang, X., Wu, Y., Zhu, L., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6907 · Cited by 69
Relational Prototypical Network for Weakly Supervised Temporal Action Localization
Huang, L., Huang, Y., Ouyang, W., & Wang, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6760 · Cited by 68
CNN spatiotemporal features and fusion for surveillance video forgery detection
Fadl, S. M., Han, Q., & Li, Q. (2020) · Signal Processing Image Communication · doi:10.1016/j.image.2020.116066 · Cited by 69
D2-Net: Weakly-Supervised Action Localization via Discriminative Embeddings and Denoised Activations
Narayan, S., Cholakkal, H., Hayat, M., Khan, F. S., Yang, M., & Shao, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01335 · Cited by 70
A Transformer-Based Network for Dynamic Hand Gesture Recognition
D’Eusanio, A., Simoni, A., Pini, S., Borghi, G., Vezzani, R., & Cucchiara, R. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00072 · Cited by 71
Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspective
Xu, J., & Wang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00992 · Cited by 71
Class Semantics-based Attention for Action Detection
Sridhar, D., Quader, N., Muralidharan, S., Li, Y., Dai, P., & Lu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01348 · Cited by 69
Using Motion History Images With 3D Convolutional Networks in Isolated Sign Language Recognition
Sincan, Ö. M., & Keleş, H. Y. (2022) · IEEE Access · doi:10.1109/access.2022.3151362 · Cited by 78
ACGNet: Action Complement Graph Network for Weakly-Supervised Temporal Action Localization
Yang, Z., Qin, J., & Huang, D. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20216 · Cited by 71
DVMark: A Deep Multiscale Framework for Video Watermarking
Luo, X., Li, Y., Chang, H., Liu, C., Milanfar, P., & Yang, F. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3251737 · Cited by 69
Detector-Free Weakly Supervised Group Activity Recognition
Kim, D.-K., Lee, J., Cho, M., & Kwak, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01945 · Cited by 69
A Survey on Temporal Action Localization
Xia, H., & Zhan, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2986861 · Cited by 75
Learning to Discretely Compose Reasoning Module Networks for Video Captioning
Tan, G., Liu, D., Wang, M., & Zha, Z.-J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/104 · Cited by 68
Hwang, H., Jang, C., Park, G., Cho, J., & Kim, I.-J. (2021) · IEEE Access · doi:10.1109/access.2021.3051842 · Cited by 73
Bridging Text and Video: A Universal Multimodal Transformer for Audio-Visual Scene-Aware Dialog
Li, Z., Li, Z., Zhang, J., Feng, Y., & Zhou, J. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3065823 · Cited by 91
AdaSGN: Adapting Joint Number and Model Size for Efficient Skeleton-Based Action Recognition
Shi, L., Zhang, Y., Cheng, J., & Lu, H.-Q. (2021) · IEEE International Conference on Computer Vision · doi:10.1109/iccv48922.2021.01316 · Cited by 64
Supervised Video Summarization Via Multiple Feature Sets with Parallel Attention
Ghauri, J. A., Hakimov, S., & Ewerth, R. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428318 · Cited by 68
Multimodal Fusion via Teacher-Student Network for Indoor Action Recognition
Yu, B. X. B., Liu, Y., & Chan, K. (2021) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16430 · Cited by 84
Spatio-temporal Contrastive Domain Adaptation for Action Recognition
Song, X., Zhao, S., Yang, J., Yue, H., Xu, P., Hu, R., & Chai, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00966 · Cited by 71
A Closer Look at Temporal Sentence Grounding in Videos
Yuan, Y., Lan, X., Wang, X. Y., Chen, L., Wang, Z., & Zhu, W. (2021) · International Workshop on Human-centric Multimedia Analysis (HCMA) · doi:10.1145/3475723.3484247 · Cited by 68
Partially Relevant Video Retrieval
Dong, J., Chen, X., Zhang, M., Yang, X., Chen, S., Li, X., & Wang, X. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547976 · Cited by 69
Few-Shot Action Recognition with Hierarchical Matching and Contrastive Learning
Zheng, S., Chen, S., & Jin, Q. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19772-7_18 · Cited by 67
Naz, N., Sajid, H., Ali, S., Hasan, O., & Ehsan, M. K. (2023) · IEEE Access · doi:10.1109/access.2023.3247761 · Cited by 68
Dissecting self-supervised learning methods for surgical computer vision
Ramesh, S., Srivastav, V., Alapatt, D., Yu, T., Murali, A., Sestini, L., Nwoye, C. I., Hamoud, I., Sharma, S., Fleurentin, A., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102844 · Cited by 81
Proposal-Based Multiple Instance Learning for Weakly-Supervised Temporal Action Localization
Ren, H., Yang, W., Zhang, T., & Zhang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00237 · Cited by 69
Yang, D.-K., Huang, S., Xu, Z., Li, Z., Wang, S.-L., Li, M.-C., Wang, Y.-Z., Liu, Y., Yang, K., Chen, Z., et al. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01871 · Cited by 91
Vision-Language Models Can Identify Distracted Driver Behavior From Naturalistic Videos
Hasan, M. Z., Chen, J., Wang, J., Rahman, M. S., Joshi, A., Velipasalar, S., Hegde, C., Sharma, A., & Sarkar, S. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3381175 · Cited by 71
Geometric Matching for Cross-Modal Retrieval
Wang, Z., Gao, Z., Yang, Y., Wang, G., Jiao, C., & Shen, H. T. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3381347 · Cited by 78
Leveraging the Present to Anticipate the Future in Videos
Miech, A., Laptev, I., Šivic, J., Wang, H., Torresani, L., & Tran, D. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00351 · Cited by 68
Mou, L., Hua, Y., Jin, P., & Zhu, X. X. (2020) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2020.3005751 · Cited by 70
Automated Video Behavior Recognition of Pigs Using Two-Stream Convolutional Networks
Zhang, K., Li, D., Huang, J., & Chen, Y. (2020) · Sensors · doi:10.3390/s20041085 · Cited by 69
RubiksNet: Learnable 3D-Shift for Efficient Video Action Recognition
Fan, L., Buch, S., Wang, G., Cao, R., Zhu, Y., Niebles, J. C., & Fei-Fei, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_30 · Cited by 65
A Unified Framework for Shot Type Classification Based on Subject Centric Lens
Rao, A., Wang, J., Xu, L., Jiang, X., Huang, Q., Zhou, B., & Lin, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58621-8_2 · Cited by 69
Home Action Genome: Cooperative Compositional Action Understanding
Rai, N., Chen, H., Ji, J., Desai, R., Kozuka, K., Ishizaka, S., Adeli, E., & Niebles, J. C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01103 · Cited by 68
Multi-Scale 2D Temporal Adjacency Networks for Moment Localization With Natural Language
Zhang, S., Peng, H., Fu, J., Lu, Y., & Luo, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3120745 · Cited by 74
MTT: Multi-Scale Temporal Transformer for Skeleton-Based Action Recognition
Kong, J., Bian, Y., & Jiang, M. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3142675 · Cited by 68
ViGT: proposal-free video grounding with a learnable token in the transformer
Li, K., Guo, D., & Wang, M. (2023) · Science China Information Sciences · doi:10.1007/s11432-022-3783-3 · Cited by 67
TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detection
Sun, H., Zhou, M., Chen, W., & Xie, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28304 · Cited by 67
Learning Video Representations From Correspondence Proposals
Liu, X., Lee, J., & Jin, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00440 · Cited by 69
AssembleNet: Searching for Multi-Stream Neural Connectivity in Video ArchitecturesPreprint
Ryoo, M. S., Piergiovanni, A., Tan, M., & Angelova, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13209 · Cited by 90
Gao, Z., Guo, L., Guan, W., Liu, A.-A., Ren, T., & Chen, S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3038372 · Cited by 63
Structural Knowledge Distillation for Efficient Skeleton-Based Action Recognition
Bian, C., Feng, W., Wan, L., & Wang, S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3056895 · Cited by 66
Isolated Sign Language Recognition with Multi-Scale Spatial-Temporal Graph Convolutional Networks
Vázquez-Enríquez, M., Alba‐Castro, J. L., Docío-Fernández, L., & Banga, E. R. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00385 · Cited by 73
Learning Cross-Modal Contrastive Features for Video Domain Adaptation
Kim, D., Tsai, Y., Zhuang, B., Yu, X., Sclaroff, S., Saenko, K., & Chandraker, M. K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01336 · Cited by 68
Wang, Y., Sun, Y., Song, W., Gao, S., Huang, Y., Chen, Z., Ge, W., & Zhang, W. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547865 · Cited by 68
Bootstrapped Masked Autoencoders for Vision BERT Pretraining
Dong, X., Bao, J., Zhang, T., Chen, D., Zhang, W., Yuan, L., Chen, D., Wen, F., & Yu, N. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20056-4_15 · Cited by 67
Future Transformer for Long-term Action Anticipation
Gong, D., Lee, J., Kim, M., Ha, S. J., & Cho, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00306 · Cited by 67
GateHUB: Gated History Unit with Background Suppression for Online Action Detection
Chen, J., Mittal, G. K., Yu, Y., Kong, Y., & Chen, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01930 · Cited by 72
Metadata
- Authors
- Carreira, J., & Zisserman, A.
- Affiliations
- University of Oxford (GB)
- ORCID
- Zisserman, Andrew
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 4724-4733
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2619082050
- Cited by
- 9,570
- References
- 38
- Citations by year
- 2026: 702 · 2025: 1227 · 2024: 1428 · 2023: 1500 · 2022: 1315 · 2021: 1414 · 2020: 994 · 2019: 697 · 2018: 274 · 2017: 16
- FWCI
- 158.44
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- human action recognition, I3D, dual-stream architecture, spatiotemporal feature extraction, pre-training, video classification, UCF101, HMDB51, YouTube videos
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review