The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Is Space-Time Attention All You Need for Video Understanding?
Open accessAbstract
We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that "divided attention," where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vision Transformer (ViT) [17], and video-specific variants such as TimeSformer [ 18, 19 ] and Video Swin Transformer [20] capture longrange dependencies and global spatiotemporal context that CNNs often miss.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar to previous trials [3, 6], training video transformers from scratch yields unsatisfied results on video datasets.”
From VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (2022) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“For this reason, due to real-time computation concerns in visual odometry applications, we selected the encoder architecture with the 'divided space-time' self-attention, which is more efficient in terms of processing complexity compared to the 'joint space-time' self-attention.”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“We chose the TimeSformer [14] model for this work since it achieved state-of-the-art results in video action recognition tasks compared to previous works based on convolutional neural networks (CNN).”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Research works printed but not linked: 5
- Ba, L. J., Kiros, J. R., and Hinton, G. E. Layer normalization. CoRR, 2016.
- Chen, M. X., Firat, O., Bapna, A., Johnson, M., Macherey, W., Foster, G., Jones, L., Schuster, M., Shazeer, N., Par- mar, N., Vaswani, A., Uszkoreit, J., Kaiser, L., Chen, Z., Wu, Y., and Hughes, M. The best of both worlds: Combining recent advances in neural machine translation. In Proceedings of the 56th Annual Meeting of the Asso- ciation for Computational Linguistics. Association for Computational Linguistics, 2018a.
- Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. Aˆ2- nets: Double attention networks. In Advances in Neural Information Processing Systems 31, 2018b.
- International Conference on Computer Vision (ICCV), October 2019.
- Cordonnier, J., Loukas, A., and Jaggi, M. On the relation- ship between self-attention and convolutional layers. In 8th International Conference on Learning Representa- tions, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020.
Cited by
Sorted by citations
Items 501–600 of 1,004
Autoregressive transformers for data-driven spatiotemporal learning of turbulent flows
Patil, A., Viquerat, J., & Hachem, E. (2023) · APL Machine Learning · doi:10.1063/5.0152212 · Cited by 15
Semantic-Disentangled Transformer With Noun-Verb Embedding for Compositional Action Recognition
Huang, P. F., Yan, R., Shu, X., Tu, Z., Dai, G., & Tang, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3341297 · Cited by 15
Knowledge-guided pre-training and fine-tuning: Video representation learning for action recognition
Wang, G., Zhou, Y., He, Z., Lu, K., Feng, Y., Liu, Z., & Wang, G. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127136 · Cited by 15
SATCount: A scale-aware transformer-based class-agnostic counting framework
Wang, Y., Yang, B., Wang, X., Liang, C., & Chen, J. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106126 · Cited by 15
Kim, D.-W., Park, J. E., Kim, M., Byun, S. H., Jung, C. I., Jeong, H. M., Woo, S. R., Lee, K. H., Lee, M. H., Jung, J.-W., et al. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3358497 · Cited by 16
Yu, T., Fu, K., Zhang, J., Huang, Q., & Yu, J. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3390984 · Cited by 19
Asymmetric Masked Distillation for Pre-Training Small Foundation Models
Zhao, Z., Huang, B., Xing, S., Wu, G., Qiao, Y., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01752 · Cited by 17
EIKA: Explicit & Implicit Knowledge-Augmented Network for entity-aware sports video captioning
Xi, Z., Shi, G., Sun, H., Zhang, B., Li, S., & Wu, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126906 · Cited by 16
Multi-modal Semantic Inconsistency Detection in Social Media News Posts
McCrae, S., Wang, K., & Zakhor, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98355-0_28 · Cited by 17
ViGAT: Bottom-Up Event Recognition and Explanation in Video Using Factorized Graph Attention Network
Gkalelis, N., Daskalakis, D., & Mezaris, V. (2022) · IEEE Access · doi:10.1109/access.2022.3213652 · Cited by 15
Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
Sun, G., Khalid, U., Mendieta, M., Wang, P., & Chen, C. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825712 · Cited by 18
Analogous to Evolutionary Algorithm: Designing a Unified Sequence ModelPreprint
Zhang, J., Xu, C., Li, J., Chen, W., Wang, Y., Tai, Y. Y., Chen, S., Wang, C., Huang, F., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.15089 · Cited by 15
GPT4Ego: Unleashing the Potential of Pre-Trained Models for Zero-Shot Egocentric Action Recognition
Dai, G., Shu, X., Wu, W., Yan, R., & Zhang, J. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521658 · Cited by 22
MT-CMVAD: A Multi-Modal Transformer Framework for Cross-Modal Video Anomaly Detection
Ding, H., Lou, S., Ye, H., & Chen, Y. (2025) · Applied Sciences · doi:10.3390/app15126773 · Cited by 14
Deep Video Networks for Automatic Assessment of Aortic Stenosis in Echocardiography
Ginsberg, T., Tal, R.-E., Tsang, M. Y. C., MacDonald, C. A., Dezaki, F. T., van der Kuur, J., Luong, C. L., Abolmaesumi, P., & Tsang, T. S. M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87583-1_20 · Cited by 14
Open-World Learning for Traffic Scenarios Categorisation
Balasubramanian, L., Wurst, J., Botsch, M., & Deng, K. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3260270 · Cited by 14
Campus Abnormal Behavior Recognition With Temporal Segment Transformers
Liu, H. L., Chuah, J. H., Khairuddin, A. S. M., Zhao, X. M., & Wang, X. D. (2023) · IEEE Access · doi:10.1109/access.2023.3266440 · Cited by 14
Li, R., & Bhanu, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3288565 · Cited by 15
A Two-Stage Modality Fusion Approach for Recognizing Human Actions
Zheng, H. M., Zhang, B., Lin, J., Zhao, D., & Shang, G. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3316137 · Cited by 14
Towards Transferable Adversarial Attacks on Image and Video Transformers
Wei, Z., Chen, J., Goldblum, M., Wu, Z., Goldstein, T., Jiang, Y., & Davis, L. S. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3331582 · Cited by 15
Yang, M., Chengke, W., Guo, Y., He, Y. Z., Jiang, R., Jiang, J., & Yang, Z. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102294 · Cited by 14
Appearance-Agnostic Representation Learning for Compositional Action Recognition
Huang, P. F., Shu, X., Yan, R., Tu, Z., & Tang, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3384392 · Cited by 14
Spatiotemporal Meteorological Prediction Based on Fully Convolutional Neural Network
Zhang, J., Wang, B., Hua, M., Chen, Z., Liang, S., & Kang, X. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3439390 · Cited by 14
Li, M., Gong, W., Yan, P., Li, X., Jiang, Y., Luo, H., Zhou, H., & Yin, S. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3452497 · Cited by 15
Mukhtar, H., & Mukhtar, U. R. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112540 · Cited by 15
Multi-Scale Spatial-Temporal Transformer for Meteorological Variable Forecasting
Li, T.-B., Su, Y.-T., Song, D., Li, W., Wei, Z., & Liu, A.-A. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3487965 · Cited by 16
Selective state models are what you need for animal action recognition
Fazzari, E., Romano, D., Falchi, F., & Stefanini, C. (2024) · Ecological Informatics · doi:10.1016/j.ecoinf.2024.102955 · Cited by 14
Ahmed, M., Zhang, X., Shen, Y., Ahmed, T., Ali, S., Ali, A., Gulakhmadov, A., Nam, W., & Chen, N. (2025) · Environment International · doi:10.1016/j.envint.2025.109496 · Cited by 14
Tang, L.-Z., Wang, X., Yang, J., Wang, Y., Qu, M., & Li, H. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107882 · Cited by 14
Integrating multimodal data and machine learning for entrepreneurship research
Shrestha, Y. R., & He, V. F. (2025) · Strategic Entrepreneurship Journal · doi:10.1002/sej.1546 · Cited by 15
Rayzer: a Self-Supervised Large View Synthesis Model
Jiang, H., Tan, H., Wang, P., Jin, H., Zhao, Y., Bi, S., Zhang, K., Luan, F., Sunkavalli, K., Huang, Q., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00468 · Cited by 50
Multi-Modal Pre-Training for Automated Speech Recognition
Chan, D. M., Ghosh, S., Chakrabarty, D., & Hoffmeister, B. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746449 · Cited by 13
MedViTGAN: End-to-End Conditional GAN for Histopathology Image Augmentation with Vision Transformers
Li, M., Li, C., Hobson, P., Jennings, T., & Lovell, B. C. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956431 · Cited by 13
Multimodal Vision Transformers with Forced Attention for Behavior Analysis
Agrawal, T., Balazia, M., Müller, P., & Brémond, F. (2022) · IEEE Workshop/Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00339 · Cited by 15
TwinFormer: Fine-to-Coarse Temporal Modeling for Long-Term Action Recognition
Zhou, J., Lin, K.-Y., Qiu, Y.-K., & Zheng, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3302471 · Cited by 13
Animation2API: API Recommendation for the Implementation of Android UI Animations
Wang, Y., Liu, H., Gao, S., & Tang, X. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3294971 · Cited by 13
Therbligs in Action: Video Understanding through Motion Primitives
Dessalene, E., Maynord, M., Fermuller, C. M., & Aloimonos, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01023 · Cited by 14
Tracking Through Containers and Occluders in the Wild
Hoorick, B. V., Tokmakov, P., Stent, S., Li, J., & Vondrick, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01326 · Cited by 14
Zhang, W., Wang, J., Tang, M., Ma, H., Wang, L., Zhang, Q., & Fan, S. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3314071 · Cited by 14
Learning Sequence Descriptor Based on Spatio-Temporal Attention for Visual Place Recognition
Zhao, J., Feng-lin, Z., Cai, Y., Tian, G., Mu, W., Ye, C., & Feng, T. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3354627 · Cited by 17
Yang, H., Chang, J., He, W., Wee, C. F., Soong, J. T. Y., & Feng, M. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3430226 · Cited by 14
FlowTrack: Revisiting Optical Flow for Long-Range Dense Tracking
Cho, S., Huang, J., Kim, S., & Lee, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01823 · Cited by 13
OST: Refining Text Knowledge with Optimal Spatio-Temporal Descriptor for General Video Recognition
Chen, T., Yu, H., Yang, Z., Li, Z., Sun, W., & Chen, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01787 · Cited by 15
Medium Scale Benchmark for Cricket Excited Actions Understanding
Hussain, A., Khan, N., Munsif, M., Kim, M. J., & Baik, S. W. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00344 · Cited by 13
ViTA: An Efficient Video-to-Text Algorithm using VLM for RAG-based Video Analysis System
Arefeen, M. A., Debnath, B. K., Uddin, M. Y. S., & Chakradhar, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00232 · Cited by 15
Wang, F., & Yi, S. (2024) · ICCK Transactions on Sensing Communication and Control · doi:10.62762/tscc.2024.212751 · Cited by 13
Wang, Z., Liu, C., Zhu, L., Wang, T., Zhang, S., & Dou, Q. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3532311 · Cited by 16
ScVLM: Enhancing Vision-Language Model for Safety-Critical Event Understanding
Shi, L., Jiang, B., Zeng, T., & Guo, F. (2025) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00119 · Cited by 16
Learning Video Representations of Human Motion from Synthetic Data
Guo, X. W., Wu, W., Wang, D., Su, J., Su, H., Gan, W., Huang, J., & Yang, Q. L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01956 · Cited by 13
Unsupervised Domain Adaptation for Video Transformers in Action Recognition
da Costa, V. G. T., Zara, G., Rota, P., Oliveira-Santos, T., Sebe, N., Murino, V., & Ricci, E. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956679 · Cited by 16
Video Event Extraction via Tracking Visual States of Arguments
Yang, G., Li, M., Zhang, J., Lin, X., Ji, H., & Chang, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25418 · Cited by 14
Egocentric Video Task Translation
Xue, Z., Song, Y., Grauman, K. L., & Torresani, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00229 · Cited by 15
Self-citationMulti-Attention Transformer for Naturalistic Driving Action Recognition
Dong, X., Zhao, R., Sun, H., Wu, D., Wang, J., Zhou, X., Liu, J., Cui, S., & He, Z. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00574 · Cited by 11
Mind captioning: Evolving descriptive text of mental content from human brain activity
Horikawa, T. (2025) · Science Advances · doi:10.1126/sciadv.adw1464 · Cited by 13
A Transformer-based Late-Fusion Mechanism for Fine-Grained Object Recognition in Videos
Koch, J., Wolf, S., & Beyerer, J. (2023) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw58289.2023.00015 · Cited by 12
LCDeT: LiDAR Curb Detection Network with Transformer
Gao, J., Jie, H., Xu, B., Liu, L., da Hu, J., & Liu, W. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191580 · Cited by 12
LiteVL: Efficient Video-Language Learning with Enhanced Spatial-Temporal Modeling
Chen, D., Tao, C., Hou, L., Shang, L., Jiang, X., & Liu, Q. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.545 · Cited by 18
Movies2Scenes: Using Movie Metadata to Learn Scene Representation
Chen, S., Liu, C.-H., Hao, X., Nie, X., Arap, M., & Hamid, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00632 · Cited by 16
Privacy-Preserving Video Understanding via Transformer-based Federated Learning
Doshi, K., & Yılmaz, Y. (2023) · IEEE Conference on Dependable and Secure Computing (DSC) · doi:10.1109/dsc61021.2023.10354099 · Cited by 15
Liu, W., & Pan, Y. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3361480 · Cited by 12
Multi-Task Learning of Object States and State-Modifying Actions From Web Videos
Souček, T., Alayrac, J.-B., Miech, A., Laptev, I., & Šivic, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3362288 · Cited by 17
Temporal Shift Module-Based Vision Transformer Network for Action Recognition
Zhang, K., Lyu, M., Guo, X., Zhang, L., & Liu, C. (2024) · IEEE Access · doi:10.1109/access.2024.3379885 · Cited by 13
PGVT: Pose-Guided Video Transformer for Fine-Grained Action Recognition
Zhang, H., Leong, M. C., Li, L., & Lin, W. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00651 · Cited by 13
Jiang, Y., Wang, J., Guan, X., & Dai, K. (2024) · Engineering Structures · doi:10.1016/j.engstruct.2024.118034 · Cited by 12
Efficient Cross-Modal Video Retrieval With Meta-Optimized Frames
Han, N., Yang, X., Lim, E., Chen, H., & Sun, Q. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3416669 · Cited by 13
Generative AI Beyond LLMs: System Implications of Multi-Modal Generation
Golden, A., Hsia, S., Sun, F., Acun, B., Hosmer, B., Lee, Y., DeVito, Z., Johnson, J., Wei, G.-Y., Brooks, D., et al. (2024) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass61541.2024.00032 · Cited by 18
Yao, C., Ren, J., Bai, R., Du, H., Liu, J., & Jiang, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124824 · Cited by 12
SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videos
Wu, T., He, R., Wu, G., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01754 · Cited by 14
Uni-AdaFocus: Spatial-Temporal Dynamic Computation for Video Recognition
Wang, Y., Zhang, H., Yue, Y., Song, S., Deng, C., Feng, J., & Huang, G. M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3514654 · Cited by 19
Manet: motion-aware network for video action recognition
Li, X., Wenzhu, Y., Wang, K., Wang, T., & Zhang, C. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01774-9 · Cited by 12
Vision-Semantics-Label: A New Two-Step Paradigm for Action Recognition With Large Language Model
Chen, X., Xu, W., Kan, S., Zhang, L., Jin, Y., Cen, Y., & Li, Y. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3548845 · Cited by 12
SMC++: Masked Learning of Unsupervised Video Semantic Compression
Tian, Y., Ling, X., Geng, C., Hu, Q., Lu, G., & Zhai, G. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3625063 · Cited by 12
Online action proposal generation using spatio-temporal attention network
Keisham, K., Jalali, A., & Lee, M. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.06.032 · Cited by 13
Action Probability Calibration for Efficient Naturalistic Driving Action Localization
Li, R., Wu, C., Li, L., Shen, Z., Xu, T., Wu, X., Li, X., Lu, J., & Kittler, J. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00555 · Cited by 12
Hong, Y., Kim, M. J., Lee, I., & Yoo, S. B. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3307285 · Cited by 13
Scene adaptive mechanism for action recognition
Wu, C., Wu, X., Wu, X., & Kittler, J. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103854 · Cited by 13
Deng, A., Yang, T., & Chen, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01876 · Cited by 12
A wearable thumb device for fruit firmness estimation with vision-based tactile sensing
Mohsan, M. M., Hasanen, B., Hassan, T., Seneviratne, L. D., & Hussain, I. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110593 · Cited by 11
Learning to Estimate External Forces of Human Motion in Video
Louis, N., Corso, J. J., Templin, T. N., Eliason, T. D., & Nicolella, D. P. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548377 · Cited by 14
Self-Supervised Learning of Neural Speech Representations From Unlabeled Intracranial Signals
Lesaja, S., Stuart, M., Shih, J. J., Soroush, P. Z., Schultz, T., Manic, M., & Krusienski, D. J. (2022) · IEEE Access · doi:10.1109/access.2022.3230688 · Cited by 12
Qiu, Y., Nagasaki, Y., Hara, K., Kataoka, H., Suzuki, R., Iwata, K., & Satoh, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00335 · Cited by 11
DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusions
Fu, T., Wang, X., Yu, H., Niu, K., Li, B., & Xue, X. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611728 · Cited by 11
Wang, L., Kang, X., Ding, F., Nakagawa, S., & Ren, F. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446699 · Cited by 12
iRAG: Advancing RAG for Videos with an Incremental Approach
Arefeen, M. A., Debnath, B. K., Uddin, M. Y. S., & Chakradhar, S. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3680088 · Cited by 22
CoSTA: Co-training spatial–temporal attention for blind video quality assessment
Xing, F., Wang, Y., Tang, W., Zhu, G., & Kwong, S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124651 · Cited by 11
ConvTransformer Attention Network for temporal action detection
Cui, D., Chang, X., Wu, L., & Wang, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112264 · Cited by 11
Tran, M. H., Ma, L., Mubarak, H. K., Gomez, O., Yu, J., Bryarly, M. D., & Fei, B. (2024) · Journal of Biomedical Optics · doi:10.1117/1.jbo.29.9.093505 · Cited by 11
The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective
Jia, W., Liu, M., Jiang, H., Ananthabhotla, I., Rehg, J. M., Ithapu, V. K., & Gao, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02493 · Cited by 11
PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition
Zhang, H., Leong, M. C., Li, L., & Lin, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01784 · Cited by 11
Enhanced Motion-Text Alignment for Image-to-Video Transfer Learning
Zhang, W., Wan, C., Liu, T., Tian, X., Shen, X., & Ye, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01751 · Cited by 13
Hussain, A., Hussain, T., Ullah, W., Khan, S. U., Kim, M. J., Muhammad, K., Ser, J. D., & Baik, S. W. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3489414 · Cited by 11
Language-driven Grasp Detection with Mask-guided Attention
Vo, T. V., Vu, M. N., Huang, B., Vuong, A., Le, N., Vo, T., & Nguyen, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802256 · Cited by 11
Graph-Jigsaw Conditioned Diffusion Model for Skeleton-Based Video Anomaly Detection
Karami, A., Ho, T. K. K., & Armanfard, N. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00416 · Cited by 15
Attention mechanism based multimodal feature fusion network for human action recognition
Xu, Z., Tang, C., Hu, H., Wang, W., Qiao, S., & Tong, A. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104459 · Cited by 11
Dynamic Graph Attention Network for Skeleton-Based Action Recognition
Li, Z., Li, F., & Hua, G. (2025) · Applied Sciences · doi:10.3390/app15094929 · Cited by 11
Do Language Models Understand Time?
Xi, D., & Wang, L. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3717744 · Cited by 23
Ullah, W., Outay, F., Khan, L. U., & Guizani, M. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3596389 · Cited by 11
MetaVD: A Meta Video Dataset for enhancing human action recognition datasets
Yoshikawa, Y., Shigeto, Y., & Takeuchi, A. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103276 · Cited by 11
KE-RCNN: Unifying Knowledge-Based Reasoning Into Part-Level Attribute Parsing
Wang, X., Song, J., Chen, X., Cheng, L., Gao, L., & Shen, H. T. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3209653 · Cited by 11
Nguyen, C. H., Nguyen, N., Huynh, S., Nguyen, V., & Nguyen, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00367 · Cited by 6
Metadata
- Authors
- Bertasius, G., Wang, H., & Torresani, L.
- Affiliations
- University of Pennsylvania (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 813-824
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.05095
- OpenAlex
- W3126721948
- Cited by
- 1,663
- References
- 58
- Citations by year
- 2026: 161 · 2025: 390 · 2024: 418 · 2023: 387 · 2022: 199 · 2021: 108
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- video classification, self-attention, spatio-temporal attention, TimeSformer, transformer models, divided attention, human action recognition, 3D convolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
