The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Is Space-Time Attention All You Need for Video Understanding?
Open accessAbstract
We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that "divided attention," where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vision Transformer (ViT) [17], and video-specific variants such as TimeSformer [ 18, 19 ] and Video Swin Transformer [20] capture longrange dependencies and global spatiotemporal context that CNNs often miss.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar to previous trials [3, 6], training video transformers from scratch yields unsatisfied results on video datasets.”
From VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (2022) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“For this reason, due to real-time computation concerns in visual odometry applications, we selected the encoder architecture with the 'divided space-time' self-attention, which is more efficient in terms of processing complexity compared to the 'joint space-time' self-attention.”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“We chose the TimeSformer [14] model for this work since it achieved state-of-the-art results in video action recognition tasks compared to previous works based on convolutional neural networks (CNN).”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Research works printed but not linked: 5
- Ba, L. J., Kiros, J. R., and Hinton, G. E. Layer normalization. CoRR, 2016.
- Chen, M. X., Firat, O., Bapna, A., Johnson, M., Macherey, W., Foster, G., Jones, L., Schuster, M., Shazeer, N., Par- mar, N., Vaswani, A., Uszkoreit, J., Kaiser, L., Chen, Z., Wu, Y., and Hughes, M. The best of both worlds: Combining recent advances in neural machine translation. In Proceedings of the 56th Annual Meeting of the Asso- ciation for Computational Linguistics. Association for Computational Linguistics, 2018a.
- Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. Aˆ2- nets: Double attention networks. In Advances in Neural Information Processing Systems 31, 2018b.
- International Conference on Computer Vision (ICCV), October 2019.
- Cordonnier, J., Loukas, A., and Jaggi, M. On the relation- ship between self-attention and convolutional layers. In 8th International Conference on Learning Representa- tions, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020.
Cited by
Sorted by citations
Items 701–800 of 1,004
A Light Touch Approach to Teaching Transformers Multi-view Geometry
Bhalgat, Y. S., Henriques, J. F., & Zisserman, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00480 · Cited by 8
Segmenting medical images via explicit–implicit attention aggregation
Zhan, B., Song, E., Liu, H., Xu, X., Li, W., & Hung, C. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110932 · Cited by 8
Semantic Video Transformer for Robust Action Recognition
Doshi, K., & Yılmaz, Y. (2023) · IEEE Conference on Dependable and Secure Computing (DSC) · doi:10.1109/dsc61021.2023.10354225 · Cited by 8
Yeganeh, Y., Farshad, A., Weinberger, P., Ahmadi, S., Adeli, E., & Navab, N. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00244 · Cited by 9
ConditionVideo: Training-Free Condition-Guided Video Generation
Peng, B., Chen, X., Wang, Y., Lu, C., & Qiao, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28244 · Cited by 15
Video Is Graph: Structured Graph Module for Video Action RecognitionPreprint
Li, R.-C., Wu, X., & Xu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.05904 · Cited by 8
Video-Text Pre-training with Learned RegionsPreprint
Yan, R., Shou, M. Z., Ge, Y., Wang, A. J., Lin, X., Cai, G., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01194 · Cited by 8
Foundation Models for Video Understanding: A SurveyPreprint
Madan, N., Møgelmose, A., Modi, R., Rawat, Y. S., & Moeslund, T. B. (2024) · doi:10.36227/techrxiv.171769139.99464428/v2 · Cited by 11
A framework for detecting fighting behavior based on key points of human skeletal posture
Zhang, P., Zhao, X., Dong, L., Lei, W., Zhang, W., & Lin, Z. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104123 · Cited by 7
VidLA: Video-Language Alignment at Scale
Rizve, M. N., Fei, F., Unnikrishnan, J., Tran, S., Yao, B., Zeng, B., Shah, M., & Chilimbi, T. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01332 · Cited by 7
Robust Motion-Guided Frame Sampler With Interpretive Evaluation for Video Action Recognition
Bai, J., Zhang, Y., Wang, Y., Xiao, Z. Q., Xiong, Y., & Jiao, L. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3541580 · Cited by 8
Zhou, S., Wang, H., Wu, Q., Meng, F., Xu, L., Wei, Z., & Li, H. (2025) · Displays · doi:10.1016/j.displa.2025.102992 · Cited by 7
Self-citationShadowMaskFormer: Mask Augmented Patch Embedding for Shadow Removal
Li, Z., Xie, G., Jiang, G., & Lu, Z. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3554605 · Cited by 7
Wu, J., Yang, Q., Xiao, D., Wu, M., Chen, Z., & Hong, Q. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110521 · Cited by 7
Pianforini, M., Dazzi, S., Pilzer, A., & Vacondio, R. (2025) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2025.106599 · Cited by 7
Basket: A Large-Scale Video Dataset for Fine-Grained Skill Estimation
Pan, Y., Zhang, C., & Bertasius, G. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02696 · Cited by 7
Self-citationInt.2D-3D-CNN: Integrated 2D and 3D Convolutional Neural Networks for Video Violence Recognition
Getsopon, W., Phiphitphatphaisit, S., Okafor, E., & Surinta, O. (2025) · Mathematics · doi:10.3390/math13162665 · Cited by 7
Multi-Frame Attention with Feature-Level Warping for Drone Crowd Tracking
Asanomi, T., Nishimura, K., & Bise, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00171 · Cited by 7
Panel-Page-Aware Comic Genre Understanding
Xu, C., Xu, X., Zhao, N., Cai, W., Zhang, H., Li, C., & Liu, X. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3270105 · Cited by 8
Liu, F., Tian, C., Wang, J., Jin, Y., Luxiang, C., & Lee, I. (2023) · Mathematics · doi:10.3390/math11143074 · Cited by 7
Breast Lesion Diagnosis Using Static Images and Dynamic Video
Huang, Y., Hu, H., Zhu, Y., & Xu, Y. (2023) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi53787.2023.10230620 · Cited by 7
Hiformer: Sequence Modeling Networks With Hierarchical Attention Mechanisms
Wu, X., Lu, H., Li, K., Wu, Z., Liu, X., & Meng, H. M. L. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3313428 · Cited by 9
MSBA-Net: Multiscale Behavior Analysis Network for Random Hand Gesture Authentication
Xie, H., Song, W., & Kang, W. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3318718 · Cited by 7
Genre Effect Toward Developing a Multi-Modal Movie Recommendation System in Indian Setting
Mondal, P., Kapoor, P., Singh, S., Saha, S., Singh, J. P., & Singh, A. K. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3324009 · Cited by 7
Zhang, Z., Tan, A., Lin, L., Wang, J., Gao, S., & Zhao, H. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3344144 · Cited by 7
Confusion Mixup Regularized Multimodal Fusion Network for Continual Egocentric Activity Recognition
Wang, H., Zhou, S., Wu, Q., Li, H., Meng, F., Xu, L., & Qiu, H. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00382 · Cited by 7
Self-citationHaltingVT: Adaptive Token Halting Transformer for Efficient Video Recognition
Wu, Q., Cui, R., Li, Y., & Zhu, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447548 · Cited by 7
Automated Sperm Assessment Framework and Neural Network Specialized for Sperm Video Recognition
Fujii, T., Nakagawa, H., Takeshima, T., Yumura, Y., & Hamagami, T. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00750 · Cited by 9
RESTHT: relation-enhanced spatial–temporal hierarchical transformer for video captioning
Zheng, L., Xu, W., Miao, Z., Qiu, X., & Gong, S. (2024) · The Visual Computer · doi:10.1007/s00371-024-03350-1 · Cited by 7
Multimodal Abnormal Event Detection in Public Transportation
Tsiktsiris, D., Lalas, A. X., Dasygenis, M., & Votis, K. (2024) · IEEE Access · doi:10.1109/access.2024.3425308 · Cited by 12
TSSAN: Time-Space Separable Attention Network for Intrusion Detection
Xu, R., Zhang, Q., & Zhang, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3429420 · Cited by 7
Illumination Variation-Resistant Network for Heart Rate Measurement by Exploring RGB and MSR Spaces
Liu, L., Xia, Z., Zhang, X., Feng, X., & Zhao, G. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3432140 · Cited by 7
Global Spatial-Temporal Information Encoder-Decoder Based Action Segmentation in Untrimmed Video
Liu, Y., Sun, Y., Chen, Z., Feng, C., & Zhu, K. (2024) · Tsinghua Science & Technology · doi:10.26599/tst.2024.9010041 · Cited by 7
Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
Zhang, Y., Ding, X., Gong, K., Ge, Y., Shan, Y., & Yue, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00584 · Cited by 12
Kung, C.-H., Lu, S.-W., Tsai, Y., & Chen, Y.-T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01746 · Cited by 9
LI3D-BiLSTM: A Lightweight Inception-3D Networks with BiLSTM for Video Action Recognition
Wang, F., Jin, X., & Yi, S. (2024) · ICCK Transactions on Emerging Topics in Artificial Intelligence · doi:10.62762/tetai.2024.628205 · Cited by 7
VC-Mamba: Causal Mamba representation consistency for video implicit understanding
Hu, Y., Zhao, J., Qi, C., Qiang, Y., Zhao, J., & Pei, B. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113437 · Cited by 7
Panacea+: Panoramic and Controllable Video Generation for Autonomous Driving
Wen, Y., Zhao, Y., Liu, Y., Huang, B., Jia, F., Wang, Y., Zhang, C., Wang, T., Sun, X., & Zhang, X. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3601553 · Cited by 7
Rethinking the Impacts of Overfitting and Feature Quality on Small-scale Video Classification
Wu, X., Yang, F., Zhou, T., & Lin, X. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3479226 · Cited by 8
Performance Evaluation of Action Recognition Models on Low Quality Videos
Otani, A., Hashiguchi, R., Omi, K., Fukushima, N., & Tamaki, T. (2022) · IEEE Access · doi:10.1109/access.2022.3204755 · Cited by 9
Spatiotemporal Feature Enhancement Aids the Driving Intention Inference of Intelligent Vehicles
Chen, H., Chen, H., Liu, H., & Feng, X. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191811819 · Cited by 7
Video Human Action Recognition Algorithm Based on Double Branch 3D-CNN
Wang, Y., & Sun, J. (2022) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei56279.2022.9979858 · Cited by 8
Broomé, S., Pokropek, E., Li, B., & Kjellström, H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00418 · Cited by 8
Self-supervised Video-centralised Transformer for Video Face Clustering
Wang, Y., Dong, M., Shen, J., Luo, Y., Lin, Y., Ma, P., Petridis, S., & Pantić, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3243812 · Cited by 8
3D-CSL: Self-Supervised 3D Context Similarity Learning for Near-Duplicate Video Retrieval
Deng, R., Wu, Q., & Li, Y. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222915 · Cited by 7
3M3D: Multi-View, Multi-Path, Multi-Representation for 3D Object Detection
Park, J., Singh, A., & Bankiti, V. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222769 · Cited by 7
Temporal shuffling for defending deep action recognition models against adversarial attacks
Hwang, J., Zhang, H., Choi, J. H., Hsieh, C., & Lee, J. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.10.033 · Cited by 7
Toward Privacy-Supporting Fall Detection via Deep Unsupervised RGB2Depth Adaptation
Xiao, H., Peng, K., Huang, X., Roitberg, A., Li, H., Wang, Z., & Stiefelhagen, R. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3322479 · Cited by 8
Towards Training Stronger Video Vision Transformers for EPIC-KITCHENS-100 Action RecognitionPreprint
Huang, Z., Qing, Z., Xiang, W., Feng, Y., Zhang, S., Jiang, J., Xia, Z., Tang, M., Sang, N., & Ang, M. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05058 · Cited by 7
Cross-dataset video deepfake detection using Transformer and CNN architectures
Petmezas, G. (2026) · Machine Vision and Applications · doi:10.1007/s00138-026-01809-w · Cited by 6
From Detection to Action Recognition: An Edge-Based Pipeline for Robot Human Perception
Toupas, P., Tsamis, G., Giakoumis, D., Votis, K., & Tzovaras, D. K. (2023) · International Conference on Control and Robotics (ICCR) · doi:10.1109/iccr60000.2023.10444804 · Cited by 6
Event-driven weakly supervised video anomaly detection
Sun, S., & Gong, X. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105169 · Cited by 6
Background debiased class incremental learning for video action recognition
Nguyen, L. Q., Choi, J., Dang, L. M., & Moon, H. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105295 · Cited by 7
Chowdhury, A. M., Imran, A., Hasan, M. M., Ahmed, R., Azad, A., & Alyami, S. A. (2024) · IEEE Access · doi:10.1109/access.2024.3516586 · Cited by 6
SQL-Net: Semantic Query Learning for Point-Supervised Temporal Action Localization
Wang, Y., Zhao, S., & Chen, S. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521799 · Cited by 6
Pose-Guided Transformer for Fine-Grained Action Quality Assessment
Zhang, Y., Li, X., Chai, W., Yan, C., Wang, W., & Wang, G. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3545625 · Cited by 6
Xu, X., Wu, T., Du, Z., Rong, H., Wang, S., Li, S., & Chen, D. (2025) · PLoS ONE · doi:10.1371/journal.pone.0318578 · Cited by 6
Zhang, R., Yang, Z., Dai, T., Sun, D., Ma, S., & Zhao, X. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3566502 · Cited by 6
Towards Student Actions in Classroom Scenes: New Dataset and Baseline
Tan, Z., Gao, C., Qin, A., Chen, R., Song, T., Yang, F., & Meng, D. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3590899 · Cited by 6
KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception
Qu, Y., Yuan, K., Xie, Q., Sun, M. Y., Zhou, C., & Wang, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00206 · Cited by 8
Yang, C., Dong, X., Zhu, X., Su, W., Wang, J., Tian, H., Chen, Z., Wang, W., Lu, L., & Dai, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02322 · Cited by 16
Dual-flow network with attention for autonomous driving
Yang, L., Lei, W., Zhang, W., & Ye, T. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.978225 · Cited by 7
Indoor Violence Detection using Lightweight Transformer Model
Kumar, A., Shetty, A., Sagar, A., Charushree, A., & Kanwal, P. (2023) · International Conference for Emerging Technology (INCET) · doi:10.1109/incet57972.2023.10170251 · Cited by 6
Harnessing optical flow in deep learning framework for cardiopulmonary resuscitation training
Ko, S., Lee, Y., Choi, M., Choi, D., Lee, C. A., & Hou, J. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121775 · Cited by 6
Leveraging spatial residual attention and temporal Markov networks for video action understanding
Xu, Y., Wang, Z., & Zhang, X.-P. S. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.10.047 · Cited by 6
Yang, J. B., Liu, K., Zhao, M., & Li, S. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107804 · Cited by 6
End-to-End Video Captioning Based on Multiview Semantic Alignment for Human–Machine Fusion
Wu, S., Gao, Y., Yang, W., Li, H., & Zhu, G. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3352903 · Cited by 6
He, B., Yu, N., Wang, Z., & Chen, X. (2024) · Applied Sciences · doi:10.3390/app14062460 · Cited by 6
P-Age: Pexels Dataset for Robust Spatio-Temporal Apparent Age Classification
Ali, A., Marisetty, A., & Brémond, F. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00841 · Cited by 6
Di, J., Hu, Z., Bi, S., Zhang, H., Wang, Y., & Sun, Z. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105058 · Cited by 6
A Global Pose and Relative Pose Fusion Network for Monocular Visual Odometry
Su, B., & Zang, T. (2024) · IEEE Access · doi:10.1109/access.2024.3439529 · Cited by 6
Spatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoring
Telegraph, K., & Kyrkou, C. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3454566 · Cited by 10
Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training
Reddy, A., Paul, W., Rivera, C. G., Shah, K., de Melo, C. M., & Chellappa, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01790 · Cited by 9
Dancing with Still Images: Video Distillation via Static-Dynamic Disentanglement
Wang, Z., Yue, X., Lu, C., & Li, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00602 · Cited by 6
Visual-guided hierarchical iterative fusion for multi-modal video action recognition
Zhang, B., Zhang, Y., Zhang, J., Sun, Q., Wang, R., & Zhang, Q. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.10.003 · Cited by 6
HCMT: A Novel Hierarchical Cross-Modal Transformer for Recognition of Abnormal Behavior
Liu, H. L., Khairuddin, A. S. M., Chuah, J. H., Zhao, X. M., Wang, X. D., & Fang, L. (2024) · IEEE Access · doi:10.1109/access.2024.3483896 · Cited by 6
Transformer-Enhanced CNN Based on Intensive Feature for Hyperspectral Unmixing
Ge, Y., Han, L., Paoletti, M. E., Haut, J. M., & Qu, G. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3485899 · Cited by 6
Yang, X., Wu, J., Wang, X., Yuan, Y., Li, J., Chen, G., Wang, N. L., & Heng, P. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3523298 · Cited by 6
CycleCrash: A Dataset of Bicycle Collision Videos for Collision Prediction and Analysis
Desai, N. P., Etemad, A., & Greenspan, M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00651 · Cited by 6
UMD-Net: A Unified Multi-Task Assistive Driving Network Based on Multimodal Fusion
Liu, W., Qiao, Y., Li, Z., Wang, W., Zhang, W., Zhu, J., Jiang, Y., Wang, L., Wang, H., Liu, H., et al. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3556852 · Cited by 6
Self-citationAbnormal-region-aware Multi-modal Feature Fusion for medical report generation
Gao, Y., Ni, Z., Liu, W., Ni, L., Xin, L., Hu, L., & Zhang, L. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113538 · Cited by 6
Current Advances on Deep Learning-based Human Action Recognition from Videos: a Survey
Zhang, Y., Li, B., Fang, H., & Meng, Q. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00054 · Cited by 8
Multi-Level Visual Representation with Semantic-Reinforced Learning for Video Captioning
Dong, C., Chen, X., Chen, A., Hu, F., Wang, Z., & Li, X. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3479217 · Cited by 6
Hand-Object Interaction Reasoning
Ma, J., & Damen, D. (2022) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss56176.2022.9959207 · Cited by 8
VIDI: A Video Dataset of Incidents
Sesver, D., Gencoglu, A. E., Yildiz, C. E., Gunindi, Z., Habibi, F., Yazıcı, Z. A., & Ekenel, H. K. (2022) · Multidimensional Signal Processing Workshop · doi:10.1109/ivmsp54334.2022.9816319 · Cited by 8
Lin, X., Xu, L., Zhuang, S., & Wang, Q. (2022) · Electronics · doi:10.3390/electronics12010117 · Cited by 6
Predicting Human-Object Interactions in Egocentric Videos
Benavent-Lledó, M., Oprea, S., Castro-Vargas, J. A., Mulero-Pérez, D., & García‐Rodríguez, J. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892910 · Cited by 6
Pooling Transformer for Detection of Risk Events in In-The-Wild Video Ego Data
Mallick, R., Benois‐Pineau, J., Zemmari, A., Yebda, T., Pech, M., Amieva, H., & Middleton, L. E. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956675 · Cited by 6
An automatic whole-slide hyperspectral imaging microscope
Tran, M. T., Gomez, O., & Fei, B. (2023) · Label-free Biomedical Imaging and Sensing (LBIS) · doi:10.1117/12.2650815 · Cited by 6
Confidence-Based Event-Centric Online Video Question Answering on a Newly Constructed ATBS Dataset
Kong, W., Ye, S., Yao, C., & Ren, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095044 · Cited by 6
IAFormer: A Transformer Network for Image Aesthetic Evaluation and Cropping
Wang, L., & Jin, Y. (2022) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait56212.2022.10137804 · Cited by 6
MultiPar-T: Multiparty-Transformer for Capturing Contingent Behaviors in Group Conversations
Lee, D. W., Kim, Y., Picard, R. W., Breazeal, C., & Park, H. W. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/433 · Cited by 6
VARSew: A Literature Review and Benchmark Dataset for Visual Recognition in Garment Sewing
Fathy, A. E., Hamdi, A., Asad, A. H., & Mohammed, A. (2023) · Intelligent Methods, Systems, and Applications (IMSA) · doi:10.1109/imsa58542.2023.10217703 · Cited by 6
Tasoren, A. E., & Çelikcan, U. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.10.011 · Cited by 6
JIST: Joint Image and Sequence Training for Sequential Visual Place Recognition
Berton, G., Trivigno, G., Barbara Caputo, B., & Masone, C. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3339058 · Cited by 6
ENTL: Embodied Navigation Trajectory Learner
Kotar, K., Walsman, A., & Mottaghi, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00997 · Cited by 8
Augmenting and Aligning Snippets for Few-Shot Video Domain Adaptation
Xu, Y., Yang, J., Zhou, Y., Chen, Z., Wu, M., & Li, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01237 · Cited by 6
The Visual Saliency Transformer Goes Temporal: TempVST for Video Saliency Prediction
Lazaridis, N., Georgiadis, K., Kalaganis, F. P., Kordopatis-Zilos, G., Papadopoulos, S., Nikolopoulos, S., & Kompatsiaris, I. Y. (2024) · IEEE Access · doi:10.1109/access.2024.3436585 · Cited by 6
SWAT: Spatial Structure Within and Among Tokens
Kahatapitiya, K., & Ryoo, M. S. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/106 · Cited by 10
What Matters for Ad-hoc Video Search? A Large-scale Evaluation on TRECVID
Chen, A., Hu, F., Wang, Z., Zhou, F., & Li, X. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00262 · Cited by 6
Metadata
- Authors
- Bertasius, G., Wang, H., & Torresani, L.
- Affiliations
- University of Pennsylvania (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 813-824
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.05095
- OpenAlex
- W3126721948
- Cited by
- 1,663
- References
- 58
- Citations by year
- 2026: 161 · 2025: 390 · 2024: 418 · 2023: 387 · 2022: 199 · 2021: 108
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- video classification, self-attention, spatio-temporal attention, TimeSformer, transformer models, divided attention, human action recognition, 3D convolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
