The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Is Space-Time Attention All You Need for Video Understanding?
Open accessAbstract
We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that "divided attention," where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vision Transformer (ViT) [17], and video-specific variants such as TimeSformer [ 18, 19 ] and Video Swin Transformer [20] capture longrange dependencies and global spatiotemporal context that CNNs often miss.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar to previous trials [3, 6], training video transformers from scratch yields unsatisfied results on video datasets.”
From VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (2022) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“For this reason, due to real-time computation concerns in visual odometry applications, we selected the encoder architecture with the 'divided space-time' self-attention, which is more efficient in terms of processing complexity compared to the 'joint space-time' self-attention.”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“We chose the TimeSformer [14] model for this work since it achieved state-of-the-art results in video action recognition tasks compared to previous works based on convolutional neural networks (CNN).”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Research works printed but not linked: 5
- Ba, L. J., Kiros, J. R., and Hinton, G. E. Layer normalization. CoRR, 2016.
- Chen, M. X., Firat, O., Bapna, A., Johnson, M., Macherey, W., Foster, G., Jones, L., Schuster, M., Shazeer, N., Par- mar, N., Vaswani, A., Uszkoreit, J., Kaiser, L., Chen, Z., Wu, Y., and Hughes, M. The best of both worlds: Combining recent advances in neural machine translation. In Proceedings of the 56th Annual Meeting of the Asso- ciation for Computational Linguistics. Association for Computational Linguistics, 2018a.
- Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. Aˆ2- nets: Double attention networks. In Advances in Neural Information Processing Systems 31, 2018b.
- International Conference on Computer Vision (ICCV), October 2019.
- Cordonnier, J., Loukas, A., and Jaggi, M. On the relation- ship between self-attention and convolutional layers. In 8th International Conference on Learning Representa- tions, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020.
Cited by
Sorted by citations
Items 801–900 of 1,004
baller2vec++: A Look-Ahead Multi-Entity Transformer For Modeling Coordinated AgentsPreprint
Alcorn, M. A., & Nguyen, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.11980 · Cited by 6
Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-AttentionPreprint
Tzinis, E., Wisdom, S., Remez, T., & Hershey, J. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09669 · Cited by 6
An Image Classifier Can Suffice For Video Understanding.Preprint
Fan, Q., Chen, C.-F., & Panda, R. (2021) · arXiv (Cornell University) · Cited by 6
Visual Keyword Spotting with AttentionPreprint
Prajwal, K. R., Momeni, L., Afouras, T., & Zisserman, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15957 · Cited by 8
Contracting Skeletal Kinematic Embeddings for Anomaly DetectionPreprint
Flaborea, A., di Melendugno, G. M. D., D’Arrigo, S., Sterpa, M. A., Sampieri, A., & Galasso, F. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4364376 · Cited by 6
Mstnet: method for glaucoma grading based on multimodal feature fusion of spatial relations
Wang, Z., Wang, J., Zhang, H., Chen, Y., Xingkui, W., & Wen, X. (2023) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad0520 · Cited by 5
Empowering Efficient Spatio-Temporal Learning with a 3D CNN for Pose-Based Action Recognition
Ren, Z., Xiao, X., & Nie, H. (2024) · Sensors · doi:10.3390/s24237682 · Cited by 5
Collaboratively Self-Supervised Video Representation Learning for Action Recognition
Zhang, J., Wan, Z., Hu, L., Lin, S., Wu, S., & Shan, S. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3531772 · Cited by 7
Behavior capture guided engagement recognition
Bei, Y., Guo, S., Gao, K., & Feng, Z. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111534 · Cited by 7
Barbosa, R. Z., & Oliveira, H. S. (2025) · IEEE Access · doi:10.1109/access.2025.3557948 · Cited by 5
Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Driving
Bai, J., Fang, J., Lv, Y., Lv, C., Xue, J., & Li, Z. G. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3554767 · Cited by 8
End-to-End Streaming Video Temporal Action Segmentation With Reinforcement Learning
Zhang, J., Wen, W., Liu, S., Huang, G. M., Li, Y., Li, Q., & Feng, L. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3550910 · Cited by 6
RAM-Hand: Robust Acoustic Multi-Hand Pose Reconstruction Using a Microphone Array
Wang, S., Pu, H., Cao, Q., Jiang, W., Wang, X., Liu, T., Jiang, Z., Xue, H., & Su, L. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722055 · Cited by 5
Kadambi, A., & Zariffa, J. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3569083 · Cited by 5
Cyclic Data Distillation Semi-Supervised Learning for Multi-Modal Emotion Recognition
Li, S., Zhang, T., & Chen, C. L. P. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3581786 · Cited by 6
TransCLIP: Transferring Vision–Language Models for Efficient Video Action Recognition
Wang, W., Su, Y., & Gu, J. J. (2025) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2025.3577686 · Cited by 5
Learning-Based Heatmap-Guided Model for Monocular Visual Odometry
Lin, H.-C., Jhong, S.-Y., Lin, Y., Fang, J.-K., Chang, C., Lu, S.-Y., & Chen, Y.-Y. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3584151 · Cited by 5
G 2 V 2 former: Graph Guided Video Vision Transformer for Face Anti-Spoofing
Yang, J., Yu, Z., Jia, H., Ni, X., Zhang, L., Li, H., & Cao, X. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3586506 · Cited by 10
Unlocking implicit motion for evaluating image complexity
Li, Y., Yang, X., Luo, Y., Amirpour, H., Liu, H., & Zhou, W. M. (2025) · Displays · doi:10.1016/j.displa.2025.103131 · Cited by 5
Nguyễn, T. T., Kawanishi, Y., John, V., Komamizu, T., & Ide, I. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099071 · Cited by 5
LoKi: Low-dimensional KAN for Efficient Fine-tuning Image Models
Cai, X., Pan, R., & Yang, H. S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01385 · Cited by 6
OwlSight: A Robust Illumination Adaptation Framework for Dark Video Human Action Recognition
Cheng, S., Zhang, J., Liu, Y., Xiao, A., & Tu, Z. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3632359 · Cited by 5
Cross-Modal Video Retrieval Model Based on Video-Text Dual Alignment
Che, Z., & Guo, H. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150232 · Cited by 5
Learning Temporal Dynamics in Videos With Image Transformer
Shu, Y., Qiu, Z., Long, F., Yao, T., Ngo, C., & Mei, T. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3383662 · Cited by 7
FETR: Feature Transformer for vehicle-infrastructure cooperative 3D object detection
Yan, W., Cao, H., Chen, J., & Wu, T. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128147 · Cited by 5
Recognizing Video Activities in the Wild via View-to-Scene Joint Learning
Yu, J., Chen, Y., Wang, X., Cheng, X., Ju, Z., & Xu, Y. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3431128 · Cited by 5
Language-aware Visual Semantic Distillation for Video Question Answering
Zou, B., Chao, Y., Qiao, Y., Quan, C., & Zhao, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02560 · Cited by 9
CPR-Coach: Recognizing Composite Error Actions Based on Single-Class Training
Wang, S., Wang, S., Yang, D., Li, M., Kuang, H., Zhao, X. Y., Su, L., Zhai, P., & Zhang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01777 · Cited by 5
Language Model Guided Interpretable Video Action Reasoning
Wang, N., Zhu, G., Li, H., Zhang, L., Shah, S. A. A., & Bennamoun, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01786 · Cited by 5
Attention BLSTM-Based Temporal-Spatial Vein Transformer for Multi-View Finger-Vein Recognition
Qin, H., Xiong, Z., Li, Y., El‐Yacoubi, M. A., & Wang, J. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3468898 · Cited by 5
EAGLE: Egocentric AGgregated Language-video Engine
Bi, J., Tang, Y., Song, L., Vosoughi, A., Nguyen, N., & Xu, C. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681618 · Cited by 13
Zhang, Z., Liu, B., Zhou, J., Wang, H., Liu, X., Lin, B., & Chen, T. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104398 · Cited by 5
Self-citationCycleACR: Cycle Modeling of Actor-Context Relations for Video Action Detection
Chen, L., Zhan, T., Song, Y., Wu, G., & Wang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3595393 · Cited by 7
Transformer Based Multimodal Scene Recognition in Soccer Videos
Gan, Y., Togo, R., Ogawa, T., & Haseyama, M. (2022) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew56448.2022.9859304 · Cited by 5
I Know How You Move: Explicit Motion Estimation for Human Action Recognition
Shen, Z., Wu, X., Li, H., Xu, T., & Wu, C. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3211423 · Cited by 5
Cognition Guided Human-Object Relationship Detection
Zeng, Z., Dai, P., Zhang, X., Zhang, L., & Cao, X. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3270040 · Cited by 5
Non-Sequential Graph Script Induction via Multimedia Grounding
Zhou, Y., Li, S., Li, M., Lin, X., Chang, S.-F., Bansal, M., & Ji, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.303 · Cited by 5
T2V2T: Text-to-Video-to-Text Fusion for Text-to-Video Retrieval
Kim, J., Lee, Y., & Moon, J. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00594 · Cited by 5
Koay, H. V., Chuah, J. H., & Chow, C. (2023) · IEEE Region 10 Symposium (TENSYMP) · doi:10.1109/tensymp55890.2023.10223643 · Cited by 5
Efficient Per-Shot Transformer-Based Bitrate Ladder Prediction for Adaptive Video Streaming
Telili, A., Hamidouche, W., Fezza, S. A., & Morin, L. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222094 · Cited by 7
Multi-label Video Classification for Underwater Ship Inspection
Azad, M. A., Mohammed, A. M., Waszak, M., Elvesæter, B., & Ludvigsen, M. (2023) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceanslimerick52467.2023.10244578 · Cited by 7
Vision Transformer-based recognition tasks: a critical review
Zhou, L. M., & Jianing, M. (2023) · Journal of Image and Graphics · doi:10.11834/jig.220895 · Cited by 5
Dokkar, R. R., Chaieb, F., Drira, H., & Aberkane, A. (2023) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp59012.2023.10337696 · Cited by 10
COPILOT: Human-Environment Collision Prediction and Localization from Egocentric Videos
Pan, B., Shen, B., Rempe, D., Paschalidou, D., Mo, K., Yang, Y., & Guibas, L. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00485 · Cited by 5
Chinese Title Generation for Short Videos: Dataset, Metric and Algorithm
Zhang, Z., Ma, Z., Yuan, C., Chen, Y., Wang, P., Qi, Z., Hao, C., Li, B., Shan, Y., Hu, W., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3365739 · Cited by 6
MgMViT: Multi-Granularity and Multi-Scale Vision Transformer for Efficient Action Recognition
Huo, H., & Li, B. (2024) · Electronics · doi:10.3390/electronics13050948 · Cited by 5
Video Event Extraction with Multi-View Interaction Knowledge Distillation
Wei, K., Du, R., Jin, L., Liu, J., Yin, J., Zhang, L., Liu, J., Liu, N., Zhang, J., & Guo, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29891 · Cited by 5
Streaming Video Temporal Action Segmentation in Real Time
Wen, W., Li, Y., Dong, Z., Feng, L., Yang, W., & Liu, S. (2023) · International Conference on Intelligent Systems and Knowledge Engineering (ISKE) · doi:10.1109/iske60036.2023.10481438 · Cited by 5
ESC-ZSAR: Expanded Semantics from Categories with Cross-Attention for Zero-Shot Action Recognition
Lee, J.-C., & Lee, D.-G. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124786 · Cited by 6
A Survey on Backbones for Deep Video Action Recognition
Tang, Z., Zhao, Y., Wen, Y., & Liu, M. (2024) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew63481.2024.10645423 · Cited by 8
Video Recognition in Portrait Mode
Han, M., Yang, L., Jin, X., Feng, J., Chang, X., & Wang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02062 · Cited by 5
Self-citationModeling Event-level Causal Representation for Video Classification
Wang, Y., Meng, L., Ma, H., Wang, Y., Huang, H., & Meng, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681547 · Cited by 5
Shan, C., Zhang, Y., Liu, C., Jin, Z., Cheng, H., Chen, Y., Yao, J., & Luo, S. (2024) · IEEE Transactions on Ultrasonics Ferroelectrics and Frequency Control · doi:10.1109/tuffc.2024.3494019 · Cited by 5
The Journey of Action Recognition
Xi, D., & Wang, L. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3717746 · Cited by 6
Estimating (and fixing) the Effect of Face Obfuscation in Video Recognition
Tomei, M., Baraldi, L., Bronzin, S., & Cucchiara, R. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00364 · Cited by 6
Time-Space Transformers for Video Panoptic Segmentation
Petrovai, A., & Nedevschi, S. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00270 · Cited by 5
Wang, J., Wang, D., Wang, Y., Wang, S., Shao, Y. C., & Lu, J. (2022) · Urolithiasis · doi:10.1007/s00240-022-01341-2 · Cited by 5
Space Time Attention Transformer for Non-Event Detection in UAV Videos
Bashmal, L., Bazi, Y., & Alajlan, N. (2022) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss46834.2022.9884661 · Cited by 5
Dense but Efficient VideoQA for Intricate Compositional Reasoning
Lee, J., Kang, W., & Kim, E. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00117 · Cited by 5
Learning Trajectory-Word Alignments for Video-Language Tasks
Xu, Y., Li, Z., Xu, H., Zhang, H., Ye, Q., Li, C., Yan, M., Zhang, Y., Huang, F., & Huang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00237 · Cited by 7
Hierarchical Home Action Understanding with Implicit and Explicit Prior Knowledge
Zhou, Y., Tan, G., & Gou, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445997 · Cited by 5
Self-supervised Video Object Segmentation by Motion GroupingPreprint
Yang, C., Lamdouar, H., Lu, E., Zisserman, A., & Xie, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07658 · Cited by 5
Unsupervised Conditional Diffusion Models in Video Anomaly Detection for Monitoring Dust Pollution
Cai, L., Li, M., & Wang, D. (2024) · Sensors · doi:10.3390/s24051464 · Cited by 5
Reversed in Time: A Novel Temporal-Emphasized Benchmark for Cross-Modal Video-Text Retrieval
Du, Y., Liu, Y., & Jin, Q. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680731 · Cited by 4
CSTA: Spatial-Temporal Causal Adaptive Learning for Exemplar-Free Video Class-Incremental Learning
Chen, T., Liu, H., Lim, C. H., See, J., Gao, X., Hou, J., & Lin, W. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3579477 · Cited by 4
Moon, Y., Ha, S., Kim, S.-Y., Ryu, J., Yoo, H., & Han, D. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11042937 · Cited by 4
SkySearch: Satellite Video Search at Scale
Choe, M., Lee, G., Han, C., Kim, S., Hu, W., Hwang, H., Park, G., Kim, B., Lee, H., Park, H.-M., et al. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737263 · Cited by 4
SocialGesture: Delving into Multi-person Gesture Understanding
Cao, X., Virupaksha, P., Jia, W., Lai, B., Ryan, F., Lee, S., & Rehg, J. M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01817 · Cited by 4
Instance-Adaptive Spatial-Temporal Enhancement for Efficient Video Compression
Zhao, Y. J., Cheng, Z., Li, J., Feng, D., Gu, Q., (22418), Q. W., Lu, G. S., & Song, L. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3602648 · Cited by 4
Is Temporal Prompting All We Need for Limited Labeled Action Recognition?
Gowda, S. N., Gao, B., Gu, X., & Jin, X. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00073 · Cited by 4
Chen, L., Li, D., Wang, X., Shao, P., Zhang, W., Wang, Y., Tian, Y., & Tang, J. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3607771 · Cited by 7
Anuar, M. F. A. M. S., Zaman, F. H. K., Abdullah, S. A. B. C., Ng, K. M., Vijyakumar, K. N. A.-L., & Ng, S. K. (2026) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2025.3650561 · Cited by 4
Paying attention to other animal detections improves camera trap classification models
Dussert, G., Dray, S., Chamaillé‐Jammes, S., & Miele, V. (2026) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.70260 · Cited by 3
Braun, B., Armani, R., Meier, M., Moebus, M., & Holz, C. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00529 · Cited by 5
Lidar Waveforms are Worth 40×128×33 Words
Scheuble, D., Holzhüter, H., Peters, S., Bijelic, M., & Heide, F. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02685 · Cited by 4
Cui, F.-Q., Huang, J., Zhao, S., Li, K., Liu, Z., Li, M., Jia, Z., Guo, D., & Wang, M. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3698795 · Cited by 4
Tab-Attention: Self-Attention-Based Stacked Generalization for Imbalanced Credit Default Prediction
Tan, Y., Zhu, H., Wu, J., & Chai, H. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230532 · Cited by 5
Markov Progressive Framework, a Universal Paradigm for Modeling Long Videos
Pang, B., Gao, P., Li, Y., & Lu, C. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3426998 · Cited by 4
ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attack
Gao, Z., Chen, K., Wei, Z., Mou, T., Chen, J., Tan, Z., Li, H., & Jiang, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680959 · Cited by 4
Short video rumor detection based on causal graph
Cao, D., Tang, X., Lin, Y., & Lin, D. (2025) · Information Sciences · doi:10.1016/j.ins.2025.121941 · Cited by 4
Pig aggression classification using CNN, Transformers and Recurrent Networks
Souza, J. S., Bedin, E., Higa, G. T. H., Loebens, N., & Pistori, H. (2024) · doi:10.5753/wvc.2024.34004 · Cited by 4
A benchmark for cycling close pass detection from video streams
Li, M., Beck, B., Rathnayake, T., Meng, L., Chen, Z., Cosgun, A., Chang, X., & Kulić, D. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105112 · Cited by 5
JointFormer: A Unified Framework With Joint Modeling for Video Object Segmentation
Zhang, J., Cui, Y., Wu, G., & Wang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3557841 · Cited by 9
Aerial video classification with Window Semantic Enhanced Video Transformers
Yang, F., Liu, X., Zhou, B., Guan, X., Qin, A., Song, T., Zhao, Y., Wang, X., & Gao, C. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127883 · Cited by 4
Zhang, Z., Yan, J., Liang, Y., Feng, J., He, H., & Cao, L. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3574799 · Cited by 6
An interpretable multi-transformer ensemble for text-based movie genre classification
Shaukat, F., Ejaz, N., Ashraf, Z., Alnfiai, M. M., Alotaibi, N. N., & Alnefaie, S. M. M. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2945 · Cited by 6
VideoMamba++: Integrating state space model with dual attention for enhanced video understanding
Song, X., Tian, W., Zhu, Q., & Zhang, X. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105609 · Cited by 4
Tian, Q., Zeng, F., Ning, J., & Zhang, L. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104456 · Cited by 4
Can Vision Feel Touch? Tactile-Aware Visual Grasping for Transparent Objects
Tong, L., Qian, K., Yue, Z., & Luo, S. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3598373 · Cited by 4
VSNet: Focusing on the Linguistic Characteristics of Sign Language
Li, Y., Chen, X., Li, H., Pu, X., Jin, P., & Ren, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02265 · Cited by 4
A global linear attention incorporated video transformer for robust sintering condition recognition
Wu, L., Wu, J., Wang, D., & Fu, Q. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112032 · Cited by 4
Sheng, Z., Huang, Z., Qu, Y., Chen, J., Luo, Y., Chen, Y., Leng, Y., & Chen, S. (2026) · CHAIN · doi:10.23919/chain.2026.000005 · Cited by 9
Temporal based Emotion Recognition inspired by Activity Recognition models
Mohan, B., & Popa, M. C. (2021) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw52867.2021.9666356 · Cited by 3
Fall-Perceived Action Recognition of Persons With Neurological Disorders Using Semantic Supervision
Nigam, N., Dutta, T., & Verma, D. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3157813 · Cited by 4
Deep Video Action Recognition Models for Assessing Cardiac Function from Echocardiograms
Almadani, A., Shivdeo, A., Agu, E., & Kpodonu, J. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020947 · Cited by 4
Simultaneous Video Retrieval and Alignment
Jo, W., Lim, G., Hwang, Y., Lee, G., Kim, J., Yun, J., Jung, J., & Choi, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3259733 · Cited by 4
A Novel Spatio-Temporal-Wise Network for Action Recognition
Cai, Z. (2023) · IEEE Access · doi:10.1109/access.2023.3274542 · Cited by 4
What Causes a Driver's Attention Shift? A Driver's Attention-Guided Driving Event Recognition Model
Du, P., Deng, T., & Yan, F. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191126 · Cited by 4
Policy Adaptation from Foundation Model Feedback
Ge, Y., Macaluso, A., Li, L. E., Luo, P., & Wang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01827 · Cited by 9
Behavior Recognition of Squid Jigger Based on Deep Learning
Song, Y., Zhang, S., Tang, F., Shi, Y., Wu, Y., He, J., Chen, Y., & Li, L. (2023) · Fishes · doi:10.3390/fishes8100502 · Cited by 4
Metadata
- Authors
- Bertasius, G., Wang, H., & Torresani, L.
- Affiliations
- University of Pennsylvania (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 813-824
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.05095
- OpenAlex
- W3126721948
- Cited by
- 1,663
- References
- 58
- Citations by year
- 2026: 161 · 2025: 390 · 2024: 418 · 2023: 387 · 2022: 199 · 2021: 108
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- video classification, self-attention, spatio-temporal attention, TimeSformer, transformer models, divided attention, human action recognition, 3D convolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
