The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Is Space-Time Attention All You Need for Video Understanding?
Open accessAbstract
We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that "divided attention," where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vision Transformer (ViT) [17], and video-specific variants such as TimeSformer [ 18, 19 ] and Video Swin Transformer [20] capture longrange dependencies and global spatiotemporal context that CNNs often miss.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar to previous trials [3, 6], training video transformers from scratch yields unsatisfied results on video datasets.”
From VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (2022) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“For this reason, due to real-time computation concerns in visual odometry applications, we selected the encoder architecture with the 'divided space-time' self-attention, which is more efficient in terms of processing complexity compared to the 'joint space-time' self-attention.”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“We chose the TimeSformer [14] model for this work since it achieved state-of-the-art results in video action recognition tasks compared to previous works based on convolutional neural networks (CNN).”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Research works printed but not linked: 5
- Ba, L. J., Kiros, J. R., and Hinton, G. E. Layer normalization. CoRR, 2016.
- Chen, M. X., Firat, O., Bapna, A., Johnson, M., Macherey, W., Foster, G., Jones, L., Schuster, M., Shazeer, N., Par- mar, N., Vaswani, A., Uszkoreit, J., Kaiser, L., Chen, Z., Wu, Y., and Hughes, M. The best of both worlds: Combining recent advances in neural machine translation. In Proceedings of the 56th Annual Meeting of the Asso- ciation for Computational Linguistics. Association for Computational Linguistics, 2018a.
- Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. Aˆ2- nets: Double attention networks. In Advances in Neural Information Processing Systems 31, 2018b.
- International Conference on Computer Vision (ICCV), October 2019.
- Cordonnier, J., Loukas, A., and Jaggi, M. On the relation- ship between self-attention and convolutional layers. In 8th International Conference on Learning Representa- tions, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020.
Cited by
Sorted by citations
Items 601–700 of 1,004
Video-Text Pre-training with Learned Regions for Retrieval
Yan, R., Shou, M. Z., Ge, Y., Wang, J., Lin, X., Cai, G., & Tang, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25414 · Cited by 29
Self-attention-based long temporal sequence modeling method for temporal action detection
Huang, J., Zhao, P. F., Wang, G., Yang, S., & Lin, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126617 · Cited by 11
Yang, F., Xue, Q., Cao, Y., Li, X., Zhang, W., & Li, G. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123081 · Cited by 11
Learnable Cube-based Video Encryption for Privacy-Preserving Action Recognition
Ishikawa, Y., Kondo, M., & Kataoka, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00685 · Cited by 12
Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models
Cheng, F., Xu, M., Xiong, Y., Chen, H., Li, X., Li, W., & Xia, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00812 · Cited by 12
Action density based frame sampling for human action recognition in videos
Lin, J., Mu, Z., Zhao, T., Zhang, H., Yang, X., & Zhao, P. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103740 · Cited by 10
Kim, H.-S., Son, M., Kim, M., Kwon, M.-J., & Kim, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00399 · Cited by 11
A Multi-Scale Video Longformer Network for Action Recognition
Chen, C., Zhang, C., & Dong, X. (2024) · Applied Sciences · doi:10.3390/app14031061 · Cited by 10
Sign Language Production with Latent Motion Transformer
Xie, P., Peng, T., Du, Y., & Zhang, Q. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00300 · Cited by 10
MAC: Masked Contrastive Pre-Training for Efficient Video-Text Retrieval
Shu, F., Chen, B., Liao, Y., Wang, J., & Liu, S. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3402613 · Cited by 23
FE-Adapter: Adapting Image-Based Emotion Classifiers to Videos
Gowda, S. N., Gao, B., & Clifton, D. A. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10581905 · Cited by 10
Auxiliary audio–textual modalities for better action recognition on vision-specific annotated videos
Alfasly, S., Lu, J. J., Chen, X., Yu, L., & Zou, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110808 · Cited by 11
Li, L., Tang, M., Yang, Z., Hu, J., & Zhao, M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124917 · Cited by 10
ACA-Net: adaptive context-aware network for basketball action recognition
Zhang, Y., Zhang, F., Zhou, Y., & Xu, X. M. (2024) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2024.1471327 · Cited by 10
Han, J., Zhao, J., Yue, Y., & Che, X. (2024) · IEEE Access · doi:10.1109/access.2024.3475372 · Cited by 10
Wu, H., Ma, X., & Li, Y. (2024) · Signal Processing Image Communication · doi:10.1016/j.image.2024.117244 · Cited by 13
Player Performance Analysis in Table Tennis Through Human Action Recognition
Dong, K., & Yan, W. (2024) · Computers · doi:10.3390/computers13120332 · Cited by 10
STAN: Spatio-Temporal Analysis Network for efficient video action recognition
Chen, S., Wang, X., Sun, Y., & Yang, K. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126255 · Cited by 10
Temporally Aligned Audio for Video with Autoregression
Viertola, I., Iashin, V., & Rahtu, E. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890587 · Cited by 39
Sotomayor-Gómez, B., Battaglia, F. P., & Vinck, M. A. (2025) · Cell Reports · doi:10.1016/j.celrep.2025.115547 · Cited by 13
FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech Synthesis
Wang, Y., & Zhao, Z. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548194 · Cited by 10
VideoABC: A Real-World Video Dataset for Abductive Visual Reasoning
Zhao, W., Rao, Y., Tang, Y., Zhou, J., & Lu, J. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3205207 · Cited by 12
A Spatio- Temporal Attentive Network for Video-Based Crowd Counting
Avvenuti, M., Bongiovanni, M., Ciampi, L., Falchi, F., Gennaro, C., & Messina, N. (2022) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc55528.2022.9913019 · Cited by 10
Baron, P., Kawashima, K., Kim, D., Hanado, H., Kawamura, S., Maesaka, T., Nakagawa, K., Satoh, S., & Ushio, T. (2023) · Journal of Atmospheric and Oceanic Technology · doi:10.1175/jtech-d-22-0109.1 · Cited by 10
Efficient End-to-End Video Question Answering with Pyramidal Multimodal Transformer
Peng, M., Wang, C., Shi, Y., & Zhou, X.-D. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25296 · Cited by 14
Improving Small-Scale Human Action Recognition Performance Using a 3D Heatmap Volume
Yuan, L., He, Z., Wang, Q., Xu, L., & Ma, X. (2023) · Sensors · doi:10.3390/s23146364 · Cited by 10
Multi-Level Content-Aware Boundary Detection for Temporal Action Proposal Generation
Su, T., Wang, H., & Wang, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3328471 · Cited by 11
Self-citationVideo-Text Retrieval by Supervised Sparse Multi-Grained Learning
Wang, Y., & Shi, P. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.46 · Cited by 12
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data
Herzig, R., Abramovich, O., Avraham, E. B., Arbelle, A., Karlinsky, L., Shamir, A., Darrell, T., & Globerson, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00666 · Cited by 10
Look, Listen, and Attack: Backdoor Attacks Against Video Action Recognition
Hammoud, H. A. A. K., Liu, S., Alkhrashi, M., AlBalawi, F., & Ghanem, B. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00348 · Cited by 15
Action Keypoint Network for Efficient Video Recognition
Chen, X., Han, Y., Wang, X., Sun, Y., & Yang, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3191461 · Cited by 10
Gong, K., Dai, Q., Wang, J., Zheng, Y., Shi, T., Yu, J., Chen, J., Huang, S., & Wang, Z. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1118340 · Cited by 10
MorphMLP: A Self-Attention Free, MLP-Like Backbone for Image and VideoPreprint
Zhang, D. J., Li, K., Chen, Y., Wang, Y., Chandra, S., Qiao, Y., Liu, L., & Shou, M. Z. (2021) · arXiv (Cornell University) · Cited by 10
Modeling dynamic social vision highlights gaps between deep learning and humansPreprint
Garcia, K., McMahon, E., Conwell, C., Bonner, M., & Işık, L. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4mpd9 · Cited by 13
Bodaghi, D., Wang, Y., Liu, G., Liu, D., Xue, Q., & Zheng, X. (2023) · Frontiers in Robotics and AI · doi:10.3389/frobt.2023.1231715 · Cited by 10
Sarraf, S., & Kabia, M. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5040067 · Cited by 9
Spatio-Temporal Convolution-Attention Video Network
Diba, A., Sharma, V., Arzani, M. M., & Gool, L. V. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00093 · Cited by 9
Fusion of satellite and street view data for urban traffic accident hotspot identification
Guo, W., Cheng, X., & Jin, S. (2024) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2024.103853 · Cited by 14
Rani, A., Ortíz-Arroyo, D., & Durdevic, P. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108921 · Cited by 10
Multi-Task Spatial-Temporal Transformer for Multi-Variable Meteorological Forecasting
Li, T.-B., Liu, A.-A., Song, D., Li, W., Zhang, J., Wei, Z., & Su, Y.-T. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3432599 · Cited by 9
Two-stream video-based deep learning model for crashes and near-crashes
Shi, L., & Guo, F. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104794 · Cited by 9
Khan, U., Thompson, R., Li, J., Etter, L. P., Camelo, I., Pieciak, R. C., Castro-Aragon, I. M., Setty, B. N., Gill, C. J., Demi, L., et al. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109014 · Cited by 9
TrVLR: A Transformer-Based Vehicle Light Recognition Method in Vehicle Inspection
Zhou, J., Yang, J., Wu, X., Zhou, W., & Wang, Y. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3447586 · Cited by 9
Yu, T., Fu, K., Wang, S., Huang, Q., & Yu, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3475510 · Cited by 13
Building Robust Video-Level Deepfake Detection via Audio-Visual Local-Global Interactions
Wang, Y., Wu, X., Zhang, J., Jing, M., Lu, K., Yu, J., Su, W., Gao, F., Liu, Q., Sun, J., et al. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3688985 · Cited by 11
Wu, M., Zhao, C., Su, A., Di, D., Fu, T., An, D., He, M., Gao, Y., Ma, M., Yan, K., et al. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680810 · Cited by 11
Predicting Pedestrian Crossing Intention in Autonomous Vehicles: A Review
Landry, F.-G., & Akhloufi, M. A. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129105 · Cited by 9
An energy-efficient near-data processing accelerator for DNNs to optimize memory accesses
Khabbazan, B., Sabri, M., Riera, M., & González, A. M. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103320 · Cited by 12
Jang, J. Y., Jeong, E., & Kim, T. W. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106042 · Cited by 9
Spatiotemporal Dual-Stream Network for Visual Odometry
Xu, C., Zeng, T., Luo, Y., Song, F., & Si, B. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3544521 · Cited by 9
Motion-driven adaptive frame selection strategy for video action recognition
Ding, H., Guo, C., Sun, J., Jiang, X., Shi, H., & Li, J. (2025) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-025-00675-2 · Cited by 9
FAME: a lightweight spatio-temporal network for model attribution of face-swap deepfakes
Ahmad, W., Peng, Y., & Chang, Y.-H. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128571 · Cited by 11
DeCafNet: Delegate and Conquer for Efficient Temporal Grounding in Long Videos
Lu, Z., Iftekhar, A., Mittal, G., Meng, T., Wang, X. S., Zhao, C., Kukkala, R., Elhamifar, E., & Chen, M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02241 · Cited by 9
Skeleton-based multi-person action recognition towards real-world violence detection
Truong, M.-T., & Hoang, V.-D. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111987 · Cited by 9
A Modified LSTM Model for Chinese Sign Language Recognition Using Leap Motion
Wu, B., Lu, Z., & Yang, C. (2022) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53654.2022.9945287 · Cited by 11
Domain knowledge-guided adversarial adaptive fusion of hybrid breast ultrasound data
Gong, X., Yuan, S., Xiang, Y., Fan, L., & Zhou, H. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107256 · Cited by 9
Motion-state Alignment for Video Semantic Segmentation
Su, J., Yin, R., Zhang, S., & Luo, J. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00365 · Cited by 9
ViTA: Video Transformer Adaptor for Robust Video Depth Estimation
Xian, K., Peng, J., Cao, Z., Zhang, J., & Lin, G. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3309559 · Cited by 9
Fillioux, L., Gontran, E., Cartry, J., Mathieu, J. R. R., Bedja, S., Boilève, A., Cournède, P.-H., Jaulin, F., Christodoulidis, S., & Vakalopoulou, M. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00425 · Cited by 10
EgoPCA: A New Framework for Egocentric Hand-Object Interaction Understanding
Xu, Y., Li, Y., Huang, Z., Liu, M. X., Lu, C., Tai, Y., & Tang, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00486 · Cited by 9
Temporal-Distributed Backdoor Attack against Video Based Action Recognition
Li, X., Wang, S., Huang, R., Gowda, M., & Kesidis, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28104 · Cited by 9
Lee, M., Lee, H., Kim, B., & Kim, S.-H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00298 · Cited by 9
Vision-based Excavator Activity Analysis and Safety Monitoring System
Zhang, S., & Zhang, L. (2021) · International Symposium on Automation and Robotics in Construction (ISARC) · doi:10.22260/isarc2021/0009 · Cited by 9
Are 3D convolutional networks inherently biased towards appearance?
Byvshev, P., Mettes, P., & Xiao, Y. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103437 · Cited by 9
MRET: Multi-resolution transformer for video quality assessment
Ke, J., Zhang, T., Wang, Y., Milanfar, P., & Yang, F. (2023) · Frontiers in Signal Processing · doi:10.3389/frsip.2023.1137006 · Cited by 10
Mondal, P., Kapoor, P., Singh, S., Saha, S., Singh, J. P., & Onoe, N. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.08.197 · Cited by 10
Video-Based Analysis of Cattle Behaviors: Improved Classification Using FlowEQ Transform
Chae, J.-W., Sim, H., Lee, C., Choi, C.-S., & Cho, H. (2024) · IEEE Access · doi:10.1109/access.2024.3379277 · Cited by 9
Xu, Y., Hong, Y., Li, X., & Hu, M. (2024) · IEEE Access · doi:10.1109/access.2024.3450121 · Cited by 10
Cap4Video++: Enhancing Video Understanding With Auxiliary Captions
Wu, W., Wang, X., Luo, H., Wang, J., Yang, Y., & Ouyang, W. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3410329 · Cited by 9
wang, S., Jia, Z., Li, Y., & yang, Q. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad7e3f · Cited by 8
Han, Z., Qin, W., Wang, Y., Wang, Q., & Shi, Y. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104193 · Cited by 9
Attention on the Preambles: Sensing With mmWave CSI
Kikuzuki, T., Mashhadi, M. B., Ma, Y., & Tafazolli, R. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3475989 · Cited by 8
SoftGrasp: Adaptive grasping for dexterous hand based on multimodal imitation learning
Li, Y., Guo, C., Ren, J., Chen, B., Cheng, C., Zhang, H., & Lu, H. (2025) · Biomimetic Intelligence and Robotics · doi:10.1016/j.birob.2025.100217 · Cited by 12
DAGCAN: Decoupled Adaptive Graph Convolution Attention Network for Traffic Forecasting
Yuan, Q., Wang, J., Han, Y., Liu, Z., & Liu, W. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3531665 · Cited by 8
SoGAR: Self-Supervised Spatiotemporal Attention-Based Social Group Activity Recognition
Chappa, N. V. S. R., Nguyen, P., Nelson, A., Seo, H., Li, X., Dobbs, P. D., & Luu, K. (2025) · IEEE Access · doi:10.1109/access.2025.3541986 · Cited by 9
Zhao, Z., Chung, E., Chung, K., & Park, C. H. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3542066 · Cited by 8
González-Cebrián, Á., Bordonaba, S., Pascau, J., Paredes, I., Lagares, A., & de Toledo, P. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110222 · Cited by 7
Transformer for Multitemporal Hyperspectral Image Unmixing
Li, H., Dong, Q., Xie, X., Xu, X., Li, T., & Shi, Z. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3577394 · Cited by 8
Unified Recurrence Modeling for Video Action Anticipation
Tai, T., Fiameni, G., Lee, C., See, S. C. W., & Lanz, O. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956467 · Cited by 11
Relational Space-Time Query in Long-Form Videos
Yang, X., Chu, F.-J., Feiszli, M., Goyal, R., Torresani, L., & Tran, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00619 · Cited by 8
Self-citationELAN: Enhancing Temporal Action Detection with Location Awareness
Chen, G., Zheng, Y.-D., Chen, Z., Wang, J., & Lü, T. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00179 · Cited by 8
MRSN: Multi-Relation Support Network for Video Action Detection
Zheng, Y.-D., Chen, G., Yuan, M., & Lü, T. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00180 · Cited by 8
Video Question Answering Using Clip-Guided Visual-Text Attention
Ye, S., Kong, W., Yao, C., Ren, J., & Jiang, X. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222286 · Cited by 10
Alleviating Spatial Misalignment and Motion Interference for UAV-based Video Recognition
Shi, G., Fu, X., Cao, C., & Zha, Z.-J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611799 · Cited by 8
Li, Y., Ma, M., Wu, J., Yang, K., Pei, Z., & Ren, J. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3363042 · Cited by 9
Multipath 3D-Conv encoder and temporal-sequence decision for repetitive-action counting
Qiu, Y., Niu, L., & Sha, F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123760 · Cited by 8
VT-Grapher: Video Tube Graph Network With Self-Distillation for Human Action Recognition
Liu, X., Liu, J., Cheng, X., Li, J., Wan, W., & Sun, J. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3380321 · Cited by 8
Amel, O., Siebert, X., & Mahmoudi, S. A. (2024) · Electronics · doi:10.3390/electronics13122294 · Cited by 8
Using Segment-Level Attention to Guide Breast Ultrasound Video Classification
Zhang, Y., Kong, D., Li, J., Yang, T., Yao, F., & Yang, G. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635722 · Cited by 8
SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos
Chen, C., Kumar, A., Girdhar, R., Harwath, D. F., & Grauman, K. L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02573 · Cited by 14
M-adapter: Multi-level image-to-video adaptation for video action recognition
Li, R., Xu, T., Wu, X., Li, L., Yang, X. P., Shen, Z., & Kittler, J. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104150 · Cited by 8
Augmented Self-Mask Attention Transformer for Naturalistic Driving Action Recognition
Zhang, T., Wang, Q., Dong, X., Yu, W., Sun, H. S., Zhou, X., Zhen, A., Cui, S., Wu, D., & He, Z. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00705 · Cited by 8
Extending Segment Anything Model into Auditory and Temporal Dimensions for Audio-Visual Segmentation
Seon, J., Im, W., Lee, S., Lee, J., & Yoon, S. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10647485 · Cited by 11
Advancing Micro-Action Recognition with Multi-Auxiliary Heads and Hybrid Loss Optimization
Li, Q., Huang, X., Chen, H., He, F., Chen, Q., & Wang, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3688975 · Cited by 8
HRRPSeqNet: Open-Set Recognition of Space Target Motions Using HRRP Sequences
Zhang, Y., Feng, X., Yin, H., Wei, X., & Yan, H. (2025) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2025.3540808 · Cited by 8
rPPG Estimation: Vision Transformer With 3-D Temporal Central Difference
Salah, M., Jouvet, P. A., & Noumeir, R. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3548236 · Cited by 9
WLiT: Windows and Linear Transformer for Video Action Recognition
Sun, R., Zhang, T., Wan, Y., Zhang, F., & Wei, J. (2023) · Sensors · doi:10.3390/s23031616 · Cited by 9
Lialin, V., Rawls, S., Chan, D., Ghosh, S., Rumshisky, A., & Hamza, W. (2023) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw58289.2023.00043 · Cited by 8
Token Mixing: Parameter-Efficient Transfer Learning from Image-Language to Video-Language
Liu, Y., Xu, L., Xiong, P., & Jin, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25267 · Cited by 9
Attentive spatial-temporal contrastive learning for self-supervised video representation
Yang, X., Xiong, S., Wu, K., Shan, D., & Xie, Z. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104765 · Cited by 8
Metadata
- Authors
- Bertasius, G., Wang, H., & Torresani, L.
- Affiliations
- University of Pennsylvania (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 813-824
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.05095
- OpenAlex
- W3126721948
- Cited by
- 1,663
- References
- 58
- Citations by year
- 2026: 161 · 2025: 390 · 2024: 418 · 2023: 387 · 2022: 199 · 2021: 108
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- video classification, self-attention, spatio-temporal attention, TimeSformer, transformer models, divided attention, human action recognition, 3D convolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
