The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Is Space-Time Attention All You Need for Video Understanding?
Open accessAbstract
We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that "divided attention," where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vision Transformer (ViT) [17], and video-specific variants such as TimeSformer [ 18, 19 ] and Video Swin Transformer [20] capture longrange dependencies and global spatiotemporal context that CNNs often miss.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar to previous trials [3, 6], training video transformers from scratch yields unsatisfied results on video datasets.”
From VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (2022) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“For this reason, due to real-time computation concerns in visual odometry applications, we selected the encoder architecture with the 'divided space-time' self-attention, which is more efficient in terms of processing complexity compared to the 'joint space-time' self-attention.”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“We chose the TimeSformer [14] model for this work since it achieved state-of-the-art results in video action recognition tasks compared to previous works based on convolutional neural networks (CNN).”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Research works printed but not linked: 5
- Ba, L. J., Kiros, J. R., and Hinton, G. E. Layer normalization. CoRR, 2016.
- Chen, M. X., Firat, O., Bapna, A., Johnson, M., Macherey, W., Foster, G., Jones, L., Schuster, M., Shazeer, N., Par- mar, N., Vaswani, A., Uszkoreit, J., Kaiser, L., Chen, Z., Wu, Y., and Hughes, M. The best of both worlds: Combining recent advances in neural machine translation. In Proceedings of the 56th Annual Meeting of the Asso- ciation for Computational Linguistics. Association for Computational Linguistics, 2018a.
- Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. Aˆ2- nets: Double attention networks. In Advances in Neural Information Processing Systems 31, 2018b.
- International Conference on Computer Vision (ICCV), October 2019.
- Cordonnier, J., Loukas, A., and Jaggi, M. On the relation- ship between self-attention and convolutional layers. In 8th International Conference on Learning Representa- tions, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020.
Cited by
Sorted by citations
Items 401–500 of 1,004
CLIPVQA: Video Quality Assessment via CLIP
Xing, F., Li, M., Wang, Y., Zhu, G., & Cao, X. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3511927 · Cited by 23
Wang, Z., & Liu, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3575440 · Cited by 20
Video‐Based Data‐Driven Models for Diagnosing Movement Disorders: Review and Future Directions
Martínez‐García‐Peña, R., Koens, L. H., Azzopardi, G., & Tijssen, M. A. J. (2025) · Movement Disorders · doi:10.1002/mds.30327 · Cited by 23
MovieCLIP: Visual Scene Recognition in Movies
Bose, D., Hebbar, R., Somandepalli, K., Zhang, H., Cui, Y., Cole-McLaughlin, K., Wang, H., & Narayanan, S. S. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00212 · Cited by 25
Self-citationMontalvo-Lezama, R., Montalvo-Lezama, B., & Fuentes-Pineda, G. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103343 · Cited by 24
Ghimire, A., Kakani, V., & Kim, H. (2023) · IEEE Access · doi:10.1109/access.2023.3278974 · Cited by 23
Saliency-Aware Spatio-Temporal Artifact Detection for Compressed Video Quality Assessment
Lin, L., Zheng, Y., Chen, W., Lan, C., & Zhao, T. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3283541 · Cited by 20
Collaborative Static and Dynamic Vision-Language Streams for Spatio-Temporal Video Grounding
Lin, Z., Tan, C., Hu, J., Jin, Z. J., Ye, T., & Zheng, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02212 · Cited by 20
How can objects help action recognition?
Zhou, X., Arnab, A., Sun, C., & Schmid, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00233 · Cited by 20
SViTT: Temporal Learning of Sparse Video-Text Transformers
Li, Y., Min, K., Tripathi, S., & Vasconcelos, N. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01814 · Cited by 20
Zhao, Y., Luo, C., Tang, C., Chen, D., Codella, N., & Zha, Z.-J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01403 · Cited by 20
Actor-agnostic Multi-label Action Recognition with Multi-modal Query
Mondal, A., Nag, S., Prada, J. M., Zhu, X., & Dutta, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00086 · Cited by 22
Adaptive Cross-Modal Transferable Adversarial Attacks From Images to Videos
Wei, Z., Chen, J., Wu, Z., & Jiang, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3347835 · Cited by 21
COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting Using Transformers
Denize, J., Liashuha, M., Rabarisoa, J., Orcesi, A., & Hérault, R. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00060 · Cited by 23
Liu, R., Huang, Z.-A., Hu, Y. F., Huang, L., Wong, K., & Tan, K. C. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3386612 · Cited by 21
Continual Action Assessment via Task-Consistent Score-Discriminative Feature Distribution Modeling
Li, Y.-M., Zeng, L.-A., Meng, J., & Zheng, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3396692 · Cited by 20
Huang, C., Jiang, F., Han, Z., Huang, X., Wang, S., Zhu, Y., Jiang, Y., & Hu, B. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3530973 · Cited by 21
Joudaki, M., Imani, M., & Arabnia, H. R. (2025) · Technologies · doi:10.3390/technologies13020053 · Cited by 23
Dynamic Graph Representation Learning for Spatio-Temporal Neuroimaging Analysis
Liu, R., Hu, Y. F., Wu, J., Wong, K., Huang, Z.-A., Huang, Y., & Tan, K. C. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3531657 · Cited by 19
Location-Aware Adaptive Normalization: A Deep Learning Approach for Wildfire Danger Forecasting
Eddin, M. H. S., Roscher, R., & Gall, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3285401 · Cited by 22
Wang, Q., Zhang, X., & Xu, D. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3286576 · Cited by 19
AMS-Net: Modeling Adaptive Multi-Granularity Spatio-Temporal Cues for Video Action Recognition
Wang, Q., Hu, Q., Gao, Z., Li, P., & Hu, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3321141 · Cited by 20
EventTransAct: A Video Transformer-Based Framework for Event-Camera Based Action Recognition
de Blegiers, T., Dave, I. R., Yousaf, A., & Shah, M. A. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341740 · Cited by 20
What Can Simple Arithmetic Operations Do for Temporal Modeling?
Wu, W., Song, Y., Sun, Z., Wang, J., Xu, C., & Ouyang, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01261 · Cited by 19
Ego-Only: Egocentric Action Detection without Exocentric Transferring
Wang, H., Singh, M. K., & Torresani, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00484 · Cited by 27
Self-citationMotion-Guided Masking for Spatiotemporal Representation Learning
Fan, D., Wang, J., Liao, S., Zhu, Y., Bhat, V., Santos-Villalobos, H., Rohith, M., & Li, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00517 · Cited by 26
V2Meow: Meowing to the Visual Beat via Video-to-Music Generation
Su, K., Li, J. Y., Huang, Q., Kuzmin, D., Lee, J., Donahue, C., Sha, F., Jansen, A., Wang, Y., Verzetti, M., et al. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28299 · Cited by 36
A Simple Recipe for Contrastively Pre-Training Video-First Encoders Beyond 16 Frames
Papalampidi, P., Koppula, S., Pathak, S., Chiu, J., Heyward, J., Pătrăucean, V., Shen, J., Miech, A., Zisserman, A., & Nematzdeh, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01364 · Cited by 29
Shifted Chunk Transformer for Spatio-Temporal Representational LearningPreprint
Zha, X., Zhu, W., Lv, T., Yang, S., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11575 · Cited by 22
Song, D., Dai, S., Li, W., Ren, T., Wei, Z., & Liu, A.-A. (2024) · Applied Ocean Research · doi:10.1016/j.apor.2024.104218 · Cited by 18
Koala: Key Frame-Conditioned Long Video-LLM
Tan, R., Sun, X., Hu, P., Wang, J.-H., Deilamsalehy, H., Plummer, B. A., Russell, B. C., & Saenko, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01289 · Cited by 25
VLPA-CLIP: Video Language Prompting and Adapting CLIP for efficient video action recognition
Wang, H., Liu, F., Jiao, L., Wang, J., Li, S., Li, L., Chen, P., Liu, X., & Ma, W. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111770 · Cited by 18
Self-citationDASFTOT: Dual attention spatiotemporal fused transformer for object tracking
Wu, R., Wen, X., Yuan, L., & Xu, H. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109897 · Cited by 18
MLP-3D: A MLP-like 3D Architecture with Grouped Time Mixing
Qiu, Z., Yao, T., Ngo, C., & Mei, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00307 · Cited by 19
Weakly Supervised Video Representation Learning with Unaligned Text for Sequential Videos
Dong, S., Hu, H., Lian, D., Luo, W., Qian, Y., & Gao, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00241 · Cited by 18
CloudpredNet: An Ultra-Short-Term Movement Prediction Model for Ground-Based Cloud Image
Wei, L., Zhu, T., Guo, Y., Ni, C., & Zheng, Q. (2023) · IEEE Access · doi:10.1109/access.2023.3310538 · Cited by 18
Temporal Chain Network With Intuitive Attention Mechanism for Long-Term Series Forecasting
Zhang, Z., Han, Y. M., Ma, B., Liu, M., & Geng, Z. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3322508 · Cited by 18
Rostami, B., Fetterly, K. A., Attia, Z. I., Challa, A., López-Jiménez, F. A., Thaden, J. J., Asirvatham, S. J., Friedman, P. A., Gulati, R., & Alkhouli, M. A. (2023) · JACC Advances · doi:10.1016/j.jacadv.2023.100632 · Cited by 19
Xu, P., Tian, L., Liu, J., Luo, D., & Jahanshahi, H. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107647 · Cited by 18
Prune Spatio-temporal Tokens by Semantic-aware Temporal Accumulation
Ding, S., Zhao, P., Zhang, X., Qian, R., Xiong, H., & Tian, Q. C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01554 · Cited by 23
Deep Optics for Video Snapshot Compressive Imaging
Wang, P., Wang, L., & Yuan, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00977 · Cited by 18
Semantic-aware Video Representation for Few-shot Action Recognition
Tang, Y., Béjar, B., & Vidal, R. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00633 · Cited by 19
EPK-CLIP: External and Priori Knowledge CLIP for action recognition
Yang, Z., An, G., Zheng, Z., Cao, S., & Wang, F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124183 · Cited by 18
DuST: Dual Swin Transformer for Multi-modal Video and Time-Series Modeling
Shi, L., Chen, Y., Liu, M., & Guo, F. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00456 · Cited by 21
MediViSTA: Medical Video Segmentation Via Temporal Fusion SAM Adaptation for Echocardiography
Kim, S., Jin, P., Chen, C., Kim, K., Lyu, Z., Ren, H., Kim, S., Liu, Z., Zhong, A., Liu, T., et al. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3540306 · Cited by 27
Multi View Action Recognition for Distracted Driver Behavior Localization
Zhou, W., Qian, Y., Jie, Z., & Ma, L. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00567 · Cited by 18
CAPE: Encoding Relative Positions with Continuous Augmented Positional EmbeddingsPreprint
Likhomanenko, T., Xu, Q., Synnaeve, G., Collobert, R., & Rogozhnikov, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03143 · Cited by 20
Foundation Models for Video Understanding: A SurveyPreprint
Madan, N., Møgelmose, A., Modi, R., Rawat, Y. S., & Moeslund, T. B. (2024) · doi:10.36227/techrxiv.171769139.99464428/v1 · Cited by 24
LS-VIT: Vision Transformer for action recognition based on long and short-term temporal difference
Chen, D., Wu, P., Chen, M., Wu, M., Zhang, T., & Li, C. (2024) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2024.1457843 · Cited by 21
Micro_NesT: multi-scale attention enhanced micro-expression recognition framework
He, J., Xiao, Y., Zhang, H., Cai, J., Cai, L., & Liu, R. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128372 · Cited by 19
Language-Guided Audio-Visual Learning for Long-Term Sports Assessment
Xu, H., Ke, X., Wu, H., Xu, R., Li, Y., & Guo, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02232 · Cited by 17
Revisiting spatio-temporal layouts for compositional action recognition
Radevski, G., Moens, M., & Tuytelaars, T. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.278 · Cited by 26
Video Sparse Transformer With Attention-Guided Memory for Video Object Detection
Fujitake, M., & Sugimoto, A. (2022) · IEEE Access · doi:10.1109/access.2022.3184031 · Cited by 17
Spatial-Temporal Exclusive Capsule Network for Open Set Action Recognition
Feng, Y., Gao, J., Yang, S., & Xu, C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3252275 · Cited by 18
Temporal Perceiver: A General Architecture for Arbitrary Boundary Detection
Tan, J., Wang, Y., Wu, G., & Wang, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3283067 · Cited by 23
Hammou, B. A., Antaki, F., Boucher, M. C., & Duval, R. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105178 · Cited by 17
Search-Map-Search: A Frame Selection Paradigm for Action Recognition
Zhao, M., Yu, Y., Wang, X., Yang, L., & Niu, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01024 · Cited by 17
Automated Seizure Detection using Transformer Models on Multi-Channel EEGs
Zhu, Y.-D., & Wang, M. D. (2023) · 2023 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI) · doi:10.1109/bhi58575.2023.10313440 · Cited by 26
E2E-LOAD: End-to-End Long-form Online Action Detection
Cao, S., Luo, W., Wang, B., Zhang, W., & Ma, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00956 · Cited by 19
Video Action Recognition with Attentive Semantic Units
Chen, Y., Chen, D., Liu, R., Li, H., & Peng, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00933 · Cited by 20
Permutation-Aware Activity Segmentation via Unsupervised Frame-to-Segment Alignment
Tran, Q.-H., Mehmood, A., Ahmed, M., Naufil, M., Zafar, A., Konin, A., & Zia, M. Z. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00630 · Cited by 18
Egocentric Action Recognition by Capturing Hand-Object Contact and Object State
Shiota, T., Takagi, M., Kumagai, K., Seshimo, H., & Aono, Y. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00641 · Cited by 23
Triplet Attention Transformer for Spatiotemporal Predictive Learning
Nie, X., Chen, X., Jin, H., Zhu, Z., Yan, Y., & Qi, D. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00688 · Cited by 20
M2VAD : Multiview multimodality transformer-based weakly supervised video anomaly detection
Paulraj, S., & Subramaniyaswamy, V. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105139 · Cited by 17
RFE-VCR: Reference-enhanced transformer for remote sensing video cloud removal
Jin, X., He, J., Xiao, Y., Lihe, Z., Liao, X., Li, J., & Yuan, Q. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.06.010 · Cited by 17
Center-enhanced video captioning model with multimodal semantic alignment
Zhang, B., Gao, J., & Yuan, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106744 · Cited by 17
Fair-VPT: Fair Visual Prompt Tuning for Image Classification
Park, S., & Byun, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01166 · Cited by 18
Xia, Z., Cheng, J., Liul, S., Hu, Y., Wang, S., Zhang, Y., & Dang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01745 · Cited by 17
Demystifying Attention Mechanisms for Deepfake Detection
Das, A., Das, S., & Dantcheva, A. (2021) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg52635.2021.9667026 · Cited by 17
MoViNets: Mobile Video Networks for Efficient Video RecognitionPreprint
Kondratyuk, D., Yuan, L., Li, Y., Li, Z., Tan, M., Brown, M., & Gong, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11511 · Cited by 17
Temporal Action Proposal Generation with TransformersPreprint
Wang, L., Yang, H., Wu, W., Yao, H., & Huang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.12043 · Cited by 28
Learning Motion and Temporal Cues for Unsupervised Video Object Segmentation
Zhuge, Y., Gu, H., Zhang, L., Qi, J., & Lu, H. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3418980 · Cited by 16
Human-Centric Transformer for Domain Adaptive Action Recognition
Lin, K.-Y., Zhou, J., & Zheng, W. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3429387 · Cited by 19
Liu, W., Wang, W., Qiao, Y., Guo, Q., Zhu, J., Li, P., Chen, Z., Yang, H., Li, Z., Wang, L., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00644 · Cited by 16
Quality-Guided Vision-Language Learning for Long-Term Action Quality Assessment
Xu, H., Wu, H., Ke, X., Li, Y., Xu, R., & Guo, W. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3599078 · Cited by 18
PERCEIVER-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention
Tang, Z., Cho, J., Lei, J., & Bansal, M. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00439 · Cited by 17
Weakly Supervised Two-Stage Training Scheme for Deep Video Fight Detection Model
Qi, Z., Zhu, R., Fu, Z., Chai, W., & Kindratenko, V. (2022) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai56018.2022.00105 · Cited by 16
The Wisdom of Crowds: Temporal Progressive Attention for Early Action Prediction
Stergiou, A., & Damen, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01413 · Cited by 17
eP-ALM: Efficient Perceptual Augmentation of Language Models
Shukor, M., Dancette, C., & Cord, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02016 · Cited by 16
Helping Hands: An Object-Aware Ego-Centric Video Recognition Model
Zhang, C., Gupta, A., & Zisserman, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01278 · Cited by 20
UMIFormer: Mining the Correlations between Similar Tokens for Multi-View 3D Reconstruction
Zhu, Z., Yang, L., Li, N., Jiang, C., & Liang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01671 · Cited by 16
Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformers
Dutson, M., Li, Y., & Gupta, M. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01551 · Cited by 28
Mitigating and Evaluating Static Bias of Action Representations in the Background and the Foreground
Li, H., Liu, Y., Zhang, H., & Li, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01823 · Cited by 16
Lin, L., Zhang, Z., Yu, H., Wang, J., Gao, S., Zhao, H., & Zhang, J. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3354254 · Cited by 17
YOWOv3: A Lightweight Spatio-Temporal Joint Network for Video Action Detection
Zhu, A., Wang, Y., Yang, J., Yan, T., Ma, H., & Li, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3387933 · Cited by 16
Dark-DSAR: Lightweight one-step pipeline for action recognition in dark videos
Yin, Y., Liu, M., Yang, R., Liu, Y., & Tu, Z. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106622 · Cited by 18
Chen, Y., Chen, D., Liu, R., Zhou, S., Xue, W., & Peng, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01768 · Cited by 16
Lee, Y., Kim, H.-I., Yun, K., & Moon, J. (2021) · IEEE Access · doi:10.1109/access.2021.3132916 · Cited by 16
Keyword-based Vehicle Retrieval
Park, E.-J., Kim, H., Jeong, S., Kang, B., & Kwon, Y. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00477 · Cited by 14
Revisiting 3D ResNets for Video RecognitionPreprint
Du, X., Li, Y., Cui, Y., Qian, R., Li, J., & Bello, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.01696 · Cited by 16
Application of deep learning in cloud cover prediction using geostationary satellite images
Lee, Y., Min, S., Yoon, J., Ha, J., Jeong, S., Ryu, S., & Ahn, M. (2024) · GIScience & Remote Sensing · doi:10.1080/15481603.2024.2440506 · Cited by 16
DIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection
Nie, F., Ni, J., Zhang, J., Zhang, B., & Zhang, W. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521766 · Cited by 17
Hu, J., Cao, Y., & Tan, G. (2025) · Energy · doi:10.1016/j.energy.2025.138049 · Cited by 17
StARformer: Transformer With State-Action-Reward Representations for Robot Learning
Shang, J., Li, X., Kahatapitiya, K., Lee, Y., & Ryoo, M. S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204708 · Cited by 18
Active Spatial Positions Based Hierarchical Relation Inference for Group Activity Recognition
Wu, L., Lang, X., Xiang, Y., Chen, C. W., Li, Z., & Wang, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3228731 · Cited by 15
Exploring Self-Supervised Vision Transformers for Gait Recognition in the Wild
Cosma, A., Cǎtrunǎ, A., & Rǎdoi, E. (2023) · Sensors · doi:10.3390/s23052680 · Cited by 21
Zero-Shot Action Recognition with Transformer-based Video Semantic Embedding
Doshi, K., & Yılmaz, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00514 · Cited by 15
Ryoo, M. S., Gopalakrishnan, K., Kahatapitiya, K., Xiao, T. G., Rao, K., Stone, A., Lu, Y., Ibarz, J., & Arnab, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01828 · Cited by 21
TTPOINT: A Tensorized Point Cloud Network for Lightweight Action Recognition with Event Cameras
Ren, H., Zhou, Y., Fu, H., Huang, Y., Xu, R., & Cheng, B. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612258 · Cited by 17
JOADAA: joint online action detection and action anticipation
Guermal, M., Ali, A., Dai, R., & Brémond, F. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00674 · Cited by 15
Metadata
- Authors
- Bertasius, G., Wang, H., & Torresani, L.
- Affiliations
- University of Pennsylvania (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 813-824
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.05095
- OpenAlex
- W3126721948
- Cited by
- 1,663
- References
- 58
- Citations by year
- 2026: 161 · 2025: 390 · 2024: 418 · 2023: 387 · 2022: 199 · 2021: 108
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- video classification, self-attention, spatio-temporal attention, TimeSformer, transformer models, divided attention, human action recognition, 3D convolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
