The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Is Space-Time Attention All You Need for Video Understanding?
Open accessAbstract
We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that "divided attention," where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Vision Transformer (ViT) [17], and video-specific variants such as TimeSformer [ 18, 19 ] and Video Swin Transformer [20] capture longrange dependencies and global spatiotemporal context that CNNs often miss.”
From Cross-dataset video deepfake detection using Transformer and CNN architectures (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar to previous trials [3, 6], training video transformers from scratch yields unsatisfied results on video datasets.”
From VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training (2022) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“For this reason, due to real-time computation concerns in visual odometry applications, we selected the encoder architecture with the 'divided space-time' self-attention, which is more efficient in terms of processing complexity compared to the 'joint space-time' self-attention.”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“We chose the TimeSformer [14] model for this work since it achieved state-of-the-art results in video action recognition tasks compared to previous works based on convolutional neural networks (CNN).”
From Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach (2023) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Research works printed but not linked: 5
- Ba, L. J., Kiros, J. R., and Hinton, G. E. Layer normalization. CoRR, 2016.
- Chen, M. X., Firat, O., Bapna, A., Johnson, M., Macherey, W., Foster, G., Jones, L., Schuster, M., Shazeer, N., Par- mar, N., Vaswani, A., Uszkoreit, J., Kaiser, L., Chen, Z., Wu, Y., and Hughes, M. The best of both worlds: Combining recent advances in neural machine translation. In Proceedings of the 56th Annual Meeting of the Asso- ciation for Computational Linguistics. Association for Computational Linguistics, 2018a.
- Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. Aˆ2- nets: Double attention networks. In Advances in Neural Information Processing Systems 31, 2018b.
- International Conference on Computer Vision (ICCV), October 2019.
- Cordonnier, J., Loukas, A., and Jaggi, M. On the relation- ship between self-attention and convolutional layers. In 8th International Conference on Learning Representa- tions, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020.
Cited by
Sorted by citations
Items 901–1,000 of 1,004
Falling Behavior Detection System for Elevator Passengers Based on Deep Learning and Edge Computing
Chen, Y., Zhao, Q., Fan, Q., Huang, X., Wu, F., & Qi, J. (2023) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2644/1/012012 · Cited by 4
FFT-UAVNet: FFT Based Human Action Recognition for Drone Surveillance System
Chowdhury, A. M., Imran, A., & Hasan, M. M. (2023) · International Conference on Sustainable Technologies for Industry 5.0 (STI) · doi:10.1109/sti59863.2023.10465205 · Cited by 4
Jointly Modeling Spatio-Temporal Features of Tactile Signals for Action Classification
Lin, J., Li, J., Gao, J., Ma, W., & Liu, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29288 · Cited by 4
EgoFormer: Ego-Gesture Classification in Context of Autonomous Driving
Qazi, T., Kumar, M. R., Mukherjee, P., & Lall, B. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3390794 · Cited by 5
Linguistic-Driven Partial Semantic Relevance Learning for Skeleton-Based Action Recognition
Chen, Q., Liu, Y., Huang, P., & Huang, J. (2024) · Sensors · doi:10.3390/s24154860 · Cited by 4
Advances in Few-Shot Action Recognition: A Comprehensive Review
Ruan, Z., Wei, Y., Yuan, Y., Li, Y., Guo, Y., & Xie, Y. (2024) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd62003.2024.10604585 · Cited by 4
SeqTrack3D: Exploring Sequence Information for Robust 3D Point Cloud Tracking
Lin, Y. R., Li, Z., Cui, Y., & Fang, Z. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611238 · Cited by 9
Bidet-Ildei, C., Ahmed, O. B., Bouidaine, D., Francisco, V., Decatoire, A., Blandin, Y., Pylouster, J., & Fernández-Maloigne, C. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02478-1 · Cited by 4
Action Progression Networks for Temporal Action Detection in Videos
Lu, C., Mak, M., Li, R., Chi, Z., & Fu, H. C. (2024) · IEEE Access · doi:10.1109/access.2024.3451503 · Cited by 4
Pandey, A., Singh, P., Bhavsar, A. V., Nigam, A., & Acharya, D. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650686 · Cited by 4
Lee, J.-H., & Kang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01299 · Cited by 4
Mean-Shift Feature Transformer
Kobayashi, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00578 · Cited by 4
Zhao, D., & Jiang, C. (2024) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat62382.2024.10695438 · Cited by 4
Synthetic Data Augmentation for Video Action Classification Using Unity
Cauli, N., & Recupero, D. R. (2024) · IEEE Access · doi:10.1109/access.2024.3485199 · Cited by 6
Xu, A., Hou, Z., Liang, J., Li, X., Zhou, X., & Geng, H. (2024) · Ecological Informatics · doi:10.1016/j.ecoinf.2024.102902 · Cited by 4
Khaled, N., Saad, S., & Aref, M. M. (2024) · Novel Intelligent and Leading Emerging Sciences Conference (NILES) · doi:10.1109/niles63360.2024.10753147 · Cited by 4
Balat, M., Gabr, M., Bakr, H. A., & Zaky, A. B. (2024) · Novel Intelligent and Leading Emerging Sciences Conference (NILES) · doi:10.1109/niles63360.2024.10753192 · Cited by 4
Zhao, Y., Li, Y., Zhang, Y., Yan, X., Yin, G., & Liu, L. (2025) · IEEE Access · doi:10.1109/access.2025.3531705 · Cited by 4
Active Hard Sample Learning for Violation Action Recognition in Power Grid Operation
Meng, L., He, D., Ban, G., Xi, G., Li, A., & Zhu, X. (2025) · Information · doi:10.3390/info16010067 · Cited by 5
Joint Coarse to Fine-Grained Spatio-Temporal Modeling for Video Action Recognition
Li, C., Cheng, C., Yu, M., Liu, Z., & Huang, D. (2025) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2025.3532416 · Cited by 5
Improving Vision-Language Models With Attention Mechanisms for Aerial Video Classification
Tu, N. A., & Aikyn, N. (2025) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2025.3532987 · Cited by 4
Multimodal understanding of human values in videos: A benchmark dataset and PLM-based method
Wang, Y., Tao, Z., He, C., Huang, N., Jin, L., & Luo, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130170 · Cited by 4
Bootstrap Masked Visual Modeling via Hard Patch Mining
Wang, H., Fan, J., Wang, Y., Song, K., Wang, T., Zhang, X., & Zhang, Z. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3557001 · Cited by 9
Self-citationMulti-Grained Temporal Clip Transformer for Skeleton-Based Human Activity Recognition
Zhu, P., Liang, C., Liu, Y., & Jiang, S. (2025) · Applied Sciences · doi:10.3390/app15094768 · Cited by 4
Few-shot event-based action recognition
Ruan, Z., Pu, N., Chen, J., Gao, S., Guo, Y., Kong, Q., Xie, Y., & Wei, Y. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107750 · Cited by 4
Majumder, S., Nagarajan, T., Al-Halah, Z., Pradhan, R., & Grauman, K. L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02702 · Cited by 9
M2A: Motion Aware Attention for Accurate Video Action Recognition
Gebotys, B., Wong, A. K. C., & Clausi, D. A. (2022) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv55824.2022.00019 · Cited by 4
M2-Conformer: Multi-modal CNN- Transformer for Driving Behavior Detection
Gao, J., Yi, J., & Murphey, Y. L. (2022) · International Symposium on Autonomous Systems (ISAS) · doi:10.1109/isas55863.2022.9757336 · Cited by 4
Integrating Temporal and Spatial Attention for Video Action Recognition
Zhou, Y., Li, B., Wang, Z., & Li, H. (2022) · Security and Communication Networks · doi:10.1155/2022/5094801 · Cited by 4
Focus and Align: Learning Tube Tokens for Video-Language Pre-Training
Zhu, Y., Li, X., Zheng, M., Yang, J., Wang, Z., Guo, X., Chai, Z., Yuan, Y., & Jiang, S. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3231108 · Cited by 4
High-order Correlation Network for Video Recognition
Dong, W., Wang, Z., Zhang, B., Zhang, J., & Zhang, Q. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892897 · Cited by 4
Group Activity Representation Learning With Long-Short States Predictive Transformer
Kong, L., Zhou, W., Pei, D., He, Z., & Huang, D. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3278984 · Cited by 4
Explainable Driver Activity Recognition Using Video Transformer in Highly Automated Vehicle
Sonth, A., Sarkar, A., Bhagat, H., & Abbott, L. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186584 · Cited by 4
Slow feature subspace: A video representation based on slow feature analysis for action recognition
Beleza, S. R. A., Shimomoto, E. K., de Souza, L. S., & Fukui, K. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100493 · Cited by 4
A Pilot Study of Deep Learning Models for Camera based Hand Hygiene Monitoring in ICU
Huang, W., Huang, J., Wang, G., Lu, H., He, M., & Wang, W. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10341146 · Cited by 5
Auxiliary Label Classification Based Multi-Label Limb Movement Recognition of Preterm Infant
Lei, H., Wang, T., Bao, X., Huang, H., & Cao, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3360430 · Cited by 4
Fine-grained Urban Flow Inference with Unobservable Data via Space-Time Attraction Learning
Wang, R., Liu, Y., Gong, Y., Liu, W., Chen, M., Yin, Y., & Zheng, Y. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00176 · Cited by 4
Differentiable Resolution Compression and Alignment for Efficient Video Classification and Retrieval
Deng, R., Wu, Q., Li, Y., & Fu, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446442 · Cited by 4
Person Fall Detection Using Weakly Supervised Methods
Madsen, K., Li, Z., Lauze, F., & Nasrollahi, K. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00023 · Cited by 4
Real-time human action recognition from aerial videos using autozoom and synthetic data
Xian, R., Vogel, B. I., de Melo, C. M., Harrison, A., & Manocha, D. (2024) · Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications · doi:10.1117/12.3013547 · Cited by 4
An Audiovisual Correlation Matching Method Based on Fine-Grained Emotion and Feature Fusion
Su, Z., Feng, Y., Liu, J., Peng, J., Jiang, W., & Liu, J. (2024) · Sensors · doi:10.3390/s24175681 · Cited by 4
A unified framework to stereotyped behavior detection for screening Autism Spectrum Disorder
Yoo, C.-H., Yoo, J., Back, M.-K., Wang, W.-J., & Shin, Y.-G. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.10.001 · Cited by 4
Machine Learning Applied for Spectra Classification
Sun, Y., Brockhauser, S., & Hegedűs, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87013-3_5 · Cited by 4
Suresh, N., Mylavarapu, P. M., Mahankali, N. S., & Channappayya, S. S. (2022) · National Conference on Communications · doi:10.1109/ncc55593.2022.9806466 · Cited by 4
Xia, M., Lin, J., Ying, L., Sun, J., Chi, K., Gao, K., & Yu, K. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3200747 · Cited by 4
Space-Time Crop & Attend: Improving Cross-Modal Video Representation LearningPreprint
Patrick, M., Asano, Y. M., Huang, B., Misra, I., Metze, F., Henriques, J., & Vedaldi, A. (2021) · arXiv (Cornell University) · Cited by 4
Tracking Without Re-recognition in Humans and MachinesPreprint
Linsley, D. A., Malik, G., Kim, J., Govindarajan, L. N., Mingolla, E., & Serre, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13351 · Cited by 5
Liu, R., Azabou, M., Dabagia, M., Xiao, J., & Dyer, E. L. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.10.495595 · Cited by 6
Self-Supervised Feature Extraction for Video Surveillance Anomaly Detection
de Paula, D. D., Salvadeo, D. H. P., Silva, L. D. B., & Uemerson, P. (2023) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi59091.2023.10347173 · Cited by 3
Lin, X., Liu, Y., Chen, F., Chen, Z., Yang, X., & Cui, H. (2024) · Electronics · doi:10.3390/electronics13101813 · Cited by 3
Neighbor Relations Matter in Video Scene Detection
Tan, J., Wang, H., Li, J., Ou, Z., & Qian, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01748 · Cited by 3
Self-citationAbilkassov, S., Gentner, M., Shintemirov, A., Steinbach, E. G., & Popa, M. C. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105443 · Cited by 3
A dual-stage spatiotemporal information fusion network for video prediction
Yuan, J., Wu, F., Zhao, L., & Tang, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127189 · Cited by 3
Wild ActionFormer: Enhancing wildlife action recognition for 11 endangered species in Wolong
Liu, D., Sun, Q., Hou, J., Zheng, B., Zhang, J., Li, D., Norton, T., & Ning, J. (2025) · Ecological Informatics · doi:10.1016/j.ecoinf.2025.103148 · Cited by 3
Detecting Deceptive Behavior via Learning Relation-Aware Visual Representations
Zhu, D., Zhang, C., Hu, R., Wang, M., Liao, L., & Ye, M. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3586468 · Cited by 4
Zhao, J., Zhang, X., Zhang, J., Sun, H., Nie, Q., Xiao, Z., Xiao, L., Zhang, F., Hu, Y., & Liu, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112194 · Cited by 5
CECL: Context-Embedded Contrastive Learning for Enhanced Recognition of Abnormal Behavior
Liu, H. L., Zhao, X. M., Khairuddin, A. S. M., Chuah, J. H., & Fang, L. M. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3593893 · Cited by 3
Chapter-Llama: Efficient Chaptering in Hour-Long Videos with LLMs
Ventura, L., Yang, A., Schmid, C., & Varol, G. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01765 · Cited by 3
M2FM: A Multimodal Fusion Model for Human Action Recognition With Camera and Millimeter-Wave Radar
Yi, J., Zou, H., Ling, M., Jun, G., & Murphey, Y. L. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3600817 · Cited by 3
Toward accurate and efficient weather prediction using a dual-gated spatiotemporal attention network
Zhang, Z., Lin, L., Gao, S., Wang, J., & Zhao, H. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111990 · Cited by 3
Spherical Vision Transformers for Audio-Visual Saliency Prediction in 360$^{\circ }$∘ Videos
Cokelek, M., Ozsoy, H., İmamoğlu, N., Ozcinar, C., Ayhan, İ., Erdem, E., & Erdem, A. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3604091 · Cited by 3
Spatiotemporal Deformable Transformer for Lung Cancer Risk Prediction Using Low-Dose CT Images
Chang, Y.-H., Lin, Y., Meng, H.-C., Wu, S., Lin, Y.-Y., & Huang, C.-R. (2026) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2026.3652592 · Cited by 3
Mishra, P. K., Taati, B., Ye, B., Newman, K., Mihailidis, A., Iaboni, A., & Khan, S. S. (2026) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2026.3656747 · Cited by 3
MFT: Memory-Aware Fine-Tuning of SAM2 for Efficient Long-Sequence Video Object Segmentation
Li, G., Yuan, H., Chen, S., Hu, Q., Wang, J., & Jiang, K. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3663047 · Cited by 3
MamV2XCalib: V2X-based Target-Less Infrastructure Camera Calibration with State Space Model
Zhu, Y., Wang, Z., & Wang, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02478 · Cited by 4
Leveraging Local Temporal Information for Multimodal Scene Classification
Sahu, S., & Goyal, P. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747429 · Cited by 3
Anomalous Behavior Detection with Spatiotemporal Interaction and Autoencoder Enhancement
Li, B., Xie, K., Zeng, X., Cao, M., Wen, C. B., He, J., & Zhang, W. (2023) · Electronics · doi:10.3390/electronics12112438 · Cited by 4
Survey of imitation learning： tradition and new advances
Zhang, C., Bai, W., Du, X., Liu, W., Zhou, C., & Qian, H. (2023) · Journal of Image and Graphics · doi:10.11834/jig.230028 · Cited by 4
SKELTER: unsupervised skeleton action denoising and recognition using transformers
Paoletti, G., Beyan, C., & Bue, A. D. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1203901 · Cited by 4
Comment-Aware Multi-Modal Heterogeneous Pre-Training for Humor Detection in Short-Form Videos
Liu, Y., Ping, H., Zhang, D., Sun, Q., Li, S., & Zhou, G. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230438 · Cited by 3
Learning Semantics-Grounded Vocabulary Representation for Video-Text Retrieval
Shi, Y., Liu, H., Xu, H., Ma, Z., Ye, Q., Hu, A., Yan, M., Zhang, J., Huang, F., Yuan, C., et al. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612537 · Cited by 3
Cross-view Semantic Alignment for Livestreaming Product Recognition
Yang, W., Chen, Y., Li, Y., Cheng, Y., Liu, X., Chen, Q., & Li, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01233 · Cited by 3
Wang, Z., & Che, Z. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150440 · Cited by 3
Adaptive Prototype Learning for Weakly-Supervised Temporal Action Localization
Luo, W., Ren, H., Zhang, T., Yang, W., & Zhang, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3431915 · Cited by 4
UnrealFall: Overcoming Data Scarcity through Generative Models
Mulero-Pérez, D., Benavent-Lledó, M., Ortiz-Pérez, D., & Garcia-Rodriguez, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651116 · Cited by 3
A Video Visual Security Metric Based on Spatiotemporal Self-Attention
Tang, B., Li, F., Liu, J., & Yang, C. Z. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3459731 · Cited by 3
End-to-end Spatio-Temporal Information Aggregation For Micro-Action Detection
Yu, J., Jing, M., Zhao, G., Lu, K., Wang, Y., Zhao, F., Sun, J., Liu, Q., & Liang, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3688974 · Cited by 3
Zheng, H. M., Zhao, Y., Zhang, W., Shang, G., Al-Shamri, M. Y. H., & Aldossary, H. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3521512 · Cited by 3
Novel vision‐LiDAR fusion framework for human action recognition based on dynamic lateral connection
Yan, F., Jin, G., Mu, Z., Zhang, S., Cai, Y., Lü, T., & Yan, Z. (2024) · IET Cyber-Systems and Robotics · doi:10.1049/csy2.70005 · Cited by 3
Real-Time Finger-Video Analysis for Accurate Identity Verification in Mobile Devices
Shrestha, S., Marasco, E., & NOROUZLOU, B. H. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825632 · Cited by 3
Hierarchical Task-aware Temporal Modeling and Matching for few-shot action recognition
Zhan, Y., Pan, Y., Wu, S., Zhang, Y., & Sun, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129467 · Cited by 4
Learning semantical dynamics and spatiotemporal collaboration for human pose estimation in video
Feng, R., & Chen, H. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129581 · Cited by 3
Revisiting Few-Shot Compositional Action Recognition With Knowledge Calibration
Huang, P., Qu, H., & Shu, X. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3542702 · Cited by 3
Multiview Attention Fusion for Explainable Body Language Behavior Recognition
Madan, S., Jain, R., Subramanian, R., & Dhall, A. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3548781 · Cited by 3
Now you see Me: Context-Aware Automatic Audio Description
Lee, S., Wang, J., Fan, D., Zhang, Z., Liu, L. L., Hao, X., Bhat, V., & Li, X. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00540 · Cited by 3
Action-Prompt: A unified visual prompt and fusion network for enhanced video action recognition
Li, L., Tang, M., Qing, S., Zheng, Y., Hu, J., Zhao, M., & Chen, S. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113547 · Cited by 4
Kour, V., Kumar, S., Reddy, T. V., Poojary, K., Misra, R., & Singh, T. N. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3592805 · Cited by 3
Motion-Consistent Representation Learning for UAV-Based Action Recognition
Liu, W., Zhong, X., Dai, Y., Jia, X., Wang, Z., & Satoh, S. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3593805 · Cited by 3
VRAG: Retrieval-Augmented Video Question Answering for Long-Form Videos
Gia, B. T., Le, K., Do, T., Mai, T.-D., Ngo, T. D., Le, D.-D., & Satoh, S. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00354 · Cited by 4
Xu, Y., Heo, S., Kim, D., Kim, H., & Lee, K. J. (2025) · Chemical Engineering Journal · doi:10.1016/j.cej.2025.169281 · Cited by 3
COWO: towards real-time spatiotemporal action localization in videos
Yi, Y., Sun, Y., Yuan, S., Yiji, Z., Zhang, M., & Zhu, W. (2022) · Assembly Automation · doi:10.1108/aa-07-2021-0098 · Cited by 3
Temporal Action Localization With Coarse-to-Fine Network
Zhang, M., Hu, H., & Li, Z. (2022) · IEEE Access · doi:10.1109/access.2022.3205594 · Cited by 3
Contrastive learning–guided multi-meta attention network for breast ultrasound video diagnosis
Huang, X., Lin, Z. R., Huang, S., Wang, F. L., Chan, M.-T., & Wang, L. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.952457 · Cited by 3
Tencent AVS: A Holistic Ads Video Dataset for Multi-Modal Scene Segmentation
Jiang, J., Li, Z., Xiong, J., Quan, R., Lu, Q., & Liu, W. (2022) · IEEE Access · doi:10.1109/access.2022.3227425 · Cited by 3
Multimodal Fatigue Recognition State Based on Eyelid Features
Han, X., & Dai, L. (2023) · IEEE International Conference on Control, Electronics and Computer Technology (ICCECT) · doi:10.1109/iccect57938.2023.10141258 · Cited by 3
An Investigation on Hardware-Aware Vision Transformer Scaling
Li, C., Kim, K., Wu, B., Zhang, P., Zhang, H., Dai, X., Vajda, P., & Lin, Y. (2023) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3611387 · Cited by 3
MCMNET: Multi-Scale Context Modeling Network for Temporal Action Detection
Zhang, H., Zhou, F., Ma, C., Wang, D., & Zhang, W. (2023) · Sensors · doi:10.3390/s23177563 · Cited by 3
Memory-efficient Temporal Moment Localization in Long Videos
Rodríguez-Opazo, C., Marrese-Taylor, E., Fernando, B., Takamura, H., & Wu, Q. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.140 · Cited by 3
A Baseline on Continual Learning Methods for Video Action Recognition
Castagnolo, G., Spampinato, C., Rundo, F., Giordano, D., & Palazzo, S. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222140 · Cited by 3
Madan, S., Jain, R., Sharma, G., Subramanian, R., & Dhall, A. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612858 · Cited by 3
Metadata
- Authors
- Bertasius, G., Wang, H., & Torresani, L.
- Affiliations
- University of Pennsylvania (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 813-824
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.05095
- OpenAlex
- W3126721948
- Cited by
- 1,663
- References
- 58
- Citations by year
- 2026: 161 · 2025: 390 · 2024: 418 · 2023: 387 · 2022: 199 · 2021: 108
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- video classification, self-attention, spatio-temporal attention, TimeSformer, transformer models, divided attention, human action recognition, 3D convolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
