Cited by 313Human Pose and Action RecognitionMultimodal Machine Learning ApplicationsAdvanced Neural Network Applications

The DOI matches its Crossref record; 87 of the 92 references it cites were found in a registry or an index.

Multiview Transformers for Video Recognition

Open access

Yan, Shen, Xiong, Xuehan, Arnab, Anurag, Lu, Zhichao, Zhang, Mi, Sun, Chen, Schmid, Cordelia·2022·2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

DOI 10.1109/cvpr52688.2022.00333

Open this paper in CoChat — free account Open PDF

Abstract

Video understanding requires reasoning at multiple spatiotemporal resolutions – from short fine-grained motions to events taking place over longer durations. Although transformer architectures have recently advanced the state-of-the-art, they have not explicitly modelled different spatiotemporal resolutions. To this end, we present Multiview Transformers for Video Recognition (MTV). Our model consists of separate encoders to represent different views of the input video with lateral connections to fuse information across views. We present thorough ablation studies of our model and show that MTV consistently performs better than single-view counterparts in terms of accuracy and computational cost across a range of model sizes. Furthermore, we achieve state-of-the-art results on six standard datasets, and improve even further with large-scale pretraining. Code and checkpoints are available at: https://github.com/google-research/scenic.

Integrity signals

Registry

Crossref · 10.1109/cvpr52688.2022.00333

Cites

87 of 87 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
MizAR 60 for Mizar 50
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562

Flagged first, then by citations

Show all 92 references

5 of the 92 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

10.1088/0954-898X/14/3/302 · DOI
adelson, 1984, Pyramid methods in image processing, RCA Engineer, 29, 33
bouguet, 2001, Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm, Intel Corporation, 5, 4

Sorted by citations

Items 101–200 of 313

Gated Multi-Scale Transformer for Temporal Action Localization
Yang, J., Wei, P., Ren, Z., & Zheng, N. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3338082 · Cited by 14
A teacher–student deep learning strategy for extreme low resolution unsafe action recognition in construction projects
Yang, M., Chengke, W., Guo, Y., He, Y. Z., Jiang, R., Jiang, J., & Yang, Z. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102294 · Cited by 14
CANet: Comprehensive Attention Network for video-based action recognition
Gao, X., Chang, Z., Ran, X., & Lu, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111852 · Cited by 15
View-interactive attention information alignment-guided fusion for incomplete multi-view clustering
Shu, Z., Luo, Y., Huang, Y., Mao, C., & Yu, Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124258 · Cited by 14
Echo-Vision-FM: a pre-training and fine-tuning framework for echocardiogram video vision foundation model
Zhang, Z., Wu, Q., Ding, S., Wang, X., & Ye, J. (2025) · Nature Communications · doi:10.1038/s41467-025-66340-4 · Cited by 19
Multimodal Vision Transformers with Forced Attention for Behavior Analysis
Agrawal, T., Balazia, M., Müller, P., & Brémond, F. (2022) · IEEE Workshop/Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00339 · Cited by 15
MTFL: multi-timescale feature learning for weakly-supervised anomaly detection in surveillance videos
Zhang, Y., Akdag, E., Bondarev, E., & de With, P. H. N. (2025) · International Conference on Machine Vision · doi:10.1117/12.3055069 · Cited by 13
Screening of Dementia on OCTA Images via Multi-projection Consistency and Complementarity
Wang, X., Li, H., Xiao, Z., Fu, H., Zhao, Y., Jin, R., Zhang, S., Kwapong, W. R., Zhang, Z., Miao, H., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16434-7_66 · Cited by 13
Multi-Task Learning of Object States and State-Modifying Actions From Web Videos
Souček, T., Alayrac, J.-B., Miech, A., Laptev, I., & Šivic, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3362288 · Cited by 17
Residual deep gated recurrent unit-based attention framework for human activity recognition by exploiting dilated features
Pandey, A., & Kumar, P. (2024) · The Visual Computer · doi:10.1007/s00371-024-03266-w · Cited by 12
PGVT: Pose-Guided Video Transformer for Fine-Grained Action Recognition
Zhang, H., Leong, M. C., Li, L., & Lin, W. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00651 · Cited by 13
Generating Action-conditioned Prompts for Open-vocabulary Video Action Recognition
Jia, C., Luo, M., Chang, X., Dang, Z., Han, M., Wang, M., Dai, G., Dang, S., & Wang, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680690 · Cited by 12
ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video
Li, X., Zhu, Y., & Wang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73010-8_25 · Cited by 20
Fluxformer: Flow-Guided Duplex Attention Transformer via Spatio-Temporal Clustering for Action Recognition
Hong, Y., Kim, M. J., Lee, I., & Yoo, S. B. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3307285 · Cited by 13
Scene adaptive mechanism for action recognition
Wu, C., Wu, X., Wu, X., & Kittler, J. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103854 · Cited by 13
Multimodal action recognition: a comprehensive survey on temporal modeling
Shabaninia, E., Nezamabadi–pour, H., & Shafizadegan, F. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17345-y · Cited by 31
Integration of Feature and Decision Fusion With Deep Learning Architectures for Video Classification
Kızıltepe, R. S., Gan, J. Q., & Escobar, J. J. (2024) · IEEE Access · doi:10.1109/access.2024.3360929 · Cited by 14
Cmf-transformer: cross-modal fusion transformer for human action recognition
Wang, J., Xia, L., & Wen, X. (2024) · Machine Vision and Applications · doi:10.1007/s00138-024-01598-0 · Cited by 11
PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition
Zhang, H., Leong, M. C., Li, L., & Lin, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01784 · Cited by 11
Enhanced Motion-Text Alignment for Image-to-Video Transfer Learning
Zhang, W., Wan, C., Liu, T., Tian, X., Shen, X., & Ye, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01751 · Cited by 13
ViC-MAE: Self-supervised Representation Learning from Images and Video with Contrastive Masked Autoencoders
Hernandez, J., Villegas, R., & Ordóñez, V. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73235-5_25 · Cited by 15
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 116
LSTPNet: Long short-term perception network for dynamic facial expression recognition in the wild
Lu, C., Jiang, Y., Fu, K., Zhao, Q., & Yang, H. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.104915 · Cited by 10
Enhancing multiview synergy: Robust learning by exploiting the wave loss function with consensus and complementarity principles
Quadir, A., Akhtar, M., & Tanveer, M. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107433 · Cited by 13
Bi-calibration Networks for Weakly-Supervised Video Representation Learning
Long, F., Yao, T., Qiu, Z., Tian, X., Luo, J., & Mei, T. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01779-w · Cited by 10
Spatio-Temporal Convolution-Attention Video Network
Diba, A., Sharma, V., Arzani, M. M., & Gool, L. V. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00093 · Cited by 9
Video-Language Graph Convolutional Network for Human Action Recognition
Zhang, R., & Yan, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445852 · Cited by 9
PosMLP-Video: Spatial and Temporal Relative Position Encoding for Efficient Video Recognition
Hao, Y., Zhou, D., Wang, Z., Ngo, C., He, X., & Wang, M. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02154-z · Cited by 9
Multi-Task Spatial-Temporal Transformer for Multi-Variable Meteorological Forecasting
Li, T.-B., Liu, A.-A., Song, D., Li, W., Zhang, J., Wei, Z., & Su, Y.-T. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3432599 · Cited by 9
A new intelligent power quality disturbance classification in renewable and decentralized hydrogen-based energy systems using SwResNET hybrid model
Küçüker, A., BARAKLI, B., Bayrak, G., Başaran, K., & Balaban, G. (2025) · Renewable Energy · doi:10.1016/j.renene.2025.123251 · Cited by 9
Multi-stream network with key frame sampling for human action recognition
Xia, L., & Wen, X. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-05893-5 · Cited by 9
A*: Atrous Spatial Temporal Action Recognition for Real Time Applications
Kim, M., Spinola, F., Benz, J. P., & Kim, T. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00686 · Cited by 9
Cap4Video++: Enhancing Video Understanding With Auxiliary Captions
Wu, W., Wang, X., Luo, H., Wang, J., Yang, Y., & Ouyang, W. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3410329 · Cited by 9
LightHART: Lightweight Human Activity Recognition Transformer
Haque, S. T., Ni, J., Li, J., Yan, Y., & Ngu, A. H. H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78354-8_27 · Cited by 8
Semantic Feature Graph Consistency with Contrastive Cluster Assignments for Multilingual Document Clustering
Sun, T., Shu, Z., Huang, Y., Wang, H., & Yu, Z. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3708887 · Cited by 8
Human Activity Recognition Based On Video Summarization And Deep Convolutional Neural Network
Kushwaha, A., Khare, M., Mounika, B., & Khare, A. (2024) · The Computer Journal · doi:10.1093/comjnl/bxae028 · Cited by 8
MA-VLAD: a fine-grained local feature aggregation scheme for action recognition
Feng, N., Tang, Y. G., Song, Z., Yu, J., Chen, Y. P., & Yang, W. H. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01341-9 · Cited by 9
M-adapter: Multi-level image-to-video adaptation for video action recognition
Li, R., Xu, T., Wu, X., Li, L., Yang, X. P., Shen, Z., & Kittler, J. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104150 · Cited by 8
Match Cutting: Finding Cuts with Smooth Visual Transitions
Chen, B., Ziai, A., Tucker, R. S., & Xie, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00215 · Cited by 13
DEVIAS: Learning Disentangled Video Representations of Action and Scene
Bae, K., Ahn, G., Kim, Y., & Choi, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73113-6_25 · Cited by 7
Feature Hallucination for Self-supervised Action Recognition
Wang, L., & Koniusz, P. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02513-4 · Cited by 7
Cross-view action recognition understanding from exocentric to egocentric perspective
Truong, T.-D., & Luu, K. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128731 · Cited by 10
Action recognition based on discrete cosine transform by optical pixel-wise encoding
Liang, Y., Huang, H., Li, J., Dong, X., Chen, M., Yang, S., & Chen, H. (2022) · APL Photonics · doi:10.1063/5.0109807 · Cited by 7
BDNet: a method based on forward and backward convolutional networks for action recognition in videos
Leng, C., Ding, Q., Wu, C., Chen, A., Wang, H., & Wu, H. (2023) · The Visual Computer · doi:10.1007/s00371-023-03073-9 · Cited by 8
Iterative Temporal-spatial Transformer-based Cardiac T1 Mapping MRI Reconstruction
Lyu, J., Wang, G., & Hossain, M. S. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3643640 · Cited by 7
TA-NET: Empowering Highly Efficient Traffic Anomaly Detection Through Multi-Head Local Self-Attention and Adaptive Hierarchical Feature Reconstruction
Chen, J., Pu, J., Yin, B., Zhang, R., & Wu, J. J. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3365820 · Cited by 6
Mahalanobis Distance-Based Multi-view Optimal Transport for Multi-view Crowd Localization
Zhang, Q., Zhang, K., Chan, A. B., & Huang, H. F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73235-5_2 · Cited by 6
Multi-scale structure-guided graph generation for multi-view semi-supervised classification
Wu, Y., Chen, Z., Zou, Y., Wang, S., & Guo, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125677 · Cited by 6
SQL-Net: Semantic Query Learning for Point-Supervised Temporal Action Localization
Wang, Y., Zhao, S., & Chen, S. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521799 · Cited by 6
Deep4Fusion: A Deep FORage Fusion framework for high-throughput phenotyping for green and dry matter yield traits
Rodrigues, L. D. S., Filho, E. C., Sakiyama, K. M., Santos, M. F., Jank, L., Carromeu, C., Silveira, E., Matsubara, E. T., Marcato, J., & Gonçalves, W. N. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107957 · Cited by 6
LGAFormer: transformer with local and global attention for action detection
Zhang, H., Zhou, F., Wang, D., Zhang, X., Yu, D., & Guan, L. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06138-1 · Cited by 6
ExoTST: Exogenous-Aware Temporal Sequence Transformer for Time Series Prediction
Tayal, K., Renganathan, A., Jia, X., Kumar, V., & Lu, D. (2024) · Proceedings · doi:10.1109/icdm59182.2024.00105 · Cited by 9
Towards Automated Ethogramming: Cognitively-Inspired Event Segmentation for Streaming Wildlife Video Monitoring
Mounir, R., Shahabaz, A., Gula, R., Theuerkauf, J., & Sarkar, S. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01781-2 · Cited by 6
Inflated 3D Convolution-Transformer for Weakly-Supervised Carotid Stenosis Grading with Ultrasound Videos
Zhou, X., Huang, Y., Xue, W., Yang, X., Zou, Y., Ying, Q., Zhang, Y., Liu, J., Ren, J., & Ni, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43895-0_48 · Cited by 6
Understanding Video Transformers: A Review on Key Strategies for Feature Learning and Performance Optimization
Chen, N., Xu, T., Sun, M., Yao, C., & Yang, D. (2025) · Intelligent Computing · doi:10.34133/icomputing.0143 · Cited by 5
Geo‐spatial traffic behaviour analysis and anomaly detection for ITS applications
Akdag, E., D’Amicantonio, G., Vijverberg, J. A., Stajan, D., Beers, B. J., de With, P. H. N., & Bondarev, E. (2024) · IET Intelligent Transport Systems · doi:10.1049/itr2.12591 · Cited by 5
Feature distillation from vision-language model for semisupervised action classification
ÇELİK, A., Küçükmanіşa, A., & Urhan, O. (2023) · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · doi:10.55730/1300-0632.4038 · Cited by 5
Learning Temporal Dynamics in Videos With Image Transformer
Shu, Y., Qiu, Z., Long, F., Yao, T., Ngo, C., & Mei, T. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3383662 · Cited by 7
HybridMammoNet: A Hybrid CNN-ViT Architecture for Multi-view Mammography Image Classification
Allaoui, H., Alj, Y., & Ameskine, Y. (2024) · International Symposium on Signal, Image, Video and Communications (ISIVC) · doi:10.1109/isivc61350.2024.10577856 · Cited by 5
Translating Motion to Notation: Hand Labanotation for Intuitive and Comprehensive Hand Movement Documentation
Li, L., Yang, W., Yu, X., Xing, J., & Zhang, X.-P. S. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680568 · Cited by 5
Spatio temporal 3D skeleton kinematic joint point classification model for human activity recognition
Karthika, S., Jane, Y. N., & Nehemiah, H. K. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104471 · Cited by 5
I Know How You Move: Explicit Motion Estimation for Human Action Recognition
Shen, Z., Wu, X., Li, H., Xu, T., & Wu, C. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3211423 · Cited by 5
SlowFast Multimodality Compensation Fusion Swin Transformer Networks for RGB-D Action Recognition
Xiao, X., Ren, Z., Li, H., Wei, W., Yang, Z., & Yang, H. (2023) · Mathematics · doi:10.3390/math11092115 · Cited by 5
F2D-SIFPNet: a frequency 2D Slow-I-Fast-P network for faster compressed video action recognition
Ming, Y., Zhou, J., Jia, X., Zheng, Q., Xiong, L., Feng, F., & Hu, N. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05408-y · Cited by 5
Spatial-temporal multiscale feature optimization based two-stream convolutional neural network for action recognition
Xia, L., & Fu, W. (2024) · Cluster Computing · doi:10.1007/s10586-024-04553-w · Cited by 5
A Survey on Backbones for Deep Video Action Recognition
Tang, Z., Zhao, Y., Wen, Y., & Liu, M. (2024) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew63481.2024.10645423 · Cited by 8
The Journey of Action Recognition
Xi, D., & Wang, L. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3717746 · Cited by 6
Temporal information oriented motion accumulation and selection network for RGB-based action recognition
Wang, H., Li, H., Liu, W., & Gu, X. D. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104785 · Cited by 5
EgoPPG: Heart Rate Estimation From Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks
Braun, B., Armani, R., Meier, M., Moebus, M., & Holz, C. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00529 · Cited by 5
A Hierarchical Joint Training Based Replay-Guided Contrastive Transformer for Action Quality Assessment of Figure Skating
Liu, Y., Cheng, X., & Ikenaga, T. (2024) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.2024smp0003 · Cited by 4
TAMT: Temporal-Aware Model Tuning for Cross-Domain Few-Shot Action Recognition
Wang, Y., Gao, Z., Wang, Q., Chen, Z., Li, P., & Hu, Q. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00327 · Cited by 8
Foundation Models for Speech, Images, Videos, and Control
Paaß, G., & Giesselbach, S. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-3-031-23190-2_7 · Cited by 6
Jointly Modeling Spatio-Temporal Features of Tactile Signals for Action Classification
Lin, J., Li, J., Gao, J., Ma, W., & Liu, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29288 · Cited by 4
EgoFormer: Ego-Gesture Classification in Context of Autonomous Driving
Qazi, T., Kumar, M. R., Mukherjee, P., & Lall, B. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3390794 · Cited by 5
VLG: General Video Recognition with Web Textual Knowledge
Lin, J., Liu, Z., Wang, W., Wu, W., & Wang, L. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02081-z · Cited by 5
Day2Dark: Pseudo-Supervised Activity Recognition Beyond Silent Daylight
Zhang, Y., Doughty, H., & Snoek, C. G. M. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02273-7 · Cited by 4
Accelerating convolutional neural networks on FPGA platforms: a high-performance design methodology using OpenCL
Gdaim, S., & Mtibaa, A. (2025) · Journal of Real-Time Image Processing · doi:10.1007/s11554-025-01647-5 · Cited by 4
A Vision Transformer Architecture for Open Set Recognition
Cai, F., Zhang, Z., Liu, J., & Koutsoukos, X. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00034 · Cited by 4
Action Recognition and Detection Based on Deep Learning: A Comprehensive Summary
Li, Y., Liang, Q., Gan, B., & Cui, X. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.042494 · Cited by 7
Action understanding in low-light and pitch-dark conditions: A comprehensive survey
Munsif, M., Khan, S. U., Khan, N., Hussain, A., & Baik, S. W. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111996 · Cited by 3
AFFS: Adaptive Fast Frequency Selection Algorithm for Deep Learning Feature Extraction
Li, X., Xie, K., He, Z., Wen, J., Cao, J., Zhang, G., Xie, G., & Liang, W. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3638836 · Cited by 3
Enhancing Weakly Supervised Multimodal Video Anomaly Detection Through Text Guidance
Sun, S., Hua, J., Feng, J., & Gong, X. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3668927 · Cited by 3
MOMA: Mixture-of-Modality-Adaptations for Transferring Knowledge from Image Models Towards Efficient Audio-Visual Action Recognition
Wang, K., & Hatzinakos, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446627 · Cited by 3
Rethinking Image-to-Video Adaptation: An Object-Centric Perspective
Qian, R., Ding, S., & Lin, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72775-7_19 · Cited by 5
TeG: Temporal-Granularity Method for Anomaly Detection with Attention in Smart City Surveillance
Akdag, E., Bondarev, E., & de With, P. H. N. (2024) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip63160.2024.10849819 · Cited by 3
Vehicle lane change behavior recognition based on multi-scale three-stream 3D ResNets
Chao, X., Qi, X., Ding, R., & Ji, G. (2025) · Multimedia Systems · doi:10.1007/s00530-024-01664-7 · Cited by 3
Gated Region-Refine pose transformer for human pose estimation
Wang, T., & Zhang, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.090 · Cited by 3
Less is More: Decoupled High-Semantic Encoding for Action Recognition
Zhang, C., Ren, K., Bian, Q., & Shi, Y. (2023) · International Conference on Multimedia Retrieval · doi:10.1145/3591106.3592233 · Cited by 3
Joint long and short span self-attention network for multi-view classification
Chen, Z., Lou, K., Liu, Z., Li, Y., Luo, Y. T., & Zhao, L. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121152 · Cited by 3
Marker-Free Computer Vision for Human Motion Analysis: A Review
Kaushik, V., Bhugra, S., Gupta, A. K., & Lall, B. (2023) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew59549.2023.00043 · Cited by 3
MTSN: Multiscale Temporal Similarity Network for Temporal Action Localization
Xiao-dong, J., & Zhang, T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612455 · Cited by 3
Slowfast Diversity-aware Prototype Learning for Egocentric Action Recognition
Dai, G., Shu, X., Yan, R., Huang, P. F., & Tang, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612144 · Cited by 3
TeST: Temporal–spatial separated transformer for temporal action localization
Wan, H., Luo, M., Zhi-hui, L., & Wang, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128688 · Cited by 3
Selective Volume Mixup for Video Action Recognition
Tan, Y., Qiu, Z., Hao, Y., Yao, T., & Mei, T. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02605-1 · Cited by 3
T1/T2 Relaxation Temporal Modelling from Accelerated Acquisitions Using a Latent Transformer
Tänzer, M., Wang, F., Qiao, M., Bai, W., Rueckert, D., Yang, G., & Nielles‐Vallespin, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-52448-6_28 · Cited by 2
CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets
Agrawal, T., Guermal, M., Balážia, M., & Brémond, F. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00717 · Cited by 2
Self-supervised suppression of MRI cardiac device artifacts based on multi-instance contrastive learning and anisotropic spatiotemporal transformer
Chen, Z., Emu, Y., Chen, H., Xue, Z., Gao, J., Yang, F., Gao, C., Tang, X., Hu, J., & Hu, C. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102598 · Cited by 2
Temporal Attention-based Vision Transformer for Source-Free Video Unsupervised Domain Adaptation
Yosry, S., Elrefaei, L. A., ElKamaar, R., & Ziedan, R. R. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-06909-2 · Cited by 3
EAAR: Efficient and Accurate Action Recognition model with enhanced spatio-temporal perception
Chen, S., Wang, X., Sun, Y., Yang, K., & Wei, X. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107737 · Cited by 2
${\text{CA}^{2}\text{ST}}$: Cross-Attention in Audio, Space, and Time for Holistic Video Recognition
Lee, J., Chang, J., Lee, D., & Choi, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3628653 · Cited by 6

Authors: Yan, S., Xiong, X., Arnab, A., Lu, Z., Zhang, M., Sun, C., & Schmid, C.
Affiliations: Michigan State University
Google (United States) (US)
Michigan State University (US)
Brown University (US)
ORCID: Arnab, Anurag
Lu, Zhichao
Zhang, Mi
Sun, Chen
Schmid, Cordelia
Venue: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher: IEEE
Published: 2022-06
Pages: 3323-3333
ISSN: 1063-6919 (ISSN-L)
DOI: 10.1109/cvpr52688.2022.00333
OpenAlex: W4312658081
Cited by: 312
References: 92
Citations by year: 2026: 26 · 2025: 63 · 2024: 115 · 2023: 91 · 2022: 17
FWCI: 25.93
Type: conference paper
Language: en
Open access: green
arxiv.org
Licence: cc-by
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
arXiv (Cornell University) (submittedVersion, cc-by)
arXiv (Cornell University) (cc-by)
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords: video recognition, spatiotemporal resolution, view fusion, lateral connections, video encoder, pre-training, computational efficiency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Multiview Transformers for Video Recognition

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks