The DOI matches its Crossref record; 98 of the 104 references it cites were found in a registry or an index.
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning
Open accessAbstract
We present a large-scale study on unsupervised spatiotemporal representation learning from videos. With a unified perspective on four recent image-based frameworks, we study a simple objective that can easily generalize all these methods to space-time. Our objective encourages temporally-persistent features in the same video, and in spite of its simplicity, it works surprisingly well across: (i) different unsupervised frameworks, (ii) pre-training datasets, (iii) downstream datasets, and (iv) backbone architectures. We draw a series of intriguing observations from this study, e.g., we discover that encouraging long-spanned persistency can be effective even if the timespan is 60 seconds. In addition to state-of-the-art results in multiple benchmarks, we report a few promising cases in which unsupervised pre-training can outperform its supervised counterpart. Code will be made available at https://github.com/facebookresearch/SlowFast.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Self-citationGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Self-citationHe, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Self-citationGirshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Self-citationBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
(2010) · International Conference on Machine Learning · Cited by 13,995
Research works printed but not linked: 4
- girshick, 2015, Fast r-cnn
- girshick, 2018, Detectron
- 10.1109/ICCV.2019.00996 · DOI
- fan, 2020, Pyslowfast
Cited by
Sorted by citations
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 730
Masked Feature Prediction for Self-Supervised Visual Pre-Training
Wei, C., Fan, H., Xie, S., Wu, C.-Y., Yuille, A., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01426 · Cited by 587
Self-citationVideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
Tong, Z., Song, Y., Wang, J., & Wang, L. (2022) · arXiv · doi:10.48550/arxiv.2203.12602 · Cited by 909
BEVT: BERT Pretraining of Video Transformers
Wang, R., Chen, D., Wu, Z., Chen, Y., Dai, X., Liu, M., Jiang, Y.-G., Zhou, L., & Yuan, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01432 · Cited by 234
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey
Chen, Y., Mancini, M., Zhu, X., & Akata, Z. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3201576 · Cited by 257
Frozen CLIP Models are Efficient Video Learners
Lin, Z., Geng, S., Zhang, R., Gao, P., de Melo, G., Wang, X., Dai, J., Qiao, Y., & Li, H. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19833-5_23 · Cited by 213
A Cookbook of Self-Supervised Learning
Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., Tian, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.12210 · Cited by 182
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
Haliassos, A., Mira, R., Petridis, S., & Pantic, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01453 · Cited by 180
Selva, J., Johansen, A. S., Escalera, S., Nasrollahi, K., Moeslund, T. B., & Clapés, A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3243465 · Cited by 192
TCLR: Temporal contrastive learning for video representation
Dave, I. R., Gupta, R., Rizve, M. N., & Shah, M. A. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103406 · Cited by 165
Shu, X., Xu, B., Zhang, L., & Tang, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3222871 · Cited by 159
Unsupervised Point Cloud Representation Learning With Deep Neural Networks: A Survey
Xiao, A., Huang, J., Guan, D., Zhang, X., Lu, S., & Shao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3262786 · Cited by 183
Self-supervised learning for videos: A survey
Schiappa, M. C., Rawat, Y. S., & Shah, M. (2023) · ACM Computing Surveys · doi:10.1145/3577925 · Cited by 155
SignBERT+: Hand-Model-Aware Self-Supervised Pre-Training for Sign Language Understanding
Hu, H., Zhao, W., Zhou, W., & Li, H. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3269220 · Cited by 167
SVFormer: Semi-supervised Video Transformer for Action Recognition
Xing, Z., Dai, Q., Han, H., Chen, J., Wu, Z., & Jiang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01804 · Cited by 130
Selective Structured State-Spaces for Long-Form Video Understanding
Wang, J., Zhu, W., Wang, P., Yu, X., Liu, L. L., Omar, M., & Hamid, R. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00618 · Cited by 131
Self-supervised Video Transformer
Ranasinghe, K., Naseer, M., Khan, S. H., Khan, F. S., & Ryoo, M. S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00289 · Cited by 128
A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directions
Zhou, S., Xu, H., Zheng, Z., Chen, J., Li, Z., Bu, J., Wu, J. X., Wang, X. Y., Zhu, W., & Ester, M. (2024) · ACM Computing Surveys · doi:10.1145/3689036 · Cited by 251
Broaden Your Views for Self-Supervised Video Learning
Recasens, A., Luc, P., Alayrac, J.-B., Wang, L., Strub, F., Tallec, C., Malinowski, M., Pătrăucean, V., Altché, F., Valko, M., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00129 · Cited by 98
Wang, R., Chen, D., Wu, Z., Chen, Y., Dai, X., Liu, M., Yuan, L., & Jiang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00611 · Cited by 91
Learning from Temporal Gradient for Semi-supervised Action Recognition
Xiao, J., Jing, L., Zhang, L., He, J., She, Q., Zhou, Z., Yuille, A., & Li, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00325 · Cited by 84
SPAct: Self-supervised Privacy Preservation for Action Recognition
Dave, I. R., Chen, C., & Shah, M. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.01953 · Cited by 101
Deep learning serves traffic safety analysis: A forward‐looking review
Razi, A., Chen, X., Li, H., Wang, H., Russo, B. J., Chen, Y., & Yu, H. (2022) · IET Intelligent Transport Systems · doi:10.1049/itr2.12257 · Cited by 83
Dissecting self-supervised learning methods for surgical computer vision
Ramesh, S., Srivastav, V., Alapatt, D., Yu, T., Murali, A., Sestini, L., Nwoye, C. I., Hamoud, I., Sharma, S., Fleurentin, A., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102844 · Cited by 81
Cross-Model Pseudo-Labeling for Semi-Supervised Action Recognition
Xu, Y., Wei, F., Sun, X. N., Yang, C., Shen, Y., Dai, B., Zhou, B., & Lin, S. C.-F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00297 · Cited by 64
Learning To Recognize Procedural Activities with Distant Supervision
Lin, X., Petroni, F., Bertasius, G., Rohrbach, M., Chang, S., & Torresani, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01348 · Cited by 70
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging
Ding, S., Li, M., Yang, T., Qian, R., Xu, H., Chen, Q., Wang, J., & Xiong, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00949 · Cited by 63
C2F-TCN: A Framework for Semi- and Fully-Supervised Temporal Action Segmentation
Singhania, D., Rahaman, R., & Yao, A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3284080 · Cited by 60
Bakhtiari, S., Mineault, P., Lillicrap, T., Pack, C. C., & Richards, B. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.18.448989 · Cited by 65
Probabilistic Representations for Video Contrastive Learning
Park, J., Lee, J., Kim, I.-J., & Sohn, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01430 · Cited by 59
Learning Gait Representation From Massive Unlabelled Walking Videos: A Benchmark
Fan, C., Hou, S., Wang, J., Huang, Y., & Yu, S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3312419 · Cited by 61
MAR: M asked Autoencoders for Efficient A ction R ecognition
Qing, Z., Zhang, S., Huang, Z., Wang, X., Wang, Y., Lv, Y., Gao, C., & Sang, N. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3263288 · Cited by 76
Contrast and Order Representations for Video Self-supervised Learning
Hu, K., Shao, J., Liu, Y., Raj, B., Savvides, M., & Shen, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00784 · Cited by 56
Diffusion Models as Masked Autoencoders
Wei, C., Mangalam, K., Huang, P.-Y., Li, Y., Fan, H., Hu, X., Wang, H., Xie, C., Yuille, A., & Feichtenhofer, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01492 · Cited by 80
Self-citationFan, H., Murrell, T., Wang, H., Alwala, K. V., Li, Y., Li, Y., Xiong, B., Ravi, N., Li, M., Yang, H., et al. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3478329 · Cited by 50
Self-citationAn Improved Inter-Intra Contrastive Learning Framework on Self-Supervised Video Representation
Tao, L., Wang, X., & Yamasaki, T. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3141051 · Cited by 50
Learnable Locality-Sensitive Hashing for Video Anomaly Detection
Lu, Y., Cao, C., Zhang, Y., & Zhang, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3205348 · Cited by 50
Fan, L., Sowmya, A., Meijering, E. H. W., & Song, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3228275 · Cited by 51
Temporal augmented contrastive learning for micro-expression recognition
Wang, T., & Shang, L. (2023) · Pattern Recognition Letters · doi:10.1016/j.patrec.2023.02.003 · Cited by 46
Masked Motion Encoding for Self-Supervised Video Representation Learning
Sun, X., Chen, P., Chen, L., Li, C., Li, T. H., Tan, M., & Gan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00222 · Cited by 48
Frame-wise Action Representations for Long Videos via Sequence Contrastive Learning
Chen, M., Wei, F., Li, C., & Cai, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01343 · Cited by 46
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives
Hoffmann, D. T., Behrmann, N., Gall, J., Brox, T., & Noroozi, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19972 · Cited by 44
CONVIQT: Contrastive Video Quality Estimator
Madhusudana, P. C., Birkbeck, N., Wang, Y.-L., Adsumilli, B., & Bovik, A. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3310344 · Cited by 41
Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning
Qing, Z., Zhang, S., Huang, Z., Zhang, Y., Gao, C., Zhao, D., & Sang, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01281 · Cited by 41
Neighbor-Guided Consistent and Contrastive Learning for Semi-Supervised Action Recognition
Wu, J., Sun, W., Gan, T., Ding, N., Jiang, F., Shen, J., & Nie, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3265261 · Cited by 34
SPARTAN: Self-supervised Spatiotemporal Transformers Approach to Group Activity Recognition
Chappa, N. V. S. R., Nguyen, P., Nelson, A., Seo, H., Li, X., Dobbs, P. D., & Luu, K. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00544 · Cited by 37
Reformulating Graph Kernels for Self-Supervised Space-Time Correspondence Learning
Qin, Z., Lu, X., Liu, D., Nie, X., Yin, Y., Shen, J., & Loui, A. C. P. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3328485 · Cited by 33
SVFAP: Self-Supervised Video Facial Affect Perceiver
Sun, L., Lian, Z., Wang, K., He, Y., Xu, M., Sun, H., Liu, B., & Tao, J. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3436913 · Cited by 38
Improving self-supervised action recognition from extremely augmented skeleton sequences
Guo, T., Liu, M., Liu, H., Wang, G., & Li, W. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110333 · Cited by 28
Iterative Contrast-Classify for Semi-supervised Temporal Action Segmentation
Singhania, D., Rahaman, R., & Yao, A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20124 · Cited by 27
Contextualized Spatio-Temporal Contrastive Learning with Self-Supervision
Yuan, L., Qian, R., Cui, Y., Gong, B., Schroff, F., Yang, M., Adam, H., & Liu, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01359 · Cited by 28
VicTR: Video-conditioned Text Representations for Activity Recognition
Kahatapitiya, K., Arnab, A., Nagran, A., & Ryoo, M. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01755 · Cited by 26
Static and Dynamic Concepts for Self-supervised Video Representation Learning
Qian, R., Ding, S., Liu, X., & Lin, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_9 · Cited by 26
ViewCLR: Learning Self-supervised Video Representation for Unseen Viewpoints
Das, S., & Ryoo, M. S. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00553 · Cited by 26
XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning
Sarkar, P., & Etemad, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29407 · Cited by 36
Contrastive Learning of Image Representations with Cross-Video Cycle-Consistency
Wu, H., & Wang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00999 · Cited by 26
A Semantic and Motion-Aware Spatiotemporal Transformer Network for Action Detection
Korban, M., Youngs, P. A., & Acton, S. T. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3377192 · Cited by 25
Self-Supervised Contrastive Learning for Cross-Domain Hyperspectral Image Representation
Lee, H., & Kwon, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747010 · Cited by 24
Learning to Align Sequential Actions in the Wild
Liu, W., Tekin, B., Coskun, H., Vineet, V., Fua, P., & Pollefeys, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00222 · Cited by 25
Duan, H., Zhao, N., Chen, K., & Lin, D.-H. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.00301 · Cited by 28
Hierarchical Self-supervised Representation Learning for Movie Understanding
Xiao, F., Kundu, K., Tighe, J., & Modolo, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00950 · Cited by 24
Dave, I. R., Rizve, M. N., Chen, C., & Shah, M. A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00232 · Cited by 22
Controllable augmentations for video representation learning
Qian, R., Lin, W., See, J., & Li, D. (2024) · Visual Intelligence · doi:10.1007/s44267-023-00034-7 · Cited by 23
LAC - Latent Action Composition for Skeleton-based Action Segmentation
Yang, D., Wang, Y., Dantcheva, A., Kong, Q., Garattoni, L., Francesca, G., & Brémond, F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01258 · Cited by 22
Dual Contrastive Learning for Spatio-temporal Representation
Ding, S., Qian, R., & Xiong, H. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547783 · Cited by 20
Audio-Visual Contrastive Learning with Temporal Self-Supervision
Jenni, S., Black, A., & Collomosse, J. P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25967 · Cited by 21
PointClustering: Unsupervised Point Cloud Pre-training using Transformation Invariance in Clustering
Long, F.-C., Yao, T., Qiu, Z.-F., Li, L., & Mei, T. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.02090 · Cited by 25
Long, B., Goodin, S., Kachergis, G., Marchman, V. A., Radwan, S. F., Sparks, R. Z., Xiang, V., Zhuang, C., Hsu, O., Newman, B., et al. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02206-1 · Cited by 25
COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting Using Transformers
Denize, J., Liashuha, M., Rabarisoa, J., Orcesi, A., & Hérault, R. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00060 · Cited by 23
Scene Consistency Representation Learning for Video Scene Segmentation
Wu, H., Chen, K., Luo, Y., Qiao, R., Ren, B., Liu, H., Xie, W., & Shen, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01363 · Cited by 23
BaSSL: Boundary-aware Self-Supervised Learning for Video Scene Segmentation
Mun, J., Shin, M., Han, G., Lee, S., Ha, S., Lee, J., & Kim, E. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26316-3_29 · Cited by 22
Koala: Key Frame-Conditioned Long Video-LLM
Tan, R., Sun, X., Hu, P., Wang, J.-H., Deilamsalehy, H., Plummer, B. A., Russell, B. C., & Saenko, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01289 · Cited by 25
How Severe Is Benchmark-Sensitivity in Video Self-supervised Learning?
Thoker, F. M., Doughty, H., Bagad, P., & Snoek, C. G. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19830-4_36 · Cited by 18
Zhao, W., Zhou, W., Hu, H., Wang, M., & Li, H. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3416881 · Cited by 22
Self-Supervised Scene-Debiasing for Video Representation Learning via Background Patching
Assefa, M., Jiang, W., Gedamu, K., Yilma, G., Kumeda, B., & Ayalew, M. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3193559 · Cited by 17
AssistQ: Affordance-Centric Question-Driven Task Completion for Egocentric Assistant
Wong, B., Chen, J., Wu, Y., Lei, S. W., Mao, D., Gao, D., & Shou, M. Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20059-5_28 · Cited by 22
Time Does Tell: Self-Supervised Time-Tuning of Dense Image Representations
Salehi, M., Gavves, E., Snoek, C. G. M., & Asano, Y. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01516 · Cited by 15
Asymmetric Masked Distillation for Pre-Training Small Foundation Models
Zhao, Z., Huang, B., Xing, S., Wu, G., Qiao, Y., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01752 · Cited by 17
Learning visual language models for video understanding
Yang, A. (2023) · theses.fr (ABES) · doi:10.70675/802872a7z8092z4556za1fdz2c7af45f0e72 · Cited by 26
About Time: Advances, Challenges, and Outlooks of Action Understanding
Stergiou, A., & Poppe, R. W. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02478-4 · Cited by 17
Motion Sensitive Contrastive Learning for Self-supervised Video Representation
Ni, J., Zhou, N., Qin, J., Wu, Q., Liu, J., Li, B., & Huang, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19833-5_27 · Cited by 14
Federated Self-supervised Learning for Video Understanding
Rehman, Y. A. U., Gao, Y., Shen, J., de Gusmão, P. P. B., & Lane, N. D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19821-2_29 · Cited by 14
AVForensics: Audio-driven Deepfake Video Detection with Masking Strategy in Self-supervision
Zhu, Y., Gao, J., & Zhou, X. (2023) · International Conference on Multimedia Retrieval · doi:10.1145/3591106.3592218 · Cited by 14
Self-Supervised Representation Learning From Temporal Ordering of Automated Driving Sequences
Lang, C., Braun, A., Schillingmann, L., Haug, K., & Valada, A. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3354552 · Cited by 14
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models
Tseng, Y., Berry, L., Chen, Y.-T., Chiu, I.-H., Lin, H.-H., Liu, M., Peng, P., Shih, Y.-J., Wang, H., Wu, H., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445941 · Cited by 15
Conformer-Based Self-Supervised Learning For Non-Speech Audio Tasks
Srivastava, S., Wang, Y., Tjandra, A., Kumar, A., Liu, C., Singh, K., & Saraf, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746490 · Cited by 16
MaCLR: Motion-Aware Contrastive Learning of Representations for Videos
Xiao, F., Tighe, J., & Modolo, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19833-5_21 · Cited by 20
Anomaly-aware self-supervised feature learning for weakly supervised video anomaly detection
Yang, Z., Wang, G., Guo, Y., Bao, X., & Huang, D. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104379 · Cited by 13
Contrastive Spatio-Temporal Pretext Learning for Self-Supervised Video Representation
Zhang, Y., Po, L.-M., Xu, X., Liu, M., Wang, Y., Ou, W., Zhao, Y., & Yu, W.-Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20248 · Cited by 13
A Deep Autoencoder-Based Approach for Suspicious Action Recognition in Surveillance Videos
Ahmed, W., & Yousaf, M. H. (2023) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-023-08038-7 · Cited by 13
Learning Text-to-Video Retrieval from Image Captioning
Ventura, L., Schmid, C., & Varol, G. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02202-8 · Cited by 13
Wang, Z., Liu, C., Zhu, L., Wang, T., Zhang, S., & Dou, Q. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3532311 · Cited by 16
Qing, Z., Zhang, S., Huang, Z., Xu, Y., Wang, X., Tang, M., Gao, C., Jin, R., & Sang, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01345 · Cited by 12
Deng, A., Yang, T., & Chen, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01876 · Cited by 12
Video Foundation Models for Animal Behavior AnalysisPreprint
Sun, J. J., Zhou, H., Zhao, L., Yuan, L., Seybold, B., Hendon, D., Schroff, F., Ross, D. A., Adam, H., Hu, B., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.07.30.605655 · Cited by 16
Objects do not disappear: Video object detection by single-frame object location anticipation
Liu, X., Nejadasl, F. K., van Gemert, J. C., Booij, O., & Pintea, S. L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00640 · Cited by 11
Enhanced Motion-Text Alignment for Image-to-Video Transfer Learning
Zhang, W., Wan, C., Liu, T., Tian, X., Shen, X., & Ye, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01751 · Cited by 13
Hernandez, J., Villegas, R., & Ordóñez, V. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73235-5_25 · Cited by 15
Self-Supervised Video Representation Learning via Latent Time Navigation
Yang, D., Wang, Y., Kong, Q., Dantcheva, A., Garattoni, L., Francesca, G., & Brémond, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25416 · Cited by 11
Deep Unsupervised Representation Learning for Feature-Informed EEG Domain Extraction
Ng, H. W., & Guan, C. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3339179 · Cited by 11
Metadata
- Authors
- Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K.
- Affiliations
- Meta (United States) (US)
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 3298-3308
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3170837227
- Cited by
- 222
- References
- 104
- Citations by year
- 2026: 10 · 2025: 33 · 2024: 49 · 2023: 67 · 2022: 49 · 2021: 13
- FWCI
- 14.56
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- unsupervised feature learning, spatio-temporal representation learning, SlowFast, video understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
