The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples
Open accessAbstract
MoCo [11] is effective for unsupervised image representation learning. In this paper, we propose VideoMoCo for unsupervised video representation learning. Given a video sequence as an input sample, we improve the temporal feature representations of MoCo from two perspectives. First, we introduce a generator to drop out several frames from this sample temporally. The discriminator is then learned to encode similar feature representations regardless of frame removals. By adaptively dropping out different frames during training iterations of adversarial learning, we augment this input sample to train a tempo-rally robust encoder. Second, we use temporal decay to model key attenuation in the memory queue when computing the contrastive loss. As the momentum encoder updates after keys enqueue, the representation ability of these keys degrades when we use the current input sample for contrastive learning. This degradation is reflected via temporal decay to attend the input sample to recent keys in the queue. As a result, we adapt MoCo to learn video representations without empirically designing pretext tasks. By empowering the temporal robustness of the encoder and modeling the temporal decay of the keys, our VideoMoCo improves MoCo temporally based on contrastive learning. Experiments on benchmark datasets including UCF101 and HMDB51 show that VideoMoCo stands as a state-of-the-art video representation learning method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Bag of Tricks for Image Classification with Convolutional Neural Networks
He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00065 · Cited by 1,680
Research works printed but not linked: 35
- 10.1109/ICCV.2019.00756 · DOI · Paper page
- 10.1109/ICCV.2019.00810 · DOI
- 10.1109/ICCV.2017.606 · DOI · Paper page
- soomro, 2012, A dataset of 101 human action classes from videos in the wild, Computer and Vision Research Center
- 10.1109/CVPR.2018.00937 · DOI · Paper page
- 10.1109/ICCV.2017.279 · DOI · Paper page
- 10.1109/CVPR42600.2020.00674 · DOI · Paper page
- arjovsky, 2017, Wasserstein generative adversarial networks, International Conference on Machine Learning
- chen, 2020, A simple framework for contrastive learning of visual representations, International Conference on Machine Learning
- buchler, 2018, Improving spatiotemporal self-supervision by deep reinforcement learning, European Conference on Computer Vision
- korbar, 2018, Cooperative learning of audio and video models from self-supervised synchronization, Neural Information Processing Systems
- 10.1109/CVPR.2019.00202 · DOI · Paper page
- 10.1109/2.36 · DOI · Paper page
- 10.1109/ICCV.2017.79 · DOI · Paper page
- 10.1609/aaai.v34i07.6840 · DOI
- liu, 2020, Rethinking image inpainting via a mutual encoder-decoder with feature equalizations, European Conference on Computer Vision
- 10.1109/CVPR.2019.01058 · DOI · Paper page
- 10.1109/CVPR42600.2020.00672 · DOI · Paper page
- 10.1109/CVPR42600.2020.00658 · DOI · Paper page
- 10.1109/ICCVW.2019.00186 · DOI · Paper page
- tian, 2020, Con-trastive multiview coding, European Conference on Computer Vision
- jenni, 2020, Video representation learning by recognizing temporal transformations, European Conference on Computer Vision
- jia, 2020, Robust tracking against adversarial attacks, European Conference on Computer Vision
- 10.1609/aaai.v33i01.33018545 · DOI · Paper page
- 10.1109/CVPR.2019.00190 · DOI · Paper page
- goodfellow, 2014, Generative adversarial nets, Neural Information Processing Systems
- 10.1109/CVPR.2018.00586 · DOI
- 10.1109/CVPR.2017.525 · DOI · Paper page
- 10.1109/CVPR.2006.100 · DOI · Paper page
- 10.1109/CVPR.2019.00267 · DOI · Paper page
- 10.1007/s11263-020-01357-4 · DOI
- wang, 2020, Rethinking image deraining via rain streaks and vapors, European Conference on Computer Vision
- vondrick, 2018, Tracking emerges by colorizing videos, European Conference on Computer Vision
- 10.1109/CVPR.2019.00140 · DOI · Paper page
- wang, 2020, Self-supervised video representation learning by pace prediction, European Conference on Computer Vision
Cited by
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
Tong, Z., Song, Y., Wang, J., & Wang, L. (2022) · arXiv · doi:10.48550/arxiv.2203.12602 · Cited by 909
Self-citationHybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis
Mai, S., Zeng, Y., Zheng, S., & Hu, H. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3172360 · Cited by 277
Guo, T., Liu, H., Chen, Z., Liu, M., Wang, T., & Ding, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19957 · Cited by 202
“Studies (Pan et al. 2021; Cheng et al. 2020) have shown that the drop mechanism can be used for contrastive learning, and can effectively solve the problem of over-fitting.”
BackgroundSelf-supervised learning for videos: A survey
Schiappa, M. C., Rawat, Y. S., & Shah, M. (2023) · ACM Computing Surveys · doi:10.1145/3577925 · Cited by 155
Liu, R., Zuo, H., Lian, Z., Schuller, B. W., & Li, H. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3378570 · Cited by 96
Metadata
- Authors
- Pan, T., Song, Y., Yang, T., Jiang, W., & Liu, W.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 11200-11209
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3176780013
- Cited by
- 231
- References
- 16
- FWCI
- 16.46
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples. https://app.cochat.ai/papers/10.1109/cvpr46437.2021.01105
- The paper
- Pan, T., Song, Y., Yang, T., Jiang, W., & Liu, W. (2021). VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr46437.2021.01105
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.