The DOI matches its OpenAlex record; 25 of the 25 references it cites were found in a registry or an index.
CURL: Contrastive Unsupervised Representations for Reinforcement Learning
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Cited by
A Metaverse: Taxonomy, Components, Applications, and Open Challenges
Park, S.-M., & Kim, Y.-G. (2022) · IEEE Access · doi:10.1109/access.2021.3140175 · Cited by 1,824
Domain Generalization: A Survey
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195549 · Cited by 1,315
Contrastive Representation Learning: A Framework and Review
Le-Khac, P. H., Healy, G., & Smeaton, A. F. (2020) · IEEE Access · doi:10.1109/access.2020.3031549 · Cited by 862
“To improve the representation for reinforcement learning (RL) tasks, CURL [93] applied the instance discrimination task with a momentum encoder from MoCo [43] to train model-free RL agents directly from the pixel observations.”
MethodInfluentialWhat makes for good views for contrastive learning
Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10243 · Cited by 773
Deep Learning applications for COVID-19
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021) · Journal of Big Data · doi:10.1186/s40537-020-00392-9 · Cited by 350
CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instances
Tack, J., Mo, S., Jeong, J., & Shin, J. (2020) · arXiv · doi:10.48550/arxiv.2007.08176 · Cited by 351
Reinforcement Learning with Augmented Data
Laskin, M., Lee, K., Stooke, A., Pinto, L., Abbeel, P., & Srinivas, A. (2020) · arXiv · doi:10.48550/arxiv.2004.14990 · Cited by 299
Self-citationRT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
Brohan, A., Brown, N., Carbajal, J., Chebotar, Y., Chen, X., Choromanski, K., Ding, T., Driess, D., Dubey, A., Finn, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.15818 · Cited by 276
“Most works focus on pre-trained visual representations that can be used to initialize the encoder of the robot’s camera observations, either via supervised ImageNet classification [53], data augmentation [54, 55, 56, 57] or objectives that are tailored towards robotic control [58, 59, 60, 61, 62].”
BackgroundImage Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Kostrikov, I., Yarats, D., & Fergus, R. (2020) · arXiv · doi:10.48550/arxiv.2004.13649 · Cited by 267
“No further modifications to standard actor-critic algorithms are required, obviating the need for additional losses, e.g. based on auto-encoders [49], dynamics models [22, 21], or contrastive loss terms [42].”
BackgroundMethodResultInfluentialMastering Atari with Discrete World Models
Hafner, D., Lillicrap, T., Norouzi, M., & Ba, J. (2020) · arXiv · doi:10.48550/arxiv.2010.02193 · Cited by 247
“Some recent model-free methods have followed the comparison at 400k steps (Srinivas et al., 2020; Kostrikov et al., 2020).”
MethodExploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domain
Hao, J., Yang, T., Tang, H., Bai, C., Liu, J., Meng, Z., Liu, P., & Wang, Z. (2021) · arXiv · doi:10.48550/arxiv.2109.06668 · Cited by 192
A Cookbook of Self-Supervised Learning
Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., Tian, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.12210 · Cited by 182
SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation
Lin, X., Wang, Y., Olkin, J., & Held, D. (2020) · arXiv · doi:10.48550/arxiv.2011.07215 · Cited by 140
Decoupling Representation Learning from Reinforcement Learning
Stooke, A., Lee, K., Abbeel, P., & Laskin, M. (2020) · arXiv · doi:10.48550/arxiv.2009.08319 · Cited by 123
Self-citationGeneralization in Reinforcement Learning by Soft Data Augmentation
Hansen, N., & Wang, X. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561103 · Cited by 111
Mastering Diverse Domains through World Models
Hafner, D., Pasukonis, J., Ba, J., & Lillicrap, T. (2023) · arXiv · doi:10.48550/arxiv.2301.04104 · Cited by 124
“The twohot encoding of a scalar is a vector with | B | entries that are all 0 except at the indices k and k + 1 of the two bins closest to the encoded scalar.”
BackgroundMastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learning
Yarats, D., Fergus, R., Lazaric, A., & Pinto, L. (2021) · arXiv · doi:10.48550/arxiv.2107.09645 · Cited by 89
“Following this, other self-supervised objectives such as contrastive learning in CURL [Srinivas et al., 2020] and ATC [Stooke et al., 2020], self-prediction in SPR [Schwarzer et al., 2020a], contrastive cluster assignment in Proto-RL [Yarats et al., 2021a], and augmented data in DrQ [Yarats et al.,…”
BackgroundMethodResultInfluentialRLAfford: End-to-End Affordance Learning for Robotic Manipulation
Geng, Y., An, B., Geng, H., Chen, Y., Yang, Y., & Dong, H. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161571 · Cited by 57
A Survey on Contrastive Self-Supervised Learning
Jaiswal, A., Babu, A. R., Zadeh, M. Z., Banerjee, D., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies9010002 · Cited by 154
Deep reinforcement learning and its applications in medical imaging and radiation therapy: a survey
Xu, L., Zhu, S., & Wen, N. (2022) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac9cb3 · Cited by 35
The Distracting Control Suite -- A Challenging Benchmark for Reinforcement Learning from Pixels
Stone, A., Ramirez, O., Konolige, K., & Jonschkowski, R. (2021) · arXiv · doi:10.48550/arxiv.2101.02722 · Cited by 31
“Recently, CURL [2], DrQ [3], and RAD [4] have established that different versions of applying image cropping augmentation can greatly improve results up to a point where DM Control can be solved similarly from pixels as from states.”
BackgroundProof Artifact Co-training for Theorem Proving with Language Models
Han, J. M., Rute, J., Wu, Y., Ayers, E. W., & Polu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.06203 · Cited by 21
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
Self-supervised Regularization for Text Classification
Zhou, M., Li, Z., & Xie, P. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00389 · Cited by 14
BYOL-Explore: Exploration by Bootstrapped Prediction
Guo, Z. D., Thakoor, S., Pîslar, M., Pires, B. A., Altché, F., Tallec, C., Saade, A., Calandriello, D., Grill, J.-B., Tang, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.08332 · Cited by 12
“There is a large body of research in building world models either for planning [66, 63, 27, 26, 61], representation learning [62, 24, 41, 19] or curiosity-driven exploration [59, 68, 60, 34, 51, 52, 2, 63, 21, 65].”
BackgroundBall, P. J., Lu, C., Parker-Holder, J., & Roberts, S. (2021) · arXiv · doi:10.48550/arxiv.2104.05632 · Cited by 11
Measuring Visual Generalization in Continuous Control from Pixels
Grigsby, J., & Qi, Y. (2020) · arXiv · doi:10.48550/arxiv.2010.06740 · Cited by 10
TD-MPC2: Scalable, Robust World Models for Continuous Control
Hansen, N., Su, H., & Wang, X. (2023) · arXiv · doi:10.48550/arxiv.2310.16828 · Cited by 8
“Additionally, we also compare against current state-of-the-art visual RL methods (4) CURL (Srinivas et al., 2020), an extension of SAC that uses a contrastive auxiliary objective, and (5) DrQ-v2 , a model-free RL algorithm that uses data augmentation.”
MethodMeasuring Progress in Deep Reinforcement Learning Sample Efficiency
Dorner, F. E. (2021) · arXiv · doi:10.48550/arxiv.2102.04881 · Cited by 6
Value-Consistent Representation Learning for Data-Efficient Reinforcement Learning
Yue, Y., Kang, B., Xu, Z., Huang, G., & Yan, S. (2022) · arXiv · doi:10.48550/arxiv.2206.12542 · Cited by 4
“…et al. 2016; Yarats et al. 2021; Laskin, Srinivas, and Abbeel 2020; Schwarzer et al. 2021), data augmentation (Yarats, Kostrikov, and Fergus 2021; Laskin et al. 2020 Despite its effectiveness, it solely focuses on learning discriminative state features, ignoring the fact that some information…”
BackgroundMethodInfluentialNavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environments
Wang, H., Tan, A. H., & Nejat, G. (2024) · arXiv · Cited by 40
“2: 1) an online network parameterized by φ that consists of an encoder ( f s,φ , f g,φ ), a projector ( g s,φ , g g,φ ), and a predictor ( q s,φ , q g,φ ); and 2) a target network parameterized by ξ that consists of an encoder ( f s,ξ , f g,ξ ), and a projector ( g s,ξ , g g,ξ ).”
Background
Metadata
- Authors
- Srinivas, A., Laskin, M., & Abbeel, P.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2020-04-08
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2004.04136
- OpenAlex
- W3015437096
- Cited by
- 213
- References
- 25
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.