The DOI matches its DataCite record; 41 of the 42 references it cites were found in a registry or an index, and 1 are not checked yet.
Exploration by Random Network Distillation
Open accessAbstract
We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations given by a fixed randomly initialized neural network. We also introduce a method to flexibly combine intrinsic and extrinsic rewards. We find that the random network distillation (RND) bonus combined with this increased flexibility enables significant progress on several hard exploration Atari games. In particular we establish state of the art performance on Montezuma's Revenge, a game famously difficult for deep reinforcement learning methods. To the best of our knowledge, this is the first method that achieves better than average human performance on this game without using demonstrations or having access to the underlying state of the game, and occasionally completes the first level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Solving these problems requires a good global exploration strategy [211] that can better balance long-term and short-term environment information [195].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [211]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Specifically, although our experiments showed strong empirical gains in simplified environments, the current approach is vulnerable to the noisy TV problem [19], where novelty-driven level prioritization may focus on unpredictable noise elements of the environment, rather than beneficial learning experiences.”
From Improving Environment Novelty Quantification for Effective Unsupervised Environment Design (2024) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This solution limits the agent looping over distinct states or getting stuck in a state like the noisy TV problem [25].”
From Playtesting: What is Beyond Personas (2023) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Since the feedback is infinite, the agent may loop over novel states or get stuck in a novel state [25].”
From Playtesting: What is Beyond Personas (2023) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citationPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815
Research works printed but not linked: 13
- Yusuf Aytar, Tobias Pfaff, David Budden, Tom Le Paine, Ziyu Wang, and Nando de Freitas. Playing hard exploration games by watching YouTube. arXiv preprint arXiv:1805.11592 , 2018. · arXiv
- Benjamin Eysenbach, Abhishek Gupta, Julian Ibarz, and Sergey Levine. Diversity is all you need: Learning skills without a reward function. arXiv preprint , 2018.
- Justin Fu, John D Co-Reyes, and Sergey Levine. EX2: Exploration with exemplar models for deep reinforcement learning. NIPS , 2017.
- Karol Gregor, Danilo Jimenez Rezende, and Daan Wierstra. Variational intrinsic control. ICLR Workshop , 2017.
- Nick Haber, Damian Mrowca, Li Fei-Fei, and Daniel LK Yamins. Learning to play with intrinsicallymotivated self-aware agents. arXiv preprint arXiv:1802.07442 , 2018. · arXiv
- Rein Houthooft, Xi Chen, Yan Duan, John Schulman, Filip De Turck, and Pieter Abbeel. VIME: Variational information maximizing exploration. In NIPS , 2016.
- Manuel Lopes, Tobias Lang, Marc Toussaint, and Pierre-Yves Oudeyer. Exploration in model-based reinforcement learning by empirically estimating learning progress. In NIPS , 2012.
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. Nature , 518(7540):529-533, February 2015.
- Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. Asynchronous methods for deep reinforcement learning. In ICML , 2016.
- Junhyuk Oh, Yijie Guo, Satinder Singh, and Honglak Lee. Self-imitation learning. arXiv preprint arXiv:1806.05635 , 2018. · arXiv
- OpenAI, :, M. Andrychowicz, B. Baker, M. Chociej, R. Jozefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba. Learning Dexterous In-Hand Manipulation. ArXiv e-prints , August 2018.
- Georg Ostrovski, Marc G Bellemare, Aaron van den Oord, and R´ emi Munos. Count-based exploration with neural density models. International Conference for Machine Learning , 2018.
- Zichao Yang, Marcin Moczulski, Misha Denil, Nando de Freitas, Alex Smola, Le Song, and Ziyu Wang. Deep fried convnets. In Proceedings of the IEEE International Conference on Computer Vision , pp. 1476-1483, 2015.
Cited by
Sorted by citations
Items 201–300 of 533
A Deep Reinforcement Learning Framework for High-Dimensional Circuit Linearization
Rong, C., Paramesh, J., & Carley, L. R. (2022) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2022.3183156 · Cited by 7
Visual Pretraining via Contrastive Predictive Model for Pixel-Based Reinforcement Learning
Luu, T. M., Vu, T., Nguyen, T., & Yoo, C. D. (2022) · Sensors · doi:10.3390/s22176504 · Cited by 7
A Controllable Agent by Subgoals in Path Planning Using Goal-Conditioned Reinforcement Learning
Lee, G. T., & Kim, K. (2023) · IEEE Access · doi:10.1109/access.2023.3264264 · Cited by 7
Learning social navigation from demonstrations with conditional neural processes
Yıldırım, Y., & Uğur, E. (2022) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.22018.yil · Cited by 7
Goal-Conditioned Reinforcement Learning With Disentanglement-Based Reachability Planning
Qian, Z., You, M., Zhou, H., Xu, X., & He, B. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3287362 · Cited by 7
Towards Causality-Aware Inferring: A Sequential Discriminative Approach for Medical Diagnosis
Lin, J., Wang, K., Chen, Z., Liang, X., & Lin, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3292363 · Cited by 9
Long-Term Visitation Value for Deep Exploration in Sparse-Reward Reinforcement Learning
Parisi, S., Tateo, D., Hensel, M., D’Eramo, C., Peters, J., & Pajarinen, J. (2022) · Algorithms · doi:10.3390/a15030081 · Cited by 8
GRIMGEP: Learning Progress for Robust Goal Sampling in Visual Deep Reinforcement Learning
Kovač, G., Laversanne-Finot, A., & Oudeyer, P. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3216911 · Cited by 12
Never Forget: Balancing Exploration and Exploitation via Learning Optical FlowPreprint
Yang, H.-K., Chiang, P.-H., Ho, K.-W., Hong, M.-F., & Lee, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08486 · Cited by 11
On Catastrophic Interference in Atari 2600 GamesPreprint
Fedus, W., Ghosh, D., Martin, J. D., Bellemare, M. G., Bengio, Y., & Larochelle, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12499 · Cited by 20
A Policy Gradient Method for Task-Agnostic ExplorationPreprint
Mutti, M., Pratissoli, L., & Restelli, M. (2020) · arXiv (Cornell University) · Cited by 7
Temporal Difference Uncertainties as a Signal for ExplorationPreprint
Flennerhag, S., Wang, J. X., Sprechmann, P., Visin, F., Galashov, A., Kapturowski, S., Borsa, D., Heess, N., Barreto, A. D. M. S., & Pascanu, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02255 · Cited by 15
Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug DiscoveryPreprint
Wu, Y., Cashman, M., Choma, N., Prates, E. T., Vergara, V. M., Shah, M. B., Chen, A. T.-Y., Clyde, A., Brettin, T. S., de Jong, W. A., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02190 · Cited by 10
Is Curiosity All You Need? On the Utility of Emergent Behaviours from Curious ExplorationPreprint
Groth, O., Wulfmeier, M., Vezzani, G., Dasagi, V., Hertweck, T., Hafner, R., Heess, N., & Riedmiller, M. A. (2021) · arXiv.org · doi:10.48550/arxiv.2109.08603 · Cited by 23
Probing for consciousness in machines
Immertreu, M., Schilling, A., Maier, A., & Krauß, P. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1610225 · Cited by 12
Exploration in Sequential Recommender Systems via Graph Representations
Kiselev, D., & Makarov, I. (2022) · IEEE Access · doi:10.1109/access.2022.3224816 · Cited by 6
Task Phasing: Automated Curriculum Learning from Demonstrations
Bajaj, V., Sharon, G., & Stone, P. (2023) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v33i1.27235 · Cited by 6
Maximizing Quadruped Velocity by Minimizing Energy
Mahankali, S., Lee, C.-C., Margolis, G. B., Hong, Z.-W., & Agrawal, P. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10609983 · Cited by 8
Candidate ratio guided proximal policy optimization
Li, Y., & Tan, X. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110576 · Cited by 6
TAMPC: A Controller for Escaping Traps in Novel Environments
Zhong, S., Zhang, Z., Fazeli, N., & Berenson, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3057789 · Cited by 6
Exploration via State influence Modeling
Kang, Y., Zhao, E., Li, K., & Xing, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16981 · Cited by 6
Self-Imitation Learning for Robot Tasks with Sparse and Delayed Rewards
Chen, Z., & Lin, M. (2021) · IEEE International Conference on Mechatronics and Automation (ICMA) · doi:10.1109/icma52036.2021.9512787 · Cited by 9
Learning a World Model With Multitimescale Memory Augmentation
Cai, W., Wang, T., Wang, J., & Sun, C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3151412 · Cited by 8
Go-Explore Complex 3-D Game Environments for Automated Reachability Testing
Lu, C., Georgescu, R., & Verwey, J. (2022) · IEEE Transactions on Games · doi:10.1109/tg.2022.3228401 · Cited by 6
Learning Potential in Subgoal-Based Reward Shaping
Okudo, T., & Yamada, S. (2023) · IEEE Access · doi:10.1109/access.2023.3246267 · Cited by 7
Gros, T. P., Groß, J., Höller, D., Hoffmann, J., Klauck, M., Meerkamp, H., Müller, N. J., Schaller, L., & Wolf, V. (2023) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/3607198 · Cited by 6
Reward shaping using convolutional neural network
Sami, H., Otrok, H., Bentahar, J., Mourad, A., & Damiani, E. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119481 · Cited by 6
Lin, H., He, Y., Li, F., Liu, Q., Wang, B., & Zhu, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122145 · Cited by 6
Dynamic Memory-Based Curiosity: A Bootstrap Approach for Exploration in Reinforcement Learning
Gao, Z., Li, Y., Xu, K., Zhai, Y., Ding, B., Feng, D., Mao, X., & Wang, H. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3335944 · Cited by 6
Multi-agent Reinforcement Learning for Safe Driving in On-ramp Merging of Autonomous Vehicles
Wang, D. (2024) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence60223.2024.10463500 · Cited by 6
Schultheis, M., Belousov, B., Abdulsamad, H., & Peters, J. (2019) · Technischen Universität Darmstadt · doi:10.26083/tuprints-00020578 · Cited by 6
Sequential Generative Exploration Model for Partially Observable Reinforcement Learning
Yin, H., Chen, J., Pan, S. J., & Tschiatschek, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17279 · Cited by 5
Gao, J., He, Y., Chen, Y., & Li, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3273687 · Cited by 6
An Intrinsically-Motivated Approach for Learning Highly Exploring and Fast Mixing Policies
Mutti, M., & Restelli, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5968 · Cited by 6
Task-Agnostic Exploration via Policy Gradient of a Non-Parametric State Entropy Estimate
Mutti, M., Pratissoli, L., & Restelli, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17091 · Cited by 12
Approximate Exploration through State AbstractionPreprint
Taïga, A. A., Courville, A. C., & Bellemare, M. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.09819 · Cited by 9
Towards a phenomenological understanding of neural networks: data
Tovey, S., Krippendorf, S., Nikolaou, K., & Holm, C. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/acf099 · Cited by 6
Celebrating Diversity With Subtask Specialization in Shared Multiagent Reinforcement Learning
Li, C., Wang, T., Wu, C., Zhao, Q., Yang, J. J., & Zhang, C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3326744 · Cited by 7
Karnan, H., Yang, E., Warnell, G., Biswas, J., & Stone, P. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611475 · Cited by 5
Cooperative Multiagent Learning and Exploration With Min–Max Intrinsic Motivation
Hou, Y., Kang, J., Piao, H., Zeng, Y., Ong, Y.-S., Jin, Y., & Zhang, Q. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3557694 · Cited by 5
Intrinsically Motivated Self-supervised Learning in Reinforcement Learning
Zhao, Y., Du, C., Zhao, H., & Li, T. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812213 · Cited by 5
Andrés, A., Villar-Rodríguez, E., Martinez, A. D., & Ser, J. D. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534146 · Cited by 5
Information Optimization and Transferable State Abstractions in Deep Reinforcement Learning
Gomez, D., Quijano, N., & Giraldo, L. F. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3200726 · Cited by 6
Physics Informed Intrinsic Rewards in Reinforcement Learning
Jiang, J., Fu, M., & Chen, Z. (2022) · Australian & New Zealand Control Conference (ANZCC) · doi:10.1109/anzcc56036.2022.9966956 · Cited by 5
Adaptive cooperative exploration for reinforcement learning from imperfect demonstrations
Huang, F., Ji, N., Ni, H., Li, S., & Li, X. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.12.003 · Cited by 5
APRS: Automatic pruning ratio search using Siamese network with layer-level rewards
Xiao, H., Wang, Y., Liu, J., Huo, J., Yang, H., & Wang, Y. (2022) · Digital Signal Processing · doi:10.1016/j.dsp.2022.103864 · Cited by 5
Duan, G., Xu, Y., Liu, Z., & Tan, J. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3232774 · Cited by 5
Complementary Learning System Based Intrinsic Reward in Reinforcement Learning
Gao, Z., Xu, K., Jia, H., Wan, T., Ding, B., Feng, D., Mao, X., & Wang, H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095379 · Cited by 5
Pre-Grasp Approaching on Mobile Robots: A Pre-Active Layered Approach
Naik, L., Kalkan, S., & Krüger, N. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3358077 · Cited by 5
InsigHTable: Insight-Driven Hierarchical Table Visualization With Reinforcement Learning
Li, G., He, P., Wang, X., Li, R., Liu, C. H., Ou, C., He, D. J., & Wang, G. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3404454 · Cited by 7
Hypothesis-Driven Skill Discovery for Hierarchical Deep Reinforcement Learning
Chuck, C., Chockchowwat, S., & Niekum, S. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340891 · Cited by 6
Curiosity Driven Deep Reinforcement Learning for Motion Planning in Multi-agent Environment
Perovic, G., & Li, N. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961660 · Cited by 5
An Adversarial Objective for Scalable Exploration
Bucher, B., Schmeckpeper, K., Matni, N., & Daniilidis, K. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636298 · Cited by 7
Discovering and Exploiting Sparse Rewards in a Learned Behavior Space
Paolo, G., Coninx, A., Laflaquière, A., & Doncieux, S. (2023) · Evolutionary Computation · doi:10.1162/evco_a_00343 · Cited by 5
Learning Design and Construction with Varying-Sized Materials via Prioritized Memory Resets
Li, Y., Kong, T., Li, L., & Wu, Y. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811624 · Cited by 5
A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation
Zhu, X., Kang, S., & Chen, J. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981185 · Cited by 5
Bodaragama, J., & Rajapaksha, S. (2023) · International Conference on Advanced Research in Computing (ICARC) · doi:10.1109/icarc57651.2023.10145730 · Cited by 5
Noisy Agents: Self-supervised Exploration by Predicting Auditory Events
Gan, C., Chen, X., Isola, P., Torralba, A. B., & Tenenbaum, J. B. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981614 · Cited by 8
MANGA: Method Agnostic Neural-policy Generalization and Adaptation
Bharadhwaj, H., Yamaguchi, S., & Maeda, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197398 · Cited by 5
Intrinsic motivations and open-ended learningPreprint
Baldassarre, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.13263 · Cited by 5
Non-local Policy Optimization via Diversity-regularized Collaborative ExplorationPreprint
Peng, Z., Sun, H., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07781 · Cited by 13
Online reinforcement learning with sparse rewards through an active inference capsulePreprint
Noel, A. D., van Hoof, C., & Millidge, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02390 · Cited by 5
Curiosity-driven learning in artificial intelligence and its applications
Sun, C. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/172831 · Cited by 6
Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning
Matthews, M., Beukman, M., Ellis, B., Samvelyan, M., Jackson, M., Coward, S., & Foerster, J. (2024) · arXiv · doi:10.48550/arxiv.2402.16801 · Cited by 4
“We also experiment using two state of the art intrinsic rewards for additional exploration: Random Network Distillation We use the popular exploration baseline Random Network Distillation (RND) (Burda et al., 2018) as our first method for global intrinsic reward.”
BackgroundMethodInfluentialNeighborhood-Curiosity-Based Exploration in Multiagent Reinforcement Learning
Yang, S., He, Z., Li, J., Shi, H., Ji, Q., Hwang, K., & Li, X. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3460368 · Cited by 4
Wang, J., & Zhu, F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125410 · Cited by 4
Self-Referencing Agents for Unsupervised Reinforcement Learning
Zhao, A., Zhu, E., Lu, R., Lin, M. G., Liu, Y., & Huang, G. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107448 · Cited by 5
Cooperative Behavior by Multi-agent Reinforcement Learning with Abstractive Communication
Tanda, J., Moustafa, A., & Itō, T. (2019) · IEEE International Conference on Agents (ICA) · doi:10.1109/agents.2019.8929151 · Cited by 4
Generative Exploration and Exploitation
Jiang, J., & Lu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5858 · Cited by 5
Sun, C., Qian, H., & Miao, C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29437 · Cited by 4
An improved proximal policy optimization algorithm for autonomous driving decision-making
Yan, Y., Liu, C., Chang, F., & Huang, Y. (2024) · International Conference on Sensors and Information Technology (ICSI) · doi:10.1117/12.3029265 · Cited by 4
Guided Cooperation in Hierarchical Reinforcement Learning via Model-Based Rollout
Wang, H., Tang, Z., Sun, Y., Wang, F., Zhang, S., & Chen, Y. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3425809 · Cited by 4
Toward Evaluating Robustness of Reinforcement Learning with Adversarial Policy
Zheng, X., Ma, X., Wang, S., Wang, X., Shen, C., & Wang, C. (2024) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn58291.2024.00038 · Cited by 5
Curriculum Learning Algorithms for Reward Weighting in Sparse Reward Robotic Manipulation Tasks
Fele, B., & Babič, J. (2025) · IEEE Access · doi:10.1109/access.2025.3549639 · Cited by 4
Lee, G., Hou, B., Choudhury, S., & Srinivasa, S. S. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636163 · Cited by 5
Song, Y., Hu, Y., Zeng, J., Hu, C., Qin, L., & Yin, Q. (2021) · International Conference on Automation, Control and Robotics Engineering (CACRE) · doi:10.1109/cacre52464.2021.9501321 · Cited by 4
Signal Novelty Detection as an Intrinsic Reward for Robotics
Kubovčík, M., Ľuptáková, I. D., & Pospı́chal, J. (2023) · Sensors · doi:10.3390/s23083985 · Cited by 4
Safe Explainable Agents for Autonomous Navigation using Evolving Behavior Trees
Potteiger, N., & Koutsoukos, X. (2023) · IEEE International Conference on Assured Autonomy (ICAA) · doi:10.1109/icaa58325.2023.00014 · Cited by 4
Draw on advantages and avoid disadvantages by making a multi-step prediction
Zhu, G., & Zhu, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121345 · Cited by 4
Wang, T., Wang, F., Xie, Z., & Qin, F. (2024) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2024.1376215 · Cited by 4
Multi-agent Exploration with Sub-state Entropy Estimation
Tao, J., Chen, Y., Zhang, Y., Yang, K., & Li, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10649966 · Cited by 4
Exploring Unknown States with Action Balance
Yan, S., Chen, Y., Hu, Y., & Fan, C. (2020) · IEEE Conference on Games (CoG) · doi:10.1109/cog47356.2020.9231562 · Cited by 4
Lin, F., Wei, N., & Zhai, H. (2022) · IEEE Joint International Information Technology and Artificial Intelligence Conference (ITAIC) · doi:10.1109/itaic54216.2022.9836631 · Cited by 4
Implicit Generative Modeling for Efficient ExplorationPreprint
Ratzlaff, N., Bai, Q., Li, F., & Xu, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08017 · Cited by 5
Evolve To Control: Evolution-based Soft Actor-Critic for Scalable Reinforcement Learning.Preprint
Suri, K., Shi, X. Q., Plataniotis, K. N., & Lawryshyn, Y. (2020) · arXiv (Cornell University) · Cited by 4
SAFARI: Safe and Active Robot Imitation Learning with ImaginationPreprint
Palo, N. D., & Johns, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09586 · Cited by 4
Adversarial Machine Learning in Text Analysis and GenerationPreprint
Alsmadi, I. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.08675 · Cited by 6
Multimodal Reward Shaping for Efficient Exploration in Reinforcement LearningPreprint
Yuan, M., Pun, M.-O., Wang, D., Chen, Y., & Li, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.08888 · Cited by 5
Huang, F., He, Y., Zhang, Y., Chen, B., & Yang, L. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110443 · Cited by 3
Jin, W., Tian, X., Wang, N., Wu, B., Shi, B., Zhao, B., & Yang, G. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107875 · Cited by 5
SCALE: Self-Correcting Visual Navigation for Mobile Robots via Anti-Novelty Estimation
Chen, C., Liu, Y., Zhuang, Y., Mao, S., Xue, K., & Zhou, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610847 · Cited by 3
Learning Intrinsically Motivated Options to Stimulate Policy Exploration
Bagot, L., Mets, K., & Latré, S. (2020) · HAL · Cited by 3
Efficient Hierarchical Exploration with An Active Subgoal Generation Strategy
Xu, X., Zuo, G., Li, J., & Huang, G. M. (2022) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio55434.2022.10011930 · Cited by 3
Exploration via Epistemic Value Estimation
Schmitt, S., Shawe-Taylor, J. S., & van Hasselt, H. P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26164 · Cited by 3
Fast Counterfactual Inference for History-Based Reinforcement Learning
Gao, H., Zhang, T., Yang, Z., Guo, Y., Ren, J., Guo, S., & Chen, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25924 · Cited by 3
Failure-aware Policy Learning for Self-assessable Robotics Tasks
Xu, K., Chen, R., Zhao, S., Li, Z., Yu, H., Chen, C., Wang, Y., & Xiong, R. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160889 · Cited by 3
Curiosity-driven Exploration for Cooperative Multi-Agent Reinforcement Learning
Xu, F., & Kaneko, T. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191336 · Cited by 3
Xu, M., Ge, S. S., Zhao, D., & Zhao, Q. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3339215 · Cited by 3
Hierarchical Reinforcement Learning-Based End-to-End Visual Servoing With Smooth Subgoals
He, Y., Gao, J., Li, H., Chen, Y., & Li, Y. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3337547 · Cited by 3
Learning to Solve Tasks with Exploring Prior Behaviours
Zhu, R., Li, S., Dai, T., Zhang, C., & Çeliktutan, O. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342272 · Cited by 3
Metadata
- Authors
- Burda, Y., Edwards, H., Storkey, A., & Klimov, O.
- Affiliations
- OpenAI (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.12894
- OpenAlex
- W2899205164
- Cited by
- 527
- References
- 41
- Citations by year
- 2026: 2 · 2025: 35 · 2024: 75 · 2023: 77 · 2022: 79 · 2021: 115 · 2020: 87 · 2019: 52 · 2018: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- random network distillation, exploration bonus, deep reinforcement learning, intrinsic rewards, Atari games, Montezuma's Revenge, feature prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
