The DOI matches its DataCite record; 41 of the 42 references it cites were found in a registry or an index, and 1 are not checked yet.
Exploration by Random Network Distillation
Open accessAbstract
We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations given by a fixed randomly initialized neural network. We also introduce a method to flexibly combine intrinsic and extrinsic rewards. We find that the random network distillation (RND) bonus combined with this increased flexibility enables significant progress on several hard exploration Atari games. In particular we establish state of the art performance on Montezuma's Revenge, a game famously difficult for deep reinforcement learning methods. To the best of our knowledge, this is the first method that achieves better than average human performance on this game without using demonstrations or having access to the underlying state of the game, and occasionally completes the first level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Solving these problems requires a good global exploration strategy [211] that can better balance long-term and short-term environment information [195].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [211]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Specifically, although our experiments showed strong empirical gains in simplified environments, the current approach is vulnerable to the noisy TV problem [19], where novelty-driven level prioritization may focus on unpredictable noise elements of the environment, rather than beneficial learning experiences.”
From Improving Environment Novelty Quantification for Effective Unsupervised Environment Design (2024) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This solution limits the agent looping over distinct states or getting stuck in a state like the noisy TV problem [25].”
From Playtesting: What is Beyond Personas (2023) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Since the feedback is infinite, the agent may loop over novel states or get stuck in a novel state [25].”
From Playtesting: What is Beyond Personas (2023) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citationPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815
Research works printed but not linked: 13
- Yusuf Aytar, Tobias Pfaff, David Budden, Tom Le Paine, Ziyu Wang, and Nando de Freitas. Playing hard exploration games by watching YouTube. arXiv preprint arXiv:1805.11592 , 2018. · arXiv
- Benjamin Eysenbach, Abhishek Gupta, Julian Ibarz, and Sergey Levine. Diversity is all you need: Learning skills without a reward function. arXiv preprint , 2018.
- Justin Fu, John D Co-Reyes, and Sergey Levine. EX2: Exploration with exemplar models for deep reinforcement learning. NIPS , 2017.
- Karol Gregor, Danilo Jimenez Rezende, and Daan Wierstra. Variational intrinsic control. ICLR Workshop , 2017.
- Nick Haber, Damian Mrowca, Li Fei-Fei, and Daniel LK Yamins. Learning to play with intrinsicallymotivated self-aware agents. arXiv preprint arXiv:1802.07442 , 2018. · arXiv
- Rein Houthooft, Xi Chen, Yan Duan, John Schulman, Filip De Turck, and Pieter Abbeel. VIME: Variational information maximizing exploration. In NIPS , 2016.
- Manuel Lopes, Tobias Lang, Marc Toussaint, and Pierre-Yves Oudeyer. Exploration in model-based reinforcement learning by empirically estimating learning progress. In NIPS , 2012.
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. Nature , 518(7540):529-533, February 2015.
- Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. Asynchronous methods for deep reinforcement learning. In ICML , 2016.
- Junhyuk Oh, Yijie Guo, Satinder Singh, and Honglak Lee. Self-imitation learning. arXiv preprint arXiv:1806.05635 , 2018. · arXiv
- OpenAI, :, M. Andrychowicz, B. Baker, M. Chociej, R. Jozefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba. Learning Dexterous In-Hand Manipulation. ArXiv e-prints , August 2018.
- Georg Ostrovski, Marc G Bellemare, Aaron van den Oord, and R´ emi Munos. Count-based exploration with neural density models. International Conference for Machine Learning , 2018.
- Zichao Yang, Marcin Moczulski, Misha Denil, Nando de Freitas, Alex Smola, Le Song, and Ziyu Wang. Deep fried convnets. In Proceedings of the IEEE International Conference on Computer Vision , pp. 1476-1483, 2015.
Cited by
Sorted by citations
Items 101–200 of 533
Unsupervised Reinforcement Learning for Transferable Manipulation Skill Discovery
Cho, D., Kim, J.-G., & Kim, H. J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3171915 · Cited by 18
Impact Makes a Sound and Sound Makes an Impact: Sound Guides Representations and Explorations
Zhao, X., Weber, C., Hafez, M. B., & Wermter, S. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981510 · Cited by 17
Adaptive Stress Testing without Domain Heuristics using Go-Explore
Koren, M., & Kochenderfer, M. J. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294729 · Cited by 18
Griddly: A platform for AI research in games
Bamford, C. (2021) · Software Impacts · doi:10.1016/j.simpa.2021.100066 · Cited by 17
BeBold: Exploration Beyond the Boundary of Explored RegionsPreprint
Zhang, T., Xu, H., Wang, X., Wu, Y., Keutzer, K., Gonzalez, J. E., & Tian, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08621 · Cited by 43
Using Deep Reinforcement Learning to Evade Web Application Firewalls
Hemmati, M., & Hadavi, M. A. (2021) · International ISC Conference on Information Security and Cryptology (ISCISC) · doi:10.1109/iscisc53448.2021.9720473 · Cited by 16
Rényi State Entropy Maximization for Exploration Acceleration in Reinforcement Learning
Yuan, M., Pun, M.-O., & Wang, D. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3185180 · Cited by 23
Combining Experience Replay with Exploration by Random Network Distillation
Sovrano, F. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8848046 · Cited by 17
Mega-Reward: Achieving Human-Level Play without Extrinsic Rewards
Song, Y., Wang, J., Lukasiewicz, T., Xu, Z., Zhang, S., Wojcicki, A., & Xu, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6040 · Cited by 15
Lipschitzness is all you need to tame off-policy generative adversarial imitation learning
Blondé, L., Strasser, P., & Kalousis, A. (2022) · Machine Learning · doi:10.1007/s10994-022-06144-5 · Cited by 20
SMiRL: Surprise Minimizing Reinforcement Learning in Unstable EnvironmentsPreprint
Berseth, G., Geng, D., Devin, C., Rhinehart, N., Finn, C., Jayaraman, D., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05510 · Cited by 41
Benchmarking the Spectrum of Agent Capabilities
Hafner, D. (2021) · arXiv · doi:10.48550/arxiv.2109.06780 · Cited by 16
Meta-Reinforcement Learning With Dynamic Adaptiveness Distillation
Hu, H., Huang, G. M., Li, X., & Song, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105407 · Cited by 16
Subspace-Aware Exploration for Sparse-Reward Multi-Agent Tasks
Xu, P., Zhang, J., Yin, Q., Yu, C., Yang, Y., & Huang, K. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26384 · Cited by 16
Efficient Preference-Based Reinforcement Learning Using Learned Dynamics Models
Liu, Y., Datta, G., Novoseller, E., & Brown, D. S. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161081 · Cited by 21
Hierarchical reinforcement learning with adaptive scheduling for robot control
Huang, Z., Liu, Q., & Zhu, F. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107130 · Cited by 15
Control of Space Flexible Manipulator Using Soft Actor-Critic and Random Network Distillation
Yang, C., Yang, J. J., Wang, X., & Liang, B. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961852 · Cited by 15
Scheduled Intrinsic Drive: A Hierarchical Take on Intrinsically Motivated ExplorationPreprint
Zhang, J., Wetzel, N., Dorka, N., Boedecker, J., & Burgard, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.07400 · Cited by 23
Explore, Discover and Learn: Unsupervised Discovery of State-Covering SkillsPreprint
Campos, V., Trott, A., Xiong, C., Socher, R., Giró-i-Nieto, X., & Torres, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03647 · Cited by 16
Intrinsically Motivated Goal-Conditioned Reinforcement Learning: a Short SurveyPreprint
Colas, C., Karch, T., Sigaud, O., & Oudeyer, P. (2021) · HAL · Cited by 16
Learning Markov State Abstractions for Deep Reinforcement LearningPreprint
Allen, C., Parikh, N., Gottesman, O., & Konidaris, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04379 · Cited by 15
Jang, J., & Lee, G. T. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119363 · Cited by 14
Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance
Xu, K., Hu, Z., Doshi, R., Rovinsky, A., Kumar, V., Gupta, A. K., & Levine, S. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161493 · Cited by 14
Emergence of integrated behaviors through direct optimization for homeostasis
Yoshida, N., Daikoku, T., Nagai, Y., & Kuniyoshi, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106379 · Cited by 18
Deep Reinforcement Learning With Part-Aware Exploration Bonus in Video Games
Xu, P., Yin, Q., Zhang, J., & Huang, K. (2021) · IEEE Transactions on Games · doi:10.1109/tg.2021.3134259 · Cited by 16
Hash Bit Selection With Reinforcement Learning for Image Retrieval
Xin, Y., Wang, M., Zhou, W., & Li, H. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3213476 · Cited by 14
Active Inference, Bayesian Optimal Design, and Expected Utility
Sajid, N., Costa, L. D., Parr, T., & Friston, K. J. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009026949.007 · Cited by 20
Population-Guided Parallel Policy Search for Reinforcement LearningPreprint
Jung, W., Park, G., & Sung, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.02907 · Cited by 23
Structural Parameter Space Exploration for Reinforcement Learning via a Matrix Variate Distribution
Wang, S.-C., Yang, R., Li, B., & Kan, Z. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3140380 · Cited by 13
Contrastive Initial State Buffer for Reinforcement Learning
Messikommer, N., Song, Y., & Scaramuzza, D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610528 · Cited by 14
A multi-agent curiosity reward model for task-oriented dialogue systems
Sun, J., Kou, J., Hou, W., & Bai, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110884 · Cited by 13
He, Z., Chen, P., Shi, H., Li, J., & Hwang, K. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3468453 · Cited by 13
Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigation
Liu, G., Cai, M., Zhao, L., Qin, T., Brown, A., Bischoff, J., & Liu, T. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893630 · Cited by 15
Skynet: A Top Deep RL Agent in the Inaugural Pommerman Team CompetitionPreprint
Gao, C., Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01360 · Cited by 14
Temporally-Extended ε-Greedy ExplorationPreprint
Dabney, W., Ostrovski, G., & Barreto, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01782 · Cited by 41
Guided Exploration with Proximal Policy Optimization using a Single DemonstrationPreprint
Libardi, G., & Fabritiis, G. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03328 · Cited by 14
Beyond Fine-Tuning: Transferring Behavior in Reinforcement LearningPreprint
Campos, V., Sprechmann, P., Hansen, S., Barreto, A. D. M. S., Kapturowski, S., Vitvitskyi, A., Badia, A. P., & Blundell, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13515 · Cited by 23
WToE: Learning When to Explore in Multiagent Reinforcement Learning
Dong, S., Mao, H., Yang, S., Zhu, S., Li, W., Hao, J., & Gao, Y. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3328732 · Cited by 12
Preference-Based Multi-Objective Reinforcement Learning
Mu, N., Luan, Y., & Jia, Q. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3589271 · Cited by 15
Real-Time Intelligent Autonomous Intersection Management Using Reinforcement Learning
Gunarathna, U., Karunasekera, S. A., Borovica‐Gajic, R., & Tanin, E. (2022) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv51971.2022.9827188 · Cited by 12
Towards Informed Design and Validation Assistance in Computer Games Using Imitation Learning
Sestini, A., Bergdahl, J., Tollmar, K., Bagdanov, A. D., & Gisslén, L. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333234 · Cited by 12
Zhu, Z., Lin, K., Dai, B., & Zhou, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20914 · Cited by 13
Reinforcement Learning with A* and a Deep HeuristicPreprint
Keselman, A., Ten, S., Ghazali, A., & Jubeh, M. (2018) · arXiv.org · doi:10.48550/arxiv.1811.07745 · Cited by 19
Curiosity-Driven Multi-Criteria Hindsight Experience ReplayPreprint
Lanier, J. B., McAleer, S., & Baldi, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03710 · Cited by 13
Visual Affordance Prediction for Guiding Robot Exploration
Bharadhwaj, H., Gupta, A., & Tulsiani, S. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161288 · Cited by 11
Boosting Policy Learning in Reinforcement Learning via Adaptive Intrinsic Reward Regulation
Zhao, Q., Han, J., & Xu, M. (2023) · IEEE Access · doi:10.1109/access.2023.3347803 · Cited by 12
Student-Initiated Action Advising via Advice Novelty
Ilhan, E., Gow, J., & Perez, D. (2020) · IEEE Transactions on Games · doi:10.1109/tg.2021.3113644 · Cited by 11
Safe and Sample-Efficient Reinforcement Learning for Clustered Dynamic Environments
Chen, H., & Liu, C. (2021) · IEEE Control Systems Letters · doi:10.1109/lcsys.2021.3136486 · Cited by 11
Haxss: Hierarchical Reinforcement Learning for XSS Payload Generation
Foley, M., & Maffeis, S. (2022) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom56396.2022.00031 · Cited by 12
On the Potential for Open-Endedness in Neural Networks
Guttenberg, N., Virgo, N., & Penn, A. S. (2019) · Artificial Life · doi:10.1162/artl_a_00286 · Cited by 11
Show Us the Way: Learning to Manage Dialog from DemonstrationsPreprint
Gordon-Hall, G., Gorinski, P. J., Λάμπουρας, Γ., & Iacobacci, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08114 · Cited by 14
Exploring Exploration: Comparing Children with RL Agents in Unified EnvironmentsPreprint
Kosoy, E., Collins, J., Chan, D. M., Huang, S., Pathak, D., Agrawal, P., Canny, J., Alison Gopnik, C., & Hamrick, J. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02880 · Cited by 23
When should agents explore?Preprint
Pislar, M., Szepesvári, D., Ostrovski, G., Borsa, D., & Schaul, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11811 · Cited by 20
Implicit Posteriori Parameter Distribution Optimization in Reinforcement Learning
Li, T., Yang, G., & Chu, J. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3254596 · Cited by 10
Consensus-Agent Deep Reinforcement Learning for Face Aging
Lin, L., Liu, H., Liang, J., Li, Z., Feng, J., & Han, H. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3364074 · Cited by 11
Learning to Cut via Hierarchical Sequence/Set Model for Efficient Mixed-Integer Programming
Wang, J., Wang, Z., Li, X., Kuang, Y., Shi, Z., Zhu, F., Yuan, M., Zeng, J., Zhang, Y., & Wu, F. H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3432716 · Cited by 20
Zhou, X., Yuan, Y., Yang, S., & Hao, J. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3529902 · Cited by 13
“Feariosity”-Guided Reinforcement Learning for Safe and Efficient Autonomous End-to-End Navigation
Hu, D. T., Mo, L., Wu, J., & Huang, C. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3577523 · Cited by 10
Hierarchical learning from human preferences and curiosity
Bougie, N., & Ichise, R. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02726-3 · Cited by 10
Nuclear Norm Maximization-Based Curiosity-Driven Reinforcement Learning
Chen, C., Zhai, Y., Gao, Z., Xu, K., Yang, S., Li, Y., Ding, B., Feng, D., & Wang, H. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3323628 · Cited by 12
Safe Policy Improvement with an Estimated Baseline Policy
Simão, T. D., Laroche, R., & Combes, R. T. D. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/hlnw2204 · Cited by 9
Exploration: from machines to humans
Fox, L., Dan, O., Elber‐Dorozko, L., & Loewenstein, Y. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.08.004 · Cited by 11
Unsupervised Reinforcement Learning in Multiple Environments
Mutti, M., Mancassola, M., & Restelli, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20754 · Cited by 13
Imaginary Hindsight Experience Replay: Curious Model-based Learning for Sparse Reward TasksPreprint
McCarthy, R., Wang, Q., & Redmond, S. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02414 · Cited by 19
Adaptive Parameter Sharing for Multi-Agent Reinforcement Learning
Li, D., Lou, N., Zhang, B., Xu, Z., & Fan, G. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447262 · Cited by 11
Lin, J., Wei, X., Xian, W., Yan, J., Leong Hou, U., Feng, Y., Shang, Z., & Zhou, M. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110676 · Cited by 10
Sampling diversity driven exploration with state difference guidance
Lu, J., Han, S. D., Lü, S., Kang, M., & Zhang, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117418 · Cited by 9
Divide & Conquer Imitation Learning
Chenu, A., Perrin, N., & Sigaud, O. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982020 · Cited by 9
Intrinsic Language-Guided Exploration for Complex Long-Horizon Robotic Manipulation Tasks
Triantafyllidis, E., Christianos, F., & Li, Z. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611483 · Cited by 13
Sample-Efficient Model-Free Reinforcement Learning with Off-Policy Critics
Steckelmacher, D., Plisnier, H., Roijers, D. M., & Nowé, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46133-1_2 · Cited by 9
Toybox: A Suite of Environments for Experimental Evaluation of Deep Reinforcement LearningPreprint
Tosch, E., Clary, K., Foley, J., & Jensen, D. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02825 · Cited by 8
Learning Sparse Rewarded Tasks from Sub-Optimal DemonstrationsPreprint
Zhu, Z., Lin, K., Dai, B., & Zhou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00530 · Cited by 9
Diversity Actor-Critic: Sample-Aware Entropy Regularization for Sample-Efficient ExplorationPreprint
Han, S., & Sung, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01419 · Cited by 9
A Max-Min Entropy Framework for Reinforcement LearningPreprint
Han, S., & Sung, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10517 · Cited by 10
Strangeness-driven exploration in multi-agent reinforcement learning
Kim, J.-B., Choi, H.-B., & Han, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106149 · Cited by 10
Multiexperience-Assisted Efficient Multiagent Reinforcement Learning
Zhang, T., Liu, Z., Yi, J., Wu, S., Pu, Z., & Zhao, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264275 · Cited by 8
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Zhu, H., Kapoor, R., Min, S. Y., Han, W., Li, J., Geng, K., Neubig, G., Bisk, Y., Kembhavi, A., & Weihs, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01434 · Cited by 9
FedSwarm: An Adaptive Federated Learning Framework for Scalable AIoT
Du, H., Ni, C., Cheng, C., Xiang, Q., Chen, X., & Liu, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3321325 · Cited by 8
Ma, Z., Liu, X., & Huang, Y. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3400224 · Cited by 9
DynaSTI: Dynamics modeling with sequential temporal information for reinforcement learning in Atari
Kim, J., Lee, Y. J., Kwak, M., Park, Y. J., & Kim, S. B. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112103 · Cited by 8
Zhou, R. W., Zhu, W., Han, S. D., Kang, M., & Lü, S. (2025) · Neural Networks · doi:10.1016/j.neunet.2024.107052 · Cited by 8
CEM: Constrained Entropy Maximization for Task-Agnostic Safe Exploration
Yang, Q., & Spaan, M. T. J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26281 · Cited by 9
Active sensing with artificial neural networks
Solopchuk, O., & Zénon, A. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.007 · Cited by 8
Self-Imitation Learning via Trajectory-Conditioned Policy for Hard-Exploration TasksPreprint
Guo, Y., Choi, J., Moczulski, M., Samy Bengio, A., Norouzi, M., & Lee, H. (2019) · arXiv (Cornell University) · Cited by 12
Neural-encoding Human Experts' Domain Knowledge to Warm Start Reinforcement LearningPreprint
Silva, A., & Gombolay, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06007 · Cited by 8
Evaluating Agents without RewardsPreprint
Matusch, B., Ba, J. L., & Hafner, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.11538 · Cited by 14
Geometric Entropic ExplorationPreprint
Guo, Z. D., Azar, M. G., Saade, A., Thakoor, S., Piot, B., Pires, B. Á., Valko, M., Mesnard, T., Lattimore, T., & Munos, R. (2021) · HAL · doi:10.48550/arxiv.2101.02055 · Cited by 41
Decoupling Exploration and Exploitation for Meta-Reinforcement Learning without SacrificesPreprint
Liu, E. Z., Raghunathan, A., Liang, P., & Finn, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.02790 · Cited by 21
FOCUS: object-centric world models for robotic manipulation
Ferraro, S., Mazzaglia, P., Verbelen, T., & Dhoedt, B. (2025) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2025.1585386 · Cited by 9
GAILPG: Multiagent Policy Gradient With Generative Adversarial Imitation Learning
Li, W., Huang, S., Qiu, Z., & Song, A. (2024) · IEEE Transactions on Games · doi:10.1109/tg.2024.3375515 · Cited by 7
Shang, C., Fu, L., Xiao, H., Bao, X., & Xu, X. (2024) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2024.3372945 · Cited by 7
Ada, S. E., Say, H., Uğur, E., & Öztop, E. (2024) · IEEE Access · doi:10.1109/access.2024.3402089 · Cited by 7
Cooperative Deep Reinforcement Learning Policies for Autonomous Navigation in Complex Environments
Tran, V. M., & Kim, G.-W. (2024) · IEEE Access · doi:10.1109/access.2024.3429230 · Cited by 7
Age of Incorrect Information-Aware Data Dissemination for Distributed Multi-Agent Systems
He, G., Zhang, S., Feng, M., Li, S., & Jiang, T. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3432780 · Cited by 7
Lochner, S., Honerkamp, D., Valada, A., & Straw, A. D. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1460006 · Cited by 8
Incremental model-based reinforcement learning with model constraint
Yang, Z., Fu, M., Qu, H., Li, F., Shi, S., & Hu, W. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107245 · Cited by 7
Rethinking exploration–exploitation trade-off in reinforcement learning via cognitive consistency
Wang, D. Z., Wei, W., Li, L., Wang, X., & Liang, J. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107342 · Cited by 7
Efficient Self-Supervised Data Collection for Offline Robot Learning
Endrawis, S., Leibovich, G., Jacob, G., Novik, G., & Tamar, A. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561097 · Cited by 7
Playtesting: What is Beyond Personas
Ariyurek, S., Surer, E., & Betin-Can, A. (2023) · IEEE Transactions on Games · doi:10.1109/tg.2022.3165882 · Cited by 7
Optimistic Initialization for Exploration in Continuous Control
Lobel, S., Gottesman, O., Allen, C., Bagaria, A., & Konidaris, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20727 · Cited by 8
Metadata
- Authors
- Burda, Y., Edwards, H., Storkey, A., & Klimov, O.
- Affiliations
- OpenAI (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.12894
- OpenAlex
- W2899205164
- Cited by
- 527
- References
- 41
- Citations by year
- 2026: 2 · 2025: 35 · 2024: 75 · 2023: 77 · 2022: 79 · 2021: 115 · 2020: 87 · 2019: 52 · 2018: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- random network distillation, exploration bonus, deep reinforcement learning, intrinsic rewards, Atari games, Montezuma's Revenge, feature prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
