The DOI matches its DataCite record; 41 of the 42 references it cites were found in a registry or an index, and 1 are not checked yet.
Exploration by Random Network Distillation
Open accessAbstract
We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations given by a fixed randomly initialized neural network. We also introduce a method to flexibly combine intrinsic and extrinsic rewards. We find that the random network distillation (RND) bonus combined with this increased flexibility enables significant progress on several hard exploration Atari games. In particular we establish state of the art performance on Montezuma's Revenge, a game famously difficult for deep reinforcement learning methods. To the best of our knowledge, this is the first method that achieves better than average human performance on this game without using demonstrations or having access to the underlying state of the game, and occasionally completes the first level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Solving these problems requires a good global exploration strategy [211] that can better balance long-term and short-term environment information [195].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [211]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Specifically, although our experiments showed strong empirical gains in simplified environments, the current approach is vulnerable to the noisy TV problem [19], where novelty-driven level prioritization may focus on unpredictable noise elements of the environment, rather than beneficial learning experiences.”
From Improving Environment Novelty Quantification for Effective Unsupervised Environment Design (2024) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This solution limits the agent looping over distinct states or getting stuck in a state like the noisy TV problem [25].”
From Playtesting: What is Beyond Personas (2023) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Since the feedback is infinite, the agent may loop over novel states or get stuck in a novel state [25].”
From Playtesting: What is Beyond Personas (2023) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Self-citationPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815
Research works printed but not linked: 13
- Yusuf Aytar, Tobias Pfaff, David Budden, Tom Le Paine, Ziyu Wang, and Nando de Freitas. Playing hard exploration games by watching YouTube. arXiv preprint arXiv:1805.11592 , 2018. · arXiv
- Benjamin Eysenbach, Abhishek Gupta, Julian Ibarz, and Sergey Levine. Diversity is all you need: Learning skills without a reward function. arXiv preprint , 2018.
- Justin Fu, John D Co-Reyes, and Sergey Levine. EX2: Exploration with exemplar models for deep reinforcement learning. NIPS , 2017.
- Karol Gregor, Danilo Jimenez Rezende, and Daan Wierstra. Variational intrinsic control. ICLR Workshop , 2017.
- Nick Haber, Damian Mrowca, Li Fei-Fei, and Daniel LK Yamins. Learning to play with intrinsicallymotivated self-aware agents. arXiv preprint arXiv:1802.07442 , 2018. · arXiv
- Rein Houthooft, Xi Chen, Yan Duan, John Schulman, Filip De Turck, and Pieter Abbeel. VIME: Variational information maximizing exploration. In NIPS , 2016.
- Manuel Lopes, Tobias Lang, Marc Toussaint, and Pierre-Yves Oudeyer. Exploration in model-based reinforcement learning by empirically estimating learning progress. In NIPS , 2012.
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. Nature , 518(7540):529-533, February 2015.
- Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. Asynchronous methods for deep reinforcement learning. In ICML , 2016.
- Junhyuk Oh, Yijie Guo, Satinder Singh, and Honglak Lee. Self-imitation learning. arXiv preprint arXiv:1806.05635 , 2018. · arXiv
- OpenAI, :, M. Andrychowicz, B. Baker, M. Chociej, R. Jozefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba. Learning Dexterous In-Hand Manipulation. ArXiv e-prints , August 2018.
- Georg Ostrovski, Marc G Bellemare, Aaron van den Oord, and R´ emi Munos. Count-based exploration with neural density models. International Conference for Machine Learning , 2018.
- Zichao Yang, Marcin Moczulski, Misha Denil, Nando de Freitas, Alex Smola, Le Song, and Ziyu Wang. Deep fried convnets. In Proceedings of the IEEE International Conference on Computer Vision , pp. 1476-1483, 2015.
Cited by
Sorted by citations
Items 301–400 of 533
Self-Supervised Exploration via Temporal Inconsistency in Reinforcement Learning
Gao, Z., Xu, K., Zhai, Y., Ding, B., Feng, D., Mao, X., & Wang, H. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3413692 · Cited by 3
Yang, H., Zhao, Q., Wang, H., Liu, C. H., Li, G., Wang, G., Tang, J., & Wu, D. O. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3414608 · Cited by 3
Li, W., Lyu, H., Liang, S., Wang, T., & Li, H. (2024) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3649329.3656526 · Cited by 3
Unsupervised Skill Discovery for Robotic Manipulation through Automatic Task Generation
Jansonnie, P., Wu, B., Pérez, J., & Peters, J. (2024) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids58906.2024.10769879 · Cited by 3
An exploration-driven framework for path planning in complex buildings using improved MADDPG
Zhang, C., Liu, H., & Li, W. (2025) · Journal of Building Engineering · doi:10.1016/j.jobe.2025.112626 · Cited by 3
Haptics-based Curiosity for Sparse-reward Tasks
Rajeswar, S., Ibrahim, C., Surya, N., Golemo, F., Vázquez, D., Courville, A. C., & Pinheiro, P. O. (2021) · Conference on Robot Learning · Cited by 3
Modified PPO-RND Method for Solving Sparse Reward Problem in ViZDoom
Chen, J.-C., & Chang, T.-H. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8847999 · Cited by 4
Curiosity-Driven Exploration Effectiveness on Various Environments
Charoenpitaks, K., & Limpiyakorn, Y. (2019) · International Conference on Vision, Image and Signal Processing (ICVISP) · doi:10.1145/3387168.3387235 · Cited by 3
Learning-To-Ensemble by Contextual Rank Aggregation in E-Commerce
Wang, X., Huzhang, G., Lin, Q., & Da, Q. (2022) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3488560.3498401 · Cited by 3
Towards Informed Exploration for Deep Reinforcement Learning
Tang, H. (2019) · eScholarship (California Digital Library) · Cited by 3
Concept Learning in Deep Reinforcement Learning.Preprint
Gomez, D., Quijano, N., & Giraldo, L. F. (2020) · arXiv (Cornell University) · Cited by 3
Novel Policy Seeking with Constrained OptimizationPreprint
Sun, H., Peng, Z., Dai, B., Guo, J. C., Lin, D., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.10696 · Cited by 14
Learning to Play by Imitating HumansPreprint
Dinyari, R., Sermanet, P., & Lynch, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06874 · Cited by 6
Learning Abstract Models for Strategic Exploration and Fast Reward TransferPreprint
Liu, E. Z., Keramati, R., Seshadri, S., Guu, K., Pasupat, P., Brunskill, E., & Liang, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05896 · Cited by 7
Follow the Object: Curriculum Learning for Manipulation Tasks with Imagined GoalsPreprint
Kilinc, O., & Montana, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.02066 · Cited by 3
Disentangling causal effects for hierarchical reinforcement learningPreprint
Corcoll, O., & Vicente, R. (2020) · arXiv.org · doi:10.48550/arxiv.2010.01351 · Cited by 11
Self-Imitation Learning in Sparse Reward Settings.Preprint
Chen, Z., & Lin, M. (2020) · arXiv (Cornell University) · Cited by 3
Towards Automatic Actor-Critic Solutions to Continuous ControlPreprint
Grigsby, J., Yoo, J., & Qi, Y.-J. (2021) · arXiv.org · doi:10.48550/arxiv.2106.08918 · Cited by 7
Decoupled Exploration and Exploitation Policies for Sample-Efficient Reinforcement LearningPreprint
Whitney, W. F., Bloesch, M., Springenberg, J. T., Abdolmaleki, A., Cho, K., & Riedmiller, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09458 · Cited by 20
Backprop-Free Reinforcement Learning with Active Neural Generative CodingPreprint
Ororbia, A. G., & Mali, A. (2021) · doi:10.31219/osf.io/3nfcm · Cited by 3
Continual Auxiliary Task LearningPreprint
McLeod, M., Lo, C., Schlegel, M., Jacobsen, A., Kumaraswamy, R., White, M., & White, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.11133 · Cited by 3
State-novelty guided action persistence in deep reinforcement learning
Hu, J., Weng, P., & Ban, Y. (2025) · Machine Learning · doi:10.1007/s10994-024-06675-z · Cited by 3
Liu, T., Yang, C., Zhou, C., Li, Y., & Sun, B. (2025) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2025.3559766 · Cited by 2
Bougie, N., & Ichise, R. (2021) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-021-09527-5 · Cited by 3
GANs with Suppressed Mode Collapse Using Intrinsic Rewards
Tsuneda, T., Kiriyama, T., Shintani, K., & Yamane, S. (2021) · International Symposium on Computing and Networking Workshops (CANDARW) · doi:10.1109/candarw53999.2021.00037 · Cited by 2
Multi-Agent Reinforcement Learning via Directed Exploration Method
Xie, Y., Lin, R., & Zou, H. (2022) · International Conference on Consumer Electronics and Computer Engineering (ICCECE) · doi:10.1109/iccece54139.2022.9712687 · Cited by 2
Deep Reinforcement Learning with Parametric Episodic Memory
Chen, K., Gan, Z., Leng, S., & Guan, C. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891902 · Cited by 3
Curiosity-driven Exploration in VizDoom
Mikhaylova, E., & Makarov, I. (2022) · IEEE International Symposium on Intelligent Systems and Informatics (SISY) · doi:10.1109/sisy56759.2022.10036273 · Cited by 2
Expert-Free Online Transfer Learning in Multi-Agent Reinforcement Learning
Castagna, A., & Dusparić, I. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230291 · Cited by 2
KUROSU, H., Kurodo, Y., & Manabe, Y. (2023) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.35.4_759 · Cited by 2
Lee, S.-H., & Seo, S. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3375714 · Cited by 2
Virtual Action Actor-Critic Framework for Exploration (Student Abstract)
Park, B., Kim, T., Lai-Dang, Q.-V., & Har, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i21.30495 · Cited by 2
Combining AI control systems and human decision support via robustness and criticality
Woods, W., Grushin, A., Khan, S., & Velasquez, A. (2024) · Disruptive Technologies in Information Sciences · doi:10.1117/12.3016311 · Cited by 2
Nagashima, K., Morita, J., & Takeuchi, Y. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1397860 · Cited by 2
Mohammadzadeh, A., & Alattas, K. A. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107444 · Cited by 2
Rethinking Exploration and Experience Exploitation in Value-Based Multi-Agent Reinforcement Learning
Borzilov, A., Skrynnik, A., & Panov, A. I. (2025) · IEEE Access · doi:10.1109/access.2025.3530974 · Cited by 2
Balancing State Exploration and Skill Diversity in Unsupervised Skill Discovery
Liu, X., Chen, Y., Chen, G., Li, H., & Zhao, D. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3548821 · Cited by 3
Intrinsic-motivation multi-robot social formation navigation with coordinated exploration
Fu, H., Liu, W., & Zhou, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111740 · Cited by 2
Villin, V., Masuyama, N., & Nojima, Y. (2021) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci50451.2021.9659949 · Cited by 2
Do Game Bots Dream of Electric Rewards?
Sweetser, P., & Aitchison, M. (2020) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3402942.3402965 · Cited by 2
Kuyoshi, D., Imade, K., & Yamane, S. (2020) · International Symposium on Computing and Networking Workshops (CANDARW) · doi:10.1109/candarw51189.2020.00095 · Cited by 2
Learning on a Budget via Teacher Imitation
İlhan, E., Gow, J., & Pérez-Liébana, D. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619033 · Cited by 2
Baier, H., & Kaisers, M. (2021) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3449726.3463217 · Cited by 2
Guo, X., Hu, A., & Zhang, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20633 · Cited by 2
Columba: A New Approach to Train an Agent for Autonomous Driving
Yang, R., Tang, H., Jin, B., & Liu, K. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533604 · Cited by 2
Reinforcement Learning with Potential Functions Trained to Discriminate Good and Bad States
Chen, Y., Kasaei, H., Schomaker, L., & Wiering, M. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533682 · Cited by 3
Seeking Visual Discomfort: Curiosity-driven Representations for Reinforcement Learning
Aljalbout, E., Ulmer, M., & Triebel, R. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811663 · Cited by 2
OPEn: An Open-ended Physics Environment for Learning Without a Task
Gan, C., Bhandwaldar, A., Torralba, A. B., Tenenbaum, J. B., & Isola, P. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636830 · Cited by 3
Multi-Temporal Abstraction with Time-Aware Deep Q-Learning for Septic Shock Prevention
Kim, Y. J., Ausin, M. S., & Chi, M. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671662 · Cited by 5
Uncertainty Estimation based Intrinsic Reward For Efficient Reinforcement Learning
Chen, C., Wan, T., Shi, P., Ding, B., Gao, Z., & Feng, D. (2022) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc56315.2022.00008 · Cited by 3
Underexplored Subspace Mining for Sparse-Reward Cooperative Multi-Agent Reinforcement Learning
Yu, Y., Yin, Q., Zhang, J., Chen, H., & Huang, K. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191833 · Cited by 2
Preference-conditioned Pixel-based AI Agent For Game Testing
Abdelfattah, S. M., Brown, A., & Zhang, P. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333200 · Cited by 2
Double Buffers CEM-TD3: More Efficient Evolution and Richer Exploration
Zhu, S., Shen, C., Lü, S., Wu, J., & An, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29665 · Cited by 2
Bucher, B., Schmeckpeper, K., Matni, N., & Daniilidis, K. (2020) · Cited by 2
Improving Model-Based Control and Active Exploration with Reconstruction Uncertainty OptimizationPreprint
Palo, N. D., & Harri Valpola, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03955 · Cited by 2
Amplifying the Imitation Effect for Reinforcement Learning of UCAV's Mission ExecutionPreprint
Lee, G. T., & Kim, C. O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.05856 · Cited by 2
Unsupervised Discovery of Decision States for Transfer in Reinforcement Learning.Preprint
Modhe, N., Chattopadhyay, P., Sharma, M. K., Das, A., Parikh, D., Batra, D., & Vedantam, R. (2019) · arXiv (Cornell University) · Cited by 2
Interpretable Few-Shot Learning via Linear DistillationPreprint
Asadulaev, A., Kuznetsov, I. A., & Filchenkov, A. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05431 · Cited by 2
Evaluating task-agnostic exploration for fixed-batch learning of arbitrary future tasksPreprint
Dasagi, V., Lee, R., Bruce, J., & Leitner, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08666 · Cited by 2
Learning Reinforced Agents with Counterfactual Simulation for Medical Automatic Diagnosis.Preprint
Lin, J., Chen, Z., Liang, X., Wang, K., & Lin, L. (2020) · arXiv (Cornell University) · Cited by 2
$\gamma$-Regret for Non-Episodic Reinforcement LearningPreprint
Liu, S., & Su, H. (2020) · arXiv (Cornell University) · Cited by 3
Online Safety Assurance for Deep Reinforcement LearningPreprint
Rotman, N. H., Schapira, M., & Tamar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03625 · Cited by 2
Bridging In- and Out-of-distribution Samples for Their Better DiscriminabilityPreprint
Techapanurak, E., Dang, A.-C., & Okatani, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.02500 · Cited by 3
RECON: Rapid Exploration for Open-World Navigation with Latent Goal ModelsPreprint
Shah, D., Eysenbach, B., Rhinehart, N., & Levine, S. (2021) · arXiv (Cornell University) · Cited by 2
A Novel Approach to Curiosity and Explainable Reinforcement Learning via Interpretable Sub-GoalsPreprint
van Rossum, C., Feinberg, C., Shumays, A. A., Baxter, K., & Bartha, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06630 · Cited by 2
A brain basis of dynamical intelligence for AI and computational neurosciencePreprint
Monaco, J. D., Rajan, K., & Hwang, G. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.07284 · Cited by 7
DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual ManipulationPreprint
Zhang, M., Jian, P., Wu, Y., Xu, H., & Wang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05907 · Cited by 5
Maximum Entropy Model-based Reinforcement LearningPreprint
Svidchenko, O., & Shpilman, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01195 · Cited by 3
On the computational principles underlying human explorationPreprint
Fox, L., Dan, O., & Loewenstein, Y. (2023) · eLife · doi:10.7554/elife.90684 · Cited by 2
Abstract and Explore: A Novel Behavioral Metric with Cyclic Dynamics in Reinforcement Learning
Zhu, A., Zhang, P.-F., Qiu, R., Zheng, Z., Huang, Z. H., & Shao, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29660 · Cited by 2
A Study of Global and Episodic Bonuses for Exploration in Contextual MDPs
Henaff, M., Jiang, M., & Raileanu, R. (2023) · arXiv · doi:10.48550/arxiv.2306.03236 · Cited by 1
“Random Network Distillation (RND) (Burda et al., 2019b) randomly initializes a neural network ¯ f : S → R k , and then trains a second neural network f with the same architecture to predict the outputs of ¯ f on states encountered by the agent.”
BackgroundMethodInfluentialSummerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0006 · Cited by 1
Progressive Diversifying Policy for Multi-Agent Reinforcement Learning
Sun, S., Zhai, Y., Xu, K., Feng, D., & Ding, B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096125 · Cited by 1
Markov Decision Processes with Time-Varying Geometric Discounting
Gan, J., Hennes, A., Majumdar, R., Mandal, D., & Radanović, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26413 · Cited by 1
Expert Data Augmentation in Imitation Learning (Student Abstract)
Han, F., & Zhang, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26970 · Cited by 1
Multi-Agent Exploration via Self-Learning and Social Learning
Dong, S., Li, C., Chen, W., Cao, H., Li, W., & Gao, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446068 · Cited by 1
Phased Continuous Exploration Method for Cooperative Multi-Agent Reinforcement Learning
Kang, J., Hou, Y., Zeng, Y., Chen, Y., Tong, X., Xu, X., & Zhang, Q. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00196 · Cited by 1
Martínez-Seras, A., Andrés, A., & Ser, J. D. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650670 · Cited by 1
Kurodo, Y., & Manabe, Y. (2024) · Joint International Conference on Soft Computing and Intelligent Systems and International Symposium on Advanced Intelligent Systems (SCIS&ISIS) · doi:10.1109/scisisis61014.2024.10760002 · Cited by 1
Active Reinforcement Learning Strategies for Offline Policy Improvement
Dukkipati, A., Ayyagari, R. S., Dasgupta, B., Dutta, P., & Onteru, P. R. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i16.33803 · Cited by 1
Maximum Next-State Entropy for Efficient Reinforcement Learning
Zhong, D., Yang, Y., Zhang, Z., Jiang, Y., Xu, B., & Zhao, Q. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3572822 · Cited by 1
Xu, P., Chen, H., Yang, W., & Huang, K. (2025) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2025.3574024 · Cited by 1
Wang, H., Sun, Y., Tang, Z., Shi, H., & Jiao, C. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107781 · Cited by 1
Causal dreamer for partially observable model-based reinforcement learning
Gao, H., Xu, T., Zhang, T., Guo, Y., Zhao, C., Ren, J., Jiang, Y., Guo, S., & Chen, F. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131012 · Cited by 2
BAYESIAN OPTIMIZATION OF HYPERPARAMETERS FOR RAINBOW DQN IN THE CARTPOLE-V1 ENVIRONMENT
Veluru, A. (2026) · ICTACT Journal on Data Science and Machine Learning · doi:10.21917/ijdsml.2026.0188 · Cited by 1
SEMI: Self-supervised Exploration via Multisensory Incongruity
Wang, J., Zhuang, Z., & Zhao, H. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811979 · Cited by 1
Learning to Play Hard Exploration Games Using Graph-Guided Self-Navigation
Zhao, E., Yan, R., Li, K., Li, L., & Xing, J. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534251 · Cited by 1
Multi-Agent Reinforcement Learning with Clipping Intrinsic Motivation
(2022) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2022.12.3.1084 · Cited by 1
Learning Attentional and Gated Communication via Curiosity
Sun, C., Zhou, K., Cong, C., Li, K., Wang, R., & Hu, X. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/2951193 · Cited by 2
Multi-Agent Reinforcement Learning-Implementation of Hide and Seek
Jagtap, S., Allen, T., Gadiwan, S., & Mishra, S. (2022) · IEEE Global Conference for Advancement in Technology (GCAT) · doi:10.1109/gcat55367.2022.9972125 · Cited by 1
An Optimistic Approach to the Temporal Difference Error in Off-Policy Actor-Critic Algorithms
Sağlam, B., Mutlu, F. B., & Kozat, S. S. (2022) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci51031.2022.10022298 · Cited by 1
Exploring Policy Diversity in Parallel Actor-Critic Learning
Zhang, Y., Zhai, Y., Zhou, G., Ding, B., Feng, D., & Liu, S. (2022) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai56018.2022.00182 · Cited by 1
An Autonomous Non-monolithic Agent with Multi-mode Exploration based on Options Framework
Kim, J., Xuan, J., Liang, C., & Hussain, F. K. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191360 · Cited by 1
Mnemonic Dictionary Learning for Intrinsic Motivation in Reinforcement Learning
Yan, R., Wu, Z., Zhan, Y., Tao, P., Wang, Z., Cai, Y., & Xing, J. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191424 · Cited by 1
Multi-agent Collaborative Target Search Based on Curiosity Intrinsic Motivation
Zhang, X., Zheng, Y., Wang, L., & Fumiya Iida, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43360-3_29 · Cited by 1
Sample-Efficient Imitation Learning via Reconstructed Intrinsic Reward
Zhang, Z., Liang, Y., Liu, Y., & Zhang, C. (2023) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus58632.2023.10318433 · Cited by 1
Actively learning costly reward functions for reinforcement learning
Eberhard, A., Metni, H., Fahland, G., Stroh, A., & Friederich, P. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad33e0 · Cited by 3
UNeC: Unsupervised Exploring In Controllable Space
Xiong, X., Meng, L., Ruan, J., Xu, S., & Xu, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447360 · Cited by 1
Curiosity-Driven Learning for Visual Control of Nonholonomic Mobile Robots
Soualhi, T., Crombez, N., Lombard, A., Galland, S., & Ruichek, Y. (2024) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur61395.2024.10597480 · Cited by 1
A Method of Path Planning and Intelligent Exploration for Robot Based on Deep Reinforcement Learning
Lyu, X., Zang, Z., & Li, S. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651449 · Cited by 1
Metadata
- Authors
- Burda, Y., Edwards, H., Storkey, A., & Klimov, O.
- Affiliations
- OpenAI (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.12894
- OpenAlex
- W2899205164
- Cited by
- 527
- References
- 41
- Citations by year
- 2026: 2 · 2025: 35 · 2024: 75 · 2023: 77 · 2022: 79 · 2021: 115 · 2020: 87 · 2019: 52 · 2018: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- random network distillation, exploration bonus, deep reinforcement learning, intrinsic rewards, Atari games, Montezuma's Revenge, feature prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
