Exploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domain
Open accessAbstract
Deep Reinforcement Learning (DRL) and Deep Multi-agent Reinforcement Learning (MARL) have achieved significant successes across a wide range of domains, including game AI, autonomous vehicles, robotics, and so on. However, DRL and deep MARL agents are widely known to be sample inefficient that millions of interactions are usually needed even for relatively simple problem settings, thus preventing the wide application and deployment in real-industry scenarios. One bottleneck challenge behind is the well-known exploration problem, i.e., how efficiently exploring the environment and collecting informative experiences that could benefit policy learning towards the optimal ones. This problem becomes more challenging in complex environments with sparse rewards, noisy distractions, long horizons, and non-stationary co-learners. In this paper, we conduct a comprehensive survey on existing exploration methods for both single-agent and multi-agent RL. We start the survey by identifying several key challenges to efficient exploration. Beyond the above two main branches, we also include other notable exploration methods with different ideas and techniques. In addition to algorithmic analysis, we provide a comprehensive and unified empirical comparison of different exploration methods for DRL on a set of commonly used benchmarks. According to our algorithmic and empirical investigation, we finally summarize the open problems of exploration in DRL and deep MARL and point out a few future directions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The failure of RL-VMC may be due to problems such as credit assignment, deep exploration, and vanishing gradients.
“The extreme long-horizon in our activities causes the visuomotor control (RL-VMC) policy to fail in all three activities, potentially due to problems such as credit assignment [65], deep exploration [66, 67], and vanishing gradients [68] as reported by prior works.”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [66]
The extreme long-horizon in BEHAVIOR-1K activities causes the visuomotor control (RL-VMC) policy to fail in all three activities.
“The extreme long-horizon in our activities causes the visuomotor control (RL-VMC) policy to fail in all three activities, potentially due to problems such as credit assignment [65], deep exploration [66, 67], and vanishing gradients [68] as reported by prior works.”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [66]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · see citing works
Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666 · see citing works
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · see citing works
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · see citing works
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · see citing works
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · see citing works
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · see citing works
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · see citing works
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578 · see citing works
Addressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650 · see citing works
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377 · see citing works
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318 · see citing works
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300 · see citing works
Self-citationSchaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120 · see citing works
Conditional Image Generation with PixelCNN DecodersPreprint
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1606.05328 · Cited by 3,066 · see citing works
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712 · see citing works
Asymptotically efficient adaptive allocation rules
Lai, T. L., & Robbins, H. (1985) · Advances in Applied Mathematics · doi:10.1016/0196-8858(85)90002-8 · Cited by 2,406 · see citing works
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235 · see citing works
Counterfactual Multi-Agent Policy Gradients
Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11794 · Cited by 1,873 · see citing works
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · see citing works
Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping
Ng, A. Y., Harada, D., & Russell, S. (1999) · Cited by 1,586 · see citing works
A Tutorial on Bayesian OptimizationPreprint
Frazier, P. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02811 · Cited by 1,423 · see citing works
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
Zhang, K., Yang, Z., & Başar, T. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-60990-0_12 · Cited by 1,403 · see citing works
Andrychowicz, M., Wolski, F., Ray, A., Schneider, J., Fong, R., Welinder, P., McGrew, B., Tobin, J., Abbeel, P., & Zaremba, W. (2017) · arXiv · doi:10.48550/arxiv.1707.01495 · Cited by 1,355 · see citing works
Deep Variational Information BottleneckPreprint
Alemi, A. A., Fischer, I., Dillon, J. V., & Murphy, K. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00410 · Cited by 1,291 · see citing works
Using confidence bounds for exploitation-exploration trade-offs
Auer, P. L. (2003) · Cited by 1,219 · see citing works
(2015) · Journal of Machine Learning Research · Cited by 1,119 · see citing works
Barycenters in the Wasserstein Space
Agueh, M., & Carlier, G. (2011) · SIAM Journal on Mathematical Analysis · doi:10.1137/100805741 · Cited by 1,100 · see citing works
Practical Variational Inference for Neural Networks
Graves, A. (2011) · Cited by 1,079 · see citing works
QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement LearningPreprint
Rashid, T., Samvelyan, M., de Witt, C. S., Farquhar, G., Foerster, J., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.11485 · Cited by 1,019 · see citing works
Deep Reinforcement Learning: An Overview
Mousavi, S. S., Schukat, M., & Howley, E. (2017) · Lecture notes in networks and systems · doi:10.1007/978-3-319-56991-8_32 · Cited by 989 · see citing works
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3618-5_2 · Cited by 941 · see citing works
Deep Exploration via Bootstrapped DQNPreprint
Osband, I., Blundell, C., Pritzel, A., & Roy, B. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04621 · Cited by 837 · see citing works
A survey and critique of multiagent deep reinforcement learning
Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 747 · see citing works
(2016) · neural information processing systems · Cited by 735 · see citing works
A Distributional Perspective on Reinforcement LearningPreprint
Bellemare, M. G., Dabney, W., & Munos, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.06887 · Cited by 724 · see citing works
Estimating the mean and variance of the target probability distribution
Nix, D. A., & Weigend, A. S. (1994) · doi:10.1109/icnn.1994.374138 · Cited by 720 · see citing works
Constrained Policy OptimizationPreprint
Achiam, J., Held, D., Tamar, A., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10528 · Cited by 706 · see citing works
Improving generalization for temporal difference learning: The successor representation
Dayan, P. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.613 · Cited by 693 · see citing works
Noisy Networks for ExplorationPreprint
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 664 · see citing works
Visual Reinforcement Learning with Imagined GoalsPreprint
Nair, A., Pong, V. H., Dalal, M., Bahl, S., Lin, S., & Levine, S. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1807.04742 · Cited by 623 · see citing works
Distributional Reinforcement Learning With Quantile Regression
Dabney, W., Rowland, M., Bellemare, M., & Munos, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11791 · Cited by 612 · see citing works
Dream to Control: Learning Behaviors by Latent Imagination
Hafner, D., Lillicrap, T., Ba, J., & Norouzi, M. (2019) · arXiv · doi:10.48550/arxiv.1912.01603 · Cited by 558 · see citing works
Distributed Prioritized Experience ReplayPreprint
Horgan, D., Quan, J., Budden, D. M., Barth-Maron, G., Hessel, M., van Hasselt, H. P., & Silver, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00933 · Cited by 557 · see citing works
ViZDoom: A Doom-based AI research platform for visual reinforcement learning
Kempka, M., Wydmuch, M., Runc, G., Toczek, J., & Jaśkowski, W. (2016) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860433 · Cited by 550 · see citing works
Incentivizing Exploration In Reinforcement Learning With Deep Predictive ModelsPreprint
Stadie, B. C., Levine, S., & Abbeel, P. (2015) · arXiv.org · doi:10.48550/arxiv.1507.00814 · Cited by 545 · see citing works
A Tutorial on Thompson Sampling
Russo, D., Roy, B. V., Kazerouni, A., Osband, I., & Wen, Z. (2018) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000070 · Cited by 543 · see citing works
Exploration in deep reinforcement learning: A survey
Ladosz, P., Weng, L., Kim, M., & Oh, H. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.003 · Cited by 525 · cited 1× · see citing works
“Work [21] is a concurrent work.”
CURL: Contrastive Unsupervised Representations for Reinforcement LearningPreprint
Srinivas, A., Laskin, M., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04136 · Cited by 521 · see citing works
#Exploration: A Study of Count-Based Exploration for Deep Reinforcement LearningPreprint
Tang, H., Houthooft, R., Foote, D., Stooke, A., Chen, X., Duan, Y., Schulman, J., Turck, F. D., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04717 · Cited by 486 · see citing works
Self-citationDiversity is All You Need: Learning Skills without a Reward Function
Eysenbach, B., Gupta, A., Ibarz, J., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1802.06070 · Cited by 480 · see citing works
Action-Conditional Video Prediction using Deep Networks in Atari GamesPreprint
Oh, J., Guo, X., Lee, H., Lewis, R. L., & Singh, S. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.08750 · Cited by 473 · see citing works
A comprehensive survey of anomaly detection techniques for high dimensional big data
Thudumu, S., Branch, P., Jin, J., & Singh, J. (2020) · Journal Of Big Data · doi:10.1186/s40537-020-00320-x · Cited by 454 · see citing works
Parameter Space Noise for ExplorationPreprint
Plappert, M., Houthooft, R., Dhariwal, P., Sidor, S., Chen, R. Y., Chen, X., Asfour, T., Abbeel, P., & Andrychowicz, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01905 · Cited by 423 · see citing works
Large-Scale Study of Curiosity-Driven Learning
Burda, Y., Edwards, H., Pathak, D., Storkey, A., Darrell, T., & Efros, A. A. (2018) · arXiv · doi:10.48550/arxiv.1808.04355 · Cited by 401 · see citing works
Reward Constrained Policy OptimizationPreprint
Tessler, C., Mankowitz, D. J., & Mannor, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11074 · Cited by 399 · see citing works
Count-Based Exploration with Neural Density Models
Ostrovski, G., Bellemare, M. G., Oord, A. V. D., & Munos, R. (2017) · arXiv · doi:10.48550/arxiv.1703.01310 · Cited by 377 · see citing works
Is Q-learning Provably Efficient?Preprint
Jin, C., Allen-Zhu, Z., Bubeck, S., & Jordan, M. I. (2018) · arXiv (Cornell University) · Cited by 368 · see citing works
Bayesian Surprise Attracts Human Attention
Itti, L., & Baldi, P. (2005) · neural information processing systems · Cited by 363 · see citing works
A Bayesian Framework for Reinforcement Learning
Strens, M. J. A. (2000) · Cited by 361 · see citing works
Deep Reinforcement Learning in Parameterized Action SpacePreprint
Hausknecht, M. J., & Stone, P. (2015) · International Conference on Learning Representations · doi:10.48550/arxiv.1511.04143 · Cited by 360 · see citing works
Machado, M. C., Bellemare, M. G., Talvitie, E., Veness, J., Hausknecht, M., & Bowling, M. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5699 · Cited by 359 · see citing works
Successor Features for Transfer in Reinforcement LearningPreprint
Barreto, A. D. M. S., Dabney, W., Munos, R., Hunt, J. J., Schaul, T., Silver, D., & van Hasselt, H. P. (2016) · arXiv (Cornell University) · doi:10.13140/rg.2.2.35439.18085 · Cited by 349 · see citing works
A Deep Hierarchical Approach to Lifelong Learning in Minecraft
Tessler, C., Givony, S., Zahavy, T., Mankowitz, D. J., & Mannor, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10744 · Cited by 300 · see citing works
Social Influence as Intrinsic Motivation for Multi-Agent Deep Reinforcement LearningPreprint
Jaques, N., Lazaridou, A., Hughes, E., Gülçehre, Ç., Ortega, P. A., Strouse, D., Leibo, J. Z., & de Freitas, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08647 · Cited by 296 · see citing works
Recurrent Experience Replay in Distributed Reinforcement Learning.
Kapturowski, S., Ostrovski, G., Quan, J., Munos, R., & Dabney, W. (2018) · International Conference on Learning Representations · Cited by 292 · see citing works
Deep reinforcement learning: a survey
Wang, H.-N., Liu, N., Zhang, Y., Feng, D., Huang, F., Li, D., & Zhang, Y. (2020) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1900533 · Cited by 286 · see citing works
Safe Exploration in Continuous Action SpacesPreprint
Dalal, G., Dvijotham, K., Vecerík, M., Hester, T., Păduraru, C., & Tassa, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.08757 · Cited by 284 · see citing works
Learning to Navigate in Cities Without a MapPreprint
Mirowski, P., Grimes, M. K., Malinowski, M., Hermann, K. M., Anderson, K., Teplyashin, D., Simonyan, K., Kavukcuoglu, K., Zisserman, A., & Hadsell, R. T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.00168 · Cited by 248 · see citing works
(More) Efficient Reinforcement Learning via Posterior SamplingPreprint
Osband, I., Russo, D., & Roy, B. V. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0940 · Cited by 236 · see citing works
Intrinsic Motivation and Reinforcement Learning
Barto, A. G. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1_2 · Cited by 234 · see citing works
Episodic Curiosity through ReachabilityPreprint
Savinov, N., Raichuk, A., Marinier, R., Vincent, D., Pollefeys, M., Lillicrap, T., & Gelly, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02274 · Cited by 231 · see citing works
MAVEN: Multi-Agent Variational ExplorationPreprint
Mahajan, A., Rashid, T., Samvelyan, M., & Whiteson, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07483 · Cited by 230 · see citing works
Epistemic planning for single- and multi-agent systems
Bolander, T., & Andersen, M. B. (2011) · Journal of Applied Non-Classical Logics · doi:10.3166/jancl.21.9-34 · Cited by 220 · see citing works
Agent57: Outperforming the Atari Human BenchmarkPreprint
Badia, A. P., Piot, B., Kapturowski, S., Sprechmann, P., Vitvitskyi, A., Guo, D., & Blundell, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13350 · Cited by 216 · see citing works
Variational Intrinsic ControlPreprint
Gregor, K., Rezende, D. J., & Wierstra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07507 · Cited by 213 · see citing works
Model-Based Active ExplorationPreprint
Shyam, P., Jaśkowski, W., & Gomez, F. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1810.12162 · Cited by 207 · see citing works
Go-Explore: a New Approach for Hard-Exploration Problems
Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1901.10995 · Cited by 205 · see citing works
On Bayesian Upper Confidence Bounds for Bandit Problems
Kaufmann, E., Garivier, A., & Paristech, T. (2012) · Cited by 201 · see citing works
Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2021) · RePEc: Research Papers in Economics · Cited by 201 · see citing works
Semi-parametric Topological Memory for NavigationPreprint
Savinov, N., Dosovitskiy, A., & Koltun, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00653 · Cited by 194 · see citing works
Provably Efficient Reinforcement Learning with Linear Function ApproximationPreprint
Jin, C., Yang, Z., Wang, Z., & Jordan, M. I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05388 · Cited by 193 · see citing works
Self-citationSelf-Supervised Exploration via DisagreementPreprint
Pathak, D., Gandhi, D., & Gupta, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04161 · Cited by 190 · see citing works
Trial without Error: Towards Safe Reinforcement Learning via Human Intervention
Saunders, W., Sastry, G., Stuhlmüller, A., & Evans, O. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/mzmg4429 · Cited by 188 · see citing works
Dynamics-Aware Unsupervised Discovery of SkillsPreprint
Sharma, A., Gu, S., Levine, S., Kumar, V., & Hausman, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01657 · Cited by 187 · see citing works
Self-Imitation LearningPreprint
Oh, J., Guo, Y., Singh, S. P., & Lee, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05635 · Cited by 184 · see citing works
Near-optimal Regret Bounds for Reinforcement Learning
Auer, P. L., Jaksch, T., & Ortner, R. (2008) · Cited by 184 · see citing works
A survey on intrinsic motivation in reinforcement learningPreprint
Aubret, A., Matignon, L., & Hassas, S. (2019) · arXiv.org · doi:10.48550/arxiv.1908.06976 · Cited by 175 · see citing works
Xiong, J., Wang, Q., Yang, Z., Sun, P., Han, L., Zheng, Y., Fu, H., Zhang, T., Liu, J., & Liu, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06394 · Cited by 170 · see citing works
Self-citationNever Give Up: Learning Directed Exploration Strategies
Badia, A. P., Sprechmann, P., Vitvitskyi, A., Guo, D., Piot, B., Kapturowski, S., Tieleman, O., Arjovsky, M., Pritzel, A., Bolt, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2002.06038 · Cited by 170 · see citing works
Generalization and Exploration via Randomized Value FunctionsPreprint
Osband, I., Roy, B. V., & Wen, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.0635 · Cited by 169 · see citing works
Salge, C., Glackin, C., & Polani, D. (2013) · Emergence, complexity and computation · doi:10.1007/978-3-642-53734-9_4 · Cited by 155 · see citing works
Li, M., Cao, Z., & Li, Z. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3071959 · Cited by 154 · see citing works
Deep Exploration via Randomized Value FunctionsPreprint
Osband, I., Roy, B. V., Russo, D., & Wen, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07608 · Cited by 153 · see citing works
A multi-objective deep reinforcement learning framework
Nguyen, T. T., Nguyen, N. D., Vamplew, P., Nahavandi, S., Dazeley, R., & Lim, C. P. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103915 · Cited by 152 · see citing works
Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play
Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A., & Fergus, R. (2017) · arXiv · doi:10.48550/arxiv.1703.05407 · Cited by 149 · see citing works
Surprise-Based Intrinsic Motivation for Deep Reinforcement Learning
Achiam, J., & Sastry, S. (2017) · arXiv · doi:10.48550/arxiv.1703.01732 · Cited by 139 · see citing works
Responsive Safety in Reinforcement Learning by PID Lagrangian MethodsPreprint
Stooke, A., Achiam, J., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03964 · Cited by 138 · see citing works
On Learning Intrinsic Rewards for Policy Gradient MethodsPreprint
Zheng, Z., Oh, J., & Singh, S. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06459 · Cited by 131 · see citing works
Planning to Explore via Self-Supervised World Models
Sekar, R., Rybkin, O., Daniilidis, K., Abbeel, P., Hafner, D., & Pathak, D. (2020) · arXiv · doi:10.48550/arxiv.2005.05960 · Cited by 129 · see citing works
Kong, L., He, W., Yang, W., Li, Q., & Kaynak, O. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2998837 · Cited by 128 · see citing works
Randomized Prior Functions for Deep Reinforcement LearningPreprint
Osband, I., Aslanides, J., & Cassirer, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03335 · Cited by 124 · see citing works
Safe Exploration in Finite Markov Decision Processes with Gaussian ProcessesPreprint
Turchetta, M., Berkenkamp, F., & Krause, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04753 · Cited by 116 · see citing works
Efficient Exploration Through Bayesian Deep Q-Networks
Azizzadenesheli, K., Brunskill, E., & Anandkumar, A. (2018) · Information Theory and Applications Workshop (ITA) · doi:10.1109/ita.2018.8503252 · Cited by 112 · see citing works
SUNRISE: A Simple Unified Framework for Ensemble Learning in Deep Reinforcement LearningPreprint
Lee, K., Laskin, M., Srinivas, A., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04938 · Cited by 111 · see citing works
Learning Montezuma's Revenge from a Single DemonstrationPreprint
Salimans, T., & Chen, R. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03381 · Cited by 102 · see citing works
Curriculum-guided Hindsight Experience Replay
Fang, M., Zhou, T., Du, Y., Han, L., & Zhang, Z. (2019) · neural information processing systems · Cited by 102 · see citing works
LIIR: Learning Individual Intrinsic Reward in Multi-Agent Reinforcement Learning
Du, Y., Han, L., Fang, M., Liu, J., Dai, T., & Tao, D. (2019) · neural information processing systems · Cited by 102 · see citing works
Self-citationProvably Efficient Exploration in Policy OptimizationPreprint
Cai, Q., Yang, Z., Jin, C., & Wang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05830 · Cited by 100 · see citing works
Self-citationReinforcement Learning With Task Decomposition for Cooperative Multiagent Systems
Sun, C., Liu, W., & Dong, L. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996209 · Cited by 98 · see citing works
Efficient Exploration via State Marginal MatchingPreprint
Lee, L., Eysenbach, B., Parisotto, E., Xing, E. P., Levine, S., & Salakhutdinov, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05274 · Cited by 97 · see citing works
EX2: Exploration with Exemplar Models for Deep Reinforcement Learning
Fu, J., Co-Reyes, J. D., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.01260 · Cited by 95 · see citing works
Uncertainty-driven Imagination for Continuous Deep Reinforcement Learning
Kalweit, G., & Boedecker, J. (2017) · Conference on Robot Learning · Cited by 94 · see citing works
Bajcsy, A. V., Bansal, S., Bronstein, E., Tolani, V., & Tomlin, C. J. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9030133 · Cited by 91 · see citing works
Information Directed Sampling and Bandits with Heteroscedastic NoisePreprint
Kirschner, J., & Krause, A. (2018) · arXiv (Cornell University) · doi:10.3929/ethz-b-000310984 · Cited by 90 · see citing works
Count-Based Exploration in Feature Space for Reinforcement Learning
Martin, J., Sasikumar, S. N., Everitt, T., & Hütter, M. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/344 · Cited by 87 · see citing works
Better Exploration with Optimistic Actor-Critic
Ciosek, K., Vuong, Q., Loftin, R., & Hofmann, K. (2019) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.1910.12807 · Cited by 85 · see citing works
Thananjeyan, B., Balakrishna, A., Rosolia, U., Li, F., McAllister, R., Gonzalez, J. E., Levine, S., Borrelli, F., & Goldberg, K. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2976272 · Cited by 83 · see citing works
Variational Option Discovery AlgorithmsPreprint
Achiam, J., Edwards, H. S., Amodei, D., & Abbeel, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10299 · Cited by 82 · see citing works
Curiosity-driven Exploration in Deep Reinforcement Learning via Bayesian Neural NetworksPreprint
Houthooft, R., Chen, X., Duan, Y., Schulman, J. D., de Turck, F., & Abbeel, P. (2016) · arXiv.org · doi:10.48550/arxiv.1605.09674 · Cited by 81 · see citing works
Lipton, Z. C., Li, X., Gao, J., Li, L. C., Ahmed, F., & Deng, L. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11946 · Cited by 81 · see citing works
Deep Multi-Agent Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces
Fu, H., Tang, H., Hao, J., Lei, Z., Chen, Y., & Fan, C. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/323 · Cited by 81 · see citing works
Self-citationStein Variational Policy GradientPreprint
Liu, Y., Ramachandran, P., Liu, Q., & Peng, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.02399 · Cited by 76 · see citing works
Conservative Safety Critics for ExplorationPreprint
Bharadhwaj, H., Kumar, A., Rhinehart, N., Levine, S., Shkurti, F., & Garg, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14497 · Cited by 75 · see citing works
Single-Model Uncertainties for Deep LearningPreprint
Tagasovska, N., & López-Paz, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00908 · Cited by 74 · see citing works
Learning Action Representations for Reinforcement LearningPreprint
Chandak, Y., Theocharous, G., Kostas, J., Jordan, S. M., & Thomas, P. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00183 · Cited by 72 · see citing works
Influence-Based Multi-Agent Exploration
Wang, T., Wang, J., Wu, Y., & Zhang, C. (2019) · arXiv · doi:10.48550/arxiv.1910.05512 · Cited by 69 · see citing works
EMI: Exploration with Mutual InformationPreprint
Kim, H., Kim, J., Jeong, Y., Levine, S., & Song, H. O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01176 · Cited by 65 · see citing works
Reinforcement Learning with Prototypical RepresentationsPreprint
Yarats, D., Fergus, R., Lazaric, A., & Pinto, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11271 · Cited by 64 · see citing works
DHER: Hindsight Experience Replay for Dynamic Goals
Fang, M., Zhou, C., Shi, B., Gong, B., Xu, J., & Zhang, T. (2018) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 64 · see citing works
Cooperative Exploration for Multi-Agent Deep Reinforcement LearningPreprint
Liu, I.-J., Jain, U., Yeh, R. A., & Schwing, A. G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11444 · Cited by 62 · see citing works
Contingency-Aware Exploration in Reinforcement LearningPreprint
Choi, J., Guo, Y., Moczulski, M., Oh, J., Wu, N., Norouzi, M., & Lee, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01483 · Cited by 57 · see citing works
Exploration via Hindsight Goal GenerationPreprint
Ren, Z., Dong, K., Zhou, Y., Liu, Q., & Peng, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04279 · Cited by 57 · see citing works
Distributional Reinforcement Learning for Efficient ExplorationPreprint
Mavrin, B., Zhang, S., Yao, H., Kong, L., Wu, K., & Yu, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.06125 · Cited by 57 · see citing works
Maximum Entropy-Regularized Multi-Goal Reinforcement LearningPreprint
Zhao, R., Sun, X., & Tresp, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.08786 · Cited by 56 · see citing works
Estimating Risk and Uncertainty in Deep Reinforcement LearningPreprint
Clements, W. R., van Delft, B., Robaglia, B.-M., Slaoui, R. B., & Toth, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09638 · Cited by 54 · see citing works
Novelty Search in representational space for sample efficient explorationPreprint
Tao, R.-Y., François-Lavet, V., & Pineau, J. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2009.13579 · Cited by 54 · see citing works
Bootstrapped Thompson Sampling and Deep ExplorationPreprint
Osband, I., & Roy, B. V. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.00300 · Cited by 53 · see citing works
The Uncertainty Bellman Equation and ExplorationPreprint
O’Donoghue, B., Osband, I., Munos, R., & Mnih, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05380 · Cited by 53 · see citing works
Episodic Multi-agent Reinforcement Learning with Curiosity-Driven ExplorationPreprint
Zheng, L., Chen, J., Wang, J., He, J., Hu, Y., Chen, Y., Fan, C., Gao, Y., & Zhang, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.11032 · Cited by 52 · see citing works
Keeping Your Distance: Solving Sparse Reward Tasks Using Self-Balancing Shaped RewardsPreprint
Trott, A., Zheng, S., Xiong, C., & Socher, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.01417 · Cited by 50 · see citing works
Learning Self-Imitating Diverse PoliciesPreprint
Gangwani, T., Liu, Q., & Peng, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10309 · Cited by 49 · see citing works
Verifiably safe exploration for end-to-end reinforcement learning
Hunt, N., Fulton, N., Magliacane, S., Hoang, T. N., Das, S., & Solar-Lezama, A. (2021) · International Conference on Hybrid Systems: computation and control · doi:10.1145/3447928.3456653 · Cited by 48 · see citing works
Combating Reinforcement Learning's Sisyphean Curse with Intrinsic FearPreprint
Lipton, Z. C., Azizzadenesheli, K., Kumar, A., Li, L., Gao, J., & Deng, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01211 · Cited by 47 · see citing works
Coordinated Versus Decentralized Exploration In Multi-Agent Multi-Armed Bandits
Chakraborty, M., Chua, K. Y. P., Das, S., & Juba, B. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/24 · Cited by 46 · see citing works
What Can Learned Intrinsic Rewards Capture?Preprint
Zheng, Z., Oh, J., Hessel, M., Xu, Z., Kroiss, M., van Hasselt, H. P., Silver, D., & Singh, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05500 · Cited by 43 · see citing works
Safe Reinforcement Learning by Imagining the Near FuturePreprint
Thomas, G., Luo, Y., & Ma, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.07789 · Cited by 43 · see citing works
Stanton, C., & Clune, J. (2018) · arXiv.org · doi:10.48550/arxiv.1806.00553 · Cited by 42 · see citing works
Reinforcement Learning of POMDPs using Spectral MethodsPreprint
Azizzadenesheli, K., Lazaric, A., & Anandkumar, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07764 · Cited by 42 · see citing works
Hindsight policy gradientsPreprint
Rauber, P., Ummadisingu, A., Mutz, F. W., & Schmidhuber, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.06006 · Cited by 41 · see citing works
Explore, discover and learn: unsupervised discovery of state-covering skills
Campos Camúñez, V., Trott, A., Xiong, C., Socher, R., Giró-i-Nieto, X., & Torres, J. (2020) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · Cited by 41 · see citing works
Chen, G. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/wlnk1814 · Cited by 41 · see citing works
Reachability-Based Safety Guarantees using Efficient Initializations
Herbert, S., Bansal, S., Ghosh, S., & Tomlin, C. J. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029575 · Cited by 38 · see citing works
DORA The Explorer: Directed Outreaching Reinforcement Action-SelectionPreprint
Choshen, L., Fox, L., & Loewenstein, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04012 · Cited by 35 · see citing works
Coordinated Exploration via Intrinsic Rewards for Multi-Agent Reinforcement LearningPreprint
Iqbal, S., & Sha, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12127 · Cited by 33 · see citing works
HyAR: Addressing Discrete-Continuous Action Reinforcement Learning via Hybrid Action RepresentationPreprint
Li, B., Tang, H., Zheng, Y., Hao, J., Li, P., Wang, Z., Meng, Z., & Wang, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05490 · Cited by 31 · see citing works
Self-citationInformation-Directed Exploration for Deep Reinforcement LearningPreprint
Nikolov, N., Kirschner, J., Berkenkamp, F., & Krause, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07544 · Cited by 30 · see citing works
Competitive Experience ReplayPreprint
Liu, H., Trott, A., Socher, R., & Xiong, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00528 · Cited by 28 · see citing works
Ready Policy One: World Building Through Active LearningPreprint
Ball, P., Parker-Holder, J., Pacchiano, A., Choromański, K., & Roberts, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02693 · Cited by 28 · see citing works
Curiosity-Bottleneck: Exploration By Distilling Task-Specific Novelty.
Kim, Y., Nam, W., Kim, H., Kim, J., & Kim, G. (2019) · KAIST Institutional Repository (KAIST) · Cited by 27 · see citing works
NovelD: A Simple yet Effective Exploration Criterion
Zhang, T., Xu, H., Wang, X., Wu, Y., Keutzer, K., Gonzalez, J. E., & Tian, Y. (2021) · neural information processing systems · Cited by 26 · see citing works
Sun, W.-F., Lee, C., & Lee, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07936 · Cited by 24 · see citing works
Efficient exploration with Double Uncertain Value NetworksPreprint
Moerland, T. M., Broekens, J., & Jonker, C. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10789 · Cited by 23 · see citing works
Successor Uncertainties: Exploration and Uncertainty in Temporal Difference Learning
Janz, D., Hron, J., Mazur, P., Hofmann, K., Hernández-Lobato, J. M., & Tschiatschek, S. (2018) · arXiv · doi:10.48550/arxiv.1810.06530 · Cited by 23 · see citing works
On Bonus-Based Exploration Methods in the Arcade Learning EnvironmentPreprint
Taïga, A. A., Fedus, W., Machado, M. C., Courville, A. C., & Bellemare, M. G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.11052 · Cited by 22 · see citing works
Efficient Model-Based Reinforcement Learning through Optimistic Policy Search and PlanningPreprint
Curi, S., Berkenkamp, F., & Krause, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08684 · Cited by 22 · see citing works
Learning Novel Policies For TasksPreprint
Zhang, Y., Yu, W., & Turk, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05252 · Cited by 22 · see citing works
Principled Exploration via Optimistic Bootstrapping and Backward InductionPreprint
Bai, C., Wang, L., Han, L., Hao, J., Garg, A., Liu, P., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.06022 · Cited by 22 · see citing works
Self-citationVariational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning
Bai, C., Liu, P., Liu, K., Wang, L., Zhao, Y., Han, L., & Wang, Z. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3129160 · Cited by 21 · see citing works
Self-citationRegret Analysis of the Anytime Optimally Confident UCB AlgorithmPreprint
Lattimore, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08661 · Cited by 21 · see citing works
Scheduled Intrinsic Drive: A Hierarchical Take on Intrinsically Motivated ExplorationPreprint
Zhang, J., Wetzel, N., Dorka, N., Boedecker, J., & Burgard, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.07400 · Cited by 20 · see citing works
Conservative Uncertainty Estimation By Fitting Prior Networks
Ciosek, K., Fortuin, V., Tomioka, R., Hofmann, K., & Turner, R. E. (2020) · International Conference on Learning Representations · Cited by 20 · see citing works
Likelihood Quantile Networks for Coordinating Multi-Agent Reinforcement Learning
Lyu, X., & Amato, C. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/cjwi9118 · Cited by 20 · see citing works
Count-based exploration with the successor representation
Machado, M. C., Bellemare, M. G., & Bowling, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5955 · Cited by 19 · see citing works
Non-Crossing Quantile Regression for Distributional Reinforcement Learning
Zhou, F., Wang, J., & Feng, X. (2020) · neural information processing systems · Cited by 18 · see citing works
Multi-agent Reinforcement Learning in Stochastic Single and Multi-stage Games
Verbeeck, K., Nowé, A., Peeters, M., & Tuyls, K. (2005) · Lecture notes in computer science · doi:10.1007/978-3-540-32274-0_18 · Cited by 17 · see citing works
Posterior sampling for reinforcement learning: worst-case regret boundsPreprint
Agrawal, S., & Jia, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07041 · Cited by 17 · see citing works
Frequentist Regret Bounds for Randomized Least-Squares Value IterationPreprint
Zanette, A., Brandfonbrener, D., Brunskill, E., Pirotta, M., & Lazaric, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00567 · Cited by 17 · see citing works
Towards Safe Reinforcement Learning with a Safety Editor Policy
Xu, W., Xu, W., & Zhang, H. (2022) · neural information processing systems · doi:10.52202/068431-0189 · Cited by 17 · see citing works
Memory Based Trajectory-conditioned Policies for Learning from Sparse RewardsPreprint
Guo, Y., Choi, J., Moczulski, M., Feng, S., Samy Bengio, A., Norouzi, M., & Lee, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10247 · Cited by 16 · see citing works
Dynamic Bottleneck for Robust Self-Supervised ExplorationPreprint
Bai, C., Wang, L., Han, L., Garg, A., Hao, J., Liu, P., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10735 · Cited by 16 · see citing works
Self-citationEpisodic Self-Imitation Learning with Hindsight
Dai, T., Liu, H., & Bharath, A. A. (2020) · Electronics · doi:10.3390/electronics9101742 · Cited by 16 · see citing works
Coordinated Exploration in Concurrent Reinforcement LearningPreprint
Dimakopoulou, M. N., & Roy, B. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01282 · Cited by 15 · see citing works
Learning latent state representation for speeding up explorationPreprint
Vezzani, G., Gupta, A., Natale, L., & Abbeel, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12621 · Cited by 15 · see citing works
Multi-Agent Safe Planning with Gaussian Processes
Zhu, Z., Bıyık, E., & Sadigh, D. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341169 · Cited by 15 · see citing works
Scalable Coordinated Exploration in Concurrent Reinforcement LearningPreprint
Dimakopoulou, M., Osband, I., & Roy, B. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08948 · Cited by 14 · see citing works
On Optimism in Model-Based Reinforcement Learning.Preprint
Pacchiano, A., Ball, P., Parker-Holder, J., Choromański, K., & Roberts, S. (2020) · arXiv (Cornell University) · Cited by 14 · see citing works
Intrinsic Motivation for Encouraging Synergistic BehaviorPreprint
Chitnis, R., Tulsiani, S., Gupta, S., & Gupta, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05189 · Cited by 14 · see citing works
Self-Imitation Learning via Generalized Lower Bound Q-learningPreprint
Tang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07442 · Cited by 14 · see citing works
Exploration with Unreliable Intrinsic Reward in Multi-Agent Reinforcement LearningPreprint
Böhmer, W., Rashid, T., & Whiteson, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02138 · Cited by 13 · see citing works
Self-Imitation Advantage Learning
Ferret, J., Pietquin, O., & Geist, M. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/kkvm3697 · Cited by 13 · see citing works
Learning Action Representations for Self-supervised Visual Exploration
Oh, C., & Cavallaro, A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794401 · Cited by 12 · see citing works
Robot Motor Skill Transfer With Alternate Learning in Two Spaces
Fu, J. Y., Teng, X., Cao, C., Ju, Z., & Lou, P. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3021530 · Cited by 12 · see citing works
Dead-ends and Secure Exploration in Reinforcement Learning
Fatemi, M., Sharma, S., van Seijen, H., & Kahou, S. E. (2019) · International Conference on Machine Learning · Cited by 10 · see citing works
Directed Exploration for Reinforcement LearningPreprint
Guo, Z. D., & Brunskill, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07805 · Cited by 10 · see citing works
Learning Transferable Domain Priors for Safe Exploration in Reinforcement Learning
Karimpanal, T. G., Rana, S., Gupta, S., Tran, T., & Venkatesh, S. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207344 · Cited by 9 · see citing works
Potential Driven Reinforcement Learning for Hard Exploration Tasks
Zhao, E., Deng, S., Zang, Y., Kang, Y., Li, K., & Xing, J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/290 · Cited by 9 · see citing works
Efficient Exploration with Self-Imitation Learning via Trajectory-Conditioned Policy.Preprint
Guo, Y., Choi, J., Moczulski, M., Samy Bengio, A., Norouzi, M., & Lee, H. (2019) · arXiv (Cornell University) · Cited by 8 · see citing works
Learning Actionable Representations with Goal-Conditioned PoliciesPreprint
Ghosh, D., Gupta, A., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07819 · Cited by 7 · see citing works
Flagged first, then by citations
9 of the 217 references couldn’t be matched to a known paper.
Research works printed but not linked: 27
- [10][10] S. S. Mousavi, M. Schukat, and E. Howley, 'Deep reinforcement learning: an overview,' in SAI Intelligent Systems Conference , 2016. -
- [20][20] T. Lattimore and C. Szepesvári, Bandit Algorithms . Cambridge University Press, 2020. -
- [32][32] D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. A. Riedmiller, 'Deterministic policy gradient algorithms,' in ICML , 2014. -
- [33][33] R. Lowe, Y. Wu, A. Tamar, J. Harb, P. Abbeel, and I. Mordatch, 'Multiagent actor-critic for mixed cooperative-competitive environments,' in NeurIPS , 2017. -
- [38][38] N. Srinivas, A. Krause, S. M. Kakade, and M. W. Seeger, 'Gaussian process optimization in the bandit setting: No regret and experimental design,' in ICML , 2010. -
- [46][46] Y. Burda, H. Edwards, A. J. Storkey, and O. Klimov, 'Exploration by random network distillation,' in ICLR , 2019. -
- [69][69] R. Dearden, N. Friedman, and S. J. Russell, 'Bayesian q-learning,' in AAAI , 1998. -
- [70][70] P. Auer, N. Cesa-Bianchi, and P. Fischer, 'Finite-time analysis of the multiarmed bandit problem,' Machine learning , vol. 47, no. 2-3, pp. 235-256, 2002. -
- [72][72] P. Auer, 'Using confidence bounds for exploitation-exploration tradeoffs,' JMLR , vol. 3, pp. 397-422, 2002. -
- [79][79] N. Nikolov, J. Kirschner, F. Berkenkamp, and A. Krause, 'Informationdirected exploration for deep reinforcement learning,' in ICLR , 2019. -
- [84][84] C. Oh and A. Cavallaro, 'Learning action representations for selfsupervised visual exploration,' in ICRA , 2019. -
- [93][93] T. Zhang, P. Rashidinejad, J. Jiao, Y. Tian, J. Gonzalez, and S. Russell, 'Made: Exploration via maximizing deviation from explored regions,' arXiv preprint arXiv:2106.10268 , 2021. - · arXiv
- [97][97] M. Klissarov, R. Islam, K. Khetarpal, and D. Precup, 'Variational state encoding as intrinsic motivation in reinforcement learning,' in TARL Workshop on ICLR , 2019. -
- [103][103] R. Houthooft, X. Chen, Y. Duan, J. Schulman, F. D. Turck, and P. Abbeel, 'VIME: variational information maximizing exploration,' in NeurIPS , 2016. -
- [134][134] S. L. Herbert, S. Bansal, S. Ghosh, and C. J. Tomlin, 'Reachabilitybased safety guarantees using efficient initializations,' in CDC , 2019, pp. 4810-4816. -
- [137][137] Y. Guo, J. Choi, M. Moczulski, S. Feng, S. Bengio, M. Norouzi, and H. Lee, 'Memory based trajectory-conditioned policies for learning from sparse rewards,' in NeurIPS , 2020. -
- [146][146] J. Zhao, M. Yang, X. Hu, W. Zhou, and H. Li, 'DQMIX: A distributional perspective on multi-agent reinforcement learning,' CoRR , vol. abs/2202.10134, 2022. - · arXiv
- [150][150] L. Zheng, J. Chen, J. Wang, J. He, Y. Hu, Y. Chen, C. Fan, Y. Gao, and C. Zhang, 'Episodic multi-agent reinforcement learning with curiositydriven exploration,' in NeurIPS , M. Ranzato, A. Beygelzimer, Y. N. Dauphin, P. Liang, and J. W. Vaughan, Eds., 2021, pp. 3757-3769. -
- [156][156] D. Carmel and S. Markovitch, 'Exploration strategies for model-based learning in multi-agent systems: Exploration strategies,' JAAMAS , vol. 2, no. 2, pp. 141-172, 1999. -
- [168][168] M. Samvelyan, T. Rashid, C. S. de Witt, G. Farquhar, N. Nardelli, T. G. J. Rudner, C. Hung, P. H. S. Torr, J. N. Foerster, and S. Whiteson, 'The starcraft multi-agent challenge,' pp. 2186-2188, 2019. -
- [169][169] G. Farquhar, L. Gustafson, Z. Lin, S. Whiteson, N. Usunier, and G. Synnaeve, 'Growing action spaces,' in ICML , 2020. -
- [179][179] K. H. Kim, M. Sano, J. De Freitas, N. Haber, and D. Yamins, 'Active world model learning in agent-rich environments with progress curiosity,' in ICML , 2020. -
- [186][186] Z. C. Lipton, X. Li, J. Gao, L. Li, F. Ahmed, and L. Deng, 'Bbqnetworks: Efficient exploration in deep reinforcement learning for taskoriented dialogue systems,' in AAAI , 2018. -
- [210][210] R. Zhao, X. Sun, and V. Tresp, 'Maximum entropy-regularized multigoal reinforcement learning,' in ICML , 2019. -
- [218][218] V. H. Pong, M. Dalal, S. Lin, A. Nair, S. Bahl, and S. Levine, 'Skew-fit: State-covering self-supervised reinforcement learning,' in ICML , 2020. -
- [219][219] A. Sharma, S. Gu, S. Levine, V. Kumar, and K. Hausman, 'Dynamicsaware unsupervised discovery of skills,' in ICLR , 2020. -
- [221][221] T. Haarnoja, H. Tang, P. Abbeel, and S. Levine, 'Reinforcement learning with deep energy-based policies,' in ICML , ser. Proceedings of Machine Learning Research, vol. 70, 2017, pp. 1352-1361. -
Cited by
Sorted by citations
Theoretical approaches to AI in supply chain optimization: Pathways to efficiency and resilience
Abaku, E. A., Edunjobi, T. E., & Odimarha, A. C. (2024) · International Journal of Science and Technology Research Archive · doi:10.53771/ijstra.2024.6.1.0033 · Cited by 149 · see citing works
Multi-agent reinforcement learning for resources allocation optimization: a survey
Hady, M. A., Hu, S., Pratama, M., Cao, Z., & Kowalczyk, R. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11340-5 · Cited by 120 · see citing works
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
Casper, S., Davies, X., Shi, C., Gilbert, T. K., Scheurer, J., Rando, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.15217 · Cited by 101 · see citing works
Li, P., Hao, J., Tang, H., Fu, X., Zheng, Y., & Tang, K. (2024) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2024.3443913 · Cited by 84 · see citing works
Self-citationAjagekar, A., Decardi-Nelson, B., & You, F. (2024) · Applied Energy · doi:10.1016/j.apenergy.2023.122349 · Cited by 82 · see citing works
Deep Reinforcement Learning for Solving Vehicle Routing Problems With Backhauls
Wang, C., Cao, Z., Wu, Y., Teng, L., & Wu, G. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3371781 · Cited by 79 · see citing works
The State of AI-Empowered Backscatter Communications: A Comprehensive Survey
Xu, F., Hussain, T., Ahmed, M., Ali, K., Mirza, M. A., Khan, W. U., Ihsan, A., & Han, Z. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3299210 · Cited by 62 · see citing works
Wang, Z., Goudarzi, M., & Buyya, R. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3528346 · Cited by 55 · see citing works
Self-citationLin, P., Wu, M., Xiao, Z., Tiong, R. L. K., & Zhang, L. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105234 · Cited by 47 · see citing works
Ming, Z., Yu, H., & Taleb, T. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3404125 · Cited by 41 · see citing works
Amodu, O. A., Jarray, C., Mahmood, R. A. R., Althumali, H., Bukar, U. A., Nordin, R., Abdullah, N. F., & Luong, N. C. (2024) · IEEE Access · doi:10.1109/access.2024.3425497 · Cited by 34 · see citing works
Lv, H. P., Chen, Y., Li, S., Zhu, B., & Li, M. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad2663 · Cited by 31 · see citing works
Performance enhancement of artificial intelligence: A survey
Krichen, M., & Abdalzaher, M. S. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.104034 · Cited by 35 · see citing works
Xu, N., Tang, Z., Si, C., Bian, J., & Mu, C. (2025) · Energies · doi:10.3390/en18071837 · Cited by 30 · see citing works
Progress and summary of reinforcement learning on energy management of MPS-EV
Lin, Y., Chu, L., Hu, J., Hou, Z., Li, J., Jiang, J., & Zhang, Y. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e23014 · Cited by 28 · see citing works
When to Switch: Planning and Learning for Partially Observable Multi-Agent Pathfinding
Skrynnik, A., Андреевич, А. А., Yakovlev, K., & Panov, A. I. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3303502 · Cited by 26 · see citing works
Xu, J., Wang, Y., Wang, Z., Wang, X., & Zhao, Y. (2024) · Aerospace Science and Technology · doi:10.1016/j.ast.2024.109701 · Cited by 28 · see citing works
Self-citationImproved exploration–exploitation trade-off through adaptive prioritized experience replay
Hassani, H., Nikan, S., & Shami, A. A. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128836 · Cited by 24 · see citing works
Wan, Z., Wang, S., Han, W., Wang, Y., Huang, X., Zhang, X., Chen, X., & Chen, Y. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.08.023 · Cited by 23 · see citing works
Intelligent games meeting with multi-agent deep reinforcement learning: a comprehensive review
Wang, Y., Wang, Y., Tian, F., Ma, J., & Jin, Q. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11166-1 · Cited by 21 · see citing works
LSTM-augmented DRL for generalisable energy management of hydrogen-hybrid ship propulsion systems
Fan, A., Liu, H., Wu, P., Yang, L., Guan, C., Li, T., Bucknall, R. W. G., & Liu, Y. (2025) · eTransportation · doi:10.1016/j.etran.2025.100442 · Cited by 20 · see citing works
Balancing exploration and exploitation in episodic reinforcement learning
Chen, Q., Zhang, Q.-W., & Liu, Y.-L. (2023) · Expert systems with applications · doi:10.1016/j.eswa.2023.120801 · Cited by 15 · see citing works
Yang, L., Guofan, J., Yixin, Z., Qianze, W., Jian, Z., Alizadehsani, R., & Pławiak, P. (2024) · IEEE Access · doi:10.1109/access.2024.3473296 · Cited by 17 · see citing works
Environment-Aware Adaptive Reinforcement Learning-Based Routing for Vehicular Ad Hoc Networks
Jiang, Y., Zhu, J., & Yang, K. (2023) · Sensors · doi:10.3390/s24010040 · Cited by 16 · see citing works
A novel inverse design method for morphing airfoil based on deep reinforcement learning
Su, J., Sun, G., & Tao, J. (2024) · Aerospace Science and Technology · doi:10.1016/j.ast.2024.108895 · Cited by 16 · see citing works
Dynamic Bottleneck for Robust Self-Supervised ExplorationPreprint
Bai, C., Wang, L., Han, L., Garg, A., Hao, J., Liu, P., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10735 · Cited by 16 · see citing works
Self-citationEnd-to-End Autonomous Driving in CARLA: A Survey
Ozaibi, Y. A., Hina, M. D., & Ramdane-Chérif, A. (2024) · IEEE Access · doi:10.1109/access.2024.3473611 · Cited by 19 · see citing works
Traffic navigation via reinforcement learning with episodic-guided prioritized experience replay
Hassani, H., Nikan, S., & Shami, A. A. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109147 · Cited by 15 · see citing works
Song, D., Liang, J., Xiao, X., & Manocha, D. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3559822 · Cited by 15 · see citing works
Li, Y., Guo, X., Meng, Z., Qin, J., Li, X., Ma, X., Ren, S., & Yang, J. Y. (2023) · Electronics · doi:10.3390/electronics12193991 · Cited by 13 · see citing works
Self-citationPham, V.-H., Hien, D. T. T., Chuong, N. P., Thai, P. T., & Duy, P. T. (2024) · IEEE Access · doi:10.1109/access.2024.3421989 · Cited by 13 · see citing works
Overview of Generative AI Techniques for Cybersecurity
Sindiramutty, S. R., Prabagaran, K. R. V., Akbar, R., Hussain, M., & Malik, N. A. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3693-5415-5.ch001 · Cited by 14 · see citing works
Zheng, J., Huang, J., Lin, A., Li, F., & Huang, H. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.113609 · Cited by 12 · see citing works
WToE: Learning When to Explore in Multiagent Reinforcement Learning
Dong, S., Mao, H., Yang, S., Zhu, S., Li, W., Hao, J., & Gao, Y. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3328732 · Cited by 12 · see citing works
Self-citationRobust Multi-Agent Reinforcement Learning by Mutual Information Regularization
Li, S., Xu, R., Xiu, J., Zheng, Y., Feng, P., Ma, Y., An, B., Yang, Y., & Liu, X. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3577259 · Cited by 12 · see citing works
Ahmad, M., Tayyab, M., & Habib, M. S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110002 · Cited by 11 · see citing works
Historical Decision-Making Regularized Maximum Entropy Reinforcement Learning
Dong, B., Huang, L., Pang, N., Chen, H., & Zhang, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3481887 · Cited by 10 · see citing works
Cai, C., Gan, F., Cui, Y., Li, B., & Hou, S. (2025) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2025.110968 · Cited by 10 · see citing works
Zhang, Y., Meng, L., de Souza, A. C. Z., Hu, Q., Liu, H., Lebedev, A., & Shotorbani, A. M. (2025) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2025.111444 · Cited by 9 · see citing works
Mutual information oriented deep skill chaining for multi‐agent reinforcement learning
Xie, Z., Ji, C., Qiao, C. Y., Song, W., Li, Z., Zhang, Y., & Zhang, Y. (2024) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12322 · Cited by 8 · see citing works
Xu, N., Mu, C., Wang, K., Ma, L., & Liu, Z. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11354-z · Cited by 8 · see citing works
Multi-agent cooperation policy gradient method based on enhanced exploration for cooperative tasks
Zhao, L.-Y., Chang, T.-Q., Zhang, L., Zhang, X., & Wang, J. (2023) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-01976-6 · Cited by 8 · see citing works
Gómez‐delaHiz, J., & Galán–Jiménez, J. (2024) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms59830.2024.10575465 · Cited by 8 · see citing works
Cooperative multi-agent game based on reinforcement learning
Liu, H. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100205 · Cited by 7 · see citing works
Reinforcement learning for fuselage shape control during aircraft assembly
Lutz, T., Wang, Y., Yue, X., & Camelio, J. A. (2024) · IISE Transactions · doi:10.1080/24725854.2024.2413136 · Cited by 7 · see citing works
Optimization methods in fully cooperative scenarios: a review of multiagent reinforcement learning
Yang, T., Shi, X., Zeng, Q., Yang, Y., Xu, C., & Liu, H. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2400259 · Cited by 7 · see citing works
Self-citationOpenBench: A New Benchmark and Baseline for Semantic Navigation in Smart Logistics
Wang, J., Huo, D., Xu, Z., Shi, Y., Yan, Y., Wang, Y., Gao, C., Qiao, Y., & Zhou, G. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127476 · Cited by 7 · see citing works
Reinforcement Learning Review: Past Acts, Present Facts and Future Prospects
Kommey, B., Isaac, O. J., Tamakloe, E., & Opoku, D. (2024) · IT JOURNAL RESEARCH AND DEVELOPMENT · doi:10.25299/itjrd.2023.13474 · Cited by 7 · see citing works
OVD-Explorer: Optimism Should Not Be the Sole Pursuit of Exploration in Noisy Environments
Liu, J., Wang, Z., Zheng, Y., Hao, J., Bai, C., Ye, J., Wang, Z., Piao, H., & Sun, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29303 · Cited by 7 · see citing works
Self-citationPORTAL: Automatic Curricula Generation for Multiagent Reinforcement Learning
Wu, J., Hao, J., Yang, T., Hao, X., Zheng, Y., Wang, W., & Taylor, M. E. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29524 · Cited by 7 · see citing works
Self-citationXiang, S., Zhang, L., Wang, Y., Zhou, S., Zhao, X., Zhang, T., & Li, S. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3553935 · Cited by 7 · see citing works
Li, C., Zhang, R., Wong, J., Gokmen, C., Srivastava, S., Martín-Martín, R., Wang, C., Levine, G., Ai, W., Martinez, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2403.09227 · Cited by 6 · see citing works
Wang, C., Wang, Z., & Aouf, N. (2025) · IET Radar Sonar & Navigation · doi:10.1049/rsn2.70033 · Cited by 6 · see citing works
Self-citationTask Phasing: Automated Curriculum Learning from Demonstrations
Bajaj, V., Sharon, G., & Stone, P. (2023) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v33i1.27235 · Cited by 6 · see citing works
Settling Decentralized Multi-Agent Coordinated Exploration by Novelty Sharing
Jiang, H., Ding, Z., & Lu, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29693 · Cited by 7 · see citing works
Yao, F., Zhao, W., Forshaw, M., & Zhou, W. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113844 · Cited by 6 · see citing works
Cao, L., Wang, C., Qi, J., & Peng, Y. (2023) · Cyborg and Bionic Systems · doi:10.34133/cbsystems.0084 · Cited by 6 · see citing works
Inverse RL Scene Dynamics Learning for Nonlinear Predictive Control in Autonomous Vehicles
Grigorescu, S. M., & Zaha, M. V. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3549816 · Cited by 5 · see citing works
Yang, X., Wang, Q., Li, J., & Jiang, X. (2025) · IEEE Access · doi:10.1109/access.2025.3602286 · Cited by 5 · see citing works
Liu, C., Cong, J., Chen, B., Jin, Y., & Zhu, E. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3631239 · Cited by 5 · see citing works
Cooperative Multiagent Learning and Exploration With Min–Max Intrinsic Motivation
Hou, Y., Kang, J., Piao, H., Zeng, Y., Ong, Y.-S., Jin, Y., & Zhang, Q. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3557694 · Cited by 5 · see citing works
Multi-fidelity reinforcement learning for time-optimal quadrotor re-planning
Ryou, G., Wang, G., & Karaman, S. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649251364393 · Cited by 5 · see citing works
Curiosity-driven learning in artificial intelligence and its applications
Sun, C. (2023) · doi:10.32657/10356/172831 · Cited by 5 · see citing works
The impact of intrinsic rewards on exploration in Reinforcement Learning
Kayal, A., Pignatelli, E., & Toni, L. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-11340-0 · Cited by 4 · see citing works
Dynamics of Q -Learning in Networked Stochastic Games
Yuan, Z., Jiang, G., Hu, S., Perc, M., Chu, C., & Liu, J. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3641365 · Cited by 4 · see citing works
Self-citationFPGA Divide-and-Conquer Placement using Deep Reinforcement Learning
Wang, S., Mamillapalli, D. R. S., Yang, T., & Taylor, M. E. (2024) · International Symposium of Electronics Design Automation (ISEDA) · doi:10.1109/iseda62518.2024.10617677 · Cited by 4 · see citing works
Self-citationEfficient and stable deep reinforcement learning: selective priority timing entropy
Huo, L., Mao, J., San, H., Zhang, S., Li, R., & Fu, L. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05705-6 · Cited by 5 · see citing works
Xu, H., Huang, L., Tao, J., Zhang, C., & Zheng, J. (2025) · Processes · doi:10.3390/pr13030728 · Cited by 4 · see citing works
Jiang, W., Liu, G., Leng, Q., & Guo, N. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130252 · Cited by 4 · see citing works
Zheng, S., Yin, H., Chen, T., Kong, X., Hou, J., & Zhao, P. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00017 · Cited by 4 · see citing works
Generative subgoal oriented multi-agent reinforcement learning through potential field
Li, S., Jiang, H., Liu, Y., Zhang, J., Xu, X., & Liu, D. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106552 · Cited by 4 · see citing works
Zhou, Z., Xie, X., Song, J., Shu, Z., & Ma, L. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3496492 · Cited by 4 · see citing works
Multi-agent Reinforcement Learning for Dynamic Dispatching in Material Handling Systems
Lee, X. Y., Wang, H., KATSUMATA, D., Matsui, T., & Gupta, C. (2024) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi62246.2024.00031 · Cited by 4 · see citing works
Road preview method for active suspension based on reinforcement learning
Wang, G., Kou, F., Liu, P., Lv, W., & Xing, L. (2025) · Measurement Science and Technology · doi:10.1088/1361-6501/adad09 · Cited by 4 · see citing works
Self-citationFeizabadi, M., Hosseini, A., & Yahouni, Z. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-80760-2_1 · Cited by 4 · see citing works
Zhou, Z., Zhang, Y., & Li, X. (2025) · Science China Information Sciences · doi:10.1007/s11432-023-4280-6 · Cited by 4 · see citing works
Zhu, Y., Wang, Z., Zhu, Y., Chen, C., & Zhao, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3446371 · Cited by 3 · see citing works
Self-citationJin, W., Tian, X., Wang, N., Wu, B., Shi, B., Zhao, B., & Yang, G. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107875 · Cited by 3 · see citing works
A cooperative jamming mode adjustment method based on Multi-Agent reinforcement learning
Wang, J., Liu, Y., Li, C., Yang, D., & Yin, Q. (2025) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2025.103672 · Cited by 3 · see citing works
Subgoal-Based Hierarchical Reinforcement Learning for Multiagent Collaboration
Xu, C., Shi, Y., Zhang, C., Wang, R., Duan, S., Wan, Y., & Zhang, X. (2026) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2025.3646451 · Cited by 3 · see citing works
Yuan, X., Wang, S., Wang, A., Zhang, N., Ye, Q., Yan, L., & Jin, X. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3697300 · Cited by 3 · see citing works
Reinforcement learning with thermal fluctuations at the nanoscale
Boccardo, F., & Pierre-Louis, O. (2024) · Physical review. E · doi:10.1103/physreve.110.l023301 · Cited by 3 · see citing works
Dynamic data partitioning strategy for distributed learning on heterogeneous edge system
Yu, K., & Zhang, W. (2025) · Computer Communications · doi:10.1016/j.comcom.2025.108262 · Cited by 3 · see citing works
Mu, C., Jiang, Z., Zhang, J., Wang, K., Xu, X., & Yi, J. (2025) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2025.3619986 · Cited by 3 · see citing works
Taghavi, M., & Vahidi, J. (2026) · Quantum Machine Intelligence · doi:10.1007/s42484-026-00361-0 · Cited by 5 · see citing works
A Unified Uncertainty-Aware Exploration: Combining Epistemic and Aleatory Uncertainty
Malekzadeh, P., Hou, M., & Plataniotis, K. N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095594 · Cited by 3 · see citing works
Deep Reinforcement Learning based channel allocation (DRLCA) in Cognitive Radio Networks
Pavan, M. N. (2024) · Journal of Electrical Systems · doi:10.52783/jes.2774 · Cited by 3 · see citing works
Wang, D., Yin, C., Liu, L., Zhang, Z., She, Y., & Yu, Y. (2024) · Asia Conference on Power and Electrical Engineering (ACPEE) · doi:10.1109/acpee60788.2024.10532664 · Cited by 3 · see citing works
Rule-Based Assessment of Reinforcement Learning Practices Using Large Language Models
Ntentos, E., Warnett, S. J., & Zdun, U. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00009 · Cited by 3 · see citing works
The State of AI-Empowered Backscatter Communications: A Comprehensive SurveyPreprint
Ahmed, M., Hussain, T., Ali, K., Mirza, M. A., Khan, W. U., Ihsan, A., Xu, F., & Han, Z. (2023) · doi:10.36227/techrxiv.22245958.v1 · Cited by 3 · see citing works
Boosting Weak-to-Strong Agents in Multiagent Reinforcement Learning via Balanced PPO
Huang, S., Chen, H., Piao, H., Sun, Z., Chang, Y., Sun, L., & Yang, B. X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3437366 · Cited by 2 · see citing works
Cognition-Oriented Multiagent Reinforcement Learning
Qiu, T., Wu, S., Liu, Z., Pu, Z., Yi, J., Zhao, Y., & Luo, B. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3502176 · Cited by 2 · see citing works
State-novelty guided action persistence in deep reinforcement learning
Hu, J., Weng, P., & Ban, Y. (2025) · Machine Learning · doi:10.1007/s10994-024-06675-z · Cited by 2 · see citing works
Pandian, J. A., Thirunavukarasu, R., & Nagarajan, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-23769-3 · Cited by 2 · see citing works
Li, J., Cheng, Z., Peng, Y., Huang, H., & Ye, C. (2026) · Sustainability · doi:10.3390/su18021027 · Cited by 2 · see citing works
Fu, Q., Qiu, T., Yi, J., Pu, Z., Ai, X., & Yuan, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3423417 · Cited by 2 · see citing works
Rethinking Exploration and Experience Exploitation in Value-Based Multi-Agent Reinforcement Learning
Borzilov, A., Skrynnik, A., & Panov, A. I. (2025) · IEEE Access · doi:10.1109/access.2025.3530974 · Cited by 2 · see citing works
Shen, H., Li, X. D., Wang, Y., Wang, T., & Bai, G. (2025) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-025-01939-4 · Cited by 2 · see citing works
DERRIC: Decentralized Reinforced RAN Intelligent Controller Orchestration for 6G Networks
Nezhad, E. H., Maio, A. D., & Braun, T. I. (2025) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc61545.2025.10978840 · Cited by 2 · see citing works
Adaptive Kalman-Based Hybrid Car Following Strategy Using Td3 and CaccPreprint
Zheng, Y., Yan, R., Jia, B., Jiang, R., Tapus, A., Chen, X., Zheng, S., & Ying, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4681766 · Cited by 2 · see citing works
- Authors
- Hao, J., Yang, T., Tang, H., Bai, C., Liu, J., Meng, Z., Liu, P., & Wang, Z.
- Affiliations
- Tianjin University (CN)
- Shanghai Artificial Intelligence Laboratory (CN)
- Harbin Institute of Technology (CN)
- Northwestern Polytechnical University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Volume
- 35
- Issue
- 7
- Pages
- 8762-8782
- ISSN
- 2162-237X (ISSN-L)
- arXiv
- 2109.06668
- OpenAlex
- W4319165238
- Cited by
- 192
- References
- 217
- Citations by year
- 2026: 42 · 2025: 77 · 2024: 48 · 2023: 23 · 2022: 1 · 2021: 1
- FWCI
- 17.91
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Tencent
- National Natural Science Foundation of China (U22B2036, 11931015, 62025602, U1836214)
- National Science Fund for Distinguished Young Scholars (62025602)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Keywords
- sample inefficiency, intrinsic motivation, sparse rewards
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
