Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works

Human Problem Solving.

Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063712 · Cited by 6,883 · see citing works

Human Problem Solving

Newell, A. (1972) · Cited by 6,222 · see citing works

Dynamic Programming and Markov Processes.

Freimer, M. L., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,388 · see citing works

A qualitative physics based on confluences

de Kleer, J., & Brown, J. S. (1984) · Artificial Intelligence · doi:10.1016/0004-3702(84)90037-7 · Cited by 1,499 · see citing works

Planning in a hierarchy of abstraction spaces

Sacerdoti, E. D. (1974) · Artificial Intelligence · doi:10.1016/0004-3702(74)90026-5 · Cited by 1,185 · see citing works

Learning to act using real-time dynamic programming

Barto, A. G., Bradtke, S. J., & Singh, S. P. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00011-o · Cited by 1,108 · see citing works

Learning and executing generalized robot plans

Fikes, R. E., Hart, P. E., & Nilsson, N. J. (1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90051-3 · Cited by 1,025 · see citing works

Reinforcement learning for robots using neural networks

Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 836 · see citing works

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 797 · see citing works

Temporal Difference Learning and TD-Gammon

Tesauro, G. (1995) · ICGA Journal · doi:10.3233/icg-1995-18207 · Cited by 770 · see citing works

Improving generalization for temporal difference learning: The successor representation

Dayan, P. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.613 · Cited by 693 · see citing works

Reinforcement Learning with Hierarchies of Machines

Parr, R., & Russell, S. (1997) · Cited by 618 · see citing works

Automatic programming of behavior-based robots using reinforcement learning

Mahadevan, S., & Connell, J. H. (1992) · Artificial Intelligence · doi:10.1016/0004-3702(92)90058-6 · Cited by 591 · see citing works

Hybrid Systems

Grossman, R. L., Nerode, A., Ravn, A. P., & Rischel, H. (1993) · Cited by 512 · see citing works

Chunking in Soar: The Anatomy of a General Learning Mechanism

Laird, J. E., Rosenbloom, P. S., & Newell, A. (1986) · Machine Learning · doi:10.1023/a:1022639103969 · Cited by 509 · see citing works

Improving Elevator Performance Using Reinforcement Learning

Crites, R. H., & Barto, A. G. (1995) · Cited by 499 · see citing works

Feudal Reinforcement Learning

Dayan, P., & Hinton, G. E. (1992) · Cited by 488 · see citing works

Probabilistic robot navigation in partially observable environments

Simmons, R. G., & Koenig, S. (1995) · Cited by 482 · see citing works

Behaviour-based control: examples from navigation, learning, and group behaviour

Matarić, M. J. (1997) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/095281397147149 · Cited by 434 · see citing works

Hybrid Models for Motion Control Systems

Brockett, R. W. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4612-0313-1_2 · Cited by 378 · see citing works

Learning to coordinate behaviors

Maes, P., & Brooks, R. A. (1990) · Cited by 376 · see citing works

Quantitative results concerning the utility of explanation-based learning

Minton, S. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90059-9 · Cited by 372 · see citing works

Teleo-Reactive Programs for Agent Control

Nilsson, N. J. (1994) · Journal of Artificial Intelligence Research · doi:10.1613/jair.30 · Cited by 367 · see citing works

Made-up minds: a constructivist approach to artificial intelligence

Drescher, G. L. (1992) · Choice Reviews Online · doi:10.5860/choice.29-3935 · Cited by 315 · see citing works

Transfer of learning by composing solutions of elemental sequential tasks

Singh, S. P. (1992) · Machine Learning · doi:10.1007/bf00992700 · Cited by 289 · see citing works

The MAXQ Method for Hierarchical Reinforcement Learning

Dietterich, T. G. (1998) · Cited by 278 · see citing works

Purposive behavior acquisition for a real robot by vision-based reinforcement learning

Asada, M., Noda, S., Tawaratsumida, S., & Hosoda, K. (1996) · Machine Learning · doi:10.1007/bf00117447 · Cited by 274 · see citing works

The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces

Moore, A., & Atkeson, C. G. (1995) · Machine Learning · doi:10.1023/a:1022656217772 · Cited by 261 · see citing works

Reinforcement Learning Methods for Continuous-Time Markov Decision Problems

Bradtke, S. J., & Duff, M. O. (1994) · Cited by 257 · see citing works

Robot shaping: developing autonomous agents through learning

Dorigo, M., & Colombetti, M. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90047-7 · Cited by 238 · see citing works

Hierarchical Solution of Markov Decision Processes using Macro-actionsPreprint

Hauskrecht, M., Meuleau, N., Kaelbling, L. P., Dean, T., & Boutilier, C. E. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.7381 · Cited by 230 · see citing works

Hierarchical control and learning for markov decision processes

Parr, R., & Russell, S. (1998) · Cited by 221 · see citing works

Reinforcement Learning for Dynamic Channel Allocation in Cellular Telephone Systems

Singh, S. P., & Bertsekas, D. P. (1996) · Cited by 213 · see citing works

Planning under time constraints in stochastic domains

Dean, T., Kaelbling, L. P., Kirman, J., & Nicholson, A. E. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00086-g · Cited by 201 · see citing works

A Q-learning-based dynamic channel assignment technique for mobile communication systems

Nie, J., & Haykin, S. (1999) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.790549 · Cited by 182 · see citing works

Finding Structure in Reinforcement Learning

Thrun, S., & Schwartz, A. (1994) · Cited by 176 · see citing works

Solving very large weakly coupled Markov decision processes

Meuleau, N., Hauskrecht, M., Kim, K.-E., Peshkin, L., Kaelbling, L. P., Dean, T., & Boutilier, C. E. (1998) · Cited by 174 · see citing works

Hierarchical Learning in Stochastic Domains: Preliminary Results

Kaelbling, L. P. (1993) · Elsevier eBooks · doi:10.1016/b978-1-55860-307-3.50028-9 · Cited by 173 · see citing works

Learning Search Control Knowledge: An Explanation-Based Approach

Minton, S. (2011) · CERN Document Server (European Organization for Nuclear Research) · Cited by 172 · see citing works

HQ-Learning

Wiering, M., & Schmidhuber, J. (1997) · Adaptive Behavior · doi:10.1177/105971239700600202 · Cited by 163 · see citing works

TD Models: Modeling the World at a Mixture of Time Scales

Sutton, R. S. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50072-4 · Cited by 144 · see citing works

A Heuristic Approach to the Discovery of Macro-Operators

Iba, G. A. (1989) · Machine Learning · doi:10.1023/a:1022693717366 · Cited by 143 · see citing works

Decomposition Techniques for Planning in Stochastic Domains

Dean, T., & Lin, S. (1995) · Cited by 132 · see citing works

Intra-Option Learning about Temporally Abstract Actions

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 129 · see citing works

Learning to solve problems by searching for macro-operators

Korf, R. E. (1983) · Pitman Advanced Pub. Program eBooks · Cited by 119 · see citing works

Reinforcement learning with a hierarchy of abstract models

Singh, S. P. (1992) · Cited by 110 · see citing works

Multi-time Models for Temporally Abstract Planning

Precup, D., & Sutton, R. S. (1997) · Cited by 105 · see citing works

Theoretical results on reinforcement learning with temporally abstract options

Precup, D., Sutton, R. S., & Singh, S. P. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026709 · Cited by 103 · see citing works

Behavior analysis and training-a methodology for behavior engineering

Colombetti, M., Dorigo, M., & Borghi, G. (1996) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.499789 · Cited by 98 · see citing works

Behavior coordination for a mobile robot using modular reinforcement learning

Uchibe, E., Asada, M., & Hosoda, K. (2002) · doi:10.1109/iros.1996.568989 · Cited by 93 · see citing works

Automatic programming of robots using genetic programming

Koza, J. R., & Rice, J. P. (1992) · Cited by 90 · see citing works

Modeling agents as qualitative decision makers

Brafman, R. I., & Tennenholtz, M. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00024-6 · Cited by 85 · see citing works

The Problem of Expensive Chunks and its Solution by Restricting Expressiveness

Tambe, M., Newell, A., & Rosenbloom, P. S. (1990) · Machine Learning · doi:10.1023/a:1022603523533 · Cited by 76 · see citing works

A feedback control structure for on-line learning tasks

Huber, M., & Grupen, R. A. (1997) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(97)00044-4 · Cited by 64 · see citing works

Prioritized goal decomposition of Markov decision processes: toward a synthesis of classical and decision theoretic planning

Boutilier, C. E., Brafman, R. I., & Geib, C. (1997) · Cited by 52 · see citing works

Why prodigy/EBL works

Etzioni, O. (1990) · National Conference on Artificial Intelligence · Cited by 51 · see citing works

Module-Based Reinforcement Learning: Experiments with a Real Robot

Kalmár, Z., Szepesvári, C., & Lörincz, A. (1998) · Machine Learning · doi:10.1023/a:1007440607681 · Cited by 49 · see citing works

Qualitative system identification: deriving structure from behavior

Say, A. C. C., & Kuru, S. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(95)00016-x · Cited by 48 · see citing works

Robust Reinforcement Learning in Motion Planning

Singh, S. P., Barto, A. G., Grupen, R. A., & Connolly, C. I. (1993) · Cited by 48 · see citing works

Learning to Plan in Continuous Domains

DeJong, G. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90038-8 · Cited by 46 · see citing works

High-Level Planning and Control with Incomplete Information Using POMDP's

Bonet, B. (1998) · Cited by 45 · see citing works

A statistical approach to solving the EBL utility problem

Greiner, R., & Jurišica, I. (1992) · Cited by 44 · see citing works

Macro-Actions in Reinforcement Learning: An Empirical Analysis

McGovern, A., & Sutton, R. S. (1998) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 42 · see citing works

Commonsense knowledge of space: learning from experience

Kuipers, B. J. (1979) · Cited by 41 · see citing works

Markov Decision Problems

Yin, G. G., & Zhang, Q. (2012) · Stochastic modelling and applied probability · doi:10.1007/978-1-4614-4346-9_7 · Cited by 38 · see citing works

Improved Switching among Temporally Abstract Actions

Sutton, R. S., Singh, S. P., Precup, D., & Ravindran, B. (1998) · Cited by 33 · see citing works

The Efficient Learning of Multiple Task Sequences

Singh, S. P. (1991) · Cited by 32 · see citing works

Reinforcement Learning for Call Admission Control and Routing in Integrated Service Networks

Marbach, P., Mihatsch, O., Schulte, M., & Tsitsiklis, J. N. (1997) · Cited by 25 · see citing works

Incremental Development of Complex Behaviors through Automatic Construction of Sensory-motor Hierarchies

Ring, M. B. (1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-200-7.50071-4 · Cited by 25 · see citing works

Composing functions to speed up reinforcement learning in a changing world

Drummond, C. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026708 · Cited by 21 · see citing works

Scaling Reinforcement Learning Techniques via Modularity

Wixson, L. E. (1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-200-7.50076-3 · Cited by 17 · see citing works

A statistical approach to adaptive problem solving

Gratch, J. S., & DEJONG, G. F. (1996) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00011-2 · Cited by 11 · see citing works

Reasoning About Probabilistic Actions At Multiple Levels of Granularity

Chrisman, L. (1994) · Cited by 6 · see citing works

Deep learning in neural networks: an overview

Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works

Deep Reinforcement Learning: A Brief Survey

Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · see citing works

Dynamic bayesian networks: representation, inference and learning

Murphy, K. P., & Russell, S. (2002) · Cited by 2,563 · see citing works

Deep reinforcement learning for autonomous driving: A survey

Kiran, B. R., Sobh, I., Talpaert, V., Mannion, P., Sallab, A. A. A., Yogamani, S., & Perez, P. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3054625 · Cited by 2,342 · see citing works

A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement LearningPreprint

Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,568 · see citing works

Transfer Learning for Reinforcement Learning Domains: A Survey

Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,521 · see citing works

Mastering Atari, Go, chess and shogi by planning with a learned model

Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., Schmitt, S., Guez, A., Lockhart, E., Hassabis, D., Graepel, T., et al. (2020) · RePEc: Research Papers in Economics · Cited by 1,310 · see citing works

Age of Information: An Introduction and Survey

Yates, R. D., Sun, Y. J., Brown, D. R., Kaul, S. K., Modiano, E., & Ulukuş, Ş. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3065072 · Cited by 1,188 · see citing works

Intrinsic Motivation Systems for Autonomous Mental Development

Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126 · see citing works

Benchmarking Deep Reinforcement Learning for Continuous Control

Duan, Y., Chen, X., Houthooft, R., Schulman, J., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1604.06778 · Cited by 1,114 · see citing works

Algorithms for reinforcement learning

Szepesvári, C. (2010) · Synthesis lectures on artificial intelligence and machine learning · doi:10.1007/978-3-031-01551-9 · Cited by 308 · see citing works

Recent Advances in Hierarchical Reinforcement Learning

Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,043 · see citing works

Deep Reinforcement Learning: A Survey

Wang, X., Wang, S., Liang, X., Zhao, D., Huang, J., Xu, X., Dai, B., & Miao, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3207346 · Cited by 972 · see citing works

Multi-agent deep reinforcement learning: a survey

Gronauer, S., & Diepold, K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09996-w · Cited by 957 · see citing works

Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic MotivationPreprint

Kulkarni, T. D., Narasimhan, K., Saeedi, A., & Tenenbaum, J. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.06057 · Cited by 895 · see citing works

Opponent interactions between serotonin and dopamine

Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works

Transfer Learning in Deep Reinforcement Learning: A Survey

Zhu, Z., Lin, K., Jain, A. K., & Zhou, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3292075 · Cited by 861 · see citing works

What is intrinsic motivation? A typology of computational approaches

Oudeyer, P.-Y. (2007) · Frontiers in Neurorobotics · doi:10.3389/neuro.12.006.2007 · Cited by 811 · see citing works

The design and implementation of Xiaoice, an empathetic social chatbot

Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777 · see citing works

Deep Reinforcement Learning: An Overview

Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762 · see citing works

The Option-Critic Architecture

Bacon, P., Harb, J., & Precup, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10916 · Cited by 219 · see citing works

Reinforcement learning in the brain

Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 724 · see citing works

Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective

Botvinick, M. M., Niv, Y., & Barto, A. G. (2009) · Cognition · doi:10.1016/j.cognition.2008.08.011 · Cited by 646 · see citing works

Universal Value Function Approximators

Schaul, T., Horgan, D., Gregor, K., & Silver, D. (2015) · Cited by 677 · see citing works

Reinforcement learning algorithms: A brief survey

Shakya, A. K., Pillai, G. N., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 700 · see citing works

Human-level performance in 3D multiplayer games with population-based reinforcement learning

Jaderberg, M., Czarnecki, W. M., Dunning, I., Marris, L., Lever, G., Castañeda, A. G., Beattie, C., Rabinowitz, N. C., Morcos, A. S., Ruderman, A., et al. (2019) · Science · doi:10.1126/science.aau6249 · Cited by 662 · see citing works

Challenges of real-world reinforcement learning: definitions, benchmarks and analysis

Dulac-Arnold, G., Levine, N., Mankowitz, D. J., Li, J., Păduraru, C., Gowal, S., & Hester, T. (2021) · Machine Learning · doi:10.1007/s10994-021-05961-4 · Cited by 778 · see citing works

Intrinsically Motivated Reinforcement Learning

Singh, S. P., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 614 · see citing works

Untitled work

(2004) · Cited by 610 · see citing works

Hierarchical models of behavior and prefrontal function

Botvinick, M. M. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.009 · Cited by 532 · see citing works

Deep learning, reinforcement learning, and world models

Matsuo, Y., LeCun, Y., Sahani, M., Precup, D., Silver, D., Sugiyama, M., Uchibe, E., & Morimoto, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.037 · Cited by 547 · see citing works

On a Formal Model of Safe and Scalable Self-driving CarsPreprint

Shalev‐Shwartz, S., Shammah, S., & Shashua, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.06374 · Cited by 540 · see citing works

Behavior Trees in Robotics and AI

Colledanchise, M., & Ögren, P. (2018) · CRC Press eBooks · doi:10.1201/9780429489105 · Cited by 534 · see citing works

Model-based Reinforcement Learning: A Survey

Moerland, T. M., Broekens, J., Plaat, A., & Jonker, C. M. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000086 · Cited by 668 · see citing works

Learning, reward, and decision making

O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475 · see citing works

Long Text Generation via Adversarial Training with Leaked Information

Guo, J., Lu, S., Cai, H., Zhang, W., Yu, Y. H., & Wang, Y.-X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11957 · Cited by 512 · see citing works

Reinforcement Learning based Recommender Systems: A Survey

Afsar, M. M., Crump, T., & Far, B. H. (2022) · ACM Computing Surveys · doi:10.1145/3543846 · Cited by 560 · see citing works

Fast gradient-descent methods for temporal-difference learning with linear function approximation

Sutton, R. S., Maei, H. R., Precup, D., Bhatnagar, S., Silver, D., Szepesvári, C., & Wiewiora, E. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553501 · Cited by 500 · see citing works

Multiple model-based reinforcement learning

Doya, K., Samejima, K., Katagiri, K.-I., & Kawato, M. (2002) · Neural Computation · doi:10.1162/089976602753712972 · Cited by 476 · see citing works

Hierarchical Reinforcement Learning

Pateria, S., Subagdja, B., Tan, A., & Quek, C. H. (2021) · ACM Computing Surveys · doi:10.1145/3453160 · Cited by 473 · see citing works

Active learning of inverse models with intrinsically motivated goal exploration in robots

Baranès, A., & Oudeyer, P. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.05.008 · Cited by 466 · see citing works

Discovery of complex behaviors through contact-invariant optimization

Mordatch, I., Todorov, E. V., & Popović, Z. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185539 · Cited by 451 · see citing works

Eligibility Traces for Off-Policy Policy Evaluation

Precup, D., Sutton, R. S., & Singh, S. P. (2000) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 439 · see citing works

LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models

Song, C. H., Sadler, B. M., Wu, J., Chao, W.-L., Washington, C., & Su, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00280 · Cited by 435 · see citing works

Predictive Representations of State

Littman, M. L., & Sutton, R. S. (2001) · Cited by 424 · see citing works

Replay Comes of Age

Foster, D. J. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031538 · Cited by 375 · see citing works

Automatic Discovery of Subgoals in Reinforcement Learning using Diverse Density

McGovern, A., & Barto, A. G. (2001) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 416 · see citing works

Neural Approaches to Conversational AI

Gao, J., Galley, M., & Li, L. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210183 · Cited by 409 · see citing works

Multi-Agent Reinforcement Learning: A Review of Challenges and Applications

Canese, L., Cardarilli, G. C., Nunzio, L. D., Fazzolari, R., Giardino, D., Re, M., & Spanò, S. (2021) · Applied Sciences · doi:10.3390/app11114948 · Cited by 408 · see citing works

Reinforcement Learning for RoboCup Soccer Keepaway

STONE, P. R., Sutton, R. S., & Kuhlmann, G. (2005) · Adaptive Behavior · doi:10.1177/105971230501300301 · Cited by 388 · see citing works

An algorithmic perspective on imitation learning

Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405 · see citing works

Quantum Reinforcement Learning

Dong, D., Chen, C., Li, H., & Tarn, T.-J. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.925743 · Cited by 410 · see citing works

Intrinsically Motivated Learning of Hierarchical Collections of Skills

Barto, A. G., Singh, S. P., & Chentanez, N. (2004) · Cited by 376 · see citing works

Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning

Tan, L. T., & Hu, R. Q. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2867191 · Cited by 356 · see citing works

FOR LEAST-SQUARES POLICY ITERATION

Schwab, D. (2016) · Cited by 372 · see citing works

Relational Reinforcement Learning

Džeroski, S., De Raedt, L., & Driessens, K. (2001) · Machine Learning · doi:10.1023/a:1007694015589 · Cited by 371 · see citing works

An Algorithmic Perspective on Imitation Learning

Osa, T., Pajarinen, J., Neumann, G. M., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834116 · Cited by 387 · see citing works

R&D Networks

Goyal, S., & Moraga‐González, J. L. (2001) · The RAND Journal of Economics · doi:10.2307/2696388 · Cited by 362 · see citing works

IQA: Visual Question Answering in Interactive Environments

Gordon, D., Kembhavi, A., Rastegari, M., Redmon, J., Fox, D., & Farhadi, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00430 · Cited by 362 · see citing works

Learning Movement Primitives

Schaal, S., Peters, J., Nakanishi, J., & Ijspeert, A. J. (2005) · Springer tracts in advanced robotics · doi:10.1007/11008941_60 · Cited by 349 · see citing works

Learning to schedule job-shop problems: representation and policy learning using graph neural network and reinforcement learning

Park, J., Chun, J., Kim, S. H., Kim, Y., & Park, J. (2021) · International Journal of Production Research · doi:10.1080/00207543.2020.1870013 · Cited by 340 · see citing works

Reinforcement Learning: A Tutorial Survey and Recent Advances

Gosavi, A. A. (2008) · INFORMS journal on computing · doi:10.1287/ijoc.1080.0305 · Cited by 331 · see citing works

Recent Advances in Hierarchical Reinforcement Learning

Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1025696116075 · Cited by 317 · see citing works

Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey

Chen, W., Qiu, X., Cai, T., Dai, H., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 318 · see citing works

Reinforcement learning in artificial and biological systems

Neftci, E., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 303 · see citing works

Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction

Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., & Precup, D. (2011) · doi:10.5555/2031678.2031726 · Cited by 301 · see citing works

A Deep Hierarchical Approach to Lifelong Learning in Minecraft

Tessler, C., Givony, S., Zahavy, T., Mankowitz, D. J., & Mannor, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10744 · Cited by 300 · see citing works

Hierarchical motor control in mammals and machines

Merel, J., Botvinick, M., & Wayne, G. (2019) · Nature Communications · doi:10.1038/s41467-019-13239-6 · Cited by 274 · see citing works

Robot learning from demonstration by constructing skill trees

Konidaris, G., Kuindersma, S., Grupen, R. A., & Barto, A. G. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911428653 · Cited by 287 · see citing works

Towards a Unified Theory of State Abstraction for MDPs.

Li, L. C., Walsh, T. J., & Littman, M. L. (2006) · Cited by 283 · see citing works

Learning Options in Reinforcement Learning

Stolle, M., & Precup, D. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45622-8_16 · Cited by 271 · see citing works

Collision avoidance for an unmanned surface vehicle using deep reinforcement learning

Woo, J., & Kim, N. (2020) · Ocean Engineering · doi:10.1016/j.oceaneng.2020.107001 · Cited by 270 · see citing works

Transfer Learning

Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 272 · see citing works

Transfer in Reinforcement Learning: A Framework and a Survey

Lazaric, A. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_5 · Cited by 270 · see citing works

Rationalization is rational

Cushman, F. A. (2019) · Behavioral and Brain Sciences · doi:10.1017/s0140525x19001730 · Cited by 268 · see citing works

A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation

Han, D., Mulyana, B., Stankovic, V., & Cheng, S. (2023) · Sensors · doi:10.3390/s23073762 · Cited by 253 · see citing works

Off-Policy Temporal Difference Learning with Function Approximation

Precup, D., Sutton, R. S., & Dasgupta, S. (2001) · Cited by 243 · see citing works

Policy Recognition in the Abstract Hidden Markov Model

Bui, H., Venkatesh, S., & WEST, G. A. W. (2002) · Cited by 243 · see citing works

Deep Reinforcement Learning

Li, C. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351006620-6 · Cited by 251 · see citing works

FIRM: Sampling-based feedback motion-planning under motion uncertainty and imperfect measurements

Agha–mohammadi, A., Chakravorty, S., & Amato, N. M. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913501564 · Cited by 236 · see citing works

Identifying useful subgoals in reinforcement learning by local graph partitioning

Şimşek, Ö., Wolfe, A. P., & Barto, A. G. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102454 · Cited by 238 · see citing works

Hierarchical reinforcement learning and decision making

Botvinick, M. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.05.008 · Cited by 230 · see citing works

From Skills to Symbols: Learning Symbolic Representations for Abstract High-Level Planning

Konidaris, G., Kaelbling, L. P., & Lozano‐Pérez, T. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5575 · Cited by 237 · see citing works

A Hierarchical Framework for Relation Extraction with Reinforcement Learning

Takanobu, R., Zhang, T., Liu, J., & Huang, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017072 · Cited by 229 · see citing works

A reinforcement learning framework for optimal operation and maintenance of power grids

Rocchetta, R., Bellani, L., Compare, M., Zio, E., & Patelli, E. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.03.027 · Cited by 228 · see citing works

The challenges of joint attention

Kaplan, F., & Hafner, V. V. (2006) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.7.2.04kap · Cited by 227 · see citing works

Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining

Konidaris, G., & Barreto, A. S. (2009) · Cited by 227 · see citing works

Neural Programmer-Interpreters

Reed, S., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06279

Towards Continual Reinforcement Learning: A Review and Perspectives

Khetarpal, K., Riemer, M., Rish, I., & Precup, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13673 · Cited by 224 · see citing works

Q-Cut—Dynamic Discovery of Sub-goals in Reinforcement Learning

Menache, I., Mannor, S., & Shimkin, N. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36755-1_25 · Cited by 222 · see citing works

Intrinsic Motivation and Reinforcement Learning

Barto, A. G. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1_2 · Cited by 234 · see citing works

Building portable options: skill transfer in reinforcement learning

Konidaris, G., & Barto, A. G. (2007) · Cited by 220 · see citing works

Actions, Action Sequences and Habits: Evidence That Goal-Directed and Habitual Action Control Are Hierarchically Organized

Dezfouli, A., & Balleine, B. W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003364 · Cited by 221 · see citing works

Meta Learning Shared HierarchiesPreprint

Frans, K., Ho, J., Chen, X., Abbeel, P., & Schulman, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09767 · Cited by 219 · see citing works

Planning and navigation as active inference

Kaplan, R., & Friston, K. J. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0753-2 · Cited by 203 · see citing works

Interplay of approximate planning strategies

Huys, Q. J. M., Lally, N., Faulkner, P., Eshel, N., Seifritz, E., Gershman, S. J., Dayan, P., & Roiser, J. P. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414219112 · Cited by 207 · see citing works

Variational Intrinsic ControlPreprint

Gregor, K., Rezende, D. J., & Wierstra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07507 · Cited by 213 · see citing works

Multi-Agent Deep Reinforcement Learning for Multi-Robot Applications: A Survey

Orr, J., & Dutta, A. (2023) · Sensors · doi:10.3390/s23073625 · Cited by 232 · see citing works

State abstraction for programmable reinforcement learning agents

André, D., & Russell, S. (2002) · doi:10.5555/777092.777114 · Cited by 207 · see citing works

Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model.

Holroyd, C. B., & McClure, S. M. (2014) · Psychological Review · doi:10.1037/a0038339 · Cited by 192 · see citing works

Between MOPs and Semi-MOP: Learning, Planning & Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 74 · see citing works

Between MDPs and Semi-MDPs: Learning, Planning, and Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 23 · see citing works

Reinforcement Learning and Artificial Intelligence

Sutton, R. S. (2003)

Intra-Option Learning about Temporally Abstract Actions

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 129 · see citing works

Hierarchical Optimal Control of MDPs

McGovern, A., Precup, D., Ravindran, B., Singh, S. P., Sutton, S. M., & Richard, S. F. (1998) · Cited by 18 · see citing works