Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

Human Problem Solving.

Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063712 · Cited by 6,886

Human Problem Solving

Newell, A. (1972) · Cited by 6,222

Dynamic Programming and Markov Processes.

Freimer, M. L., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,388

A qualitative physics based on confluences

de Kleer, J., & Brown, J. S. (1984) · Artificial Intelligence · doi:10.1016/0004-3702(84)90037-7 · Cited by 1,510

Planning in a hierarchy of abstraction spaces

Sacerdoti, E. D. (1974) · Artificial Intelligence · doi:10.1016/0004-3702(74)90026-5 · Cited by 1,185

Learning to act using real-time dynamic programming

Barto, A. G., Bradtke, S. J., & Singh, S. P. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00011-o · Cited by 1,129

Learning and executing generalized robot plans

Fikes, R. E., Hart, P. E., & Nilsson, N. J. (1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90051-3 · Cited by 1,025

Reinforcement learning for robots using neural networks

Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 841

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 801

Mario Becomes Cognitive

Schrodt, F., Kneissler, J., Ehrenfeld, S., & Butz, M. V. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12252 · Cited by 29

Vision-Based Robot Navigation through Combining Unsupervised Learning and Hierarchical Reinforcement Learning

Zhou, X., Bai, T., Gao, Y., & Han, Y. (2019) · Sensors · doi:10.3390/s19071576 · Cited by 27

Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning

Sharma, A., Ahn, M., Levine, S., Kumar, V., Hausman, K., & Gu, S. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.053 · Cited by 44

A Mind-inspired Architecture for Adaptive HRI

Umbrico, A., Benedictis, R. D., Fracasso, F., Cesta, A., Orlandini, A., & Cortellessa, G. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00897-8 · Cited by 28

HAVEN: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Dual Coordination Mechanism

Xu, Z., Bai, Y., Zhang, B., Li, D., & Fan, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26386 · Cited by 33

Structure in Deep Reinforcement Learning: A Survey and Open Problems

Mohan, A., Zhang, A., & Lindauer, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15703 · Cited by 38

A Unified Theoretical Framework for Cognitive Sequencing

Savalia, T., Shukla, A. K., & Bapi, R. S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01821 · Cited by 24

Multi-Task Hierarchical Imitation Learning for Home Automation

Fox, R., Berenstein, R., Stoica, I. G., & Goldberg, K. Y. (2019) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2019.8843293 · Cited by 26

Meta-control of the exploration-exploitation dilemma emerges from probabilistic inference over a hierarchy of time scales

Marković, D., Goschke, T., & Kiebel, S. J. (2020) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-020-00837-x · Cited by 24

Hierarchical reinforcement learning as creative problem solving

Colin, T. R., Belpaeme, T., Cangelosi, A., & Hemion, N. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.08.021 · Cited by 26

Hierarchical Reinforcement Learning in Communication-Mediated Multiagent Coordination

Fischer, F., Rovatsos, M., & Weiß, G. (2004) · doi:10.1109/aamas.2004.137 · Cited by 25

Option Discovery in Hierarchical Reinforcement Learning using Spatio-Temporal ClusteringPreprint

Srinivas, A., Krishnamurthy, R., Kumar, P., & Ravindran, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.05359 · Cited by 25

Combating the Compounding-Error Problem with a Multi-step ModelPreprint

Asadi, K., Misra, D. K., Kim, S., & Littman, M. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13320 · Cited by 69

How to Avoid Being Eaten by a Grue: Structured Exploration Strategies for Textual WorldsPreprint

Ammanabrolu, P., Tien, E., Hausknecht, M., & Riedl, M. O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07409 · Cited by 31

Unifying temporal and organizational scales in multiscale decision-making

Wernz, C., & Deshmukh, A. S. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.06.038 · Cited by 24

The eMOSAIC model for humanoid robot control

Sugimoto, N., Morimoto, J., Hyon, S.-H., & Kawato, M. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.01.002 · Cited by 24

Hierarchical Approach to Transfer of Control in Semi-Autonomous Systems: (Extended Abstract)

Wray, K. H., Pineda, L., & Shlomo Zilberstein, B. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/lrvj9432 · Cited by 24

Behavior Is Everything: Towards Representing Concepts with Sensorimotor Contingencies

Hay, N., Stark, M. M., Schlegel, A. A., Wendelken, C., Park, D., Purdy, E., Silver, T., Phoenix, D. S., & George, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11547 · Cited by 25

Deep Abstract Q-Networks

Roderick, M., Grimm, C., & Tellex, S. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/zpmm4618 · Cited by 26

Human-Like Decision Making: Document-level Aspect Sentiment Classification via Hierarchical Reinforcement Learning

Wang, J., Sun, C., Li, S., Wang, J., Si, L., Zhang, M., Liu, X., & Zhou, G. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1560 · Cited by 26

Simultaneously Learning Transferable Symbols and Language Groundings from Perceptual Data for Instruction Following

Gopalan, N., Rosen, E., Konidaris, G., & Tellex, S. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.102 · Cited by 24

Learning event-triggered control from data through joint optimization

Funk, N., Baumann, D., Berenz, V., & Trimpe, S. (2021) · IFAC Journal of Systems and Control · doi:10.1016/j.ifacsc.2021.100144 · Cited by 26

Communication-Based Decomposition Mechanisms for Decentralized MDPs

Goldman, C. V., Goldman, C. V., & Shlomo Zilberstein, B. (2008) · Cited by 24

Congestion-Aware Policy Synthesis for Multirobot Systems

Street, C., Pütz, S., Mühlig, M., Hawes, N., & Lacerda, B. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3071618 · Cited by 24

Hierarchies of Planning and Reinforcement Learning for Robot Navigation

Wöhlke, J., Schmitt, F., & van Hoof, H. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561151 · Cited by 24

Monkey plays Pac-Man with compositional strategies and hierarchical decision-making

Yang, Q., Lin, Z., Zhang, W., Li, J., Chen, X., Zhang, J., & Yang, T. (2022) · eLife · doi:10.7554/elife.74500 · Cited by 20

Creativity of AI: Automatic Symbolic Option Discovery for Facilitating Deep Reinforcement Learning

Jin, M., Ma, Z., Jin, K., Zhuo, H. H., Chen, C., & Yu, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20663 · Cited by 28

Hierarchical Deep Reinforcement Learning for Self-Powered Monitoring and Communication Integrated System in High-Speed Railway Networks

Ling, Z., Hu, F., Liu, T., Jia, Z., & Han, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3248161 · Cited by 24

Reinforcement learning and higher level cognition: Introduction to special issue

Daw, N. D., & Frank, M. J. (2009) · Cognition · doi:10.1016/j.cognition.2009.09.005 · Cited by 24

Bootstrapping $Q$ -Learning for Robotics From Neuro-Evolution Results

Zimmer, M., & Doncieux, S. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2628817 · Cited by 24

Safe option-critic: learning safety in the option-critic architecture

Jain, A., Khetarpal, K., & Precup, D. (2021) · The Knowledge Engineering Review · doi:10.1017/s0269888921000035 · Cited by 24

Model primitives for hierarchical lifelong reinforcement learning

Wu, B., Gupta, J. K., & Kochenderfer, M. J. (2020) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-020-09451-0 · Cited by 25

Hierarchical reinforcement learning via dynamic subspace search for multi-agent planning

Ma, A., Ouimet, M., & Cortés, J. (2019) · Autonomous Robots · doi:10.1007/s10514-019-09871-2 · Cited by 27

Learning for multi-robot cooperation in partially observable stochastic environments with macro-actions

Liu, M., Sivakumar, K., Omidshafiei, S., Amato, C., & How, J. P. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206001 · Cited by 29

ADAPS: Autonomous Driving Via Principled Simulations

Li, W., Wolinski, D., & Lin, M. C. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794239 · Cited by 24

Induction of Subgoal Automata for Reinforcement Learning

Furelos-Blanco, D., Law, M., Russo, A., Broda, K. B., & Jönsson, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5802 · Cited by 7

Compositional Transfer in Hierarchical Reinforcement Learning

Wulfmeier, M., Abdolmaleki, A., Hafner, R., Springenberg, J. T., Neunert, M., Siegel, N., Hertweck, T., Lampe, T., Heess, N., & Riedmiller, M. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.054 · Cited by 24

Hierarchical Approaches

Hengst, B. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_9 · Cited by 24

MOSAIC for Multiple-Reward Environments

Sugimoto, N., Haruno, M., Doya, K., & Kawato, M. (2011) · Neural Computation · doi:10.1162/neco_a_00246 · Cited by 24

Learning Goal Embeddings via Self-Play for Hierarchical Reinforcement LearningPreprint

Sukhbaatar, S., Denton, E., Szlam, A. D., & Fergus, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09083 · Cited by 31

Knowledge Transfer for Cross-Domain Reinforcement Learning: A Systematic Review

Serrano, S. A., Martínez-Carranza, J., & Sucar, L. E. (2024) · IEEE Access · doi:10.1109/access.2024.3435558 · Cited by 26

Conjugate Markov Decision Processes

Thomas, P. S., & Barto, A. G. (2011) · Cited by 23

Learning a Set of Interrelated Tasks by Using a Succession of Motor Policies for a Socially Guided Intrinsically Motivated Learner

Duminy, N., Nguyen, S. M., & Duhaut, D. (2019) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00087 · Cited by 23

Multi-Reward Architecture based Reinforcement Learning for Highway Driving Policies

Yuan, W., Yang, M. Z., He, Y., Wang, C., & Wang, B. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917304 · Cited by 25

Learning Functionally Decomposed Hierarchies for Continuous Control Tasks With Path Planning

Christen, S., Jendele, L., Aksan, E., & Hilliges, O. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3060403 · Cited by 23

Hierarchical Multiagent Reinforcement Learning for Maritime Traffic Management

Singh, A. J., Kumar, A., & Lau, H. C. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/hamn2012 · Cited by 23

Traffic Light Control Using Hierarchical Reinforcement Learning and Options Framework

Borges, D. F., Leite, J. P., Moreira, E. M., & Carpinteiro, O. A. S. (2021) · IEEE Access · doi:10.1109/access.2021.3096666 · Cited by 23

Discrete Event Modeling and Simulation for Reinforcement Learning System Design

Capocchi, L., & Santucci, J.-F. (2022) · Information · doi:10.3390/info13030121 · Cited by 23

Detect, Understand, Act: A Neuro-symbolic Hierarchical Reinforcement Learning Framework

Mitchener, L., Tuckey, D., Crosby, M., & Russo, A. (2022) · Machine Learning · doi:10.1007/s10994-022-06142-7 · Cited by 23

Hierarchical generative modelling for autonomous robots

Yuan, K., Sajid, N., Friston, K., & Li, Z. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00752-z · Cited by 23

Multi-robot Cooperation Based on Hierarchical Reinforcement Learning

Cheng, X., Shen, J., Liu, H., & Gu, G. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72588-6_12 · Cited by 23

Reinforcement Learning in a Nutshell

Heidrich-Meisner, V., Lauer, M., Igel, C., & Riedmiller, M. (2007) · Cited by 23

Automatic abstraction in reinforcement learning using data mining techniques

Kheradmandian, G., & Rahmati, M. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.07.002 · Cited by 23

AUTOMATIC COMPLEXITY REDUCTION IN REINFORCEMENT LEARNING

Chiu, C., & Soo, V. (2010) · Computational Intelligence · doi:10.1111/j.1467-8640.2009.00350.x · Cited by 23

Designing Decentralized Controllers for Distributed-Air-Jet MEMS-Based Micromanipulators by Reinforcement Learning

Matignon, L., Laurent, G. J., Fort-Piat, N. L., & Chapuis, Y. A. (2010) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-010-9396-9 · Cited by 23

Incremental learning of skill collections based on intrinsic motivation

Metzen, J. H., & Kirchner, F. (2013) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2013.00011 · Cited by 22

Continuous-Observation Partially Observable Semi-Markov Decision Processes for Machine Maintenance

Zhang, M., & Revie, M. (2016) · IEEE Transactions on Reliability · doi:10.1109/tr.2016.2626477 · Cited by 23

Intrinsic motivation and mental replay enable efficient online adaptation in stochastic recurrent networks

Tanneberg, D., Peters, J., & Rueckert, E. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.10.005 · Cited by 25

Learning Symbolic Representations for Planning with Parameterized Skills

Ames, B., Thackston, A., & Konidaris, G. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594313 · Cited by 23

Options of Interest: Temporal Abstraction with Interest Functions

Khetarpal, K., Klissarov, M., Chevalier-Boisvert, M., Bacon, P., & Precup, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5871 · Cited by 23

Multi-agent reinforcement learning: using macro actions to learn a mating task

Elfwing, S., Uchibe, E., Doya, K., & Christensen, H. I. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2004.1389904 · Cited by 23

The Development of Hierarchical Knowledge in Robot Systems

Hart, S. W. (2019) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/782w-wa28 · Cited by 23

Learning Purposeful Behaviour in the Absence of RewardsPreprint

Machado, M. C., & Bowling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07700 · Cited by 23

Learning to Compose SkillsPreprint

Sahni, H., Kumar, S., Tejani, F., & Isbell, C. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11289 · Cited by 23

Dynamics-aware EmbeddingsPreprint

Whitney, W., Agarwal, R., Cho, K., & Gupta, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09357 · Cited by 26

Initial Task Allocation in Multi-Human Multi-Robot Teams: An Attention-Enhanced Hierarchical Reinforcement Learning Approach

Wang, R., Zhao, D., Gupte, A., & Min, B. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3366414 · Cited by 24

RLocator: Reinforcement Learning for Bug Localization

Chakraborty, P., Alfadel, M., & Nagappan, M. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3452595 · Cited by 31

Grounding Language to Non-Markovian Tasks with No Supervision of Task Specifications

Patel, R., Pavlick, E., & Tellex, S. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.016 · Cited by 22

Forgetful experience replay in hierarchical reinforcement learning from expert demonstrations

Skrynnik, A., Staroverov, A., Aitygulov, E., Aksenov, K., Davydov, V., & Panov, A. I. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106844 · Cited by 22

Subgoal-Based Reward Shaping to Improve Efficiency in Reinforcement Learning

Okudo, T., & Yamada, S. (2021) · IEEE Access · doi:10.1109/access.2021.3090364 · Cited by 25

Cooperative Multigroup Broadcast 360° Video Delivery Network: A Hierarchical Federated Deep Reinforcement Learning Approach

Hu, F., Deng, Y., & Aghvami, A. H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3126147 · Cited by 26

Hierarchical Policies for Cluttered-Scene Grasping With Latent Plans

Wang, L., Meng, X., Yu, X., & Fox, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3143198 · Cited by 22

SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments

Jamgochian, A. L., Buehrle, E., Fischer, J., & Kochenderfer, M. J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161449 · Cited by 22

Olfactory search with finite-state controllers

Verano, K. V. B., Panizon, E., & Celani, A. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2304230120 · Cited by 21

Integrating big data analytics in autonomous driving: An unsupervised hierarchical reinforcement learning approach

Mao, Z., Yang, L., & Qu, X. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104606 · Cited by 25

Incremental Skill Acquisition for Self-motivated Learning Animats

Bonarini, A., Lazaric, A., & Restelli, M. (2006) · Lecture notes in computer science · doi:10.1007/11840541_30 · Cited by 22

Learning a Super Mario controller from examples of human play

Lee, G., Luo, M., Zambetta, F., & Li, X. (2014) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2014.6900246 · Cited by 22

Unified Inter and Intra Options Learning Using Policy Gradient Methods

Levy, K. Y., & Shimkin, N. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29946-9_17 · Cited by 22

Modeling human behavior in the aftermath of a hypothetical improvised nuclear detonation

Parikh, N., Swarup, S., Stretz, P. E., Rivers, C., Lewis, B. L., MARATHE, M. V., Eubank, S., Barrett, C. L., Lum, K., & Chungbaek, Y. (2013) · doi:10.5555/2484920.2485070 · Cited by 22

The Mental Representation of Human Action

Levine, S., Leslie, A. M., & Mikhail, J. (2018) · Cognitive Science · doi:10.1111/cogs.12608 · Cited by 23

Learning to Learn: Hierarchical Meta-Critic Networks

Xu, Z., Cao, L., & Chen, X. (2019) · IEEE Access · doi:10.1109/access.2019.2914469 · Cited by 21

Automatic Discovery of Subgoals in Reinforcement Learning Using Strongly Connected Components

Kazemitabar, S. J., & Hamid Beigy, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02490-0_101 · Cited by 22

Exact Decomposition Approaches for Markov Decision Processes: A Survey

Daoui, C., Abbad, M., & Tkiouat, M. (2010) · Advances in Operations Research · doi:10.1155/2010/659432 · Cited by 22

A proposal of a behavior-based control architecture with reinforcement learning for an autonomous underwater robot

Pérez, M. C. (2003) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 22

An inductive logic programming approach to statistical relational learning

Kersting, K. (2006) · Cited by 22

Exploiting Hierarchy for Learning and Transfer in KL-regularized RLPreprint

Tirumala, D., Noh, H., Galashov, A., Hasenclever, L., Ahuja, A., Wayne, G., Pascanu, R., Teh, Y. W., & Heess, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.07438 · Cited by 38

From Pixels to Legs: Hierarchical Learning of Quadruped LocomotionPreprint

Jain, D., Işçen, A., & Caluwaerts, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.11722 · Cited by 29

Reinforcement Learning

Dayan, P. (2002) · Wiley eBooks · doi:10.1002/0471214426.pas0303 · Cited by 23

Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation

Schmalstieg, F., Honerkamp, D., Welschehold, T., & Valada, A. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3329619 · Cited by 21

HRLB⌃2: A Reinforcement Learning Based Framework for Believable Bots

Arzate Cruz, C., & Ramirez Uresti, J. A. (2018) · Applied Sciences · doi:10.3390/app8122453 · Cited by 21

Dynamic production scheduling and maintenance planning under opportunistic grouping

Ouahabi, N., Chebak, A., Kamach, O., & Zegrari, M. (2024) · Computers & Industrial Engineering · doi:10.1016/j.cie.2024.110646 · Cited by 26

Multi-timescale Nexting in a Reinforcement Learning Robot

Modayil, J., White, A., & Sutton, R. S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33093-3_30 · Cited by 21

Addressing Hindsight Bias in Multigoal Reinforcement Learning

Bai, C., Wang, L., Wang, Z., Wang, Z., Zhao, R., Bai, C., & Liu, P. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3107202 · Cited by 21

Towards Safe, Explainable, and Regulated Autonomous Driving

Atakishiyev, S., Salameh, M., Yao, H., & Goebel, R. G. (2023) · CRC Press eBooks · doi:10.1201/9781003324140-2 · Cited by 21

Representation learning in the artificial and biological neural networks underlying sensorimotor integration

Suhaimi, A. M. M., Lim, A. W. H., Chia, X. W., Li, C., & Makino, H. (2022) · Science Advances · doi:10.1126/sciadv.abn0984 · Cited by 22

HMDRL: Hierarchical Mixed Deep Reinforcement Learning to Balance Vehicle Supply and Demand

Xi, J., Zhu, F., Ye, P., Lv, Y., Tang, H., & Wang, F. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3191752 · Cited by 21

Risk-Aware Operation Modeling for Ride-Hailing Fleet in Order Grabbing Mode: A Distributional Reinforcement Learning Approach

Sun, Y., Ding, Z., Hu, Z., & Lee, W. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3237574 · Cited by 20

An Overview of Environmental Features that Impact Deep Reinforcement Learning in Sparse-Reward Domains

Ocana, J. M. C., Capobianco, R., & Nardi, D. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14390 · Cited by 21

Skill Transformer: A Monolithic Policy for Mobile Manipulation

Huang, X., Batra, D., Rai, A., & Szot, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00996 · Cited by 23

Reinforcement learning with automatic basis construction based on isometric feature mapping

Huang, Z., Xu, X., & Zuo, L. (2014) · Information Sciences · doi:10.1016/j.ins.2014.07.008 · Cited by 21

Between MOPs and Semi-MOP: Learning, Planning & Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 74

Between MDPs and Semi-MDPs: Learning, Planning, and Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 23

Reinforcement Learning and Artificial Intelligence

Sutton, R. S. (2003)

Intra-Option Learning about Temporally Abstract Actions

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 129

Hierarchical Optimal Control of MDPs

McGovern, A., Precup, D., Ravindran, B., Singh, S. P., Sutton, S. M., & Richard, S. F. (1998) · Cited by 18