Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

Human Problem Solving.

Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063712 · Cited by 6,886

Human Problem Solving

Newell, A. (1972) · Cited by 6,222

Dynamic Programming and Markov Processes.

Freimer, M. L., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,388

A qualitative physics based on confluences

de Kleer, J., & Brown, J. S. (1984) · Artificial Intelligence · doi:10.1016/0004-3702(84)90037-7 · Cited by 1,510

Planning in a hierarchy of abstraction spaces

Sacerdoti, E. D. (1974) · Artificial Intelligence · doi:10.1016/0004-3702(74)90026-5 · Cited by 1,185

Learning to act using real-time dynamic programming

Barto, A. G., Bradtke, S. J., & Singh, S. P. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00011-o · Cited by 1,129

Learning and executing generalized robot plans

Fikes, R. E., Hart, P. E., & Nilsson, N. J. (1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90051-3 · Cited by 1,025

Reinforcement learning for robots using neural networks

Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 841

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 801

Computation by Time

Walter, F., Röhrbein, F., & Knoll, A. (2015) · Neural Processing Letters · doi:10.1007/s11063-015-9478-6 · Cited by 25

Hybrid MDP based integrated hierarchical Q-learning

Chen, C., Dong, D., Li, H., & Tarn, T. (2011) · Science China Information Sciences · doi:10.1007/s11432-011-4332-6 · Cited by 21

Potential based reward shaping for hierarchical reinforcement learning

Gao, Y., & Toni, F. (2015) · Spiral (Imperial College London) · Cited by 21

Intrinsic motivation mechanisms for competence acquisition

Santucci, V. G., Baldassarre, G., & Mirolli, M. (2012) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2012.6400835 · Cited by 21

Monte Carlo Tree Search with options for general video game playing

Waard, M. P. D., Roijers, D. M., & Bakkes, S. C. J. (2016) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860383 · Cited by 20

The Bottleneck Simulator: A Model-Based Deep Reinforcement Learning Approach

Serban, I. V., Sankar, C., Pieper, M., Pineau, J., & Bengio, Y. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12463 · Cited by 25

Decision-Making Under Uncertainty in Multi-Agent and Multi-Robot Systems: Planning and Learning

Amato, C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/805 · Cited by 21

Diversity-Driven Extensible Hierarchical Reinforcement Learning

Song, Y., Wang, J., Lukasiewicz, T., Xu, Z., & Xu, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014992 · Cited by 21

Composable Modular Reinforcement Learning

Simpkins, C. L., & Isbell, C. L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014975 · Cited by 21

Real-time robot path planning from simple to complex obstacle patterns via transfer learning of options

Saha, O., Dasgupta, P., & Woosley, B. (2019) · Autonomous Robots · doi:10.1007/s10514-019-09852-5 · Cited by 21

Fixed-Horizon Temporal Difference Methods for Stable Reinforcement Learning

Asis, K. D., Chan, A., Pitis, S., Sutton, R. S., & Graves, D. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i04.5784 · Cited by 21

Multi-Resolution POMDP Planning for Multi-Object Search in 3D

Zheng, K., Sung, Y., Konidaris, G., & Tellex, S. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636737 · Cited by 21

Self-organization of action hierarchy and compositionality by reinforcement learning with recurrent neural networks

Han, D., Doya, K., & Tani, J. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.06.002 · Cited by 21

Towards integrated dialogue policy learning for multiple domains and intents using Hierarchical Deep Reinforcement Learning

Saha, T., Gupta, D., Saha, S., & Bhattacharyya, P. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113650 · Cited by 21

Towards Developing a Novel Framework for Practical PHM: a Sequential Decision Problem solved by Reinforcement Learning and Artificial Neural Networks

Bellani, L., Compare, M., Baraldi, P., & Zio, E. (2019) · International Journal of Prognostics and Health Management · doi:10.36001/ijphm.2019.v10i4.2616 · Cited by 21

Optimum Maintenance Policy Using Semi-Markov Decision Processes

Tomasevicz, C. L., & Asgarpoor, S. (2006) · North American Power Symposium (NAPS) · doi:10.1109/naps.2006.359586 · Cited by 21

Improving reinforcement learning by using sequence trees

Girgin, S., Polat, F., & Alhajj, R. (2010) · Machine Learning · doi:10.1007/s10994-010-5182-y · Cited by 21

Incremental acquisition of behaviors and signs based on a reinforcement learning schemata model and a spike timing-dependent plasticity network

Taniguchi, T., & Sawaragi, T. (2007) · Advanced Robotics · doi:10.1163/156855307781389374 · Cited by 20

Discovering options from example trajectories

Zang, P., Zhou, P., Minnen, D. C., & Isbell, C. L. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553529 · Cited by 21

A Novel Target Movement Model and Energy Efficient Target Tracking in Sensor Networks

Yeow, W.-L., Tham, C., & Wong, W. (2005) · IEEE Vehicular Technology Conference · doi:10.1109/vetecs.2005.1543862 · Cited by 21

Actor-critic algorithms for hierarchical Markov decision processes

Bhatnagar, S., & Panigrahi, J. R. (2006) · Automatica · doi:10.1016/j.automatica.2005.12.010 · Cited by 21

Large Scale Hidden Semi-Markov SVMs

Rätsch, G., & Sonnenburg, S. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0150 · Cited by 21

Reward-Based Learning, Model-Based and Model-Free

Huys, Q. J. M., Cruickshank, A., & Seriès, P. (2014) · Springer eBooks · doi:10.1007/978-1-4614-7320-6_674-1 · Cited by 24

Abstraction from demonstration for efficient reinforcement learning in high-dimensional domains

Cobo, L. C., Subramanian, K., Isbell, C. L., Lanterman, A. D., & Thomaz, A. L. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.07.003 · Cited by 19

Multi-step Off-policy Learning Without Importance Sampling RatiosPreprint

Mahmood, A. R., Yu, H., & Sutton, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03006 · Cited by 21

Novelty Search in Representational Space for Sample Efficient ExplorationPreprint

Tao, R. Y., François-Lavet, V., & Pineau, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13579 · Cited by 21

An Efficient Transfer Learning Framework for Multiagent Reinforcement LearningPreprint

Yang, T., Wang, W., Tang, H., Hao, J., Meng, Z., Mao, H., Li, D., Liu, W., Zhang, C., Hu, Y., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08030 · Cited by 21

Neural Networks With Motivation

Shuvaev, S. A., Tran, N. B., Stephenson‐Jones, M., Li, B., & Koulakov, A. A. (2021) · UCL Discovery (University College London) · Cited by 20

Design of simulation-based pilot training systems using machine learning agents

Källström, J., Granlund, R., & Heintz, F. (2022) · The Aeronautical Journal · doi:10.1017/aer.2022.8 · Cited by 22

Predictive hierarchical reinforcement learning for path-efficient mapless navigation with moving target

Li, H., Luo, B., Song, W., & Yang, C. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.06.007 · Cited by 21

Neural Program Lattices

Li, C., Tarlow, D., Gaunt, A. L., Brockschmidt, M., & Kushman, N. (2016) · International Conference on Learning Representations · Cited by 23

Recognition of Activities of Daily Living via Hierarchical Long-Short Term Memory Networks

Devanne, M., Papadakis, P., & Nguyen, S. M. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914457 · Cited by 22

Iterative Bounding MDPs: Learning Interpretable Policies via Non-Interpretable Methods

Topin, N., Milani, S., Fang, F., & Veloso, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17192 · Cited by 20

Robustly Learning Composable Options in Deep Reinforcement Learning

Bagaria, A., Senthil, J., Slivinski, M., & Konidaris, G. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/298 · Cited by 21

Option-Based Multi-Agent Reinforcement Learning for Painting With Multiple Large-Sized Robots

Liu, X., Wang, G., & Chen, K. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3145375 · Cited by 20

Cola-HRL: Continuous-Lattice Hierarchical Reinforcement Learning for Autonomous Driving

Gao, L., Gu, Z., Qiu, C., Lei, L., Li, S. E., Zheng, S., Jing, W., & Chen, J. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982041 · Cited by 20

Recent Advances of Deep Robotic Affordance Learning: A Reinforcement Learning Perspective

Yang, X., Ji, Z., Wu, J., & Lai, Y. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3277288 · Cited by 24

Accelerating Reinforcement Learning for Autonomous Driving Using Task-Agnostic and Ego-Centric Motion Skills

Zhou, T., Wang, L., Chen, R., Wang, W., & Liu, Y. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341449 · Cited by 22

Collaborative Computing in Non-Terrestrial Networks: A Multi-Time-Scale Deep Reinforcement Learning Approach

Cao, Y., Lien, S., Liang, Y., Niyato, D. T., & Shen, X. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3323554 · Cited by 24

PathRL: An End-to-End Path Generation Method for Collision Avoidance via Deep Reinforcement Learning

Yu, W., Peng, J., Qiu, Q., Wang, H., Zhang, L., & Ji, J. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610107 · Cited by 20

Active Learning of Parameterized Skills

da Silva, B., Konidaris, G., & Barto, A. G. (2014) · Cited by 20

Universal Option Models

Yao, H., Szepesvári, C., Sutton, R. S., Modayil, J., & Bhatnagar, S. (2014) · Cited by 23

Better generalization with forecasts

Schaul, T., & Ring, M. B. (2013) · Cited by 20

Efficient Planning for Near-Optimal Compliant Manipulation Leveraging Environmental Contact

Guan, C., Vega-Brown, W., & Roy, N. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8462696 · Cited by 20

Linear options

Sorg, J., & Singh, S. P. (2010) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/1838206.1838211 · Cited by 20

Guided goal generation for hindsight multi-goal reinforcement learning

Bai, C., Liu, P., Zhao, W., & Tang, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.022 · Cited by 20

Lifelong Learning with a Changing Action Set

Chandak, Y., Theocharous, G., Nota, C., & Thomas, P. S. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i04.5739 · Cited by 20

Skill Learning by Autonomous Robotic Playing Using Active Learning and Exploratory Behavior Composition

Hangl, S., Dunjko, V., Briegel, H. J., & Piater, J. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00042 · Cited by 36

Motivational engine and long-term memory coupling within a cognitive architecture for lifelong open-ended learning

Becerra, J. A., Romero, A., Bellas, F., & Duro, R. J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.124 · Cited by 20

CoMic: Complementary Task Learning & Mimicry for Reusable Skills

Hasenclever, L., Pardo, F., Hadsell, R. T., Heess, N., & Merel, J. (2020) · International Conference on Machine Learning · Cited by 20

MAGIC: Learning Macro-Actions for Online POMDP Planning

Lee, Y., Cai, P., & Hsu, D. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.041 · Cited by 25

Optimal indolence: a normative microscopic approach to work and leisure

Niyogi, R. K., Breton, Y.-A., Solomon, R. B., Conover, K. L., Shizgal, P., & Dayan, P. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0969 · Cited by 20

Reinforcement learning of hierarchical skills on the sony aibo robot

Soni, V. D., & Singh, S. P. (2005) · Cited by 20

Probabilistic Hybrid Action Models for Predicting Concurrent Percept-driven Robot Behavior

Beetz, M., & Großkreutz, H. (2005) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1565 · Cited by 20

Discovering Options for Exploration by Minimizing Cover TimePreprint

Jinnai, Y., Park, J. W., Abel, D. L., & Konidaris, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.00606 · Cited by 20

Learning and Planning in Average-Reward Markov Decision ProcessesPreprint

Wan, Y., Naik, A., & Sutton, R. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16318 · Cited by 20

Hierarchical Skills for Efficient ExplorationPreprint

Gehring, J., Synnaeve, G., Krause, A., & Usunier, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10809 · Cited by 20

When Waiting Is Not an Option: Learning Options With a Deliberation Cost

Harb, J., Bacon, P., Klissarov, M., & Precup, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11831 · Cited by 19

Hierarchical reinforcement learning for handling sparse rewards in multi-goal navigation

Yan, J., Luo, B., & Xu, X. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10794-3 · Cited by 19

Synthesis of model predictive control and reinforcement learning: Survey and classification

Reiter, R., Hoffmann, J., Reinhardt, D. P., Messerer, F., Baumgärtner, K., Sawant, S., Bödecker, J., Diehl, M., & Gros, S. (2026) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2026.101045 · Cited by 19

Graph-based Cross Entropy method for solving multi-robot decentralized POMDPs

Omidshafiei, S., Agha–mohammadi, A., Amato, C., Liu, S.-Y., How, J. P., & Vian, J. L. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487751 · Cited by 19

Ubiquitous Robotic Technology for Smart Manufacturing System

Wang, W., Zhu, X., Wang, L., Qiu, Q., & Cao, Q. (2016) · Computational Intelligence and Neuroscience · doi:10.1155/2016/6018686 · Cited by 19

Agbots 3.0: Adaptive Weed Growth Prediction for Mechanical Weeding Agbots

McAllister, W., Whitman, J., Varghese, J., Davis, A. S., & Chowdhary, G. V. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3083204 · Cited by 19

Classical Planning in Deep Latent Space

Asai, M., Kajino, H., Fukunaga, A. S., & Muise, C. J. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13768 · Cited by 22

Reward Machines for Vision-Based Robotic Manipulation

Camacho, A., Varley, J., Zeng, A., Jain, D., Işçen, A., & Kalashnikov, D. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561927 · Cited by 19

Search-based task and motion planning for hybrid systems: Agile autonomous vehicles

Ajanović, Z., Regolin, E., Shyrokau, B. N., Ćatić, H., Horn, M., & Ferrara, A. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105893 · Cited by 19

Having multiple selves helps learning agents explore and adapt in complex changing worlds

Dulberg, Z., Dubey, R., Berwian, I. M., & Cohen, J. D. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2221180120 · Cited by 19

Hierarchical Knowledge-Enhancement Framework for multi-hop knowledge graph reasoning

Xie, S., Liu, R., Wang, X., Luo, X., Sugumaran, V., & Yu, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127673 · Cited by 19

Goal-Based Action Priors

Abel, D. L., Hershkowitz, D. E., Barth-Maron, G., Brawner, S., O'Farrell, K., MacGlashan, J., & Tellex, S. (2015) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v25i1.13697 · Cited by 19

Empirical analysis of an on-line adaptive system using a mixture of Bayesian networks

Kitakoshi, D., Shioya, H., & Nakano, R. (2010) · Information Sciences · doi:10.1016/j.ins.2010.04.001 · Cited by 19

Transfer learning with Partially Constrained Models: Application to reinforcement learning of linked multicomponent robot system control

Fernandez‐Gauna, B., López-Guede, J. M., & Graña, M. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.07.020 · Cited by 19

An Efficient Approach to Model-Based Hierarchical Reinforcement Learning

Li, Z., Narayan, A., & Leong, T.-Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11024 · Cited by 20

Individual and Collective Behavior in Public Health Epidemiology

Chen, J., Lewis, B. L., Marathe, A., MARATHE, M. V., Swarup, S., & Vullikanti, A. K. S. (2017) · Handbook of statistics · doi:10.1016/bs.host.2017.08.011 · Cited by 21

Composing Value Functions in Reinforcement Learning.

van Niekerk, B., James, S. D., Earle, A. C., & Rosman, B. (2019) · International Conference on Machine Learning · Cited by 19

QUOTA: The Quantile Option Architecture for Reinforcement Learning

Zhang, S., & Yao, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015797 · Cited by 24

Towards sentiment aided dialogue policy learning for multi-intent conversations using hierarchical reinforcement learning

Saha, T., Saha, S., & Bhattacharyya, P. (2020) · PLoS ONE · doi:10.1371/journal.pone.0235367 · Cited by 20

Hierarchical Behaviours: Getting the Most Bang for Your Bit

van Dijk, S. G., Polani, D., & Nehaniv, C. L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21314-4_43 · Cited by 19

Hierarchical reinforcement learning with subpolicies specializing for learned subgoals.

Bakker, B., & Schmidhuber, J. (2004) · Cited by 19

Information-theoretic framework for unsupervised activity classification

Kaplan, F., & Hafner, V. V. (2006) · Advanced Robotics · doi:10.1163/156855306778522514 · Cited by 19

A Hierarchical Modular Architecture for Embodied Cognition

Ballard, D. H., Kit, D. M., Rothkopf, C. A., & Sullivan, B. T. (2013) · Multisensory Research · doi:10.1163/22134808-00002414 · Cited by 21

A Distributed Q-Learning Algorithm for Multi-Agent Team Coordination

Huang, J., Yang, B., & Liu, D. (2005) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2005.1526928 · Cited by 19

Interrupting behaviour: Minimizing decision costs via temporal commitment and low-level interrupts

Lloyd, K., & Dayan, P. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005916 · Cited by 22

Graph-Based Skill Acquisition For Reinforcement Learning

Mendonça, M. R. F., Ziviani, A., & Barreto, A. M. S. (2019) · ACM Computing Surveys · doi:10.1145/3291045 · Cited by 19

Toward Hierachical Decomposition for Planning in Uncertain Environments

Lane, T. D. R., & Kaelbling, L. P. (2001) · Cited by 19

Reinforcement learning in partially observable mobile robot domains using unsupervised event extraction

Bakker, B., Linåker, F., & Schmidhuber, J. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1041511 · Cited by 19

Hierarchical Reinforcement Learning using Spatio-Temporal Abstractions and Deep Neural Networks.Preprint

Krishnamurthy, R., Lakshminarayanan, A. S., Kumar, P., & Ravindran, B. (2016) · arXiv (Cornell University) · Cited by 19

Generative Multi-Agent Behavioral CloningPreprint

Zhan, E., Zheng, S., Yue, Y., Sha, L., & Lucey, P. (2018) · arXiv (Cornell University) · Cited by 22

The Value Equivalence Principle for Model-Based Reinforcement LearningPreprint

Grimm, C., Barreto, A. D. M. S., Singh, S. P., & Silver, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03506 · Cited by 19

ELLA: Exploration through Learned Language AbstractionPreprint

Mirchandani, S., Karamcheti, S., & Sadigh, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05825 · Cited by 21

Hierarchical Reinforcement Learning

Hengst, B. (2010) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_363 · Cited by 19

An inference-based policy gradient method for learning options

Smith, M. J., van Hoof, H., & Pineau, J. (2018) · UvA-DARE (University of Amsterdam) · Cited by 21

Economical operation strategy of an integrated energy system with wind power and power to gas technology – a DRL‐based approach

Zhang, B., Hu, W., Cao, D., Huang, Q. P., Chen, Z., & Blaabjerg, F. (2020) · IET Renewable Power Generation · doi:10.1049/iet-rpg.2020.0370 · Cited by 18

Continuous Action Reinforcement Learning From a Mixture of Interpretable Experts

Akrour, R., Tateo, D., & Peters, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3103132 · Cited by 21

Behavior Self-Organization Supports Task Inference for Continual Robot Learning

Hafez, M. B., & Wermter, S. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636297 · Cited by 18

Goal-Conditioned Hierarchical Reinforcement Learning With High-Level Model Approximation

Luo, Y., Ji, T., Sun, F., Liu, H., Zhang, J., Jing, M., & Huang, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3354061 · Cited by 19

Auxiliary Network Enhanced Hierarchical Graph Reinforcement Learning for Vehicle Repositioning

Xi, J., Zhu, F., Ye, P., Lv, Y., Xiong, G., & Wang, F. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3383720 · Cited by 19

Integrated energy hub dispatch with a multi-mode CAES–BESS hybrid system: An option-based hierarchical reinforcement learning approach

Cui, F., An, D., & Xi, H. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123950 · Cited by 18

Active Inference and Intentional Behavior

Friston, K. J., Salvatori, T., Isomura, T., Tschantz, A., Kiefer, A. B., Verbelen, T., Koudahl, M., Paul, A., Parr, T., Razi, A., et al. (2025) · Neural Computation · doi:10.1162/neco_a_01738 · Cited by 36

A novel graphical approach to automatic abstraction in reinforcement learning

Taghizadeh, N., & Hamid Beigy, A. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.04.010 · Cited by 18

A hierarchical reinforcement learning approach for optimal path tracking of wheeled mobile robots

Zuo, L., Xu, X., Liu, C., & Huang, Z. (2012) · Neural Computing and Applications · doi:10.1007/s00521-012-1243-4 · Cited by 18

Between MOPs and Semi-MOP: Learning, Planning & Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 74

Between MDPs and Semi-MDPs: Learning, Planning, and Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 23

Reinforcement Learning and Artificial Intelligence

Sutton, R. S. (2003)

Intra-Option Learning about Temporally Abstract Actions

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 129

Hierarchical Optimal Control of MDPs

McGovern, A., Precup, D., Ravindran, B., Singh, S. P., Sutton, S. M., & Richard, S. F. (1998) · Cited by 18