Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

Human Problem Solving.

Axten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063712 · Cited by 6,886

Human Problem Solving

Newell, A. (1972) · Cited by 6,222

Dynamic Programming and Markov Processes.

Freimer, M. L., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,388

A qualitative physics based on confluences

de Kleer, J., & Brown, J. S. (1984) · Artificial Intelligence · doi:10.1016/0004-3702(84)90037-7 · Cited by 1,510

Planning in a hierarchy of abstraction spaces

Sacerdoti, E. D. (1974) · Artificial Intelligence · doi:10.1016/0004-3702(74)90026-5 · Cited by 1,185

Learning to act using real-time dynamic programming

Barto, A. G., Bradtke, S. J., & Singh, S. P. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00011-o · Cited by 1,129

Learning and executing generalized robot plans

Fikes, R. E., Hart, P. E., & Nilsson, N. J. (1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90051-3 · Cited by 1,025

Reinforcement learning for robots using neural networks

Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 841

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 801

Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control

Macpherson, T., Matsumoto, M., Gomi, H., Morimoto, J., Uchibe, E., & Hikida, T. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.09.009 · Cited by 30

Learning Methods to Generate Good Plans: Integrating HTN Learning and Reinforcement Learning

Hogg, C., Kuter, U., & Muñoz‐Avila, H. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7571 · Cited by 32

TCS Learning Classifier System Controller on a Real Robot

Hurst, J., Bull, L., & Melhuish, C. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45712-7_57 · Cited by 32

Learning user models of mobility-related activities through instrumented walking aids

Glover, J., Thrun, S., & Matthews, J. T. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1308764 · Cited by 32

Learnings Options End-to-End for Continuous Action TasksPreprint

Klissarov, M., Bacon, P., Harb, J., & Precup, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00004 · Cited by 32

Hierarchical Actor-Critic.Preprint

Levy, A., Platt, R. W., & Saenko, K. (2017) · arXiv (Cornell University) · Cited by 32

Maturationally-constrained competence-based intrinsically motivated learning

Baranès, A., & Oudeyer, P. (2010) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2010.5578842 · Cited by 31

Portable option discovery for automated learning transfer in object-oriented Markov decision processes

Topin, N., Haltmeyer, N., Squire, S., Winder, J., desJardins, M., & MacGlashan, J. (2015) · International Conference on Artificial Intelligence · Cited by 31

Sampled-data Control of Probabilistic Boolean Control Networks: A Deep Reinforcement Learning Approach

Yerudkar, A., Chatzaroulas, E., Vecchio, C. D., & Moschoyiannis, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.11.030 · Cited by 31

Collaborative Edge Intelligence Service Provision in Blockchain Empowered Urban Rail Transit Systems

Liang, H., Zhu, L., & Yu, F. R. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3294400 · Cited by 34

Efficient learning and planning with compressed predictive states

Hamilton, W. L., Fard, M. M., & Pineau, J. (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2750354 · Cited by 31

Hierarchical model-based reinforcement learning

Jong, N. K., & Stone, P. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390211 · Cited by 31

Hierarchical Reinforcement Learning With Monte Carlo Tree Search in Computer Fighting Game

Pinto, I. D. J. P., & Coutinho, L. (2018) · IEEE Transactions on Games · doi:10.1109/tg.2018.2846028 · Cited by 31

A FRAMEWORK FOR LEARNING AND CONTROL IN INTELLIGENT HUMANOID ROBOTS

Brock, O., Fagg, A. H., Grupen, R. A., PLATT, R., Rosenstein, M. T., & Sweeney, J. D. (2005) · International Journal of Humanoid Robotics · doi:10.1142/s0219843605000491 · Cited by 31

Hierarchical Decision Making by Generating and Following Natural Language InstructionsPreprint

Hu, H., Yarats, D., Gong, Q., Tian, Y., & Lewis, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00744 · Cited by 31

Modelling Hierarchical Structure between Dialogue Policy and Natural Language Generator with Option Framework for Task-oriented Dialogue SystemPreprint

Wang, J., Zhang, Y., Kim, T., & Gu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06814 · Cited by 38

CAPE: Corrective Actions from Precondition Errors using Large Language Models

Raman, S. S., Cohen, V., Idrees, I., Rosen, E., Mooney, R. J., Tellex, S., & Paulius, D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611376 · Cited by 63

An intrinsic value system for developing multiple invariant representations with incremental slowness learning

Luciw, M., Kompella, V. R., Kazerounian, S., & Schmidhuber, J. (2013) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2013.00009 · Cited by 31

Converse-Et-Impera: Exploiting Deep Learning and Hierarchical Reinforcement Learning for Conversational Recommender Systems

Greco, C., Suglia, A., Basile, P., & Semeraro, G. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70169-1_28 · Cited by 32

Fraud detection in banking using deep reinforcement learning

Bouchti, A. E., Chakroun, A., Abbar, H., & Okar, C. (2017) · International Conference on Innovative Computing Technology · doi:10.1109/intech.2017.8102446 · Cited by 31

Learning Robust Options

Mankowitz, D., Mann, T., Bacon, P.-L., Precup, D., & Mannor, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12115 · Cited by 30

Generalizing to generalize: Humans flexibly switch between compositional and conjunctive structures during reinforcement learning

Franklin, N. T., & Frank, M. J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007720 · Cited by 39

Parameter Adaptation and Situation Awareness of LTE-R Handover for High-Speed Railway Communication

Wu, C., Cai, X., Sheng, J., Tang, Z., Ai, B., & Wang, Y. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3026195 · Cited by 30

Hierarchical deep reinforcement learning reveals a modular mechanism of cell movement

Wang, Z., Xu, Y., Wang, D., Yang, J., & Bao, Z. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-021-00431-x · Cited by 30

Context-aware reinforcement learning for course recommendation

Lin, Y., Lin, F., Yang, L., Zeng, W., Liu, Y., & Wu, P. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109189 · Cited by 30

DROP: Deep relocating option policy for optimal ride-hailing vehicle repositioning

Qian, X., Guo, S., & Aggarwal, V. (2022) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2022.103923 · Cited by 30

Automatic skill acquisition in reinforcement learning using graph centrality measures

Moradi, P., Shiri, M. E., Rad, A. A., Khadivi, A., & Hasler, M. (2012) · Intelligent Data Analysis · doi:10.3233/ida-2011-0513 · Cited by 30

Optimal policy switching algorithms for reinforcement learning

Comanici, G., & Precup, D. (2010) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/1838206.1838300 · Cited by 30

Interaction of Culture-Based Learning and Cooperative Co-Evolution and its Application to Automatic Behavior-Based System Design

Farahmand, A. M., Ahmadabadi, M. N., Lucas, C. L., & Araabi, B. N. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2016216 · Cited by 30

Learning predictive representations from a history

Wiewiora, E. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102473 · Cited by 30

Approximate solution methods for partially observable markov and semi-markov decision processes

Bertsekas, D. P., & Yu, H. (2006) · Cited by 30

Hierarchical Average Reward Reinforcement Learning

Ghavamzadeh, M., & Mahadevan, S. (2003) · doi:10.21236/ada445728 · Cited by 30

Hierarchical Reinforcement Learning via Advantage-Weighted Information MaximizationPreprint

Osa, T., Tangkaratt, V., & Sugiyama, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01365 · Cited by 32

Action and Perception as Divergence MinimizationPreprint

Hafner, D., Ortega, P. A., Ba, J. L., Parr, T., Friston, K. J., & Heess, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01791 · Cited by 52

N$^{2}$M$^{2}$: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environments

Honerkamp, D., Welschehold, T., & Valada, A. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3284346 · Cited by 30

The value of abstraction

Ho, M. K., Abel, D. L., Griffiths, T. L., & Littman, M. L. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.05.001 · Cited by 42

Skill based transfer learning with domain adaptation for continuous reinforcement learning domains

Shoeleh, F., & Asadpour, M. (2019) · Applied Intelligence · doi:10.1007/s10489-019-01527-z · Cited by 29

Exploration in Reinforcement Learning with Deep Covering Options

Jinnai, Y., Park, J. W., Machado, M. C., & Konidaris, G. (2020) · International Conference on Learning Representations · Cited by 28

A Framework for Learning From Demonstration With Minimal Human Effort

Rigter, M. P., Lacerda, B., & Hawes, N. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2970619 · Cited by 29

Multi-Objective Optimization of Energy Saving and Throughput in Heterogeneous Networks Using Deep Reinforcement Learning

Ryu, K., & Kim, W. (2021) · Sensors · doi:10.3390/s21237925 · Cited by 29

Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making

Grossman, C. D., & Cohen, J. Y. (2022) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092021-125059 · Cited by 30

Guided Reinforcement Learning: A Review and Evaluation for Efficient and Effective Real-World Robotics [Survey]

Eßer, J., Bach, N., Jestel, C., Urbann, O., & Kerner, S. (2022) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2022.3207664 · Cited by 34

Operational optimization for the grid-connected residential photovoltaic-battery system using model-based reinforcement learning

Xu, Y., Gao, W., Li, Y., & Xiao, F. (2023) · Journal of Building Engineering · doi:10.1016/j.jobe.2023.106774 · Cited by 29

Learning for Decentralized Control of Multiagent Systems in Large, Partially-Observable Stochastic Environments

Liu, M., Amato, C., Anesta, E., Griffith, J., & How, J. P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10135 · Cited by 29

Hierarchical Reinforcement Learning for Pedagogical Policy Induction

Zhou, G., Azizsoltani, H., Ausin, M. S., Barnes, T. M., & Chi, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23204-7_45 · Cited by 29

Logical Markov Decision Programs and the Convergence of Logical TD(λ)

Kristian Kersting, B., & Raedt, L. D. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30109-7_16 · Cited by 29

Developing navigation behavior through self-organizing distinctive-state abstraction

Provost, J., Kuipers, B. J., & Miikkulainen, R. P. (2006) · Connection Science · doi:10.1080/09540090600768609 · Cited by 29

MCP: Learning Composable Hierarchical Control with Multiplicative Compositional PoliciesPreprint

Peng, X. B., Chang, M., Zhang, G., Abbeel, P., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09808 · Cited by 101

Generalized Hindsight for Reinforcement LearningPreprint

Li, A. C., Pinto, L., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11708 · Cited by 30

Task-oriented Dialogue System for Automatic Disease Diagnosis via Hierarchical Reinforcement Learning.Preprint

Liao, K., Liu, Q., Wei, Z., Peng, B., Chen, Q., Sun, W., & Huang, X. (2020) · arXiv (Cornell University) · Cited by 29

Using Bisimulation for Policy Transfer in MDPs

Castro, P. F., & Precup, D. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7751 · Cited by 28

A priori-knowledge/actor-critic reinforcement learning architecture for computing the mean–variance customer portfolio: The case of bank marketing campaigns

Sánchez, E. M., Clempner, J. B., & Poznyak, A. S. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.08.011 · Cited by 28

Self-Organizing Sensorimotor Maps Plus Internal Motivations Yield Animal-Like Behavior

Butz, M. V., Shirinov, E., & Reif, K. L. (2010) · Adaptive Behavior · doi:10.1177/1059712310376842 · Cited by 28

Self-organization in an agent network: A mechanism and a potential application

Ye, D., Zhang, M., & Sutanto, D. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.02.009 · Cited by 28

Unsupervised Real-Time Control Through Variational Empowerment

Karl, M., Becker-Ehmck, P., Soelch, M., Benbouzid, D., van der Smagt, P., & Bayer, J. (2022) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-95459-8_10 · Cited by 28

Discovering Motor Programs by Recomposing Demonstrations

Shankar, T., Tulsiani, S., Pinto, L., & Gupta, A. (2020) · International Conference on Learning Representations · Cited by 29

Navigating an Automated Driving Vehicle via the Early Fusion of Multi-Modality

Haris, M., & Głowacz, A. (2022) · Sensors · doi:10.3390/s22041425 · Cited by 30

A combined hierarchical reinforcement learning based approach for multi-robot cooperative target searching in complex unknown environments

Cai, Y., Yang, S. X., & Xu, X. (2013) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2013.6614989 · Cited by 28

Intrinsically Motivated Machines

Kaplan, F., & Oudeyer, P. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77296-5_27 · Cited by 28

Logically-Correct Reinforcement Learning.Preprint

Hasanbeig, M., Abate, A., & Kroening, D. (2018) · arXiv (Cornell University) · Cited by 30

Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects

Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27

Becoming Team Members: Identifying Interaction Patterns of Mutual Adaptation for Human-Robot Co-Learning

van Zoelen, E. M., van den Bosch, K., & Neerincx, M. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.692811 · Cited by 31

A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning

Zhang, X., Sun, J., Wang, Y., & Sun, J. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3300748 · Cited by 27

Optimizing warfarin dosing for patients with atrial fibrillation using machine learning

Petch, J., Nelson, W., Wu, M., Ghassemi, M., Benz, A. P., Fatemi, M., Di, S., Carnicelli, A., Granger, C. B., Giugliano, R. P., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-55110-9 · Cited by 28

Energy-Aware Hierarchical Reinforcement Learning Based on the Predictive Energy Consumption Algorithm for Search and Rescue Aerial Robots in Unknown Environments

Ramezani, M., & Atashgah, M. A. A. (2024) · Drones · doi:10.3390/drones8070283 · Cited by 29

Constructing Abstraction Hierarchies Using a Skill-Symbol Loop

Konidaris, G. (2015) · PubMed · doi:10.48550/arxiv.1509.07582 · Cited by 27

Induction and Exploitation of Subgoal Automata for Reinforcement Learning

Furelos-Blanco, D., Law, M., Jonsson, A., Broda, K., & Russo, A. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12372 · Cited by 38

Hierarchical Reinforcement Learning With Automatic Sub-Goal Identification

Liu, C., Zhu, F., Liu, Q., & Fu, Y. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1004141 · Cited by 27

Active Predictive Coding: A Unifying Neural Model for Active Perception, Compositional Learning, and Hierarchical Planning

Rao, R. P. N., Gklezakos, D. C., & Sathish, V. (2023) · Neural Computation · doi:10.1162/neco_a_01627 · Cited by 39

Multigrid Reinforcement Learning with Reward Shaping

Grześ, M., & Kudenko⋆, D. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87536-9_37 · Cited by 27

Grounding subgoals in information transitions

van Dijk, S. G., & Polani, D. (2011) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2011.5967384 · Cited by 29

Automatic skill acquisition in Reinforcement Learning using connection graph stability centrality

Rad, A. A., Hasler, M., & Moradi, P. (2010) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2010.5537485 · Cited by 27

Automated Hierarchy Discovery for Planning in Partially Observable Environments

Charlin, L., Poupart, P., & Shioda, R. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0033 · Cited by 27

A memetic-based fuzzy support vector machine model and its application to license plate recognition

Samma, H., Lim, C. P., Mohamad–Saleh, J., & Suandi, S. A. (2016) · Memetic Computing · doi:10.1007/s12293-016-0187-0 · Cited by 27

A Reinforcement Learning Architecture That Transfers Knowledge Between Skills When Solving Multiple Tasks

Tommasino, P., Caligiore, D., Mirolli, M., & Baldassarre, G. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2607018 · Cited by 27

Continuous-Time Hierarchical Reinforcement Learning

Ghavamzadeh, M., & Mahadevan, S. (2001) · Cited by 27

Maximizing Reward in a Non-Stationary Mobile Robot Environment

Goldberg, D., & Matarić, M. J. (2003) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/a:1022935725296 · Cited by 27

Temporal abstraction in temporal-difference networks

Rafols, E. J. (2006) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-b3jb-nw13 · Cited by 27

Reinforcement Learning with Competitive Ensembles of Information-Constrained PrimitivesPreprint

Goyal, A., Sodhani, S., Binas, J., Peng, X. B., Levine, S., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.10667 · Cited by 30

Experience Replay with Likelihood-free Importance WeightsPreprint

Sinha, S., Song, J., Garg, A., & Ermon, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13169 · Cited by 31

Evolving Childhood's Length and Learning Parameters in an Intrinsically Motivated Reinforcement Learning Robot

Schembri, M., Mirolli, M., & Baldassarre, G. (2007) · Cited by 26

Rationalizable Irrationalities of Choice

Dayan, P. (2014) · Topics in Cognitive Science · doi:10.1111/tops.12082 · Cited by 29

Fast Reinforcement Learning using multiple models

Narendra, K. S., Wang, Y., & Mukhopadhay, S. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7799377 · Cited by 26

Open Problem: The Dependence of Sample Complexity Lower Bounds on Planning Horizon

Jiang, N., & Agarwal, A. (2018) · Conference on Learning Theory · Cited by 26

Hybrid Hierarchical Reinforcement Learning for online guidance and navigation with partial observability

Zhou, Y., Kampen, E.-J. V., & Chu, Q. P. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.11.072 · Cited by 26

Model-Free Model Reconciliation

Sreedharan, S., Olmo, A., Mishra, A. P., & Subbarao Kambhampati, B. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/83 · Cited by 26

Advice-Guided Reinforcement Learning in a non-Markovian Environment

Neider, D., Gaglione, J.-R., Gavran, I., Topcu, U., Wu, B., & Xu, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17096 · Cited by 26

Intrinsic Motivation and Introspection in Reinforcement Learning

Merrick, K. E. (2012) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2012.2208457 · Cited by 26

A Pursuit-Evasion Algorithm Based on Hierarchical Reinforcement Learning

Liu, J., Liu, S., Hong-yan, W., & Zhang, Y. (2009) · International Conference on Measuring Technology and Mechatronics Automation (ICMTMA) · doi:10.1109/icmtma.2009.213 · Cited by 26

Divide and Conquer: Hierarchical Reinforcement Learning and Task Decomposition in Humans

Diuk, C., Schapiro, A. C., Córdova, N. I., Fernandes, J. J. F. R., Niv, Y., & Botvinick, M. (2013) · Springer eBooks · doi:10.1007/978-3-642-39875-9_12 · Cited by 26

Successor Options: An Option Discovery Framework for Reinforcement Learning

Ramesh, R., Tomar, M., & Ravindran, B. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/458 · Cited by 27

Visual pathways from the perspective of cost functions and multi-task deep neural networks

Scholte, H. S., Losch, M., Ramakrishnan, K., de Haan, E. H. F., & Bohté, S. M. (2017) · Cortex · doi:10.1016/j.cortex.2017.09.019 · Cited by 29

Contributions of the basal ganglia to action sequence learning and performance

Garr, E. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.017 · Cited by 30

Planning and response in the aftermath of a large crisis: An agent-based informatics framework

Barrett, C. L., Bisset, K. R., Chandan, S., Chen, J., Chungbaek, Y., Eubank, S., Evrenosoglu, Y., Lewis, B. L., Lum, K., Marathe, A., et al. (2013) · Winter Simulation Conference · doi:10.1109/wsc.2013.6721535 · Cited by 26

Nearly deterministic abstractions of Markov decision processes

Lane, T. D. R., & Kaelbling, L. P. (2002) · doi:10.5555/777092.777135 · Cited by 26

Using Machine Learning Techniques in Complex Multi-Agent Domains

Riedmiller, M., & Merke, A. (2003) · Springer eBooks · doi:10.1007/978-3-662-05594-6_22 · Cited by 26

A Framework for Constrained and Adaptive Behavior-Based AgentsPreprint

Pereira, R. D. P., & Engel, P. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02312 · Cited by 26

Learning Shared Representations in Multi-task Reinforcement LearningPreprint

Borsa, D., Graepel, T., & Shawe-Taylor, J. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.02041 · Cited by 43

Hierarchical Decision Making In Electricity Grid ManagementPreprint

Dalal, G., Gilboa, E., & Mannor, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01840 · Cited by 26

Human-AI interaction in safety-critical network infrastructures

Mussi, M., Metelli, A. M., Restelli, M., Losapio, G., Bessa, R. J., Boos, D., Borst, C., Leto, G., Castagna, A., Chavarriaga, R., et al. (2025) · iScience · doi:10.1016/j.isci.2025.113400 · Cited by 33

Between MOPs and Semi-MOP: Learning, Planning & Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 74

Between MDPs and Semi-MDPs: Learning, Planning, and Representing Knowledge at Multiple Temporal Scales

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 23

Reinforcement Learning and Artificial Intelligence

Sutton, R. S. (2003)

Intra-Option Learning about Temporally Abstract Actions

Sutton, R. S., Precup, D., & Singh, S. P. (1998) · Cited by 129

Hierarchical Optimal Control of MDPs

McGovern, A., Precup, D., Ravindran, B., Singh, S. P., Sutton, S. M., & Richard, S. F. (1998) · Cited by 18