Hierarchical Reinforcement Learning: A Survey and Open Research Challenges
Open accessThe DOI matches its Crossref record; 210 of the 210 references it cites were found in a registry or an index.
Abstract
Reinforcement learning (RL) allows an agent to solve sequential decision-making problems by interacting with an environment in a trial-and-error fashion. When these environments are very complex, pure random exploration of possible solutions often fails, or is very sample inefficient, requiring an unreasonable amount of interaction with the environment. Hierarchical reinforcement learning (HRL) utilizes forms of temporal- and state-abstractions in order to tackle these challenges, while simultaneously paving the road for behavior reuse and increased interpretability of RL systems. In this survey paper we first introduce a selection of problem-specific approaches, which provided insight in how to utilize often handcrafted abstractions in specific task settings. We then introduce the Options framework, which provides a more generic approach, allowing abstractions to be discovered and learned semi-automatically. Afterwards we introduce the goal-conditional approach, which allows sub-behaviors to be embedded in a continuous space. In order to further advance the development of HRL agents, capable of simultaneously learning abstractions and how to use them, solely from interaction with complex high dimensional environments, we also identify a set of promising research directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Pretraining is a common approach to increase the stability of the policy in hierarchical reinforcement learning [24].”
From Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation (2023) · cites this paper as [24]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Research works printed but not linked: 53
- Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
- Li, Y. (2017). Deep Reinforcement Learning: An Overview. arXiv.
- Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv.
- Badia, A.P., Piot, B., Kapturowski, S., Sprechmann, P., Vitvitskyi, A., Guo, D., and Blundell, C. (2020). Agent57: Outperforming the Atari Human Benchmark. arXiv.
- OpenAI (2019). Dota 2 with Large Scale Deep Reinforcement Learning. arXiv.
- OpenAI (2019). Learning Dexterous In-Hand Manipulation. arXiv.
- Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., and Vanhoucke, V. (2018). QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation. arXiv.
- Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016). Concrete problems in AI safety. arXiv.
- Burda, Y., Edwards, H., Storkey, A., and Klimov, O. (2018). Exploration by Random Network Distillation. arXiv.
- Bellemare, M.G., Srinivasan, S., Ostrovski, G., Schaul, T., Saxton, D., and Munos, R. (2016). Unifying Count-Based Exploration and Intrinsic Motivation. arXiv.
- Nachum, O., Tang, H., Lu, X., Gu, S., Lee, H., and Levine, S. (2019). Why Does Hierarchy (Sometimes) Work So Well in Reinforcement Learning?. arXiv.
- Mott, A., Zoran, D., Chrzanowski, M., Wierstra, D., and Rezende, D.J. (2019). Towards Interpretable Reinforcement Learning Using Attention Augmented Agents. arXiv.
- Garnelo, M., Arulkumaran, K., and Shanahan, M. (2016). Towards Deep Symbolic Reinforcement Learning. arXiv.
- Houthooft, R., Chen, X., Chen, X., Duan, Y., Schulman, J., Turck, F.D., and Abbeel, P. (2016). VIME: Variational Information Maximizing Exploration. arXiv.
- Harutyunyan, A., Dabney, W., Mesnard, T., Heess, N., Azar, M.G., Piot, B., van Hasselt, H., Singh, S., Wayne, G., and Precup, D. (2019). Hindsight Credit Assignment. arXiv.
- Rummery, G.A., and Niranjan, M. (1994). On-Line Q-Learning Using Connectionist Systems, University of Cambridge, Department of Engineering.
- Donahue, J., and Simonyan, K. (2019). Large Scale Adversarial Representation Learning. arXiv.
- Radford, A., Metz, L., and Chintala, S. (2016). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv.
- van den Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). WaveNet: A Generative Model for Raw Audio. arXiv.
- Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. arXiv.
- Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
- Van Hasselt, H., Doron, Y., Strub, F., Hessel, M., Sonnerat, N., and Modayil, J. (2018). Deep Reinforcement Learning and the Deadly Triad. arXiv.
- Zhang, S., and Sutton, R.S. (2017). A Deeper Look at Experience Replay. arXiv.
- Schaul, T., Quan, J., Antonoglou, I., and Silver, D. (2016). Prioritized Experience Replay. arXiv.
- Dabney, W., Rowland, M., Bellemare, M., and Munos, R. (2018, January 2–7). Distributional Reinforcement Learning with Quantile Regression. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA. · DOI · Paper page
- Ferns, N., Panangaden, P., and Precup, D. (2004, January 9–11). Metrics for Finite Markov Decision Processes. Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence, Banff, AB, Canada.
- McGovern, A., Sutton, R.S., and Fagg, A.H. (1997, January 19–21). Roles of macro-actions in accelerating reinforcement learning. Proceedings of the Grace Hopper Celebration of Women in Computing, San Jose, CA, USA.
- Heess, N., Wayne, G., Tassa, Y., Lillicrap, T., Riedmiller, M., and Silver, D. (2016). Learning and transfer of modulated locomotor controllers. arXiv.
- Eysenbach, B., Gupta, A., Ibarz, J., and Levine, S. (2019). Diversity Is All You Need: Learning Skills without a Reward Function. arXiv.
- Abel, D., Umbanhowar, N., Khetarpal, K., Arumugam, D., Precup, D., and Littman, M.L. (2020, January 26–28). Value Preserving State-Action Abstractions. Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, Palermo, Italy.
- Fox, R., Krishnan, S., Stoica, I., and Goldberg, K. (2017). Multi-level discovery of deep options. arXiv.
- Ng, A.Y., and Russell, S.J. (July, January 29). Algorithms for Inverse Reinforcement Learning. Proceedings of the International Conference on Machine Learning, Stanford, CA, USA.
- Pan, X., Ohn-Bar, E., Rhinehart, N., Xu, Y., Shen, Y., and Kitani, K.M. (2018). Human-Interactive Subgoal Supervision for Efficient Inverse Reinforcement Learning. arXiv.
- Krishnan, S., Garg, A., Liaw, R., Miller, L., Pokorny, F.T., and Goldberg, K. (2016). Hirl: Hierarchical inverse reinforcement learning for long-horizon tasks with delayed rewards. arXiv.
- Kumar, A., Swersky, K., and Hinton, G. (2017, January 9). Feudal Learning for Large Discrete Action Spaces with Recursive Substructure. Proceedings of the NIPS Workshop Hierarchical Reinforcement Learning, Long Beach, CA, USA.
- Kulkarni, T.D., Saeedi, A., Gautam, S., and Gershman, S.J. (2016). Deep successor reinforcement learning. arXiv.
- Lakshminarayanan, A.S., Krishnamurthy, R., Kumar, P., and Ravindran, B. (2016). Option discovery in hierarchical reinforcement learning using spatio-temporal clustering. arXiv.
- Da Silva, B.C., Konidaris, G., and Barto, A.G. (July, January 26). Learning Parameterized Skills. Proceedings of the International Conference on Machine Learning, Edinburgh, Scotland.
- Wang, J.X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J.Z., Munos, R., Blundell, C., Kumaran, D., and Botvinick, M. (2017). Learning to Reinforcement Learn. arXiv.
- Duan, Y., Schulman, J., Chen, X., Bartlett, P.L., Sutskever, I., and Abbeel, P. (2016). RL$2^$: Fast Reinforcement Learning via Slow Reinforcement Learning. arXiv.
- Li, A.C., Florensa, C., Clavera, I., and Abbeel, P. (2020). Sub-Policy Adaptation for Hierarchical Reinforcement Learning. arXiv.
- Sohn, S., Woo, H., Choi, J., and Lee, H. (2020). Meta Reinforcement Learning with Autonomous Inference of Subtask Dependencies. arXiv.
- Bengio, E., Thomas, V., Pineau, J., Precup, D., and Bengio, Y. (2017). Independently Controllable Features. arXiv.
- Van Seijen, H., Fatemi, M., Romoff, J., Laroche, R., Barnes, T., and Tsang, J. (2017). Hybrid reward architecture for reinforcement learning. arXiv.
- Sukhbaatar, S., Denton, E., Szlam, A., and Fergus, R. (2018). Learning Goal Embeddings via Self-Play for Hierarchical Reinforcement Learning. arXiv.
- Gregor, K., Rezende, D.J., and Wierstra, D. (2016). Variational Intrinsic Control. arXiv.
- Achiam, J., Edwards, H., Amodei, D., and Abbeel, P. (2018). Variational option discovery algorithms. arXiv.
- Beattie, C., Leibo, J.Z., Teplyashin, D., Ward, T., Wainwright, M., Küttler, H., Lefrancq, A., Green, S., Valdés, V., and Sadik, A. (2016). Deepmind lab. arXiv.
- Vinyals, O., Ewalds, T., Bartunov, S., Georgiev, P., Vezhnevets, A.S., Yeo, M., Makhzani, A., Küttler, H., Agapiou, J., and Schrittwieser, J. (2017). Starcraft ii: A new challenge for reinforcement learning. arXiv.
- Osband, I., Doron, Y., Hessel, M., Aslanides, J., Sezener, E., Saraiva, A., McKinney, K., Lattimore, T., Szepezvari, C., and Singh, S. (2019). Behaviour Suite for Reinforcement Learning. arXiv.
- Shang, W., Trott, A., Zheng, S., Xiong, C., and Socher, R. (2019). Learning World Graphs to Accelerate Hierarchical Reinforcement Learning. arXiv.
Cited by
Items 101–151 of 151
A Novel Software Test Data Generation Framework based on Multi-level Fuzzy Clustering Algorithm
Lin, H. (2024) · International Conference on Image Processing and Capsule Networks (ICIPCN) · doi:10.1109/icipcn63822.2024.00135
MaxMI: A Maximal Mutual Information Criterion for Manipulation Concept Discovery
Zhou, P., & Yang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72897-6_6 · Cited by 6
Collision-aware cooperative multi-UAV path planning with hierarchical PPO-LSTM
Güzey, A. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12366-8
Wang, M., Ling, J., Qiao, P., Wang, Y., Xiang, Q., Zhu, R., & Hu, Z. (2025) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit65432.2025.11035993
Exploiting robot abstractions in episodic RL via reward shaping and heuristics
Cipollone, R., Favorito, M., Maiorana, F., Giacomo, G. D., Iocchi, L., & Patrizi, F. (2025) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2025.105116
Scaling up Deep Reinforcement Learning for AI Using FPGAs
Porcello, J. C. (2025) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero63441.2025.11068614
Hierarchical Deep RL for Sustainable API Throughput and Latency Optimization in Advertising Clouds
Tan, A., & Rajesh, K. (2025) · Journal of Computing and Electronic Information Management · doi:10.54097/5a4fg660
Learning with Expert Abstractions for Efficient Multi-Task Continuous ControlPreprint
Jewett, J., & Saisubramanian, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.14809
A cascading policy learning framework for enhancing power grid resilience
Bensalah, A. S., Marir, T., Yaich, R., & Chebout, M. S. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3358
Convergence and stability of Q-learning in Hierarchical Reinforcement Learning
Manenti, M., & Iannelli, A. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.135319 · Cited by 1
Reinforcement learning for real-time luminosity optimization in colliders
Mamutov, R., Baranov, G., & Gerasev, A. (2025) · Physical Review Accelerators and Beams · doi:10.1103/71jq-vbl6
Water pressure optimisation for leakage management using deep reinforcement learning
Negm, A. S. (2024) · Lancaster EPrints (Lancaster University) · doi:10.17635/lancaster/thesis/2302
Hierarchical Reinforcement Learning to control the AWAKE Electron Beamline
Rodriguez Mateos, B. (2023) · CERN Document Server (European Organization for Nuclear Research)
Heimerson, A. (2023) · Lund University Publications (Lund University) · Cited by 2
Decentralised Coordination and Communication in Multi-Agent Reinforcement Learning Systems
Minelli, G. (2023) · AMS Degree Thesis (University of Bologna)
Offline Reinforcement Learning for Community-Acquired Pneumonia Management: A Feasibility Study
Beeson, A., Couper, K., & Montana, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06118-8_18
Learning to Drive Safely with Hybrid OptionsPreprint
Cooman, B. D., & Suykens, J. A. K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.24674
Turlykozhayeva, D., Akhtanov, S., Zhexebay, D., Ussipov, N., Boranbayeva, N., & Sawicki, D. (2025) · Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments (WILGA) · doi:10.1117/12.3100258
Dhaya, R., & Radhakrishnan, K. (2026) · Artificial Intelligence and Applications · doi:10.47852/bonviewaia62026154
Pergher, K. G. R., Soldera, J., & Scharcanski, J. (2026) · IEEE Access · doi:10.1109/access.2026.3656702 · Cited by 1
Li, K., Wang, Z., Tang, X., You, H., Hu, L., Xie, H., & Chen, M. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10020052
Rani, A. J. M., R, B. S., Krishnan, N., Adilakshmi, J., Shankar, T. A. S., & Muthukrishnan, K. (2025) · Modern Electronics Devices and Intelligent Communication Systems (MEDCOM) · doi:10.1109/medcom67532.2025.11405177
A Reinforcement Learning Framework for Autonomous Behavior Tree Construction in Door Traversal Tasks
Paoamnartrit, H., Thamrongaphichartkul, K., Sakulkueakulsuk, B., & Vongbunyong, S. (2025) · International Conference on Robotics, Automation and Artificial Intelligence (RAAI) · doi:10.1109/raai67517.2025.11423416
Neuro-Symbolic Reinforcement Learning for RoboticsPreprint
Bisták, T., & Farkaš, I. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6537226
Détection distribuée d'anomalies dans les flux de données
Togbe, M. U. (2022) · theses.fr (ABES) · doi:10.70675/d95c1ebfz04f1z4211z862azec8079bbfd36
Free-Gate: Planning, Control and Policy Composition via Free Energy Gating
Rossi, F., Garrabé, É., & Russo, G. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-16955-6_20 · Cited by 1
Shi, M., Zhu, J., & Yang, X. (2026) · Ocean Engineering · doi:10.1016/j.oceaneng.2026.125480
A Tactile-Driven Hierarchical Reinforcement Learning Framework for Dexterous Robotic Manipulation
Liu, G., Li, C., Liao, R., Yu, L., Zhang, J., & Ding, N. (2026) · Informatica · doi:10.31449/inf.v50i11.13667
Du, X., Xu, P., Yu, Y., Li, H., Gao, J., Feng, Y., Wei, M., & Hu, X. (2026) · Engineering Science and Technology an International Journal · doi:10.1016/j.jestch.2026.102359
Ramadhani, N., Aritonang, D. A. E., Tania, K. D., & Rifai, A. (2026) · JATI (Jurnal Mahasiswa Teknik Informatika) · doi:10.36040/jati.v10i3.18093
A Review of Reinforcement Learning Frameworks for Adaptive and Privacy-Preserving PDAs
Biradar, A. N., Kiragi, P. S., Angadi, V., Chiranth, P., Achyuth Kasyap, P., & Sandhya, N. (2026) · International Conference Big Data and Machine Learning · doi:10.1109/icbdml68582.2026.11544832
Al-Ali, M., Inga, E., Inga, J., & Yaacoub, E. E. (2026) · Future Internet · doi:10.3390/fi18070337
A Survey on Large Language Models for Deep Reinforcement Learning
Suzuki, K., Murase, T., Sasaki, K., Hirakawa, T., Yamashita, T., & Fujiyoshi, H. (2026) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.41-4_c-p102
Three-way decision-guided hierarchical reinforcement learning for high-frequency trading
Cao, J., Zhang, X., Sun, Y., Zhou, X., & Li, H. (2026) · Information Sciences · doi:10.1016/j.ins.2026.123880
Amraouy, E. H., Lablali, O., Yahyaouy, A., Chaoui, H., Faquir, S., & Gualous, H. (2026) · Scientific African · doi:10.1016/j.sciaf.2026.e03522
Lv, C., Zhu, M., Ou, J., Sun, L., Guo, X., & Zheng, B. (2026) · Aerospace Science and Technology · doi:10.1016/j.ast.2026.113194
Hierarchical Soft Actor-Critic for Sparse-Reward Long-Horizon Reinforcement LearningPreprint
Elashaal, Z. A., Hfaiedh, A., Khraief, N., Ellabib, I. M., & Cirrincione, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.23726
A scoping review of reinforcement learning methods for long horizon robotic manipulation
Acs, M., & Zhong, X. (2026) · Discover Robotics · doi:10.1007/s44430-026-00037-1
Panda, S. P., Genest, B., & Easwaran, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37667-1_32
Let it Cook: Learning to Wait in Sequential Decision MakingPreprint
Watson, C., Krishna, A., Jayaraman, D., & Alur, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.11511
On the Creation of Artificial Intelligence
Krylov, S. S., Bulakina, M. B., & Судаков, В. А. (2026) · Herald of the Russian Academy of Sciences · doi:10.1134/s1019331626602343
Xu, Y., Lin, Y., Li, S., Gao, X., & Liu, Z. (2026) · Sustainability · doi:10.3390/su18168604
Shin, H., Ahn, J., Kim, D., Ahn, J. H., Kim, J. Y., Kim, J., & Kim, S. (2026) · Journal of Marine Science and Engineering · doi:10.3390/jmse14171569
Cheng, Q., Fu, B., Wang, Z., & Ding, Z. (2026) · Drones · doi:10.3390/drones10090664
Adaptive Successor Features for Transfer Reinforcement Learning
Aparicio, O. K. G. (2025) · OPUS - Open Publications of UTS Scholars (University of Technology Sydney)
Phungjununt, W., Srisomboon, K., Lee, W., Prayote, A., & Pipanmekaporn, L. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8100317
Modular dual-critic reinforcement learning control for AUV path tracking and collision avoidance
Jiang, X., Lv, S., & Ma, D. (2026) · Ocean Engineering · doi:10.1016/j.oceaneng.2026.128446
Comprehensive Analysis of Machine Learning Methods for Large Data Mining
Workineh, Y. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1016188
Structured goal-guided reinforcement learning with large language models
Qi, Y., Wei, W., Li, L., Zhang, L., Gao, Z., Wang, D. Z., & Song, H. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109769
Deng, H., Yang, B., Chen, X., Zhou, S., & Yao, W. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134831
Metadata
- Authors
- Hutsebaut-Buysse, M., Mets, K., & Latré, S.
- Affiliations
- University of Antwerp (BE)
- Corresponding author
- Hutsebaut-Buysse, Matthias
- Venue
- Machine Learning and Knowledge Extraction
- Publisher
- MDPI AG
- Published
- 2022-02-17
- Volume
- 4
- Issue
- 1
- Pages
- 172-221
- ISSN
- 2504-4990 (ISSN-L)
- OpenAlex
- W4212996499
- Cited by
- 129
- References
- 208
- Citations by year
- 2026: 30 · 2025: 45 · 2024: 29 · 2023: 19 · 2022: 6
- FWCI
- 8.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Machine Learning and Knowledge Extraction (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- University of Antwerp (x)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Keywords
- hierarchical reinforcement learning, abstraction, temporal abstraction, state abstraction, options framework, goal-conditioned policies, sample efficiency, exploration, interpretability, high-dimensional environments, sequential decision making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.