Teacher algorithms for curriculum learning of Deep RL in continuously parameterized environments
Open accessAbstract
We consider the problem of how a teacher algorithm can enable an unknown Deep Reinforcement Learning (DRL) student to become good at a skill over a wide range of diverse environments. To do so, we study how a teacher algorithm can learn to generate a learning curriculum, whereby it sequentially samples parameters controlling a stochastic procedural generation of environments. Because it does not initially know the capacities of its student, a key challenge for the teacher is to discover which environments are easy, difficult or unlearnable, and in what order to propose them to maximize the efficiency of learning over the learnable ones. To achieve this, this problem is transformed into a surrogate continuous bandit problem where the teacher samples environments in order to maximize absolute learning progress of its student. We present a new algorithm modeling absolute learning progress with Gaussian mixture models (ALP-GMM). We also adapt existing algorithms and provide a complete study in the context of DRL. Using parameterized variants of the BipedalWalker environment, we study their efficiency to personalize a learning curriculum for different learners (embodiments), their robustness to the ratio of learnable/unlearnable environments, and their scalability to non-linear and high-dimensional parameter spaces. Videos and code are available at https://github.com/flowersteam/teachDeepRL.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Maximum Likelihood from Incomplete Data Via the <i>EM</i> Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444 · see citing works
Multidimensional binary search trees used for associative searching
Bentley, J. L. (1975) · Communications of the ACM · doi:10.1145/361002.361007 · Cited by 7,659 · see citing works
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594 · see citing works
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 1× · see citing works
“Curriculum learning , as formulated in the supervised machine learning community, initially refers to techniques aimed at organizing labeled data to optimize the training of neural networks [11, 12, 13].”
BackgroundBozdogan, H. (1987) · Psychometrika · doi:10.1007/bf02294361 · Cited by 4,468 · see citing works
(2002) · doi:10.1137/s0097539701398375 · Cited by 2,275 · see citing works
Learning and development in neural networks: the importance of starting small
Elman, J. L. (1993) · Cognition · doi:10.1016/0010-0277(93)90058-4 · Cited by 1,988 · cited 1× · see citing works
“Curriculum learning , as formulated in the supervised machine learning community, initially refers to techniques aimed at organizing labeled data to optimize the training of neural networks [11, 12, 13].”
BackgroundTransfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,521 · see citing works
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126 · see citing works
Self-citationThe Infinite Gaussian Mixture Model
Rasmussen, C. E. (1999) · Cited by 985 · see citing works
Active learning of inverse models with intrinsically motivated goal exploration in robots
Baranès, A., & Oudeyer, P. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.05.008 · Cited by 466 · see citing works
Self-citationTeacher–Student Curriculum Learning
Matiisen, T., Oliver, A., Cohen, T., & Schulman, J. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2934906 · Cited by 351 · see citing works
Flexible shaping: How learning in small steps helps
Krueger, K. A., & Dayan, P. (2009) · Cognition · doi:10.1016/j.cognition.2008.11.014 · Cited by 221 · see citing works
The Malmo platform for artificial intelligence experimentation
Johnson, M., Hofmann, K., Hutton, T. J., & Bignell, D. E. (2016) · International Joint Conference on Artificial Intelligence · Cited by 205 · see citing works
Self-citationIntrinsically Motivated Goal Exploration Processes with Automatic Curriculum LearningPreprint
Forestier, S., Portelas, R., Mollard, Y., & Oudeyer, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02190 · Cited by 200 · see citing works
Self-citationMoulin-Frier, C., Nguyen, S., & Oudeyer, P. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01006 · Cited by 172 · see citing works
Self-citationWang, R., Lehman, J., Clune, J., & Stanley, K. O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01753 · Cited by 166 · see citing works
In search of the neural circuits of intrinsic motivation
Kaplan, F. (2007) · Frontiers in Neuroscience · doi:10.3389/neuro.01.1.1.017.2007 · Cited by 139 · see citing works
R-IAC: Robust Intrinsically Motivated Exploration and Active Learning
Baranès, A., & Oudeyer, P. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2037513 · Cited by 133 · see citing works
Self-citationAutomatic Goal Generation for Reinforcement Learning Agents
Florensa, C., Held, D., Geng, X., & Abbeel, P. (2018) · International Conference on Machine Learning · Cited by 127 · see citing works
Reinforcement Learning for Improving Agent Design
Ha, D. (2019) · Artificial Life · doi:10.1162/artl_a_00301 · Cited by 124 · see citing works
Multi-Armed Bandits for Intelligent Tutoring SystemsPreprint
Clement, B., Roy, D., Oudeyer, P., & Lopes, M. C. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.3174 · Cited by 107 · see citing works
Self-citationCURIOUS: Intrinsically Motivated Modular Multi-Goal Reinforcement LearningPreprint
Colas, C., Fournier, P., Sigaud, O., Chétouani, M., & Oudeyer, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06284 · Cited by 104 · see citing works
Self-citationBlank, D., Kumar, D., Meeden, L., et al. (2005) · Cybernetics & Systems · doi:10.1080/01969720590897107 · Cited by 64 · see citing works
Modular active curiosity-driven discovery of tool use
Forestier, S., & Oudeyer, P. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759584 · Cited by 59 · see citing works
Self-citationThe strategic student approach for life-long exploration and learning
Lopes, M. C., & Oudeyer, P. (2012) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2012.6400807 · Cited by 56 · see citing works
Self-citation
Flagged first, then by citations
1 of the 27 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- [16][16] A. Graves, M. G. Bellemare, J. Menick, R. Munos, and K. Kavukcuoglu. Automated curriculum learning for neural networks. In Proceedings of the 34th International Conference on Machine Learning-Volume 70 , pages 1311-1320. JMLR. org, 2017. -
- [24][24] P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire. The nonstochastic multiarmed bandit problem. SIAM journal on computing , 32(1):48-77, 2002. -
- [30][30] A. Laversanne-Finot, A. Pere, and P.-Y. Oudeyer. Curiosity driven exploration of learned disentangled goal spaces. In Proceedings of The 2nd Conference on Robot Learning , volume 87 of Proceedings of Machine Learning Research , pages 487-504. PMLR, 29-31 Oct 2018.
Cited by
Sorted by citations
Soviany, P., Ionescu, R. T., Rota, P., & Sebe, N. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01611-x · Cited by 486 · see citing works
Colas, C., Karch, T., Sigaud, O., & Oudeyer, P. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13554 · Cited by 101 · see citing works
Self-citationLearning with AMIGo: Adversarially Motivated Intrinsic GoalsPreprint
Campero, A., Raileanu, R., Küttler, H., Tenenbaum, J., Rocktäschel, T., & Grefenstette, E. (2020) · International Conference on Learning Representations · doi:10.48550/arxiv.2006.12122 · Cited by 150 · see citing works
Adversarial Reinforcement Learning for Procedural Content Generation
Gissl'en, L., Eakins, A., Gordillo, C., Bergdahl, J., & Tollmar, K. (2021) · 2021 IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619053 · Cited by 73 · see citing works
Reinforcement learning for control of valves
Siraskar, R. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100030 · Cited by 43 · see citing works
Learning Controllable Content Generators
Earle, S., Edwards, M., Khalifa, A., Bontrager, P., & Togelius, J. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619159 · Cited by 39 · see citing works
Curriculum-Based Augmented Fourier Domain Adaptation for Robust Medical Image Segmentation
Wang, A., Islam, M., Xu, M., & Ren, H. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3295600 · Cited by 30 · see citing works
Curriculum Reinforcement Learning Based on K-Fold Cross Validation
Lin, Z., Lai, J., Chen, X., Cao, L., & Wang, J. (2022) · Entropy · doi:10.3390/e24121787 · Cited by 25 · see citing works
Li, J., & Zhou, T. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104917 · Cited by 23 · see citing works
Human-Timescale Adaptation in an Open-Ended Task Space
Adaptive Agent Team, Bauer, J., Baumli, K., Baveja, S., Behbahani, F., Bhoopchand, A., Bradley-Schmieg, N., Chang, M., Clay, N., Collister, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.07608 · Cited by 19 · see citing works
“Our work also relates to curriculum learning (Matiisen et al., 2020; Portelas et al., 2019; Sukhbaatar et al., 2018; OpenAI et al., 2021; Campero et al., 2021; Fang et al., 2021; Mu et al., 2022), with the key difference that these methods typically have a specific downstream goal or task in mind.”
BackgroundSelf-Paced Deep Reinforcement LearningPreprint
Klink, P., D’Eramo, C., Peters, J., & Pajarinen, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.11812 · Cited by 19 · see citing works
Gupta, K., Mukherjee, D., & Najjaran, H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00934-9 · Cited by 18 · see citing works
TeachMyAgent: a Benchmark for Automatic Curriculum Learning in Deep RLPreprint
Romac, C., Portelas, R., Hofmann, K., & Oudeyer, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.09815 · Cited by 10 · see citing works
Self-citationAutomated curriculum learning for embodied agents a neuroevolutionary approach
Milano, N., & Nolfi, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-88464-5 · Cited by 10 · see citing works
Accelerate Multi-Agent Reinforcement Learning in Zero-Sum Games with Subgame Curriculum Learning
Chen, J., Xu, Z., Li, Y., Yu, C., Song, J., Yang, H., Fang, F., Wang, Y., & Wu, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29011 · Cited by 9 · see citing works
Sang, C.-Y., Huang, S.-H., Chen, C.-T., & Chang, H.-T. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.112846 · Cited by 10 · see citing works
Learning-to-Fly RL: Reinforcement Learning-based Collision Avoidance for Scalable Urban Air Mobility
Jang, K. J., Pant, Y. V., Rodionova, A., & Mangharam, R. (2020) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc50938.2020.9256710 · Cited by 8 · see citing works
Situated Dialogue Learning through Procedural Environment Generation
Ammanabrolu, P., Jia, R., & Riedl, M. O. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.557 · Cited by 9 · see citing works
On the Benefit of Optimal Transport for Curriculum Reinforcement Learning
Klink, P., D’Eramo, C., Peters, J., & Pajarinen, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3390051 · Cited by 8 · see citing works
Adaptive Procedural Task Generation for Hard-Exploration ProblemsPreprint
Fang, K., Zhu, Y., Savarese, S., & Fei-Fei, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00350 · Cited by 10 · see citing works
Solving Compositional Reinforcement Learning Problems via Task ReductionPreprint
Li, Y., Wu, Y., Xu, H., Wang, X., & Wu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07607 · Cited by 8 · see citing works
A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement LearningPreprint
Klink, P., Abdulsamad, H., Belousov, B., D’Eramo, C., Peters, J., & Pajarinen, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13176 · Cited by 9 · see citing works
Automated Play-Testing through RL Based Human-Like Play-Styles Generation
Le Pelletier de Woillemont, P., Labory, R., & Corruble, V. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v18i1.21958 · Cited by 7 · see citing works
GRIMGEP: Learning Progress for Robust Goal Sampling in Visual Deep Reinforcement Learning
Kovač, G., Laversanne-Finot, A., & Oudeyer, P. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3216911 · Cited by 12 · see citing works
Self-citationTask Phasing: Automated Curriculum Learning from Demonstrations
Bajaj, V., Sharon, G., & Stone, P. (2023) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v33i1.27235 · Cited by 6 · see citing works
General Cyclical Training of Neural Networks
Smith, L. N. (2023) · Advances in Artificial Intelligence and Machine Learning · doi:10.54364/aaiml.2023.1157 · Cited by 10 · see citing works
Hypernetworks for Zero-Shot Transfer in Reinforcement Learning
Rezaei-Shoshtari, S., Morissette, C., Hogan, F. R., Dudek, G., & Meger, D. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26146 · Cited by 6 · see citing works
Curriculum-Based Deep Reinforcement Learning for Adaptive Robotics: A Mini-Review
Gupta, K., & Najjaran, H. (2021) · International Journal of Robotic Engineering · doi:10.35840/2631-5106/4131 · Cited by 6 · see citing works
Coinbot: Intelligent Robotic Coin Bag Manipulation Using Artificial Brain
Gonnochenko, A., Semochkin, A., Egorov, D. E., Statovoy, D., Zabihifar, S., Postnikov, A., Seliverstova, E., Zaidi, A. M., Stemmler, J., & Limkrailassiri, K. (2021) · International Conference on Automation, Robotics and Applications · doi:10.1109/icara51699.2021.9376455 · Cited by 5 · see citing works
Discovering Generalizable Skills via Automated Generation of Diverse Tasks
Fang, K., Zhu, Y., Savarese, S., & Fei-Fei, L. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.010 · Cited by 6 · see citing works
Adversarial Environment Generation for Learning to Navigate the WebPreprint
Gür, İ., Jaques, N., Malta, K., Tiwari, M. K., Lee, H., & Faust, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01991 · Cited by 6 · see citing works
Video Games as a Testbed for Open-Ended Phenomena
Earle, S., Togelius, J., & Soros, L. B. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619042 · Cited by 5 · see citing works
Meta Automatic Curriculum LearningPreprint
Portelas, R., Romac, C., Hofmann, K., & Oudeyer, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08463 · Cited by 5 · see citing works
Self-citationAcar, C., Binici, K., Tekirdağ, A., & Wu, Y. J. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3336245 · Cited by 5 · see citing works
A Survey of Curriculum Learning in Deep Reinforcement Learning
Lin, S., Mi, Q., & Gao, T. (2025) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc62904.2025.10903795 · Cited by 5 · see citing works
Curriculum Learning Algorithms for Reward Weighting in Sparse Reward Robotic Manipulation Tasks
Fele, B., & Babič, J. (2025) · IEEE Access · doi:10.1109/access.2025.3549639 · Cited by 4 · see citing works
Unsupervised Task Clustering for Multi-task Reinforcement Learning
Ackermann, J., Richter, O., & Wattenhofer, R. P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86486-6_14 · Cited by 4 · see citing works
Let’s learn step by step: Enhancing in-context learning ability with curriculum learning
Liu, Y., Liu, J., Shi, X., Cheng, Q., Huang, Y., & Lu, W. (2024) · arXiv · doi:10.48550/arxiv.2402.10738 · Cited by 4 · see citing works
“Many studies have demonstrated the efficacy of curriculum learning applied in different models (Portelas et al., 2020; Nagatsuka et al., 2021) and different tasks (Wang et al., 2022; Xu et al., 2020).”
BackgroundMAESTRO: Open-Ended Environment Design for Multi-Agent Reinforcement Learning
Samvelyan, M., Khan, A., Dennis, M., Jiang, M., Parker-Holder, J., Foerster, J., Raileanu, R., & Rocktäschel, T. (2023) · arXiv · doi:10.48550/arxiv.2303.03376 · Cited by 8 · see citing works
“Several methods generate curricula by adapting the environment parameters in response to the agent’s performance (Portelas et al., 2019; Matiisen et al., 2020; Klink et al., 2019; Eimer et al., 2021).”
MethodLATS: Low resource abstractive text summarization
van Yperen, C., Frăsincar, F., & Kanfoudi, K. E. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128078 · Cited by 3 · see citing works
Fang, K., Migimatsu, T., Mandlekar, A., Fei-Fei, L., & Bohg, J. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341727 · Cited by 5 · see citing works
Unsupervised Skill Discovery for Robotic Manipulation through Automatic Task Generation
Jansonnie, P., Wu, B., Pérez, J., & Peters, J. (2024) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids58906.2024.10769879 · Cited by 3 · see citing works
Sparse Curriculum Reinforcement Learning for End-to-End Driving.Preprint
Agarwal, P., de Beaucorps, P., & de Charette, R. (2021) · arXiv (Cornell University) · Cited by 3 · see citing works
Curiosity-driven exploration: Diversity of mechanisms and functionsPreprint
Ten, A., Oudeyer, P.-Y., & Moulin-Frier, C. (2021) · doi:10.31234/osf.io/n2byt · Cited by 3 · see citing works
Self-citationGeneralization through Diversity: Improving Unsupervised Environment Design
Li, W., Varakantham, P., & Li, D. (2023) · arXiv · Cited by 3 · see citing works
Continual Driving Policy Optimization with Closed-Loop Individualized Curricula
Niu, H., Xu, Y., Jiang, X., & Hu, J. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611578 · Cited by 2 · see citing works
Trying AGAIN instead of Trying Longer: Prior Learning for Automatic Curriculum LearningPreprint
Portelas, R., Hofmann, K., & Oudeyer, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.03168 · Cited by 2 · see citing works
Self-citationGeneralization through Diversity: Improving Unsupervised Environment Design
Li, W., Varakantham, P., & Li, D. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/601 · Cited by 3 · see citing works
Bayesian curriculum generation in sparse reward reinforcement learning environments
Akgün, O., & Üre, N. K. (2025) · Engineering Science and Technology an International Journal · doi:10.1016/j.jestch.2025.102048 · Cited by 1 · see citing works
Tao, H., Jia, Z., Zhu, B., & Lin, T.-Y. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110948 · Cited by 1 · see citing works
RetractedParallel Curriculum Experience Replay in Distributed Reinforcement Learning
Yu-yu, L., & Ji, J. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/xyie2156 · Cited by 1 · see citing works
GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Grasping
Kurkcu, A., Acar, C., Campolo, D., & Tee, K. P. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636492 · Cited by 1 · see citing works
Battlesnake Challenge: A Multi-agent Reinforcement Learning Playground with Human-in-the-loopPreprint
Chung, J., Luo, A., Raffin, X., & Perry, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.10504 · Cited by 1 · see citing works
Gonnochenko, A., Semochkin, A., Egorov, D. E., Statovoy, D., Zabihifar, S., Postnikov, A., Seliverstova, E., Zaidi, A. M., Stemmler, J., & Limkrailassiri, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.01356 · Cited by 1 · see citing works
Statistical Measures For Defining Curriculum Scoring FunctionPreprint
Sadasivan, V. S., & Dasgupta, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00147 · Cited by 1 · see citing works
Goal-constrained Sparse Reinforcement Learning for End-to-End DrivingPreprint
Agarwal, P., de Beaucorps, P., & de Charette, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.09189 · Cited by 1 · see citing works
Improving Environment Novelty Quantification for Effective Unsupervised Environment Design
Teoh, J., Li, W., & Varakantham, P. (2025) · arXiv
“A particular relevant method in this space is ALP-GMM , introduced by Portelas et al. [40].”
Curriculum learning for robotic agents
Kurkcu, A. (2022) · doi:10.32657/10356/160311
Generating Scenarios from High-Level Specifications for Object Rearrangement Tasks
van Waveren, S., Pek, C., Leite, I., Tůmová, J., & Kragić, D. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341369
Curriculum Generation for Learning Guiding Functions in State-Space Search Algorithms
Pendurkar, S., Lelis, L. H. S., Sturtevant, N., et al. (2024) · Proceedings of the International Symposium on Combinatorial Search · doi:10.1609/socs.v17i1.31546
Improving Environment Novelty Quantification for Effective Unsupervised Environment Design
Teoh, J., Li, W., & Varakantham, P. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-4300
Open-Ended Learning Leads to Generally Capable Agents
Open Ended Learning Team, Stooke, A., Mahajan, A., Barros, C., Deck, C., Bauer, J., Sygnowski, J., Trebacz, M., Jaderberg, M., Mathieu, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.12808 · Cited by 56 · see citing works
Multi-task curriculum learning in a complex, visual, hard-exploration domain: Minecraft
Kanitscheider, I., Huizinga, J., Farhi, D., Guss, W. H., Houghton, B., Sampedro, R., Zhokhov, P., Baker, B., Ecoffet, A., Tang, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.14876 · Cited by 9 · see citing works
- Authors
- Portelas, R., Colas, C., Hofmann, K., & Oudeyer, P.-Y.
- Affiliations
- Microsoft Research (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1910.07224
- OpenAlex
- W2981234930
- Cited by
- 59
- References
- 27
- Citations by year
- 2025: 6 · 2024: 5 · 2023: 10 · 2022: 7 · 2021: 22 · 2020: 9
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- teacher-student learning, curriculum learning, deep reinforcement learning, procedural environment generation, Gaussian mixture model, personalized learning, high-dimensional parameter spaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
