The DOI matches its DataCite record; 53 of the 55 references it cites were found in a registry or an index.
Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learning
Open accessAbstract
Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause proficient but specialized policies to fail at test time. Given that it is impractical to train separate policies to accommodate all situations the agent may see in the real world, this work proposes to learn how to quickly and effectively adapt online to new tasks. To enable sample-efficient learning, we consider learning online adaptation in the context of model-based reinforcement learning. Our approach uses meta-learning to train a dynamics model prior such that, when combined with recent data, this prior can be rapidly adapted to the local context. Our experiments demonstrate online adaptation for continuous control tasks on both simulated and real-world agents. We first show simulated agents adapting their behavior online to novel terrains, crippled body parts, and highly-dynamic environments. We also illustrate the importance of incorporating online adaptation into autonomous agents that operate in the real world by applying our method to a real dynamic legged millirobot. We demonstrate the agent's learned ability to quickly adapt online to a missing leg, adjust to novel terrains and slopes, account for miscalibration or errors in pose estimation, and compensate for pulling payloads.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the problem settings in these papers were offline as they had two separate phases, one for learning and the other for evaluation.”
From Loss of plasticity in deep continual learning (2024) · cites this paper as [122]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Åström, K. J., & Wittenmark, B. (1989) · Cited by 5,009
MuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Self-citationHuman-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Optimization as a Model for Few-Shot Learning
Ravi, S., & Larochelle, H. (2017) · International Conference on Learning Representations · Cited by 2,766
End-to-End Training of Deep Visuomotor PoliciesPreprint
Levine, S., Finn, C., Darrell, T., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 2,641
Self-citationLearning to learn by gradient descent by gradient descent
Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., Shillingford, B., & de Freitas, N. (2016) · arXiv · doi:10.48550/arxiv.1606.04474 · Cited by 1,486
Research works printed but not linked: 6
- B. Baker, O. Gupta, N. Naik, and R. Raskar. Designing neural network architectures using reinforcement learning. arXiv preprint arXiv:1611.02167 , 2016. · arXiv
- K. Chua, R. Calandra, R. McAllister, and S. Levine. Deep reinforcement learning in a handful of trials using probabilistic dynamics models. arXiv preprint arXiv:1805.12114 , 2018. · arXiv
- M. P. Deisenroth, G. Neumann, J. Peters, et al. A survey on policy search for robotics. Foundations and Trends R © in Robotics , 2(1-2):1-142, 2013.
- Y. Duan, J. Schulman, X. Chen, P. L. Bartlett, I. Sutskever, and P. Abbeel. Rl$ˆ2$: Fast reinforcement learning via slow reinforcement learning. CoRR , abs/1611.02779, 2016. · arXiv
- C. Finn, P. Abbeel, and S. Levine. Model-agnostic meta-learning for fast adaptation of deep networks. CoRR , abs/1703.03400, 2017. · arXiv
- T. Munkhdalai and H. Yu. Meta networks. arXiv preprint arXiv:1703.00837 , 2017. · arXiv
Cited by
Sorted by citations
Items 101–200 of 371
Shin, J.-U., Hakobyan, A., Park, M., Kim, Y., Kim, G., & Yang, I. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3191234 · Cited by 21
Learning Robotic Manipulation of Natural Materials With Variable Properties for Construction Tasks
Kalousdian, N. K., Łochnicki, G., Hartmann, V. N., Leder, S., Oguz, O. S., Menges, A., & Toussaint, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3159288 · Cited by 20
Rao, N., Xu, H., Qi, Z., Wang, D., & Zhang, Y. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3418944 · Cited by 21
Human-Timescale Adaptation in an Open-Ended Task Space
Adaptive Agent Team, Bauer, J., Baumli, K., Baveja, S., Behbahani, F., Bhoopchand, A., Bradley-Schmieg, N., Chang, M., Clay, N., Collister, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.07608 · Cited by 19
“Adaptation also plays a critical role in robotics, with agents trained to adapt to varying terrain (Clavera et al., 2019; Kumar et al., 2021) or damaged joints (Cully et al.”
BackgroundWang, Z., Chen, C., & Dong, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3160173 · Cited by 21
Experience-Embedded Visual ForesightPreprint
Lin, Y.-C., Bauzá, M., & Isola, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.05071 · Cited by 22
Trajectory-wise Multiple Choice Learning for Dynamics Generalization in Reinforcement Learning
Seo, Y., Lee, K., Clavera, I., Kurutach, T., Shin, J., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2010.13303 · Cited by 20
Self-citationTRANS-AM: Transfer Learning by Aggregating Dynamics Models for Soft Robotic Assembly
Tanaka, K., Yonetani, R., Hamaya, M., Lee, R., von Drigalski, F., & Ijiri, Y. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561081 · Cited by 18
Zhang, S., Wen, L., Peng, H., & Tseng, H. E. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564972 · Cited by 18
Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian ProcessesPreprint
Xu, M., Ding, W., Zhu, J., Liu, Z., Chen, B., & Zhao, D. X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11441 · Cited by 18
Dynamics Generalization via Information Bottleneck in Deep Reinforcement LearningPreprint
Lu, X., Lee, K., Abbeel, P., & Tiomkin, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.00614 · Cited by 18
Self-citationDetecting and adapting to crisis pattern with context based Deep Reinforcement Learning
Benhamou, E., Saltiel, D., Ohana, J., & Jamal Atif, C. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412958 · Cited by 17
Meta-Learning for Fast Adaptive Locomotion with Uncertainties in Environments and Robot Dynamics
Anne, T., Wilkinson, J., & Li, Z. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635840 · Cited by 18
Training a Resilient Q-network against Observational Interference
Yang, C.-H. H., Hung, I.-T. D., Ouyang, Y., & Chen, P. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20862 · Cited by 34
Tang, Z. Q., Wang, P., Xin, W., Xie, Z., Kan, L., Muralidharan, M., & Laschi, C. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160513 · Cited by 19
Context-Based Meta-Reinforcement Learning With Bayesian Nonparametric Models
Bing, Z., Yun, Y., Huang, K., & Knoll, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3386780 · Cited by 17
Transfer Reinforcement Learning Across Homotopy Classes
Cao, Z., Kwon, M., & Sadigh, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3057050 · Cited by 17
Lifelong Robotic Reinforcement Learning by Retaining ExperiencesPreprint
Xie, A., & Finn, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.09180 · Cited by 25
Self-citationRange-Aware Impact Angle Guidance Law With Deep Reinforcement Meta-Learning
Chen, L., Wang, W., Liu, Z., Lai, C., & Wang, S. (2020) · IEEE Access · doi:10.1109/access.2020.3017480 · Cited by 16
Focused Adaptation of Dynamics Models for Deformable Object Manipulation
Mitrano, P. P., LaGrassa, A., Kroemer, O., & Berenson, D. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161366 · Cited by 16
Meta Reinforcement Learning of Locomotion Policy for Quadruped Robots With Motor Stuck
Chen, C., Li, C., Lu, H., Wang, Y., & Xiong, R. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3424328 · Cited by 16
Barekatain, M., Yonetani, R., & Hamaya, M. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/430 · Cited by 17
Revisiting Meta-Learning as Supervised LearningPreprint
Chao, W., Ye, H.-J., Zhan, D., Campbell, M., & Weinberger, K. Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00573 · Cited by 18
Mendonca, R., Geng, X., Finn, C., & Levine, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07178 · Cited by 36
Self-citationMeta-Reinforcement Learning With Dynamic Adaptiveness Distillation
Hu, H., Huang, G. M., Li, X., & Song, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105407 · Cited by 16
Meta-Active Learning in Probabilistically Safe Optimization
Schrum, M., Connolly, M. J., Cole, E. R., Ghetiya, M., Gross, R. E., & Gombolay, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3193497 · Cited by 15
Data-Driven Strategies for Hierarchical Predictive Control in Unknown Environments
Vallon, C., & Borrelli, F. (2022) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2021.3137769 · Cited by 15
Some New Trends of Deep Learning Research
Meng, D., & Sun, L. (2019) · Chinese Journal of Electronics · doi:10.1049/cje.2019.07.011 · Cited by 15
Lifelong Policy Gradient Learning of Factored Policies for Faster Training Without ForgettingPreprint
Mendez, J. A., Wang, B., & Eaton, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07011 · Cited by 15
Model-based Reinforcement Learning for Decentralized Multiagent RendezvousPreprint
Wang, R., Kew, J. C., Lee, D. M., Lee, T.-W. E., Zhang, T., Ichter, B., Tan, J., & Faust, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06906 · Cited by 15
Deep Learning for Embodied Vision Navigation: A SurveyPreprint
Zhu, F., Zhu, Y., Lee, V. C., Liang, X., & Chang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04097 · Cited by 30
Meta-Reinforcement Learning Based on Self-Supervised Task Representation Learning
Wang, M., Bing, Z., Yao, X., Wang, S., Huang, K., Su, H., Yang, C., & Knoll, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26210 · Cited by 16
Graph Convolutional Network Based Multi-Objective Meta-Deep Q-Learning for Eco-Routing
Ma, X., Xie, Y., & Chigan, C. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3348034 · Cited by 14
Lee, J., Kim, S., Kim, S.-J., Jo, W., Han, D., Lee, J., & Yoo, H. (2021) · Symposium on VLSI Circuits · doi:10.23919/vlsicircuits52068.2021.9492504 · Cited by 14
Watch, Try, Learn: Meta-Learning from Demonstrations and RewardPreprint
Zhou, A., Jang, E., Kappler, D., Herzog, A., Khansari, M., Wohlhart, P., Bai, Y., Kalakrishnan, M., Levine, S., & Finn, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03352 · Cited by 31
Self-citationModelLight: Model-Based Meta-Reinforcement Learning for Traffic Signal ControlPreprint
Huang, X., Wu, D., Jenkin, M. R. M., & Boulet, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08067 · Cited by 14
Deep Reinforcement Learning: Emerging Trends in Macroeconomics and Future Prospects
Atashbar, T., & Shi, R. A. (2022) · IMF Working Paper · doi:10.5089/9798400224713.001 · Cited by 13
Towards Retrieval-Based Neural Code Summarization: A Meta-Learning Approach
Zhou, Z., Yu, H., Fan, G., Huang, Z., & Yang, K. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3238161 · Cited by 15
A Survey of Algorithmic Methods for Competency Self-Assessments in Human-Autonomy Teaming
Conlon, N., Ahmed, N. R., & Szafir, D. J. (2023) · ACM Computing Surveys · doi:10.1145/3616010 · Cited by 13
Meta-reinforcement learning-based collision avoidance for autonomous ship
Jia, X., Gao, S., & He, W. (2025) · Ocean Engineering · doi:10.1016/j.oceaneng.2025.122064 · Cited by 13
Deep Meta-Learning Energy-Aware Path Planner for Unmanned Ground Vehicles in Unknown Terrains
Visca, M., Powell, R. S., Gao, Y., & Fallah, S. (2022) · IEEE Access · doi:10.1109/access.2022.3155161 · Cited by 14
Intelligent TCP Congestion Control Scheme in Internet of Deep Space Things Communication
Masood, A., Ha, T., Lakew, D. S., Dao, N., & Cho, S. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3212534 · Cited by 13
Provably Convergent Policy Gradient Methods for Model-Agnostic Meta-Reinforcement LearningPreprint
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv (Cornell University) · Cited by 13
Continual Backprop: Stochastic Gradient Descent with Persistent RandomnessPreprint
Dohare, S., Sutton, R. S., & Mahmood, A. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06325 · Cited by 88
MAGIC VFM -Meta-Learning Adaptation for Ground Interaction Control With Visual Foundation Models
Lupu, E. S., Xie, F., Preiss, J. A., Alindogan, J., Anderson, M., & Chung, S. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3475212 · Cited by 12
Meta-Learning Enhanced Model Predictive Contouring Control for Agile and Precise Quadrotor Flight
Wei, M., Zheng, L., Wu, Y. J., Mei, R., & Cheng, H. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3567491 · Cited by 12
Meta-SE: A Meta-Learning Framework for Few-Shot Speech Enhancement
Zhou, W., Lu, M., & Ji, R. (2021) · IEEE Access · doi:10.1109/access.2021.3066609 · Cited by 12
PSTO: Learning Energy-Efficient Locomotion for Quadruped Robots
Zhu, W., & Rosendo, A. (2022) · Machines · doi:10.3390/machines10030185 · Cited by 12
METAVerse: Meta-Learning Traversability Cost Map for Off-Road Navigation
Seo, J., Kim, T., Ahn, S., & Kwak, K. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802444 · Cited by 17
Watch, Try, Learn: Meta-Learning from Demonstrations and RewardsPreprint
Zhou, A., Jang, E., Kappler, D., Herzog, A., Khansari, M., Wohlhart, P., Bai, Y., Kalakrishnan, M., Levine, S., & Finn, C. (2020) · arXiv (Cornell University) · Cited by 12
Self-citationCausal Inference Q-Network: Toward Resilient Reinforcement LearningPreprint
Yang, C.-H. H., Hung, I.-T. D., Ouyang, Y., & Chen, P. (2021) · arXiv (Cornell University) · Cited by 12
Robust Domain Randomised Reinforcement Learning through Peer-to-Peer Distillation
Zhao, C., & Hospedales, T. (2020) · arXiv · doi:10.48550/arxiv.2012.04839 · Cited by 11
Bi, C., Liu, D., Zhu, L., Lu, C., Li, S., & Tang, Y. (2024) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2024.110376 · Cited by 12
Multi-Vehicle Mixed Reality Reinforcement Learning for Autonomous Multi-Lane Driving
Mitchell, R., Fletcher, J., Panerati, J., & Prorok, A. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/lqgx1131 · Cited by 11
Online Policies for Real-Time Control Using MRAC-RL
Guha, A., & Annaswamy, A. M. (2021) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc45484.2021.9683641 · Cited by 15
Chen, X., He, B., Yu, Y., Li, Q., Qin, Z. T., Shang, W., Ye, J., & Ma, C. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00260 · Cited by 14
Meta Reinforcement Learning with Generative Adversarial Reward from Expert Knowledge
Wang, D., Ding, B., & Feng, D. (2020) · IEEE International Conference on Information Systems and Computer Aided Education (ICISCAE) · doi:10.1109/iciscae51034.2020.9236869 · Cited by 11
Velocity Regulation for Automatic Train Operation via Meta-Reinforcement Learning
Zhao, F., You, K., Fan, Y., & Yan, G. (2020) · Chinese Control Conference (CCC) · doi:10.23919/ccc50068.2020.9188581 · Cited by 11
Meta Learning MPC using Finite-Dimensional Gaussian Process ApproximationsPreprint
Arcari, E., Carron, A., & Zeilinger, M. N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05984 · Cited by 11
Ball, P. J., Lu, C., Parker-Holder, J., & Roberts, S. (2021) · arXiv · doi:10.48550/arxiv.2104.05632 · Cited by 11
Cloud-Edge Training Architecture for Sim-to-Real Deep Reinforcement Learning
Cao, H., Theile, M., Wyrwal, F. G., & Caccamo, M. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981565 · Cited by 10
Alegre, L. N., Bazzan, A. L. C., & da Silva, B. C. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/tqzj5060 · Cited by 10
First Do Not Fall: Learning to Exploit a Wall With a Damaged Humanoid Robot
Anne, T., Dalin, E., Bergonzani, I., Ivaldi, S., & Mouret, J.-B. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3188884 · Cited by 10
Contrastive Knowledge-Augmented Meta-Learning for Few-Shot Classification
Subramanyam, R., Heimann, M., Jayram, T. S., Anirudh, R., & Thiagarajan, J. J. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00251 · Cited by 10
Dynamic OHT Routing Using Travel Time Approximation Based on Deep Neural Network
Choi, J., Yu, T., & Choi, D. G. (2024) · IEEE Access · doi:10.1109/access.2024.3351225 · Cited by 10
Fast Adaptation to New Environments via Policy-Dynamics Value Functions
Răileanu, R., Goldstein, M. A., & Szlam, A. D. (2020) · International Conference on Machine Learning · Cited by 10
Complementary Meta-Reinforcement Learning for Fault-Adaptive Control
Ahmed, I. H., Quiñones-Grueiro, M., & Biswas, G. (2020) · Annual Conference of the PHM Society · doi:10.36001/phmconf.2020.v12i1.1289 · Cited by 10
Few-Shot Model-Based Adaptation in Noisy Conditions
Arndt, K., Ghadirzadeh, A., Hazara, M., & Kyrki, V. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068104 · Cited by 10
Regularizing Model-Based Planning with Energy-Based ModelsPreprint
Boney, R., Kannala, J., & Ilin, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.05527 · Cited by 12
Imagined Value Gradients: Model-Based Policy Optimization with Transferable Latent Dynamics ModelsPreprint
Byravan, A., Springenberg, J. T., Abdolmaleki, A., Hafner, R., Neunert, M., Lampe, T., Siegel, N., Heess, N., & Riedmiller, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04142 · Cited by 10
Adaptive Meta-Learning for Identification of Rover-Terrain DynamicsPreprint
Banerjee, S., Harrison, J., Furlong, P. M., & Pavone, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10191 · Cited by 12
MRAC-RL: A Framework for On-Line Policy Adaptation Under Parametric Model UncertaintyPreprint
Guha, A., & Annaswamy, A. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.10562 · Cited by 10
GST: Group-Sparse Training for Accelerating Deep Reinforcement LearningPreprint
Lee, J., Kim, S., Kim, S.-J., Jo, W., & Yoo, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09650 · Cited by 9
Data-Efficient Task Generalization via Probabilistic Model-Based Meta Reinforcement Learning
Bhardwaj, A., Rothfuss, J., Sukhija, B., As, Y., Hutter, M., Coros, S., & Krause, A. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3371260 · Cited by 9
Simultaneous System Identification and Model Predictive Control With No Dynamic Regret
Zhou, H., & Tzoumas, V. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3576969 · Cited by 9
Sim-to-Real Transfer of Deep Reinforcement Learning Agents for Online Coverage Path Planning
Jonnarth, A., Johansson, O., Zhao, J. W., & Felsberg, M. (2025) · IEEE Access · doi:10.1109/access.2025.3581035 · Cited by 9
Safe and Efficient Exploration of Human Models During Human-Robot Interaction
Pandya, R., & Liu, C. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981085 · Cited by 9
Li, R., Huang, C. Z., Qin, X., Jiang, S., Ma, N., & Cui, S. R. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3295183 · Cited by 9
Xiao, W., He, T., Dolan, J. M., & Shi, G. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611340 · Cited by 13
MPR-RL: Multi-Prior Regularized Reinforcement Learning for Knowledge Transfer
Yang, Q., Stork, J. A., & Stoyanov, T. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3184805 · Cited by 9
Kamienny, P.-A., Pirotta, M., Lazaric, A., Lavril, T., Usunier, N., & Denoyer, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02934 · Cited by 10
An enjoyable involvement: A qualitative study of short-term study abroad for nursing students
Hsiao, P.-R., Lin, C., Han, C.-Y. S., Wang, L., & Chen, L. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249629 · Cited by 8
Meta-Learning-Based Proactive Online Planning for UAVs Under Degraded Conditions
Yel, E., Gao, S., & Bezzo, N. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3191792 · Cited by 8
Jia, H., Zhao, Y. B., Zhai, Y., Ding, B., Wang, H., & Wu, Q. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3196782 · Cited by 8
Ada-VSR: Adaptive Video Super-Resolution with Meta-Learning
Gupta, A., Jonnalagedda, P., Bhanu, B., & Roy–Chowdhury, A. K. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475320 · Cited by 8
Adaptive Adversarial Training for Meta Reinforcement Learning
Chen, S., Chen, Z., & Wang, D. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534316 · Cited by 8
Meta Reinforcement Learning Based Underwater Manipulator Control
Moon, J., Bae, S.-H., & Cashmore, M. (2021) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.23919/iccas52745.2021.9650009 · Cited by 8
Energy Consumption Minimization of Quadruped Robot Based on Reinforcement Learning of DDPG Algorithm
Yan, Z., Ji, H., & Chang, Q. (2024) · Actuators · doi:10.3390/act13010018 · Cited by 8
Fast Adaptation via Policy-Dynamics Value FunctionsPreprint
Răileanu, R., Goldstein, M., Szlam, A. D., & Fergus, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02879 · Cited by 13
Decoupling Exploration and Exploitation for Meta-Reinforcement Learning without SacrificesPreprint
Liu, E. Z., Raghunathan, A., Liang, P., & Finn, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.02790 · Cited by 21
Self-citationOn the Convergence Theory of Debiased Model-Agnostic Meta-Reinforcement LearningPreprint
Fallah, A., Georgiev, K., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05135 · Cited by 8
Lee, J., Kim, S., Kim, S., Jo, W., Kim, J.-H., Han, D., & Yoo, H. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3138520 · Cited by 8
Online Meta Adaptation for Variable-Rate Learned Image Compression
Jiang, W., Wang, W., Li, S., & Liu, S. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00065 · Cited by 7
Self-citationEvolving gaits for damage control in a hexapod robot
Mailer, C., Nitschke, G., & Raw, L. (2021) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3449639.3459271 · Cited by 8
Fault-Aware Robust Control via Adversarial Reinforcement Learning
Yang, F., Yang, C., Guo, D., Liu, H., & Sun, F. (2021) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber53097.2021.9588329 · Cited by 10
Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks
Guo, Y., Wu, Q., & Lee, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20635 · Cited by 7
Learning State-Dependent Losses for Inverse Dynamics Learning
Morse, K., Das, N., Lin, Y., Wang, A. S., Rai, A., & Meier, F. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341701 · Cited by 7
A Model-based Approach for Sample-efficient Multi-task Reinforcement LearningPreprint
Landolfi, N. C., Thomas, G., & Ma, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04964 · Cited by 7
When Is Generalizable Reinforcement Learning Tractable?Preprint
Malik, D., Li, Y., & Ravikumar, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00300 · Cited by 8
Learning Not to Learn: Nature versus Nurture in Silico
Lange, R. T., & Sprekeler, H. (2020) · arXiv · doi:10.48550/arxiv.2010.04466 · Cited by 6
Metadata
- Authors
- Nagabandi, A., Clavera, I., Liu, S., Fearing, R. S., Abbeel, P., Levine, S., & Finn, C.
- Affiliations
- University of California, Berkeley (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1803.11347
- OpenAlex
- W2903630557
- Cited by
- 370
- References
- 55
- Citations by year
- 2026: 3 · 2025: 25 · 2024: 47 · 2023: 46 · 2022: 61 · 2021: 100 · 2020: 65 · 2019: 18 · 2018: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Locomotion and Control
- Keywords
- meta-reinforcement learning, online adaptation, model-based reinforcement learning, meta-learning, dynamics model, sample efficiency, continuous control, legged robots, millirobots, terrain adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
