The DOI matches its Crossref record; 184 of the 193 references it cites were found in a registry or an index.
How to train your robot with deep reinforcement learning: lessons we have learned
Open accessAbstract
Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low-level sensor observations. Although a large portion of deep RL research has focused on applications in video games and simulated control, which does not connect with the constraints of learning in real environments, deep RL has also demonstrated promise in enabling physical robots to learn complex skills in the real world. At the same time, real-world robotics provides an appealing domain for evaluating such algorithms, as it connects directly to how humans learn: as an embodied agent in the real world. Learning to perceive and move in the real world presents numerous challenges, some of which are easier to address than others, and some of which are often not considered in RL research that focuses only on simulated domains. In this review article, we present a number of case studies involving robotic deep RL. Building off of these case studies, we discuss commonly perceived challenges in deep RL and how they have been addressed in these works. We also provide an overview of other outstanding challenges, many of which are unique to the real-world robotics setting and are not often the focus of mainstream RL research. Our goal is to provide a resource both for roboticists and machine learning researchers who are interested in furthering the progress of deep RL in the real world.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“POMDPs more accurately describe real-world applications of robotic systems [7] and are a major tool for training modern DRL and DIL end-to-end policy controllers.”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, DRL is data-hungry and trained through trial and error which requires human involvement for constantly resetting the environment and preventing unsafe actions [7].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“(4) high-dimensional/continuous state settings exacerbate the challenge of exploration and further affect data efficiency.”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We can also utilise demonstration data to further reduce the distribution shift, as it causes the model to learn the important part of the state space [7].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In recent years, data-driven approaches with deep learning (DL) [6], such as deep reinforcement learning (DRL) [7] and deep imitation learning (DIL) [8], have demonstrated many advantages in performing task-level and skill-level control problems (Section 3.3).”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“(3) DRL algorithms often come with a set of hyper-parameters, and the algorithms are often sensitive to these hyper-parameters and the application domain”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“(2) data efficiency (both sampling and learning efficiency) is a major concern for such complex settings”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“MBRL is generally more data-efficient than MFRL algorithms and it generalises better with large and diverse data [7].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“(1) theoretically, we have no guarantee of convergence of the DRL algorithms”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 16,043
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
(2017) · Cited by 11,625
Research works printed but not linked: 61
- Achiam J, 2017, International Conference on Machine Learning
- Agarwal R, 2020, International Conference on Machine Learning
- Andrychowicz M, 2017, Advances in Neural Information Processing Systems, 5048
- Burda Y, 2019, International Conference on Learning Representations
- Cabi S, 2019, arXiv preprint arXiv:1909.12200 · arXiv
- Chebotar Y, 2017, International Conference on Machine Learning, 703
- Chen Z, 2018, International Conference on Machine Learning
- Clavera I, 2019, International Conference on Learning Representations
- Deisenroth M, 2011, International Conference on Machine Learning, 465
- Deisenroth MP, 2013, Foundations and Trends in Robotics, 2, 1
- Devlin J, 2019, NAACL-HLT
- Duan Y, 2017, Advances in Neural Information Processing Systems, 1087
- Eysenbach B, 2018, International Conference on Learning Representations
- Finn C, 2017, International Conference on Machine Learning
- Finn C, 2016, International Conference on Machine Learning, 49
- Finn C, 2017, Proceedings of Machine Learning Research, 78, 357
- Fox R, 2016, Conference on Uncertainty in Artificial Intelligence
- Fu J, 2017, Advances in Neural Information Processing Systems, 2577
- Fujimoto S, 2019, International Conference on Machine Learning
- Fujimoto S, 2018, International Conference on Machine Learning
- Garofolo JS, 1993, NASA STI/Recon Technical Report, 93
- Goodfellow I, 2014, Advances in Neural Information Processing Systems, 2672
- Gregor K, 2017, International Conference on Learning Representations, Workshop Track Proceedings
- Gu S, 2016, International Conference on Machine Learning, 2829
- Haarnoja T, 2017, International Conference on Machine Learning, 1352
- Haarnoja T, 2018, International Conference on Machine Learning
- Hausman K, 2017, AAAI Symposium on Interactive Multi-Sensory Object Perception for Embodied Agents
- Iscen A, 2018, Conference on Robot Learning
- Jabri A, 2019, Advances in Neural Information Processing Systems, 10519
- James S, 2018, Conference on Robot Learning
- James S, 2017, Conference on Robot Learning
- Kalashnikov D, 2018, Conference on Robot Learning, Proceedings of Machine Learning Research
- Khadka S, 2019, International Conference on Machine Learning
- Kroemer O, 2019, CoRR abs/1907.03146 · arXiv
- Kumar A, 2019, Advances in Neural Information Processing Systems, 32
- Kurutach T, 2018, International Conference on Learning Representations
- Levine S, 2014, Advances in Neural Information Processing Systems, 1071
- Levine S, 2016, The Journal of Machine Learning Research, 17, 1334
- Levine S, 2013, International Conference on Machine Learning
- Mania H, 2018, Advances in Neural Information Processing Systems
- Montgomery WH, 2016, Advances in Neural Information Processing Systems, 4008
- Nagabandi A, 2020, Conference on Robot Learning
- Osband I, 2016, Advances in Neural Information Processing Systems, 4026
- Parisotto E, 2016, CoRR
- Paszke A, 2017, Advances in Neural Information Processing Systems Workshop on Autodiff
- Pinto L, 2017, International Conference on Machine Learning
- Rakelly K, 2019, International Conference on Machine Learning
- Riedmiller M, 2018, International Conference on Machine Learning
- Schaul T, 2019, Multidisciplinary Conference on Reinforcement Learning and Decision Making
- Schoettler G, 2019, International Conference on Intelligent Robots and Systems
- Schulman J, 2015, International Conference on Machine Learning
- Sener O, 2018, Advances in Neural Information Processing Systems, 527
- Tedrake R, 2015, Workshop on Adaptive and Learning Systems
- Viereck U, 2017, Conference on Robot Learning
- Wu YH, 2019, International Conference on Machine Learning, Proceedings of Machine Learning Research
- Xiao T, 2020, International Conference on Learning Representations
- Xie A, 2019, arXiv preprint arXiv:1904.05538 · arXiv
- Xie A, 2018, Proceedings of Machine Learning Research, 87, 40
- Yang Y, 2019, AAMAS
- Yang Y, 2020, Conference on Robot Learning
- Yen-Chen L, 2020, Conference on Robot Learning
Cited by
Sorted by citations
Items 401–500 of 569
Xia, W., Lu, Y., & Xu, X. W. (2023) · International Conference on Mechatronics and Machine Vision in Practice (M2VIP) · doi:10.1109/m2vip58386.2023.10413400 · Cited by 1
AI Adoption in Islamic Tourism Stakeholders’ Business Orientation
Abas, R., Radzi, S. M., & Zahari, M. S. M. (2024) · International Journal of Business and Technology Management · doi:10.55057/ijbtm.2024.6.1.1 · Cited by 1
Reinforcement learning and autonomous driving: Comparison between DQN and PPO
Ma, D. (2024) · AIP conference proceedings · doi:10.1063/5.0215570 · Cited by 1
Efficient Reinforcement Learning via Decoupling Exploration and Utilization
Yang, J., Wang, H., Zhao, Q., Shi, Z., Song, Z., & Fang, M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5581-3_32 · Cited by 2
Unknown Object Retrieval in Confined Space through Reinforcement Learning with Tactile Exploration
Zhao, X., Liang, W., Zhang, X., Chew, C., & Wu, Y. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611541 · Cited by 1
Compositional Servoing by Recombining Demonstrations
Argus, M. J., Nayak, A., Büchner, M., Galesso, S., Valada, A., & Brox, T. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10609978 · Cited by 1
Application of Autonomous Control for Quadruped Robots Based on Deep Reinforcement Learning
Qi, Y., Yu, B., Xu, S., & Yang, X. (2024) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce62493.2024.10653022 · Cited by 1
Paola, V. D., Calcagno, G., Metelli, A. M., & Restelli, M. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650627 · Cited by 3
Show Me Once: A Transformer-Based Approach for an Assisted-Driving System
Pacini, F., Dini, P., & Fanucci, L. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6030103 · Cited by 1
Simulation-Aided Policy Tuning for Black-Box Robot Learning
He, S., von Rohr, A., Baumann, D., Ji, X., & Trimpe, S. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3539192 · Cited by 1
APriCoT: Action Primitives based on Contact-state Transition for In-Hand Tool Manipulation
Saito, D., Kanehira, A., Sasabuchi, K., Wake, N., Takamatsu, J., Koike, H., & Ikeuchi, K. (2024) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids58906.2024.10769968 · Cited by 1
Yang, L. (2024) · International Conference on Computing, Robotics and System Sciences (ICRSS) · doi:10.1109/icrss65752.2024.00022 · Cited by 1
Exploring Robot Trajectories in Panoramic Vision-Based Control Using Deep Reinforcement Learning
Soualhi, T., Crombez, N., Ruichek, Y., Lombard, A., & Galland, S. (2025) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii59315.2025.10870926 · Cited by 1
Supervised Learning for Stochastic Optimal Control
Kurtz, V., & Burdick, J. W. (2024) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc56724.2024.10885802 · Cited by 1
LFE: Hierarchical Compliance Control for PiH Assembly
Xu, J. L., Su, H., Chen, R., & Hou, Z. (2025) · Research on intelligent manufacturing · doi:10.1007/978-981-96-2657-1_10 · Cited by 1
VR table tennis techniques learning for humanoid robot via AMP-Former
Wang, J., Lu, X., Li, H., Huang, X., & Xia, J. (2025) · The Visual Computer · doi:10.1007/s00371-025-04119-w · Cited by 2
Ethically Aligned Design in Autonomous and Intelligent Systems: An Overview
Burnside, A., & Bodde, E. R. (2025) · IEEE International Symposium on Ethics in Engineering, Science, and Technology (ETHICS) · doi:10.1109/ethics65148.2025.11098316 · Cited by 1
Optimal Gait Control for a Tendon-Driven Soft Quadruped Robot by Model-Based Reinforcement Learning
Niu, X., Tan, K., Broo, D. G., & Feng, L. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128611 · Cited by 1
Physical State Exploration for Reinforcement Learning from Scratch
Pinosky, A., Berrueta, T. A., Li, O., & Murphey, T. D. (2025) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case58245.2025.11164095 · Cited by 1
Learning Control with Soft Robots: Application for Industrial Assembly
Hamaya, M., Tanaka, K., von Drigalski, F., & Ijiri, Y. (2021) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.39.609 · Cited by 1
A study of inverse reinforcement learning and its implementation
Zhang, C., Jing, G., Zuo, S., & Dong, Z. (2023) · International Symposium on Computer Engineering and Intelligent Communications (ISCEIC) · doi:10.1117/12.2661162 · Cited by 1
Decoding Reinforcement Learning for newcomers
Neves, F. S. P., Andrade, G. A., dos Reis, M. F., Aguiar, A. P., & Pinto, A. M. (2023) · IEEE Access · doi:10.1109/access.2023.3279729 · Cited by 1
Chen, G., & Huang, V. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/391 · Cited by 1
Fidelity of Robotic Chemical Operations of Homogenous and Heterogeneous ReactionsPreprint
Wang, G., Xin, B., Wang, G., Zhang, Y., Lu, Y., Guo, L., Li, S., Chen, C., Cheng, X., & Ma, J. (2021) · ChemRxiv · doi:10.26434/chemrxiv-2021-dd9zr · Cited by 1
Nguyen, H., Cruz, F., & Dazeley, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08003 · Cited by 1
Kadi, H. A., & Terzić, K. (2022) · Preprints.org · doi:10.20944/preprints202212.0305.v1 · Cited by 1
Survey on Multimodal Transformers for RobotsPreprint
Miyazawa, K., & Nagai, T. (2023) · doi:10.36227/techrxiv.21993317.v1 · Cited by 2
Experimental Study on the Effect of Multi-Step Deep Reinforcement Learning in PomdpsPreprint
Meng, L., Gorbet, R., Burke, M., & Kulić, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5201725 · Cited by 1
Thawani, P. V., Ajmre, P. E., Chaurasia, S. A., & Ponnusamy, S. (2025) · doi:10.1002/9781394272624.ch19 · Cited by 1
Imitation Learning via Simultaneous Optimization of Policies and Auxiliary TrajectoriesPreprint
Xie, M., Li, A., Wyk, K. V., Dellaert, F., Boots, B., & Ratliff, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03019
Koopman Spectrum Nonlinear Regulators and Efficient Online LearningPreprint
Ohnishi, M., Ishikawa, I., Lowrey, K., Ikeda, M., Kakade, S. M., & Kawahara, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15775
Generative Imitation Learning using Forward and Inverse Reinforcement Learning
Uchibe, E. (2021) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.39.617
EdgeRL: A Light-Weight C/C++ Framework for On-Device Reinforcement Learning
Park, S.-S., Kim, D., Kang, J.-G., & Chung, K. (2021) · International SoC Design Conference · doi:10.1109/isocc53507.2021.9613916
Non-homogeneous Multi-robot Collaboration for Environment Mapping and Inference
Hensley, C., Patel, P. G., Koduru, C., & Tanveer, M. H. (2021) · International Conference on Robotics, Control and Automation Engineering (RCAE) · doi:10.1109/rcae53607.2021.9638810
Controlling Agents by Constrained Policy Updates
Farsang, M., & Szegletes, L. (2021) · SYSTEM THEORY CONTROL AND COMPUTING JOURNAL · doi:10.52846/stccj.2021.1.2.24
Nazir, A., Xu, P., Rojas, J., & Seo, J. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811554 · Cited by 1
Bridging the Reality Gap via Progressive Bayesian Optimisation
Chen, Y., & Rosendo, A. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-15226-9_17
Improving animal behaviors through a neural interface with deep reinforcement learningPreprint
Li, C., Kreiman, G., & Ramanathan, S. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.19.508590
Souza, J. M. B. D., Rêgo, P. H. M., Sousa, G. B. D., & Lima, J. V. R. (2022) · Revista de Informática Teórica e Aplicada · doi:10.22456/2175-2745.121388
Collision-Free Path Planning of Manipulator Based on Safety Reinforcement Learning
许, 银. (2023) · Computer Science and Application · doi:10.12677/csa.2023.131011
Particle Swarm Based Reinforcement Learning
Duan, J., Guo, Y., Wang, Z., & Ke, L. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-9297-1_3
Virtual Reality-Based Expert Demonstrations for Training Construction Robots via Imitation Learning
Huang, L., Cai, W., & Zou, Z. (2023) · Lecture notes in civil engineering · doi:10.1007/978-3-031-34593-7_4
Sibona, F., Luijkx, J., van der Heijden, B., Ferranti, L., & Indri, M. (2023) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin51400.2023.10218251
Zhou, Q., Xiong, X., Zhu, L., & Wang, G. (2023) · Wireless Networks · doi:10.1007/s11276-023-03415-4
RetractedLearning robotic manipulation of deformable objects in the real world
Lee, R. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.242729
Application of deep learning-based ethnic music therapy for selecting repertoire
Zhang, Y., & Zhang, Y. (2023) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-230893
Learning Control Tasks Via Output Measurements: A Data-Efficient Iterative Online ApproachPreprint
Vu, M., He, W., & Zeng, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4577649
Machine Learning Perspectives in Glucose Level Monitoring and Control (Preprint)Preprint
Mroszczak, M., Mroskowiak, A., Jarosz-Chobot, P. A., & Seget, S. (2023) · doi:10.2196/preprints.52797
Causal inference and forescasting methods for climate data nalysis
Silini, R. (2022) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-370852
Robust Classification and 6D Pose Estimation by Sensor Dual Fusion of Image and Point Cloud Data
Xu, Y., Wang, Y., & Li, B. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3639705
Pandey, S., Bhashkar, A., & Sharma, A. K. (2024) · AIP conference proceedings · doi:10.1063/5.0189079
An Empirical Investigation of Visual Reinforcement Learning for 3D Continuous Control
Noh, S., Kim, S., Jang, I., & Lee, D. (2023) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc58733.2023.10393822
Guidelines for RoboticsPreprint
Fiolet, T., Topart, J., Lahleb, S., & Fortin, J. (2024) · doi:10.36227/techrxiv.170793941.11975329/v1
Innovation of the Government Management Model in The Digital Economy Era
Zainal, F. G. &. D. S. R. M. (2022) · GLOBAL MAINSTREAM JOURNAL · doi:10.62304/jbedpm.v1i03.31
Deep Reinforcement Learning for Controlling Cable-Driven Parallel RobotsPreprint
Bouaouda, A., Boutayeb, M., Martinez, D., Pannequin, R., & Charpillet, F. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4777241
ECoDe: A Sample-Efficient Method for Co-Design of Robotic AgentsPreprint
Nagiredla, K. R., kumar.V, A., Karimpanal, T. G., Semage, B. L., & Rana, S. (2024) · Research Square · doi:10.21203/rs.3.rs-4487442/v1
Dynamic Object Recognition and Robot Grasping using CNN-BiLSTM with integration of Double-DQNPreprint
Soumyashree, S., Singh, G., & Gill, H. S. (2024) · Research Square · doi:10.21203/rs.3.rs-4477839/v1
Hebbian Spatial Encoder with Adaptive Sparse ConnectivityPreprint
Panov, A. I., Kuderov, P., & Dzhivelikian, E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4864801
SpineWave: Harnessing Fish Spinal Kinematics in Biomimetic Robotics for Enhanced Aquatic ExplorationPreprint
Li, W., He, Q., Dai, G., Chen, H., Liu, Q., Tian, X., You, J., Cui, W., Triantafyllou, M. S., & Fan, D. (2024) · Research Square · doi:10.21203/rs.3.rs-4544520/v1
Wu, X., Ding, Y., & Yang, S. (2024) · International Conference on Computer and Automation Engineering · doi:10.1109/iccae59995.2024.10569963
Self-Evolution Policy Learning: Leveraging Basic Tasks to Complex Ones
Chen, Q., Xiao, W., Li, Y., & Luo, X. (2024) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit61980.2024.10581501
A soft actor-critic based method for two manipulators coordinated lifting and balancing
Liu, S., & Huang, Y. C. (2024) · Youth Academic Annual Conference of Chinese Association of Automation (YAC) · doi:10.1109/yac63405.2024.10598575
Aprendizaje por refuerzo en vivo para robots móviles
Huonder, S. A., Arévalo, V., Cruz‐Martín, A., & Fernández‐Madrigal, J. (2024) · Jornadas de Automática · doi:10.17979/ja-cea.2024.45.10898
Push and Pull Robot with Reinforcement Learning Algorithms
Vu, H.-D., Cong, P.-K. P., Hoang, N.-M., Tran, K., Ngo, M. D., Pham, D.-D., & Pham, T. (2024) · International Conference on Integrated Circuits, Design, and Verification (ICDV) · doi:10.1109/icdv61346.2024.10617147
Extremum-Seeking Action Selection for Accelerating Policy Optimization
Chang, Y.-C., & Gao, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610197
Dynamics Adaptive Safe Reinforcement Learning with a Misspecified Simulator
Xue, R., Zhang, Z., Li, L., Chen, F., Li, Y.-C., Yu, Y., & Yuan, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70368-3_5
Shota, W. A. D. A., Kouya, S. U. W. A., & Yanagisawa, K. (2024) · Transactions of the Society of Instrument and Control Engineers · doi:10.9746/sicetr.60.555
Wang, M., Ding, F., Liao, C., Pan, Y., Yang, T., & He, J. (2024) · International Conference on Industrial Artificial Intelligence (IAI) · doi:10.1109/iai63275.2024.10730423
Performance–Robustness Tradeoffs in Adversarially Robust Control and Estimation
Lee, B. D., Zhang, T. T. C. K., Hassani, H., & Matni, N. (2024) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2024.3492318
Multi-Obstacle Path Planning using Deep Reinforcement Learning
Morgan, B., Trigg, L., Stringer, A., Schley, L., & Hougen, D. F. (2024) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc62030.2024.10748994
Heat It Up: Using Robo-gym to Warm-up Deep Reinforcement Learning Algorithms
Bermudez, G., Alves, M. A. D. C., Pedro, G. D. G., & Boaventura, T. (2024) · Latin American Robotics Symposium, Brazilian Symposium on Robotics and Workshop on Robotics in Education (LARS/SBR/WRE) · doi:10.1109/lars64411.2024.10786424
WITHDRAWNPreprint
Wilkinson, N. (2024) · doi:10.31234/osf.io/dn8bq
Mastering Rocket League with Reinforcement Learning A Proximal Policy Optimization Approach
Misaroş, M., Gota, D.-I., Niste, D. F., Stan, A., Ciobotaru, A., & Miclea, L. C. (2024) · International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) · doi:10.1109/iceccme62383.2024.10796434
A Variational Quantum Soft Actor-Critic Algorithm for Continuous Control Tasks
Policicchio, A., Acuto, A., Barillà, P., Bozzolo, L., & Conterno, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-81247-7_13 · Cited by 1
Exploring Visual Reinforcement Learning for Sample-Efficient Robotic Manipulation
Noh, S., Kim, S., & Jang, I. (2024) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc62082.2024.10827272
Curriculum Reinforcement Learning with Hybrid Exploration Strategies for 2D Maze Path Planning
Tao, Z. (2024) · International Conference on Algorithms, Computing and Systems (ICACS) · doi:10.1145/3708597.3708615
Minghao, Z., Bifeng, S., Xiaojun, Y., & Wang, L. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110373
Development of Obstacle Navigation in Robots Using the Linear Regression Method
Turnip, A., Noor, M. A. S., Trisanto, A., & Yohanes, G. F. (2024) · IEEE International Conference on Control & Automation, Electronics, Robotics, Internet of Things, and Artificial Intelligence (CERIA) · doi:10.1109/ceria64726.2024.10914955
Artificial Intelligence in Endodontics
Herbst, S. R., & Hossein, M.-R. (2025) · Springer eBooks · doi:10.1007/978-3-031-84047-0_8
A Memory Consolidation Model Based on Neuromodulation Mechanisms in the Human Brain
Nong, X., & Wang, D. (2025) · Journal of The Institution of Engineers (India) Series B · doi:10.1007/s40031-025-01228-x
Duran, K., Hernandez, R. J., & Shrestha, S. (2025) · International Conference on Disruptive Technologies (ICDT) · doi:10.1109/icdt63985.2025.10986448
Sample Efficient Proximal Policy Optimization for Effective Aircraft Stall Recovery
Wang, J., Lu, C., & Chen, Y. C. (2025) · Advances in transdisciplinary engineering · doi:10.3233/atde250364
Li, Y., Zhao, S., & Yu, J. (2025) · Information Sciences · doi:10.1016/j.ins.2025.122455
Zeng, Y. (2025) · International Conference on Data Science and Information System (ICDSIS) · doi:10.1109/icdsis65355.2025.11070705
Seamless skill transitions with hierarchical reward shaping and failure-driven replay
Xin, L., Tian, H., & Sheng, B. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133801
Improving Robot Image Perception Design Using Artificial Intelligence
(2025) · REST Journal on Emerging trends in Modelling and Manufacturing · doi:10.46632/jemm/9/4/6
Reachability Graph Learning with Reinforcement Learning Control for Robotic Tasks
Bonnavaud, H., Albore, A., & Rachelson, E. (2025) · International Conference on Control and Robotics Engineering (ICCRE) · doi:10.1109/iccre65455.2025.11093311
Min, H., Li, Z., & Chi, W. (2025) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc65474.2025.11090489
Experimental Study on the Effect of Multi-Step Deep Reinforcement Learning in PomdpsPreprint
Meng, L., Kulić, D., Burke, M., & Gorbet, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5387658
Pseudo-distribution elite critics: Enhancing accuracy in reinforcement learning value estimation
Zhang, Y., Li, L., Wei, W., Wu, J., & Liang, J. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108018
Kotani, N. (2025) · IEEJ Transactions on Electronics Information and Systems · doi:10.1541/ieejeiss.145.795
RelAIBotiX: Reliability Assessment for AI-Controlled Robotic Systems
Grimmeisen, P., Golwalkar, R., Sautter, F., & Morozov, A. S. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128348
Simplifying Reward Design in Complex Robotics: Average-Reward Maximum Entropy Reinforcement Learning
Choe, J. S. B., Choi, B., & Kim, J.-K. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128043
Speedtuning: Speeding Up Policy Execution with Lightweight Reinforcement Learning
Yuan, D. D., Zhao, T. Z., Burns, K., & Finn, C. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128753
Self-citationOptimization of pour-over coffee extraction variables using reinforcement learning
Bramantoro, A., Moch Riyadi Maskur, A., Alzahrani, A. A., Jeffery, Z., & Shiddiqi, A. M. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3219
Zhang, D., Liang, J., Miao, Z., Li, Q., Wang, Y., Wu, J., Xiong, R., & Wang, Y. (2025) · Chinese Control Conference (CCC) · doi:10.23919/ccc64809.2025.11178658
Multicriteria Optimization of the Robot’s Territory Processing Trajectory
Zuev, S., Rybak, L. A., Polyakov, V. M., Dhar, N. K., Shit, S., & Витальевич, Ч. В. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04761-8_8
Novel Dynamic Force Shaping Method for Agoraphilic Navigation Algorithm
Gunathilaka, W. M. D. R., Kahandawa, G. C., Ibrahim, M. Y., Hewawasam, H. S., & Nguyen, L. V. (2025) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon58223.2025.11221016
Metadata
- Authors
- Ibarz, J., Tan, J., Finn, C., Kalakrishnan, M., Pastor, P., & Levine, S.
- Affiliations
- Google (United States) (US)
- Everyday Robots, X, The Moonshot Factory, Mountain View, CA, USA
- Corresponding author
- Ibarz, Julian
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2021-01-31
- Volume
- 40
- Issue
- 4-5
- Pages
- 698-721
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W3126321819
- Cited by
- 570
- References
- 193
- Citations by year
- 2026: 63 · 2025: 123 · 2024: 145 · 2023: 112 · 2022: 89 · 2021: 38
- FWCI
- 33.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The International Journal of Robotics Research (publishedVersion, cc-by-nc)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep reinforcement learning, robot learning, embodied agents, physical robots, robot skill learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
