The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.
Sim-to-Real Robot Learning from Pixels with Progressive Nets
Open accessAbstract
Applying end-to-end learning to solve complex, interactive, pixel-driven control tasks on a robot is an unsolved problem. Deep Reinforcement Learning algorithms are too slow to achieve performance on a real robot, but their potential has been demonstrated in simulated environments. We propose using progressive networks to bridge the reality gap and transfer learned policies from simulation to the real world. The progressive net approach is a general framework that enables reuse of everything from low-level visual features to high-level policies for transfer to new tasks, enabling a compositional, yet simple, approach to building complex skills. We present an early demonstration of this approach with a number of experiments in the domain of robot manipulation that focus on bridging the reality gap. Unlike other proposed approaches, our real-world experiments demonstrate successful task learning from raw visual input on a fully actuated robot manipulator. Moreover, rather than relying on model-based trajectory optimisation, the task learning is accomplished using only deep reinforcement learning and sparse rewards.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, the authors assume that, when the consequences of a control input applied in simulation differ from those applied on the real robot, real observations should match simulated ones, and that is not always true.”
From Crossing the Reality Gap: A Survey on Sim-to-Real Transferability of Robot Controllers in Reinforcement Learning (2021) · cites this paper as [49]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Christiano et al. [49] adopted TL to perform sim-to-real control input adaptation.”
From Crossing the Reality Gap: A Survey on Sim-to-Real Transferability of Robot Controllers in Reinforcement Learning (2021) · cites this paper as [49]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Results highlight the effectiveness of such method and the relatively low number of samples required for convergence.”
From Crossing the Reality Gap: A Survey on Sim-to-Real Transferability of Robot Controllers in Reinforcement Learning (2021) · cites this paper as [49]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The methods of imitation learning can be broadly classified into two key areas: behaviour cloning where an agent learns a mapping from observations to actions given demonstrations [26], [27] and inverse reinforcement learning where an agent attempts to estimate a reward function that describes the given demonstrations [28].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [26]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 25
- [1][1] S. Levine and P. Abbeel. Learning neural network policies with guided policy search under unknown dynamics. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 27 , pages 1071-1079. Curran Associates, Inc., 2014. URL http://papers.nips.cc/paper/ 5444-learning-neural-network-policies-with-guided-policy-search-under-unknown-dynamics. pdf . -
- [2][2] J. Schulman, S. Levine, P. Moritz, M. I. Jordan, and P. Abbeel. Trust region policy optimization. In Proceedings of the 32nd International Conference on Machine Learning (ICML) , 2015. -
- [3][3] N. Heess, G. Wayne, D. Silver, T. P. Lillicrap, T. Erez, and Y. Tassa. Learning continuous control policies by stochastic value gradients. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada , pages 2944-2952, 2015. URL http://papers.nips.cc/paper/ 5796-learning-continuous-control-policies-by-stochastic-value-gradients . -
- [4][4] T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y . Tassa, D. Silver, and D. Wierstra. Continuous control with deep reinforcement learning. Proceedings of the International Conference on Learning Representations (ICLR) , 2016. URL http://arxiv.org/abs/1509.02971 . - · arXiv
- [5][5] J. Schulman, P. Moritz, S. Levine, M. Jordan, and P. Abbeel. High-dimensional continuous control using generalized advantage estimation. In Proceedings of the International Conference on Learning Representations (ICLR) , 2016. -
- [6][6] V. Mnih, A. P. Badia, M. Mirza, A. Graves, T. P. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu. Asynchronous methods for deep reinforcement learning. In Int'l Conf. on Machine Learning (ICML) , 2016. -
- [7][7] S. Gu, T. P. Lillicrap, I. Sutskever, and S. Levine. Continuous deep q-learning with model-based acceleration. In ICML 2016 , 2016. -
- [8][8] A. Rusu, N. Rabinowitz, G. Desjardins, H. Soyer, J. Kirkpatrick, K. Kavukcuoglu, R. Pascanu, and R. Hadsell. Progressive neural networks. arXiv preprint arXiv:1606.04671 , 2016. - · arXiv
- [9][9] X. Peng, B. Sun, K. Ali, and K. Saenko. Learning deep object detectors from 3d models. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015 , pages 1278-1286, 2015. -
- [10][10] H. Su, C. R. Qi, Y. Li, and L. J. Guibas. Render for CNN: viewpoint estimation in images using cnns trained with rendered 3d model views. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015 , pages 2686-2694, 2015. -
- [11][11] M. Long, Y. Cao, J. Wang, and M. I. Jordan. Learning transferable features with deep adaptation networks. In Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015 , pages 97-105, 2015. -
- [12][12] E. Tzeng, J. Hoffman, T. Darrell, and K. Saenko. Simultaneous deep transfer across domains and tasks. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015 , pages 4068-4076, 2015. -
- [14][14] E. Tzeng, C. Devin, J. Hoffman, C. Finn, X. Peng, S. Levine, K. Saenko, and T. Darrell. Towards adapting deep visuomotor representations from simulated to real environments. CoRR , abs/1511.07111, 2015. URL http://arxiv.org/abs/1511.07111 . - · arXiv
- [15][15] Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky. Domain-adversarial training of neural networks. Journal of Machine Learning Research , 17(59):1-35, 2016. -
- [16][16] H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, and M. Marchand. Domain-adversarial neural networks. CoRR , abs/1412.4446, 2014. URL http://arxiv.org/abs/1412.4446 . - · arXiv
- [17][17] K. Bousmalis, G. Trigeorgis, N. Silberman, D. Krishnan, and D. Erhan. Domain separation networks. In Advances in Neural Information Processing Systems , pages 343-351, 2016. -
- [18][18] S. Barrett, M. E. Taylor, and P. Stone. Transfer learning for reinforcement learning on a physical robot. In Ninth International Conference on Autonomous Agents and Multiagent Systems - Adaptive Learning Agents Workshop (AAMAS - ALA) , 2010. -
- [19][19] S. James and E. Johns. 3D Simulation for Robot Arm Control with Deep Q-Learning. ArXiv e-prints , 2016. -
- [20][20] Y. Zhu, R. Mottaghi, E. Kolve, J. J. Lim, A. Gupta, L. Fei-Fei, and A. Farhadi. Target-driven visual navigation in indoor scenes using deep reinforcement learning. In Robotics and Automation (ICRA), 2017 IEEE International Conference on , pages 3357-3364. IEEE, 2017. -
- [21][21] S. Levine, C. Finn, T. Darrell, and P. Abbeel. End-to-end training of deep visuomotor policies. Journal of Machine Learning Research , 17(39):1-40, 2016. -
- [22][22] S. Levine, N. Wagener, and P. Abbeel. Learning contact-rich manipulation skills with guided policy search. In IEEE International Conference on Robotics and Automation, ICRA 2015, Seattle, WA, USA, 26-30 May, 2015 , pages 156-163, 2015. -
- [23][23] L. Pinto and A. Gupta. Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours. In ICRA 2016 , 2016. -
- [24][24] S. Levine, P. Pastor, A. Krizhevsky, J. Ibarz, and D. Quillen. Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. The International Journal of Robotics Research , page 0278364917710318, 2016. -
- [25][25] V. Mnih, K. Kavukcuoglu, D. Silver, A. Rusu, J. Veness, M. Bellemare, A. Graves, M. Riedmiller, A. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis. Human-level control through deep reinforcement learning. Nature , 518(7540):529-533, 2015. -
- [26][26] E. Todorov, T. Erez, and Y. Tassa. Mujoco: A physics engine for model-based control. In International Conference on Intelligent Robots and Systems IROS , 2012.
Cited by
Sorted by citations
Items 101–200 of 403
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation
Gordon, D., Kadian, A., Parikh, D., Hoffman, J., & Batra, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00111 · Cited by 57
Dexterous Manipulation for Multi-Fingered Robotic Hands With Reinforcement Learning: A Review
Yu, C., & Wang, P. (2022) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.861825 · Cited by 62
CRAVES: Controlling Robotic Arm With a Vision-Based Economic System
Zuo, Y., Qiu, W., Xie, L., Zhong, F., Wang, Y., & Yuille, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00434 · Cited by 62
SimGAN: Hybrid Simulator Identification for Domain Adaptation via Adversarial Reinforcement Learning
Jiang, Y., Zhang, T., Ho, D., Bai, Y., Liu, C. K., Levine, S., & Tan, J. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561731 · Cited by 64
Experience Selection in Deep Reinforcement Learning for Control
de Bruin, T., Kober, J., Tuyls, K., & Babuška, R. (2018) · Research Repository (Delft University of Technology) · doi:10.5555/3291125.3291134 · Cited by 56
Comparing Task Simplifications to Learn Closed-Loop Object Picking Using Deep Reinforcement Learning
Breyer, M., Furrer, F., Novković, T., Siegwart, R., & Nieto, J. I. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2896467 · Cited by 63
One-Shot Reinforcement Learning for Robot Navigation with Interactive ReplayPreprint
Bruce, J., Suenderhauf, N., Mirowski, P., Hadsell, R. T., & Milford, M. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10137 · Cited by 59
Self-citationYuan, W., Hang, K., Kragic, D., Wang, M. Y., & Stork, J. A. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.06.007 · Cited by 54
Challenges of Reinforcement Learning
Ding, Z., & Dong, H. (2020) · Springer eBooks · doi:10.1007/978-981-15-4095-0_7 · Cited by 52
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated FlightPreprint
Blukis, V., Terme, Y., Niklasson, E., Knepper, R. A., & Artzi, Y. (2019) · Conference on Robot Learning · doi:10.48550/arxiv.1910.09664 · Cited by 85
Show, Attend, and Translate: Unsupervised Image Translation With Self-Regularization and Attention
Yang, C., Kim, T., Wang, R., Peng, H., & Kuo, C.-C. J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2914583 · Cited by 53
Zhang, H., Yang, D., Wang, H., Zhao, B., Lan, X., Ding, J., & Zheng, N. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3142401 · Cited by 52
Never Stop Learning: The Effectiveness of Fine-Tuning in Robotic Reinforcement LearningPreprint
Julian, R., Swanson, B., Sukhatme, G. S., Levine, S., Finn, C., & Hausman, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.10190 · Cited by 78
A survey of visual navigation: From geometry to embodied AI
Zhang, T., Hu, X., Xiao, J., & Zhang, G. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105036 · Cited by 53
Reinforcement Learning for Robotic Assembly Using Non-Diagonal Stiffness Matrix
Oikawa, M., Kusakabe, T., Kutsuzawa, K., Sakaino, S., & Tsuji, T. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3060389 · Cited by 49
Rupprecht, T., & Wang, Y. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.05.013 · Cited by 48
Virtual to Real-World Transfer Learning: A Systematic Review
Ranaweera, M., & Mahmoud, Q. H. (2021) · Electronics · doi:10.3390/electronics10121491 · Cited by 48
Adversarial discriminative sim-to-real transfer of visuo-motor policies
Zhang, F., Leitner, J., Ge, Z., Milford, M. J., & Corke, P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919870227 · Cited by 47
Environment Probing Interaction PoliciesPreprint
Zhou, W., Pinto, L., & Gupta, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.11740 · Cited by 55
DayDreamer: World Models for Physical Robot Learning
Wu, P., Escontrela, A., Hafner, D., Goldberg, K., & Abbeel, P. (2022) · arXiv · doi:10.48550/arxiv.2206.14176 · Cited by 76
van Baar, J., Sullivan, A., Cordorel, R., Jha, D. K., Romeres, D., & Nikovski, D. N. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793561 · Cited by 51
Learning Deep Visuomotor Policies for Dexterous Hand Manipulation
Jain, D., Li, A. R., Singhal, S., Rajeswaran, A., Kumar, V., & Todorov, E. V. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794033 · Cited by 49
Mutual Alignment Transfer LearningPreprint
Wulfmeier, M., Posner, I., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07907 · Cited by 49
Machine learning meets advanced robotic manipulation
Nahavandi, S., Alizadehsani, R., Nahavandi, D., Lim, C. P., Kelly, K., & Bello, F. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102221 · Cited by 46
Policy transfer via modularity and reward guiding
Clavera, I., Held, D., & Abbeel, P. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8205959 · Cited by 42
Christen, S., Stevšić, S., & Hilliges, O. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794065 · Cited by 42
Few-Shot Goal Inference for Visuomotor Learning and PlanningPreprint
Xie, A., Singh, A., Levine, S., & Finn, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00482 · Cited by 42
Deep Continual Learning for Emerging Emotion Recognition
Thuseethan, S., Rajasegarar, S., & Yearwood, J. L. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3116434 · Cited by 41
Generalization in neural networks: A broad survey
Rohlfs, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128701 · Cited by 51
Mo, Y., Ma, S., Gong, H., Chen, Z., Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3068736 · Cited by 41
Visuomotor Reinforcement Learning for Multirobot Cooperative Navigation
Liu, Z., Liu, Q., Tang, L., Jin, K., Wang, H., Liu, M., & Wang, H. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2021.3114327 · Cited by 41
Chaffre, T., Moras, J., Chan-Hon-Tong, A., & Marzat, J. (2020) · Proceedings of the 17th International Conference on Informatics in Control, Automation and Robotics · doi:10.5220/0009821603140323 · Cited by 38
Modular Deep Q Networks for Sim-to-real Transfer of Visuo-motor PoliciesPreprint
Zhang, F., Leitner, J., Milford, M. J., & Corke, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.06781 · Cited by 43
Sample-efficient Reinforcement Learning in Robotic Table Tennis
Tebbe, J., Krauch, L., Gao, Y., & Zell, A. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560764 · Cited by 39
Memory-Augmented Capsule Network for Adaptable Lung Nodule Classification
Mobiny, A., Yuan, P., Cicalese, P. A., Moulik, S. K., Garg, N., Wu, C. C., Wong, K. A., Wong, S. T. C., He, T., & Nguyen, H. V. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3051089 · Cited by 37
Source Model Selection for Deep Learning in the Time Series Domain
Meiseles, A., & Rokach, L. (2020) · IEEE Access · doi:10.1109/access.2019.2963742 · Cited by 37
A Survey of Deep Learning Techniques for Mobile Robot ApplicationsPreprint
Shabbir, J., & Anwer, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07608 · Cited by 42
Natural Environment Benchmarks for Reinforcement LearningPreprint
Zhang, A., Wu, Y., & Pineau, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.06032 · Cited by 56
Domain Randomization for Simulation-Based Policy Optimization with Transferability Assessment
Muratore, F., Treede, F., Gienger, M., & Peters, J. (2018) · MPG.PuRe (Max Planck Society) · Cited by 34
Improving Data Efficiency of Self-supervised Learning for Robotic Grasping
Berscheid, L., Rühr, T., & Kröger, T. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793952 · Cited by 34
Automatic control of cardiac ablation catheter with deep reinforcement learning method
You, H., Bae, E., Moon, Y., Kweon, J., & Choi, J. (2019) · Journal of Mechanical Science and Technology · doi:10.1007/s12206-019-1036-0 · Cited by 35
Online Continual Learning on Sequences
Parisi, G. I., & Lomonaco, V. (2020) · Studies in computational intelligence · doi:10.1007/978-3-030-43883-8_8 · Cited by 39
A dedicated hardware accelerator for real-time acceleration of YOLOv2
Xu, K., Wang, X., Liu, X., Cao, C., Li, H., Peng, H., & Wang, D. (2020) · Journal of Real-Time Image Processing · doi:10.1007/s11554-020-00977-w · Cited by 35
Predicting the position-dependent dynamics of machine tools using progressive network
Liu, Y.-P., & Altıntaş, Y. (2021) · Precision Engineering · doi:10.1016/j.precisioneng.2021.10.010 · Cited by 34
Relative Entropy Regularized Sample-Efficient Reinforcement Learning With Continuous Actions
Shang, Z., Li, R., Zheng, C., Li, H., & Cui, Y. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3329513 · Cited by 34
TuneNet: One-Shot Residual Tuning for System Identification and Sim-to-Real Robot Task TransferPreprint
Allevato, A., Short, E. S., Pryor, M., & Thomaz, A. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.11200 · Cited by 34
Active Learning-Based Grasp for Accurate Industrial Manipulation
Fu, X., Liu, Y., & Wang, Z. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2897791 · Cited by 33
Real–Sim–Real Transfer for Real-World Robot Control Policy Learning with Deep Reinforcement Learning
Liu, N., Cai, Y., Lu, T., Wang, R., & Wang, S. (2020) · Applied Sciences · doi:10.3390/app10051555 · Cited by 33
Lucchi, M., Zindler, F., Mühlbacher-Karrer, S., & Pichler, H. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340956 · Cited by 33
On the Transfer of Disentangled Representations in Realistic SettingsPreprint
Dittadi, A., Träuble, F., Locatello, F., Wüthrich, M., Agrawal, V., Winther, O., Bauer, S., & Schölkopf, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14407 · Cited by 50
DIViS: Domain Invariant Visual Servoing for Collision-Free Goal Reaching
Sadeghi, F. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.055 · Cited by 32
Learning Deployable Navigation Policies at Kilometer Scale from a Single TraversalPreprint
Bruce, J., Sünderhauf, N., Mirowski, P., Hadsell, R. T., & Milford, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.05211 · Cited by 33
Self-citationSim-to-Real Transfer of Accurate Grasping with Eye-In-Hand Observations and Continuous Control
Yan, M., Frosio, I., Tyree, S., & Kautz, J. (2017) · arXiv · doi:10.48550/arxiv.1712.03303 · Cited by 31
A Data-Efficient Framework for Training and Sim-to-Real Transfer of Navigation Policies
Bharadhwaj, H., Wang, Z., Bengio, Y., & Paull, L. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794310 · Cited by 31
DESK: A Robotic Activity Dataset for Dexterous Surgical Skills Transfer to Medical Robots
Madapana, N., Rahman, M. M., Sanchez‐Tamayo, N., Balakuntala, M. V., Gonzalez, G., Bindu, J. P., Venkatesh, L. N. V., Zhang, X., Noguera, J. A. B., Low, T., et al. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967760 · Cited by 31
Real-Time Trajectory Adaptation for Quadrupedal Locomotion using Deep Reinforcement Learning
Gangapurwala, S., Geisert, M., Orsolino, R., Fallon, M. F., & Havoutis, I. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561639 · Cited by 34
DROID: Minimizing the Reality Gap Using Single-Shot Human Demonstration
Tsai, Y.-Y., Xu, H., Ding, Z., Zhang, C., Johns, E., & Huang, B. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3062311 · Cited by 30
Shi, Y., Yuan, C., Tsitos, A., Cong, L., Hadjar, H., Chen, Z., & Zhang, J. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3237734 · Cited by 30
Learning Cross-Domain Correspondence for Control with Dynamics Cycle-ConsistencyPreprint
Zhang, Q., Xiao, T., Efros, A. A., Pinto, L., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09811 · Cited by 30
Autonomous Driving in Reality with Reinforcement Learning and Image TranslationPreprint
Xu, N., Tan, B., & Kong, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05299 · Cited by 29
SRDA: Generating Instance Segmentation Annotation via Scanning, Reasoning and Domain Adaptation
Xu, W., Li, Y., & Lu, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_8 · Cited by 28
Adversarial Skill Networks: Unsupervised Robot Skill Learning from Video
Mees, O., Merklinger, M., Kalweit, G., & Burgard, W. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196582 · Cited by 28
Indirect Object-to-Robot Pose Estimation from an External Monocular RGB Camera
Tremblay, J., Tyree, S., Mosier, T., & Birchfield, S. T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341163 · Cited by 28
Grounded action transformation for sim-to-real reinforcement learning
Hanna, J. P., Desai, S., Karnan, H., Warnell, G. A., & Stone, P. (2021) · Machine-mediated learning · doi:10.1007/s10994-021-05982-z · Cited by 38
A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning
Zhang, X., Sun, J., Wang, Y., & Sun, J. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3300748 · Cited by 27
Reinforcement Learning-Based Algorithm to Avoid Obstacles by the Anthropomorphic Robotic Arm
Lindner, T., & Milecki, A. (2022) · Applied Sciences · doi:10.3390/app12136629 · Cited by 27
iTD3-CLN: Learn to navigate in dynamic scene through Deep Reinforcement Learning
Jiang, H., Esfahani, M. A., Wu, K., Wan, K.-W., Heng, K.-K., Wang, H., & Jiang, X. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.102 · Cited by 27
Analysing deep reinforcement learning agents trained with domain randomisation
Dai, T., Arulkumaran, K., Gerbert, T., Tukra, S., Behbahani, F., & Bharath, A. A. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.04.005 · Cited by 28
Benchmark Environments for Multitask Learning in Continuous DomainsPreprint
Henderson, P., Chang, W.-D., Shkurti, F., Hansen, J., Meger, D., & Dudek, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.04352 · Cited by 27
A Dirichlet Process Mixture of Robust Task Models for Scalable Lifelong Reinforcement Learning
Wang, Z., Chen, C., & Dong, D. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3170485 · Cited by 25
Co-Salient Object Detection with Uncertainty-Aware Group Exchange-Masking
Wu, Y., Song, H., Liu, B., Zhang, K.-H., & Liu, D. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.01881 · Cited by 25
Sim2Real Rope Cutting With a Surgical Robot Using Vision-Based Reinforcement Learning
Haiderbhai, M., Gondokaryono, R., Wu, A. Y., & Kahrs, L. A. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3410297 · Cited by 23
Adaptive Curriculum Generation from Demonstrations for Sim-to-Real Visuomotor Control
Hermann, L., Argus, M. J., Eitel, A., Amiranashvili, A., Burgard, W., & Brox, T. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197108 · Cited by 23
Efficient Hybrid-Supervised Deep Reinforcement Learning for Person Following Robot
Pang, L., Zhang, Y., Coleman, S., & Cao, H. (2019) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-019-01030-0 · Cited by 24
Adaptive Deep Learning Through Visual Domain Localization
Angeletti, G., Barbara Caputo, B., & Tommasi, T. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460650 · Cited by 22
Blind spot detection for safe sim-to-real transfer
Ramakrishnan, R., Kamar, E., Dey, D., Horvitz, E., & Shah, J. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11436 · Cited by 21
Iterative residual tuning for system identification and sim-to-real robot learning
Allevato, A., Short, E. S., Pryor, M., & Thomaz, A. L. (2020) · Autonomous Robots · doi:10.1007/s10514-020-09925-w · Cited by 21
Wada, D., Araujo-Estrada, S. A., & Windsor, S. P. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3205442 · Cited by 21
From the Dexterous Surgical Skill to the Battlefield—A Robotics Exploratory Study
Gonzalez, G., Kaur, U., Rahman, M., Venkatesh, V. L. N., Sanchez, N., Hager, G. D., Xue, Y., Voyles, R. M., & Wachs, J. P. (2021) · Military Medicine · doi:10.1093/milmed/usaa253 · Cited by 21
Diverse Auto-Curriculum is Critical for Successful Real-World Multiagent Learning Systems
Yang, Y., Luo, J., Wen, Y., Slumbers, O., Graves, D., Ammar, H. B., Wang, Y.-X., & Taylor, M. E. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/lixm5646 · Cited by 27
Zhang, F., Leitner, J., Milford, M. J., & Corke, P. (2017) · arXiv (Cornell University) · Cited by 21
Lechner, M., Hasani, R., Rus, D. L., & Grosu, R. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196608 · Cited by 20
A Continual Learning Framework for Uncertainty-Aware Interactive Image Segmentation
Zheng, E., Yu, Q., Li, R., Shi, P., & Haake, A. R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16752 · Cited by 20
Policy Fusion Transfer: The Knowledge Transfer for Different Robot Peg-in-Hole Insertion Assemblies
Men, Y., Jin, L., Cui, T., Bai, Y., Li, F., & Song, R. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3305709 · Cited by 20
A conceptual study of transfer learning with linear models for data-driven property prediction
Li, B., & Rangarajan, S. (2021) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2021.107599 · Cited by 22
Intervention Aided Reinforcement Learning for Safe and Practical Policy Optimization in NavigationPreprint
Wang, F., Zhou, B., Chen, K., Fan, T., Zhang, X., Li, J., Tian, H., & Pan, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.06187 · Cited by 21
Asymmetric self-play for automatic goal discovery in robotic manipulation
OpenAI, O., Plappert, M., Sampedro, R., Xu, T., Akkaya, I., Kosaraju, V., Welinder, P., D'Sa, R., Petron, A., Pinto, H. P. D. O., et al. (2021) · arXiv · doi:10.48550/arxiv.2101.04882 · Cited by 18
Simultaneously Learning Vision and Feature-Based Control Policies for Real-World Ball-In-A-Cup
Schwab, D., Springenberg, J. T., Martins, M. F., Neunert, M., Lampe, T., Abdolmaleki, A., Hertweck, T., Hafner, R., Nori, F., & Riedmiller, M. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.027 · Cited by 18
Reusable Reinforcement Learning via Shallow Trails
Yu, Y., Chen, S.-Y., Da, Q., & Zhou, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2803729 · Cited by 18
Transferring Visuomotor Learning from Simulation to the Real World for Robotics Manipulation Tasks
Phương, N. D., Fischer, T., Chang, H. J., Pattacini, U., Giorgio Metta, B., & Demiris, Y. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594519 · Cited by 18
Constrained-Space Optimization and Reinforcement Learning for Complex Tasks
Tsai, Y.-Y., Xiao, B. J., Johns, E., & Yang, G. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2965392 · Cited by 18
Deep Learning for Embodied Vision Navigation: A SurveyPreprint
Zhu, F., Zhu, Y., Lee, V. C., Liang, X., & Chang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04097 · Cited by 30
Zhao, Z., He, W., & Lu, Z. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3359553 · Cited by 17
Unified curiosity-Driven learning with smoothed intrinsic reward estimation
Huang, F., Li, W., Cui, J., Fu, Y., & Li, X. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108352 · Cited by 17
GoferBot: A Visual Guided Human-Robot Collaborative Assembly System
Zhuang, Z., Ben-Shabat, Y., Zhang, J., Gould, S. J., & Mahony, R. E. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981122 · Cited by 17
Deep Reinforcement Learning for sim-to-real policy transfer of VTOL-UAVs offshore docking operations
Ali, A. M., Gupta, A. K., & Hashim, H. A. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111843 · Cited by 17
Real-Time Prediction of Intermediate-Horizon Automotive Collision Risk
Wulfe, B., Chintakindi, S., Choi, S.-C. T., Hartong-Redden, R., Kodali, A., & Kochenderfer, M. J. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/xkar6754 · Cited by 17
An Energy Efficient EdgeAI Autoencoder Accelerator for Reinforcement Learning
Manjunath, N. K., Shiri, A., Hosseini, M., Prakash, B., Waytowich, N. R., & Mohsenin, T. (2021) · IEEE Open Journal of Circuits and Systems · doi:10.1109/ojcas.2020.3043737 · Cited by 17
Simulation to Scaled City: Zero-Shot Policy Transfer for Traffic Control via Autonomous VehiclesPreprint
Jang, K., Vinitsky, E., Chalaki, B., Remer, B., Beaver, L. E., Malikopoulos, A. A., & Bayen, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06120 · Cited by 17
Josifovski, J., Malmir, M., Klarmann, N., Žagar, B. L., Navarro-Guerrero, N., & Knoll, A. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981951 · Cited by 18
Metadata
- Authors
- Rusu, A. A., Vecerik, M., Rothörl, T., Heess, N., Pascanu, R., & Hadsell, R.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- Pages
- 262-270
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1610.04286
- OpenAlex
- W2534269850
- Cited by
- 385
- References
- 0
- Citations by year
- 2026: 2 · 2025: 14 · 2024: 23 · 2023: 21 · 2022: 36 · 2021: 66 · 2020: 68 · 2019: 72 · 2018: 52 · 2017: 29 · 2016: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Conference on Robot Learning
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- sim-to-real transfer, robotic manipulation, visual features, policy transfer, reality gap, deep reinforcement learning, sparse rewards, end-to-end learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
