Sim-To-Real via Sim-To-Sim: Data-Efficient Robotic Grasping via Randomized-To-Canonical Adaptation Networks

James, Stephen, Wohlhart, Paul, Kalakrishnan, Mrinal, Kalashnikov, Dmitry, Irpan, Alex, Ibarz, Julian, Levine, Sergey, Hadsell, Raia +1 more·2019·2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Cited by (421)

Items 301–400 of 421

  1. CAD-to-real: enabling deep neural networks for 3D pose estimation of electronic control units
    Simon Bäuerle, Moritz Böhland, Jonas Barth, Markus Reischl, Andreas Steimer, Ralf Mikut · 2021 · at - Automatisierungstechnik
  2. SESR: Self-Ensembling Sim-to-Real Instance Segmentation for Auto-Store Bin Picking
    Biqi Yang, Xiaojie Gao, Kai Chen, Rui Cao, Yidan Feng, Xianzhi Li, Qi Dou, Chi‐Wing Fu, Yunhui Liu, Pheng‐Ann Heng · 2022 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  3. Reinforcement Learning for Pan-Tilt-Zoom Camera Control, with Focus on Drone Tracking
    Mariusz Wisniewski, Zeeshan Ali Rana, Ivan V. Petrunin · 2023 · AIAA SciTech Forum
  4. Continual Learning of Vacuum Grasps from Grasp Outcome for Unsupervised Domain Adaption
    Maximilian Gilles, Vinzenz Rau · 2022 · International Conference on Robotics, Automation and Artificial Intelligence (RAAI)
  5. Learning Visual-Audio Representations for Voice-Controlled Robots
    Peixin Chang, Shuijing Liu, David L. McPherson, Katherine Driggs-Campbell · 2023 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  6. Software Framework for Simulation and Control of Quadruped Robot Solo12
    Milutin N. Nikolić, Vladimir M. Mitić, Aleksandar V. Lalić · 2024 · International Siberian workshops and tutorials on electron devices and materials
  7. Domain Adaption as Auxiliary Task for Sim-to-Real Transfer in Vision-based Neuro-Robotic Control
    Connor Gäde, Jan-Gerrit Habekost, Stefan Wermter · 2024 · International Joint Conference on Neural Networks (IJCNN)
  8. Reconnaissance and Planning algorithm for constrained MDP
    Shin‐ichi Maeda, Hayato Watahiki, Shintarou Okada, Masanori Koyama · 2019 · arXiv (Cornell University)
  9. End-to-End Egospheric Spatial Memory
    Daniel Lenton, Stephen James, Ronald Clark, Andrew J. Davison · 2021 · arXiv (Cornell University)
  10. Scoring Graspability based on Grasp Regression for Better Grasp Prediction
    Amaury Depierre, Emmanuel Dellandréa, Liming Chen · 2021 · HAL Portal Artxiker (Hindustan Aeronautics Limited (India))
  11. Pre-training of Deep RL Agents for Improved Learning under Domain Randomization
    Artemij Amiranashvili, Max J. Argus, Lukás Hermann, Wolfram Burgard, Thomas Brox · 2021 · arXiv (Cornell University)
  12. Training neural networks with synthetic electrocardiograms
    Matti Kaisti, Juho Laitala, Antti Airola · 2021 · arXiv (Cornell University)
  13. Simulation to reality and back: A robot's guide to crossing the reality gap
    Jack T. Collins · 2022 · Queensland University of Technology
  14. Iterative improvements from feedback for language models
    Yuxi Li · 2023
  15. HAGrasp: Hybrid Action Grasp Control in Cluttered Scenes using Deep Reinforcement Learning
    Kai‐Tai Song, H. W. Chen · 2024 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  16. Robot Vision-Based Autonomous Navigation Method Using Sim2Real Domain Adaptation
    Meng-Ying Zhang, Shihong Duan, Cheng Xu · 2024 · International Symposium on Image and Signal Processing and Analysis
  17. Temporal modeling for domain-invariant fault diagnosis in robotics digital twin systems
    Pranjal Kumar · 2026 · Intelligent Service Robotics
  18. Circular path planning and adaptive force control for breast ultrasound autonomous scanning
    Le Zhang, Dapeng Yang, Haonan Yang, Baoshan Niu, Qi Huang, Hong Liu · 2025 · International Journal of Intelligent Robotics and Applications
  19. Embodied AI: Bridging Simulation and Reality in Robotics
    Peng Xu · 2025 · International Symposium on Robotics, Artificial Intelligence and Information Engineering (RAIIE)
  20. Motion Control of Wheeled-Legged Quadrupeds on Complex Terrains via Integrated Latent Encoding
    Xinyuan Shi, Shijun Xiao, Hui Ding, Teng Chen, Chao Ding, Guoteng Zhang, Xuewen Rong · 2025 · Procedia Computer Science
  21. A Comprehensive Survey of Deep Reinforcement Learning Techniques for Soft Mobile Robots
    Hadi Ghodsi Mohammad, Shahbazi Hamed, Torabi Keivan · 2025 · Drones and autonomous vehicles/Drones and Autonomous Vehicles
  22. Game-Engine-Based 3D Simulation of Mobile Robot and its Application to Autonomous Navigation in Physical Environments
    Shou Kurebayashi, Tetsuo Tomizawa, Susumu Tarao · 2025 · Journal of Robotics and Mechatronics
  23. OHPL: One-shot Hand-eye Policy Learner
    Changjae Oh, Yik Lung Pang, Andrea Cavallaro · 2021 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  24. Investigating Neural Network Architectures, Techniques, and Datasets for Autonomous Navigation in Simulation
    Oliver Chang, Christiana Marchese, Jared Mejia, Anthony J. Clark · 2021 · IEEE Symposium Series on Computational Intelligence (SSCI)
  25. Data Augmentation and Domain Randomization: Empirical Approaches for Data-driven Robot Learning
    Ryo Hanai, Koshi Makihara, Yukiyasu Domae · 2022 · Journal of the Robotics Society of Japan
  26. Multimodal Generation of Novel Action Appearances for Synthetic-to-Real Recognition of Activities of Daily Living
    Zdravko Marinov, David Schneider, Alina Roitberg, Rainer Stiefelhagen · 2022 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  27. Energy Transfer Contrast Network for Unsupervised Domain Adaption
    Jiajun Ouyang, Qingxuan Lv, Shu Zhang, Junyu Dong · 2023 · Lecture notes in computer science
  28. Learning to Control Under Uncertainty with Data-Based Iterative Linear Quadratic Regulator
    Ran Wang, Raman Goyal, Suman Chakravorty · 2023 · IEEE Conference on Decision and Control (CDC)
  29. What Do We Learn from a Large-Scale Study of Pre-Trained Visual Representations in Sim and Real Environments?
    S. Silwal, K. Yadav, Ting-Fan Wu, Jay Vakil, Arjun Majumdar, Sergio Arnaud, Claire Chen, Vincent-Pierre Berges, Dhruv Batra, A. Rajeswaran et al. · 2023 · IEEE International Conference on Robotics and Automation
  30. Zero-Shot Transfer of a Tactile-based Continuous Force Control Policy from Simulation to Robot
    Luca Lach, Robert Haschke, Davide Tateo, Jan Peters, Helge Joachim Ritter, Júlia Borràs, Carme Torras A · 2024 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  31. Self-Supervised Learning of Grasping Arbitrary Objects On-the-Move
    Takuya Kiyokawa, Eiki Nagata, Yoshihisa Tsurumine, Yuhwan Kwon, Takamitsu Matsubara · 2025 · IEEE/SICE International Symposium on System Integration (SII)
  32. Achieving time-critical control in Edge Robotics Systems over 5G
    Amit Baxi, Vincent Mageshkumar, Girish S. Murthy, Arvind Merwaday, Arvind Raju, Gowtham Hosamane, Sugnan Prabhu, Venkat Natarajan, Susruth Sudhakaran, Dave A Cavalcanti et al. · 2025
  33. Learning Wrist Policies for Anthropomorphic Soft Power Grasping in Handle and Door Manipulation
    Florian Voigt, Abdeldjallil Naceri, Sami Haddadin · 2025 · IEEE Transactions on Robotics
  34. Simulation-based reinforcement learning for autonomous driving
    Christopher Galias, Adam Jakubowski, Henryk Michalewski, Błażej Osiński, Paweł Zięcina · 2019
  35. Domain Generalization via Optical Flow: Training a CNN in a Low-Quality Simulation to Detect Obstacles in the Real World
    Moritz Sperling, Yann Bouteiller, Ricardo de Azambuja, Giovanni Beltrame · 2020 · Canadian Conference on Computer and Robot Vision
  36. Active Cross-domain Self-localization Using Pole-like Landmarks
    Tanaka Kanji · 2021 · IEEE International Conference on Mechatronics and Automation (ICMA)
  37. On Assessing the Usefulness of Proxy Domains for Developing and Evaluating Embodied Agents
    Anthony Courchesne, Andrea Censi, Liam Paull · 2021 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  38. Reduced Simulation: Real-to-Sim Approach toward Collision Detection in Narrowly Confined Environments
    Yusuke Takayama, Photchara Ratsamee, Tomohiro Mashita · 2021 · Robotics
  39. Improving the Environmental Adaptability of Conditional Imitation Learning Driving Model
    Zhihui Guo, Shuo Zhang, Sheng Han, Youfang Lin · 2021 · International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS)
  40. Multi-task Deep Reinforcement Learning with Evolutionary Algorithm and Policy Gradients Method in 3D Control Tasks
    Shota Imai, Yuichi Sei, Yasuyuki Tahara, Ryohei Orihara, Akihiko Ohsuga · 2019 · Studies in computational intelligence
  41. Sim-to-Real Reinforcement Learning for Autonomous Driving Using Pseudosegmentation Labeling and Dynamic Calibration
    Jiseong Heo, Hyoung woo Lim · 2022 · Journal of Robotics
  42. Knowledge Transfer in Deep Reinforcement Learning via an RL-Specific GAN-Based Correspondence Function
    Marko Ruman, Tatiana V. Guy · 2024 · IEEE Access
  43. Deep Reinforcement Learning with Linear Quadratic Regulator Regions
    Gabriel I. Fernandez, Colin Togashi, Dennis W. Hong, Lin Forrest Yang · 2020 · arXiv (Cornell University)
  44. "What, not how": Solving an under-actuated insertion task from scratch
    Giulia Vezzani, Michael Neunert, Markus Wulfmeier, Rae Jeong, Thomas Lampe, Noah Siegel, Roland Hafner, Abbas Abdolmaleki, Martin Riedmiller, Francesco Nori · 2020 · arXiv (Cornell University)
  45. ERMAS: Becoming Robust to Reward Function Sim-to-Real Gaps in Multi-Agent Simulations.
    Eric Zhao, Alexander Trott, Caiming Xiong, Stephan Zheng · 2021 · arXiv (Cornell University)
  46. RL-DARTS: Differentiable Architecture Search for Reinforcement Learning.
    Yingjie Miao, Xingyou Song, Daiyi Peng, Summer Yue, Eugene Brevdo, Aleksandra Faust · 2021 · arXiv (Cornell University)
  47. Learning Provably Robust Motion Planners Using Funnel Libraries
    Ali Ekin Gurgen, Anirudha Majumdar, Sushant Veer · 2021 · arXiv (Cornell University)
  48. An Affective Computing Multilayer Cognitive Architecture for Evolutionary Cognitive Robotics
    Zheming Zhang · 2020
  49. Shared control and authority distribution for robotic teleoperation
    Rahaf Rahal · 2020
  50. Adversarial Imitation Learning between Agents with Different Numbers of State Dimensions
    Yoshida Taketo, Yasuo Kuniyoshi · 2019 · IEEE International Conference on Artificial Intelligence and Knowledge Engineering (AIKE)
  51. Development of a Basic Educational Kit for Robot Development Using Deep Neural Networks
    Momomi Kanamura, Yuki Suga, Tetsuya Ogata · 2020 · IEEE/SICE International Symposium on System Integration (SII)
  52. Domain Adaptation with Morphologic Segmentation
    Jonathan Klein, Sören Pirk, Dominik Ludewig Michels · 2020 · arXiv (Cornell University)
  53. Robotic Visual Functions Required for Picking Tasks
    Kimitoshi Yamazaki · 2020 · Journal of the Robotics Society of Japan
  54. Deep Reinforcement Learning for Tactile Robotics: Learning to Type on a Braille Keyboard
    Alex Church, Lloyd, John, Raia T. Hadsell, Nathan F. Lepora · 2020 · arXiv (Cornell University)
  55. Nonprehensile Riemannian Motion Predictive Control
    Hamid Izadinia, Byron Boots, Steven M. Seitz · 2021 · Springer proceedings in advanced robotics
  56. Introspective Visuomotor Control: Exploiting Uncertainty in Deep Visuomotor Control for Failure Recovery
    Chia-Man Hung, Li Sun, Yizhe Wu, Ioannis Havoutis, Ingmar Posner · 2021 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  57. InsertionNet -- A Scalable Solution for Insertion
    Oren Spector, Dotan Di Castro · 2021 · arXiv (Cornell University)
  58. Where is the Grass Greener? Revisiting Generalized Policy Iteration for Offline Reinforcement Learning.
    Lionel Blondé, Alexandros Kalousis · 2021 · arXiv (Cornell University)
  59. Sim and Real: Better Together
    Shirli Di-Castro Shashua, Dotan Di Castro, Shie Mannor · 2021 · arXiv (Cornell University)
  60. Cycle-Consistent World Models for Domain Independent Latent Imagination
    Sidney Bender, Tim Joseph, J. Marius Zöllner · 2023 · Lecture notes in computer science
  61. Nonprehensile Riemannian Motion Predictive Control
    Hamid Izadinia, Byron Boots, Steven M. Seitz · 2021 · arXiv (Cornell University)
  62. 6d Object Pose Estimation with Location-and-Channel Attention
    Guoyu Zuo, Kexin Chen, Gao Ming Huang · 2021 · SSRN Electronic Journal
  63. Improving Automatic Quality Inspection in the Automotive Industry by Combining Simulated and Real Data
    Pedro Guilherme Lacerda Ferreira Pinho, Isabel Rio-Torto, Luís Filipe Teixeira · 2021 · Lecture notes in computer science
  64. A Smart Grasping System for Handling Irregular, Naturally Varying Objects
    Zhicong Deng, Luke Holibar, Eric Wester · 2021 · International Conference on Mechatronics Technology (ICMT)
  65. Physics-Informed Data-Driven Seismic Inversion: Recent Progress and Future Opportunities
    Youzuo Lin, James P. Theiler, Brendt E. Wohlberg · 2022
  66. A deep learning approach to visual servo control and grasp detection for autonomous robotic manipulation
    Eduardo G. Ribeiro · 2020
  67. Multimedia Meets Deep Reinforcement Learning
    Shu‐Ching Chen · 2022 · IEEE Multimedia
  68. Recent Research on 6D Pose Estimation Method Based on Deep Learning
    涵 杨 · 2022 · Software Engineering and Applications
  69. Few-Shot Image-to-Semantics Translation for Policy Transfer in Reinforcement Learning
    Rei Sato, Kazuto Fukuchi, Jun Sakuma, Youhei Akimoto · 2022 · International Joint Conference on Neural Networks (IJCNN)
  70. Evaluation of Techniques for Sim2Real Reinforcement Learning
    Mahesh Ranaweera, Qusay H. Mahmoud · 2023 · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
  71. Cross Domain Class-Aware Clustering Partial Domain Adaptation
    JiaJun OuYang, Shu Zhang, JingBo Jiang, Ting Wang, Junyu Dong · 2023 · IEEE Smart World Congress (SWC)
  72. A soft actor-critic based method for two manipulators coordinated lifting and balancing
    Shijian Liu, Yi Chu Huang · 2024 · Youth Academic Annual Conference of Chinese Association of Automation (YAC)
  73. RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applications
    Xingyu Liu, Chenyangguang Zhang, Gu Wang, Ruida Zhang, Xiangyang Ji · 2024 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  74. Real-Time Parameter Control for Trajectory Generation Using Reinforcement Learning With Zero-Shot Sim-to-Real Transfer
    Chang-Hun Ji, Gyeonghun Lim, Youn‐Hee Han, SungTae Moon · 2024 · IEEE Access
  75. Multi-Agent Reinforcement Learning for High-Efficiency Multi-Finger Robotic Grasping
    Jiashuai Wang, Ke Li · 2024 · International Conference on Advanced Robotics and Mechatronics (ICARM)
  76. VILMO-Grasp: Vision-Integrated Imitation Learning for Meta-Operative Grasping
    Ci Song, Yimin Ji, Xiasheng Ma, Weiyun Yi, Shanlin Zhong · 2024 · International Conference on Advanced Robotics and Mechatronics (ICARM)
  77. Exploring augmentation strategies in mixed reality for autonomous driving with depth cameras
    Imane Argui, Maxime Guériau, Samia Aïnouz · 2024 · Transactions of the Institute of Measurement and Control
  78. Domain Randomization-free Sim-to-Real : An Attention-Augmented Memory Approach for Robotic Tasks
    Jia Qu, Shun Otsubo, Tomoya Yamanokuchi, Takamitsu Matsubara, Shotaro Miwa · 2024 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  79. Curriculum Reinforcement Learning with Hybrid Exploration Strategies for 2D Maze Path Planning
    Zhenyang Tao · 2024 · International Conference on Algorithms, Computing and Systems (ICACS)
  80. Sicgan-Driven Sim-to-Real Transfer: Zero-Shot Deployment on Robotic Manipulators Through Visual Deception
    Lucía Güitta-López, Lionel Güitta-López, Jaime Boal Martín-Larrauri, Álvaro Jesús López López · 2025 · SSRN Electronic Journal
  81. A Schwarz-Christoffel Mapping-based Framework for Sim-to-Real Transfer in Autonomous Robot Operations
    Shijie Gao, Nicola Bezzo · 2025 · Journal of Intelligent & Robotic Systems
  82. Analysis of Methods for Training Robotic Manipulators to Perform Complex Motion Trajectories
    Yurii Senchuk, Fedir D. Matiko · 2025 · Energy Engineering and Control Systems
  83. Domain Adaptation Across Geographic Regions Through Region-Specific Feature Learning and Distribution Matching
    Takashi Horihata, Soh Yoshida, Mitsuji Muneyasu · 2025 · IEEE Access
  84. A Self-Cognitive Grasping Strategy for Edge-Distributed Objects Based on Multi-Stage Perception
    Haodong Luo, Mingshan Xie, Wei Zhang · 2025 · Research Square
  85. Duolingo: Dynamics Utilization for Online Translation of Actions
    Karthikeya Vemuri, Alan Wu, Arnav Thareja, Zoey Qiuyu Chen, Ian Good, Jeffrey I. Lipton, Abhishek Gupta · 2025 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  86. Learning human-to-robot handovers through 3D scene reconstruction
    Yuekun Wu, Yik Lung Pang, Andrea Cavallaro, Changjae Oh · 2025 · IEEE RO-MAN
  87. Deep Reinforcement Learning-Based Levitation Control of Wireless Capsule Endoscope by Robotically Driven Permanent Magnet
    Ding Huang, Zongze Li, Chengzhi Hu · 2025 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  88. Embodiment-Agnostic Legged Manipulation with Whole-Body End-Effector Pose Tracking
    Zhiwei Cai, Aiping Zhou, Xiao Meng Cui, Zhi Zhou Li · 2025 · International Conference on Industrial Artificial Intelligence (IAI)
  89. ADR-PNAS: A Novel Sim-to-Real Transfer Approach for Robotic Manipulation Tasks
    Yu Nong, Hai-Tao Zhang, Jia-Qiang Sun · 2025 · IEEE Transactions on Robotics
  90. Steering Control for High-Speed Locomotion of Wheeled-Legged Quadrupedal Robots Based on Vertical Joint Steering
    Yifan Zhang, Zhicheng Zhao, Xinyuan Shi, Shijun Xiao, Xuewen Rong · 2025 · International Conference on Robotics, Intelligent Control and Artificial Intelligence (RICAI)
  91. InverseLight: Inverse Dynamics Enabling Policy Transfer with Limited Data for Traffic Signal Control
    Yang Zhang, Ziyu Bian, Qiyuan Liu, Zhiheng Li · 2025 · IEEE International Conference on Intelligent Transportation Systems (ITSC)
  92. Illy-Net: A Data-Efficient Surrogate-Based Framework for Sim-to-Real Policy Ranking in Robotic Grasping with Minimal Real-World Trials
    Subin Im, Jaeseon Lee · 2026 · International Journal of Precision Engineering and Manufacturing
  93. AI Technologies in the Field of Space Robotics: A Review
    Yaobing Wang, Jijun Yu, D. Li, Changchun LIANG, Jianfei Cao, Zequan Zeng, Kai Wang · 2026 · Advances in Astronautics
  94. Apprentissage profond auto-supervisé par simulation pour la saisie robotique adaptative
    Amaury Depierre · 2021 · theses.fr (ABES)
  95. Robots that can see : Learning visually guided behavior
    Alexander Pashevich · 2021 · theses.fr (ABES)
  96. Deep learning interpretability with visual analytics : Exploring reasoning and bias exploitation
    Théo Jaunet · 2022 · theses.fr (ABES)
  97. A vision-based mixed-reality framework for testing autonomous driving systems
    Imane Argui · 2024
  98. Improving Cooperation in Multi-agent Deep Reinforcement Learning for Mobile Robotics
    Maxime Toquebiau · 2024 · theses.fr (ABES)
  99. Tactile Sensing for Grasp Stability and Adaptation
    Dounia Kitouni · 2024
  100. Improving Novelty Search Sample Efficiency with Models or Archive Bootstrapping
    Elias Hanna · 2024 · theses.fr (ABES)