CoChat
Sign Up
PreprintCited by 30Reinforcement Learning in RoboticsRobot Manipulation and LearningDomain Adaptation and Few-Shot Learning

DoorGym: A Scalable Door Opening Environment And Baseline Agent

Open access
Urakami, Yusuke, Hodgkinson, Alec, Carlin, Casey, Leu, Randall, Rigazio, Luca, Abbeel, Pieter·2019·arXiv
DOI 10.48550/arxiv.1908.01887arXiv 1908.01887
Open this paper in CoChat — free accountOpen PDF

Abstract

In order to practically implement the door opening task, a policy ought to be robust to a wide distribution of door types and environment settings. Reinforcement Learning (RL) with Domain Randomization (DR) is a promising technique to enforce policy generalization, however, there are only a few accessible training environments that are inherently designed to train agents in domain randomized environments. We introduce DoorGym, an open-source door opening simulation framework designed to utilize domain randomization to train a stable policy. We intend for our environment to lie at the intersection of domain transfer, practical tasks, and realism. We also provide baseline Proximal Policy Optimization and Soft Actor-Critic implementations, which achieves success rates between 0% up to 95% for opening various types of doors in this environment. Moreover, the real-world transfer experiment shows the trained policy is able to work in the real world. Environment kit available here: https://github.com/PSVL/DoorGym/

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1908.01887

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Achieving realism for a diverse set of activities remains a tremendous challenge due to the effort required to provide realistic models and simulation features.

    “While significant progress in realism has been made in specific domains [43-45], achieving realism for a diverse set of activities remains a tremendous challenge, due to the effort required to provide realistic models and simulation features.”

    From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [44]

    Section 2 (p. 3) describes a realism trade-off in door-opening simulation: MuJoCo provides rich physical simulation but sacrifices visual realism, prompting the authors to use Unity. This supports the general difficulty of achieving realism, but the paper does not say that realism across diverse activities is a tremendous challenge because realistic models and simulation features require substantial effort. (LLM, conf=0.72)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 25

  1. [1][1] E. Klingbeil, A. Saxena, and A. Y. Ng. Learning to open new doors. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems , pages 2751-2757, 2010. -
  2. [3][3] B. Nemec, L. Žlajpah, and A. Ude. Door opening by joining reinforcement learning and intelligent control. In 2017 18th International Conference on Advanced Robotics (ICAR) , 2017. -
  3. [4][4] S. Gu, E. Holly, T. Lillicrap, and S. Levine. Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates. In 2017 IEEE International Conference on Robotics and Automation (ICRA) , pages 3389-3396, May 2017. doi: 10.1109/ICRA.2017.7989385. - · DOI
  4. [5][5] Y. Karayiannidis, C. Smith, F. E. Viña, P. Ogren, and D. Kragic. 'open sesame!' adaptive force/velocity control for opening unknown doors. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems , 2012. -
  5. [6][6] F. Endres, J. Trinkle, and W. Burgard. Learning the dynamics of doors for robotic manipulation. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems , pages 35433549, 2013. -
  6. [7][7] D. Anguelov, D. Koller, E. Parker, and S. Thrun. Detecting and modeling doors with mobile robots. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 , volume 4, pages 3777-3784 Vol.4, April 2004. doi: 10.1109/ROBOT.2004.1308857. - · DOI
  7. [8][8] R. B. Rusu, W. Meeussen, S. Chitta, and M. Beetz. Laser-based perception for door and handle identification. In 2009 International Conference on Advanced Robotics , pages 1-8, June 2009. -
  8. [9][9] M. Kalakrishnan, L. Righetti, P. Pastor, and S. Schaal. Learning force control policies for compliant manipulation. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems , pages 4639-4644, Sep. 2011. doi: 10.1109/IROS.2011.6095096. - · DOI · Paper page
  9. [11][11] A. Rajeswaran, V. Kumar, A. Gupta, J. Schulman, E. Todorov, and S. Levine. Learning complex dexterous manipulation with deep reinforcement learning and demonstrations. CoRR , abs/1709.10087, 2017. URL http://arxiv.org/abs/1709.10087 . - · arXiv
  10. [12][12] A. Rajeswaran, S. Ghotra, S. Levine, and B. Ravindran. Epopt: Learning robust neural network policies using model ensembles. CoRR , abs/1610.01283, 2016. URL http://arxiv.org/ abs/1610.01283 . - · arXiv
  11. [13][13] F. Sadeghi and S. Levine. (cad)$ˆ2$rl: Real single-image flight without a single real image. CoRR , abs/1611.04201, 2016. URL http://arxiv.org/abs/1611.04201 . - · arXiv
  12. [14][14] J. Tobin, R. Fong, A. Ray, J. Schneider, W. Zaremba, and P. Abbeel. Domain randomization for transferring deep neural networks from simulation to the real world. CoRR , abs/1703.06907, 2017. - · arXiv
  13. [15][15] F. Sadeghi, A. Toshev, E. Jang, and S. Levine. Sim2real view invariant visual servoing by recurrent control. CoRR , abs/1712.07642, 2017. URL http://arxiv.org/abs/1712.07642 . - · arXiv
  14. [16][16] X. B. Peng, M. Andrychowicz, W. Zaremba, and P. Abbeel. Sim-to-real transfer of robotic control with dynamics randomization. CoRR , abs/1710.06537, 2017. - · arXiv
  15. [17][17] OpenAI, M. Andrychowicz, B. Baker, M. Chociej, R. Józefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba. Learning dexterous in-hand manipulation. CoRR , 2018. URL http://arxiv.org/abs/1808.00177 . - · arXiv
  16. [19][19] Y. Tassa, Y. Doron, A. Muldal, T. Erez, Y. Li, D. de Las Casas, D. Budden, A. Abdolmaleki, J. Merel, A. Lefrancq, T. P. Lillicrap, and M. A. Riedmiller. Deepmind control suite. CoRR , abs/1801.00690, 2018. URL http://arxiv.org/abs/1801.00690 . - · arXiv
  17. [20][20] A. Mandlekar, Y. Zhu, A. Garg, J. Booher, M. Spero, A. Tung, J. Gao, J. Emmons, A. Gupta, E. Orbay, S. Savarese, and L. Fei-Fei. Roboturk: A crowdsourcing platform for robotic skill learning through imitation. CoRR , abs/1811.02790, 2018. URL bit.ly/2XJsT9N . - · arXiv
  18. [22][22] L. Fan, Y. Zhu, J. Zhu, Z. Liu, O. Zeng, A. Gupta, J. Creus-Costa, S. Savarese, and L. Fei-Fei. Surreal: Open-source reinforcement learning framework and robot manipulation benchmark. In Proceedings of The 2nd Conference on Robot Learning , volume 87 of Proceedings of Machine Learning Research , pages 767-782. PMLR, 29-31 Oct 2018. URL http://proceedings. mlr.press/v87/fan18a.html . -
  19. [23][23] E. Todorov, T. Erez, and Y. Tassa. Mujoco: A physics engine for model-based control. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems , pages 5026-5033, 2012. -
  20. [26][26] D. V. Gealy, S. McKinley, B. Yi, P. Wu, P. R. Downey, G. Balke, A. Zhao, M. Guo, R. Thomasson, A. Sinclair, P. Cuellar, Z. McCarthy, and P. Abbeel. Quasi-direct drive for low-cost compliant robotic manipulation. CoRR , abs/1904.03815, 2019. URL http: //arxiv.org/abs/1904.03815 . - · arXiv
  21. [27][27] S. Levine, N. Wagener, and P. Abbeel. Learning contact-rich manipulation skills with guided policy search. CoRR , abs/1501.05611, 2015. URL http://arxiv.org/abs/1501.05611 . - · arXiv
  22. [29][29] T. Haarnoja, A. Zhou, P. Abbeel, and S. Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. CoRR , abs/1801.01290, 2018. - · arXiv
  23. [31][31] R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning , 8(3):229-256, 1992. ISSN 1573-0565. doi: 10.1007/BF00992696. - · DOI
  24. [32][32] J. Schulman, P. Moritz, S. Levine, M. Jordan, and P. Abbeel. High-dimensional continuous control using generalized advantage estimation. In Proceedings of the International Conference on Learning Representations (ICLR) , 2016. -
  25. [34][34] D. P. Kingma and J. Ba. Adam: A method for stochastic optimization, 2014. cite arxiv:1412.6980Comment: Published as a conference paper at the 3rd International Conference for Learning Representations, San Diego, 2015.

Cited by

Sorted by citations

Authors
Urakami, Y., Hodgkinson, A., Carlin, C., Leu, R., Rigazio, L., & Abbeel, P.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1908.01887
arXiv
1908.01887
OpenAlex
W2965293401
Cited by
30
References
2
Citations by year
2024: 3 · 2023: 7 · 2022: 2 · 2021: 10 · 2020: 8
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
door opening, domain randomization, reinforcement learning, domain transfer, proximal policy optimization, soft actor-critic, robotic manipulation, policy generalization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review