The DOI matches its Crossref record; 40 of the 45 references it cites were found in a registry or an index.
Grasping in the Wild: Learning 6DoF Closed-Loop Grasping From Low-Cost Demonstrations
Open accessAbstract
Intelligent manipulation benefits from the capacity to flexibly control an end-effector with high degrees of freedom (DoF) and dynamically react to the environment. However, due to the challenges of collecting effective training data and learning efficiently, most grasping algorithms today are limited to top-down movements and open-loop execution. In this work, we propose a new low-cost hardware interface for collecting grasping demonstrations by people in diverse environments. This data makes it possible to train a robust end-to-end 6DoF closed-loop grasping model with reinforcement learning that transfers to real robots. A key aspect of our grasping model is that it uses “action-view” based rendering to simulate future states with respect to different possible actions. By evaluating these states using a learned value function (e.g., Q-function), our method is able to better select corresponding actions that maximize total rewards (i.e., grasping success). Our final grasping system is able to achieve reliable 6DoF closed-loop grasping of novel objects across various scene configurations, as well as in dynamic scenes with moving objects.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While these approaches simplify tool design, they still require a system-specific tool or modifications to a robot's original hardware to align the end-effector's physical interactions and the recorded visual observations.”
From LEGATO: Cross-Embodiment Imitation Using a Grasping Tool (2025) · cites this paper as [11]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“Compared to other methods of aggregating past observations such as using recurrent neural networks or LSTMs [38], our TSDF fusion explicitly leverages accurate industrial-grade robot motion in order to reduce the burden of learning view point registration or 3D reconstruction inside the network.”
MethodDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008 · cited 1×
“The sign of that value indicates whether the voxel is in free space or occluded space [4, 22, 35].”
BackgroundA volumetric method for building complex models from range images
Curless, B., & Levoy, M. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237269 · Cited by 3,124 · cited 1×
“The sign of that value indicates whether the voxel is in free space or occluded space [35]–[37].”
BackgroundMethod for registration of 3-D shapes:
Besl, P. J., & McKay, N. D. (1992) · SPIE Proceedings · doi:10.1117/12.57955 · Cited by 2,413
Levine, S., Pastor, P., Krizhevsky, A., Ibarz, J., & Quillen, D. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917710318 · Cited by 1,971 · cited 2×
“vily depend on acquiring high-quality training data. However, most prior self-supervised grasping systems are often constrained to learning in simulation [30,18,19, 27] or structured lab environments [23,36,15,14]. Gupta et al. [9] improves the data collection process by physically moving a robot into different enviro…”
BackgroundMethodDeep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634 · cited 2×
“With human experts directly annotating the training data [2], [22] or controlling the robot via teleoperation [7], [26], the system can quickly obtain positive examples to speed up the training process.”
BackgroundMahler, J., Liang, J., Niyaz, S., Laskey, M., Doan, R., Liu, X., Aparicio, J., & Goldberg, K. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.058 · Cited by 1,268
3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions
Zeng, A., Song, S., Niessner, M., Fisher, M., Xiao, J., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.29 · Cited by 1,128
Self-citationSupersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047 · cited 4×
“in simple tabletop settings [23, 37, 36], or detect grasps in 6DoF but with open-loop execution [17, 21, 7].”
BackgroundInfluential
Research works printed but not linked: 2
- hester, 0, Proc Assoc Advance Artif Intell, 3223
- besl, 1992, Sensor Fusion IV
Cited by
GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators
Wu, P., Shentu, Y., Yi, Z., Lin, X., & Abbeel, P. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801581 · Cited by 403
“The focus for the design of GELLO is to create an interface that is both economically accessible and easy-to-use for users aiming to render high-quality demonstrations in robot learning.”
DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation
Wang, C., Shi, H., Wang, W., Zhang, R., Fei-Fei, L., & Liu, C. K. (2024) · Robotics: Science and Systems · doi:10.15607/rss.2024.xx.043 · Cited by 390
(2021) · doi:10.1109/icra48506.2021.9561877 · Cited by 370
“To address the limitations of planar grasping, there has been a recent interest in tackling the problem of 6-DoF grasping of unknown objects [10, 11, 12, 13, 14].”
BackgroundDexMV: Imitation Learning for Dexterous Manipulation from Human Videos
Qin, Y., Wu, Y.-H., Liu, S., Jiang, H., Yang, R., Fu, Y. L., & Wang, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19842-7_33 · Cited by 340
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation
Simeonov, A., Du, Y., Tagliasacchi, A., Tenenbaum, J. B., Rodríguez, A., Agrawal, P., & Sitzmann, V. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812146 · Cited by 313
Metadata
- Authors
- Song, S., Zeng, A., Lee, J., & Funkhouser, T.
- Affiliations
- Google (United States) (US)
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2020-07
- Volume
- 5
- Issue
- 3
- Pages
- 4978-4985
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W3037767967
- Cited by
- 185
- References
- 45
- Citations by year
- 2026: 12 · 2025: 33 · 2024: 35 · 2023: 44 · 2022: 32 · 2021: 18 · 2020: 11
- FWCI
- 12.98
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Robotics and Automation Letters (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Keywords
- end-effector control, human demonstrations, reinforcement learning, Q-function, dynamic scenes, novel object grasping, robotic manipulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Grasping in the Wild: Learning 6DoF Closed-Loop Grasping From Low-Cost Demonstrations. https://app.cochat.ai/papers/10.1109/lra.2020.3004787
- The paper
- Song, S., Zeng, A., Lee, J., & Funkhouser, T. (2020). Grasping in the Wild: Learning 6DoF Closed-Loop Grasping From Low-Cost Demonstrations. IEEE Robotics and Automation Letters. https://doi.org/10.1109/lra.2020.3004787
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.