The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Object recognition and full pose registration from a single image for robotic manipulation
Open accessAbstract
Robust perception is a vital capability for robotic manipulation in unstructured scenes. In this context, full pose estimation of relevant objects in a scene is a critical step towards the introduction of robots into household environments. In this paper, we present an approach for building metric 3D models of objects using local descriptors from several images. Each model is optimized to fit a set of calibrated training images, thus obtaining the best possible alignment between the 3D model and the real object. Given a new test image, we match the local descriptors to our stored models online, using a novel combination of the RANSAC and Mean Shift algorithms to register multiple instances of each object. A robust initialization step allows for arbitrary rotation, translation and scaling of objects in the test images. The resulting system provides markerless 6-DOF pose estimation for complex objects in cluttered scenes. We provide experimental results demonstrating orientation and translation accuracy, as well a physical implementation of the pose output being used by an autonomous robot to perform grasping in highly cluttered scenes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Generalizing the Hough transform to detect arbitrary shapes
Ballard, D. H. (1981) · Pattern Recognition · doi:10.1016/0031-3203(81)90009-1 · Cited by 4,371
Mean shift, mode seeking, and clustering
Cheng, Y. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.400568 · Cited by 3,856
EPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
Multiple View Geometry in Computer Vision (2nd ed)
Hartley, R. I., & Zisserman, A. (2003) · Cambridge University Press eBooks · Cited by 2,761
Marker tracking and HMD calibration for a video-based augmented reality conferencing system
Kato, H., & Billinghurst, M. (2003) · Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99) · doi:10.1109/iwar.1999.803809 · Cited by 2,194
A Generalized Solution of the Orthogonal Procrustes Problem
Schönemann, P. H. (1966) · Psychometrika · doi:10.1007/bf02289451 · Cited by 2,040
Model-based object pose in 25 lines of code
Dementhon, D. F., & Davis, L. S. (1995) · International Journal of Computer Vision · doi:10.1007/bf01450852 · Cited by 1,009
Multiple view geometry in computer visiond
Hartley, R. I., & Zisserman, A. (2001) · Cambridge University Press eBooks · Cited by 883
Shape indexing using approximate nearest-neighbour search in high-dimensional spaces
Beis, J. S., & Lowe, D. G. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609451 · Cited by 879
Stable real-time 3D tracking using online and offline information
Vacchetti, L., Lepetit, V., & Fua, P. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.92 · Cited by 328
Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares
Szeliski, R., & Kang, S. B. (1994) · Journal of Visual Communication and Image Representation · doi:10.1006/jvci.1994.1002 · Cited by 328
On the sensitivity of the Hough transform for object recognition
Grimson, W. E. L., & Huttenlocher, D. P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.49052 · Cited by 232
Manipulation planning with Workspace Goal Regions
Berenson, D., Srinivasa, S. S., Ferguson, D., Collet, A., & Kuffner, J. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152401 · Cited by 156
Self-citationWhat and Where: 3D Object Recognition with Accurate Pose
Gordon, I., & Lowe, D. G. (2006) · Lecture notes in computer science · doi:10.1007/11957959_4 · Cited by 151
Object recognition and pose estimation using color cooccurrence histograms and geometric modeling
Ekvall, S., Kragic, D., & Hoffmann, F. (2005) · Image and Vision Computing · doi:10.1016/j.imavis.2005.05.006 · Cited by 52
Fusion of Multimodal Visual Cues for Model-Based Object Tracking
Taylor, G., & Kleeman, L. (2003) · Cited by 49
N3M: Natural 3D Markers for Real-Time Object Detection and Pose Estimation
Hinterstoißer, S., Benhimane, S., & Navab, N. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409004 · Cited by 42
Calculating the 3d-pose of rigid-objects using active appearance models
Mittrapiyanumic, P., DeSouza, G. N., & Kak, A. C. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1302534 · Cited by 40
Detection and Localization of Multiple Objects
Zickler, S., & Veloso, M. (2006) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2006.321358 · Cited by 34
Edge-Projected Integration of Image and Model Cues for Robust Model-Based Object Tracking
Vincze, M., Ayromlou, M., Ponweiser, W., & Zillich, M. (2001) · The International Journal of Robotics Research · doi:10.1177/02783640122067534 · Cited by 22
Automatic dismantling integrating optical flow into a machine vision-controlled robot system
Gengenbach, V., Nagel, H.-H., Tonko, M., & Schafer, K. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1996.506889 · Cited by 19
Gabor filters for object localization and robot grasping
Walter, J., & Bert Arnrich, A. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.902879 · Cited by 10
Calculating the 3D-Pose of Rigid-Objects Using Active Appearance Models
Mittrapiyanuruk, P., DeSouza, G., & Kak, A. C. (2004) · MOspace Institutional Repository (University of Missouri) · Cited by 8
Cited by
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124
“There has also been some success with only monocular camera images [5].”
BackgroundMethodDeep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Data-Driven Grasp Synthesis—A Survey
Bohg, J., Morales, A., Asfour, T., & Kragic, D. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2289018 · Cited by 929
Multimodal deep learning for robust RGB-D object recognition
Eitel, A., Springenberg, J. T., Spinello, L., Riedmiller, M., & Burgard, W. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353446 · Cited by 631
Deep visual foresight for planning robot motion
Finn, C., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989324 · Cited by 599
Metadata
- Authors
- Collet, A., Berenson, D., Srinivasa, S. S., & Ferguson, D.
- Venue
- 2009 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2009-05
- Pages
- 48-55
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2146447720
- Cited by
- 275
- References
- 28
- FWCI
- 21.26
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.