Interactive segmentation, tracking, and kinematic modeling of unknown 3D articulated objects
Open accessThe DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Abstract
We present an interactive perceptual skill for segmenting, tracking, and modeling the kinematic structure of 3D articulated objects. This skill is a prerequisite for general manipulation in unstructured environments. Robot-environment interactions are used to move an unknown object, creating a perceptual signal that reveals the kinematic properties of the object. The resulting perceptual information can then inform and facilitate further manipulation. The algorithm is computationally efficient, handles partial occlusions, and depends on little object motion; it only requires sufficient texture for visual feature tracking. We conducted experiments with everyday objects on a robotic manipulation platform equipped with an RGB-D sensor. The results demonstrate the robustness of the proposed method to lighting conditions, object appearance, size, structure, and configuration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Katz et al. [18] is the pioneer work that introduces interactive perception [2] for articulation model estimation.”
From Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception (2023) · cites this paper as [18]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
(1981) · Cited by 11,963
Least-Squares Fitting of Two 3-D Point Sets
Arun, K. S., Huang, T. S., & Blostein, S. D. (1987) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1987.4767965 · Cited by 3,952 · cited 1×
“To handle measurement noise, we find the optimal transformation by solving a least square minimization problem using singular value decomposition (SVD) [2].”
MethodComputer Vision: A Modern Approach
Forsyth, D. A., & Ponce, J. (2002) · Cited by 3,739
Blake, A., & Yuille, A. (1993) · Cited by 1,383
Aloimonos, J., Weiss, I., & Bandyopadhyay, A. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133571 · Cited by 931 · cited 1×
“Existing segmentation methods typically analyze a single image, identifying discontinuities in color, brightness, texture, or depth [1], [4].”
BackgroundManipulating articulated objects with interactive perception
Katz, D., & Brock, O. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543220 · Cited by 135 · cited 2×
“[5], [7] extract kinematic models of planar articulated objects.”
BackgroundSelf-citationInteractive segmentation for manipulation in unstructured environments
Kenney, J., Buckley, T., & Brock, O. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152393 · Cited by 99 · cited 1×
“These algorithms [3], [8] rely on the robot’s body to generate motion, thereby revealing a visual signal which can be analyzed to segment the moving rigid bodies.”
BackgroundFirst contact: an active vision approach to segmentation
Fitzpatrick, P. (2004) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2003.1249191 · Cited by 77 · cited 1×
“These algorithms [3], [8] rely on the robot’s body to generate motion, thereby revealing a visual signal which can be analyzed to segment the moving rigid bodies.”
BackgroundKatz, D., Pyuro, Y., & Brock, O. (2008) · Robotics: Science and Systems IV · doi:10.15607/rss.2008.iv.033 · Cited by 70 · cited 5×
“These interactions can also be random (not efficient), or better: learned from experience [7].”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 1
- arun, 1987, Least-squares fitting of two 3d point sets, IPAMI, 9, 698
Cited by
Category-Level Articulated Object Pose Estimation
Li, X., Wang, H., Yi, L., Guibas, L. J., Abbott, A. L., & Song, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00376 · Cited by 196
URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Images
Chen, Q., Walsman, A., Memmel, M., Mo, K., Fang, A., Fox, D., & Gupta, A. (2024) · Robotics: Science and Systems · doi:10.15607/rss.2024.xx.124 · Cited by 146
Fast odometry and scene flow from RGB-D cameras based on geometric clustering
Jaimez, M., Kerl, C., González-Jiménez, J., & Cremers, D. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989459 · Cited by 132
“In general, these methods cannot provide a dense scene flow, but there exist extensions to estimate the motion of multiple rigid objects [5].”
MethodScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theory
Jain, A., Lioutikov, R., Chuck, C., & Niekum, S. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561132 · Cited by 61
“Katz and Brock [21] first studied IP to learn articulated motion models for planar objects [21], and later extended it to learn 3D kinematics of articulated objects [22].”
BackgroundVAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated ObjectsPreprint
Wu, R., Zhao, Y. L., Mo, K., Guo, Z., Wang, Y., Wu, T., Fan, Q., Chen, X., Guibas, L. J., & Dong, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14440 · Cited by 104
“A vast literature (Yan & Pollefeys, 2006; Katz et al., 2008; Sturm et al., 2009; 2011; Huang et al., 2012; Katz et al., 2013; Martin & Brock, 2014; Höfer et al., 2014; Katz et al., 2014; Schmidt et al., 2014; Hausman et al., 2015; Martı́n-Martı́n et al., 2016; Tzionas & Gall, 2016; Paolillo et…”
Background
Metadata
- Authors
- Katz, D., Kazemi, M., Andrew Bagnell, J., & Stentz, A.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- 2013 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2013-05
- Pages
- 5003-5010
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2159461149
- Cited by
- 74
- References
- 17
- Citations by year
- 2025: 1 · 2024: 3 · 2023: 6 · 2022: 6 · 2021: 6 · 2020: 6 · 2019: 7 · 2018: 5 · 2017: 7 · 2016: 7 · 2015: 10 · 2014: 6 · 2013: 4
- FWCI
- 12.29
- Type
- conference paper
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- Figshare (submittedVersion, cc-by)
- KiltHub Repository (submittedVersion)
- KiltHub Repository
- Funders
- Defense Advanced Research Projects Agency
- Army Research Laboratory (W911NF, W911NF-10-2-0016)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- interactive segmentation, object tracking, kinematic modeling, articulated objects, robotic manipulation, unknown object, RGB-D sensing, visual feature tracking, partial occlusion, robot-environment interaction, perceptual skills
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interactive segmentation, tracking, and kinematic modeling of unknown 3D articulated objects. https://app.cochat.ai/papers/10.1109/icra.2013.6631292
- The paper
- Katz, D., Kazemi, M., Andrew Bagnell, J., & Stentz, A. (2013). Interactive segmentation, tracking, and kinematic modeling of unknown 3D articulated objects. 2013 IEEE International Conference on Robotics and Automation. https://doi.org/10.1109/icra.2013.6631292
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.