Learning Articulated Motions From Visual Demonstration
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Many functional elements of human homes and workplaces consist of rigid components which are connected through one or more sliding or rotating linkages.Examples include doors and drawers of cabinets and appliances; laptops; and swivel office chairs.A robotic mobile manipulator would benefit from the ability to acquire kinematic models of such objects from observation.This paper describes a method by which a robot can acquire an object model by capturing depth imagery of the object as a human moves it through its range of motion.We envision that in future, a machine newly introduced to an environment could be shown by its human user the articulated objects particular to that environment, inferring from these "visual demonstrations" enough information to actuate each object independently of the user.Our method employs sparse (markerless) feature tracking, motion segmentation, component pose estimation, and articulation learning; it does not require prior object models.Using the method, a robot can observe an object being exercised, infer a kinematic model incorporating rigid, prismatic and revolute joints, then use the model to predict the object's motion from a novel vantage point.We evaluate the method's performance, and compare it to that of a previously published technique, for a variety of household objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 5×
“At each image scale, we compute the SURF descriptor [1] over features that were predicted from the previous step, denoted as f̂ t, and compare them with the description of the detected features at time t, denoted as f .”
MethodInfluentialShi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 2×
“We employ Good Features To Track (GFTT) [20] to initialize up to 1500 salient features with a quality level of 0.04 or greater, across multiple image scales.”
MethodInfluentialiSAM2: Incremental smoothing and mapping using the Bayes tree
Kaess, M., Johannsson, H., Roberts, R., Ila, V., Leonard, J. J., & Dellaert, F. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911430419 · Cited by 1,362
Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Interactive segmentation, tracking, and kinematic modeling of unknown 3D articulated objects
Katz, D., Kazemi, M., Andrew Bagnell, J., & Stentz, A. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631292 · Cited by 74 · cited 4×
“Like other feature-based methods [14] our method requires visual texture.”
MethodInfluential
Cited by
Interactive perception: Leveraging action in perception and perception in action
Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., & Sukhatme, G. S. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2721939 · Cited by 227
“[99], and Martı́n Martı́n and Brock [96] aim at understanding the structure of AO by observing their motion when they are interacted with.”
BackgroundMethodActive articulation model estimation through interactive perception
Hausman, K., Niekum, S., Osentoski, S., & Sukhatme, G. S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139655 · Cited by 77
ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theory
Jain, A., Lioutikov, R., Chuck, C., & Niekum, S. (2020) · arXiv · doi:10.48550/arxiv.2008.10518 · Cited by 63
Sung, J., Jin, S. H., & Saxena, A. (2018) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-319-60916-4_40 · Cited by 52
“Manipulating new instances of objects relies on finding articulation [50, 39] or using interaction [23] but requires tracking with a vision algorithm.”
BackgroundDitto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161431 · Cited by 21
“Some following works extend it with hierarchical recursive Bayesian filters [25], probabilistic models [38], and feature tracking [33].”
Background
Metadata
- Authors
- Pillai, S., Walter, M., & Teller, S.
- Venue
- Robotics: Science and Systems X
- Published
- 2014-07-12
- OpenAlex
- W1548410568
- Cited by
- 39
- References
- 6
- FWCI
- 6.48
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.