The DOI matches its DataCite record; 51 of the 59 references it cites were found in a registry or an index.
Where2Act: From Pixels to Actions for Articulated 3D Objects
Open accessAbstract
One of the fundamental goals of visual perception is to allow agents to meaningfully interact with their environment. In this paper, we take a step towards that long-term goal -- we extract highly localized actionable information related to elementary actions such as pushing or pulling for articulated objects with movable parts. For example, given a drawer, our network predicts that applying a pulling force on the handle opens the drawer. We propose, discuss, and evaluate novel network architectures that given image and depth data, predict the set of actions possible at each pixel, and the regions over articulated parts that are likely to move under the force. We propose a learning-from-interaction framework with an online data sampling strategy that allows us to train the network in simulation (SAPIEN) and generalizes across categories. Check the website for code and data release: https://cs.stanford.edu/~kaichun/where2act/
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Another line of research acquires active training data with simulated or real robots for affordance learning [16, 19, 26, 28, 41].”
From Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception (2023) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric SpacePreprint
Qi, C. R., Yi, L., Su, H., & Guibas, L. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02413 · Cited by 10,099
Self-citation3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298801 · Cited by 5,413
A Point Set Generation Network for 3D Object Reconstruction from a Single Image
Fan, H., Su, H., & Guibas, L. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.264 · Cited by 2,513
Self-citationShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Self-citationPoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Xiang, Y., Schmidt, T., Narayanan, V., & Fox, D. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.019 · Cited by 2,139
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,774
Self-citationMedical Image Computing and Computer-Assisted Intervention — MICCAI’98
Roche, A., Malandain, G., Pennec, X., & Ayache, N. (1998) · Lecture notes in computer science · doi:10.1007/bfb0056181 · Cited by 1,578
Research works printed but not linked: 1
- Zihao Yan, Ruizhen Hu, Xingguang Yan, Luanmin Chen, Oliver Van Kaick, Hao Zhang, and Hui Huang. Rpm-net: Recurrent prediction of motion and parts from point cloud. ACM Transactions on Graphics (TOG), 38(6):240, 2019. 2
Cited by
Sorted by citations
OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction
Yang, L., Li, K., Zhan, X., Wu, F., Xu, A., Liu, L., & Lu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02028 · Cited by 99
Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks
Nasiriany, S., Liu, H., & Zhu, Y. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9812140 · Cited by 91
Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation
Mittal, M., Hoeller, D., Farshidian, F., Hutter, M., & Garg, A. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981779 · Cited by 91
A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representation
Mu, J., Qiu, W., Kortylewski, A., Yuille, A., Vasconcelos, N. M., & Wang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01276 · Cited by 85
Geng, H., Xu, H., Zhao, C., Xu, C., Yi, L., Huang, S., & Wang, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00684 · Cited by 121
Dai, Q., Zhang, J., Li, Q., Wu, T., Dong, H., Liu, Z., Tan, P., & Wang, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19842-7_22 · Cited by 75
AKB-48: A Real-World Articulated Object Knowledge Base
Liu, L., Xu, W., Fu, H., Qian, S., Yu, Q., Yang, H., & Lu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01439 · Cited by 70
RLAfford: End-to-End Affordance Learning for Robotic Manipulation
Geng, Y., An, B., Geng, H., Chen, Y., Yang, Y., & Dong, H. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161571 · Cited by 57
Universal Manipulation Policy Network for Articulated Objects
Xu, Z., He, Z., & Song, S. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3142397 · Cited by 56
From screens to scenes: A survey of embodied AI in healthcare
Liu, Y., Cao, X., Chen, T., Jiang, Y., You, J., Wu, M., Wang, X., Feng, M., Jin, Y., & Chen, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103033 · Cited by 76
Track2Act: Predicting Point Tracks from Internet Videos Enables Generalizable Robot Manipulation
Bharadhwaj, H., Mottaghi, R., Gupta, A., & Tulsiani, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73116-7_18 · Cited by 98
Self-citationJu, Y., Hu, K., Zhang, G., Zhang, G., Jiang, M., & Xu, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_13 · Cited by 42
Wang, Y., Wu, R., Mo, K., Ke, J., Fan, Q., Guibas, L. J., & Dong, H. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19818-2_6 · Cited by 40
Self-citationDexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects
Bao, C., Xu, H., Qin, Y., & Wang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02030 · Cited by 40
PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objects
Liu, J., Amiri, A. M., & Savva, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00039 · Cited by 38
Act the Part: Learning Interaction Strategies for Articulated Object Part Discovery
Gadre, S. Y., Ehsani, K., & Song, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01546 · Cited by 36
Grounding 3D Object Affordance from 2D Interactions in Images
Yang, Y., Zhai, W., Luo, H., Cao, Y. H., Luo, J., & Zha, Z.-J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01001 · Cited by 32
Human Hands as Probes for Interactive Object Understanding
Goyal, M., Modi, S., Goyal, R., & Gupta, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00329 · Cited by 31
GIFT: Generalizable Interaction-aware Functional Tool Affordances without Labels
Turpin, D., Wang, L., Tsogkas, S., Dickinson, S., & Garg, A. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.060 · Cited by 30
Affordance Learning from Play for Sample-Efficient Policy Learning
Borja-Diaz, J., Mees, O., Kalweit, G., Hermann, L., Boedecker, J., & Burgard, W. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9811889 · Cited by 32
Geng, H., Li, Z., Geng, Y., Chen, J., Dong, H., & Wang, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00291 · Cited by 31
Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objects
Weng, Y., Wen, B., Tremblay, J., Blukis, V., Fox, D., Guibas, L. J., & Birchfield, S. T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00303 · Cited by 26
Self-citationHuang, S., Ponomarenko, I., Jiang, Z., Li, X., Hu, X., Gao, P., Li, H., & Dong, H. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801993 · Cited by 43
A Survey of Embodied Learning for Object-centric Robotic Manipulation
Zheng, Y., Yao, L., Su, Y., Zhang, Y., Wang, Y., Zhao, S., Zhang, Y., & Chau, L. (2025) · Machine Intelligence Research · doi:10.1007/s11633-025-1542-8 · Cited by 56
VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated ObjectsPreprint
Wu, R., Zhao, Y. L., Mo, K., Guo, Z., Wang, Y., Wu, T., Fan, Q., Chen, X., Guibas, L. J., & Dong, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14440 · Cited by 25
Self-citationTac-Man: Tactile-Informed Prior-Free Manipulation of Articulated Objects
Zhao, Z., Li, Y., Li, W., Qi, Z., Ruan, L., Zhu, Y., & Althoefer, K. A. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3508134 · Cited by 22
Contact2Grasp: 3D Grasp Synthesis via Hand-Object Contact Constraint
Li, H., Lin, X., Zhou, Y. M., Li, X., Huo, Y., Chen, J., & Ye, Q. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/117 · Cited by 23
Embodied AI: A Survey on the Evolution from Perceptive to Behavioral Intelligence
Yifan, C., Wei, M., Wang, X., Liu, Y., Wang, J., Song, H., Ma, L., Di, D., Sun, C., Liu, K., et al. (2025) · SmartBot · doi:10.1002/smb2.70003 · Cited by 30
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161431 · Cited by 21
Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Plans
Bharadhwaj, H., Gupta, A., Kumar, V., & Tulsiani, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610288 · Cited by 35
Self-citationRecent Advances of Deep Robotic Affordance Learning: A Reinforcement Learning Perspective
Yang, X., Ji, Z., Wu, J., & Lai, Y. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3277288 · Cited by 24
Wu, R., Lu, H., Wang, Y., Wang, Y., & Dong, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01546 · Cited by 20
3D Implicit Transporter for Temporally Consistent Keypoint Discovery
Zhong, C., Zheng, Y., Zheng, Y., Zhao, H., Yi, L., Mu, X., Wang, L., Li, P., Zhou, G., Yang, C., et al. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00358 · Cited by 19
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images
Yang, Y., Zhai, W., Luo, H., Cao, Y. H., & Zha, Z.-J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01541 · Cited by 28
Seeing the Unseen: Visual Common Sense for Semantic Placement
Ramrakhya, R., Kembhavi, A., Batra, D., Kira, Z., Zeng, K.-H., & Weihs, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01540 · Cited by 19
Guo, J., Xin, Y., Liu, G., Xu, K., Liu, L., & Hu, R. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02528 · Cited by 17
Leverage Interactive Affinity for Affordance Learning
Luo, H.-C., Zhai, W., Zhang, J., Cao, Y., & Tao, D.-C. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.00658 · Cited by 29
RGBManip: Monocular Image-based Robotic Manipulation through Active Object Pose Estimation
An, B., Geng, Y., Chen, K., Li, X., Dou, Q., & Dong, H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610690 · Cited by 17
Ling, S., Wang, Y., Wu, R., Wu, S., Zhuang, Y., Xu, T., Li, Y., Liu, C., & Dong, H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610593 · Cited by 16
Learning Agent-Aware Affordances for Closed-Loop Interaction with Articulated Objects
Schiavi, G., Wulkop, P., Rizzi, G., Ott, L., Siegwart, R., & Chung, J. J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160747 · Cited by 15
Learning Foresightful Dense Visual Affordance for Deformable Object Manipulation
Wu, R., Ning, C., & Dong, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01005 · Cited by 15
GAMMA: Generalizable Articulation Modeling and Manipulation for Articulated Objects
Yu, Q., Wang, J., Liu, W., Hao, C., Liu, L., Shao, L., Wang, W., & Lu, C. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610652 · Cited by 17
About Time: Advances, Challenges, and Outlooks of Action Understanding
Stergiou, A., & Poppe, R. W. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02478-4 · Cited by 17
Understanding 3D Object Articulation in Internet Videos
Qian, S., Jin, L., Rockwell, C., Chen, S., & Fouhey, D. F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00165 · Cited by 14
Understanding 3D Object Interaction from a Single Image
Qian, S., & Fouhey, D. F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01988 · Cited by 23
O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance LearningPreprint
Mo, K., Qin, Y., Xiang, F., Su, H., & Guibas, L. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15087 · Cited by 12
Self-citationVisual Affordance Prediction for Guiding Robot Exploration
Bharadhwaj, H., Gupta, A., & Tulsiani, S. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161288 · Cited by 11
Self-citationDragAPart: Learning a Part-Level Motion Prior for Articulated Objects
Li, R., Zheng, C., Rupprecht, C., & Vedaldi, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72627-9_10 · Cited by 24
Part-Guided 3D RL for Sim2Real Articulated Object Manipulation
Xie, P., Chen, R., Chen, S., Qin, Y., Xiang, F., Sun, T., Xu, J., Wang, G., & Su, H. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3313063 · Cited by 10
PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environments
Ding, K., Chen, B., Wu, R., Li, Y., Zhang, Z., Gao, H.-A., Li, S., Zhou, G., Zhu, Y., Dong, H., et al. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802523 · Cited by 10
Survey on Modeling of Human‐made Articulated Objects
Liu, J., Savva, M., & Amiri, A. M. (2025) · Computer Graphics Forum · doi:10.1111/cgf.70092 · Cited by 23
Xu, Z., Gao, C., Liu, Z., Yang, G., Tie, C., Zheng, H., Zhou, H., Peng, W., Wang, D., Hu, T., et al. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801782 · Cited by 11
Lift3D Policy: Lifting 2D Foundation Models for Robust 3D Robotic Manipulation
Jia, Y., Liu, J., Chen, S., Gu, C., Wang, Z., Luo, L., Li, X., Wang, P., Wang, Z., Zhang, R., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01617 · Cited by 59
Bridging language and action: A survey of language-conditioned robot manipulation
Yao, X., Zhou, H., Mees, O., Meng, Y., Xiao, T. G., Bisk, Y., Oh, J., Johns, E., Shridhar, M., Shah, D., et al. (2026) · The International Journal of Robotics Research · doi:10.1177/02783649261468360 · Cited by 56
Xin, J., Wang, L., Xu, K., Yang, C., & Yin, B. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3301307 · Cited by 9
Sim2Real 2 : Actively Building Explicit Physics Model for Precise Articulated Object Manipulation
Ma, L., Meng, J., Liu, S., Chen, W., Xu, J. L., & Chen, R. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160370 · Cited by 9
Object-Centric Prompt-Driven Vision-Language-Action Model for Robotic Manipulation
Li, X., Xu, J., Zhang, M., Liu, J., Shen, Y. F., Ponomarenko, I., Xu, J., Heng, L., Huang, S., Zhang, S., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02574 · Cited by 9
Pettinger, A., Alambeigi, F., & Pryor, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3181732 · Cited by 8
Command-driven Articulated Object Understanding and Manipulation
Chu, R., Liu, Z., Ye, X., Tan, X., Qi, X., Fu, C., & Jia, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00851 · Cited by 8
Interaction-Driven Active 3D Reconstruction with Object Interiors
Yan, Z., Su, F., Wang, M., Hu, R., Zhang, H., & Huang, H. F. (2023) · ACM Transactions on Graphics · doi:10.1145/3618327 · Cited by 7
TARS: Tactile Affordance in Robot Synesthesia for Dexterous Manipulation
Wu, Q., Wang, H., Zhou, J., Xiong, X., & Lou, Y. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3505783 · Cited by 7
Tactile-Filter: Interactive Tactile Perception for Part Mating
Ota, K., Jha, D. K., Tung, H.-Y. F., & Tenenbaum, J. B. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.079 · Cited by 7
U-COPE: Taking a Further Step to Universal 9D Category-Level Object Pose Estimation
Zhang, L., Meng, W., Zhong, Y., Kong, B., Xu, M., Du, J., Wang, X., Wang, R., & Liu, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72684-2_15 · Cited by 6
Structure from Action: Learning Interactions for 3D Articulated Object Structure Discovery
Nie, N., Gadre, S. Y., Ehsani, K., & Song, S. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342135 · Cited by 6
Jiang, T., Guan, Y., Ma, L., Xu, J. L., Meng, J., Chen, W., Zeng, Z., Li, L., Wu, D., & Chen, R. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3584504 · Cited by 5
A Survey on Deep Generative Models for Robot Learning From Multimodal Demonstrations
Urain, J., Mandlekar, A., Du, Y., Shafiullah, N. M. “., Xu, D., Fragkiadaki, K., Chalvatzaki, G., & Peters, J. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3631816 · Cited by 45
RPMArt: Towards Robust Perception and Manipulation for Articulated Objects
Wang, J., Liu, W., Yu, Q., You, Y., Liu, L., Wang, W., & Lu, C. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802368 · Cited by 5
Seg&Struct: The Interplay Between Part Segmentation and Structure Inference for 3D Shape Parsing
Kim, J., Mo, K., Sung, M., & Woo, W. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00128 · Cited by 5
Self-citationDecoupling Skill Learning from Robotic Control for Generalizable Object Manipulation
Lü, K., Yang, B., Wang, B., & Markham, A. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160332 · Cited by 5
Online Estimation of Articulated Objects with Factor Graphs using Vision and Proprioceptive Sensing
Buchanan, R., Röfer, A., Moura, J., Valada, A., & Vijayakumar, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610590 · Cited by 5
Yu, Q., Huang, S., Yuan, X., Jiang, Z., Hao, C., Li, X., Chang, H., Wang, J.-B., Liu, L., Li, H., et al. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127736 · Cited by 12
P^3-Net: Part Mobility Parsing from Point Cloud Sequences via Learning Explicit Point Correspondence
Shi, Y., Cao, X., Lu, F., & Zhou, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20122 · Cited by 6
Task-Directed Exploration in Continuous POMDPs for Robotic Manipulation of Articulated Objects
Curtis, A., Kaelbling, L., & Jain, S. (2022) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra48891.2023.10160306 · Cited by 15
$A_{0}$: An Affordance-Aware Hierarchical Model for General Robotic Manipulation
Xu, R., Zhang, J., Guo, M., Wen, Y., Yang, H., Lin, M., Huang, J., Li, Z., Zhang, K., Wang, L., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01253 · Cited by 46
Yu, Q., Yuan, X., Jiang, Y., Chen, J., Zheng, D., Hao, C., You, Y., Chen, Y., Mu, Y., Liu, L., et al. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246522 · Cited by 4
Generalizable Articulated Object Perception with Superpoints
Yu, Q., Hao, C., Yuan, X., Li, Z., Liu, L., Huo, Y., Agarwal, R., & Lu, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890874 · Cited by 4
Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction
Hong, Y., Mo, K., Yi, L., Guibas, L. J., Torralba, A. B., Tenenbaum, J. B., & Gan, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00147 · Cited by 4
Self-citationPredicting Motion Plans for Articulating Everyday Objects
Gupta, A., Shepherd, M. E., & Gupta, S. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160752 · Cited by 4
Self-citationInformation-driven Affordance Discovery for Efficient Robotic Manipulation
Mazzaglia, P., Cohen, T., & Dijkman, D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611170 · Cited by 4
Learning Instruction-Guided Manipulation Affordance via Large Models for Embodied Robotic Tasks*
Li, D., Zhao, C., Yang, S., Ma, L., Li, Y., & Zhang, W. (2024) · International Conference on Advanced Robotics and Mechatronics (ICARM) · doi:10.1109/icarm62033.2024.10715821 · Cited by 3
Zhou, Y., Ouyang, Y., Liu, S., Xu, H., Li, X., Nan, J., Ji, X., & Yi, J. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103600 · Cited by 4
UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulation
Tang, Y., Huang, W., Wang, Y., Li, C., Yuan, R., Zhang, R., Wu, J., & Fei-Fei, L. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128868 · Cited by 24
Cui, W., Zhao, C., Wei, S., Zhang, J., Geng, H., Chen, Y., Li, H., & Wang, H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128643 · Cited by 3
Self-Supervised Learning of Action Affordances as Interaction Modes
Wang, L., Dvornik, N., Dubeau, R., Mittal, M., & Garg, A. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161371 · Cited by 3
Active Planar Mass Distribution Estimation with Robotic Manipulation
Yuan, J., Choi, C., Tadmor, E. B., & Isler, V. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342506 · Cited by 3
MAAL: Multimodality-Aware Autoencoder-based Affordance Learning for 3D Articulated Objects
Liang, Y., Wang, X., Zhu, L., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00027 · Cited by 3
PAPR in Motion: Seamless Point-level 3D Scene Interpolation
Peng, S., Yanshu, Z., & Li, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01985 · Cited by 3
Ota, K., Tung, H.-Y. F., Smith, K. A., Cherian, A., Marks, T. K., Sullivan, A., Kanezaki, A., & Tenenbaum, J. B. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160575 · Cited by 3
Learning Distributional Demonstration Spaces for Task-Specific Cross-Pose Estimation
Wang, J., Donca, O., & Held, D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611004 · Cited by 2
A Closed-Chain Approach to Generating Affordance Joint Trajectories for Robotic Manipulators
Panthi, J., Alambeigi, F., & Pryor, M. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3582832 · Cited by 2
FIction: 4D Future Interaction Prediction from Video
Ashutosh, K., Pavlakos, G., & Grauman, K. L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01641 · Cited by 2
A2G: Leveraging Intuitive Physics for Force-Efficient Robotic Grasping
Cheng, Y., Liu, S., Zha, F., Guo, W., Du, H., Wang, P., & Bing, Z. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3401675 · Cited by 2
Temporal Logic Guided Affordance Learning for Generalizable Dexterous Manipulation
Zhang, H., Wang, H., Qian, T., & Kan, Z. (2024) · International Symposium on Autonomous Systems (ISAS) · doi:10.1109/isas61044.2024.10552562 · Cited by 2
SKT-Hang: Hanging Everyday Objects via Object-Agnostic Semantic Keypoint Trajectory Generation
Kuo, C.-L., Chao, Y.-W., & Chen, Y.-T. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610266 · Cited by 2
Learning Generalizable Manipulation Policy with Adapter-Based Parameter Fine-Tuning
Lü, K., Ly, K. T., Hebberd, W., Zhou, K., Havoutis, I., & Markham, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801544 · Cited by 2
CNN-based Joint State Estimation During Robotic Interaction with Articulated Objects
Młodzikowski, K., & Belter, D. (2022) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv57592.2022.10004277 · Cited by 2
Fernández, I. S. M., Oprea, S., Castro-Vargas, J. A., Martínez-González, P., & García‐Rodríguez, J. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-87869-6_41 · Cited by 2
Articulated Objects: From Detection to Manipulation—Survey
Pejić, P., Šimundić, V., Džijan, M., & Cupec, R. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-22216-0_34 · Cited by 3
Tool as Embodiment for Recursive ManipulationPreprint
Noguchi, Y., Matsushima, T., Matsuo, Y., & Gu, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00359 · Cited by 3
SIMBA: An Interactive Sketch-Based Tool for Motion Visualization
Ramana, G. K., Simha, S., & Onkar, P. S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48044-7_13 · Cited by 1
Metadata
- Authors
- Mo, K., Guibas, L., Mukadam, M., Gupta, A., & Tulsiani, S.
- Affiliations
- Stanford University (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 6793-6803
- arXiv
- 2101.02692
- OpenAlex
- W3120441392
- Cited by
- 132
- References
- 59
- Citations by year
- 2026: 19 · 2025: 29 · 2024: 29 · 2023: 33 · 2022: 15 · 2021: 7
- FWCI
- 31.33
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1763268)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Keywords
- articulated objects, actionable information, pushing and pulling, movable parts, learning from interaction, simulation-based training, depth information, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
