The DOI matches its DataCite record; 51 of the 59 references it cites were found in a registry or an index.
Where2Act: From Pixels to Actions for Articulated 3D Objects
Open accessAbstract
One of the fundamental goals of visual perception is to allow agents to meaningfully interact with their environment. In this paper, we take a step towards that long-term goal -- we extract highly localized actionable information related to elementary actions such as pushing or pulling for articulated objects with movable parts. For example, given a drawer, our network predicts that applying a pulling force on the handle opens the drawer. We propose, discuss, and evaluate novel network architectures that given image and depth data, predict the set of actions possible at each pixel, and the regions over articulated parts that are likely to move under the force. We propose a learning-from-interaction framework with an online data sampling strategy that allows us to train the network in simulation (SAPIEN) and generalizes across categories. Check the website for code and data release: https://cs.stanford.edu/~kaichun/where2act/
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Another line of research acquires active training data with simulated or real robots for affordance learning [16, 19, 26, 28, 41].”
From Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception (2023) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric SpacePreprint
Qi, C. R., Yi, L., Su, H., & Guibas, L. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02413 · Cited by 10,099
Self-citation3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298801 · Cited by 5,413
A Point Set Generation Network for 3D Object Reconstruction from a Single Image
Fan, H., Su, H., & Guibas, L. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.264 · Cited by 2,513
Self-citationShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Self-citationPoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Xiang, Y., Schmidt, T., Narayanan, V., & Fox, D. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.019 · Cited by 2,139
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,774
Self-citationMedical Image Computing and Computer-Assisted Intervention — MICCAI’98
Roche, A., Malandain, G., Pennec, X., & Ayache, N. (1998) · Lecture notes in computer science · doi:10.1007/bfb0056181 · Cited by 1,578
Research works printed but not linked: 1
- Zihao Yan, Ruizhen Hu, Xingguang Yan, Luanmin Chen, Oliver Van Kaick, Hao Zhang, and Hui Huang. Rpm-net: Recurrent prediction of motion and parts from point cloud. ACM Transactions on Graphics (TOG), 38(6):240, 2019. 2
Cited by
Sorted by citations
Items 101–133 of 133
Le, H., Hoang, T., Gabriel, M., Neumann, G. M., & Vien, N. A. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3564780 · Cited by 5
Chen, H., Xu, J., Sheng, L., Ji, T., Liu, S., Li, Y., & Driggs-Campbell, K. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127387 · Cited by 1
Do, T.-D., Gireesh, N., Wang, J., & Wang, H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128365 · Cited by 1
Kim, T., Bae, H., Li, Z., Li, X., Ponomarenko, I., Wu, R., & Dong, H. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246374 · Cited by 3
Task-Oriented Robot-Human Handovers on Legged Manipulators
Tulbure, A., Scheidemann, C., Steiner, E., & Hutter, M. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3785629 · Cited by 2
Articulate That Object Part (ATOP): 3D Part Articulation from Text and via Motion Personalization
Vora, A., Nag, S., Wang, K., & Zhang, H. (2026) · ACM Transactions on Graphics · doi:10.1145/3820375 · Cited by 11
Registering Articulated Objects With Human-in-the-loop Corrections
Hagenow, M., Senft, E., Laske, E., Hambuchen, K., Fong, T., Radwin, R. G., Gleicher, M. L., Mutlu, B., & Zinn, M. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981949 · Cited by 1
Neural Fields for Multimedia Applications (Part-2): Trends in Volumetric Videos and 3D Objects
Muraleedharan, L. P., Liu, J., Dutta, U. K., Choudhury, A., & Su, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-82475-3_20 · Cited by 1
One-Shot Manipulation Strategy Learning by Making Contact Analogies
Liu, Y., Mao, J., Tenenbaum, J. B., Lozano‐Pérez, T., & Kaelbling, L. P. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127356 · Cited by 1
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · arXiv · Cited by 21
It’s Just Semantics: How to Get Robots to Understand the World the Way We Do
Chung, J. J., Förster, J., Wulkop, P., Ott, L., Lawrance, N., & Siegwart, R. (2023) · Springer proceedings in advanced robotics · doi:10.1007/978-3-031-25555-7_1
GAM: General affordance-based manipulation for contact-rich object disentangling tasks
Yang, X., Wu, J., Lai, Y., & Ji, Z. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127386
Locate N’ Rotate: Two-Stage Openable Part Detection with Foundation Model Priors
Li, S., Chen, X., Cheng, H., Zhou, G., Zhao, H., & Tian, G. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0963-5_6
Fang, S., Gao, W., Goel, S., Thierauf, C., Scheutz, M. J., & Sinapov, J. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127866
Hu, R., He, X., Huang, F., Zhao, J., Cheng, X., & Wang, Z. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3623300
Liu, L., Zhang, R., Xu, W., Zhang, L., Tang, Y., Wu, Q., & Wu, H. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11208907
Qian, S., Zhang, L., Wei, Y., Liu, L., & Lu, C. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246094
ObjectForesight: Predicting Future 3D Object Trajectories from Human Videos
Soraki, R., Bharadhwaj, H., Farhadi, A., & Mottaghi, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37098-3_24 · Cited by 6
Active Kinematic Modeling for Precise Manipulation of Unseen Articulated Objects
Zhang, B., Wang, Y., Wang, Y., Wang, W., & Zhang, Z. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3656781
Online estimation and manipulation of articulated objects
Buchanan, R., Röfer, A., Moura, J., Valada, A., & Vijayakumar, S. (2026) · Autonomous Robots · doi:10.1007/s10514-025-10233-4
Panoramic Affordance Prediction
Zhang, Z., Liao, C., Zhang, H., Chen, H. H., Chen, K., Wen, Z., Guo, L., Ren, B., Xu, Z., Li, Y., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37556-8_16 · Cited by 3
Wang, Y., & Dong, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463603
GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation
Shao, B., Xie, M., Su, H., Zhang, W., Li, M., Ding, Y., Giunchiglia, F., & Chen, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36229-2_24
Patel, M., Jain, R., Unmesh, A., Hsia, S.-K., & Karthik Ramani, A. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812912
Appliances Describe Themselves: Part–Function–State Modeling for Appliance Manipulation Planning
Yang, X.-T., Yu, J.-C., Gu, Q., Tang, J.-H., Wang, Y., & Ding, W.-B. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3706941
RelAfford6D: Relational 6D Affordance Graphs for Constraint-Driven Robotic Manipulation
Zhang, G., He, Q., Xie, W., Wu, S., Ji, Y., Li, Q., Bayramli, B., Ding, Y., & Ҫirkinoğlu, H. O. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37013-6_28
A Review of Language-Guided Dexterous Grasping with Human-in-the-Loop Adaptation
Jeong, E., & Lim, S. (2026) · Mathematics · doi:10.3390/math14152709
A Domain-Randomized Sim-to-Real Framework for Garment Folding Using a Low-Cost Robot
Yang, H., Li, Z., Sun, S., & Hou, Z.-G. (2026) · Lecture notes in mechanical engineering · doi:10.1007/978-981-92-3086-0_8
Grasp Pose Estimation of Articulated Objects Based on Semantic and Geometric Feature Fusion
Lee, D., Kim, Y., Jo, S. B., & Hwang, M. J. (2026) · IEEE Access · doi:10.1109/access.2026.3724058
A survey on large model-driven embodied grasping technologies
Lu, X., Liu, H., Huang, H., Zhou, C., Yu, F., Wu, X., & Liu, J. (2026) · Proceedings of the Institution of Mechanical Engineers Part C Journal of Mechanical Engineering Science · doi:10.1177/09544062261480780
$A_{1}$: Adaptive Truncated Vision-Language-Action Model From Affordance to Action
Zhang, K., Zhang, J., Xu, R., Sun, Y., Wen, Y., Xue, S., Guo, X., Guo, M., Liufu, W., Zihou, L., et al. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00149
GRAFT: Graph-Based Affordance Transfer via Part Correspondence
Lin, M., Mishra, U., Mandlekar, A., & Xu, D. (2026) · doi:10.1109/cvprf71909.2026.00839
SemAnCorr: Sem antic An chored Corr espondence for Zero-Shot Manipulation Skill Transfer
Dong, X., Baron, W., Chen, H., Yoo, U., Ichnowski, J., & Zhi, W. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3746139
Metadata
- Authors
- Mo, K., Guibas, L., Mukadam, M., Gupta, A., & Tulsiani, S.
- Affiliations
- Stanford University (US)
- Meta (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 6793-6803
- arXiv
- 2101.02692
- OpenAlex
- W3120441392
- Cited by
- 132
- References
- 59
- Citations by year
- 2026: 19 · 2025: 29 · 2024: 29 · 2023: 33 · 2022: 15 · 2021: 7
- FWCI
- 31.33
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1763268)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Keywords
- articulated objects, actionable information, pushing and pulling, movable parts, learning from interaction, simulation-based training, depth information, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
