AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detection
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
We propose AffordanceNet, a new deep learning approach to simultaneously detect multiple objects and their affordances from RGB images. Our AffordanceNet has two branches: an object detection branch to localize and classify the object, and an affordance detection branch to assign each pixel in the object to its most probable affordance label. The proposed framework employs three key components for effectively handling the multiclass problem in the affordance mask: a sequence of deconvolutional layers, a robust resizing strategy, and a multi-task loss function. The experimental results on the public datasets show that our AffordanceNet outperforms recent state-of-the-art methods by a fair margin, while its end-to-end architecture allows the inference at the speed of 150ms per image. This makes our AffordanceNet well suitable for real-time robotic applications. Furthermore, we demonstrate the effectiveness of AffordanceNet in different testing environments and in real robotic applications. The source code is available at https://github.com/nqanh/affordance-net.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation
Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287
Self-citation
Research works printed but not linked: 2
- he, 2017, Mask R-CNN, ICCV
- girshick, 2015, Fast R-CNN, ICCV
Cited by
Du, G., Wang, K., Lian, S., & Zhao, K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09888-5 · Cited by 475
Deep Learning Approaches to Grasp Synthesis: A Review
Newbury, R., Gu, M., Chumbley, L., Mousavian, A., Eppner, C., Leitner, J., Bohg, J., Morales, A., Asfour, T., Kragic, D., et al. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3280597 · Cited by 255
Learning task-oriented grasping for tool manipulation from simulated self-supervision
Fang, K., Zhu, Y., Garg, A., Kurenkov, A., Mehta, V., Fei-Fei, L., & Savarese, S. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919872545 · Cited by 180
Hand-Object Contact Consistency Reasoning for Human Grasps Generation
Jiang, H., Liu, S., Wang, J., & Wang, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01092 · Cited by 165
GanHand: Predicting Human Grasp Affordances in Multi-Object Scenes
Corona, E., Pumarola, A., Alenya, G., Moreno-Noguer, F., & Rogez, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00508 · Cited by 171
Deep-6DPose: Recovering 6D Object Pose from a Single RGB Image
Do, T.-T., Cai, M., Pham, T. T., & Reid, I. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10367 · Cited by 119
Self-citationGrounded Human-Object Interaction Hotspots From Video
Nagarajan, T., Feichtenhofer, C., & Grauman, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00878 · Cited by 147
Visual Affordance and Function Understanding: A Survey
Hassanin, M., Khan, S. H., & Tahtalı, M. (2021) · ACM Computing Surveys · doi:10.1145/3446370 · Cited by 173
Learning Dexterous Grasping with Object-Centric Visual Affordances
Mandikal, P., & Grauman, K. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561802 · Cited by 113
3D AffordanceNet: A Benchmark for Visual Object Affordance Understanding
Deng, S., Xu, X., Wu, C., Chen, K., & Jia, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00182 · Cited by 124
OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction
Yang, L., Li, K., Zhan, X., Wu, F., Xu, A., Liu, L., & Lu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02028 · Cited by 220
A Survey of Knowledge Representation in Service Robotics
Paulius, D., & Sun, Y. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.005 · Cited by 128
Grounding Language with Visual Affordances over Unstructured Data
Mees, O., Borja-Diaz, J., & Burgard, W. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10160396 · Cited by 69
CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulation
Wen, B., Lian, W., Bekris, K. E., & Schaal, S. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811568 · Cited by 118
PLACE: Proximity Learning of Articulation and Contact in 3D Environments
Zhang, S., Zhang, Y., Ma, Q., Black, M. J., & Tang, S. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00074 · Cited by 129
Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos
Liu, S., Tripathi, S., Majumdar, S., & Wang, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00328 · Cited by 155
Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks
Nasiriany, S., Liu, H., & Zhu, Y. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9812140 · Cited by 91
KETO: Learning Keypoint Representations for Tool Manipulation
Qin, Z., Fang, K., Zhu, Y., Fei-Fei, L., & Savarese, S. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196971 · Cited by 78
Siam, M., Jiang, C., Lu, S., Petrich, L., Gamal, M., Elhoseiny, M., & Jägersand, M. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794254 · Cited by 103
Retargetable AR: Context-aware Augmented Reality in Indoor Scenes based on 3D Scene Graph
Tahara, T., Seno, T., Narita, G., & Ishikawa, T. (2020) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct51615.2020.00072 · Cited by 101
Learning Affordance Grounding from Exocentric Images
Luo, H., Zhai, W., Zhang, J., Cao, Y. H., & Tao, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00229 · Cited by 154
Translating Videos to Commands for Robotic Manipulation with Deep Recurrent Neural Networks
Nguyen, A., Kanoulas, D., Muratore, L., Caldwell, D. G., & Tsagarakis, N. G. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460857 · Cited by 77
Self-citationAffordance-based robot manipulation with flow matching
Zhang, F., & Gienger, M. (2026) · Frontiers in Robotics and AI · doi:10.3389/frobt.2026.1906861 · Cited by 88
The Object Detection, Perspective and Obstacles In Robotic: A Review
Ge, X., Khan, A. S., Moshayedi, A. J., Zhang, X., & Shuxin, Y. (2022) · EAI Endorsed Transactions on AI and Robotics · doi:10.4108/airo.v1i1.2709 · Cited by 86
VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated ObjectsPreprint
Wu, R., Zhao, Y. L., Mo, K., Guo, Z., Wang, Y., Wu, T., Fan, Q., Chen, X., Guibas, L. J., & Dong, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14440 · Cited by 113
Robotics Dexterous Grasping: The Methods Based on Point Cloud and Deep Learning
Duan, H., Wang, P., Huang, Y.-Y., Xu, G., Wei, W., & Shen, X. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.658280 · Cited by 92
Learning Affordance Segmentation for Real-World Robotic Manipulation via Synthetic Images
Chu, F.-J., Xu, R., & Vela, P. A. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2894439 · Cited by 79
Learning Grasp Affordance Reasoning Through Semantic Relations
Ardón, P., Pairet, È., Petrick, R. P. A., Ramamoorthy, S., & Lohan, K. S. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2933815 · Cited by 67
Grasp’D: Differentiable Contact-Rich Grasp Synthesis for Multi-Fingered Hands
Turpin, D., Wang, L., Heiden, E., Chen, Y.-C., Macklin, M., Tsogkas, S., Dickinson, S., & Garg, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20068-7_12 · Cited by 110
Graph-based Person Signature for Person Re-Identifications
Nguyen, B. X., Nguyen, B. D., Do, T., Tjiputra, E., Tran, Q. D., & Nguyen, A. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00388 · Cited by 64
Self-citationLOCATE: Localize and Transfer Object Parts for Weakly Supervised Affordance Grounding
Li, G., Jampani, V., Sun, D., & Sevilla-Lara, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01051 · Cited by 97
Coarse-to-Fine Reasoning for Visual Question Answering
Nguyen, B. X., Do, T., Tran, H., Tjiputra, E., Tran, Q. D., & Nguyen, A. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00502 · Cited by 82
Self-citationLearning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision
Fang, K., Zhu, Y., Garg, A., Kurenkov, A., Mehta, V., Fei-Fei, L., & Savarese, S. (2018) · Robotics: Science and Systems · doi:10.15607/rss.2018.xiv.012 · Cited by 70
An Affordance Keypoint Detection Network for Robot Manipulation
Xu, R., Chu, F.-J., Tang, C., Liu, W., & Vela, P. A. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3062560 · Cited by 72
RLAfford: End-to-End Affordance Learning for Robotic Manipulation
Geng, Y., An, B., Geng, H., Chen, Y., Yang, Y., & Dong, H. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161571 · Cited by 57
Affordances in Robotic Tasks -- A SurveyPreprint
Ardón, P., Pairet, È., Lohan, K. S., Ramamoorthy, S., & Petrick, R. P. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07400 · Cited by 57
A Survey of Embodied Learning for Object-centric Robotic Manipulation
Zheng, Y., Yao, L., Su, Y., Zhang, Y., Wang, Y., Zhao, S., Zhang, Y., & Chau, L. (2025) · Machine Intelligence Research · doi:10.1007/s11633-025-1542-8 · Cited by 89
Enabling Robots to Understand Incomplete Natural Language Instructions Using Commonsense Reasoning
Chen, H., Tan, H. X., Kuntz, A., Bansal, M., & Alterovitz, R. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197315 · Cited by 59
Wang, F., Wang, R., Xie, C., Zhang, J., Li, R., & Liu, L. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106268 · Cited by 52
CAGE: Context-Aware Grasping Engine
Liu, W., Daruna, A., & Chernova, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197289 · Cited by 62
A4T: Hierarchical Affordance Detection for Transparent Objects Depth Reconstruction and Manipulation
Jiang, J., Cao, G., Do, T.-T., & Luo, S. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3191231 · Cited by 61
Self-citationSceneCut: Joint Geometric and Object Segmentation for Indoor Scenes
Pham, T. T., Do, T.-T., Sünderhauf, N., & Reid, I. D. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461108 · Cited by 49
Self-citationGlobal-local attention for emotion recognition
Le, N., Nguyen, K., Nguyen, A., & Le, B. H. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06778-x · Cited by 57
Self-citationOne-Shot Object Affordance Detection in the Wild
Zhai, W., Luo, H., Zhang, J., Cao, Y. H., & Tao, D. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01642-4 · Cited by 69
Grounding 3D Object Affordance from 2D Interactions in Images
Yang, Y., Zhai, W., Luo, H., Cao, Y. H., Luo, J., & Zha, Z.-J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01001 · Cited by 99
Liang, S., Thung, K., Nie, D., Zhang, Y., & Shen, D. G. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2975853 · Cited by 51
Affordance Learning for End-to-End Visuomotor Robot Control
Hämäläinen, A., Arndt, K., Ghadirzadeh, A., & Kyrki, V. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968596 · Cited by 53
Robot Object Retrieval with Contextual Natural Language Queries
Nguyen, T. N., Gopalan, N., Patel, R., Corsaro, M., Pavlick, E., & Tellex, S. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.080 · Cited by 44
Open-Vocabulary Affordance Detection in 3D Point Clouds
Nguyen, T. Q., Vu, M. N., Vuong, A., Nguyen, D., Vo, T., Le, N., & Nguyen, A. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341553 · Cited by 85
Self-citationSame Object, Different Grasps: Data and Semantic Knowledge for Task-Oriented GraspingPreprint
Murali, A., Liu, W., Marino, K., Chernova, S., & Gupta, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06431 · Cited by 97
K-VIL: Keypoints-Based Visual Imitation Learning
Gao, J., Tao, Z., Jaquier, N., & Asfour, T. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3286074 · Cited by 60
Watch and Act: Learning Robotic Manipulation From Visual Demonstration
Yang, S., Zhang, W., Song, R., Cheng, J., Wang, H., & Li, Y. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3248324 · Cited by 37
Object affordance detection with relationship-aware network
Zhao, X. Z., Cao, Y. H., & Kang, Y. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04336-0 · Cited by 49
LASO: Language-Guided Affordance Segmentation on 3D Object
Li, Y., Zhao, N., Xiao, J., Feng, C., Wang, X., & Chua, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01351 · Cited by 88
Patten, T., Park, K., & Vincze, M. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00120 · Cited by 41
Affordance Grounding from Demonstration Video to Target Image
Chen, J., Gao, D., Lin, K. Q., & Shou, M. Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00657 · Cited by 66
Visual Sorting of Express Parcels Based on Multi-Task Deep Learning
Han, S., Liu, X., Han, X., Wang, G., & Wu, S. (2020) · Sensors · doi:10.3390/s20236785 · Cited by 35
One-Shot Open Affordance Learning with Foundation Models
Li, G., Sun, D., Sevilla-Lara, L., & Jampani, V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00298 · Cited by 79
Toward Affordance Detection and Ranking on Novel Objects for Real-World Robotic Manipulation
Chu, F.-J., Xu, R., Seguin, L., & Vela, P. A. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2930364 · Cited by 41
Learning Human-Like Functional Grasping for Multifinger Hands From Few Demonstrations
Wei, W., Wang, P., Wang, S., Luo, Y., Li, W., Li, D., Huang, Y.-Y., & Duan, H. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3420722 · Cited by 33
Grasp Pose Detection with Affordance-based Task Constraint Learning in Single-view Point Clouds
Qian, K., Jing, X., Duan, Y., Zhou, B., Fang, F., Jing, X., & Ma, X. (2020) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-020-01202-3 · Cited by 37
GIFT: Generalizable Interaction-aware Functional Tool Affordances without Labels
Turpin, D., Wang, L., Tsogkas, S., Dickinson, S., & Garg, A. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.060 · Cited by 42
Learning Visual Affordance Grounding From Demonstration Videos
Luo, H., Zhai, W., Zhang, J., Cao, Y. H., & Tao, D. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3298638 · Cited by 48
Kentaro, W., Kitagawa, S., Okada, K., & Inaba, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593690 · Cited by 37
Affordance Learning from Play for Sample-Efficient Policy Learning
Borja-Diaz, J., Mees, O., Kalweit, G., Hermann, L., Boedecker, J., & Burgard, W. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9811889 · Cited by 32
Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spaces
Zhang, C., Delitzas, A., Wang, F., Zhang, R., Ji, X., Pollefeys, M., & Engelmann, F. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01807 · Cited by 85
Affordance-Based Mobile Robot Navigation Among Movable Obstacles
Wang, M., Luo, R., Önol, A. Ö., & Padır, T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341337 · Cited by 41
From Selective Deep Convolutional Features to Compact Binary Representations for Image Retrieval
Do, T.-T., Hoang, T., Tan, D.-K. L., Le, H., Nguyen, T., & Cheung, N. M. (2019) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3314051 · Cited by 32
Self-citationLearning Actions from Human Demonstration Video for Robotic Manipulation
Yang, S., Zhang, W., Lu, W., Wang, H., & Li, Y. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968278 · Cited by 31
Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsing
Chen, X., Liu, T., Zhao, H., Zhou, G., & Zhang, Y.-Q. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01903 · Cited by 44
Learning 6-DoF Fine-Grained Grasp Detection Based on Part Affordance Grounding
Song, Y., Sun, P., Jin, P., Ren, Y., Zheng, Y., Li, Z., Chu, X., Zhang, Y., Li, T., & Gu, J. J. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3566461 · Cited by 42
Language-Conditioned Affordance-Pose Detection in 3D Point Clouds
Nguyen, T. Q., Vu, M. N., Huang, B., Vo, T. V., Truong, V., Le, N., Vo, T., Le, B. H., & Nguyen, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610008 · Cited by 42
Self-citationLi, Z., Liu, J., Li, Z., Dong, Z., Teng, T., Ou, Y., Caldwell, D. G., & Chen, F. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3524426 · Cited by 38
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images
Yang, Y., Zhai, W., Luo, H., Cao, Y. H., & Zha, Z.-J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01541 · Cited by 67
Rediscovering Affordance: A Reinforcement Learning Perspective
Liao, Y.-C., Todi, K., Acharya, A., Keurulainen, A., Howes, A., & Oulasvirta, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501992 · Cited by 32
What Object Should I Use? - Task Driven Object Detection
Sawatzky, J., Souri, Y., Grund, C., & Gall, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00779 · Cited by 43
V2CNet: A Deep Learning Framework to Translate Videos to Commands for Robotic ManipulationPreprint
Nguyen, A., Do, T.-T., Reid, I. D., Caldwell, D. G., & Tsagarakis, N. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10869 · Cited by 27
Self-citationGenerative Robotic Grasping Using Depthwise Separable Convolution
Teng, Y., & Gao, P. (2021) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2021.107318 · Cited by 27
Learning 6-DoF Task-oriented Grasp Detection via Implicit Estimation and Visual Affordance
Chen, W., Liang, H., Chen, Z., Sun, F., & Zhang, J. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981900 · Cited by 30
Grounded Affordance from Exocentric View
Luo, H., Zhai, W., Zhang, J., Cao, Y. H., & Tao, D. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01962-z · Cited by 40
UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulation
Tang, Y., Huang, W., Wang, Y., Li, C., Yuan, R., Zhang, R., Wu, J., & Fei-Fei, L. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128868 · Cited by 39
Ortenzi, V., Cini, F., Pardi, T., Marturi, N., Stolkin, R., Corke, P., & Controzzi, M. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.542406 · Cited by 27
Recent Advances of Deep Robotic Affordance Learning: A Reinforcement Learning Perspective
Yang, X., Ji, Z., Wu, J., & Lai, Y. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3277288 · Cited by 32
From text to mask: Localizing entities using the attention of text-to-image diffusion models
Xiao, C., Yang, Q., Zhou, F., & Zhang, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128437 · Cited by 28
Affordance-based robot object retrieval
Nguyen, T. N., Gopalan, N., Patel, R., Corsaro, M., Pavlick, E., & Tellex, S. (2021) · Autonomous Robots · doi:10.1007/s10514-021-10008-7 · Cited by 24
Wu, H., & Chirikjian, G. S. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3039943 · Cited by 30
GATER: Learning Grasp-Action-Target Embeddings and Relations for Task-Specific Grasping
Sun, M., & Gao, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3131378 · Cited by 25
A Survey of Visual Affordance Recognition Based on Deep Learning
Chen, D., Kong, D., Li, J., Wang, S., & Yin, B. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3291558 · Cited by 30
Point Cloud Projective Analysis for Part-Based Grasp Planning
Monica, R., & Aleotti, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3003883 · Cited by 22
Learning Multi-Object Dense Descriptor for Autonomous Goal-Conditioned Grasping
Yang, S., Zhang, W., Song, R., Cheng, J., & Li, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3062300 · Cited by 22
Domain adversarial transfer for cross-domain and task-constrained grasp pose detection
Jing, X., Qian, K., Xu, X., Bai, J., & Zhou, B. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103872 · Cited by 23
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161431 · Cited by 21
“inferring scene affordance from visual observations [6, 26, 28].”
Multi-label affordance mapping from egocentric vision
Mur-Labadia, L., Guerrero, J. J., & Martínez-Cantín, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00483 · Cited by 31
Manipulation Planning for Object Re-Orientation Based on Semantic Segmentation Keypoint Detection
Wong, C., Yeh, L.-Y., Liu, C., Tsai, C., & Aoyama, H. (2021) · Sensors · doi:10.3390/s21072280 · Cited by 21
Meta-Learning Deep Visual Words for Fast Video Object Segmentation
Behl, H. S., Naja, M., Arnab, A., & Torr, P. H. S. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341737 · Cited by 22
Zhang, K., Cochran, B. R., Chen, R., Hartung, L., Sprecher, B., Tredinnick, R. D., Ponto, K., Banerjee, S., & Zhao, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642195 · Cited by 20
Object Captioning and Retrieval with Natural Language
Nguyen, A., Tran, Q. D., Do, T.-T., Reid, I. D., Caldwell, D. G., & Tsagarakis, N. G. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00316 · Cited by 23
Self-citationFast and Comfortable Interactive Robot-to-Human Object Handover
Meng, C., Zhang, T., & Lam, T. L. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981484 · Cited by 25
GPDAN: Grasp Pose Domain Adaptation Network for Sim-to-Real 6-DoF Object Grasping
Zheng, L., Ma, W., Cai, Y., Lu, T., & Wang, S. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3286816 · Cited by 22
Leverage Interactive Affinity for Affordance Learning
Luo, H., Zhai, W., Zhang, J., Cao, Y. H., & Tao, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00658 · Cited by 31
Metadata
- Authors
- Do, T.-T., Nguyen, A., & Reid, I.
- Affiliations
- Australian Centre for Robotic Vision (AU)
- Venue
- 2018 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 1-5
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2962984928
- Cited by
- 305
- References
- 31
- Citations by year
- 2026: 17 · 2025: 44 · 2024: 30 · 2023: 44 · 2022: 40 · 2021: 44 · 2020: 42 · 2019: 33 · 2018: 11
- FWCI
- 48.79
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Commission (611832, FP7 ICT, FP7 ICT 2013–10)
- Australian Centre for Robotic Vision (#CE140100016)
- FP7 Information and Communication Technologies (611832, FP7-ICT-2013-10)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- object detection, multi-task learning, multi-class segmentation, robotic manipulation, real-time inference, RGB images
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.