AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detection
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
We propose AffordanceNet, a new deep learning approach to simultaneously detect multiple objects and their affordances from RGB images. Our AffordanceNet has two branches: an object detection branch to localize and classify the object, and an affordance detection branch to assign each pixel in the object to its most probable affordance label. The proposed framework employs three key components for effectively handling the multiclass problem in the affordance mask: a sequence of deconvolutional layers, a robust resizing strategy, and a multi-task loss function. The experimental results on the public datasets show that our AffordanceNet outperforms recent state-of-the-art methods by a fair margin, while its end-to-end architecture allows the inference at the speed of 150ms per image. This makes our AffordanceNet well suitable for real-time robotic applications. Furthermore, we demonstrate the effectiveness of AffordanceNet in different testing environments and in real robotic applications. The source code is available at https://github.com/nqanh/affordance-net.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation
Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287
Self-citation
Research works printed but not linked: 2
- he, 2017, Mask R-CNN, ICCV
- girshick, 2015, Fast R-CNN, ICCV
Cited by
Items 101–200 of 327
Wang, Z., & Tian, G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3252578 · Cited by 18
Learning by Watching: A Review of Video-Based Learning Approaches for Robot Manipulation
Eze, C., & Crick, C. (2025) · IEEE Access · doi:10.1109/access.2025.3624723 · Cited by 29
Context-based affordance segmentation from 2D images for robot actions
Lüddecke, T., Kulvičius, T., & Wörgötter, F. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.05.005 · Cited by 18
Park, G., Im, D., Han, D., & Yoo, H. (2020) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2020.3005191 · Cited by 18
Object affordance detection with boundary-preserving network for robotic manipulation tasks
Yin, C.-C., & Zhang, Q.-J. (2022) · Neural computing & applications (Print) · doi:10.1007/s00521-022-07446-4 · Cited by 19
Xu, Z., Gao, C., Liu, Z., Yang, G., Tie, C., Zheng, H., Zhou, H., Peng, W., Wang, D., Hu, T., et al. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801782 · Cited by 27
LBAP: Improved Uncertainty Alignment of LLM Planners using Bayesian Inference
Mullen, J. F., & Manocha, D. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11245905 · Cited by 20
Autonomous Tool Construction Using Part Shape and Attachment Prediction
Nair, L. V., Srikanth, N. S., Erickson, Z., & Chernova, S. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.009 · Cited by 17
Building Affordance Relations for Robotic Agents - A Review
Ardón, P., Pairet, È., Lohan, K. S., Ramamoorthy, S., & Petrick, R. P. A. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/590 · Cited by 17
Self-Assessment of Grasp Affordance Transfer
Ardón, P., Pairet, È., Pétillot, Y., Petrick, R. P. A., Ramamoorthy, S., & Lohan, K. S. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340841 · Cited by 16
Kasaei, H., Melsen, J., van Beers, F., Steenkist, C., & Voncina, K. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01458-3 · Cited by 18
O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance LearningPreprint
Mo, K., Qin, Y., Xiang, F., Su, H., & Guibas, L. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15087 · Cited by 55
A Large Scale Multi-View RGBD Visual Affordance Learning Dataset
Khalifa, Z., & Shah, S. A. A. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222906 · Cited by 20
COSMO: Contextualized scene modeling with Boltzmann Machines
Bozcan, İ., & Kalkan, S. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.12.009 · Cited by 15
Interactive Open-Ended Object, Affordance and Grasp Learning for Robotic Manipulation
Kasaei, H., Shafii, N., Lopes, L. S., & Tomé, A. M. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794184 · Cited by 15
Weakly Supervised Multimodal Affordance Grounding for Egocentric Images
Xu, L., Gao, Y., Song, W., & Hao, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28451 · Cited by 14
A Deep Learning Approach to Object Affordance Segmentation
Thermos, S., Daras, P., & Potamianos, G. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054167 · Cited by 19
Redefining Affordance via Computational Rationality
Liao, Y.-C., & Holz, C. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712114 · Cited by 15
Automatic Generation of Object Shapes With Desired Affordances Using Voxelgrid Representation
Andries, M., Dehban, A., & Santos-Victor, J. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00022 · Cited by 13
Visual affordance detection using an efficient attention convolutional neural network
Gu, Q., Su, J., & Yuan, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.018 · Cited by 13
The Functional Correspondence Problem
Lai, Z., Purushwalkam, S., & Gupta, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01548 · Cited by 13
Modeling and Learning Constraints for Creative Tool Use
Fitzgerald, T., Goel, A. K., & Thomaz, A. L. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.674292 · Cited by 13
Bayesian deep learning for affordance segmentation in images
Mur-Labadia, L., Martínez-Cantín, R., & Guerrero, J. J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160606 · Cited by 13
One-Shot Learning for Task-Oriented Grasping
Holomjova, V., Starkey, A. J., Yun, B., & Meißner, P. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3326001 · Cited by 13
AFF-ttention! Affordances and Attention Models for Short-Term Object Interaction Anticipation
Mur-Labadia, L., Martínez-Cantín, R., Guerrero, J. J., Farinella, G. M., & Furnari, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73337-6_10 · Cited by 20
Is That a Chair? Imagining Affordances Using Simulations of an Articulated Human Body
Wu, H., Misra, D., & Chirikjian, G. S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197384 · Cited by 15
Recognizing Object Affordances to Support Scene Reasoning for Manipulation TasksPreprint
Chu, F.-J., Xu, R., Tang, C., & Vela, P. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05770 · Cited by 12
GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency
Lu, D., Kong, L., Huang, T., & Lee, G. H. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00164 · Cited by 29
3DAffordSplat: Efficient Affordance Reasoning with 3D Gaussians
Wei, Z., Lin, J., Liu, Y., Chen, W., Luo, J., Li, G., & Lin, L. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754778 · Cited by 21
Open-Vocabulary Affordance Detection using Knowledge Distillation and Text-Point Correlation
Vo, T. V., Vu, M. N., Huang, B., Nguyen, T. Q., Le, N., Vo, T., & Nguyen, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610247 · Cited by 24
Self-citationAutonomous Navigation with Mobile Robots Using Deep Learning and the Robot Operating System
Nguyen, A., & Tran, Q. D. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-75472-3_5 · Cited by 13
Self-citationGeometric Affordance Perception: Leveraging Deep 3D Saliency With the Interaction Tensor
Ruiz, E., & Mayol-Cuevas, W. W. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00045 · Cited by 12
Benchmarking pose estimation for robot manipulation
Hietanen, A., Latokartano, J., Foi, A., Pieters, R., Kyrki, V., Lanz, M., & Kämäräinen, J.-K. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103810 · Cited by 15
Pettinger, A., Alambeigi, F., & Pryor, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3181732 · Cited by 15
Xin, J., Wang, L., Xu, K., Yang, C., & Yin, B. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3301307 · Cited by 10
Multi-scale Fusion and Global Semantic Encoding for Affordance Detection
Zhang, Y., Li, H., Ren, T., Dou, Y., & Li, Q.-F. (2022) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn55064.2022.9892363 · Cited by 10
Text-driven object affordance for guiding grasp-type recognition in multimodal robot teaching
Wake, N., Saito, D., Sasabuchi, K., Koike, H., & Ikeuchi, K. (2023) · Machine Vision and Applications · doi:10.1007/s00138-023-01408-z · Cited by 12
Beyond Object Recognition: A New Benchmark towards Object Concept Learning
Li, Y., Xu, Y., Xu, X., Mao, X., Yao, Y., Liu, S., & Lu, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01833 · Cited by 17
Learning Affordance Segmentation: An Investigative Study
Nguyen, C. D. M., Gilani, S. Z., Islam, S. M. S., & Suter, D. (2020) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta51227.2020.9363390 · Cited by 15
DAViD: Modeling Dynamic Affordance of 3D Objects Using Pre-Trained Video Diffusion Models
Kim, H., Baik, S., & Joo, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00962 · Cited by 27
A New Semantic Edge Aware Network for Object Affordance Detection
Yin, C., Zhang, Q., & Ren, W. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01525-9 · Cited by 11
What does CLIP know about peeling a banana?
Cuttano, C., Rosi, G., Trivigno, G., & Averta, G. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00229 · Cited by 15
SpotLight: Robotic Scene Understanding Through Interaction and Affordance Detection
Engelbracht, T., Zurbrügg, R., Pollefeys, M., Blum, H., & Bauer, Z. (2025) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids65713.2025.11203097 · Cited by 14
Towards robust grasps: Using the environment semantics for robotic object affordances
Ardón, P., Pairet, È., Ramamoorthy, S., & Lohan, K. S. (2018) · National Conference on Artificial Intelligence · Cited by 9
Hussain.S, S. M., Liu, L., Xu, W., & Lu, C. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190733 · Cited by 11
Liu, W., Bansal, D., Daruna, A., & Chernova, S. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10099-4 · Cited by 10
Hassanin, M., Khan, S. H., & Tahtalı, M. (2019) · IEEE Access · doi:10.1109/access.2019.2958608 · Cited by 9
Wu, H., Meng, X., Ruan, S., & Chirikjian, G. S. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811619 · Cited by 10
Object Pose Estimation in Robotics RevisitedPreprint
Hietanen, A., Latokartano, J., Foi, A., Pieters, R., Kyrki, V., Lanz, M., & Kämäräinen, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02783 · Cited by 9
Imagine That! Leveraging Emergent Affordances for 3D Tool SynthesisPreprint
Wu, Y., Kasewa, S., Groth, O., Salter, S., Sun, L., Jones, Ō. P., & Posner, I. (2019) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.1909.13561 · Cited by 9
Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions
Zhu, H., Kong, Q., Xu, K., Xia, X., Deng, B., Ye, J., Xiong, R., & Wang, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01616 · Cited by 29
RAGNet: Large-Scale Reasoning-Based Affordance Segmentation Benchmark Towards General Grasping
Wu, D., Fu, Y., Huang, S., Liu, Y., Jia, F., Liu, N., Dai, F., Wang, T., Anwer, R. M., Khan, F. S., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01114 · Cited by 23
Jeon, J., Jung, H.-R., Luong, T. A., Yumbla, F., & Moon, H. (2022) · Intelligent Service Robotics · doi:10.1007/s11370-022-00437-3 · Cited by 10
ADOSMNet: a novel visual affordance detection network with object shape mask guided feature encoders
Chen, D., Kong, D., Li, J., Wang, S., & Yin, B. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16898-2 · Cited by 9
Sultana, S., Alam, M. M., Su’ud, M. M., Mustapha, J. C., & Prasad, M. (2024) · ACM Computing Surveys · doi:10.1145/3648357 · Cited by 9
Zhuang, C., Wang, H., Niu, W., & Ding, H. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102879 · Cited by 9
Review of the techniques used in motor‐cognitive human‐robot skill transfer
Guan, Y. H., Wang, N., & Yang, C. (2021) · Cognitive Computation and Systems · doi:10.1049/ccs2.12025 · Cited by 8
Learning prohibited and authorised grasping locations from a few demonstrations
Hélénon, F., Bimont, L., Nyiri, É., Thiery, S., & Gibaru, O. (2020) · IEEE RO-MAN · doi:10.1109/ro-man47096.2020.9223486 · Cited by 8
Liu, W., Bansal, D., Daruna, A., & Chernova, S. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.035 · Cited by 12
Unseen Salient Object Discovery for Monocular Robot Vision
Chan, D. M., & Riek, L. D. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2968059 · Cited by 10
Relationship Oriented Affordance Learning through Manipulation Graph ConstructionPreprint
Tang, C., Yu, J., Chen, W., & Zhang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14137 · Cited by 9
Joint Object Affordance Reasoning and Segmentation in RGB-D Videos
Thermos, S., Potamianos, G., & Daras, P. (2021) · IEEE Access · doi:10.1109/access.2021.3090471 · Cited by 7
Meng, X., Wu, H., Ruan, S., & Chirikjian, G. S. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3306671 · Cited by 7
Task-Oriented Grasping with Point Cloud Representation of Objects
Patankar, A., Phi, K., Mahalingam, D., Chakraborty, N., & Ramakrishnan, I. V. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342318 · Cited by 7
Du, G., Wang, K., Lian, S., & Zhao, K. (2019) · arXiv (Cornell University) · Cited by 7
Tool Macgyvering: A Novel Framework for Combining Tool Substitution and ConstructionPreprint
Nair, L., Shrivatsav, N., & Chernova, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10638 · Cited by 7
Are standard Object Segmentation models sufficient for Learning Affordance Segmentation?Preprint
Caselles-Dupré, H., Garcia-Ortiz, M., & Filliat, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02095 · Cited by 7
Hu, S., Nagai, T., & Horii, T. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3598998 · Cited by 7
Wang, Z., & Tian, G. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3333693 · Cited by 7
Jiang, C., Yang, Y., & Jägersand, M. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611647 · Cited by 6
ToolEENet: Tool Affordance 6D Pose Estimation
Wang, Y., Zhang, L., Tu, Y., Zhang, H., Bai, K., Chen, Z., & Zhang, J. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801680 · Cited by 12
An Affordance Detection Pipeline for Resource-Constrained Devices
Apicella, T., Cavallaro, A., Berta, R., Gastaldo, P., Bellotti, F., & Ragusa, E. (2021) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs53924.2021.9665447 · Cited by 6
Thwe, Y., Jongsawat, N., & Tungkasthan, A. (2022) · Applied Sciences · doi:10.3390/app12168068 · Cited by 6
Relationship Oriented Semantic Scene Understanding for Daily Manipulation Tasks
Tang, C., Yu, J., Chen, W., Xia, B., & Zhang, H. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981960 · Cited by 7
Task-Motion Planning System for Socially Viable Service Robots Based on Object Manipulation
Jeon, J., Jung, H.-R., Pico, N., Luong, T. A., & Moon, H. (2024) · Biomimetics · doi:10.3390/biomimetics9070436 · Cited by 6
Learning Labeled Robot Affordance Models Using Simulations and Crowdsourcing
Allevato, A., Short, E. S., Pryor, M., & Thomaz, A. L. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.037 · Cited by 6
Inpaint2Learn: A Self-Supervised Framework for Affordance Learning
Zhang, L., Du, W., Zhou, S., Wang, J., & Shi, J. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00383 · Cited by 9
Affordance embeddings for situated language understanding
Krishnaswamy, N., & Pustejovsky, J. D. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.774752 · Cited by 12
Chen, D., Kong, D., Li, J., Wang, L., Gao, J., & Yin, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3324595 · Cited by 5
Continuous Wrist Control on the Hannes Prosthesis: A Vision-Based Shared Autonomy Framework
Vasile, F., Maiettini, E., Pasquale, G., Boccardo, N., & Natale, L. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127529 · Cited by 5
Afford-X: Generalizable and Slim Affordance Reasoning for Task-Oriented Manipulation
Zhu, X., Li, Y., Cui, L., Li, P., Gao, H.-A., Zhu, Y., & Zhao, H. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3722040 · Cited by 7
Multimodal Attention-Based Instruction-Following Part-Level Affordance Grounding
Wen, Q., Guo, L., Cui, J., & Xiao, J. (2024) · Applied Sciences · doi:10.3390/app14114696 · Cited by 5
ISOOV2 DL - Semantic Instance Segmentation of Touching and Overlapping Objects
Böhm, A., Tatarchenko, M., & Falk, T. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759334 · Cited by 5
Enhancing object, action, and effect recognition using probabilistic affordances
Jaramillo-Cabrera, E., Morales, E. F., & Martínez-Carranza, J. (2019) · Adaptive Behavior · doi:10.1177/1059712319839057 · Cited by 5
Reasoning on Grasp-Action Affordances
Ardón, P., Pairet, È., Petrick, R. P. A., Ramamoorthy, S., & Lohan, K. S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23807-0_1 · Cited by 5
Deep Multicameral Decoding for Localizing Unoccluded Object Instances from a Single RGB Image
Grard, M., Dellandréa, E., & Chen, L. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01323-0 · Cited by 6
Human-Centric Scene Understanding from Single View 360 Video
Fowler, S., Kim, H., & Hilton, A. (2018) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00046 · Cited by 7
Affordance Agent Harness: Verification-Gated Skill OrchestrationPreprint
Huang, H., Shi, J., Li, Y., & Chen, Y.-C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.00663 · Cited by 5
Generating 6DoF Object Manipulation Trajectories from Action Description in Egocentric Vision
Yoshida, T., Kurita, S., Nishimura, T., & Mori, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01619 · Cited by 15
Pose-Guided 3D Human Generation in Indoor Scene
Kim, M., Kang, C., Park, J., & Joo, K. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25195 · Cited by 5
Wang, Z., Yuan, H., Lv, J., Liu, Y., Xu, H., & Zhang, Y. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3548815 · Cited by 4
MaskPrompt: Open-Vocabulary Affordance Segmentation with Object Shape Mask Prompts
Chen, D., Kong, D., Li, J., & Yin, B. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i2.32200 · Cited by 10
Kong, W., Lin, Z., Yu, W., Guo, H., Su, Z., & Dong, H. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3598984 · Cited by 5
Girgin, T., & Uğur, E. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3520086 · Cited by 9
Ex Paucis Plura: Learning Affordance Segmentation from Very Few Examples
Sawatzky, J., Garbade, M., & Gall, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_13 · Cited by 4
Robotik Uygulamalar İçin Derin Öğrenme Tabanlı Nesne Tespiti ve Sınıflandırması
Özbilgin, F., & Tepe, C. (2020) · Karadeniz Fen Bilimleri Dergisi · doi:10.31466/kfbd.734393 · Cited by 4
Inferring Semantic Object Affordances from Videos
Bhattacharyya, R., Bhuyan, Z., & Hazarika, S. M. (2021) · Communications in computer and information science · doi:10.1007/978-981-16-1103-2_24 · Cited by 4
Visual Sorting Method Based on Multi-Modal Information Fusion
Han, S., Liu, X., & Wang, G. (2022) · Applied Sciences · doi:10.3390/app12062946 · Cited by 4
Deep Learning-Based Occlusion Handling of Overlapped Plants for Robotic Grasping
Babr, M. M., Faghihabdolahi, M., Ristić–Durrant, D., & Michels, K. (2022) · Applied Sciences · doi:10.3390/app12073655 · Cited by 4
Robotic Autonomous Grasping Technique: A Survey
Wang, L., Zhang, Z., Su, J., & Gu, Q. (2021) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait53529.2021.9731320 · Cited by 4
Metadata
- Authors
- Do, T.-T., Nguyen, A., & Reid, I.
- Affiliations
- Australian Centre for Robotic Vision (AU)
- Venue
- 2018 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 1-5
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2962984928
- Cited by
- 305
- References
- 31
- Citations by year
- 2026: 17 · 2025: 44 · 2024: 30 · 2023: 44 · 2022: 40 · 2021: 44 · 2020: 42 · 2019: 33 · 2018: 11
- FWCI
- 48.79
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Commission (611832, FP7 ICT, FP7 ICT 2013–10)
- Australian Centre for Robotic Vision (#CE140100016)
- FP7 Information and Communication Technologies (611832, FP7-ICT-2013-10)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- object detection, multi-task learning, multi-class segmentation, robotic manipulation, real-time inference, RGB images
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.