Interactive Perception: Leveraging Action in Perception and Perception in Action
Open accessThe DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index.
Abstract
Recent approaches in robot perception follow the insight that perception is facilitated by interaction with the environment. These approaches are subsumed under the term Interactive Perception (IP). This view of perception provides the following benefits. First, interaction with the environment creates a rich sensory signal that would otherwise not be present. Second, knowledge of the regularity in the combined space of sensory data and action parameters facilitates the prediction and interpretation of the sensory signal. In this survey, we postulate this as a principle for robot perception and collect evidence in its support by analyzing and categorizing existing work in this area. We also provide an overview of the most important applications of IP. We close this survey by discussing remaining open questions. With this survey, we hope to help define the field of Interactive Perception and to provide a valuable resource for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Such structure is called Action Perception Regularity [1], and is believed to be the key for IP to reveal richer signals, which is impossible for passive and one-shot perception.”
From Interactive Perception for Deformable Object Manipulation (2024) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Interactive Perception (IP) exploits various types of forceful interactions with the environment to facilitate perception [1].”
From Interactive Perception for Deformable Object Manipulation (2024) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 1×
“t given only a single input image. A method has to cope with occlusions, different lighting conditions, scale of the images, just to name a few. State-of-the-art approaches in Computer Vision as e.g. [107, 108] require enormous amounts of training data to handle these variations. Interactive Perception approaches allo…”
MethodMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 1×
“These three examples illustrate that biological perception and perceptually-guided behavior intrinsically rely on active exploration and knowledge of the relation between action and sensory response.”
BackgroundFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 2×
“The most successful approaches learn models from data sets that contain hundreds of thousands of semantically annotated static images, such as Pascal VOC [6], ImageNet [7] or Microsoft COCO [8].”
BackgroundDomain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454 · cited 1×
“This emphasizes the blurred boundary which is traditionally drawn between manipulation and perception.”
BackgroundLaValle, S. M. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546877 · Cited by 5,211
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · cited 1×
“of freedom [17]–[19] and models of visual attention [20], [21] that these active vision systems could use for guiding their gaze.”
Background
Research works printed but not linked: 17
- [33] P. Allen and R. Bajscy, 'Two sensors are better than one: Example of integration of vision and touch,' in International Symposium on Robotics Research (ISRR) , France, October 1985. -
- [32] K. I. Goldberg and R. Bajscy, 'Active touch and robot perception,' Cognition and Brain Theory , vol. 7, no. 2, pp. 199-214, 1984. -
- [31] R. Bajscy, 'Shape from touch,' Advances in Automation and Robotics, JAI Press , 1988. -
- [24] G. Sandini, F. Gandolfo, E. Grosso, and M. Tistarelli, Vision during Action . Lawrence Erlbaum Associates, Inc, 1993, ch. 4. -
- [23] L. Natale, G. Metta, and G. Sandini, 'Learning haptic representation of objects,' in International Conference on Intelligent Manipulation and Grasping , July 2004. -
- [101] S. Otte, J. Kulick, M. Toussaint, and O. Brock, 'Entropybased strategies for physical exploration of the environments degrees of freedom,' in IEEE/RSJ International Conference on Intelligent Robots and Systems , 2014. -
- noë, 2004, Action in Perception
- [5] J. J. Gibson, The senses considered as perceptual systems . Boston: Houghton Mifflin, 1966. -
- [43] D. Katz and O. Brock, 'Interactive segmentation of articulated objects in 3d,' in Workshop on Mobile Manipulation at ICRA 2011 , 2011. -
- [128] S. Singh, M. R. James, and M. R. Rudary, 'Predictive state representations: A new theory for modeling dynamical systems,' in Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence , ser. UAI '04. Arlington, Virginia, United States: AUAI Press, 2004, pp. 512-519. -
- [131] N. Kr¨ uger, C. Geib, J. Piater, R. Petrick, M. Steedman, F. W¨ org¨ otter, A. Ude, T. Asfour, D. Kraft, D. Omrˇ cen, A. Agostini, and R. Dillmann, 'Objectaction complexes: Grounded abstractions of sensorymotor processes,' Robotics and Autonomous Systems , vol. 59, no. 10, pp. 740 - 757, 2011. -
- [3] A. No¨ e, Action in Perception . The MIT Press, 2004. -
- [1] J. J. Gibson, The Ecological Approach to Visual Perception . Houghton Mifflin, 1979. -
- [103] D. Katz, A. Orthey, and O. Brock, 'Interactive perception of articulated objects,' Springer Tracts in Advanced Robotics , vol. 79, pp. 301-315, 2014. -
- [111] L. Natale and E. Torres-Jara, 'A sensitive approach to grasping,' in Proceedings of the sixth international workshop on epigenetic robotics . Citeseer, 2006, pp. 87-94. -
- [17] K. Pahlavan, T. Uhlin, and J.-O. Eklundh, 'Active vision as a methodology,' Active perception , pp. 19-46, 1993. -
- [120] E. Torres-Jara, L. Natale, and P. Fitzpatrick, 'Tapping into touch,' pp. 79-86, 2005. -
Cited by
Items 201–300 of 308
Detection, Tracking and 3D Modeling of Objects with Sparse RGB-D SLAM and Interactive Perception
Almeida, D., Ataer-Cansızoğlu, E., & Corcodel, R. (2019) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids43949.2019.9035001 · Cited by 4
“This type of interactionguided perception is often dubbed interactive perception (IP) [1], [2].”
BackgroundMarcel, V., Argentieri, S., & Gas, B. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2959915 · Cited by 4
“[15] have introduced the notion of “interactive perception” as the set of approaches in robotics concerned with the implication of action in perception.”
A Formal Account of Structuring Motor Actions With Sensory Prediction for a Naive Agent
Godon, J.-M., Argentieri, S., & Gas, B. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.561660 · Cited by 4
A Framework for Multisensory Foresight for Embodied Agents
Chen, X., Hosseini, R., Panetta, K. A., & Sinapov, J. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9562068 · Cited by 5
“tive science [3], [4] and robotics [5], [6] has demonstrated the importance of using multiple (and often, non-visual)”
BackgroundMulti-modal Interactive Perception in Human Control of Complex Objects
Nayeem, R., Bazzi, S., Sadeghi, M., Razavian, R. S., & Sternad, D. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160375 · Cited by 4
“This human ability of interactive perception, i.e., using forceful interactions with an object to gain information, has recently received substantial attention in the robotics community [2].”
BackgroundNon-Parametric Self-Identification and Model Predictive Control of Dexterous In-Hand Manipulation
Chanrungmaneekul, P., Ren, K., Grace, J. T., Dollar, A. M., & Hang, K. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341520 · Cited by 4
“Interactive Perception: Leveraging proactive manipulation actions to unveil hidden system information can greatly improve the robot perception under limited sensing [16].”
BackgroundObject and Relation Centric Representations for Push Effect PredictionPreprint
Tekden, A. E., Erdem, A., Erdem, E., Asfour, T., & Uğur, E. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4386221 · Cited by 5
Learning to Grasp in Clutter with Interactive Visual Failure Prediction
Murray, M. H., Gupta, A., & Çakmak, M. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611363 · Cited by 4
“To address this challenge, we draw on ideas from interactive perception , a broad class of techniques in which the environment is manipulated to create rich sensory signals that would not be present through passive perception alone [1].”
BackgroundContext Awareness and Human–Robot Interaction Optimization for Museum Intelligent Guide Robot
Zou, A., Meng, Y., & Tong, S. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.202500728 · Cited by 3
“Interactive perception techniques have shown that robots can improve their perceptual abilities through actions while using perception to improve their actions as well, leading to increased context-awareness abilities for dynamic situations [29].”
Self-Supervised Robot In-hand Object Learning.
Florence, V., Corso, J. J., & Griffin, B. (2019) · Cited by 3
Using Active Vision for Enhancing an Surface-based Object Recognition Approach
Rohner, D., & Henrich, D. (2020) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2020.00065 · Cited by 3
“In addition, not only the viewpoint of the camera can be modified, but also the scene to enable more views, which is known as Interactive Perception [17].”
BackgroundYagi, H., Kobayashi, Y., Kato, D., Miyazawa, N., Kosuke, H. A. R. A., & Usui, D. (2023) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii55687.2023.10039176 · Cited by 3
“This approach can be regarded as ‘interactive perception’ [1], which includes utilization of tactile information obtained by touching actions (e.”
BackgroundBriegel, H. J., & Müller, T. (2025) · Synthese Library/Synthese library · doi:10.1007/978-3-031-98119-7_6 · Cited by 3
Towards Adjoint Sensing and Acting Schemes and Interleaving Task Planning for Robust Robot Plan
Yang, S., Mao, X., Wang, S., Xiao, H., & Xue, Y. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561756 · Cited by 4
“Instead, a robust plan expects to consist of sensor-based observation actions to purposefully observe the environment states, whose sensory feedback could be utilized for optimal decision-making on state-changing actuating actions [2].”
BackgroundKinematic Structure Estimation of Arbitrary Articulated Rigid Objects for Event Cameras
Nunes, U. M., & Demiris, Y. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812430 · Cited by 4
Ota, K., Tung, H.-Y. F., Smith, K. A., Cherian, A., Marks, T. K., Sullivan, A., Kanezaki, A., & Tenenbaum, J. B. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160575 · Cited by 7
“One can approximate this by a samplingbased method [19].”
Fusing RGBD Tracking and Segmentation Tree Sampling for Multi-Hypothesis Volumetric Segmentation
Price, A., Huang, K., & Berenson, D. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561136 · Cited by 3
“Instance segmentation of manipulation scenes is a wellstudied and rich field [12].”
BackgroundReinforcement Learning: An Industrial Perspective
Surana, A. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-60990-0_21 · Cited by 3
Planning Multimodal Exploratory Actions for Online Robot Attribute Learning
Zhang, X., Sinapov, J., & Zhang, S. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.005 · Cited by 4
Building 3D Object Models during Manipulation by Reconstruction-Aware Trajectory OptimizationPreprint
Huang, K., & Hermans, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03907 · Cited by 3
“Interactive perception [25] has shown success in many different applications, most significantly object segmentation [26, 27].”
BackgroundFast Joint Space Model-Predictive Control for Reactive Manipulation.Preprint
Bhardwaj, M., Sundaralingam, B., Mousavian, A., Ratliff, N., Fox, D., Ramos, F. T., & Boots, B. (2021) · arXiv (Cornell University) · Cited by 3
A comparative review of decision-making approaches for realistic event-driven environments
Stoyanova, I., Museux, N., Nguyen, S. M., & Filliat, D. (2025) · Discrete Event Dynamic Systems · doi:10.1007/s10626-025-00421-w · Cited by 2
“Interactive perception Interactive perception is a concept where perception and action are deeply intertwined, making observation an active process influenced by the agent’s actions (Bohg et al. 2017).”
CCPose: high-precision six-dimensional pose estimation for industrial objects
Roovere, P. D., Daems, R., Croenen, J., & wyffels, F. (2025) · Machine Vision and Applications · doi:10.1007/s00138-025-01763-z · Cited by 2
Deep Learning-Driven Segmentation of Unseen Objects in Indoor Robotic Environments
Zhang, Y., Yin, M., Zhang, Q., Zhang, C.-H., Yang, S. X., Li, Z., & Hua, C. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3673587 · Cited by 4
“Second, interactive perception allows robots to physically engage with their environment (e.g., via grasping or pushing) to acquire visual-motor data and self-label unknown objects [31], [32].”
Ma, H., Song, A., He, M., Li, M., Yan, Y., & Wei, L. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3678835 · Cited by 3
Achieving robustness by optimizing failure behavior
Baum, M., & Brock, O. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989681 · Cited by 2
Self-citationContinuous Perception for Classifying Shapes and Weights of Garments for Robotic Vision Applications
Duan, L., & Aragón-Camarasa, G. (2022) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0010804300003124 · Cited by 2
“The World Is Its Own Best Model”: Robust Real-World Manipulation Through Online Behavior Selection
Baum, M., & Brock, O. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811845 · Cited by 5
Self-citationLearning to Act for Perceiving in Partially Unknown Environments
Lamanna, L., Faridghasemnia, M., Gerevini, A., Saetti, A., Saffiotti, A., Serafini, L., & Traverso, P. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/609 · Cited by 2
“This is also a well-known challenge in the field of active perception (Bohg et al. 2017).”
BackgroundObject pose estimation by iterative contacts with soft tactile sensor
Kato, D., Kobayashi, Y., Yagi, H., Miyazawa, N., Kosuke, H. A. R. A., & Usui, D. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2366980 · Cited by 2
“This is called ‘interactive perception’ [7] using tactile sensors, and tactile information has been used in many studies (e.g. [8,9]).”
MANIP: A Modular Architecture for Integrating Interactive Perception for Robot Manipulation
Yu, J., Sadjadpour, T., O'Neill, A., Khfifi, M., Chen, L. Y., Cheng, R., Irshad, M. Z., Balakrishna, A., Kollar, T., & Goldberg, K. Y. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801746 · Cited by 9
“While active perception aims to explore the environment through multiple modalities, “interactive perception” differs in that it physically modifies the environment to facilitate perception [4].”
Extending robot minds through collective learning
Prorok, A. (2025) · Science Robotics · doi:10.1126/scirobotics.adv4049 · Cited by 2
Bailly, G., & Elisei, F. (2018) · doi:10.21437/ai-mhri.2018-10 · Cited by 2
“It remains to be seen if better multimodal representations are learned if the agent can actively decide on how to explore its environment (i.e. active learning [Bajcsy et al. , 2018] or interactive perception [Bohg et al. , 2017]).”
BackgroundAutomatic Grasping Using Tactile Sensing and Deep Calibration
Baghbahari, M., & Behal, A. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-32520-6_14 · Cited by 2
On decomposability in robot reinforcement learning
Höfer, S. (2017) · DepositOnce · doi:10.14279/depositonce-6054 · Cited by 4
“The key insight behind this concept is that interaction can reveal sensory signals that are not present otherwise (Bohg et al., 2016).”
BackgroundLoCoQuad: A Low-Cost Arachnoid Quadruped Robot for Research and EducationPreprint
Bernal, M., & Civera, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09025 · Cited by 2
“Integrating perception and action might cross-fertilize both topics and open new research areas with huge potential, as discussed for example in [2].”
Robotic grasping in unstructured and dynamic environments
Morrison, D. (2021) · Queensland University of Technology · doi:10.5204/thesis.eprints.207886 · Cited by 2
Sensor Planning for Large Numbers of Robots
Corah, M. (2021) · arXiv (Cornell University) · doi:10.1184/r1/14402495 · Cited by 3
CAT-RRT: Motion Planning that Admits Contact One Link at a Time
Nechyporenko, N., Escobedo, C., Kadekodi, S., & Roncone, A. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341668 · Cited by 1
“In our future research, we aim to demonstrate how robots can help leverage more “action” in the “sense-perceive-act” paradigm [36].”
BackgroundLearning Rearrangement Manipulation via Scene Prediction in Point Cloud
Ma, A., & Duan, X. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3414265 · Cited by 1
Interactive Robotic Moving Cable Segmentation by Motion Correlation
Holešovský, O., Škoviera, R., & Hlaváč, V. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3574960 · Cited by 1
Bimanual Regrasp Planning and Control for Active Reduction of Object Pose Uncertainty
Nagahama, R., Wan, W., Hu, Z., & Harada, K. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3580327 · Cited by 1
“From a broader perspective, our research also falls within the category of methods that utilize interactive perception [30] to estimate the pose of grasped objects.”
Tacser and Action-Conditioned Latent Filter for Generalizable Robotic Surface Perception
Dutta, A., Massalim, Y., Burdet, E., & Kaboli, M. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3626240 · Cited by 1
Proactive Scene Decomposition and Reconstruction
Li, B., Yan, Z., Wu, D., & Zha, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00912 · Cited by 1
“We refer readers to [3], a comprehensive review on interactive perception.”
Chen, Z., Hari, K., Dasari, T., Shieh, K., Jain, R., Fer, D., Guthart, G. S., & Goldberg, K. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246566 · Cited by 6
“Interaction with the environment generates sensory signals that provide valuable information for estimating visual data correlated over time [30].”
Lokesh, R., & Sternad, D. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013797 · Cited by 1
“Active perception via physical interaction also has received significant attention in robotics research for navigation and interaction in unknown environments [82–84].”
Takamori, D., Kobayashi, Y., Hayakawa, T., Kosuke, H. A. R. A., & Usui, D. (2026) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2025.105319 · Cited by 2
Online estimation and manipulation of articulated objects
Buchanan, R., Röfer, A., Moura, J., Valada, A., & Vijayakumar, S. (2026) · Autonomous Robots · doi:10.1007/s10514-025-10233-4 · Cited by 4
Berrens, A., Pirkovets, K., Azargoshasb, S., Slof, L. J., Çakal, B. A., van Leeuwen, P. J., Wit, E. M. K., Sinaasappel, M., Wendler, T., van der Poel, H. G., et al. (2026) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-026-07987-z · Cited by 1
“…sensor third-person tracing of high-count regions and Robo SPECT first person imaging of these targets tailor robotic interactive perception [35], meaning that during the execution of intraoperative imaging, every motion of the robot is instigated by a surgeon-robot-patient interaction and…”
Recognizing Orientation Slip in Human Demonstrations
Hagenow, M., Zhang, B., Mutlu, B., Zinn, M., & Gleicher, M. L. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561856 · Cited by 1
“Orientation slip is a frequent strategy in constrained motion, yet previous methods in learning constrained motion from demonstration and estimating articulation models from interactive perception [7] have not focused on recognizing and parameterizing orientation slip.”
Background6-DoF Occluded Object Semantic Grasp Planning with De-occlusion Instance Segmentation
Huang, Z., & Yang, S. (2022) · Intelligent Autonomous Systems · doi:10.1109/icoias56028.2022.9931318 · Cited by 1
“Current works [1] have achieved robust algorithms to solve the problem that how the robot could understand the layout of a certain scenario, as well as how to approach the target object in a correct movement and position.”
BackgroundAmortized Inference for Efficient Grasp Model Adaptation
Noseworthy, M., Shaw, S., Kessens, C. C., & Roy, N. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610789 · Cited by 3
“Disentangling object properties through interaction, termed ‘interactive and active perception’ [25], is a common strategy.”
BackgroundHuman Visual Understanding for Cognition and Manipulation -- A primer for the roboticistPreprint
Hjelm, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05272 · Cited by 1
“For a thorough review on interactive perception and further arguments for actionbased perception see [17].”
BackgroundContinuous Perception for Classifying Shapes and Weights of Garmentsfor Robotic Vision ApplicationsPreprint
Duan, L., & Aragón-Camarasa, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06089 · Cited by 1
“Perception and manipulation in robotics are an interactive process which a robot uses to complete a task [1].”
BackgroundActive Perception with Neural NetworksPreprint
Lee, E. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02744 · Cited by 1
Kober, J. (2019) · Springer eBooks · doi:10.1007/978-1-4471-5102-9_100027-1 · Cited by 2
CoPRE: Improving Sensitivity in Proprioceptive Contact Detection for Low-Cost Robot ArmsPreprint
Zhu, Y., Li, J., Dong, Y., Suhail, M., Yang, C., Luo, X., Li, H., Chen, B., & Cheng, X. (2026) · arXiv (Cornell University) · Cited by 1
Unknown Object Detection by Punching: An Impacting-Based Approach to Picking Novel Objects
Maeda, Y., Tsuruga, H., Honda, H., & Hirono, S. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-01370-7_52
Grasping Using Tactile Sensing and Deep CalibrationPreprint
Baghbahari, M., & Behal, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09656
“in recent years [22].”
Information-Collection in Robotic Process Monitoring: An Active Perception ApproachPreprint
Sehr, M. A., Xia, W. X., Akella, P., Ojea, J. A., & Solowjow, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00167
“As detailed in [2], interest in active perception and information theoretic control have grown rapidly in recent years.”
BackgroundAction-oriented Scene Understanding
Lüddecke, T. (2019) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-7632
Kober, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-44184-5_100027 · Cited by 1
Dynamic Contracting with AIPreprint
Qi, Q. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4155507
A method to estimate contact regions between hands and objects during human multi-digit graspingPreprint
Hartmann, F., Maiello, G., Rothkopf, C. A., & Fleming, R. W. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.30.510358
The Impact of Action in Visual Representation Learning
Devillers, A., Chaffraix, V., Armetta, F., Duffner, S., & Lefort, M. (2022) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/icdl53763.2022.9962210
“The benefits of such interactive perception are mainly to get access to some objects characteristics requiring manipulation as weights for example and to enrich and structure the regularities in the inputs (see [5] for an in-depth survey).”
Learning Geometric Representations of Objects via Interaction
Reichlin, A., Marchetti, G. L., Yin, H., Varava, A., & Kragić, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43421-1_37
An Inflatable Eversible Finger Pad for Variable-Stiffness Grasping with Parallel-Jaw Grippers
Deimel, R., & Kugi, A. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341676
“Robots are being pushed into manipulation tasks where they know less and less about their physical environment [1], [2], [3], [4], [5], [6].”
BackgroundBiological Motion in Robots and Users’ Action UnderstandingPreprint
Wan, M. F., & Bennett, S. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/368ux
Learning of the Exploratory Behavior of Mobile Robots for Environmental Segmentation
Gouko, M. (2024) · International Conference on Automation, Robotics and Applications · doi:10.1109/icara60736.2024.10553045
Planning and learning to perceive in partially unknown environments
Lamanna, L. (2024) · Intelligenza Artificiale · doi:10.3233/ia-240036
Briegel, H. J., & Müller, T. (2025) · Synthese Library/Synthese library · doi:10.1007/978-3-031-98119-7_5
Tool-Mediated Robot Perception of Granular Substances Using Multiple Sensory Modalities
Liu, S., & Sinapov, J. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127366
“In many cases, robots need to exploit forceful interactions with the environment to create novel and rich signals that would otherwise not be present [2].”
Autonomous learning of exploratory behavior for environmental modeling in mobile robots
Gouko, M. (2025) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-025-00491-x
Guo, D., & Liu, H. (2025) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-981-95-3044-1_12
Active Exploration for Robotic Manipulation
Guo, D., & Liu, H. (2025) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-981-95-3044-1_6
Introduction to Active Perception
Guo, D., & Liu, H. (2025) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-981-95-3044-1_1
Least Commitment Planning for the Object Scouting Problem
Merlin, M., Yang, Z., Konidaris, G., & Paulius, D. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246625
“The result is a model in which the robot actively constructs an envelope of known objects, within which it can use an efficient Markov task-level planner.”
Takamori, D., Hayakawa, T., Kobayashi, Y., Hara, K., & Usui, D. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11245918 · Cited by 1
“Object recognition without 3D shape representation can be categorized into two approaches, end-to-end (teaching) approach ( e.g. , [12], [13]) and representation learning approach [14], [15].”
Qian, H. H., Chen, Y., Wang, G., Chanrungmaneekul, P., & Hang, K. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247003
“Motion-based segmentation methods approach object segmentation from an active lens, using scene changes to segment objects [7], [21].”
Encoding Robot Behavior as Sensory-Based Adaptation of Learned Skillful Trajectories
Madera, J., Varveropoulos, L., & Fey, A. M. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247078
“A key observation in developing complex robotic behavior is linking perception and actions for robust control in unstructured, dynamic environments [30]–[32].”
Learning from human-robot interaction
Azagra, P., Murillo Arnal, A. C., & Sancho, J. C. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Active Kinematic Modeling for Precise Manipulation of Unseen Articulated Objects
Zhang, B., Wang, Y., Wang, Y., Wang, W., & Zhang, Z. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3656781 · Cited by 1
Adaptive Illumination Control for Robot PerceptionPreprint
Turkar, Y., Sadeghi, S., & Dantu, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.15900
“In robotics, active perception is often studied as a decision-making problem where robot actions are planned to improve perceptual quality and reduce uncertainty or speed up exploration [9, 22].”
G-MAPP: GPU-Accelerated Multi-Agent Planning and Perception for Reactive Motion Generation
Bishnoi, T., Laha, R., Löw, T., Chandy, J. A., Figueredo, L., & Haddadin, S. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3678839
“Others explicitly construct models of the environment, utilizing prior knowledge of the world’s geometry [26], [27] or its dynamics [28] to achieve efficient reactive control.”
Bootstrapping Robotic Ecological Perception with Exploration and Interactions
Goff, L. K. L. (2019) · theses.fr (ABES) · doi:10.70675/4332ada9zfeefz451dzbe4fz46f981073ef7
“A domain of robotics research, known as interactive perception, is interested in building such representations by associating perception and interaction (Bohg et al. [2017]).”
BackgroundInfluentialOpen-Ended Affordance Discovery in Robotics Using Pertinent Visual Features
Luce-Vayrac, P. (2019) · theses.fr (ABES) · doi:10.70675/c10595d0zd650z4447z9deczff002ff05548
On the role of Actions and Machine Learning in Artificial Agent Perception.
Caselles-Dupré, H. (2021) · theses.fr (ABES) · doi:10.70675/6cfe7f36z5adcz4a30za086z8f2bdc924098 · Cited by 1
Action shapes time perception : insights from visual motion extrapolation
Li, X. (2024) · theses.fr (ABES) · doi:10.70675/79a06befz3493z4f58zb017z86cbd09d1b8d
Open-Set Tactile Recognition Using Regression of Mechanical Properties
Uttayopas, P., Cheng, X., Eden, J., & Burdet, E. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3682587
“When encountering unknown objects, humans gather new information through interaction, identify new objects, and update their knowledge base accordingly [6], [7].”
On, S. K., Jeong, S., Lee, J., & Yang, I. (2026) · International Journal of Control Automation and Systems · doi:10.1007/s12555-026-00082-x · Cited by 3
Intrinsic recreation of moderately uncertain events in macaques
Iki, S., Iwaoki, H., Hattori, Y., & Adachi, I. (2026) · iScience · doi:10.1016/j.isci.2026.115820
“…the latter can be viewed as an extension of active sensing toward what contemporary cognitive science and robotics call ‘‘interactive perception’’ ( 25,26 ; see also a recent neuroscience framework 27 that distinguishes ‘‘alloactive’’ sensing, in which an animal moves only its sensors, from…”
Surgical innovation and technology
Matthews, J. B., Ruurda, J. P. H., Vaughan-Shaw, P. G., Winter, D. C., Beggs, A. D., Yiu, A. J., Davidson, B. R., Seeliger, B., Chen, X., Stoyanov, D. V., et al. (2025) · British journal of surgery · doi:10.1093/bjs/znaf224
SensorPerch: Sense Wherever and Whenever It Matters
Wu, Z., Tong, R., & Bhattacharjee, T. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3747651
When the Environment Becomes the Body:,Architectural Body Intelligence and Inverted EmbodimentPreprint
Hattori, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7290446
Multi-granularity 3D Visual Language Tracking from monocular videos: A benchmark and model
Wei, H., Wang, R., Guo, K., Huang, Y., Sun, S., Song, X., Feng, M., & Akhtar, N. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114771 · Cited by 1
Appendage-Inspired Soft Overturning Robot With Tactile-Driven Navigation in Confined Channels
Li, J., Wu, Z., Ding, J., Wen, L., Yang, G., & Zhang, F. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3729482
Metadata
- Authors
- Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., & Sukhatme, G. S.
- Affiliations
- Max Planck Institute for Intelligent Systems (DE)
- University of Southern California (US)
- Technische Universität Berlin (DE)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-12
- Volume
- 33
- Issue
- 6
- Pages
- 1273-1291
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2337977475
- Cited by
- 227
- References
- 118
- Citations by year
- 2026: 16 · 2025: 37 · 2024: 30 · 2023: 30 · 2022: 27 · 2021: 28 · 2020: 23 · 2019: 22 · 2018: 11 · 2017: 3
- FWCI
- 10.14
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (IIS-1205249, IIS-1017134, EECS-0926052)
- Office of Naval Research
- Okawa Foundation
- Max Planck Society
- German Science Foundation (DFG) (BR 2248/3-1)
- European Commission (H2020-ICT-645599)
- Soft Manipulation (Soma)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- interactive perception, robot perception, perception-action coupling, perception-action interaction, robot-environment interaction, sensorimotor learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.