The DOI matches its Crossref record; 119 of the 119 references it cites were found in a registry or an index.
Interactive Perception: Leveraging Action in Perception and Perception in Action
Open accessAbstract
Recent approaches in robot perception follow the insight that perception is facilitated by interaction with the environment. These approaches are subsumed under the term Interactive Perception (IP). This view of perception provides the following benefits. First, interaction with the environment creates a rich sensory signal that would otherwise not be present. Second, knowledge of the regularity in the combined space of sensory data and action parameters facilitates the prediction and interpretation of the sensory signal. In this survey, we postulate this as a principle for robot perception and collect evidence in its support by analyzing and categorizing existing work in this area. We also provide an overview of the most important applications of IP. We close this survey by discussing remaining open questions. With this survey, we hope to help define the field of Interactive Perception and to provide a valuable resource for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Such structure is called Action Perception Regularity [1], and is believed to be the key for IP to reveal richer signals, which is impossible for passive and one-shot perception.”
From Interactive Perception for Deformable Object Manipulation (2024) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Interactive Perception (IP) exploits various types of forceful interactions with the environment to facilitate perception [1].”
From Interactive Perception for Deformable Object Manipulation (2024) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 1×
“t given only a single input image. A method has to cope with occlusions, different lighting conditions, scale of the images, just to name a few. State-of-the-art approaches in Computer Vision as e.g. [107, 108] require enormous amounts of training data to handle these variations. Interactive Perception approaches allo…”
MethodMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 1×
“These three examples illustrate that biological perception and perceptually-guided behavior intrinsically rely on active exploration and knowledge of the relation between action and sensory response.”
BackgroundFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 2×
“The most successful approaches learn models from data sets that contain hundreds of thousands of semantically annotated static images, such as Pascal VOC [6], ImageNet [7] or Microsoft COCO [8].”
BackgroundContour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454 · cited 1×
“This emphasizes the blurred boundary which is traditionally drawn between manipulation and perception.”
BackgroundLaValle, S. M. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546877 · Cited by 5,211
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · cited 1×
“of freedom [17]–[19] and models of visual attention [20], [21] that these active vision systems could use for guiding their gaze.”
BackgroundReinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · cited 2×
“Reinforcement learning [126] is also a common choice to learn a policy for action selection under these complex conditions.”
Background
Research works printed but not linked: 14
- allen, 1985, Two sensors are better than one: Example of integration of vision and touch, Proc Int Symp Robot Res
- goldberg, 1984, Active touch and robot perception, Cognition Brain Theory, 7, 199
- bajscy, 1988, Shape from touch, Advances in Automation and Robotics
- sandini, 1993, Vision During Action
- natale, 0, Learning haptic representation of objects, Proc Int Conf Intell Manipulation Grasping
- noë, 2004, Action in Perception
- gibson, 1966, The Senses Considered as Perceptual Systems
- katz, 0, Interactive segmentation of articulated objects in 3D, Mobile Manipulation Workshop Proc Int Conf Robot Automat
- singh, 2004, Predictive state representations: A new theory for modeling dynamical systems, Proceedings of the 20th conference on Uncertainty in artificial intelligence, 512
- gibson, 1979, The Ecological Approach to Visual Perception
- katz, 2014, Interactive Perception of Articulated Objects, 79, 301
- natale, 0, A sensitive approach to grasping, Proc 6th Int Workshop Epigenetic Robot, 87
- pahlavan, 1993, Active vision as a methodology, Active Perception, 19
- torres-jara, 2005, Tapping into touch, Proc 5th Int Workshop on Epigenetic Robotics, 79
Cited by
Trends and challenges in robot manipulation
Billard, A., & Kragic, D. (2019) · Science · doi:10.1126/science.aat8414 · Cited by 993
“Today, it is also recognized that perception and control are tightly coupled, and the field of interactive perception (63) regardsmanipulation as ameans to perceive and perception as a means to achieve better manipulation.”
BackgroundDeep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Neural Fields in Visual Computing and Beyond
Xie, Y., Takikawa, T., Saito, S., Litany, O., Yan, S., Khan, N., Tombari, F., Tompkin, J., sitzmann, V., & Sridhar, S. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14505 · Cited by 484
Lee, M. A., Zhu, Y., Srinivasan, K., Shah, P., Savarese, S., Fei-Fei, L., Garg, A., & Bohg, J. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793485 · Cited by 349
“There is compelling evidence that the interdependence and concurrency of different sensory streams aid perception and manipulation [9, 18, 31].”
BackgroundSelf-citationState representation learning for control: An overview
Lesort, T., Díaz-Rodríguez, N., Goudou, J.-F., & Filliat, D. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.006 · Cited by 301
“This is for instance the case of representation learning from different temporal signals in [Duan, 2017, Bohg et al., 2017].”
Background
Metadata
- Authors
- Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., & Sukhatme, G. S.
- Affiliations
- Max Planck Institute for Intelligent Systems (DE)
- University of Southern California (US)
- Technische Universität Berlin (DE)
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-12
- Volume
- 33
- Issue
- 6
- Pages
- 1273-1291
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2337977475
- Cited by
- 227
- References
- 118
- Citations by year
- 2026: 16 · 2025: 37 · 2024: 30 · 2023: 30 · 2022: 27 · 2021: 28 · 2020: 23 · 2019: 22 · 2018: 11 · 2017: 3
- FWCI
- 10.14
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (IIS-1205249, IIS-1017134, EECS-0926052)
- Office of Naval Research
- Okawa Foundation
- Max Planck Society
- German Science Foundation (DFG) (BR 2248/3-1)
- European Commission (H2020-ICT-645599)
- Soft Manipulation (Soma)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- interactive perception, robot perception, perception-action coupling, perception-action interaction, robot-environment interaction, sensorimotor learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interactive Perception: Leveraging Action in Perception and Perception in Action. https://app.cochat.ai/papers/10.1109/tro.2017.2721939
- The paper
- Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., & Sukhatme, G. S. (2017). Interactive Perception: Leveraging Action in Perception and Perception in Action. IEEE Transactions on Robotics. https://doi.org/10.1109/tro.2017.2721939
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.