Adaptive Robot Body Learning and Estimation Through Predictive Coding
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The predictive functions that permit humans to infer their body state by sensorimotor integration are critical to perform safe interaction in complex environments. These functions are adaptive and robust to non-linear actuators and noisy sensory information. This paper introduces a computational perceptual model based on predictive processing that enables any multisensory robot to learn, infer and update its body configuration when using arbitrary sensors with Gaussian additive noise. The proposed method integrates different sources of information (tactile, visual and proprioceptive) to drive the robot belief to its current body configuration. The motivation is to provide robots with the embodied perception needed for self-calibration and safe physical human-robot interaction. We formulate body learning as obtaining the forward model that encodes the sensor values depending on the body variables, and we solve it by Gaussian process regression. We model body estimation as minimizing the discrepancy between the robot body configuration belief and the observed posterior. We minimize the variational free energy using the sensory prediction errors (sensed vs expected). In order to evaluate the model we test it on a real multi-sensory robotic arm. We show how different sensor modalities contributions, included as additive errors, improve the refinement of the body estimation and how the system adapts itself to provide the most plausible solution even when injecting strong sensory visuo-tactile perturbations. We further analyse the reliability of the model when different sensor modalities are disabled. This provides grounded evidence about the correctness of the perceptual model and shows how the robot estimates and adjusts its body configuration just by means of sensory information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 3×
“the brain as observed by Rao and Ballard in the visual cortex [2].”
BackgroundMethodEvensen, G. (1994) · Journal of Geophysical Research: Oceans · doi:10.1029/94jc00572 · Cited by 5,371 · cited 1×
“Furthermore, it is important to highlight the strong similarities with the ensemble Kalman filter [14].”
BackgroundA View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 7×
“The model is based on works from predictive processing [7] and freeenergy approaches to perception [15], [8].”
BackgroundMethodInfluentialPerception of Body Ownership Is Driven by Bayesian Sensory Inference
Samad, M., Chung, A. J., & Shams, L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0117178 · Cited by 315 · cited 1×
“where a1, b1, a2, b2 are parameters that shape the likelihood and have been tuned in concordance with the data acquired in [27] from human participants; δ is the level of synchrony of the event (e.”
BackgroundA tutorial on the free-energy framework for modelling perception and learning
Bogacz, R. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.003 · Cited by 283 · cited 5×
“The model is based on works from predictive processing [7] and freeenergy approaches to perception [15], [8].”
BackgroundMethodInfluential
Cited by
A Novel Adaptive Controller for Robot Manipulators Based on Active Inference
Pezzato, C., Ferrari, R., & Corbato, C. H. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974451 · Cited by 104
“Another recent work [14] formalised the use of the free-energy for static state estimation, using a real UR5 robot arm equipped with proprioceptive and visual sensors.”
MethodPredictive processing in cognitive robotics: A review
Ciria, A., Schillaci, G., Pezzulo, G., Hafner, V. V., & Lara, B. (2021) · Neural Computation · doi:10.1162/neco_a_01383 · Cited by 51
“3 Lanillos and Cheng (2018) address also the tactile modality in their study, but do not fully integrate it in the error minimization scheme.”
BackgroundNeural dynamics under active inference: plausibility and efficiency of information processing
Da Costa, L., Parr, T., Sengupta, B., & Friston, K. (2021) · Entropy · doi:10.3390/e23040454 · Cited by 38
“These include planning and navigation [25– 31], exploration [32–36], learning of self and others [37,38], concept learning [39–41], playing games [42–44], adapting to changing environments [45–47], active vision [48–51] and psychiatric illness [42,52–55].”
BackgroundRobot self/other distinction: active inference meets neural networks learning in a mirror
Lanillos, P., Pages, J., & Cheng, G. (2020) · arXiv · doi:10.48550/arxiv.2004.05473 · Cited by 35
“Conversely to previous works on active inference we enabled the robot to learn those models taking inspiration from our latest contributions on body perception with function learning [21, 22].”
BackgroundSelf-citationPredictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
Millidge, B., Salvatori, T., Song, Y., Bogacz, R., & Lukasiewicz, T. (2022) · arXiv · doi:10.48550/arxiv.2202.09467 · Cited by 31
Metadata
- Authors
- Lanillos, P., & Cheng, G.
- Venue
- 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Publisher
- IEEE
- Published
- 2018-10
- Pages
- 4083-4090
- OpenAlex
- W2801487100
- Cited by
- 71
- References
- 6
- FWCI
- 19.67
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Adaptive Robot Body Learning and Estimation Through Predictive Coding. https://app.cochat.ai/papers/10.1109/iros.2018.8593684
- The paper
- Lanillos, P., & Cheng, G. (2018). Adaptive Robot Body Learning and Estimation Through Predictive Coding. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). https://doi.org/10.1109/iros.2018.8593684
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.