Active inference body perception and action for humanoid robots
Open accessAbstract
Providing artificial agents with the same computational models of biological systems is a way to understand how intelligent behaviours may emerge. We present an active inference body perception and action model working for the first time in a humanoid robot. The model relies on the free energy principle proposed for the brain, where both perception and action goal is to minimise the prediction error through gradient descent on the variational free energy bound. The body state (latent variable) is inferred by minimising the difference between the observed (visual and proprioceptive) sensor values and the predicted ones. Simultaneously, the action makes sensory data sampling to better correspond to the prediction made by the inner model. We formalised and implemented the algorithm on the iCub robot and tested in 2D and 3D visual spaces for online adaptation to visual changes, sensory noise and discrepancies between the model and the real robot. We also compared our approach with classical inverse kinematics in a reaching task, analysing the suitability of such a neuroscience-inspired approach for real-world interaction. The algorithm gave the robot adaptive body perception and upper body reaching with head object tracking (toddler-like), and was able to incorporate visual features online (in a closed-loop manner) without increasing the computational complexity. Moreover, our model predicted involuntary actions in the presence of sensorimotor conflicts showing the path for a potential proof of active inference in humans.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The DAI_HR papers propose a free energy minimization scheme based on a single decoder network used to control Nao, TIAGo, and iCub robots.
“Briefly, those papers propose a free energy minimization scheme based on a single decoder network, which is used to control Nao, TIAGo, and iCub robots, respectively.”
From Deconstructing Deep Active Inference: A Contrarian Information Gatherer (2024) · cites this paper as Oliver et al (2019)
The abstract (p. 1) says the paper implements free-energy-based active inference on the iCub, supporting the iCub part of the respectively ordered claim. The free-energy optimization section (p. 3) describes a forward model of the arm, not a single decoder network; the technical challenges section (p. 8) says learned generative functions could replace forward kinematics. This source therefore does not support the attributed decoder-network detail. (LLM, conf=0.88)
Experimental — accuracy not yet measuredThe DAI_HR approaches cannot be considered complete implementations of deep active inference because they are restricted to a single decoder and lack encoder, transition, and critic networks.
“Since, Sancaktar et al (2020); Lanillos et al (2020); Oliver et al (2019) restricted themself to the context of a single decoder, this approach can not be considered as a complete implementation of deep active inference.More precisely, the encoder, transition and critic (or policy) networks are missing.”
From Deconstructing Deep Active Inference: A Contrarian Information Gatherer (2024) · cites this paper as Oliver et al (2019)
The Technical Challenges section (p. 8) describes generative functions computed from forward kinematics, but does not characterize the implementation as a single decoder. The passages on the computational model and conclusions (pp. 5, 8) do not address encoder, transition, or critic networks. I searched for those network terms and for deep active inference; our copy does not establish the architectural claim attributed to Oliver et al. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193 · see citing works
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · see citing works
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · see citing works
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · see citing works
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · see citing works
Handbuch der physiologischen Optik
Helmholtz, H. L. F. (2011) · DFG Viewer (DFG Viewer) · Cited by 1,947 · see citing works
Variational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880 · see citing works
Action and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · cited 3× · see citing works
“Active inference Active inference [8], is the extension of perceptual inference to the relationship between sensors and actions, taking into account that actions can change the world to make sensory data more accurate with predictions made by the inner model.”
BackgroundInfluentialYARP: Yet Another Robot Platform
Metta, G., Fitzpatrick, P., & Natale, L. (2006) · International Journal of Advanced Robotic Systems · doi:10.5772/5761 · Cited by 658 · see citing works
Giorgio Metta, B., Sandini, G., Vernon, D., Natale, L., & Nori, F. (2008) · Workshop on Performance Metrics for Intelligent Systems (PerMIS) · doi:10.1145/1774674.1774683 · Cited by 548 · see citing works
The Markov blankets of life: autonomy, active inference and the free energy principle
Kirchhoff, M., Parr, T., Palacios, E., Friston, K., & Kiverstein, J. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0792 · Cited by 463 · cited 1× · see citing works
“Active inference would allow living beings to infer and simultaneously adapt their body to uncertain environments [8], something just partially solved in robotics.”
BackgroundThe free energy principle for action and perception: A mathematical review
Buckley, C. L., Kim, C. S., McGregor, S., & Seth, A. K. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.09.004 · Cited by 352 · see citing works
A tutorial on the free-energy framework for modelling perception and learning
Bogacz, R. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.003 · Cited by 283 · see citing works
Uncertainty, epistemics and active inference
Parr, T., & Friston, K. J. (2017) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0376 · Cited by 252 · see citing works
Tani, J. (2003) · Neural Networks · doi:10.1016/s0893-6080(02)00214-9 · Cited by 148 · see citing works
Kuniyoshi, Y., & Sangawa, S. (2006) · Biological Cybernetics · doi:10.1007/s00422-006-0127-z · Cited by 106 · see citing works
Active inference and robot control: a case study
Pio‐Lopez, L., Nizard, A., Friston, K. J., & Pezzulo, G. (2016) · Journal of The Royal Society Interface · doi:10.1098/rsif.2016.0616 · Cited by 84 · see citing works
Adaptive Robot Body Learning and Estimation Through Predictive Coding
Lanillos, P., & Cheng, G. (2018) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.1109/iros.2018.8593684 · Cited by 81 · see citing works
Self-citationProbabilistic Articulated Real-Time Tracking for Robot Manipulation
Cifuentes, C. G., Issac, J., Wüthrich, M., Stefan Schaal, A., & Bohg, J. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2645124 · Cited by 72 · see citing works
Roncone, A., Hoffmann, M., Pattacini, U., Fadiga, L., & Giorgio Metta, B. (2016) · PLoS ONE · doi:10.1371/journal.pone.0163713 · Cited by 56 · see citing works
An active inference implementation of phototaxis
Baltieri, M., & Buckley, C. L. (2017) · European Conference on Artificial Life · doi:10.1162/isal_a_011 · Cited by 47 · see citing works
Yielding Self-Perception in Robots Through Sensorimotor Contingencies
Lanillos, P., Dean-León, E., & Cheng, G. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2627820 · Cited by 34 · see citing works
Self-citationRobots as powerful allies for the study of embodied cognition from the bottom up
Hoffmann, M., & Pfeifer, R. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198735410.013.45 · Cited by 33 · see citing works
Hinz, N.-A., Lanillos, P., Müller, H. J., & Cheng, G. (2018) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2018.8761005 · Cited by 29 · see citing works
Self-citationOnline Body Schema Adaptation Based on Internal Mental Simulation and Multisensory Feedback
Vicente, P., Jamone, L., & Bernardino, A. J. M. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00007 · Cited by 27 · see citing works
Jamone, L., Brandão, M., Natale, L., Hashimoto, K., Sandini, G., & Takanishi, A. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.12.011 · Cited by 26 · see citing works
Online learning of a motor map for humanoid robot reaching
Gaskett, C., & Cheng, G. (2003) · ResearchOnline at James Cook University (James Cook University) · Cited by 26 · see citing works
Self-citationEnactive self: A study of engineering perspectives to obtain the sensorimotor self through enaction
Lanillos, P., Dean‐Leon, E., & Cheng, G. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329790 · Cited by 21 · see citing works
Self-citationVisual end-effector tracking using a 3D model-aided particle filter for humanoid robot platforms
Fantacci, C., Pattacini, U., Tikhanoff, V., & Natale, L. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8205942 · Cited by 13 · see citing works
Active inference with function learning for robot body perception
Lanillos, P., & Cheng, G. (2018) · Cited by 10 · see citing works
Self-citationAn active inference implementation of phototaxis
Baltieri, M., & Buckley, C. L. (2017) · European Conference on Artificial Life · doi:10.7551/ecal_a_011 · Cited by 1 · see citing works
Hinz, N.-A., Lanillos, P., Mueller, H., & Cheng, G. (2018) · arXiv · doi:10.48550/arxiv.1806.06809
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
A review on neural network models of schizophrenia and autism spectrum disorder
Lanillos, P., Oliva, D., Philippsen, A. K., Yamashita, Y., Nagai, Y., & Cheng, G. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.10.014 · Cited by 148 · see citing works
Self-citationA Novel Adaptive Controller for Robot Manipulators Based on Active Inference
Pezzato, C., Ferrari, R., & Corbato, C. H. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974451 · Cited by 104 · see citing works
The computational neurology of movement under active inference
Parr, T., Limanowski, J., Rawji, V., & Friston, K. J. (2021) · Brain · doi:10.1093/brain/awab085 · Cited by 59 · see citing works
End-to-End Pixel-Based Deep Active Inference for Body Perception and Action
Sancaktar, C., van Gerven, M. A. J., & Lanillos, P. (2020) · 2020 Joint IEEE 10th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) · doi:10.1109/icdl-epirob48136.2020.9278105 · Cited by 58 · see citing works
Self-citationPredictive processing in cognitive robotics: A review
Ciria, A., Schillaci, G., Pezzulo, G., Hafner, V. V., & Lara, B. (2021) · Neural Computation · doi:10.1162/neco_a_01383 · Cited by 51 · see citing works
Active Inference and Behavior Trees for Reactive Action Planning and Execution in Robotics
Pezzato, C., Corbato, C. H., Bonhof, S., & Wisse, M. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3226144 · Cited by 44 · see citing works
Matsumoto, T., & Tani, J. (2020) · Entropy · doi:10.3390/e22050564 · Cited by 34 · see citing works
Robot self/other distinction: active inference meets neural networks learning in a mirror
Lanillos, P., Pages, J., & Cheng, G. (2020) · arXiv · doi:10.48550/arxiv.2004.05473 · Cited by 35 · see citing works
“This work presents a novel active inference computational model that combines free energy optimization from [27] with function learning from [22].”
BackgroundMethodInfluentialSelf-citationOhata, W., & Tani, J. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00061 · Cited by 31 · see citing works
Robot in the Mirror: Toward an Embodied Computational Model of Mirror Self-Recognition
Hoffmann, M., Wang, S., Outrata, V., Alzueta, E., & Lanillos, P. (2021) · Künstliche Intell. · doi:10.1007/s13218-020-00701-7 · Cited by 22 · see citing works
Self-citationFlexible intentions: An Active Inference theory
Priorelli, M., & Stoianov, I. P. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1128694 · Cited by 23 · see citing works
Active strategies for multisensory conflict suppression in the virtual hand illusion
Lanillos, P., Franklin, S., Maselli, A., & Franklin, D. W. (2021) · Scientific Reports · doi:10.1038/s41598-021-02200-7 · Cited by 25 · see citing works
Self-citationFault-tolerant Control of Robot Manipulators with Sensory Faults using Unbiased Active Inference
Baioumy, M., Pezzato, C., Ferrari, R., Corbato, C. H., & Hawes, N. (2021) · 2021 European Control Conference (ECC) · doi:10.23919/ecc54610.2021.9654913 · Cited by 19 · see citing works
Ohata, W., & Tani, J. (2020) · Institutional Repositories DataBase (IRDB) · Cited by 15 · see citing works
Active Inference for Fault Tolerant Control of Robot Manipulators with Sensory Faults
Pezzato, C., Baioumy, M., Corbato, C. H., Hawes, N., Wisse, M., & Ferrari, R. (2020) · Communications in Computer and Information Science · doi:10.1007/978-3-030-64919-7_3 · Cited by 14 · see citing works
Free Energy Principle for State and Input Estimation of a Quadcopter Flying in Wind
Bos, F., Meera, A. A., Benders, D., & Wisse, M. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812415 · Cited by 14 · see citing works
A deep active inference model of the rubber-hand illusion
Rood, T., van Gerven, M., & Lanillos, P. (2020) · Communications in Computer and Information Science · doi:10.1007/978-3-030-64919-7_10 · Cited by 19 · see citing works
Self-citationSleep: Model Reduction in Deep Active Inference
Wauthier, S. T., Çatal, O., Boom, C. D., Verbelen, T., & Dhoedt, B. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-64919-7_9 · Cited by 11 · see citing works
Application of the Free Energy Principle to Estimation and Control
van de Laar, T., Özçelikkale, A., & Wymeersch, H. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3095711 · Cited by 11 · see citing works
Annabi, L., Pitti, A., & Quoy, M. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.07.016 · Cited by 10 · see citing works
Active Inference Through Energy Minimization in Multimodal Affective Human–Robot Interaction
Horii, T., & Nagai, Y. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.684401 · Cited by 10 · see citing works
A worked example of Fokker-Planck-based active inference
Koudahl, M. T., & de Vries, B. (2020) · Communications in Computer and Information Science · doi:10.1007/978-3-030-64919-7_4 · Cited by 7 · see citing works
Active Inference for Stochastic Control
Paul, A., Sajid, N., Gopalkrishnan, M., & Razi, A. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-93736-2_47 · Cited by 6 · see citing works
Active Strategies for Multisensory Conflict Suppression in the Virtual Hand IllusionPreprint
Lanillos, P., Franklin, S., Maselli, A., & Franklin, D. W. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.07.08.191304 · Cited by 5 · see citing works
Self-citationDeconstructing Deep Active Inference: A Contrarian Information Gatherer
Champion, T., Grześ, M., Bonheme, L., & Bowman, H. (2024) · Neural Computation · doi:10.1162/neco_a_01697 · Cited by 5 · see citing works
Active Inference for Integrated State-Estimation, Control, and Learning
Baioumy, M., Duckworth, P., Lacerda, B., & Hawes, N. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9562009 · Cited by 4 · see citing works
Active Inference or Control as Inference? A Unifying ViewPreprint
Watson, J., Imohiosen, A., & Peters, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00262 · Cited by 4 · see citing works
A Brain Inspired Learning Algorithm for the Perception of a Quadrotor in WindPreprint
Meera, A. A., & Wisse, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.11971 · Cited by 4 · see citing works
Iwashita, M., & Ishikawa, M. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3102993 · Cited by 2 · see citing works
Free Energy Principle for the Noise Smoothness Estimation of Linear Systems with Colored Noise
Meera, A. A., & Wisse, M. (2022) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc51059.2022.9992717 · Cited by 2 · see citing works
Ergul, B., van de Laar, T., Koudahl, M., Roa-Villescas, M., & de Vries, B. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-64919-7_14 · Cited by 1 · see citing works
van Vucht, V. (2021) · Research Repository (Delft University of Technology)
- Authors
- Oliver, G., Lanillos, P., & Cheng, G.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1906.03022
- OpenAlex
- W2948283202
- Cited by
- 30
- References
- 30
- Citations by year
- 2024: 1 · 2023: 2 · 2022: 2 · 2021: 13 · 2020: 11 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- active inference, free energy principle, body perception, humanoid robots, iCub, inverse kinematics, reaching task, online adaptation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
