Active inference, eye movements and oculomotor delays
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
This paper considers the problem of sensorimotor delays in the optimal control of (smooth) eye movements under uncertainty. Specifically, we consider delays in the visuo-oculomotor loop and their implications for active inference. Active inference uses a generalisation of Kalman filtering to provide Bayes optimal estimates of hidden states and action in generalised coordinates of motion. Representing hidden states in generalised coordinates provides a simple way of compensating for both sensory and oculomotor delays. The efficacy of this scheme is illustrated using neuronal simulations of pursuit initiation responses, with and without compensation. We then consider an extension of the generative model to simulate smooth pursuit eye movements-in which the visuo-oculomotor system believes both the target and its centre of gaze are attracted to a (hidden) point moving in the visual field. Finally, the generative model is equipped with a hierarchical structure, so that it can recognise and remember unseen (occluded) trajectories and emit anticipatory responses. These simulations speak to a straightforward and neurobiologically plausible solution to the generic problem of integrating information from different sources with different temporal delays and the particular difficulties encountered when a system-like the oculomotor system-tries to control its environment with delayed signals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886
Information Theory and Statistical Mechanics. II
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.108.171 · Cited by 3,253
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 2×
“In Bayesian terms, this means that the brain maximises the evidence for its model of sensory inputs (Ballard et al. 1983; Bialek et al. 2001; Dayan et al. 1995; Gregory 1980; Grossberg et al. 1997; Knill and Pouget 2004; Olshausen and Field 1996).”
BackgroundCanonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 3×
“See Bastos et al. [2012] for a review of the anatomical and electrophysiological evidence that is consistent with the scheme used here.”
BackgroundMethodResultSelf-citationThe free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Self-citationAttention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
Self-citationVisuomotor integration is associated with zero time-lag synchronization among cortical areas
Roelfsema, P. R., Engel, A. K., König, P., & Singer, W. (1997) · Nature · doi:10.1038/385157a0 · Cited by 1,136 · cited 1×
“Representations of generalised motion may be important for modelling delays when integrating information in the brain from distal sources— such as other cortical columns in the same cortical area or other areas that are connected with fixed but different delays (Roelfsema et al. 1997).”
BackgroundMotion illusions as optimal percepts
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002) · Nature Neuroscience · doi:10.1038/nn0602-858 · Cited by 1,076
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074 · cited 3×
“Conversely,pre-dictionsareconveyedfromdeeppyramidalcellsbybackward connections, to target (polysynaptically) the superficial pyramidal cells encoding prediction error (Friston and Kiebel 2009; Mumford 1992).”
BackgroundMethodHierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 3×
“The equations on the right represent a generalised descent on free energy under the hierarchical model described in the main text—this can be regarded as a generalisation of predictive coding or Kalman filtering: see Friston [2008].”
BackgroundInfluentialSelf-citationOn the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929 · cited 3×
“Conversely,pre-dictionsareconveyedfromdeeppyramidalcellsbybackward connections, to target (polysynaptically) the superficial pyramidal cells encoding prediction error (Friston and Kiebel 2009; Mumford 1992).”
BackgroundMethodAction and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · cited 6×
“…second pair of equations), expressed in terms of action and internal states that encode conditional expectations about hidden states of the world (Friston et al. 2010b): For clarity, real-world states are written in boldface, while internal states of the agent are in italics: Here, ( s , x , ν,…”
InfluentialSelf-citationVision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
Object-based attention in the primary visual cortex of the macaque monkey
Roelfsema, P. R., Lamme, V. A. F., & Spekreijse, H. (1998) · Nature · doi:10.1038/26475 · Cited by 814
Gregory, R. L. (1980) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1980.0090 · Cited by 789
Perceptions as Hypotheses: Saccades as Experiments
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00151 · Cited by 462 · cited 1×
“A recent example of using dynamic causal modelling to test hypotheses based upon predictive coding architectures can be found in Brown and Friston (2012).”
Self-citationReinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443
Self-citationAttention reverses the effect of prediction in silencing sensory signals
Kok, P., Rahnev, D., Jehee, J. F. M., Lau, H. C., & de Lange, F. P. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr310 · Cited by 430
Free-Energy Minimization and the Dark-Room Problem
Friston, K., Thornton, C., & Clark, A. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00130 · Cited by 367
Self-citationBallard, D. H., Hinton, G. E., & Sejnowski, T. J. (1983) · Nature · doi:10.1038/306021a0 · Cited by 356
What is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332
Self-citationFriston, K., Stephan, K., Li, B., & Daunizeau, J. (2010) · Mathematical Problems in Engineering · doi:10.1155/2010/621670 · Cited by 171 · cited 4×
“These engage classical reflex arcs to suppress proprioceptive prediction errors and produce the predicted motor trajectory The reduction of action to classical reflexes follows because the only way that action can minimise free energy is to change sensory (proprioceptive) prediction errors by…”
InfluentialSelf-citationOn the theory of superconductivity
Ginzburg, V. L. (1955) · Il Nuovo Cimento · doi:10.1007/bf02731579 · Cited by 158
Smooth pursuit and visual occlusion: active inference and oculomotor control in schizophrenia
Adams, R. A., Perrinet, L. U., & Friston, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047502 · Cited by 91 · cited 1×
“This manipulation can account for several abnormalities of smooth pursuit eye movements typical of schizophrenia(Adams et al. 2012).”
BackgroundSelf-citationThaker, G. K., Ross, D. E., Buchanan, R. W., Adami, H. M., & Medoff, D. R. (1999) · Psychiatry Research · doi:10.1016/s0165-1781(99)00084-0 · Cited by 71
Cited by
A review of predictive coding algorithms
Spratling, M. W. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2015.11.003 · Cited by 437
Friston, K., & Frith, C. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2014.12.003 · Cited by 359
Self-citationPetzschner, F. H., Weber, L. A. E., Gard, T., & Stephan, K. E. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.05.012 · Cited by 181
Neuronal message passing using mean-field, bethe, and marginal approximations
Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J. (2019) · Scientific Reports · doi:10.1038/s41598-018-38246-3 · Cited by 128
Self-citationGenerative models for active vision
Parr, T., Sajid, N., Da Costa, L., Mirza, M. B., & Friston, K. J. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.651432 · Cited by 46
“This has important implications for things like sensorimotor delays (Perrinet et al., 2014), accounting for small discrepancies in the time the brainstem receives a proprioceptive signal compared to the time an oculomotor muscle contracted.”
BackgroundSelf-citation
Metadata
- Authors
- Perrinet, L. U., Adams, R. A., & Friston, K. J.
- Venue
- Biological Cybernetics
- Published
- 2014-08-16
- Volume
- 108
- Issue
- 6
- Pages
- 777-801
- ISSN
- 0340-1200 (ISSN-L)
- 1432-0770
- OpenAlex
- W1995035875
- Cited by
- 65
- References
- 27
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.