Perception and hierarchical dynamics
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
In this paper, we suggest that perception could be modeled by assuming that sensory input is generated by a hierarchy of attractors in a dynamic system. We describe a mathematical model which exploits the temporal structure of rapid sensory dynamics to track the slower trajectories of their underlying causes. This model establishes a proof of concept that slowly changing neuronal states can encode the trajectories of faster sensory signals. We link this hierarchical account to recent developments in the perception of human action; in particular artificial speech recognition. We argue that these hierarchical models of dynamical systems are a plausible starting point to develop robust recognition schemes, because they capture critical temporal dependencies induced by deep hierarchical structure. We conclude by suggesting that a fruitful computational neuroscience approach may emerge from modeling perception as non-autonomous recognition dynamics enslaved by autonomous hierarchical dynamics in the sensorium.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Detecting strange attractors in turbulence
Takens, F. (1981) · Lecture Notes in Mathematics · doi:10.1007/bfb0091924 · Cited by 10,459
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · cited 1×
“• Extrinsic forward connections convey prediction error (from superfi cial pyramidal cells) and backward connections mediate predictions, based on hidden and causal states (from deep pyramidal cells) (Friston, 2005; Mumford, 1992; Sherman and Guillery, 1998).”
BackgroundSelf-citationOptimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081
Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing
Rauschecker, J. P., & Scott, S. K. (2009) · Nature Neuroscience · doi:10.1038/nn.2331 · Cited by 1,766
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
A free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369 · cited 2×
“In Kiebel et al. (2008), we showed how inversion of this hierarchical model can be implemented using the free-energy principle (Friston et al., 2006).”
BackgroundMethodSelf-citationDayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074 · cited 1×
“• Extrinsic forward connections convey prediction error (from superfi cial pyramidal cells) and backward connections mediate predictions, based on hidden and causal states (from deep pyramidal cells) (Friston, 2005; Mumford, 1992; Sherman and Guillery, 1998).”
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955 · cited 1×
“This is consistent with neuroscience fi ndings that higher cortical levels show invariance over greater time scales than lower levels (Giese and Poggio, 2003; Hasson et al., 2008; Koechlin and Jubault, 2006).”
ResultHierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952
On the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929
A hierarchy of temporal receptive windows in human cortex
Hasson, U., Yang, E., Vallines, I., Heeger, D. J., & Rubin, N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5487-07.2008 · Cited by 874
Chiel, H. J., & Beer, R. D. (1997) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01149-1 · Cited by 864
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
On the actions that one nerve cell can have on another: distinguishing “drivers” from “modulators”
Sherman, S. M., & Guillery, R. W. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.12.7121 · Cited by 746 · cited 1×
“• Extrinsic forward connections convey prediction error (from superfi cial pyramidal cells) and backward connections mediate predictions, based on hidden and causal states (from deep pyramidal cells) (Friston, 2005; Mumford, 1992; Sherman and Guillery, 1998).”
BackgroundA Hierarchy of Time-Scales and the Brain
Kiebel, S. J., Daunizeau, J., & Friston, K. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000209 · Cited by 694 · cited 19×
“In Kiebel et al. (2008), we used simulations to show that the inversion of these models shows a range of features which reproduce experimental fi ndings in systems neuroscience.”
InfluentialSelf-citationProbabilistic models of language processing and acquisition
Chater, N., & Manning, C. D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.006 · Cited by 411 · cited 2×
“Human speech perception has been construed as the output of a multi-level hierarchical system, which must be decoded at different time-scales (Chater and Manning, 2006; Poeppel et al., 2008).”
Upper processing stages of the perception–action cycle
Fuster, J. M. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.004 · Cited by 380 · cited 1×
“For cortical structure, these are: • Cortical areas are organized hierarchically (Felleman and Van Essen, 1991; Fuster, 2004).”
BackgroundLayered representations for learning and inferring office activity from multiple sensory channels
Oliver, N., Garg, A., & Horvitz, E. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.02.004 · Cited by 316 · cited 5×
“Here, we focus on artifi cial speech recognition (ASR) but note that there are similar modeling initiatives in other areas of artifi cial perception; e.g., vision (Moeslund et al., 2006; Oliver et al., 2004; Yam et al., 2004).”
InfluentialDEM: A variational treatment of dynamic systems
Friston, K. J., Trujillo-Barreto, N., & Daunizeau, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.054 · Cited by 278
BILMES, J. A. (2006) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e89-d.3.869 · Cited by 172 · cited 4×
“It is worth noting that these developments seem to have made minimal reference to neuroscience but were driven by the insight that conventional non-hierarchical models do not capture the deep structure of sensory data (Bilmes, 2006; Deng et al., 2006; Oliver et al., 2004).”
BackgroundMethodInfluentialFriston, K. J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.017 · Cited by 68
Self-citation
Cited by
The Computational Anatomy of Psychosis
Adams, R. A., Stephan, K. E., Brown, H. R., Frith, C. D., & Friston, K. J. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00047 · Cited by 850
Action understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
“Heteroclinic channels and their associated itinerant dynamics are easy to specify in generative models and have been used to model the recognition of speech and song (e.g. Afraimovich et al. 2008; Rabinovich et al. 2008; Kiebel et al. 2009a,b).”
InfluentialPrediction, cognition and the brain
Bubic (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00025 · Cited by 647
Hohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578
A neuronal model of predictive coding accounting for the mismatch negativity.
Wacongne, C., Changeux, J.-P., & Dehaene, S. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5003-11.2012 · Cited by 542
“While mathematical models of predictive coding have been proposed (Garrido et al., 2007; Kiebel et al., 2008, 2009), including some attributing distinct functions to the various cortical layers (Friston, 2005), none of them has yet led to a precise neuronal implementation of the generators of the…”
Method
Metadata
- Authors
- Kiebel, S. J.
- Venue
- Frontiers in Neuroinformatics
- Publisher
- Frontiers Media SA
- Published
- 2009
- Volume
- 3
- Pages
- 20-20
- ISSN
- 1662-5196 (ISSN-L)
- OpenAlex
- W2070813962
- Cited by
- 102
- References
- 23
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.