Principles of Temporal Processing Across the Cortical Hierarchy
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
The world is richly structured on multiple spatiotemporal scales. In order to represent spatial structure, many machine-learning models repeat a set of basic operations at each layer of a hierarchical architecture. These iterated spatial operations - including pooling, normalization and pattern completion - enable these systems to recognize and predict spatial structure, while robust to changes in the spatial scale, contrast and noisiness of the input signal. Because our brains also process temporal information that is rich and occurs across multiple time scales, might the brain employ an analogous set of operations for temporal information processing? Here we define a candidate set of temporal operations, and we review evidence that they are implemented in the mammalian cerebral cortex in a hierarchical manner. We conclude that multiple consecutive stages of cortical processing can be understood to perform temporal pooling, temporal normalization and temporal pattern completion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653
Kutas, M., & Federmeier, K. D. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.131123 · Cited by 4,377
Mesulam, M. (1998) · Brain · doi:10.1093/brain/121.6.1013 · Cited by 3,072
The mismatch negativity (MMN) in basic research of central auditory processing: A review
Näätänen, R., Paavilainen, P., Rinne, T., & Alho, K. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.026 · Cited by 2,644
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Predictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
The mismatch negativity: a review of underlying mechanisms
Garrido, M. I., Kilner, J. M., Stephan, K. E., & Friston, K. J. (2009) · Clinical Neurophysiology · doi:10.1016/j.clinph.2008.11.029 · Cited by 1,441
Poeppel, D. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00107-3 · Cited by 1,315
Language-specific phoneme representations revealed by electric and magnetic brain responses
Näätänen, R., Lehtokoski, A., Lennes, M., Cheour, M., Huotilainen, M., Iivonen, A., Vainio, M., Alku, P., Ilmoniemi, R. J., Luuk, A., et al. (1997) · Nature · doi:10.1038/385432a0 · Cited by 1,260
Synaptic theory of working memory
Mongillo, G., Barak, O., & Tsodyks, M. (2008) · Science · doi:10.1126/science.1150769 · Cited by 1,253
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074
Processing of low-probability sounds by cortical neurons
Ulanovsky, N., Las, L., & Nelken, I. (2003) · Nature Neuroscience · doi:10.1038/nn1032 · Cited by 1,049
The Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042
Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition
Fukushima, K., & Miyake, S. (1982) · Lecture Notes in Biomathematics · doi:10.1007/978-3-642-46466-9_18 · Cited by 991
A hierarchy of intrinsic timescales across primate cortex
Murray, J. D., Bernacchia, A., Freedman, D. J., Romo, R., Wallis, J. D., Cai, X., Padoa-Schioppa, C., Pasternak, T., Seo, H., Lee, D., et al. (2014) · Nature Neuroscience · doi:10.1038/nn.3862 · Cited by 990
Discovering Event Structure in Continuous Narrative Perception and Memory
Baldassano, C., Chen, J., Zadbood, A., Pillow, J. W., Hasson, U., & Norman, K. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.041 · Cited by 952
On the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929
A hierarchy of temporal receptive windows in human cortex
Hasson, U., Yang, E., Vallines, I., Heeger, D. J., & Rubin, N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5487-07.2008 · Cited by 874
Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory
Wang, X.-J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09587.1999 · Cited by 859
‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework
Stokes, M. G. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.05.004 · Cited by 850
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
Topographic mapping of a hierarchy of temporal receptive windows using a narrated story
Lerner, Y., Honey, C. J., Silbert, L. J., & Hasson, U. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3684-10.2011 · Cited by 834
Self-citationHierarchical process memory: memory as an integral component of information processing
Hasson, U., Chen, J., & Honey, C. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.04.006 · Cited by 749
Self-citationNeural signature of the conscious processing of auditory regularities
Bekinschtein, T. A., Dehaene, S., Rohaut, B., Tadel, F., Cohen, L., & Naccache, L. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0809667106 · Cited by 738
A Hierarchy of Time-Scales and the Brain
Kiebel, S. J., Daunizeau, J., & Friston, K. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000209 · Cited by 694
Perceiving, remembering, and communicating structure in events.
Zacks, J. M., Tversky, B., & Iyer, G. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.1.29 · Cited by 640
Evidence for a hierarchy of predictions and prediction errors in human cortex
Wacongne, C., Labyt, E., van Wassenhove, V., Bekinschtein, T., Naccache, L., & Dehaene, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117807108 · Cited by 560
Slow cortical dynamics and the accumulation of information over long timescales
Honey, C. J., Thesen, T., Donner, T. H., Silbert, L. J., Carlson, C. E., Devinsky, O., Doyle, W. K., Rubin, N., Heeger, D. J., & Hasson, U. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.011 · Cited by 532
Self-citationLanguage in context: Emergent features of word, sentence, and narrative comprehension
Xu, J., Kemeny, S., Park, G., Frattali, C., & Braun, A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.013 · Cited by 502
Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex?
Heilbron, M., & Chait, M. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2017.07.061 · Cited by 428
Prior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study
Todorovic, A., van Ede, F., Maris, E., & de Lange, F. P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1425-11.2011 · Cited by 391
Neurons along the auditory pathway exhibit a hierarchical organization of prediction error
Parras, G. G., Nieto-Diego, J., Carbajal, G. V., Valdés-Baizabal, C., Escera, C., & Malmierca, M. S. (2017) · Nature Communications · doi:10.1038/s41467-017-02038-6 · Cited by 344
Broca's Area in Language, Action, and Music
Fadiga, L., Craighero, L., & D’Ausilio, A. (2009) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.04582.x · Cited by 332
Expectation and Attention in Hierarchical Auditory Prediction
Chennu, S., Noreika, V., Gueorguiev, D., Blenkmann, A., Kochen, S., Ibanez, A., Owen, A. M., & Bekinschtein, T. A. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0114-13.2013 · Cited by 299
Brain responses in humans reveal ideal observer-like sensitivity to complex acoustic patterns
Barascud, N., Pearce, M. T., Griffiths, T. D., Friston, K. J., & Chait, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1508523113 · Cited by 296
A reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292
Learned spatiotemporal sequence recognition and prediction in primary visual cortex
Gavornik, J. P., & Bear, M. F. (2014) · Nature Neuroscience · doi:10.1038/nn.3683 · Cited by 227
Heeger, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1619788114 · Cited by 220
Hierarchy of prediction errors for auditory events in human temporal and frontal cortex
Dürschmid, S., Edwards, E., Reichert, C., Dewar, C., Hinrichs, H., Heinze, H.-J., Kirsch, H. E., Dalal, S. S., Deouell, L. Y., & Knight, R. T. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1525030113 · Cited by 161
A place for time: The spatiotemporal structure of neural dynamics during natural audition
Stephens, G. J., Honey, C. J., & Hasson, U. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00268.2013 · Cited by 141
Self-citationGjorgjieva, J., Drion, G., & Marder, E. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.12.008 · Cited by 127
Statistical Learning Signals in Macaque Inferior Temporal Cortex
Kaposvari, P., Kumar, S., & Vogels, R. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhw374 · Cited by 91
Laminar fMRI and computational theories of brain function
Stephan, K. E., Petzschner, F. H., Kasper, L., Bayer, J., Wellstein, K. V., Stefanics, G., Pruessmann, K. P., & Heinzle, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.001 · Cited by 82
Repetition suppression to faces in the fusiform face area: A personal and dynamic journey
Henson, R. N. (2016) · Cortex · doi:10.1016/j.cortex.2015.09.012 · Cited by 76 · cited 1×
“…both spatial contrast and temporal contrast (Carandini & Heeger 2012), and multiple stages of visual cortex adapt their responses to repeated stimuli, as measured using fMRI (Kourtzi & Huberle, 2005; Henson, 2016), EEG (Stefanics et al., 2011), and single unit recordings (Krekelberg et al., 2006).”
MethodTemporal scaling of neural responses to compressed and dilated natural speech
Lerner, Y., Honey, C. J., Katkov, M., & Hasson, U. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00497.2013 · Cited by 75
Self-citationDeep Predictive Learning: A Comprehensive Model of Three Visual Streams
O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J. (2017) · arXiv · doi:10.48550/arxiv.1709.04654 · Cited by 26
Cited by
The brain and its time: intrinsic neural timescales are key for input processing
Golesorkhi, M., Gomez-Pilar, J., Zilio, F., Berberian, N., Wolff, A., Yagoub, M. C. E., & Northoff, G. (2021) · Communications Biology · doi:10.1038/s42003-021-02483-6 · Cited by 198
Atypical intrinsic neural timescale in autism
Watanabe, T., Rees, G., & Masuda, N. (2019) · eLife · doi:10.7554/elife.42256 · Cited by 150
The self and its prolonged intrinsic neural timescale in schizophrenia
Northoff, G., Sandsten, K. E., Nordgaard, J., Kjaer, T. W., & Parnas, J. (2021) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaa083 · Cited by 91
Intrinsic timescales and predictive allostatic interoception in brain health and disease
Ibanez, A., & Northoff, G. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105510 · Cited by 36
Prolonged intrinsic neural timescales dissociate from phase coherence in schizophrenia
Lechner, S., & Northoff, G. (2023) · Brain Sciences · doi:10.3390/brainsci13040695 · Cited by 27
Metadata
- Authors
- Himberger, K. D., Chien, H.-Y., & Honey, C. J.
- Venue
- Neuroscience
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 389
- Pages
- 161-174
- ISSN
- 0306-4522 (ISSN-L)
- OpenAlex
- W2803053786
- Cited by
- 88
- References
- 52
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.