CoChat
Sign Up
PreprintCited by 26Visual perception and processing mechanismsNeural dynamics and brain functionEmbodied and Extended Cognition

Deep Predictive Learning: A Comprehensive Model of Three Visual Streams

Open access
O'Reilly, Randall C., Wyatte, Dean R., Rohrlich, John·2017·arXiv
DOI 10.48550/arxiv.1709.04654arXiv 1709.04654
Open this paper in CoChat — free accountOpen PDF

Abstract

How does the neocortex learn and develop the foundations of all our high-level cognitive abilities? We present a comprehensive framework spanning biological, computational, and cognitive levels, with a clear theoretical continuity between levels, providing a coherent answer directly supported by extensive data at each level. Learning is based on making predictions about what the senses will report at 100 msec (alpha frequency) intervals, and adapting synaptic weights to improve prediction accuracy. The pulvinar nucleus of the thalamus serves as a projection screen upon which predictions are generated, through deep-layer 6 corticothalamic inputs from multiple brain areas and levels of abstraction. The sparse driving inputs from layer 5 intrinsic bursting neurons provide the target signal, and the temporal difference between it and the prediction reverberates throughout the cortex, driving synaptic changes that approximate error backpropagation, using only local activation signals in equations derived directly from a detailed biophysical model. In vision, predictive learning requires a carefully-organized developmental progression and anatomical organization of three pathways (What, Where, and What * Where), according to two central principles: top-down input from compact, high-level, abstract representations is essential for accurate prediction of low-level sensory inputs; and the collective, low-level prediction error must be progressively and opportunistically partitioned to enable extraction of separable factors that drive the learning of further high-level abstractions. Our model self-organized systematic invariant object representations of 100 different objects from simple movies, accounts for a wide range of data, and makes many testable predictions.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1709.04654

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • A maximal SOHM within a brain may center on posterior cortices, particularly the temporoparietal junction and posteromedial cortices, with synchronizing complexes forming at alpha frequencies generating basic phenomenal consciousness.

    “A maximal SOHM—as a MICS and MICE repertoires—within a brain may center on posterior cortices, and in particular the temporoparietal junction (Graziano, 2019) and posteromedial cortices (PMCs) (O'Reilly et al., 2017), with synchronizing complexes forming at alpha frequencies generating basic phenomenal consciousness.”

    From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as O'Reilly et al., 2017

    The citation is attached specifically to posteromedial cortices, but the paper’s “Consciousness and Qualia” section (p. 41) explicitly avoids strongly localizing consciousness. It instead proposes that the pulvinar may coordinate processing across diffuse brain areas; it does not identify posteromedial cortices as a center. (LLM, conf=0.82)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 213

  1. Aisa, B., Mingus, B., & O'Reilly, R. (2008). The emergent neural modeling system. Neural Networks , 21 (8), 1146-1152.
  2. Artola, A., Br¨ ocher, B., & Singer, W. (1990). Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature , 347 (6288), 69-72.
  3. Aslin, R. N., Saffran, J. R., & Newport, E. L. (1998). Computation of Conditional Probability Statistics By 8-Month-Old Infants. Psychological Science , 9 (4), 321-324.
  4. Baars, B. J. (1983). Conscious Contents Provide the Nervous System with Coherent, Global Information. In R. J. Davidson, G. E. Schwartz, & D. H. Shapiro (Eds.), Consciousness and Self-Regulation (pp. 4179). Plenum.
  5. Barsalou, L. (2009). Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society B , 364 (1521), 1281-1289.
  6. Barsalou, L. W. (2008). Grounded cognition. Annual review of psychology , 59 , 617-645.
  7. Behrmann, M., & Plaut, D. C. (2013). Distributed circuits, not circumscribed centers, mediate visual recognition. Trends in Cognitive Sciences , 17 (5), 210-219.
  8. Bender, D. B. (1981). Retinotopic organization of macaque pulvinar. Journal of Neurophysiology , 46 (3), 672-693.
  9. Bender, D. B. (1982). Receptive-field properties of neurons in the macaque inferior pulvinar. Journal of neurophysiology , 48 .
  10. Bender, D. B., & Youakim, M. (2001). Effect of attentive fixation in macaque thalamus and cortex. Journal of neurophysiology , 85 , 219-234.
  11. Bengio, Y., Courville, A., & Vincent, P. (2013a). Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence , 35 (8), 1798-1828.
  12. Bengio, Y., Yao, L., Alain, G., & Vincent, P. (2013b). Generalized Denoising Auto-Encoders as Generative Models. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, & K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 26 (pp. 899907). Curran Associates, Inc.
  13. Bienenstock, E. L., Cooper, L. N., & Munro, P. W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. The Journal of Neuroscience , 2 (2), 32-48.
  14. Bisley, J. W., & Goldberg, M. E. (2010). Attention, intention, and priority in the parietal lobe. Annual Review of Neuroscience , 33 , 1-21.
  15. Bollimunta, A., Chen, Y., Schroeder, C. E., & Ding, M. (2008). Neuronal mechanisms of cortical alpha oscillations in awake-behaving macaques. The Journal of Neuroscience , 28 (40), 9976-9988.
  16. Bollimunta, A., Mo, J., Schroeder, C. E., & Ding, M. (2011). Neuronal mechanisms and attentional modulation of corticothalamic alpha oscillations. The Journal of Neuroscience , 31 (13), 4935-4943.
  17. Bourne, J. A., & Rosa, M. G. P. (2006). Hierarchical Development of the Primate Visual Cortex, as Revealed by Neurofilament Immunoreactivity: Early Maturation of the Middle Temporal Area (MT). Cerebral Cortex , 16 (3), 405-414.
  18. Brette, R., & Gerstner, W. (2005). Adaptive Exponential Integrate-and-Fire Model as an Effective Description of Neuronal Activity. Journal of Neurophysiology , 94 (5), 3637-3642.
  19. Bridge, H., Leopold, D. A., & Bourne, J. A. (2016). Adaptive Pulvinar Circuitry Supports Visual Cognition. Trends in Cognitive Sciences , 20 (2), 146-157.
  20. Buffalo, E. A., Fries, P., Landman, R., Buschman, T. J., & Desimone, R. (2011). Laminar differences in gamma and alpha coherence in the ventral stream. Proceedings of the National Academy of Sciences of the United States of America , 108 (27), 11262-11267.
  21. Busch, N. A., Dubois, J., & VanRullen, R. (2009). The phase of ongoing EEG oscillations predicts visual perception. The Journal of Neuroscience , 29 (24), 78697876.
  22. Buschman, T. J., Siegel, M., Roy, J. E., & Miller, E. K. (2011). Neural substrates of cognitive capacity limitations. Proceedings of the National Academy of Sciences , 108 (27), 11252-11255.
  23. Calderone, D. J., Lakatos, P., Butler, P. D., & Castellanos, F. X. (2014). Entrainment of neural oscillations as a modifiable substrate of attention. Trends in Cognitive Sciences , 18 (6), 300-309.
  24. Cavanagh, P., Hunt, A. R., Afraz, A., & Rolfs, M. (2010). Visual stability based on remapping of attention pointers. Trends in Cognitive Sciences , 14 (4), 147-153.
  25. Cer, D., & O'Reilly, R. C. (2006). Neural mechanisms of binding in the hippocampus and neocortex: Insights from computational models. In H. D. Zimmer, A. Mecklinger, & U. Lindenberger (Eds.), Handbook of binding & memory. Perspectives from cognitive neuroscience . Oxford: Oxford University Press.
  26. Chalmers, D. (1995). Facing up to the problem of consciousness. Journal of Consciousness Studies , 3(1) , 200-217.
  27. Ciresan, D., Meier, U., & Schmidhuber, J. (2012). Multicolumn Deep Neural Networks for Image Classification. IEEE Conf. on Computer Vision and Pattern Recognition CVPR 2012 , 3642-3649.
  28. Ciresan, D. C., Meier, U., Gambardella, L. M., & Schmidhuber, J. (2010). Deep, big, simple neural nets for handwritten digit recognition. Neural Computation , 22 (12), 3207-3220.
  29. Cleeremans, A. (1993). Mechanisms of Implicit Learning: Connectionist models of sequence processing . Cambridge, MA: MIT Press.
  30. Cleeremans, A., Servan-Schreiber, D., & McClelland, J. L. (1989). Finite State Automata and Simple Recurrent Networks. Neural Computation , 1 (3), 372-381.
  31. Colby, C. L., Duhamel, J. R., & Goldberg, M. E. (1997). Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. Journal of neurophysiology , 76 , 2841.
  32. Colunga, E., & Smith, L. B. (2005). From the lexicon to expectations about kinds: A role for associative learning. Psychological review , 112 (2), 347-382.
  33. Connors, B. W., Gutnick, M. J., & Prince, D. A. (1982). Electrophysiological properties of neocortical neurons in vitro. Journal of Neurophysiology , 48 (6), 1302-1320.
  34. Cooper, L. N., Intrator, N., Blais, B. S., & Shouval, H. (2004). Theory of Cortical Plasticity. New Jersey: World Scientific.
  35. Crick, F. (1984). Function of the thalamic reticular complex: The searchlight hypothesis. Proceedings of the National Academy of Sciences of the United States of America , 81 , 4586-4590.
  36. Crick, F., & Koch, C. (2003). A framework for consciousness. Nature Neuroscience , 6 (2), 119-126.
  37. Dayan, P., Hinton, G. E., Neal, R. N., & Zemel, R. S. (1995). The Helmholtz machine. Neural Computation , 7 (5), 889-904.
  38. de Haan, E. H. F., & Cowey, A. (2011). On the usefulness of 'what' and 'where' pathways in vision. Trends in Cognitive Sciences , 15 (10), 460-466.
  39. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society. Series B (Methodological) , 39 (1), 1-38.
  40. Desimone, R., & Duncan, J. (1995). Neural Mechanisms of Selective Visual Attention. Annual Review of Neuroscience , 18 , 193-222.
  41. Dougherty, K., Cox, M. A., Ninomiya, T., Leopold, D. A., & Maier, A. (2017). Ongoing Alpha Activity in V1 Regulates Visually Driven Spiking Responses. Cerebral Cortex , 27 (2), 1113-1124.
  42. Douglas, R. J., & Martin, K. A. C. (2004). Neuronal Circuits of the Neocortex. Annual Review of Neuroscience , 27 , 419-451.
  43. Dromme, I. C. V., Premereur, E., Verhoef, B.-E., Vanduffel, W., & Janssen, P. (2016). Posterior Parietal Cortex Drives Inferotemporal Activations During ThreeDimensional Object Vision. PLOS Biology , 14 (4), e1002445.
  44. Duhamel, J. R., Colby, C. L., & Goldberg, M. E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science , 255 (5040), 90-92.
  45. Elman, J., Bates, E., Karmiloff-Smith, A., Johnson, M., Parisi, D., & Plunkett, K. (1996). Rethinking Innateness: A Connectionist Perspective on Development . Cambridge, MA: MIT Press.
  46. Elman, J. L. (1990). Finding Structure In Time. Cognitive Science , 14 (2), 179-211.
  47. Elman, J. L. (1991). Distributed Representations, Simple Recurrent Networks, and Grammatical Structure. Machine Learning , 7 (2-3), 195-225.
  48. Engel, A. K., K¨ onig, P., Kreiter, A. K., Schillen, T. B., & Singer, W. (1992). Temporal coding in the visual cortex: New vistas on integration in the nervous system. Trends in neurosciences , 15 (6), 218-226.
  49. Fahrenfort, J. J., Scholte, H. S., & Lamme, V. A. F. (2008). The spatiotemporal profile of cortical processing leading up to visual perception. Journal of Vision , 8 (1), 1-12.
  50. Fattori, P., Pitzalis, S., & Galletti, C. (2009). The cortical visual area V6 in macaque and human brains. Journal of Physiology-Paris , 103 (1), 88-97.
  51. Felleman, D. J., & Van Essen, D. C. (1991). Distributed Hierarchical Processing in the Primate Cerebral Cortex. Cerebral Cortex , 1 (1), 1-47.
  52. Field, D. J. (1994). What Is the Goal of Sensory Coding? Neural Computation , 6 (4), 559-601.
  53. Fix, J., Rougier, N., & Alexandre, F. (2011). A dynamic neural field approach to the covert and overt deployment of spatial attention. Cognitive Computation , 3 (1), 279-293.
  54. Flint, A. C., & Connors, B. W. (1996). Two types of network oscillations in neocortex mediated by distinct glutamate receptor subtypes and neuronal populations. Journal of Neurophysiology , 75 (2), 951-957.
  55. Franceschetti, S., Guatteo, E., Panzica, F., Sancini, G., Wanke, E., & Avanzini, G. (1995). Ionic mechanisms underlying burst firing in pyramidal neurons: Intracellular study in rat sensorimotor cortex. Brain Research , 696 (1-2), 127-139.
  56. Freud, E., Plaut, D. C., & Behrmann, M. (2016). 'What' Is Happening in the Dorsal Visual Pathway. Trends in Cognitive Sciences , 20 (10), 773-784.
  57. Friston, K. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society B , 360 (1456), 815-836.
  58. Friston, K. (2010). The free-energy principle: A unified brain theory? Nature Reviews Neuroscience , 11 (2), 127-138.
  59. Fukushima, K. (1980). Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics , 36 (4), 193-202.
  60. Gerstner, W., & Naud, R. (2009). How Good Are Neuron Models? Science , 326 (5951), 379-380.
  61. Grill-Spector, K., Henson, R., & Martin, A. (2006). Repetition and the brain: Neural models of stimulusspecific effects. Trends in Cognitive Sciences , 10 (1), 14-23.
  62. Guenther, F. H., & Vladusich, T. (2012). A Neural Theory of Speech Acquisition and Production. Journal of neurolinguistics , 25 .
  63. Gulbinaite, R., ˙ Ilhan, B., & VanRullen, R. (2017). The Triple-Flash Illusion Reveals a Driving Role of Alpha-Band Reverberations in Visual Perception. Journal of Neuroscience , 37 (30), 7219-7230.
  64. Haegens, S., Ncher, V., Luna, R., Romo, R., & Jensen, O. (2011). -Oscillations in the monkey sensorimotor network influence discrimination performance by rhythmical inhibition of neuronal spiking. Proceedings of the National Academy of Sciences USA , 108 (48), 19377-19382.
  65. Hinton, G. E. (1981, January). A Parallel Computation That Assigns Canonical Object-Based Frames of Reference. Proceedings of the 7th IJCAI (pp. 683-685). Vancouver.
  66. Hinton, G. E. (2007). Learning multiple layers of representation. Trends in cognitive sciences , 11 (10), 428434.
  67. Hinton, G. E., McClelland, J. L., & Rumelhart, D. E. (1986). Distributed Representations. In D. E. Rumelhart, J. L. McClelland, & P. R. Group (Eds.), Parallel Distributed Processing. Volume 1: Foundations (pp. 77-109). Cambridge, MA: MIT Press.
  68. Hinton, G. E., & Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science , 313 (5786), 504-507.
  69. Hommel, B. (2004). Event files: Feature binding in and across perception and action. Trends in cognitive sciences , 8 (11), 494-500.
  70. Hong, H., Yamins, D. L. K., Majaj, N. J., & DiCarlo, J. J. (2016). Explicit information for category-orthogonal object properties increases along the ventral stream. Nature Neuroscience , 19 (4), 613-622.
  71. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences of the United States of America , 79 (8), 2554-2558.
  72. Hopfield, J. J. (1984). Neurons with graded response have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences of the United States of America , 81 , 3088-3092.
  73. Hummel, J. E., & Biederman, I. (1992). Dynamic binding in a neural network for shape recognition. Psychological review , 99 (3), 480-517.
  74. Ito, J., Maldonado, P., Singer, W., & Grn, S. (2011). Saccade-related modulations of neuronal excitability support synchrony of visually elicited spikes. Cerebral Cortex , 21 (11), 2482-2497.
  75. Jedlicka, P., Benuskova, L., & Abraham, W. C. (2015). A Voltage-Based STDP Rule Combined with Fast BCM-Like Metaplasticity Accounts for LTP and Concurrent 'Heterosynaptic' LTD in the Dentate Gyrus In Vivo. PLOS Computational Biology , 11 (11), e1004588.
  76. Jensen, O., Bonnefond, M., & VanRullen, R. (2012). An oscillatory mechanism for prioritizing salient unat- tended stimuli. Trends in Cognitive Sciences , 16 (4), 200-206.
  77. Jensen, O., Gips, B., Bergmann, T. O., & Bonnefond, M. (2014). Temporal coding organized by coupled alpha and gamma oscillations prioritize visual processing. Trends in Neurosciences , 37 (7), 357-369.
  78. Jilk, D., Lebiere, C., O'Reilly, R., & Anderson, J. (2008). SAL: An explicitly pluralistic cognitive architecture. Journal of Experimental & Theoretical Artificial Intelligence , 20 (3), 197-218.
  79. Johnson, R. R., & Burkhalter, A. (1997). A polysynaptic feedback circuit in rat visual cortex. The Journal of Neuroscience , 17 (18), 7129-7140.
  80. Jordan, M. I. (1989). Serial Order: A Parallel, Distributed Processing Approach. In J. L. Elman, & D. E. Rumelhart (Eds.), Advances in Connectionist Theory: Speech . Hillsdale, NJ: Lawrence Erlbaum Associates.
  81. Jordan, M. I., & Rumelhart, D. E. (1992). Forward Models: Supervised Learning with a Distal Teacher. Cognitive Science , 16 (3), 307-354.
  82. Kaas, J. H., & Lyon, D. C. (2007). Pulvinar contributions to the dorsal and ventral streams of visual processing in primates. Brain Research Reviews , 55 (2), 285-296.
  83. Kachergis, G., Wyatte, D., O'Reilly, R. C., de Kleijn, R., & Hommel, B. (2014). A continuous-time neural model for sequential action. Philosophical Transactions of the Royal Society B: Biological Sciences , 369 (1655), 20130623.
  84. Kawato, M., Hayakawa, H., & Inui, T. (1993). A forward-inverse optics model of reciprocal connections between visual cortical areas. Network: Computation in Neural Systems , 4 (4), 415-422.
  85. Kellman, P. J., & Spelke, E. (1983). Perception of partially occluded objects in infancy. Cognitive Psychology , 15 (4), 483-524.
  86. Ketz, N., Morkonda, S. G., & O'Reilly, R. C. (2013). Theta coordinated error-driven learning in the hippocampus. PLoS Computational Biology , 9 , e1003067.
  87. Ketz, N. A., Jensen, O., & O'Reilly, R. C. (2015). Thalamic pathways underlying prefrontal cortex-medial temporal lobe oscillatory interactions. Trends in neurosciences , 38 , 3-12.
  88. Klimesch, W., Sauseng, P., & Hanslmayr, S. (2007). EEG alpha oscillations: The inhibition-timing hypothesis. Brain Research Reviews , 53 (1), 63-88.
  89. Kok, P., & de Lange, F. P. (2015). Predictive Coding in Sensory Cortex. In An Introduction to Model-Based Cognitive Neuroscience (pp. 221-244). Springer, New York, NY.
  90. Komura, Y., Nikkuni, A., Hirashima, N., Uetake, T., & Miyamoto, A. (2013). Responses of pulvinar neurons reflect a subject's confidence in visual categorization. Nature Neuroscience , 16 (6), 749-755.
  91. Kravitz, D. J., Saleem, K. S., Baker, C. I., & Mishkin, M. (2011). A new neural framework for visuospatial processing. Nature Reviews Neuroscience , 12 (4), 217-230.
  92. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. In F. Pereira, C. J. C. Burges, L. Bottou, & K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 25 (pp. 10971105). Curran Associates, Inc.
  93. LaBerge, D., & Buchsbaum, M. S. (1990). Positron emission tomographic measurements of pulvinar activity during an attention task. The Journal of neuroscience : the official journal of the Society for Neuroscience , 10 , 613-9.
  94. Lakatos, P., Karmos, G., Mehta, A. D., Ulbert, I., & Schroeder, C. E. (2008). Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection. Science , 320 (5872), 110-113.
  95. Le, Q. V., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., & Ng, A. Y. (2012). Building highlevel features using large scale unsupervised learning. In ICML .
  96. LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature , 521 (7553), 436-444.
  97. (1990). Handwritten Digit Recognition with a BackPropagation Network. Advances in Neural Information Processing Systems (pp. 396-404). Morgan Kaufmann.
  98. Lee, T. S. (2015). The Visual System's Internal Model of the World. Proceedings of the IEEE , 103 (8), 13591378.
  99. Lee, T. S., & Nguyen, M. (2001). Dynamics of subjective contour formation in the early visual cortex. Proceedings of the National Academy of Sciences of the United States of America , 98 , 1907-1911.
  100. Lee, T. S., Yang, C. F., Romero, R. D., & Mumford, D. (2002). Neural activity in early visual cortex reflects behavioral experience and higher-order perceptual saliency. Nature Neuroscience , 5 (6), 589-597.
  101. Lim, S., McKee, J. L., Woloszyn, L., Amit, Y., Freedman, D. J., Sheinberg, D. L., & Brunel, N. (2015). Inferring learning rules from distributions of firing rates in cortical neurons. Nature Neuroscience , 18 (12), 1804-1810.
  102. Lisman, J. (1990). A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proceedings of the National Academy of Sciences USA , 86 (23), 9574-9578.
  103. Lisman, J., & Redish, A. D. (2009). Prediction, sequences and the hippocampus. Philosophical Transactions of the Royal Society B: Biological Sciences , 364 (1521), 1193-1201.
  104. Logothetis, N. K., & Sheinberg, D. L. (1996). Visual Object Recognition. Annual Review of Neuroscience , 19 , 577-621.
  105. Lopes da Silva, F. (1991). Neural mechanisms underlying brain waves: From neural membranes to networks. Electroencephalography and Clinical Neurophysiology , 79 (2), 81-93.
  106. Lorincz, M. L., Kekesi, K. A., Juhasz, G., Crunelli, V., & Hughes, S. W. (2009). Temporal framing of thalamic relay-mode firing by phasic inhibition during the alpha rhythm. Neuron , 63 (5), 683-696.
  107. Lotter, W., Kreiman, G., & Cox, D. (2016). Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning. arXiv:1605.08104 [cs, q-bio] . · arXiv
  108. Luczak, A., Bartho, P., & Harris, K. D. (2013). Gating of sensory input by spontaneous cortical activity. The Journal of Neuroscience , 33 (4), 1684-1695.
  109. Maier, A., Aura, C. J., & Leopold, D. A. (2011). Infragranular sources of sustained local field potential responses in macaque primary visual cortex. The Journal of Neuroscience , 31 (6), 1971-1980.
  110. Majaj, N. J., Hong, H., Solomon, E. A., & DiCarlo, J. J. (2015). Simple Learned Weighted Sums of Inferior Temporal Neuronal Firing Rates Accurately Predict Human Core Object Recognition Performance. The Journal of Neuroscience , 35 (39), 13402-13418.
  111. Maldonado, P., Babul, C., Singer, W., Rodriguez, E., Berger, D., & Gr¨ un, S. (2008). Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. Journal of Neurophysiology , 100 (3), 1523-1532.
  112. Markov, N. T., Ercsey-Ravasz, M. M., Gomes, R., R, A., Lamy, C., Magrou, L., Vezoli, J., Misery, P., Falchier, A., Quilodran, R., Gariel, M. A., Sallet, J., Gamanut, R., Huissoud, C., Clavagnier, S., Giroud, P., SappeyMarinier, D., Barone, P., Dehay, C., Toroczkai, Z., Knoblauch, K., Van Essen, D. C., & Kennedy, H. (2014a). A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex. Cerebral Cortex , 24 (1), 17-36.
  113. Markov, N. T., Vezoli, J., Chameau, P., Falchier, A., Quilodran, R., Huissoud, C., Lamy, C., Misery, P., Giroud, P., Ullman, S., Barone, P., Dehay, C., Knoblauch, K., & Kennedy, H. (2014b). Anatomy of hierarchy: Feedforward and feedback pathways in macaque visual cortex: Cortical counterstreams. Journal of Comparative Neurology , 522 (1), 225-259.
  114. Markram, H., & Tsodyks, M. (1996). Redistribution of synaptic efficacy between neocortical pyramidal neurons. Nature , 382 (6594), 807-810.
  115. Martinez-Conde, S., Macknik, S. L., & Hubel, D. H. (2004). The role of fixational eye movements in visual perception. Nature Reviews Neuroscience , 5 (3), 229-240.
  116. Martinez-Conde, S., Otero-Millan, J., & Macknik, S. L. (2013). The impact of microsaccades on vision: Towards a unified theory of saccadic function. Nature Reviews Neuroscience , 14 (2), 83-96.
  117. Mathewson, K. E., Fabiani, M., Gratton, G., Beck, D. M., & Lleras, A. (2010). Rescuing stimuli from invisibility: Inducing a momentary release from visual masking with pre-target entrainment. Cognition , 115 (1), 186-191.
  118. Melloni, L., Schwiedrzik, C. M., Rodriguez, E., & Singer, W. (2009). (Micro)Saccades, corollary activity and cortical oscillations. Trends in Cognitive Sciences , 13 (6), 239-245.
  119. Meyer, T., & Olson, C. R. (2011). Statistical learning of visual transitions in monkey inferotemporal cortex. Proceedings of the National Academy of Sciences of the United States of America , 108 (48), 19401-19406.
  120. Miall, R. C., & Wolpert, D. M. (1996). Forward Models for Physiological Motor Control. Neural Netw , 9 (8), 1265-1279.
  121. Michalareas, G., Vezoli, J., van Pelt, S., Schoffelen, J.M., Kennedy, H., & Fries, P. (2016). Alpha-Beta and Gamma Rhythms Subserve Feedback and Feedforward Influences among Human Visual Cortical Areas. Neuron , 89 (2), 384-397.
  122. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed Representations of Words and Phrases and their Compositionality. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, & K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 26 (pp. 3111-3119). Curran Associates, Inc.
  123. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience , 24 , 167-202.
  124. Milner, A. D., & Goodale, M. A. (2006). The Visual Brain in Action . Oxford University Press, 2 edition.
  125. Morton, J., & Johnson, M. H. (1991). CONSPEC and CONLERN: A two-process theory of infant face recognition. Psychological review , 98 , 164-181.
  126. Mountcastle, V. B. (1957). Modality and topographic properties of single neurons of cat's somatic sensory cortex. Journal of Neurophysiology , 20 (4), 408-434.
  127. Touretzky, G. E. Hinton, & T. J. Sejnowski (Eds.), Proceedings of the 1989 Connectionist Models Summer School (pp. 10-17). San Mateo, CA: Morgan Kaufman.
  128. Mumford, D. (1991). On the computational architecture of the neocortex. Biological Cybernetics , 65 (2), 135145.
  129. Mumford, D. (1992). On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biological Cybernetics , 66 (3), 241-251.
  130. Munakata, Y., McClelland, J. L., Johnson, M. H., & Siegler, R. S. (1997). Rethinking infant knowledge: Toward an adaptive process account of successes and failures in object permanence tasks. Psychological Review , 104 , 686-713.
  131. Nakamura, K., & Colby, C. L. (2002). Updating of the visual representation in monkey striate and extrastriate cortex during saccades. Proceedings of the National Academy of Sciences of the United States of America , 99 (6), 4026-4031.
  132. Neupane, S., Guitton, D., & Pack, C. C. (2017). Coherent alpha oscillations link current and future receptive fields during saccades. Proceedings of the National Academy of Sciences , 201701672.
  133. Norman, K. A., & O'Reilly, R. C. (2003). Modeling hippocampal and neocortical contributions to recognition memory: A complementary-learning-systems approach. Psychological Review , 110 (4), 611-646.
  134. Nunn, C. M. H., & Osselton, J. W. (1974). The Influence of the EEG Alpha Rhythm on the Perception of Visual Stimuli. Psychophysiology , 11 (3), 294-303.
  135. Olsen, S., Bortone, D., Adesnik, H., & Scanziani, M. (2012). Gain control by layer six in cortical circuits of vision. Nature , 483 (7387), 47-52.
  136. Olshausen, B. A., & Field, D. J. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research , 37 (23), 3311-3325.
  137. O'Reilly, R. C. (1996). Biologically plausible errordriven learning using local activation differences: The generalized recirculation algorithm. Neural Computation , 8 (5), 895-938.
  138. O'Reilly, R. C. (1998). Six Principles for BiologicallyBased Computational Models of Cortical Cognition. Trends in Cognitive Sciences , 2 (11), 455-462.
  139. O'Reilly, R. C. (2001). Generalization in interactive networks: The benefits of inhibitory competition and Hebbian learning. Neural Computation , 13 (6), 11991242.
  140. O'Reilly, R. C., & Busby, R. S. (2002, January). Generalizable Relational Binding from Coarse-coded Distributed Representations. In T. G. Dietterich, S. Becker, & Z. Ghahramani (Eds.), Advances in Neural Information Processing Systems (NIPS) 14 . Cambridge, MA: MIT Press.
  141. O'Reilly, R. C., Busby, R. S., & Soto, R. (2003). Three Forms of Binding and their Neural Substrates: Alternatives to Temporal Synchrony. In A. Cleeremans (Ed.), The Unity of Consciousness: Binding, Integration, and Dissociation (pp. 168-192). Oxford: Oxford University Press.
  142. O'Reilly, R. C., Hazy, T. E., & Herd, S. A. (2015). The Leabra cognitive architecture: How to play 20 principles with nature and win! In S. Chipman (Ed.), Oxford handbook of cognitive science . Oxford University Press.
  143. O'Reilly, R. C., Hazy, T. E., Mollick, J., Mackie, P., & Herd, S. (2014a). Goal-Driven Cognition in the Brain: A Computational Framework. arXiv:1404.7591 [qbio] . · arXiv
  144. O'Reilly, R. C., & Johnson, M. H. (1994). Object Recognition and Sensitive Periods: A Computational Analysis of Visual Imprinting. Neural Computation , 6 (3), 357-389.
  145. O'Reilly, R. C., & Munakata, Y. (2000). Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain . Cambridge, MA: MIT Press.
  146. O'Reilly, R. C., Petrov, A. A., Cohen, J. D., Lebiere, C. J., Herd, S. A., & Kriete, T. (2014b). How Limited Systematicity Emerges: A Computational Cognitive Neuroscience Approach. In I. P. Calvo, & J. Symons (Eds.), The architecture of cognition: Rethinking Fodor and Pylyshyn 1 s Systematicity Challenge . Cambridge, MA: MIT Press.
  147. O'Reilly, R. C., Wyatte, D., Herd, S., Mingus, B., & Jilk, D. J. (2013). Recurrent Processing during Object Recognition. Frontiers in Psychology , 4 (124).
  148. O'Reilly, R. C., Wyatte, D., & Rohrlich, J. (2014c). Learning Through Time in the Thalamocortical Loops. arXiv:1407.3432 [q-bio] . · arXiv
  149. Palva, S., & Palva, J. M. (2007). New vistas for alphafrequency band oscillations. Trends in Neurosciences , 30 (4), 150-158.
  150. Paradiso, M. A., Meshi, D., Pisarcik, J., & Levine, S. (2012). Eye movements reset visual perception. Journal of Vision , 12 (13).
  151. Pastalkova, E., Itskov, V., Amarasingham, A., & Buzs´ aki, G. (2008). Internally generated cell assembly sequences in the rat hippocampus. Science (New York, N.Y.) , 321 (5894), 1322-1327.
  152. Petersen, S. E., Robinson, D. L., & Keys, W. (1985). Pulvinar nuclei of the behaving rhesus monkey: Visual responses and their modulation. Journal of neurophysiology , 54 .
  153. Pouget, A., & Sejnowski, T. J. (1997). A new view of hemineglect based on the response properties of parietal neurones. Philosophical Transactions of the Royal Society of London B Biol Sci , 352 (1360), 14491459.
  154. Puce, A., & Perrett, D. (2003). Electrophysiology and brain imaging of biological motion. Philosophical Transactions of the Royal Society B: Biological Sciences , 358 (1431), 435-445.
  155. Pylyshyn, Z. (1989). The role of location indexes in spatial perception: A sketch of the FINST spatial-index model. Cognition , 32 (1), 65-97.
  156. Rajkai, C., Lakatos, P., Chen, C.-M., Pincze, Z., Karmos, G., & Schroeder, C. E. (2008). Transient cortical excitation at the onset of visual fixation. Cerebral Cortex , 18 (1), 200-209.
  157. Rao, S. G., Williams, G. V., & Goldman-Rakic, P. S. (1999). Isodirectional tuning of adjacent interneurons and pyramidal cells during working memory: Evidence for microcolumnar organization in PFC. Journal of Neurophysiology , 81 (4), 1903-1916.
  158. Rasmus, A., Berglund, M., Honkala, M., Valpola, H., & Raiko, T. (2015). Semi-supervised Learning with Ladder Networks. In C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, & R. Garnett (Eds.), Advances in Neural Information Processing Systems 28 (pp. 35463554). Curran Associates, Inc.
  159. Reynolds, J. H., & Heeger, D. J. (2009). The normalization model of attention. Neuron , 61 (2), 168-185.
  160. Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience , 2 (11), 1019-1025.
  161. Rizzolatti, G., & Matelli, M. (2003). Two different streams form the dorsal visual system: Anatomy and functions. Experimental Brain Research , 153 (2), 146-157.
  162. Rockland, K. S. (1996). Two types of corticopulvinar terminations: Round (type 2) and elongate (type 1). The Journal of comparative neurology , 368 , 57-87.
  163. Rockland, K. S. (1998b). Convergence and branching patterns of round, type 2 corticopulvinar axons. The Journal of Comparative Neurology , 390 (4), 515-536.
  164. Rockland, K. S., & Pandya, D. N. (1979). Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey. Brain Research , 179 (1), 3-20.
  165. Rodman, H. R. (1994). Development of Inferior Temporal Cortex in the Monkey. Cerebral Cortex , 4 (5), 484-498.
  166. Rodriguez, A., Whitson, J., & Granger, R. (2004). Derivation and analysis of basic computational operations of thalamocortical circuits. Journal of Cognitive Neuroscience , 16 (5), 856-877.
  167. Rohenkohl, G., & Nobre, A. C. (2011). Alpha oscillations related to anticipatory attention follow temporal expectations. The Journal of Neuroscience , 31 (40), 14076-14084.
  168. Roy, B. C., Frank, M. C., DeCamp, P., Miller, M., & Roy, D. (2015). Predicting the birth of a spoken word. Proceedings of the National Academy of Sciences , 112 (41), 12663-12668.
  169. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature , 323 (9), 533-536.
  170. Rumelhart, D. E., & McClelland, J. L. (1982). An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. Psychological review , 89 , 60-94.
  171. Saalmann, Y. B., Pinsk, M. A., Wang, L., Li, X., & Kastner, S. (2012). The Pulvinar Regulates Information Transmission Between Cortical Areas Based on Attention Demands. Science , 337 (6095), 753-756.
  172. Schenk, T., & McIntosh, R. D. (2010). Do we have independent visual streams for perception and action? Cognitive Neuroscience , 1 (1), 52-62.
  173. Schubert, D., Kotter, R., & Staiger, J. F. (2007). Mapping functional connectivity in barrel-related columns reveals layer- and cell type-specific microcircuits. Brain Structure & Function , 212 (2), 107-119.
  174. Schuster, M., & Paliwal, K. K. (1997). Bidirectional recurrent neural networks. Signal Processing, IEEE Transactions on , 45 (11), 2673-2681.
  175. Sereno, A. B., & Maunsell, J. H. (1998). Shape selectivity in primate lateral intraparietal cortex. Nature , 395 (6701), 500.
  176. Shadmehr, R. (2017). Learning to Predict and Control the Physics of Our Movements. Journal of Neuroscience , 37 (7), 1663-1671.
  177. Shao, Z., & Burkhalter, A. (1996). Different Balance of Excitation and Inhibition in Forward and Feedback Circuits of Rat Visual Cortex. The Journal of Neuroscience , 16 (22), 7353-7365.
  178. Sherman, S., & Guillery, R. (2006). Exploring the Thalamus and Its Role in Cortical Function . Cambridge, MA: MIT Press.
  179. Shrager, J., & Johnson, M. H. (1996). Dynamic Plasticity Influences the Emergence of Function in a Simple Cortical Array. Neural Networks , 9 (7), 1119-1129.
  180. Silva, L. R., Amitai, Y., & Connors, B. W. (1991). Intrinsic oscillations of neocortex generated by layer 5 pyramidal neurons. Science , 251 (4992), 432-435.
  181. Simons, D. J., & Rensink, R. A. (2005). Change blindness: Past, present, and future. Trends in cognitive sciences , 9 (1), 16-20.
  182. Sincich, L. C., Park, K. F., Wohlgemuth, M. J., & Horton, J. C. (2004). Bypassing V1: a direct geniculate input to area MT. Nature Neuroscience , 7 (10), 1123-1128.
  183. Spaak, E., Bonnefond, M., Maier, A., Leopold, D. A., & Jensen, O. (2012). Layer-specific entrainment of gamma-band neural activity by the alpha rhythm in monkey visual cortex. Current Biology , 22 (24), 2313-2318.
  184. Spratling, M. W. (2008). Reconciling predictive coding and biased competition models of cortical function. Frontiers in Computational Neuroscience , 2 (4), 1-8 (online).
  185. Stocco, A., Lebiere, C., & Anderson, J. (2010). Conditional Routing of Information to the Cortex: A Model of the Basal Ganglia's Role in Cognitive Coordination. Psychological Review , 117 , 541-574.
  186. Strick, P. L., Dum, R. P., & Fiez, J. A. (2009). Cerebellum and Nonmotor Function. Annual Review of Neuroscience , 32 (1), 413-434.
  187. Summerfield, C., & Egner, T. (2009). Expectation (and attention) in visual cognition. Trends in Cognitive Sciences , 13 (9), 403-409.
  188. Summerfield, C., Trittschuh, E. H., Monti, J. M., Mesulam, M. M., & Egner, T. (2008). Neural repetition suppression reflects fulfilled perceptual expectations. Nature Neuroscience , 11 (9), 1004-1006.
  189. Tanaka, K. (1996). Inferotemporal cortex and object vision. Annual Review of Neuroscience , 19 , 109-139.
  190. Thomson, A. M. (2010). Neocortical layer 6, a review. Frontiers in Neuroanatomy , 4 (13).
  191. Thomson, A. M., & Lamy, C. (2007). Functional maps of neocortical local circuitry. Frontiers in Neuroscience , 1 (1), 19-42.
  192. Tsutsui, K.-I., Jiang, M., Yara, K., Sakata, H., & Taira, M. (2001). Integration of Perspective and Disparity Cues in Surface-Orientation-Selective Neurons of Area CIP. Journal of Neurophysiology , 86 (6), 28562867.
  193. Ullman, S. (1995). Sequence seeking and counter streams: A computational model for bidirectional information flow in the visual cortex. Cerebral cortex , 5 (1), 1-11.
  194. Urakubo, H., Honda, M., Froemke, R. C., & Kuroda, S. (2008). Requirement of an allosteric kinetics of NMDA receptors for spike timing-dependent plasticity. The Journal of Neuroscience , 28 (13), 3310-3323.
  195. van Kerkoerle, T., Self, M. W., Dagnino, B., GarielMathis, M.-A., Poort, J., van der Togt, C., & Roelfsema, P. R. (2014). Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex. Proceedings of the National Academy of Sciences U.S.A. , 111 (40), 14332-14341.
  196. VanRullen, R., & Koch, C. (2003). Is perception discrete or continuous? Trends in Cognitive Sciences , 7 (5), 207-213.
  197. Varela, F. J., Toro, A., John, E. R., & Schwartz, E. L. (1981). Perceptual framing and cortical alpha rhythm. Neuropsychologia , 19 (5), 675-686.
  198. Verduzco-Flores, S. O., & O'Reilly, R. C. (2015). How the credit assignment problems in motor control could be solved after the cerebellum predicts increases in error. Frontiers in Computational Neuroscience , 9 .
  199. von Holst, E. (1954). Relations between the central Nervous System and the peripheral organs. The British Journal of Animal Behaviour , 2 (3), 89-94.
  200. von Stein, A., Chiang, C., & K¨ onig, P. (2000). Topdown processing mediated by interareal synchronization. Proceedings of the National Academy of Sciences of the United States of America , 97 (26), 1474814753.

200 of 213 shown

Cited by

Sorted by citations

Authors
O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J.
ORCID
Rohrlich, John
Venue
arXiv
Publisher
arXiv
Published
2017
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1709.04654
arXiv
1709.04654
OpenAlex
W2755877200
Cited by
26
References
25
Citations by year
2026: 1 · 2025: 2 · 2022: 2 · 2021: 8 · 2020: 5 · 2019: 3 · 2018: 5
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
Keywords
predictive learning, neocortex, visual cortex, pulvinar, corticothalamic projections, layer 6, synaptic plasticity, backpropagation, top-down prediction, object recognition, biophysical model, thalamus

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review