Associative Prediction of Visual Shape in the Hippocampus
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Abstract Perception can be cast as a process of inference, in which bottom-up signals are combined with top-down predictions in sensory systems. However, the source of these top-down predictions, especially when complex and multisensory, remains largely unknown. We hypothesised that the hippocampus — which rapidly learns arbitrary associations and has bidirectional connections with sensory systems — may be involved. We exposed humans to auditory cues predicting visual shapes, while measuring high-resolution fMRI signals in visual cortex and the hippocampus. Using multivariate reconstruction methods, we discovered a dissociation between these regions: representations in visual cortex were dominated by whichever shape was presented, whereas representations in the hippocampus (CA3 and subiculum, but not CA1) reflected only which shape was predicted by the cue. The strength of hippocampal predictions correlated across participants with the amount of expectation-related facilitation in visual cortex. These findings are consistent with the possibility that the hippocampus supplies predictions to sensory systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jenkinson, M., Beckmann, C. F., Behrens, T. E. J., Woolrich, M. W., & Smith, S. M. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.015 · Cited by 11,314
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 5×
“Generally, such models seek to explain mostly lower-level phenomena that can be resolved within local circuits of visual cortex, such as end-stopping and surround suppression (Rao and Ballard, 1999; Spratling, 2010).”
BackgroundInfluentialMcClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · cited 6×
“Third, one of the main computational functions of the hippocampus is to retrieve associated items from memory based on partial information, a process known as pattern completion (Treves and Rolls, 1994; McClelland et al., 1995; Henke, 2010).”
BackgroundInfluentialSMITH, S., & NICHOLS, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.061 · Cited by 5,250
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · cited 3×
“Predictive coding theories (Mumford, 1992; Rao and Ballard, 1999; Friston, 2005) of cortical processing fit well with the strong influence of predictions on sensory processing reported here and elsewhere (for review, see den Ouden et al., 2012; Summerfield and de Lange, 2014).”
BackgroundPermutation inference for the general linear model
Winkler, A. M., Ridgway, G. R., Webster, M. A., Smith, S. M., & Nichols, T. E. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.060 · Cited by 3,563 · cited 2×
“Group-level nonparametric permutation tests were applied to these searchlight maps using FSL Randomize (Winkler et al., 2014), correcting for multiple comparisons at p 0.05 using threshold-free cluster enhancement (Smith and Nichols, 2009).”
MethodInfluentialAndersson, J. L. R., Skare, S., & Ashburner, J. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00336-7 · Cited by 3,469
The Medial Temporal Lobe and Recognition Memory
Eichenbaum, H., Yonelinas, A. P., & Ranganath, C. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.30.051606.094328 · Cited by 2,580
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · cited 1×
“This may be a particularly difficult challenge given that complex shapes are known to be encoded in a spatially invariant manner in higher-level visual cortex (DiCarlo et al., 2012).”
BackgroundTop-down facilitation of visual recognition
Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., Hämäläinen, M. S., Marinkovic, K., Schacter, D. L., Rosen, B. R., et al. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507062103 · Cited by 1,489 · cited 2×
“…are several other mechanisms for prediction in the brain, including related to object recognition and semantic labels in medial prefrontal cortex (Bar et al., 2006) and to value and reinforcement learning in the ventral striatum (den Ouden et al., 2012), as well as many other areas of polymodal…”
BackgroundDecoding reveals the contents of visual working memory in early visual areas
Harrison, S. A., & Tong, F. (2009) · Nature · doi:10.1038/nature07832 · Cited by 1,347
Computational analysis of the role of the hippocampus in memory
Treves, A., & Rolls, E. T. (1994) · Hippocampus · doi:10.1002/hipo.450040319 · Cited by 1,272
Item, context and relational episodic encoding in humans
Davachi, L. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.10.012 · Cited by 1,138
Interactive memory systems in the human brain
Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001) · Nature · doi:10.1038/35107080 · Cited by 1,132
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074
On the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929 · cited 2×
“Predictive coding theories (Mumford, 1992; Rao and Ballard, 1999; Friston, 2005) of cortical processing fit well with the strong influence of predictions on sensory processing reported here and elsewhere (for review, see den Ouden et al., 2012; Summerfield and de Lange, 2014).”
BackgroundExpectation in perceptual decision making: neural and computational mechanisms
Summerfield, C., & de Lange, F. P. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3838 · Cited by 832
Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex
Kok, P., Jehee, J. F. M., & de Lange, F. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.034 · Cited by 798
Self-citationSolomon, P. R., Vander Schaaf, E. R., Thompson, R. F., & Weisz, D. J. (1986) · Behavioral Neuroscience · doi:10.1037/0735-7044.100.5.729 · Cited by 724 · cited 2×
“…involved in learning arbitrary relationships between stimuli (Cohen and Eichenbaum, 1993; Davachi, 2006; Turk-Browne et al., 2009; Henke, 2010; Hsieh et al., 2014; Garvert et al., 2017), particularly over space and time (Solomon et al., 1986; Wallenstein et al., 1998; Staresina and Davachi, 2009).”
BackgroundNeural repetition suppression reflects fulfilled perceptual expectations
Summerfield, C., Trittschuh, E. H., Monti, J. M., Mesulam, M.-M., & Egner, T. (2008) · Nature Neuroscience · doi:10.1038/nn.2163 · Cited by 692 · cited 1×
“Neural activity in sensory cortex can be strongly modulated by prior expectations (Summerfield et al., 2008; den Ouden et al., 2009; Alink et al., 2010; Meyer and Olson, 2011; Todorovic et al., 2011; Wacongne et al., 2011; Kok et al., 2012, 2013; Bell et al., 2016; Kaposvari et al., 2016).”
BackgroundEvidence for a hierarchy of predictions and prediction errors in human cortex
Wacongne, C., Labyt, E., van Wassenhove, V., Bekinschtein, T., Naccache, L., & Dehaene, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117807108 · Cited by 560 · cited 1×
“Neural activity in sensory cortex can be strongly modulated by prior expectations (Summerfield et al., 2008; den Ouden et al., 2009; Alink et al., 2010; Meyer and Olson, 2011; Todorovic et al., 2011; Wacongne et al., 2011; Kok et al., 2012, 2013; Bell et al., 2016; Kaposvari et al., 2016).”
BackgroundMemory deficits for implicit contextual information in amnesic subjects with hippocampal damage
Chun, M. M., & Phelps, E. A. (1999) · Nature Neuroscience · doi:10.1038/12222 · Cited by 554 · cited 3×
“This function has been mostly considered in the context of recall from episodic memory but is also ideally suited for retrieving predictions based on contextual cues (McClelland et al., 1995; Chun and Phelps, 1999; Eichenbaum and Fortin, 2009; Schapiro et al., 2012; Davachi and DuBrow, 2015; Hindy et al., 2016).”
BackgroundShared representations for working memory and mental imagery in early visual cortex
Albers, A. M., Kok, P., Toni, I., Dijkerman, H. C., & de Lange, F. P. (2013) · Current Biology · doi:10.1016/j.cub.2013.05.065 · Cited by 528
Self-citationTurk-Browne, N. B., Scholl, B. J., Chun, M. M., & Johnson, M. K. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21131 · Cited by 523
Self-citationHow prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512 · cited 2×
“…including related to object recognition and semantic labels in medial prefrontal cortex (Bar et al., 2006) and to value and reinforcement learning in the ventral striatum (den Ouden et al., 2012), as well as many other areas of polymodal association cortex that receive the required sensory inputs.”
BackgroundSelf-citationStimulus Predictability Reduces Responses in Primary Visual Cortex
Alink, A., Schwiedrzik, C. M., Kohler, A., Singer, W., & Muckli, L. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3730-10.2010 · Cited by 435
Shaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities
Schapiro, A. C., Kustner, L. V., & Turk-Browne, N. B. (2012) · Current Biology · doi:10.1016/j.cub.2012.06.056 · Cited by 430 · cited 3×
“This function has been mostly considered in the context of recall from episodic memory but is also ideally suited for retrieving predictions based on contextual cues (McClelland et al., 1995; Chun and Phelps, 1999; Eichenbaum and Fortin, 2009; Schapiro et al., 2012; Davachi and DuBrow, 2015; Hindy et al., 2016).”
BackgroundMethodSelf-citationDynamics of subjective contour formation in the early visual cortex
Lee, T. S., & Nguyen, M. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.4.1907 · Cited by 428
Contextual Feedback to Superficial Layers of V1
Muckli, L., De Martino, F., Vizioli, L., Petro, L. S., Smith, F. W., Ugurbil, K., Goebel, R., & Yacoub, E. (2015) · Current Biology · doi:10.1016/j.cub.2015.08.057 · Cited by 423 · cited 2×
“Additionally, do these different processes affect visual cortex the same way, or do different processes modulate different layers of visual cortex, in support of different computational goals (Friston, 2005; Muckli et al., 2015; Kok et al., 2016a)?”
BackgroundMethodSelective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback
Kok, P., Bains, L. J., van Mourik, T., Norris, D. G., & de Lange, F. P. (2016) · Current Biology · doi:10.1016/j.cub.2015.12.038 · Cited by 397
Self-citationPrior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study
Todorovic, A., van Ede, F., Maris, E., & de Lange, F. P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1425-11.2011 · Cited by 391 · cited 1×
“Neural activity in sensory cortex can be strongly modulated by prior expectations (Summerfield et al., 2008; den Ouden et al., 2009; Alink et al., 2010; Meyer and Olson, 2011; Todorovic et al., 2011; Wacongne et al., 2011; Kok et al., 2012, 2013; Bell et al., 2016; Kaposvari et al., 2016).”
BackgroundA cortical-hippocampal-cortical loop of information processing during memory consolidation
Rothschild, G., Eban, E., & Frank, L. M. (2017) · Nature Neuroscience · doi:10.1038/nn.4457 · Cited by 387
A map of abstract relational knowledge in the human hippocampal-entorhinal cortex
Garvert, M. M., Dolan, R. J., & Behrens, T. E. (2017) · eLife · doi:10.7554/elife.17086 · Cited by 379
The Human Hippocampus: Functional Anatomy, Vascularization and Serial Sections with MRI
Duvernoy, H. M. (2005) · doi:10.1007/b138576 · Cited by 350
Prior expectations induce prestimulus sensory templates
Kok, P., Mostert, P., & de Lange, F. P. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705652114 · Cited by 340
Self-citationExperience-dependent spatial expectations in mouse visual cortex
Fiser, A., Mahringer, D., Oyibo, H. K., Petersen, A. V., Leinweber, M., & Keller, G. B. (2016) · Nature Neuroscience · doi:10.1038/nn.4385 · Cited by 332
How the hippocampus preserves order: the role of prediction and context
Davachi, L., & DuBrow, S. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.004 · Cited by 328 · cited 2×
“This function has been mostly considered in the context of recall from episodic memory but is also ideally suited for retrieving predictions based on contextual cues (McClelland et al., 1995; Chun and Phelps, 1999; Eichenbaum and Fortin, 2009; Schapiro et al., 2012; Davachi and DuBrow, 2015; Hindy et al., 2016).”
BackgroundStatistical learning of visual transitions in monkey inferotemporal cortex
Meyer, T., & Olson, C. R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1112895108 · Cited by 325 · cited 1×
“Neural activity in sensory cortex can be strongly modulated by prior expectations (Summerfield et al., 2008; den Ouden et al., 2009; Alink et al., 2010; Meyer and Olson, 2011; Todorovic et al., 2011; Wacongne et al., 2011; Kok et al., 2012, 2013; Bell et al., 2016; Kaposvari et al., 2016).”
BackgroundTop-down activation of shape-specific population codes in visual cortex during mental imagery
Stokes, M., Thompson, R., Cusack, R., & Duncan, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4657-08.2009 · Cited by 323 · cited 1×
“Such cortical reinstatement has been shown for other cognitive processes as well, such as visual short-term memory (Harrison and Tong, 2009), mental imagery (Stokes et al., 2009; Albers et al., 2013), and preparatory attention (Peelen and Kastner, 2011; Myers et al., 2015).”
BackgroundA Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306 · cited 3×
“Finally, putamen and caudate ROIs were obtained from FreeSurfer’s subcortical segmentation, since these regions have been implicated in associative learning and prediction (Poldrack et al., 2001; den Ouden et al., 2009; Turk-Browne et al., 2009; Shohamy and Turk-Browne, 2013).”
BackgroundMethodStriatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304 · cited 1×
“For instance, it has been proposed that the striatum serves as a gating mechanism, upregulating connectivity between top-down attention systems and sensory cortex when prediction errors occur (Zink et al., 2006; den Ouden et al., 2010), rather than containing actual stimulus representations itself.”
BackgroundPrior Expectations Evoke Stimulus Templates in the Primary Visual Cortex
Kok, P., Failing, M. F., & de Lange, F. P. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00562 · Cited by 293
Self-citationMind the Gap: Binding Experiences across Space and Time in the Human Hippocampus
Staresina, B. P., & Davachi, L. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.024 · Cited by 273 · cited 1×
“…involved in learning arbitrary relationships between stimuli (Cohen and Eichenbaum, 1993; Davachi, 2006; Turk-Browne et al., 2009; Henke, 2010; Hsieh et al., 2014; Garvert et al., 2017), particularly over space and time (Solomon et al., 1986; Wallenstein et al., 1998; Staresina and Davachi, 2009).”
BackgroundPrior expectations bias sensory representations in visual cortex
Kok, P., Brouwer, G. J., van Gerven, M. A. J., & de Lange, F. P. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.0742-13.2013 · Cited by 260
Self-citationLinking pattern completion in the hippocampus to predictive coding in visual cortex
Hindy, N. C., Ng, F. Y., & Turk-Browne, N. B. (2016) · Nature Neuroscience · doi:10.1038/nn.4284 · Cited by 246
Self-citationPredictive coding as a model of response properties in cortical area V1
Spratling, M. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4911-09.2010 · Cited by 206
Mechanisms for widespread hippocampal involvement in cognition.
Shohamy, D., & Turk-Browne, N. B. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034461 · Cited by 187
Self-citationSutherland, R. J., McDonald, R. J., Hill, C. R., & Rudy, J. W. (1989) · Behavioral and Neural Biology · doi:10.1016/s0163-1047(89)90457-3 · Cited by 175
Imaging the Human Medial Temporal Lobe with High-Resolution fMRI
Carr, V. A., Rissman, J., & Wagner, A. D. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.022 · Cited by 174
Gordon, A. M., Rissman, J., Kiani, R., & Wagner, A. D. (2014) · Cerebral Cortex · doi:10.1093/cercor/bht194 · Cited by 173
Shape Perception Simultaneously Up- and Downregulates Neural Activity in the Primary Visual Cortex
Kok, P., & de Lange, F. P. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.042 · Cited by 163
Self-citationPhantom perception: voluntary and involuntary nonretinal vision
Pearson, J., & Westbrook, F. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.004 · Cited by 161 · cited 1×
“One intriguing possibility is that these different cognitive processes are subserved by the same neural mechanism (Pearson and Westbrook, 2015).”
BackgroundReinstatement of associative memories in early visual cortex is signaled by the hippocampus
Bosch, S. E., Jehee, J. F. M., Fernández, G., & Doeller, C. F. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0805-14.2014 · Cited by 157 · cited 1×
“Specifically, is cortical reinstatement in working memory, imagery, and attention mediated by the hippocampus, as it seems to be in associative memory (Bosch et al., 2014; Gordon et al., 2014) and the crossmodal predictions studied here?”
BackgroundEncoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Bell, A. H., Summerfield, C., Morin, E. L., Malecek, N. J., & Ungerleider, L. G. (2016) · Current Biology · doi:10.1016/j.cub.2016.07.007 · Cited by 118 · cited 1×
“Neural activity in sensory cortex can be strongly modulated by prior expectations (Summerfield et al., 2008; den Ouden et al., 2009; Alink et al., 2010; Meyer and Olson, 2011; Todorovic et al., 2011; Wacongne et al., 2011; Kok et al., 2012, 2013; Bell et al., 2016; Kaposvari et al., 2016).”
BackgroundStatistical Learning Signals in Macaque Inferior Temporal Cortex
Kaposvari, P., Kumar, S., & Vogels, R. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhw374 · Cited by 91 · cited 1×
“Neural activity in sensory cortex can be strongly modulated by prior expectations (Summerfield et al., 2008; den Ouden et al., 2009; Alink et al., 2010; Meyer and Olson, 2011; Todorovic et al., 2011; Wacongne et al., 2011; Kok et al., 2012, 2013; Bell et al., 2016; Kaposvari et al., 2016).”
BackgroundLearning of anticipatory responses in single neurons of the human medial temporal lobe
Reddy, L., Poncet, M., Self, M. W., Peters, J. C., Douw, L., van Dellen, E., Claus, S., Reijneveld, J. C., Baayen, J. C., & Roelfsema, P. R. (2015) · Nature Communications · doi:10.1038/ncomms9556 · Cited by 54
Cited by
Prediction and memory: A predictive coding account
Barron, H. C., Auksztulewicz, R., & Friston, K. (2020) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101821 · Cited by 220
Forgetting as a form of adaptive engram cell plasticity
Ryan, T. J., & Frankland, P. W. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-021-00548-3 · Cited by 182
Pennartz, C. M. A., Oude Lohuis, M. N., & Olcese, U. (2023) · Philosophical Transactions of the Royal Society B · doi:10.1098/rstb.2022.0336 · Cited by 38
Fitting predictive coding to the neurophysiological data
Spratling, M. W. (2019) · Brain Research · doi:10.1016/j.brainres.2019.146313 · Cited by 23
Metadata
- Authors
- Kok, P., & Turk-Browne, N. B.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2018-07-09
- Volume
- 38
- Issue
- 31
- Pages
- 6888-6899
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2826006208
- Cited by
- 115
- References
- 57
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.