Decoding individual natural scene representations during perception and imagery
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
We used a multi-voxel classification analysis of functional magnetic resonance imaging (fMRI) data to determine to what extent item-specific information about complex natural scenes is represented in several category-selective areas of human extrastriate visual cortex during visual perception and visual mental imagery. Participants in the scanner either viewed or were instructed to visualize previously memorized natural scene exemplars, and the neuroimaging data were subsequently subjected to a multi-voxel pattern analysis (MVPA) using a support vector machine (SVM) classifier. We found that item-specific information was represented in multiple scene-selective areas: the occipital place area (OPA), parahippocampal place area (PPA), retrosplenial cortex (RSC), and a scene-selective portion of the precuneus/intraparietal sulcus region (PCu/IPS). Furthermore, item-specific information from perceived scenes was re-instantiated during mental imagery of the same scenes. These results support findings from previous decoding analyses for other types of visual information and/or brain areas during imagery or working memory, and extend them to the case of visual scenes (and scene-selective cortex). Taken together, such findings support models suggesting that reflective mental processes are subserved by the re-instantiation of perceptual information in high-level visual cortex. We also examined activity in the fusiform face area (FFA) and found that it, too, contained significant item-specific scene information during perception, but not during mental imagery. This suggests that although decodable scene-relevant activity occurs in FFA during perception, FFA activity may not be a necessary (or even relevant) component of one's mental representation of visual scenes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2023) · doi:10.1126/science · Cited by 6,063
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · cited 3×
“1 Department of Psychology, Yale University, New Haven, CT, USA 2 Interdepartmental Neuroscience Program, Yale University, New Haven, CT, USA Edited by: John J. Foxe, Albert Einstein College of Medicine, USA Reviewed by: Marius Peelen, University of Trento, Italy Matthew R. G. Brown, University of Alberta, Canada Aida…”
BackgroundKosslyn, S. M., Ganis, G., & Thompson, W. L. (2001) · Nature Reviews Neuroscience · doi:10.1038/35090055 · Cited by 1,894
Expertise for cars and birds recruits brain areas involved in face recognition
Gauthier, I., Skudlarski, P., Gore, J. C., & Anderson, A. W. (2000) · Nature Neuroscience · doi:10.1038/72140 · Cited by 1,418
Decoding reveals the contents of visual working memory in early visual areas
Harrison, S. A., & Tong, F. (2009) · Nature · doi:10.1038/nature07832 · Cited by 1,347
Face-specific processing in the human fusiform gyrus
McCarthy, G., Puce, A., Gore, J. C., & Allison, T. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.5.605 · Cited by 1,127
Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M.-A., Morito, Y., Tanabe, H. C., Sadato, N., & Kamitani, Y. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.004 · Cited by 543 · cited 2×
“Other studies have been able to construct reliable predictions of the visual stimulus being projected onto the retina based on activity in early visual cortex (Kay et al., 2008; Miyawaki et al., 2008).”
BackgroundResultYovel, G., & Kanwisher, N. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.018 · Cited by 450
Top-down activation of shape-specific population codes in visual cortex during mental imagery
Stokes, M., Thompson, R., Cusack, R., & Duncan, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4657-08.2009 · Cited by 323 · cited 2×
“…et al., 2012; Epstein and Morgan, 2012), as well as work that has uncovered item-specific information in other areas during visual mental imagery (Thirion et al., 2006; Harrison and Tong, 2009; Serences et al., 2009; Stokes et al., 2009; Reddy et al., 2010; Lee et al., 2012; Xing et al., 2013).”
BackgroundMethod
Cited by
Mental Imagery: Functional Mechanisms and Clinical Applications
Pearson, J., Naselaris, T., Holmes, E. A., & Kosslyn, S. M. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.08.003 · Cited by 1,087
“MVPC studies have also revealed similarity in activity patterns across visual perception and imagery in high-level visual areas [59,60,63].”
Generic decoding of seen and imagined objects using hierarchical visual features
Horikawa, T., & Kamitani, Y. (2017) · Nature Communications · doi:10.1038/ncomms15037 · Cited by 516
Shared Neural Mechanisms of Visual Perception and Imagery
Dijkstra, N., Bosch, S. E., & van Gerven, M. A. J. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.004 · Cited by 439
A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes
Naselaris, T., Olman, C. A., Stansbury, D. E., Ugurbil, K., & Gallant, J. L. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.10.018 · Cited by 356
Zadbood, A., Chen, J., Leong, Y. C., Norman, K. A., & Hasson, U. (2016) · doi:10.1101/081208 · Cited by 281
Zadbood, A., Chen, J., Leong, Y. C., Norman, K. A., & Hasson, U. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx202 · Cited by 281
Bainbridge, W. A., Pounder, Z., Eardley, A. F., & Baker, C. I. (2021) · Cortex · doi:10.1016/j.cortex.2020.11.014 · Cited by 195
Wing, E. A., Ritchey, M., & Cabeza, R. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00740 · Cited by 174
Robin, J., Rivest, J., Rosenbaum, R. S., & Moscovitch, M. (2019) · Cortex · doi:10.1016/j.cortex.2019.04.013 · Cited by 21
The brain as image processor and generator: towards function-restoring brain-computer-interfaces
van Hoof, R. (2022) · doi:10.26481/dis.20220603rh · Cited by 1
Metadata
- Authors
- Johnson, M. R., & Johnson, M. K.
- Venue
- Frontiers in Human Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2014
- Volume
- 8
- Pages
- 59-59
- ISSN
- 1662-5161 (ISSN-L)
- OpenAlex
- W2155369816
- Cited by
- 105
- References
- 13
- FWCI
- 5.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.