Decoding Natural Sounds in Early “Visual” Cortex of Congenitally Blind Individuals
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Complex natural sounds, such as bird singing, people talking, or traffic noise, induce decodable fMRI activation patterns in early visual cortex of sighted blindfolded participants [1]. That is, early visual cortex receives non-visual and potentially predictive information from audition. However, it is unclear whether the transfer of auditory information to early visual areas is an epiphenomenon of visual imagery or, alternatively, whether it is driven by mechanisms independent from visual experience. Here, we show that we can decode natural sounds from activity patterns in early "visual" areas of congenitally blind individuals who lack visual imagery. Thus, visual imagery is not a prerequisite of auditory feedback to early visual cortex. Furthermore, the spatial pattern of sound decoding accuracy in early visual cortex was remarkably similar in blind and sighted individuals, with an increasing decoding accuracy gradient from foveal to peripheral regions. This suggests that the typical organization by eccentricity of early visual cortex develops for auditory feedback, even in the lifelong absence of vision. The same feedback to early visual cortex might support visual perception in the sighted [1] and drive the recruitment of this area for non-visual functions in blind individuals [2, 3].
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
Activation of the primary visual cortex by Braille reading in blind subjects
Sadato, N., Pascual-Leone, A., Grafman, J., Ibañez, V., Deiber, M.-P., Dold, G., & Hallett, M. (1996) · Nature · doi:10.1038/380526a0 · Cited by 1,253
Visual field maps in human cortex.
Wandell, B. A., Dumoulin, S. O., & Brewer, A. A. (2007) · Neuron · doi:10.1016/j.neuron.2007.10.012 · Cited by 1,231
Functional relevance of cross-modal plasticity in blind humans
Cohen, L. G., Celnik, P., Pascual-Leone, A., Corwell, B., Faiz, L., Dambrosia, J., Honda, M., Sadato, N., Gerloff, C., Catala´, M. D., et al. (1997) · Nature · doi:10.1038/38278 · Cited by 911
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 1×
“A testable hypothesis is that this kind of recruitment could bemost pronounced in peripheral parts of early visual cortex of blind individuals, as peripheral areas are primary receivers of auditory and, potentially, high-level information [15, 16].”
Predictive Processing: A Canonical Cortical Computation
Keller, G. B., & Mrsic-Flogel, T. D. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.003 · Cited by 836 · cited 1×
“In the sighted, auditory feedback to early visual cortexmight be relevant for visual perception, in line with predictive coding theories [21].”
Decoding Neural Representational Spaces Using Multivariate Pattern Analysis
Haxby, J. V., Connolly, A. C., & Guntupalli, J. S. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170325 · Cited by 717 · cited 1×
“Using multi-variate pattern analysis (MVPA), we decoded the three different sounds from fMRI activity patterns in the corresponding early ‘‘visual’’ areas of blind individuals [1, 4, 5] (STAR Methods).”
Multisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564
Stelzer, J., Chen, Y., & Turner, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.063 · Cited by 372
Decoding sound and imagery content in early visual cortex
Vetter, P., Smith, F. W., & Muckli, L. (2014) · Current Biology · doi:10.1016/j.cub.2014.04.020 · Cited by 323
Self-citationNonstimulated early visual areas carry information about surrounding context
Smith, F. W., & Muckli, L. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000233107 · Cited by 238 · cited 1×
“Using multi-variate pattern analysis (MVPA), we decoded the three different sounds from fMRI activity patterns in the corresponding early ‘‘visual’’ areas of blind individuals [1, 4, 5] (STAR Methods).”
Self-citationThe Retinotopic Organization of Striate Cortex Is Well Predicted by Surface Topology
Benson, N. C., Butt, O. H., Datta, R., Radoeva, P. D., Brainard, D. H., & Aguirre, G. K. (2012) · Current Biology · doi:10.1016/j.cub.2012.09.014 · Cited by 227
Functional connectivity of visual cortex in the blind follows retinotopic organization principles
Striem-Amit, E., Ovadia-Caro, S., Caramazza, A., Margulies, D. S., Villringer, A., & Amedi, A. (2015) · Brain · doi:10.1093/brain/awv083 · Cited by 194 · cited 1×
“Our finding complements previous results demonstrating retinotopic-like organization of functional connectivity of early visual cortex in blind individuals, highly similar to the ones observed in the sighted [14].”
ResultSelf-citationAttention but not awareness modulates the BOLD signal in the human V1 during binocular suppression
Watanabe, M., Cheng, K., Murayama, Y., Ueno, K., Asamizuya, T., Tanaka, K., & Logothetis, N. (2011) · Science · doi:10.1126/science.1203161 · Cited by 187
Eckert, M. A., Kamdar, N. V., Chang, C. E., Beckmann, C. F., Greicius, M. D., & Menon, V. (2008) · Human Brain Mapping · doi:10.1002/hbm.20560 · Cited by 138
Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex
Beer, A. L., Plank, T., & Greenlee, M. W. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2715-y · Cited by 124
Wang, X., Peelen, M. V., Han, Z., He, C., Caramazza, A., & Bi, Y. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3914-14.2015 · Cited by 68
Cited by
Cellular psychology: relating cognition to context-sensitive pyramidal cells
Phillips, W. A., Bachmann, T., Spratling, M. W., Muckli, L., Petro, L. S., & Zolnik, T. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.09.002 · Cited by 18
“For example, when subjects are blindfolded, sound processing provides contextual input to visual cortex [99,100].”
Self-citationThe Cooperative Neuron: Cellular Foundations of Mental Life
Phillips, W. A. (2023) · doi:10.1093/oso/9780198876984.001.0001 · Cited by 13
Imageless imagery in aphantasia: decoding non-sensory imagery in aphantasia
Meng, M., Chang, S., Zhang, X., & Pearson, J. (2023) · doi:10.21203/rs.3.rs-3162223/v1 · Cited by 8
Metadata
- Authors
- Vetter, P., Bola, Ł., Reich, L., Bennett, M., Muckli, L., & Amedi, A.
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 2020-08
- Volume
- 30
- Issue
- 15
- Pages
- 3039-3044.e2
- ISSN
- 0960-9822 (ISSN-L)
- OpenAlex
- W3036382403
- Cited by
- 126
- References
- 18
- FWCI
- 11.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.