Contextual modulation of primary visual cortex by auditory signals
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Early visual cortex receives non-feedforward input from lateral and top-down connections (Muckli & Petro 2013 Curr. Opin. Neurobiol. 23 , 195–201. ( doi:10.1016/j.conb.2013.01.020 )), including long-range projections from auditory areas. Early visual cortex can code for high-level auditory information, with neural patterns representing natural sound stimulation (Vetter et al. 2014 Curr. Biol. 24 , 1256–1262. ( doi:10.1016/j.cub.2014.04.020 )). We discuss a number of questions arising from these findings. What is the adaptive function of bimodal representations in visual cortex? What type of information projects from auditory to visual cortex? What are the anatomical constraints of auditory information in V1, for example, periphery versus fovea, superficial versus deep cortical layers? Is there a putative neural mechanism we can infer from human neuroimaging data and recent theoretical accounts of cortex? We also present data showing we can read out high-level auditory information from the activation patterns of early visual cortex even when visual cortex receives simple visual stimulation, suggesting independent channels for visual and auditory signals in V1. We speculate which cellular mechanisms allow V1 to be contextually modulated by auditory input to facilitate perception, cognition and behaviour. Beyond cortical feedback that facilitates perception, we argue that there is also feedback serving counterfactual processing during imagery, dreaming and mind wandering, which is not relevant for immediate perception but for behaviour and cognition over a longer time frame. This article is part of the themed issue ‘Auditory and visual scene analysis’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Hohwy, J. (2013) · doi:10.1093/acprof:oso/9780199682737.001.0001 · Cited by 1,914
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · cited 1×
“Early electrophysiological recordings in primary visual cortex showed that in the presence of simple visual stimuli, neurons function as spatio-temporal filters that extract elementary visual features, upon which progressively higher visual areas perform increasingly complex recognition operations [5].”
BackgroundKastner, S., Pinsk, M. A., De Weerd, P., Desimone, R., & Ungerleider, L. G. (1999) · Neuron · doi:10.1016/s0896-6273(00)80734-5 · Cited by 1,622
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
Attention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
Shams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262
Top-down influences on visual processing
Gilbert, C. D., & Li, W. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3476 · Cited by 1,224
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
A new cellular mechanism for coupling inputs arriving at different cortical layers
Larkum, M. E., Zhu, J. J., & Sakmann, B. (1999) · Nature · doi:10.1038/18686 · Cited by 1,180
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892
A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex
Larkum, M. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2012.11.006 · Cited by 755 · cited 4×
“It is possible that feedforward and feedback inputs arrive at individual cortical neurons [4], which can be studied in isolation using appropriate paradigms (such as visual occlusion) that mask feedforward input.”
BackgroundInfluentialMultisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564
Talsma, D., Doty, T. J., & Woldorff, M. G. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhk016 · Cited by 434
Contextual Feedback to Superficial Layers of V1
Muckli, L., De Martino, F., Vizioli, L., Petro, L. S., Smith, F. W., Ugurbil, K., Goebel, R., & Yacoub, E. (2015) · Current Biology · doi:10.1016/j.cub.2015.08.057 · Cited by 423
Self-citationTowards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404
A Top-Down Cortical Circuit for Accurate Sensory Perception
Manita, S., Suzuki, T., Homma, C., Matsumoto, T., Odagawa, M., Yamada, K., Ota, K., Matsubara, C., Inutsuka, A., Sato, M., et al. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.006 · Cited by 365
Decoding sound and imagery content in early visual cortex
Vetter, P., Smith, F. W., & Muckli, L. (2014) · Current Biology · doi:10.1016/j.cub.2014.04.020 · Cited by 323
Self-citationNonstimulated early visual areas carry information about surrounding context
Smith, F. W., & Muckli, L. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000233107 · Cited by 238
Self-citationPrimary visual cortex activity along the apparent-motion trace reflects illusory perception
Muckli, L., Kohler, A., Kriegeskorte, N., & Singer, W. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030265 · Cited by 225
Self-citationThe multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219
Shape Perception Simultaneously Up- and Downregulates Neural Activity in the Primary Visual Cortex
Kok, P., & de Lange, F. P. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.042 · Cited by 163
Wang, Y., Celebrini, S., Trotter, Y., & Barone, P. (2008) · BMC Neuroscience · doi:10.1186/1471-2202-9-79 · Cited by 144
Eckert, M. A., Kamdar, N. V., Chang, C. E., Beckmann, C. F., Greicius, M. D., & Menon, V. (2008) · Human Brain Mapping · doi:10.1002/hbm.20560 · Cited by 138
Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex
Beer, A. L., Plank, T., & Greenlee, M. W. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2715-y · Cited by 124
Interregional alpha-band synchrony supports temporal cross-modal integration
van Driel, J., Knapen, T., van Es, D. M., & Cohen, M. X. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.022 · Cited by 66
Beer, A. L., Plank, T., Meyer, G., & Greenlee, M. W. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00005 · Cited by 53
Hertz, U., & Amedi, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.186 · Cited by 43
Naumer, M. J., van den Bosch, J. J. F., Wibral, M., Kohler, A., Singer, W., Kaiser, J., van de Ven, V., & Muckli, L. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2669-0 · Cited by 11
Self-citation
Cited by
Laminar fMRI: applications for cognitive neuroscience
Lawrence, S. J. D., Formisano, E., Muckli, L., & de Lange, F. P. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.004 · Cited by 186
Self-citationPhillips, W. A., Bachmann, T., & Storm, J. F. (2018) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00050 · Cited by 62
A roadmap for the study of conscious audition and its neural basis
Dykstra, A. R., Cariani, P. A., & Gutschalk, A. (2017) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0103 · Cited by 61
Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Franzen, L., Delis, I., De Sousa, G., Kayser, C., & Philiastides, M. G. (2020) · Nature Communications · doi:10.1038/s41467-020-19306-7 · Cited by 57
Imageless imagery in aphantasia: decoding non-sensory imagery in aphantasia
Meng, M., Chang, S., Zhang, X., & Pearson, J. (2023) · doi:10.21203/rs.3.rs-3162223/v1 · Cited by 8
Metadata
- Authors
- Petro, L. S., Paton, A. T., & Muckli, L.
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2017-02-19
- Volume
- 372
- Issue
- 1714
- Pages
- 20160104
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2567365536
- Cited by
- 101
- References
- 32
- FWCI
- 11.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.