Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing
Open accessAbstract
Functional magnetic resonance imaging (MRI) showed that the superior temporal and occipital cortex are involved in multisensory integration. Probabilistic fiber tracking based on diffusion-weighted MRI suggests that multisensory processing is supported by white matter connections between auditory cortex and the temporal and occipital lobe. Here, we present a combined functional MRI and probabilistic fiber tracking study that reveals multisensory processing mechanisms that remained undetected by either technique alone. Ten healthy participants passively observed visually presented lip or body movements, heard speech or body action sounds, or were exposed to a combination of both. Bimodal stimulation engaged a temporal-occipital brain network including the multisensory superior temporal sulcus (msSTS), the lateral superior temporal gyrus (lSTG), and the extrastriate body area (EBA). A region-of-interest (ROI) analysis showed multisensory interactions (e.g., subadditive responses to bimodal compared to unimodal stimuli) in the msSTS, the lSTG, and the EBA region. Moreover, sounds elicited responses in the medial occipital cortex. Probabilistic tracking revealed white matter tracts between the auditory cortex and the medial occipital cortex, the inferior occipital cortex (IOC), and the superior temporal sulcus (STS). However, STS terminations of auditory cortex tracts showed limited overlap with the msSTS region. Instead, msSTS was connected to primary sensory regions via intermediate nodes in the temporal and occipital cortex. Similarly, the lSTG and EBA regions showed limited direct white matter connections but instead were connected via intermediate nodes. Our results suggest that multisensory processing in the STS is mediated by separate brain areas that form a distinct network in the lateral temporal and inferior occipital cortex.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is evidence for multisensory integration on the subcortical level and for direct anatomical connections between early auditory and early visual areas, mostly reaching peripheral regions.
“Apart from the route via multisensory areas, there is evidence for multisensory integration on the subcortical level [27] and for direct anatomical connections between early auditory and early visual areas [12, 28, 29], mostly reaching peripheral regions [12–14], consistent with both our eccentricity and searchlight results.”
From Decoding sound and imagery content in early visual cortex (2014) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630 · see citing works
Desikan, R. S., Ségonne, F., Fischl, B., Quinn, B. T., Dickerson, B. C., Blacker, D., Buckner, R. L., Dale, A. M., Maguire, R. P., Hyman, B. T., et al. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.021 · Cited by 13,324 · see citing works
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910 · see citing works
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., et al. (2002) · Neuron · doi:10.1016/s0896-6273(02)00569-x · Cited by 8,610 · see citing works
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · see citing works
Cortical Surface-Based Analysis
Fischl, B., Sereno, M. I., & Dale, A. M. (1999) · NeuroImage · doi:10.1006/nimg.1998.0396 · Cited by 6,147 · see citing works
A nonparametric method for automatic correction of intensity nonuniformity in MRI data
Sled, J. G., Zijdenbos, A. P., & Evans, A. C. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.668698 · Cited by 4,731 · see citing works
Automatically Parcellating the Human Cerebral Cortex
Fischl, B. R. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg087 · Cited by 4,208 · see citing works
Estimation of the Effective Self-Diffusion Tensor from the NMR Spin Echo
Basser, P. J., Mattiello, J., & Bihan, D. L. (1994) · Journal of Magnetic Resonance Series B · doi:10.1006/jmrb.1994.1037 · Cited by 3,656 · see citing works
Three-dimensional tracking of axonal projections in the brain by magnetic resonance imaging
Mori, S., Crain, B. J., Chacko, V. P., & van Zijl, P. C. M. (1999) · Annals of Neurology · doi:10.1002/1531-8249(199902)45:2 · Cited by 3,479 · see citing works
Probabilistic diffusion tractography with multiple fibre orientations: What can we gain?
Behrens, T. E. J., Berg, H. J., Jbabdi, S., Rushworth, M. F. S., & Woolrich, M. W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.018 · Cited by 3,471 · see citing works
Searching for a baseline: Functional imaging and the resting human brain
Gusnard, D. A., & Raichle, M. E. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094500 · Cited by 3,371 · see citing works
Characterization and propagation of uncertainty in diffusion-weighted MR imaging
Behrens, T. E. J., Woolrich, M. W., Jenkinson, M., Johansen‐Berg, H., Nunes, R. G., Clare, S., Matthews, P. M., Brady, J. M., & Smith, S. M. (2003) · Magnetic Resonance in Medicine · doi:10.1002/mrm.10609 · Cited by 3,038 · see citing works
Bayesian analysis of neuroimaging data in FSL
Woolrich, M., Jbabdi, S., Patenaude, B., Chappell, M., Makni, S., Behrens, T. E. J., Beckmann, C., Jenkinson, M., & Smith, S. M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.055 · Cited by 2,774 · see citing works
A hybrid approach to the skull stripping problem in MRI
Ségonne, F., Dale, A. M., Busa, E., Glessner, M., Salat, D. H., Hahn, H., & Fischl, B. R. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.032 · Cited by 2,227 · see citing works
Sequence-independent segmentation of magnetic resonance images
Fischl, B. R., Salat, D. H., van der Kouwe, A. J. W., Makris, N., Ségonne, F., Quinn, B. T., & Dale, A. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.016 · Cited by 2,117 · see citing works
Tracking neuronal fiber pathways in the living human brain
Conturo, T. E., Lori, N. F., Cull, T. S., Akbudak, E., Snyder, A. Z., Shimony, J. S., McKinstry, R. C., Burton, H., & Raichle, M. E. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.18.10422 · Cited by 1,774 · see citing works
Fischl, B. R., Liu, A., & Dale, A. M. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906426 · Cited by 1,755 · see citing works
Reproducibility of quantitative tractography methods applied to cerebral white matter
Wakana, S., Caprihan, A., Panzenboeck, M. M., Fallon, J. H., Perry, M., Gollub, R. L., Hua, K., Zhang, J., Jiang, H., Dubey, P., et al. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.02.049 · Cited by 1,686 · see citing works
Multisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598 · see citing works
Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging
Tootell, R. B. H., Reppas, J. B., Kwong, K. K., Malach, R., Born, R. T., Brady, T., Rosen, B. R., & Belliveau, J. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-04-03215.1995 · Cited by 1,412 · see citing works
Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex
Romanski, L. M., Tian, B., Fritz, J. B., Mishkin, M., Goldman, P. S., & Rauschecker, J. P. (1999) · Nature Neuroscience · doi:10.1038/16056 · Cited by 1,136 · see citing works
Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops
Ségonne, F., Pacheco, J., & Fischl, B. R. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.887364 · Cited by 995 · see citing works
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954 · see citing works
SELECTIVE DISTURBANCE OF MOVEMENT VISION AFTER BILATERAL BRAIN DAMAGE
Zihl, J., CRAMON, D. V., & Mai, N. (1983) · Brain · doi:10.1093/brain/106.2.313 · Cited by 943 · see citing works
Occipito-temporal connections in the human brain.
Catani, M., Jones, D., Donato, R., & Ffytche, D. (2003) · Brain : a journal of neurology · doi:10.1093/brain/awg203 · Cited by 934 · see citing works
Damoiseaux, J. S., & Greicius, M. D. (2009) · Brain Structure and Function · doi:10.1007/s00429-009-0208-6 · Cited by 897 · see citing works
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 2× · see citing works
“Anatomical tracer studies reported direct axonal connections between auditory and early visual cortex in non-human primates (Falchier et al., 2002; Rockland and Ojima, 2003; Clavagnier et al., 2004; Bizley et al., 2007).”
BackgroundIntegration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B., & Martin, A. D. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 765 · see citing works
The neural basis of visual body perception
Peelen, M. V., & Downing, P. E. (2007) · Nature reviews. Neuroscience · doi:10.1038/nrn2195 · Cited by 686 · see citing works
DTI Tractography of the Human Brain's Language Pathways
Glasser, M. F., & Rilling, J. K. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn011 · Cited by 654 · see citing works
Multisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564 · see citing works
Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex
Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.0799-05.2005 · Cited by 531 · see citing works
Unraveling multisensory integration: patchy organization within human STS multisensory cortex
Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004) · Nature Neuroscience · doi:10.1038/nn1333 · Cited by 513 · see citing works
A Positron Emission Tomographic Study of Auditory Localization in the Congenitally Blind
Weeks, R., Horwitz, B., Aziz‐Sultan, M. A., Tian, B., Wessinger, C. M., Cohen, L. G., Hallett, M., & Rauschecker, J. P. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-07-02664.2000 · Cited by 486 · see citing works
Involuntary orienting to sound improves visual perception
McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000) · Nature · doi:10.1038/35038085 · Cited by 464 · see citing works
Gougoux, F., Zatorre, R. J., Lassonde, M. C., Voss, P., & Leporé, F. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030027 · Cited by 392 · see citing works
Multisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383 · see citing works
Speech processing activates visual cortex in congenitally blind humans
Röder, B., Stock, O., Bien, S., Neville, H. J., & Rösler, F. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.02147.x · Cited by 373 · see citing works
Does the brain have a baseline? Why we should be resisting a rest
Morcom, A. M., & Fletcher, P. C. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.013 · Cited by 369 · see citing works
Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex
Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I., & King, A. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl128 · Cited by 341 · see citing works
Seltzer, B., & Pandya, D. Ν. (1994) · The Journal of Comparative Neurology · doi:10.1002/cne.903430308 · Cited by 327 · see citing works
Barraclough, N. E., Xiao, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053279586 · Cited by 320 · see citing works
Perceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech
Miller, L. M., & D’Esposito, M. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.0896-05.2005 · Cited by 318 · see citing works
The case for feedforward multisensory convergence during early cortical processing
Foxe, J. J., & Schroeder, C. E. (2005) · Neuroreport · doi:10.1097/00001756-200504040-00001 · Cited by 311 · see citing works
Human Primary Auditory Cortex Follows the Shape of Heschl's Gyrus
Costa, S. D., van der Zwaag, W., Marques, J. P., Frackowiak, R. S. J., Clarke, S., & Sàenz, M. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2000-11.2011 · Cited by 294 · see citing works
Lee, S., Kim, D. I., Kim, J., Kim, D. J., Kim, H. D., Kim, D. S., & Mori, S. (2005) · Radiographics · doi:10.1148/rg.251045085 · Cited by 284 · see citing works
Audiovisual Integration of Letters in the Human Brain
Raij, T., Uutela, K., & Hari, R. (2000) · Neuron · doi:10.1016/s0896-6273(00)00138-0 · Cited by 282 · see citing works
Noesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H., & Driver, J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2252-07.2007 · Cited by 282 · see citing works
A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion
Nath, A. R., & Beauchamp, M. S. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.024 · Cited by 282 · see citing works
Clavagnier, S., Falchier, A., & Kennedy, H. (2004) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.4.2.117 · Cited by 249 · see citing works
Characterizing white matter with magnetization transfer andT2
Stanisz, G. J., Kecojević, A., Bronskill, M. J., & Henkelman, R. M. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199912)42:6 · Cited by 249 · see citing works
Binding crossmodal object features in perirhinal cortex
Taylor, K. I., Moss, H. E., Stamatakis, E. A., & TYLER, L. K. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0509704103 · Cited by 247 · see citing works
Behrens, T. E. J., & Sporns, O. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.08.005 · Cited by 245 · see citing works
Localization of sublexical speech perception components
Turkeltaub, P. E., & Coslett, H. B. (2010) · Brain and Language · doi:10.1016/j.bandl.2010.03.008 · Cited by 244 · see citing works
Imagerie de diffusion in-vivo par résonance magnétique nucléaire
Bihan, D. L., & Breton, E. (1985) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 232 · see citing works
Functional Imaging Reveals Numerous Fields in the Monkey Auditory Cortex
Petkov, C. I., Kayser, C., Augath, M. A., & Logothetis, N. K. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040215 · Cited by 231 · see citing works
New approaches for exploring anatomical and functional connectivity in the human brain
Ramnani, N., Behrens, T. E. J., Penny, W. D., & Matthews, P. M. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.02.004 · Cited by 229 · see citing works
Stein, B. E., Stanford, T. R., Ramachandran, R., Perrault, T. J., & Rowland, B. A. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1880-8 · Cited by 221 · see citing works
Touch, sound and vision in human superior temporal sulcus
Beauchamp, M. S., Yasar, N. E., Frye, R. E., & Ro, T. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.015 · Cited by 208 · see citing works
Hearing Lips and Seeing Voices
Boston, D. W. (1977) · British Journal of Audiology · doi:10.3109/03005367709078839 · Cited by 203 · see citing works
Jones, D. K., Williams, S. C. R., Gasston, D., Horsfield, M., Simmons, A., & Howard, R. (2002) · Human Brain Mapping · doi:10.1002/hbm.10018 · Cited by 203 · see citing works
Hein, G., Doehrmann, O., Müller, N. G., Kaiser, J., Muckli, L. F., & Naumer, M. J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1740-07.2007 · Cited by 203 · see citing works
Werner, S., & Noppeney, U. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5091-09.2010 · Cited by 197 · see citing works
Speeded responses to audiovisual signal changes result from bimodal integration
Schröger, E., & Widmann, A. (1998) · Psychophysiology · doi:10.1111/1469-8986.3560755 · Cited by 190 · see citing works
Laurienti, P. J., Perrault, T. J., Stanford, T. R., Wallace, M. T., & Stein, B. E. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2370-2 · Cited by 187 · see citing works
Werner, S., & Noppeney, U. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp248 · Cited by 168 · see citing works
Lewis, R., & Noppeney, U. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5745-09.2010 · Cited by 167 · see citing works
Romanski, L. M. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm099 · Cited by 165 · see citing works
Neural Substrates of Perceptual Enhancement by Cross-Modal Spatial Attention
McDonald, J. J., Teder-Sälejärvi, W. A., Russo, F. D., & Hillyard, S. A. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107783 · Cited by 157 · see citing works
Budinger, E., & Scheich, H. (2009) · Hearing Research · doi:10.1016/j.heares.2009.04.021 · Cited by 148 · see citing works
Auditory–Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources
Cappe, C., Thut, G., Romei, V., & Murray, M. M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1099-10.2010 · Cited by 146 · see citing works
Eckert, M. A., Kamdar, N. V., Chang, C. E., Beckmann, C. F., Greicius, M. D., & Menon, V. (2008) · Human Brain Mapping · doi:10.1002/hbm.20560 · Cited by 138 · see citing works
Poldrack, R. A., & Devlin, J. T. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.019 · Cited by 133 · see citing works
Raij, T., Ahveninen, J., Lin, F., Witzel, T., Jääskeläinen, I. P., Letham, B., Israeli, E. R., Sahyoun, C. P., Vasios, C. E., Stufflebeam, S. M., et al. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07213.x · Cited by 132 · see citing works
Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex
Beer, A. L., Plank, T., & Greenlee, M. W. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2715-y · Cited by 124 · see citing works
Neural Correlates of Coherent Audiovisual Motion Perception
Baumann, O., & Greenlee, M. W. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl055 · Cited by 117 · see citing works
The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing
Hocking, J., & Price, C. J. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn007 · Cited by 116 · see citing works
Probabilistic fibre tracking: Differentiation of connections from chance events
Morris, D. M., Embleton, K. V., & Parker, G. J. M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.012 · Cited by 113 · see citing works
Spatial Organization of Multisensory Responses in Temporal Association Cortex
Dahl, C. D., Logothetis, N. K., & Kayser, C. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.3437-09.2009 · Cited by 110 · see citing works
A hybrid approach to the skull stripping problem in MRI
Ségonne, F. (2004) · NeuroImage · doi:10.1016/s1053-8119(04)00188-0 · Cited by 102 · see citing works
Neural correlates of coherent audiovisual motion perception.
Baumann, O., & Greenlee, M. (2007) · Cerebral Cortex · doi:10.1167/5.8.648 · Cited by 100 · see citing works
Neural Correlates of Visually Induced Self-Motion Illusion in Depth
Kovács, G., Raabe, M., & Greenlee, M. W. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm203 · Cited by 98 · see citing works
Discrete neural substrates underlie complementary audiovisual speech integration processes
Stevenson, R. A., VanDerKlok, R. M., Pisoni, D. B., & James, T. W. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.12.063 · Cited by 97 · see citing works
Primary and multisensory cortical activity is correlated with audiovisual percepts
Benoit, M. M., Raij, T., Lin, F., Jääskeläinen, I. P., & Stufflebeam, S. M. (2009) · Human Brain Mapping · doi:10.1002/hbm.20884 · Cited by 88 · see citing works
Taylor, J. C., & Downing, P. E. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00091 · Cited by 83 · see citing works
A new method for detecting interactions between the senses in event-related potentials
Gondan, M., & Röder, B. (2006) · Brain Research · doi:10.1016/j.brainres.2005.12.050 · Cited by 69 · see citing works
van Atteveldt, N., Blau, V. C., Blomert, L., & Goebel, R. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-11 · Cited by 64 · see citing works
Coding of multisensory temporal patterns in human superior temporal sulcus
Noesselt, T., Bergmann, D., Heinze, H., Münte, T. F., & Spence, C. J. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00064 · Cited by 59 · see citing works
Functional Magnetic Resonance Adaptation in Visual Neuroscience
Weigelt, S., Muckli, L. F., & Kohler, A. (2008) · Reviews in the Neurosciences · doi:10.1515/revneuro.2008.19.4-5.363 · Cited by 53 · see citing works
Meyer, G. F., Greenlee, M. W., & Wuerger, S. M. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21593 · Cited by 52 · see citing works
Szameitat, A. J., Schubert, T., & Müller, H. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.069 · Cited by 48 · see citing works
3D surface perception from motion involves a temporal–parietal network
Beer, A., Watanabe, T., Ni, R., Sasaki, Y., & Andersen, G. J. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06857.x · Cited by 47 · see citing works
Physiological Mapping of Human Auditory Cortices with a Silent Event-Related fMRI Technique
Engelien, A. (2002) · NeuroImage · doi:10.1006/nimg.2002.1149 · Cited by 45 · see citing works
Source of nonlinearity of the BOLD response revealed by simultaneous fMRI and NIRS
Toyoda, H., Kashikura, K., Okada, T., Nakashita, S., Honda, M., Yonekura, Y., Kawaguchi, H., Maki, A., & Sadato, N. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.053 · Cited by 43 · see citing works
Neural Correlates of High-Level Adaptation-Related Aftereffects
Cziraki, C., Greenlee, M. W., & Kovács, G. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00582.2009 · Cited by 43 · see citing works
Premotor Cortex Is Sensitive to Auditory–Visual Congruence for Biological Motion
Wuerger, S. M., Parkes, L. M., Lewis, P. A., Crocker-Buque, A., Rutschmann, R. M., & Meyer, G. F. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00173 · Cited by 43 · see citing works
Clemo, H. R., Sharma, G. K., Allman, B. L., & Meredith, M. A. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1493-7 · Cited by 41 · see citing works
Fiber pathways and cortical connections of preoccipital areas in rhesus monkeys
Yeterian, E. H., & Pandya, D. Ν. (2010) · The Journal of Comparative Neurology · doi:10.1002/cne.22420 · Cited by 40 · see citing works
Phonological Processing in Human Auditory Cortical Fields
Woods, D. L., Herron, T. J., Cate, A. D., Kang, X., & Yund, E. W. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00042 · Cited by 39 · see citing works
Do you see what you are hearing? Cross-modal effects of speech sounds on lipreading
Baart, M., & Vroomen, J. (2010) · Neuroscience Letters · doi:10.1016/j.neulet.2010.01.019 · Cited by 29 · see citing works
Neural correlates of audio‐visual object recognition: Effects of implicit spatial congruency
Plank, T., Rosengarth, K., Song, W., Ellermeier, W., & Greenlee, M. W. (2011) · Human Brain Mapping · doi:10.1002/hbm.21254 · Cited by 28 · see citing works
Beer, A. L., & Watanabe, T. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1769-6 · Cited by 25 · see citing works
Multisensory perceptual learning reshapes both fast and slow mechanisms of crossmodal processing
Beer, A., Batson, M. A., & Watanabe, T. (2010) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-010-0006-x · Cited by 17 · see citing works
Proctor, B. J., & Meyer, G. F. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2724-x · Cited by 5 · see citing works
Jones (1999) · doi:10.1002/(sici)1522-2594(199907)42:1
High-resolution intersubject averaging and a coordinate system for the cortical surface
Fischl, B., Sereno, M. I., Tootell, R. B. H., & Dale, A. M. (1999) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1999)8:4
Flagged first, then by citations
1 of the 109 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Convergence of spoken and written language processing in the superior temporal sulcus
Wilson, S. M., Bautista, A., & McCarron, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.068 · Cited by 399 · see citing works
Decoding sound and imagery content in early visual cortex
Vetter, P., Smith, F. W., & Muckli, L. (2014) · Current Biology · doi:10.1016/j.cub.2014.04.020 · Cited by 323 · see citing works
Multisensory Processes: A Balancing Act across the Lifespan
Murray, M. M., Lewkowicz, D. J., Amedi, A., & Wallace, M. T. (2016) · Trends in Neurosciences · doi:10.1016/j.tins.2016.05.003 · Cited by 242 · see citing works
The multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219 · see citing works
Cortical microstructural changes along the Alzheimer’s disease continuum
Montal, V., Vilaplana, E., Alcolea, D., Pegueroles, J., Pasternak, O., González‐Ortiz, S., Clarimón, J., Carmona‐Iragui, M., Illán‐Gala, I., Morenas‐Rodríguez, E., et al. (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2017.09.013 · Cited by 204 · see citing works
Contextual modulation of primary visual cortex by auditory signals
Petro, L. S., Paton, A., & Muckli, L. F. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0104 · Cited by 97 · see citing works
Is the extrastriate body area part of the dorsal visuomotor stream?
Zimmermann, M., Mars, R. B., de Lange, F. P., Toni, I., & Verhagen, L. (2017) · Brain Structure and Function · doi:10.1007/s00429-017-1469-0 · Cited by 88 · see citing works
Binder, M. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2015.05.011 · Cited by 80 · see citing works
A computational neuroethology perspective on body and expression perception
de Gelder, B., & Solanas, M. P. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.05.010 · Cited by 78 · see citing works
Cortical microstructural correlates of astrocytosis in autosomal-dominant Alzheimer disease
Vilaplana, E., Rodriguez-Vieitez, E., Ferreira, D., Montal, V., Almkvist, O., Wall, A., Lleó, A., Westman, E., Graff, C., Fortea, J., et al. (2020) · Neurology · doi:10.1212/wnl.0000000000009405 · Cited by 61 · see citing works
The Efficacy of Single-Trial Multisensory Memories
Thelen, A., & Murray, M. M. (2013) · Multisensory Research · doi:10.1163/22134808-00002426 · Cited by 51 · see citing works
Rodriguez‐Vieitez, E., Montal, V., Sepulcre, J., Lois, C., Hanseeuw, B. J., Vilaplana, E., Schultz, A. P., Properzi, M. J., Scott, M. R., Amariglio, R. E., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-021-01290-z · Cited by 47 · see citing works
White Matter Connectivity of the Visual–Vestibular Cortex Examined by Diffusion-Weighted Imaging
Wirth, A., Frank, S., Greenlee, M. W., & Beer, A. (2018) · Brain Connectivity · doi:10.1089/brain.2017.0544 · Cited by 40 · see citing works
Ramos-Prats, A., Paradiso, E., Castaldi, F., Sadeghi, M., Mir, M. Y., Hörtnagl, H., Göbel, G., & Ferraguti, F. (2022) · Cell Reports · doi:10.1016/j.celrep.2022.110893 · Cited by 37 · see citing works
Meta-analytic connectivity modeling of the human superior temporal sulcus
Erickson, L. C., Rauschecker, J. P., & Turkeltaub, P. E. (2016) · Brain Structure and Function · doi:10.1007/s00429-016-1215-z · Cited by 35 · see citing works
Worschech, F., ALTENMÜLLER, E. O., Jünemann, K., Sinke, C., Krüger, T. H. C., Scholz, D. S., Müller, C. A. H., Kliegel, M., James, C. E., & Marié, D. (2022) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14762 · Cited by 36 · see citing works
Neural patterns of word processing differ in children with dyslexia and isolated spelling deficit
Dębska, A., Banfi, C., Chyl, K., Dzięgiel‐Fivet, G., Dynak, A., Łuniewska, M., Plewko, J., Grabowska, A., Landerl, K., & Jednoróg, K. (2021) · Brain Structure and Function · doi:10.1007/s00429-021-02255-2 · Cited by 32 · see citing works
Relating Cognition to both Brain Structure and Function: A Systematic Review of Methods
Litwińczuk, M. C., Trujillo‐Barreto, N. J., Muhlert, N., Cloutman, L. L., & Woollams, A. M. (2022) · Brain Connectivity · doi:10.1089/brain.2022.0036 · Cited by 27 · see citing works
Interoceptive signals impact visual processing: Cardiac modulation of visual body perception
Ronchi, R., Bernasconi, F., Pfeiffer, C., Bello‐Ruiz, J., Kaliuzhna, M., & Blanke, O. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.06.064 · Cited by 24 · see citing works
Alterations of theta oscillation in executive control in temporal lobe epilepsy patients
Li, X., Hou, Y., Ren, Y., Tian, X., & Song, Y. (2018) · Epilepsy Research · doi:10.1016/j.eplepsyres.2017.12.017 · Cited by 23 · see citing works
Meyer, G. F., Harrison, N., & Wuerger, S. M. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.05.014 · Cited by 23 · see citing works
Passive reading and motor imagery about hand actions and tool-use actions: an fMRI study
Yang, J., & Shu, H. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3753-4 · Cited by 22 · see citing works
Meyer, G. F., Spray, A., Fairlie, J., & Uomini, N. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00552 · Cited by 22 · see citing works
Multisensory integration substantiates distributed and overlapping neural networks
Pasqualotto, A. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15001612 · Cited by 21 · see citing works
Multisensory perception and action: development, decision-making, and neural mechanisms
Shi, Z., & Müller, H. J. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00081 · Cited by 19 · see citing works
Frank, S., Pawellek, M., Forster, L., Langguth, B., Schecklmann, M., & Greenlee, M. W. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.1952-19.2019 · Cited by 19 · see citing works
Neuroplasticity and crossmodal connectivity in the normal, healthy brain.
Karim, A. K. M. R., Proulx, M. J., de Sousa, A. A., & Likova, L. T. (2021) · Psychology & Neuroscience · doi:10.1037/pne0000258 · Cited by 20 · see citing works
Benetti, S., Ferrari, A., & Pavani, F. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1108354 · Cited by 18 · see citing works
Aloufi, A., Rowe, F. J., & Meyer, G. F. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117673 · Cited by 15 · see citing works
Gu, J., Liu, B., Li, X., Wang, P., & Wang, B. (2019) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00135-2 · Cited by 13 · see citing works
Vestibular and visual brain areas in the medial cortex of the human brain
Beer, A., Becker, M., Frank, S., & Greenlee, M. W. (2023) · Journal of Neurophysiology · doi:10.1152/jn.00431.2022 · Cited by 13 · see citing works
Landsiedel, J., & Koldewyn, K. (2023) · Imaging Neuroscience · doi:10.1162/imag_a_00003 · Cited by 13 · see citing works
Xie, Y., Yang, Q. Z., Liu, C., Zhang, Q., Jiang, J., Han, Y., & Initiative, T. A. D. N. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2020.617173 · Cited by 13 · see citing works
Action-specific feature processing in the human cortex: An fMRI study
Monaco, S., Chen, Y., Menghi, N., & Crawford, J. D. (2023) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2023.108773 · Cited by 15 · see citing works
Webster, P. J., Skipper‐Kallal, L. M., Frum, C., Still, H. N., Ward, B. D., & Lewis, J. W. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00579 · Cited by 12 · see citing works
Smekal, V., Beckers, L. L. M., Solanas, M. P., & de Gelder, B. (2026) · Cerebral Cortex · doi:10.1093/cercor/bhag078 · Cited by 12 · see citing works
Regional and long-range neural synchronization abnormality during passive hyperthermia
Han, W., Qian, S., Jiang, Q., Liu, K., Li, B., & Sun, G. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.12.011 · Cited by 9 · see citing works
Brain correlates of emotional prosodic change detection in autism spectrum disorder
Charpentier, J., Latinus, M., Andersson, F., Saby, A., Cottier, J.-P., Bonnet-Brilhault, F., Houy-Durand, E., & Gomot, M. (2020) · NeuroImage: Clinical · doi:10.1016/j.nicl.2020.102512 · Cited by 9 · see citing works
Effects of scanner acoustic noise on intrinsic brain activity during auditory stimulation
Yakunina, N., Kang, E. K., Kim, T. S., Min, J.-H., Kim, S. S., & Nam, E. (2015) · Neuroradiology · doi:10.1007/s00234-015-1561-1 · Cited by 10 · see citing works
Neural processing of naturalistic audiovisual events in space and time
Hu, Y., & Mohsenzadeh, Y. (2025) · Communications Biology · doi:10.1038/s42003-024-07434-5 · Cited by 9 · see citing works
Laing, M., Rees, A., & Vuong, Q. C. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01440 · Cited by 8 · see citing works
Esteves, D., Valente, M., Bendor, S. E., Andrade, A., & Vourvopoulos, A. (2025) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2025.1572851 · Cited by 7 · see citing works
Alwashmi, K., Rowe, F. J., & Meyer, G. F. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120983 · Cited by 6 · see citing works
Yang, H., Zhang, Y.-J., Hu, H., Wang, L., Yan, Y.-J., Lui, S. S. Y., Wang, Y., & Chan, R. C. K. (2023) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-023-06050-2 · Cited by 6 · see citing works
The “Hidden Observer” as the Cognitive Unconscious During Hypnosis
Császár, N., Scholkmann, F., Kapócs, G., & Bókkon, I. (2016) · Activitas Nervosa Superior · doi:10.1007/bf03379735 · Cited by 5 · see citing works
Altered white matter structure in auditory tracts following early monocular enucleation
Wong, N. A., Rafique, S. A., Moro, S. S., Kelly, K. R., & Steeves, J. K. E. (2019) · NeuroImage Clinical · doi:10.1016/j.nicl.2019.102006 · Cited by 5 · see citing works
Resting-state functional connectivity changes following audio-tactile speech training
Cieśla, K., Wolak, T. P., & Amedi, A. (2025) · Frontiers in Neuroscience · doi:10.3389/fnins.2025.1482828 · Cited by 3 · see citing works
Structural connectivity changes in unilateral hearing loss
Tsai, P., Latypov, T. H., Hung, P. S.-P., Halawani, A., Srisaikaew, P., Walker, M. R., Zhang, A. B., Wang, W., Hassannia, F., Barake, R., et al. (2024) · Cerebral Cortex · doi:10.1093/cercor/bhae220 · Cited by 3 · see citing works
Onset timing of letter processing in auditory and visual sensory cortices
Raij, T., Lin, F., Letham, B., Lankinen, K., Nayak, T., Witzel, T., Hämäläinen, M., & Ahveninen, J. (2024) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2024.1427149 · Cited by 2 · see citing works
The neural representations underlying asymmetric cross‐modal prediction of words
Shi, L., Liu, C., Peng, X., Cao, Y., Levy, D. A., & Xue, G. (2023) · Human Brain Mapping · doi:10.1002/hbm.26219
Landsiedel, J., & Koldewyn, K. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.03.13.532398 · Cited by 2 · see citing works
Neuronal basis of audio-tactile speech perceptionPreprint
Cieśla, K., Wolak, T. P., & Amedi, A. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.16.608369 · Cited by 1 · see citing works
Alharshan, F., Aloufi, A., Rowe, F. J., & Meyer, G. F. (2025) · Neuroimage Reports · doi:10.1016/j.ynirp.2025.100316
- Authors
- Beer, A. L., Plank, T., Meyer, G., & Greenlee, M. W.
- Affiliations
- University of Regensburg (DE)
- University of Liverpool (GB)
- Corresponding author
- Beer, Anton L.
- Venue
- Frontiers in Integrative Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2013
- Volume
- 7
- Pages
- 5-5
- ISSN
- 1662-5145 (ISSN-L)
- PMC
- PMC3570774
- OpenAlex
- W2076405631
- Cited by
- 53
- References
- 109
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 4 · 2023: 7 · 2022: 3 · 2021: 5 · 2020: 3 · 2019: 3 · 2018: 2 · 2017: 7 · 2016: 4 · 2015: 4 · 2014: 2 · 2013: 4
- FWCI
- 6.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Frontiers in Integrative Neuroscience (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Regensburg Publication Server (University of Regensburg) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Regensburg Publication Server (University of Regensburg)
- Funders
- Deutsche Forschungsgemeinschaft (FOR1075)
- Elitenetzwerk Bayern
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- multisensory integration, superior temporal sulcus, extrastriate body area, white matter connectivity, auditory cortex, medial occipital cortex, inferior occipital cortex, human motion perception, speech perception, probabilistic tractography
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
