The DOI matches its Crossref record.
The Handbook of Multisensory Processes
Abstract
A reference work for the emerging field of multisensory integration, covering multidisciplinary research that goes beyond the traditional "sense-by-sense" approach and recognizes that perception is fundamentally a multisensory experience. This landmark reference work brings together for the first time in one volume the most recent research from different areas of the emerging field of multisensory integration. After many years of using a modality-specific "sense-by-sense" approach, researchers across different disciplines in neuroscience and psychology now recognize that perception is fundamentally a multisensory experience. To understand how the brain synthesizes information from the different senses, we must study not only how information from each sensory modality is decoded but also how this information interacts with the sensory processing taking place within other sensory channels. The findings cited in The Handbook of Multisensory Processes suggest that there are broad underlying principles that govern this interaction, regardless of the specific senses involved. The book is organized thematically into eight sections; each of the 55 chapters presents a state-of-the-art review of its topic by leading researchers in the field. The key themes addressed include multisensory contributions to perception in humans; whether the sensory integration involved in speech perception is fundamentally different from other kinds of multisensory integration; multisensory processing in the midbrain and cortex in model species, including rat, cat, and monkey; behavioral consequences of multisensory integration; modern neuroimaging techniques, including EEG, PET, and fMRI, now being used to reveal the many sites of multisensory processing in the brain; multisensory processes that require postnatal sensory experience to emerge, with examples from multiple species; brain specialization and possible equivalence of brain regions; and clinical studies of such breakdowns of normal sensory integration as brain damage and synesthesia. Bradford Books imprint
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Aromas such as caramel, vanilla, and berry flavours have been found to increase the perception of sweetness, at least in Western participants (e.g., [2,44,45,93-100], see References [1,101] for reviews).”
From The Role of Intrinsic and Extrinsic Sensory Factors in Sweetness Perception of Food and Beverages: A Review (2019) · cites this paper as [99]
Citations
Cited by
Sorted by citations
Items 301–400 of 946
The brain weights body‐based cues higher than vision when estimating walked distances
Campos, J. L., Byrne, P., & Sun, H. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07212.x · Cited by 48
Parietal disruption impairs reflexive spatial attention within and between sensory modalities
Chambers, C., Payne, J. M., & Mattingley, J. B. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.01.001 · Cited by 45
Boll, S., & Berti, S. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00803.x · Cited by 42
Multisensory simultaneity judgment and proximity to the body
Noel, J., Łukowska, M., Wallace, M. T., & Serino, A. (2016) · Journal of Vision · doi:10.1167/16.3.21 · Cited by 44
Static and active tactile perception and touch anisotropy: aging and gender effect
Abdouni, A., Moreau, G., Vargiolu, R., & Zahouani, H. (2018) · Scientific Reports · doi:10.1038/s41598-018-32724-4 · Cited by 42
Falco, P., Lu, S., Natale, C., Pirozzi, S., & Lee, D. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2914772 · Cited by 42
Agustus, J. L., Ruff, C. C., & Driver, J. (2011) · Human Brain Mapping · doi:10.1002/hbm.21278 · Cited by 44
Spatial–temporal dynamics of gesture–speech integration: a simultaneous EEG-fMRI study
He, Y., Steines, M., Sommer, J. B., Gebhardt, H., Nagels, A., Sammer, G., Kircher, T. T. J., & Straube, B. (2018) · Brain Structure and Function · doi:10.1007/s00429-018-1674-5 · Cited by 40
Visual Motion Influences the Contingent Auditory Motion Aftereffect
Vroomen, J., & de Gelder, B. (2003) · Psychological Science · doi:10.1111/1467-9280.24431 · Cited by 41
Multisensory integration in the mammalian brain: diversity and flexibility in health and disease
Choi, I., Demir, I., Oh, S., & Lee, S. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2022.0338 · Cited by 41
Carpal tunnel syndrome impairs sustained precision pinch performance
Li, K., Evans, P. J., Seitz, W. H., & Li, Z. (2014) · Clinical Neurophysiology · doi:10.1016/j.clinph.2014.05.004 · Cited by 44
User-profile-based perceived olfactory and visual media synchronization
Murray, N., Qiao, Y., Lee, B., & Muntean, G. (2014) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2540994 · Cited by 41
de Jong, J. J., Hodiamont, P. P. G., & de Gelder, B. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.04.010 · Cited by 39
A multisensory approach for the design of food and drink enhancing sonic systems
Velasco, C., Reinoso‐Carvalho, F., Petit, O., & Nijholt, A. (2016) · doi:10.1145/3007577.3007578 · Cited by 42
Mielby, L. A., Wang, Q. J., Jensen, S., Bertelsen, A. S., Kidmose, U., Spence, C. J., & Byrne, D. V. (2018) · Foods · doi:10.3390/foods7080119 · Cited by 41
Language comprehension and dominant hand motion simulation
Borghi, A. M., & Scorolli, C. (2008) · Human Movement Science · doi:10.1016/j.humov.2008.07.002 · Cited by 46
Holmes, N. P., Sanabria, D., Calvert, G. A., & Spence, C. J. (2006) · Brain Research · doi:10.1016/j.brainres.2005.11.010 · Cited by 41
Howes, D. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009329668 · Cited by 42
Pitts, B. J., & Sarter, N. B. (2018) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720818759102 · Cited by 41
Multisensory Interactions in the Real World
Soto‐Faraco, S., Kvasova, D., Biau, E., Ikumi, N., Ruzzoli, M., Fernández, L. M., & Cuello, M. T. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108578738 · Cited by 39
Odour–taste interactions in flavour perception
Salles, C. (2006) · Elsevier eBooks · doi:10.1533/9781845691400.3.345 · Cited by 48
Tactile-visual temporal ventriloquism: No effect of spatial disparity
Keetels, M., & Vroomen, J. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.5.765 · Cited by 41
Audio-Visual Detection Benefits in the Rat
Kayser, S. J., & Kayser, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045677 · Cited by 38
Questioning the automaticity of audiovisual correspondences
Getz, L. M., & Kubovy, M. (2018) · Cognition · doi:10.1016/j.cognition.2018.02.015 · Cited by 38
Visual-Somatosensory Integration and Quantitative Gait Performance in Aging
Mahoney, J. R., & Verghese, J. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00377 · Cited by 39
Geise, S., Panke, D., & Heck, A. (2020) · The International Journal of Press/Politics · doi:10.1177/1940161220968534 · Cited by 39
Compensating for age limits through emotional crossmodal integration
Chaby, L., Boullay, V. L.-D., Chétouani, M., & Plaza, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00691 · Cited by 43
Auditory–visual multisensory interactions attenuate subsequent visual responses in humans
Meylan, R. V., & Murray, M. M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.11.033 · Cited by 37
Efficient video coding based on audio-visual focus of attention
Lee, J., Francesca De Simone, A., & Ebrahimi, T. (2010) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2010.11.002 · Cited by 39
Multisensory Integration: The Case of a Time Window of Gesture–Speech Integration
Obermeier, C., & Gunter, T. C. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00688 · Cited by 36
Nahorna, O., Berthommier, F., & Schwartz, J. (2015) · The Journal of the Acoustical Society of America · doi:10.1121/1.4904536 · Cited by 35
School-aged children can benefit from audiovisual semantic congruency during memory encoding
Heikkilä, J., & Tiippana, K. M. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4341-6 · Cited by 37
The subjective duration of audiovisual looming and receding stimuli
Grassi, M., & Pavan, A. (2012) · Attention Perception & Psychophysics · doi:10.3758/s13414-012-0324-x · Cited by 36
Action-sound Latency and the Perceived Quality of Digital Musical Instruments
Jack, R. H., Mehrabi, A., Stockman, T., & McPherson, A. (2018) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2018.36.1.109 · Cited by 42
Can odours acquire fat-like properties?
Sundqvist, N., Stevenson, R. J., & Bishop, I. (2006) · Appetite · doi:10.1016/j.appet.2006.03.328 · Cited by 35
Vision Merges With Touch in a Purely Tactile Discrimination
Arabzadeh, E., Clifford, C. W. G., & Harris, J. A. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02134.x · Cited by 36
Visual speech primes open-set recognition of spoken words
Buchwald, A. B., Winters, S. J., & Pisoni, D. B. (2008) · Language and Cognitive Processes · doi:10.1080/01690960802536357 · Cited by 36
Leonardelli, E., Braun, C., Weisz, N., Lithari, C. D., Occelli, V., & Zampini, M. (2015) · Human Brain Mapping · doi:10.1002/hbm.22857 · Cited by 30
Meyer, G., Wong, L., Timson, E., Perfect, P., & White, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044381 · Cited by 40
True and Perceived Synchrony are Preferentially Associated With Particular Sensory Pairings
Noel, J., Wallace, M. T., Orchard-Mills, E., Alais, D., & der Burg, E. V. (2015) · Scientific Reports · doi:10.1038/srep17467 · Cited by 40
The strength of weak embodiment
Tirado, C., Khatin‐Zadeh, O., Vargas, M. G., Jones, N., & Marmolejo‐Ramos, F. (2018) · International journal of psychological research · doi:10.21500/20112084.3420 · Cited by 39
Damaziak, K., Stelmasiak, A., Riedel, J., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210722 · Cited by 35
Perception of Synchrony between the Senses
Keetels, M., & Vroomen, J. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-12 · Cited by 35
The mechanisms of the effect of light finger touch on postural control
Chen, F., & Tsai, C. (2015) · Neuroscience Letters · doi:10.1016/j.neulet.2015.08.016 · Cited by 35
The multisensory environmental evaluations of sound and odour in urban public open spaces
Ba, M., Li, Z., & Kang, J. (2022) · Environment and Planning B Urban Analytics and City Science · doi:10.1177/23998083221141438 · Cited by 34
Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit
Lalonde, K., & Werner, L. A. (2021) · Brain Sciences · doi:10.3390/brainsci11010049 · Cited by 31
Multisensory Processing and Perceptual Consciousness: Part I
BRISCOE, R. E. (2016) · Philosophy Compass · doi:10.1111/phc3.12227 · Cited by 35
A Cognitive Approach to Audio Description
Holšánová, J. (2016) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-137-56917-2_4 · Cited by 38
Audiovisual contrast enhancement is articulated primarily via the M-pathway
Jaekl, P. M., & Soto‐Faraco, S. (2010) · Brain Research · doi:10.1016/j.brainres.2010.10.012 · Cited by 33
Olfactory priming on consumer categorization, recall, and choice
Luca, R. D., & Botelho, D. (2020) · Psychology and Marketing · doi:10.1002/mar.21342 · Cited by 33
Invisible Boundaries for VR: Auditory and Haptic Signals as Indicators for Real World Boundaries
George, C., Tamunjoh, P. C., & Hußmann, H. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3023607 · Cited by 34
Schifferstein, H. N. J., & Wastiels, L. (2013) · Elsevier eBooks · doi:10.1016/b978-0-08-099359-1.00002-3 · Cited by 33
Cross-modal interaction between vision and hearing: A speed-accuracy analysis
Arieh, Y., & Marks, L. E. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.3.412 · Cited by 33
Diederich, A., & Colonius, H. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0768-0 · Cited by 33
Multisensory Immersive Analytics
McCormack, J., Roberts, J. C., Bach, B., Freitas, C. M. D. S., Itoh, T., Hurter, C., & Marriott, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01388-2_3 · Cited by 38
Multimodal Navigation Systems for Users with Visual Impairments—A Review and Analysis
Kuriakose, B., Shrestha, R., & Sandnes, F. E. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4040073 · Cited by 32
McLean, B. (2020) · Linguistic Typology · doi:10.1515/lingty-2020-2063 · Cited by 32
The Aesthetic Appeal of Auditory-Visual Synaesthetic Perceptions in People without Synaesthesia
Ward, J., Moore, S., Thompson-Lake, D. G. Y., Salih, S., & Beck, B. (2008) · Perception · doi:10.1068/p5815 · Cited by 33
Demattè, M. L., Sanabria, D., & Spence, C. J. (2006) · Acta Psychologica · doi:10.1016/j.actpsy.2006.04.001 · Cited by 32
Tactile perception of the roughness of the end of a tool: What role does tool handle roughness play?
Zampini, M., Mawhinney, S., & Spence, C. J. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2006.02.068 · Cited by 33
Early- and Late-Onset Blindness Both Curb Audiotactile Integration on the Parchment-Skin Illusion
Champoux, F., Collignon, O., Bacon, B. A., Leporé, F., Zatorre, R. J., & Théoret, H. (2010) · Psychological Science · doi:10.1177/0956797610391099 · Cited by 30
Vision and Virtual Environments
Badcock, D. R., Palmisano, S. A., & May, J. G. (2014) · Human factors and ergonomics · doi:10.1201/b17360-6 · Cited by 35
Turchet, L. (2015) · Virtual Reality · doi:10.1007/s10055-015-0267-3 · Cited by 32
Alameda-Pineda, X., & Horaud, R. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914548050 · Cited by 31
Multisensory processing and perceptual consciousness: Part II
BRISCOE, R. E. (2017) · Philosophy Compass · doi:10.1111/phc3.12423 · Cited by 31
A comparison of the McGurk effect for spoken and sung syllables
Quinto, L. R., Thompson, W. F., Russo, F., & Trehub, S. E. (2010) · Attention Perception & Psychophysics · doi:10.3758/app.72.6.1450 · Cited by 34
Förster, B., & Pavone, E. F. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.1.65 · Cited by 31
Bolognini, N., Rasi, F., & Làdavas, E. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.01.015 · Cited by 31
Ramachandran, V. S., Marcus, Z. J., & Chunharas, C. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-812492-5.00001-2 · Cited by 30
Spence, C. J., Lee, J., & der Stoep, N. V. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13733 · Cited by 32
Slipped lips: onset asynchrony detection of auditory‐visual language in autism
Grossman, R. B., Schneps, M. H., & Tager-Flusberg, H. B. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2008.02002.x · Cited by 30
Multisensory systems integration for high-performance motor control in flies
Frye, M. A. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.002 · Cited by 30
Deafness and visual enumeration: Not all aspects of attention are modified by deafness
Hauser, P. C., Dye, M., Boutla, M., Green, C. S., & Bavelier, D. (2007) · Brain Research · doi:10.1016/j.brainres.2007.03.065 · Cited by 32
Musical mode and visual-spatial cross-modal associations in infants and adults
Bonetti, L., & Costa, M. (2017) · Musicae Scientiae · doi:10.1177/1029864917705001 · Cited by 28
Are representations of unfamiliar faces independent of encoding modality?
Casey, S. J., & Newell, F. N. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.02.011 · Cited by 30
Tactile stimulation can suppress visual perception
Ide, M., & Hidaka, S. (2013) · Scientific Reports · doi:10.1038/srep03453 · Cited by 33
A novel behavioral paradigm to assess multisensory processing in mice
Siemann, J. K., Muller, C. L., Bamberger, G., Allison, J. D., Veenstra-VanderWeele, J. M., & Wallace, M. T. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00456 · Cited by 35
The Cambridge Handbook of Infant Development
Lockman, J. J., Hertz, D., Tamis-LeMonda, C. S., Brain, B. C., Context..........................................., Rey, J., Falck-Ytter, T., Jones, E., Maurer, D., Cirelli, L., et al. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108351959 · Cited by 31
Audiotactile temporal order judgments in sighted and blind individuals
Occelli, V., Spence, C. J., & Zampini, M. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.05.023 · Cited by 34
A phonetically neutral model of the low-level audio-visual interaction
Berthommier, F. (2004) · Speech Communication · doi:10.1016/j.specom.2004.10.003 · Cited by 29
Spatial Heterogeneity of Cortical Receptive Fields and Its Impact on Multisensory Interactions
Carriere, B. N., Royal, D. W., & Wallace, M. T. (2008) · Journal of Neurophysiology · doi:10.1152/jn.01386.2007 · Cited by 33
Large-Scale Brain Plasticity Following Blindness and the Use of Sensory Substitution Devices
Bubić, A., Striem-Amit, E., & Amedi, A. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5615-6_18 · Cited by 33
Ramić-Brkić, B., & Chalmers, A. G. (2010) · International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (AFRIGRAPH) · doi:10.1145/1811158.1811166 · Cited by 29
Designing Interactive Sound Maps Using Scalable Vector Graphics
Brauen, G. (2006) · Cartographica The International Journal for Geographic Information and Geovisualization · doi:10.3138/5512-628g-2h57-h675 · Cited by 29
Repetition blindness and the Colavita effect
Ngo, M. K., Sinnett, S., Soto‐Faraco, S., & Spence, C. J. (2010) · Neuroscience Letters · doi:10.1016/j.neulet.2010.06.028 · Cited by 28
Kang, N., Sah, Y. J., & Lee, S. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102613 · Cited by 32
The integration of higher order form and motion by the human brain
Sarkheil, P., Vuong, Q. C., Bülthoff, H., & Noppeney, U. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.04.265 · Cited by 28
Spence, C. J., & Zampini, M. (2007) · CoDesign · doi:10.1080/15710880701362679 · Cited by 28
Selection in touch: Negative priming with tactile stimuli
Frings, C., Bader, R., & Spence, C. J. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.3.516 · Cited by 27
Loomis, J. M., Klatzky, R. L., McHugh, B., & Giudice, N. A. (2012) · Attention Perception & Psychophysics · doi:10.3758/s13414-012-0311-2 · Cited by 28
Interactions between space and effectiveness in human multisensory performance
Nidiffer, A. R., Stevenson, R. A., Fister, J. K., Barnett, Z. P., & Wallace, M. T. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.01.031 · Cited by 26
Reciprocal greeting in chimpanzees ( Pan troglodytes ) at the Ngogo community
Luef, E. M., & Pika, S. (2016) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2016.11.002 · Cited by 28
The multisensory roles for auditory cortex in primate vocal communication
Ghazanfar, A. A. (2009) · Hearing Research · doi:10.1016/j.heares.2009.04.003 · Cited by 28
Lyons, G., Sanabria, D., Vatakis, A., et al. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0485-8 · Cited by 28
The effects of sounds and food odour on crowd behaviours in urban public open spaces
Ba, M., Kang, J., & Li, Z. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.107104 · Cited by 27
Crossmodal interaction in speeded responses: time window of integration model
Diederich, A., & Colonius, H. (2009) · Progress in brain research · doi:10.1016/s0079-6123(09)01311-9 · Cited by 27
Gray, B., Bailey, N. W., Poon, M., et al. (2014) · Animal Behaviour · doi:10.1016/j.anbehav.2014.04.033 · Cited by 27
Early exposure to odors changes later visual prey preferences in cuttlefish
Guibé, M., Boal, J. G., & Dickel, L. (2010) · Developmental Psychobiology · doi:10.1002/dev.20470 · Cited by 27
Sequential audiovisual interactions during speech perception: A whole-head MEG study
Hertrich, I., Mathiak, K., Lutzenberger, W., Menning, H., & Ackermann, H. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.09.019 · Cited by 27
Visual Influences on Interactive Speech Alignment
Dias, J. W., & Rosenblum, L. D. (2011) · Perception · doi:10.1068/p7071 · Cited by 29
Metadata
- Venue
- The MIT Press eBooks
- Publisher
- The MIT Press
- Published
- 2004-05-21
- OpenAlex
- W4313177291
- Cited by
- 948
- References
- 0
- Citations by year
- 2026: 27 · 2025: 25 · 2024: 21 · 2023: 24 · 2022: 33 · 2021: 41 · 2020: 81 · 2019: 39 · 2018: 47 · 2017: 43 · 2016: 40 · 2015: 50 · 2014: 48 · 2013: 45 · 2012: 35
- FWCI
- 28.07
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- The MIT Press eBooks (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- multisensory integration, perception, speech perception, brain specialization, synesthesia, brain damage, multisensory interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
