The DOI matches its Crossref record; 253 of the 254 references it cites were found in a registry or an index.
Crossmodal correspondences: A tutorial review
Open accessAbstract
In many everyday situations, our senses are bombarded by many different unisensory signals at any given time. To gain the most veridical, and least variable, estimate of environmental stimuli/properties, we need to combine the individual noisy unisensory perceptual estimates that refer to the same object, while keeping those estimates belonging to different objects or events separate. How, though, does the brain "know" which stimuli to combine? Traditionally, researchers interested in the crossmodal binding problem have focused on the roles that spatial and temporal factors play in modulating multisensory integration. However, crossmodal correspondences between various unisensory features (such as between auditory pitch and visual size) may provide yet another important means of constraining the crossmodal binding problem. A large body of research now shows that people exhibit consistent crossmodal correspondences between many stimulus features in different sensory modalities. For example, people consistently match high-pitched sounds with small, bright objects that are located high up in space. The literature reviewed here supports the view that crossmodal correspondences need to be considered alongside semantic and spatiotemporal congruency, among the key constraints that help our brains solve the crossmodal binding problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to Bayesian decision theory, the brain uses prior knowledge about what sensory signals go together-whether inborn or explicitly learned-to integrate appropriate sensory stimuli with the goal of maximising the reliability of perceived information [139-141] and, presumably, to reduce cognitive load by combining disparate sensory cues into a single object.”
From The Role of Intrinsic and Extrinsic Sensory Factors in Sweetness Perception of Food and Beverages: A Review (2019) · cites this paper as [141]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Studies of interference in serial verbal reactions
Stroop, J. R. (1935) · Journal of Experimental Psychology · doi:10.1037/h0054651 · Cited by 18,622
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Journal of Consciousness Studies
(2022) · Journal of Consciousness Studies · doi:10.53765/20512201 · Cited by 6,852
The Senses Considered as Perceptual Systems
West, C. K., & Gibson, J. J. (1969) · Journal of Aesthetic Education · doi:10.2307/3331482 · Cited by 6,344
Half a century of research on the Stroop effect: An integrative review.
MacLeod, C. M. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.2.163 · Cited by 5,500
Stevens, S. S. (1957) · Psychological Review · doi:10.1037/h0046162 · Cited by 3,388
The Senses Considered as Perceptual Systems
Kensler, G. L., & Gibson, J. J. (1969) · Studies in Art Education · doi:10.2307/1319633 · Cited by 2,773
A theory of magnitude: common cortical metrics of time, space and quantity
Walsh, V. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.09.002 · Cited by 2,044
Dimensional overlap: cognitive basis for stimulus-response compatibility-a model and taxonomy
Kornblum, S., Hasbroucq, T., & Osman, A. (1990) · Psychological Review · doi:10.1037/0033-295x.97.2.253 · Cited by 1,970
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Merging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906
Synaesthesia? A window into perception, thought and language
Ramachandran, V. S., & Hubbard, E. M. (2001) · Cited by 1,570
Computation of conditional probability statistics by 8-month-old infants
Aslin, R. N., Saffran, J. R., & Newport, E. L. (1998) · Psychological Science · doi:10.1111/1467-9280.00063 · Cited by 1,189
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
A study in phonetic symbolism.
Sapir, E. (1929) · Journal of Experimental Psychology · doi:10.1037/h0070931 · Cited by 1,054
(2004) · Medical Entomology and Zoology · Cited by 978
Self-citationGestalt Psychology: An Introduction to New Concepts in Modern Psychology
Köhler, W. (1970) · Medical Entomology and Zoology · Cited by 934
Crossmodal Space and Crossmodal Attention
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.001.0001 · Cited by 801
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B., & Martin, A. D. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 765
A Source Book Of Gestalt Psychology
Ellis, W. D. (2013) · Routledge eBooks · doi:10.4324/9781315009247 · Cited by 763
Temporal window of integration in auditory-visual speech perception
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.001 · Cited by 649
Intermodal matching by human neonates
Meltzoff, A. N., & Borton, R. (1979) · Nature · doi:10.1038/282403a0 · Cited by 630
Issues in psychophysical measurement.
Stevens, S. S. (1971) · Psychological Review · doi:10.1037/h0031324 · Cited by 622
(1964) · Progress in brain research · doi:10.1016/s0079-6123(08)61284-4 · Cited by 618
Deep croaks and fighting assessment in toads Bufo bufo
DAVIES, N. B., & Halliday, T. R. (1978) · Nature · doi:10.1038/274683a0 · Cited by 593
Integration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 568
Proceedings of the International Conference on Spoken Language Processing.
Lickley, R. J., & Bard, E. G. (1992) · Cited by 562
McMahon, T. A., & Bonner, J. T. (1983) · Cited by 561
The shape of boubas: sound–shape correspondences in toddlers and adults
Maurer, D. M., Pathman, T., & Mondloch, C. J. (2006) · Developmental Science · doi:10.1111/j.1467-7687.2006.00495.x · Cited by 553
Does food color influence taste and flavor perception in humans?
Spence, C., Levitan, C. A., Shankar, M. U., & Zampini, M. (2010) · Chemosensory Perception · doi:10.1007/s12078-010-9067-z · Cited by 540
Self-citationUnraveling multisensory integration: patchy organization within human STS multisensory cortex
Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004) · Nature Neuroscience · doi:10.1038/nn1333 · Cited by 513
Sound symbolism facilitates early verb learning
Imai, M., Kita, S., Nagumo, M., & Okada, H. (2008) · Cognition · doi:10.1016/j.cognition.2008.07.015 · Cited by 508
Automatic multimedia cross-modal correlation discovery
Pan, J.-Y., Yang, H.-J., Faloutsos, C., & Duygulu, P. (2004) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1014052.1014135 · Cited by 484
Auditory capture of vision: examining temporal ventriloquism
Morein‐Zamir, S., Soto‐Faraco, S., & Kingstone, A. F. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00089-2 · Cited by 468
The descended larynx is not uniquely human
Fitch, W. T., & Reby, D. (2001) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2001.1704 · Cited by 468
Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All?
Ward, J., HUCKSTEP, B., & Tsakanikos, E. (2006) · Cortex · doi:10.1016/s0010-9452(08)70352-6 · Cited by 458
Increased structural connectivity in grapheme-color synesthesia
Rouw, R., & Scholte, H. S. (2007) · Nature Neuroscience · doi:10.1038/nn1906 · Cited by 445
On colored-hearing synesthesia: Cross-modal translations of sensory dimensions.
Marks, L. E. (1975) · Psychological Bulletin · doi:10.1037/0033-2909.82.3.303 · Cited by 441
The Unity of the Senses: Interrelations Among the Modalities
Marks, L. E. (1978) · Cited by 424
Further Experiments in Phonetic Symbolism
Newman, S. S. (1933) · The American Journal of Psychology · doi:10.2307/1414186 · Cited by 419
Causal inference in perception
Shams, L., & Beierholm, U. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.07.001 · Cited by 403
Natural cross-modal mappings between visual and auditory features
Evans, K. K., & Treisman, A. (2010) · Journal of Vision · doi:10.1167/10.1.6 · Cited by 403
Multisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Molholm, S. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh007 · Cited by 385
Synaesthesia : classic and contemporary readings
Baron‐Cohen, S., & Harrison, J. (1997) · Cited by 372
Cross-modal equivalence in early infancy: Auditory–visual intensity matching.
Lewkowicz, D. J., & Turkewitz, G. (1980) · Developmental Psychology · doi:10.1037/0012-1649.16.6.597 · Cited by 371
On cross-modal similarity: Auditory-visual interactions in speeded discrimination.
Marks, L. E. (1987) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.13.3.384 · Cited by 368
Preverbal Infants’ Sensitivity to Synaesthetic Cross-Modality Correspondences
Walker, P., Bremner, J. G., Mason, U. C., Spring, J., Mattock, K., Slater, A. M., & Johnson, S. P. (2009) · Psychological Science · doi:10.1177/0956797609354734 · Cited by 361
Varieties of anomalous experience: Examining the scientific evidence.
(2000) · American Psychological Association eBooks · doi:10.1037/10371-000 · Cited by 360
Temporal and spatial dependency of the ventriloquism effect
Slutsky, D. A., & Recanzone, G. H. (2001) · Neuroreport · doi:10.1097/00001756-200101220-00009 · Cited by 344
Broken Mirrors: A Theory of Autism
Ramachandran, V. S., & Oberman, L. M. (2006) · Scientific American · doi:10.1038/scientificamerican1106-62 · Cited by 341
Human Body Perception From The Inside Out
(2005) · doi:10.1093/oso/9780195178371.001.0001 · Cited by 339
Nuckolls, J. B. (1999) · Annual Review of Anthropology · doi:10.1146/annurev.anthro.28.1.225 · Cited by 338
Learning to integrate arbitrary signals from vision and touch
Ernst, M. O. (2007) · Journal of Vision · doi:10.1167/7.5.7 · Cited by 332
Semantic congruence is a critical factor in multisensory behavioral performance
Laurienti, P. J., Kraft, R., Maldjian, J. A., Burdette, J. H., & Wallace, M. T. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1913-2 · Cited by 329
Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements
Frens, M. A., Opstal, A. J. V., & van der Willigen, R. F. (1995) · Perception & Psychophysics · doi:10.3758/bf03206796 · Cited by 328
Interaction of Face and Voice Areas during Speaker Recognition
von Kriegstein, K., Kleinschmidt, A. K., Sterzer, P., & Giraud, A. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053279577 · Cited by 327
Audiotactile interactions in roughness perception
Guest, S., Catmur, C., Lloyd, D. M., & Spence, C. J. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1164-z · Cited by 326
Self-citationCrossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. J. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 320
Self-citationMartino, G., & Marks, L. E. (2001) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00116 · Cited by 318
Multisensory synesthetic interactions in the speeded classification of visual size
Gallace, A., & Spence, C. J. (2006) · Perception & Psychophysics · doi:10.3758/bf03193720 · Cited by 312
Self-citationOn specification and the senses
Stoffregen, T. A., & Bardy, B. G. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003946 · Cited by 311
Perceptual-cognitive universals as reflections of the world
Shepard, R. N. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03200759 · Cited by 309
Implicit multisensory associations influence voice recognition
von Kriegstein, K., & Giraud, A.-L. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040326 · Cited by 309
Wednesday is indigo blue: discovering the brain of synesthesia
(2009) · Choice Reviews Online · doi:10.5860/choice.47-1138 · Cited by 305
Statistical Learning Within and Between Modalities
Conway, C. M., & Christiansen, M. H. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01801.x · Cited by 295
Unifying multisensory signals across time and space
Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., & Schirillo, J. A. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1899-9 · Cited by 291
Dainton, B. (2010) · doi:10.1017/upo9781844654437 · Cited by 287
Implicit sound symbolism in lexical access: Evidence from an interference task
Westbury, C. F. (2004) · Brain and Language · doi:10.1016/j.bandl.2004.07.006 · Cited by 284
On Associations of Light and Sound: The Mediation of Brightness, Pitch, and Loudness
Marks, L. E. (1974) · The American Journal of Psychology · doi:10.2307/1422011 · Cited by 283
Non-random associations of graphemes to colours in synaesthetic and non-synaesthetic populations
Simner, J., Ward, J., Lanz, M., Jansari, A. S., Noonan, K. A., Glover, L., & Oakley, D. A. (2005) · Cognitive Neuropsychology · doi:10.1080/02643290500200122 · Cited by 281
Parise, C. V., & Spence, C. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005664 · Cited by 272
Self-citationA theory of magnitude estimation and cross-modality matching
Krantz, D. H. (1972) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(72)90025-9 · Cited by 272
Factors That Influence the Localization of Sound in the Vertical Plane
Roffler-Tarlov, S. K., & Butler, R. A. (1968) · The Journal of the Acoustical Society of America · doi:10.1121/1.1910976 · Cited by 271
Sound-induced flash illusion as an optimal percept
Shams, L. B., Ma, W. J., & Beierholm, U. (2005) · Neuroreport · doi:10.1097/01.wnr.0000187634.68504.bb · Cited by 267
Guttman, S. E., Gilroy, L. A., & Blake, R. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.00808.x · Cited by 257
Auditory Influences on Visual Temporal Rate Perception
Recanzone, G. H. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00706.2002 · Cited by 255
Coloured Speech Perception: Is Synaesthesia what Happens when Modularity Breaks Down?
Baron‐Cohen, S., Harrison, J., Goldstein, L. H., & Wyke, M. (1993) · Perception · doi:10.1068/p220419 · Cited by 254
On cross-modal similarity: Auditory–visual interactions in speeded discrimination.
Marks, L. E. (1987) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.13.3.384 · Cited by 254
Audiovisual multisensory integration
Spence, C. J. (2007) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.28.61 · Cited by 252
Self-citationCytowič, R. E., & Cole, J. R. (2003) · Digital Commons - RU (Rockefeller University) · Cited by 247
Hearing visual motion in depth
Kitagawa, N., & Ichihara, S. (2002) · Nature · doi:10.1038/416172a · Cited by 247
The processing and perception of size information in speech sounds
Smith, D. R. R., Patterson, R., Turner, R. E., Kawahara, H., & Irino, T. (2005) · Journal of the Acoustical Society of America · doi:10.1121/1.1828637 · Cited by 246
Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging
Murray, M. M., Michel, C. M., de Peralta, R. G., Ortigue, S., Brunet, D., Andino, S. L. G., & Schnider, A. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.035 · Cited by 244
Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration
Doehrmann, O., & Naumer, M. J. (2008) · Brain Research · doi:10.1016/j.brainres.2008.03.071 · Cited by 241
Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991) · Perception & Psychophysics · doi:10.3758/bf03207536 · Cited by 239
Synesthesia : perspectives from cognitive neuroscience
Robertson, L. C., & Sagiv, N. (2005) · Cited by 237
The cross-cultural generality of visual-verbal synesthetic tendencies
Osgood, C. E. (2007) · Systems Research and Behavioral Science · doi:10.1002/bs.3830050204 · Cited by 234
THE FITNESS OF NAMES TO DRAWINGS. A CROSS‐CULTURAL STUDY IN TANGANYIKA
Davis, R. (1961) · British Journal of Psychology · doi:10.1111/j.2044-8295.1961.tb00788.x · Cited by 232
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x_3_1_008 · Cited by 231
Interaction between synesthetically corresponding dimensions.
Melara, R. D., & O'Brien, T. P. (1987) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.116.4.323 · Cited by 229
Cross-Modal Correspondence between Vision and Olfaction: The Color of Smells
Gilbert, A. N., Martin, R., & Kemp, S. E. (1996) · The American Journal of Psychology · doi:10.2307/1423010 · Cited by 228
Chen, Y.-C., & Spence, C. (2010) · Cognition · doi:10.1016/j.cognition.2009.10.012 · Cited by 221
Self-citationThe spatial character of high and low tones.
Pratt, C. C. (1930) · Journal of Experimental Psychology · doi:10.1037/h0072651 · Cited by 219
Hein, G., Doehrmann, O., Müller, N. G., Kaiser, J., Muckli, L. F., & Naumer, M. J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1740-07.2007 · Cited by 215
Visual Factors in Auditory Localization
Jackson, C. V. (1953) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215308416626 · Cited by 213
Roach, N. W., Heron, J., & McGraw, P. V. (2006) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2006.3578 · Cited by 210
A Bayesian View on Multimodal Cue Integration
Ernst, M. O. (2005) · Human Body Perception From The Inside Out · doi:10.1093/oso/9780195178371.003.0006 · Cited by 209
Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability
Morgan, M. L., DeAngelis, G. C., & Angelaki, D. E. (2008) · Neuron · doi:10.1016/j.neuron.2008.06.024 · Cited by 208
Similarities between hearing and skin sensations.
von Békésy, G. (1959) · Psychological Review · doi:10.1037/h0046967 · Cited by 207
Cognitive Processes in the Perception of Art
(1984) · Advances in psychology · doi:10.1016/s0166-4115(08)x6093-5 · Cited by 203
Do small white balls squeak? Pitch-object correspondences in young children
Mondloch, C. J., & Maurer, D. M. (2004) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.4.2.133 · Cited by 194
The shape of words in the brain
Ković, V., Plunkett, K., & Westermann, G. (2009) · Cognition · doi:10.1016/j.cognition.2009.08.016 · Cited by 191
Cross-modality matching of brightness and loudness.
Stevens, J., & Marks, L. E. (1965) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.54.2.407 · Cited by 186
Improvement of visual contrast detection by a simultaneous sound
Lippert, M., Logothetis, N. K., & Kayser, C. (2007) · Brain Research · doi:10.1016/j.brainres.2007.07.050 · Cited by 186
Birds of a Feather Flock Together: Similarity Judgments with Semantically Rich Stimuli
Bassok, M., & Medin, D. L. (1997) · Journal of Memory and Language · doi:10.1006/jmla.1996.2492 · Cited by 186
Crisinel, A.-S., & Spence, C. (2010) · Attention, Perception & Psychophysics · doi:10.3758/app.72.7.1994 · Cited by 184
Self-citationVision and touch are automatically integrated for the perception of sequences of events
Bresciani, J., Dammeier, F., & Ernst, M. O. (2006) · Journal of Vision · doi:10.1167/6.5.2 · Cited by 183
A developmental analysis of the polar structure of dimensions
Smith, L. B., & Sera, M. D. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90004-l · Cited by 183
Bee, M. A. (2000) · Behavioral Ecology · doi:10.1093/beheco/11.2.169 · Cited by 180
Hearing Colors, Tasting Shapes
Ramachandran, V. S., & Hubbard, E. M. (2003) · Scientific American · doi:10.1038/scientificamerican0503-52 · Cited by 179
"Metaphorical" Mapping in Human Infants
Wagner, S., Winner, E., Cicchetti, D., & Gardner, H. (1981) · Child Development · doi:10.2307/1129200 · Cited by 179
Neonatal Synesthesia: Implications for the Processing of Speech And Faces
Maurer, D. M. (1993) · Springer eBooks · doi:10.1007/978-94-015-8234-6_10 · Cited by 175
Temporal Frequency Channels Are Linked across Audition and Touch
Yau, J. M., Olenczak, J. B., Dammann, J. F., & Bensmaı̈a, S. J. (2009) · Current Biology · doi:10.1016/j.cub.2009.02.013 · Cited by 175
What sound does that taste? Cross-modal mappings across gustation and audition
Simner, J., Cuskley, C., & Kirby, S. (2010) · Perception · doi:10.1068/p6591 · Cited by 174
Perceiving Similarity and Comprehending Metaphor
Marks, L. E., Hammeal, R. J., Bornstein, M. H., & Smith, L. B. (1987) · Monographs of the Society for Research in Child Development · doi:10.2307/1166084 · Cited by 173
Visual-auditory interaction in speeded classification: Role of stimulus difference
Ben‐Artzi, E., & Marks, L. E. (1995) · Perception & Psychophysics · doi:10.3758/bf03208371 · Cited by 171
Dimensional interaction between color and pitch.
Melara, R. D. (1989) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.15.1.69 · Cited by 166
Effects of some variations in auditory input upon visual choice reaction time.
Bernstein, I. H., & Edelstein, B. A. (1971) · Journal of Experimental Psychology · doi:10.1037/h0030524 · Cited by 164
Gallace, A., Boschin, E. A., & Spence, C. J. (2010) · Cognitive Neuroscience · doi:10.1080/17588928.2010.516820 · Cited by 160
Self-citationMartino, G., & Marks, L. E. (1999) · Perception · doi:10.1068/p2866 · Cited by 153
Perception of object length by sound
Carello, C., Anderson, K. L., & Kunkler-Peck, A. J. (1998) · Psychological Science · doi:10.1111/1467-9280.00040 · Cited by 153
Cross-Modal Interactions in Speeded Classification
Marks, L. E. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3422.003.0009 · Cited by 151
Chapter 15 Crossmodal interactions: lessons from synesthesia
Sagiv, N., & Ward, J. (2006) · Progress in brain research · doi:10.1016/s0079-6123(06)55015-0 · Cited by 148
Implicit association between basic tastes and pitch
Crisinel, A.-S., & Spence, C. (2009) · Neuroscience Letters · doi:10.1016/j.neulet.2009.08.016 · Cited by 141
Self-citationCross-Modal Interaction between Vision and Touch: The Role of Synesthetic Correspondence
Martino, G., & Marks, L. E. (2000) · Perception · doi:10.1068/p2984 · Cited by 140
Auditory contributions to multisensory product perception
Spence, C. J., & Zampini, M. (2006) · Institutional Research Information System (Università degli Studi di Trento) · Cited by 136
Self-citationCan synaesthesia research inform cognitive science?
Kadosh, R. C., & Henik, A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.003 · Cited by 135
Spence, C. J., & Gallace, A. (2010) · Food Quality and Preference · doi:10.1016/j.foodqual.2010.11.005 · Cited by 133
Self-citationChannel interaction and the redundant-targets effect in bimodal divided attention.
Miller, J. O. (1991) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.17.1.160 · Cited by 133
Vatakis, A., & Spence, C. J. (2007) · Acta Psychologica · doi:10.1016/j.actpsy.2006.12.002 · Cited by 132
Self-citationStudies in Synesthetic Thinking: II. The Rôle Of Form In Visual Responses To Music
Karwoski, T. F., Odbert, H. S., & Osgood, C. E. (1942) · The Journal of General Psychology · doi:10.1080/00221309.1942.10545166 · Cited by 132
Odor Intensity and Color Lightness Are Correlated Sensory Dimensions
Kemp, S. E., & Gilbert, A. N. (1997) · The American Journal of Psychology · doi:10.2307/1423699 · Cited by 128
Poffenberger, A. T., & Barrows, B. E. (1924) · Journal of Applied Psychology · doi:10.1037/h0073513 · Cited by 127
On the cross-modal perception of intensity.
Marks, L. E., Szczesiul, R., & Ohlott, P. J. (1986) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.12.4.517 · Cited by 127
Synesthesia-like Mappings of Lightness, Pitch, and Melodic Interval
Hubbard, T. L. (1996) · The American Journal of Psychology · doi:10.2307/1423274 · Cited by 127
Some Demographic and Socio-cultural Aspects of Synesthesia
Day, S. A. (2004) · doi:10.1093/oso/9780195166231.003.0002 · Cited by 127
Do we hear size or sound? Balls dropped on plates
Grassi, M. (2005) · Perception & Psychophysics · doi:10.3758/bf03206491 · Cited by 121
Auditory Pitch as a Perceptual Analogue to Odor Quality
Belkin, K., Martin, R., Kemp, S. E., & Gilbert, A. N. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00450.x · Cited by 120
Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect
Walker, S., Bruce, V., & O’Malley, C. L. (1995) · Perception & Psychophysics · doi:10.3758/bf03208369 · Cited by 119
Changing pitch induced visual motion illusion
Maeda, F., Ryota Kanai, C., & Shinsuke Shimojo, A. (2004) · Current Biology · doi:10.1016/j.cub.2004.11.018 · Cited by 117
Cross-modal, auditory-visual Stroop interference and possible implications for speech memory
Cowan, N., & Barron, A. (1987) · Perception & Psychophysics · doi:10.3758/bf03203031 · Cited by 115
Cross-modal integration between odors and abstract symbols
Seo, H., Arshamian, A., Schemmer, K., Scheer, I., Sander, T., Ritter, G., & Hummel, T. R. (2010) · Neuroscience Letters · doi:10.1016/j.neulet.2010.05.011 · Cited by 115
(1922) · Springer eBooks · doi:10.1007/978-3-662-29583-0 · Cited by 112
An investigation of synesthesia.
Rader, C. M., & Tellegen, A. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.52.5.981 · Cited by 111
Phonetic symbolism re-examined.
Taylor, I. K. (1963) · Psychological Bulletin · doi:10.1037/h0040632 · Cited by 110
Affective synesthesia: Extracting emotion space from simple perceptual stimuli
Collier, G. L. (1996) · Motivation and Emotion · doi:10.1007/bf02251005 · Cited by 109
A sweet sound? Food names reveal implicit associations between taste and pitch
Crisinel, A.-S., & Spence, C. (2010) · Perception · doi:10.1068/p6574 · Cited by 108
Self-citationMesz, B., Trevisan, M. A., & Sigman, M. (2011) · Perception · doi:10.1068/p6801 · Cited by 108
Walker, R. (1987) · Perception & Psychophysics · doi:10.3758/bf03209757 · Cited by 108
Oberman, L. M., & Ramachandran, V. S. (2008) · Social Neuroscience · doi:10.1080/17470910701563681 · Cited by 108
Experimental study of the influence of vision on sound localization.
Thomas, G. (1941) · Journal of Experimental Psychology · doi:10.1037/h0055183 · Cited by 108
Multisensory Object Perception in the Primate Brain
Kaiser, J., & Naumer, M. J. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5615-6 · Cited by 107
The Brightness-Weight Illusion
Walker, P., Francis, B. J., & Walker, L. (2010) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000057 · Cited by 106
Temporal aspects of the visuotactile congruency effect.
Shore, D. I., Barnes, M. E., & Spence, C. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2005.09.001 · Cited by 105
Self-citationAuditory-visual interaction and the timing of inputs
Radeau, M., & Bertelson, P. (1987) · Psychological Research · doi:10.1007/bf00309198 · Cited by 102
Knowledge about a Common Source Can Promote Visual — Haptic Integration
Helbig, H. B., & Ernst, M. O. (2007) · Perception · doi:10.1068/p5851 · Cited by 102
Some Physiognomic Aspects of Naming, or, Maluma and Takete Revisited
Holland, M. K., & Wertheimer, M. (1964) · Perceptual and Motor Skills · doi:10.2466/pms.1964.19.1.111 · Cited by 100
Synesthetic congruency modulates the temporal ventriloquism effect
Parise, C., & Spence, C. J. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2008.07.010 · Cited by 99
Self-citationBaier, B., Kleinschmidt, A. K., & Müller, N. G. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1457-06.2006 · Cited by 98
On cross-modal similarity: The perceptual structure of pitch, loudness, and brightness.
Marks, L. E. (1989) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.15.3.586 · Cited by 94
Facilitation of multisensory integration by the "unity effect" reveals that speech is special
Vatakis, A., Ghazanfar, A. A., & Spence, C. J. (2008) · Journal of Vision · doi:10.1167/8.9.14 · Cited by 94
Self-citationPerceptual dominance during lipreading
Easton, R. D., & Basala, M. (1982) · Perception & Psychophysics · doi:10.3758/bf03204211 · Cited by 92
Spatial stereotypes of four dimensions of pure tone.
Mudd, S. A. (1963) · Journal of Experimental Psychology · doi:10.1037/h0040045 · Cited by 92
Stroop Interference Based on the Synaesthetic Qualities of Auditory Pitch
Walker, P., & Smith, S. B. (1984) · Perception · doi:10.1068/p130075 · Cited by 90
Elias, L. J., Saucier, D. M., Hardie, C., & Sarty, G. E. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00278-1 · Cited by 90
Harrington, F. H. (1987) · Animal Behaviour · doi:10.1016/s0003-3472(87)80204-x · Cited by 89
A Cross-Cultural Test of the Maluma—Takete Phenomenon
Rogers, S. K., & Ross, A. S. (1975) · Perception · doi:10.1068/p040105 · Cited by 89
On the cross-modal perception of intensity.
Marks, L. E., Szczesiul, R., & Ohlott, P. J. (1986) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.12.4.517 · Cited by 89
Small is bright and big is dark in synaesthesia
Kadosh, R. C., Henik, A., & Walsh, V. (2007) · Current Biology · doi:10.1016/j.cub.2007.07.048 · Cited by 88
Dual Mechanisms for the Cross-Sensory Spread of Attention: How Much Do Learned Associations Matter?
Fiebelkorn, I. C., Foxe, J. J., & Molholm, S. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp083 · Cited by 86
Gustatory responses to nongustatory stimuli
O'Mahony, M. (1983) · Perception · doi:10.1068/p120627 · Cited by 83
Channel interaction and the redundant-targets effect in bimodal divided attention.
Miller, J. O. (1991) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.17.1.160 · Cited by 82
Auditory-Visual Crossmodal Integration in Perception of Face Gender
Smith, E. L., Grabowecky, M., & Suzuki, S. (2007) · Current Biology · doi:10.1016/j.cub.2007.08.043 · Cited by 78
From symbols to sounds: Visual symbolic information activates sound representations
Widmann, A., Kujala, T., Tervaniemi, M. H., Kujala, A., & Schröger, E. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00208.x · Cited by 78
Cross-modality matching of brightness to loudness by 5-year-olds
Bond, B., & Stevens, S. S. (1969) · Perception & Psychophysics · doi:10.3758/bf03212787 · Cited by 77
Zangenehpour, S., & Zatorre, R. J. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.10.022 · Cited by 76
Synesthesia in Children: Association of Colors with Pure Tone Frequencies
Simpson, R. H., Quinn, M., & Ausubel, D. P. (1956) · The Journal of Genetic Psychology · doi:10.1080/00221325.1956.10532990 · Cited by 75
Phonetic symbolism in four unrelated languages.
Taylor, I. K., & Taylor, M. M. (1962) · Canadian Journal of Psychology/Revue Canadienne de Psychologie · doi:10.1037/h0083261 · Cited by 75
The experimental development of color-tone synesthesia.
Howells, T. H. (1944) · Journal of Experimental Psychology · doi:10.1037/h0054424 · Cited by 75
The spatial constraint in intersensory pairing: No role in temporal ventriloquism.
Vroomen, J., & Keetels, M. (2006) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.32.4.1063 · Cited by 74
Ein experimenteller Beitrag zum Problem der psychologischen Grundlagen der Namengebung
Usnadze, D. (1924) · Psychological Research · doi:10.1007/bf00402395 · Cited by 74
On cross-modal similarity: The perceptual structure of pitch, loudness, and brightness.
Marks, L. E. (1989) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.15.3.586 · Cited by 74
Exploring the relation between mcgurk interference and ventriloquism
Bertelson, P., Vroomen, J., Wiegeraad, W. G., & de Gelder, B. (1994) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1994-142 · Cited by 73
Eysenck, M. W. (2014) · Psychology Press eBooks · doi:10.4324/9781315736945 · Cited by 72
Welch, R. B. (1972) · Perception & Psychophysics · doi:10.3758/bf03210933 · Cited by 72
Multisensory integration of speech signals: the relationship between space and time
Jones, J. A., & Jarick, M. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0634-0 · Cited by 71
Cytowič, R. E., & Wood, F. (1982) · Brain and Cognition · doi:10.1016/0278-2626(82)90005-7 · Cited by 70
Interaction of vision and touch in conflict and nonconflict form perception tasks.
Miller, E. A. (1972) · Journal of Experimental Psychology · doi:10.1037/h0033468 · Cited by 69
Spatial selection and target identification are separable processes in visual search
Ghorashi, S. M. (2010) · Journal of Vision · doi:10.1167/10.3.7 · Cited by 69
Mapping the Intersensory Regions of Perceptual Space
Wicker, F. W. (1968) · The American Journal of Psychology · doi:10.2307/1421262 · Cited by 69
Garner and congruence effects in the speeded classification of bimodal signals.
Patching, G. R., & Quinlan, P. T. (2002) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.28.4.755 · Cited by 68
von Hornbostel, E. M. (1931) · Pflügers Archiv - European Journal of Physiology · doi:10.1007/bf01755351 · Cited by 68
The handbook of multisensory processes
Calvert, G. (2004) · Cited by 66
Sound symbolism and its role in non-human vertebrate communication
Morton, E. S. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511751806.023 · Cited by 65
Audiovisual bounce-inducing effect: When sound congruence affects grouping in vision
Grassi, M., & Casco, C. (2010) · Attention Perception & Psychophysics · doi:10.3758/app.72.2.378 · Cited by 64
Cross-modal interactions in auditory and visual discrimination
Marks, L. E., Ben‐Artzi, E., & Lakatos, S. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00129-6 · Cited by 64
Review of Hinton, Nichols & Ohala (1994): Sound Symbolism
Cseresnyési, L. (1997) · Studies in Language · doi:10.1075/sl.21.2.10cse · Cited by 63
Holt‐Hansen, K. (1968) · Perceptual and Motor Skills · doi:10.2466/pms.1968.27.1.59 · Cited by 62
Research works printed but not linked: 15
- Bedford, F. L. (2001). Towards a general law of numerical/object identity. Cahiers de Psychologie Cognitive, 20, 113–175.
- Belli, F., & Sagrillo, F. (2001). Qual è Takete? Qual è Maluma? La psicolinguistica applicata alla comunicazione pubblicitaria [What is Takete? What is Maluma? Psycholinguistics applied to advertising] (2nd ed.). Milan: Franco Angeli.
- Berlin, B. (1994). Evidence for pervasive synthetic sound symbolism in ethnozoological nomenclature. In L. Hinton, J. Nicholls, & J. J. Ohala (Eds.), Sound symbolism (pp. 76–93). New York: Cambridge University Press.
- Gal, D., Wheeler, S. C., & Shiv, B. (2011). Cross-modal influences on gustatory perception. Manuscript submitted for publication. Available at http://ssrn.com/abstract=1030197
- Hinton, L., Nichols, J., & Ohala, J. J. (Eds.). (1994). Sound symbolism. Cambridge: Cambridge University Press.
- Jespersen, O. (1922). The symbolic value of the vowel i. Philologica, 1, 1–19.
- Köhler, W. (1929). Gestalt psychology. New York: Liveright.
- Kusnir, F., & Thut, G. (2010, June). When letters evoke colours: Probing for induction of synaesthetic behaviour in non-synaesthetes through explicit versus implicit grapheme–colour associations. Poster presented at the 11th International Multisensory Research Forum meeting, Liverpool, U.K.
- Maurer, D., & Mondloch, C. J. (2005). Neonatal synaesthesia: A reevaluation. In L. C. Robertson & N. Sagiv (Eds.), Synaesthesia: Perspectives from cognitive neuroscience (pp. 193–213). Oxford: Oxford University Press.
- Pan, J.-Y., Yang, H.-J., Faloutsos, C., & Duygulu, P. (2004). Automatic multimedia crossmodal correlation discovery. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 653–658). Seattle: ACM Press.
- Piesse, C. H. (1891). Piesse’s art of perfumery (5th ed.). London: Piesse and Lubin.
- Plato. (1961). In E. Hamilton & H. Cairns (Eds.), The collected dialogues. New York: Pantheon.
- Simner, J., & Ludwig, V. (2009). What colour does that feel? Cross-modal correspondences from touch to colour. Paper presented at the Third International Conference of Synaesthesia and Art, Granada, Spain, April.
- Spence, C. (2010). The color of wine—Part 1. The World of Fine Wine, 28, 122–129.
- Stumpf, K. (1883). Tonpsychologie I [Psychology of the tone]. Leipzig: Hirzel.
Cited by
Sorted by citations
Arbitrariness, iconicity, and systematicity in language
Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.013 · Cited by 494
Store Atmospherics: A Multisensory Perspective
Spence, C. J., Puccinelli, N. M., Grewal, D., & Roggeveen, A. L. (2014) · Psychology and Marketing · doi:10.1002/mar.20709 · Cited by 667
Self-citationDigital Sensory Marketing: Integrating New Technologies into Multisensory Online Experience
Petit, O., Velasco, C., & Spence, C. J. (2018) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2018.07.004 · Cited by 587
Self-citationSpence, C. J. (2011) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.09.004 · Cited by 435
Self-citationMusic–color associations are mediated by emotion
Palmer, S. E., Schloss, K. B., Xu, Z., & Prado-León, L. R. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212562110 · Cited by 434
Metadata
- Authors
- Spence, C.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Spence, Charles
- ORCID
- Spence, Charles
- Venue
- Attention, Perception, & Psychophysics
- Published
- 2011-01-19
- Volume
- 73
- Issue
- 4
- Pages
- 971-995
- ISSN
- 1943-3921 (ISSN-L)
- 1943-393X
- OpenAlex
- W2010927954
- Cited by
- 1,618
- References
- 254
- Citations by year
- 2026: 144 · 2025: 121 · 2024: 128 · 2023: 139 · 2022: 109 · 2021: 124 · 2020: 125 · 2019: 160 · 2018: 123 · 2017: 98 · 2016: 79 · 2015: 95 · 2014: 65 · 2013: 58 · 2012: 33
- FWCI
- 7.16
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Attention Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- cross-modal correspondence, multisensory integration, auditory-visual correspondence, semantic congruence, perceptual binding, feature binding
- MeSH terms
- Association, Attention, Auditory Perception, Bayes Theorem, Discrimination, Psychological, Humans, Psychophysics, Research, Symbolism, Time Perception, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review