The DOI matches its Crossref record; 253 of the 254 references it cites were found in a registry or an index.
Crossmodal correspondences: A tutorial review
Open accessAbstract
In many everyday situations, our senses are bombarded by many different unisensory signals at any given time. To gain the most veridical, and least variable, estimate of environmental stimuli/properties, we need to combine the individual noisy unisensory perceptual estimates that refer to the same object, while keeping those estimates belonging to different objects or events separate. How, though, does the brain "know" which stimuli to combine? Traditionally, researchers interested in the crossmodal binding problem have focused on the roles that spatial and temporal factors play in modulating multisensory integration. However, crossmodal correspondences between various unisensory features (such as between auditory pitch and visual size) may provide yet another important means of constraining the crossmodal binding problem. A large body of research now shows that people exhibit consistent crossmodal correspondences between many stimulus features in different sensory modalities. For example, people consistently match high-pitched sounds with small, bright objects that are located high up in space. The literature reviewed here supports the view that crossmodal correspondences need to be considered alongside semantic and spatiotemporal congruency, among the key constraints that help our brains solve the crossmodal binding problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“According to Bayesian decision theory, the brain uses prior knowledge about what sensory signals go together-whether inborn or explicitly learned-to integrate appropriate sensory stimuli with the goal of maximising the reliability of perceived information [139-141] and, presumably, to reduce cognitive load by combining disparate sensory cues into a single object.”
From The Role of Intrinsic and Extrinsic Sensory Factors in Sweetness Perception of Food and Beverages: A Review (2019) · cites this paper as [141]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–253 of 253
Evidence of sound symbolism in simple vocalizations
Parise, C., & Pavani, F. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2836-3 · Cited by 61
Cross-modal effects on visual and auditory object perception
O’Leary, A., & Rhodes, G. (1984) · Perception & Psychophysics · doi:10.3758/bf03205954 · Cited by 61
Karwoski, T. F., & Odbert, H. S. (1938) · The Psychological Monographs · doi:10.1037/h0093458 · Cited by 60
The Impact of Spatial Incongruence on an Auditory-Visual Illusion
Innes-Brown, H., & Crewther, D. P. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006450 · Cited by 59
Stroop Interference Based on the Multimodal Correlates of Haptic Size and Auditory Pitch
Walker, P., & Smith, S. B. (1985) · Perception · doi:10.1068/p140729 · Cited by 58
Implications for phonetic symbolism: The relationship between pure tones and geometric figures
O’Boyle, M. W., & Tarte, R. D. (1980) · Journal of Psycholinguistic Research · doi:10.1007/bf01068115 · Cited by 54
Extraordinary Experiences during Cross-Modal Perception
Holt‐Hansen, K. (1976) · Perceptual and Motor Skills · doi:10.2466/pms.1976.43.3f.1023 · Cited by 52
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/1/008 · Cited by 52
Effects of separating auditory and visual sources on audiovisual integration of speech
Jones, J. A., & Munhall, K. G. (1997) · Canadian acoustics · Cited by 49
Age Differences in the Associations between Felt Temperatures and Color Choices
Morgan, G. A., Goodson, F. E., & Jones, T. M. (1975) · The American Journal of Psychology · doi:10.2307/1421671 · Cited by 49
Kelly, E. L. (1934) · Journal of Experimental Psychology · doi:10.1037/h0074963 · Cited by 48
(1989) · Springer eBooks · doi:10.1007/978-3-642-74382-5 · Cited by 47
Position, direction, and their perceptual integrality
Clark, H. H., & Brownell, H. (1976) · Perception & Psychophysics · doi:10.3758/bf03204238 · Cited by 47
von Hornbostel, E. M. (1938) · Kegan Paul, Trench, Trubner & Company eBooks · doi:10.1037/11496-017 · Cited by 47
Crossmodal congruency effects based on stimulus identity
Frings, C., & Spence, C. J. (2010) · Brain Research · doi:10.1016/j.brainres.2010.07.058 · Cited by 44
Self-citationTone-Taste Synesthesia: A Replication
Rudmin, F. W., & Cappelli, M. (1983) · Perceptual and Motor Skills · doi:10.2466/pms.1983.56.1.118 · Cited by 44
On the Functional Relations of the Sense Organs to One Another and to the Organism as a Whole
Börnstein, W. (1936) · The Journal of General Psychology · doi:10.1080/00221309.1936.9917907 · Cited by 40
The Relation between the Sound of a Word and Its Meaning
Wertheimer, M. (1958) · The American Journal of Psychology · doi:10.2307/1420089 · Cited by 40
Synaesthesia: learned or lost?
Kadosh, R. C., Henik, A., & Walsh, V. (2009) · Developmental Science · doi:10.1111/j.1467-7687.2008.00798.x · Cited by 39
Cross-modal associations and the human amygdala
Nahm, F., Tranel, D., Damásio, H., & Damásio, A. R. (1993) · Neuropsychologia · doi:10.1016/0028-3932(93)90125-j · Cited by 39
The meanings of the physiognomic stimuli taketa and maluma
Lindauer, M. S. (1990) · Bulletin of the Psychonomic Society · doi:10.3758/bf03337645 · Cited by 39
Representation of Complex Emotional and Abstract Meanings by Simple Forms
Lyman, B. (1979) · Perceptual and Motor Skills · doi:10.2466/pms.1979.49.3.839 · Cited by 38
Coward, S. W., & Stevens, C. (2004) · The Psychological Record · doi:10.1007/bf03395478 · Cited by 36
Equivalence of Brightnesses across Modalities
Cohen, N. E. (1934) · The American Journal of Psychology · doi:10.2307/1416240 · Cited by 36
Similarity relations among synesthetic stimuli and their attributes.
Melara, R. D. (1989) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.15.2.212 · Cited by 35
A Genetic Study of the Naming of Visual Figures
Irwin, F. W., & Newland, E. (1940) · The Journal of Psychology · doi:10.1080/00223980.1940.9917674 · Cited by 34
An investigation of phonetic symbolism in different cultures
Gebels, G. (1969) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(69)80083-6 · Cited by 32
On cross-modal similarity: Perceiving temporal patterns by hearing, touch, and vision
Marks, L. E. (1987) · Perception & Psychophysics · doi:10.3758/bf03203076 · Cited by 31
The Philosophy and Psychology of Sensation
Koffka, K., & Hartshorne, C. S. (1935) · The American Journal of Psychology · doi:10.2307/1416027 · Cited by 31
The Philosophy and Psychology of Sensation
Hartshorne, C. H. (1935) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-193505000-00055 · Cited by 31
Similarity relations among synesthetic stimuli and their attributes.
Melara, R. D. (1989) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.15.2.212 · Cited by 30
Sounds Move a Static Visual Object
Teramoto, W., Hidaka, S., & Sugita, Y. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012255 · Cited by 29
No effect of synesthetic congruency on temporal ventriloquism
Keetels, M., & Vroomen, J. (2010) · Attention Perception & Psychophysics · doi:10.3758/s13414-010-0019-0 · Cited by 26
An Experimental Study of Naming
Fox, C. W. (1935) · The American Journal of Psychology · doi:10.2307/1416003 · Cited by 26
An experimental study of the pairing of certain auditory and visual stimuli.
Cowles, J. T. (1935) · Journal of Experimental Psychology · doi:10.1037/h0062202 · Cited by 25
Hue-Tone Sensory Interaction: A Negative Result
Bernstein, I. H., Eason, T. R., & Schurman, D. L. (1971) · Perceptual and Motor Skills · doi:10.2466/pms.1971.33.3f.1327 · Cited by 23
Miller, A., Werner, H., & Wapner, S. (1958) · The Journal of Psychology · doi:10.1080/00223980.1958.9916273 · Cited by 21
Marks, L. E. (2004) · American Psychological Association eBooks · doi:10.1037/10371-004 · Cited by 21
Root, R., & Ross, S. (1965) · The American Journal of Psychology · doi:10.2307/1420502 · Cited by 20
The Philosophy and Psychology of Sensation.
M., A. E., & Hartshorne, C. H. (1934) · The Journal of Philosophy · doi:10.2307/2015621 · Cited by 17
Marks, L. E. (1984) · Advances in psychology · doi:10.1016/s0166-4115(08)62362-6 · Cited by 16
Solving the Correspondence Problem in Haptic/Multisensory Interface Design
Spence, C. J., Mary, K., Lee, J.-H., & Hong, T. (2010) · InTech eBooks · doi:10.5772/8694 · Cited by 13
Self-citationSound-shape congruency affects the multisensory response enhancement
Makovac, E., & Gerbino, W. (2010) · ArTS Archivio della ricerca di Trieste (University of Trieste https://www.units.it/) · Cited by 13
Contextual Assimilation and Its Effect on the Division of Attention between Nonverbal Signals
Long, J. B. (1977) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640747708400617 · Cited by 12
For Hedgehogs and Foxes: Individual Differences in the Perception of Cross-Modal Similarity
Marks, L. E. (1989) · Springer eBooks · doi:10.1007/978-3-642-74382-5_5 · Cited by 11
The Philosophy and Psychology of Sensation.
Marhenke, P., & Hartshorne, C. H. (1937) · The Philosophical Review · doi:10.2307/2180744 · Cited by 9
Cross-modal interactions: lessons from synesthesia
(16037513), N. S., & (4460812), J. W. (2006) · Figshare · Cited by 9
[Experimental research on the intermodal relationships between expressive qualities].
Bozzi, P., & Gb, F. D. (1968) · PubMed · Cited by 8
PERCEIVING AND THINKING: THEIR INTERRELATIONSHIP AND ORGANISMIC ORGANIZATION*
Boernstein, W. S. (1970) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1970.tb27008.x · Cited by 7
The Effect of Tone Frequency on Successive Comparison of Brightness
Kuze, J. (1995) · Psychologica · Cited by 4
Shape-color synesthesia in the first year of life: A normal stage of visual development?
Wagner, K., & Dobkins, K. R. (2010) · Journal of Vision · doi:10.1167/9.8.699 · Cited by 4
The brightness-weight illusion : darker objects look heavier but feel lighter
Walker, P., Francis, B. J., & Walker, L. (2010) · Lancaster EPrints (Lancaster University) · Cited by 4
Multisensory object perception in the primate brain
Naumer, M. J. (2010) · Cited by 4
Research works printed but not linked: 15
- Bedford, F. L. (2001). Towards a general law of numerical/object identity. Cahiers de Psychologie Cognitive, 20, 113–175.
- Belli, F., & Sagrillo, F. (2001). Qual è Takete? Qual è Maluma? La psicolinguistica applicata alla comunicazione pubblicitaria [What is Takete? What is Maluma? Psycholinguistics applied to advertising] (2nd ed.). Milan: Franco Angeli.
- Berlin, B. (1994). Evidence for pervasive synthetic sound symbolism in ethnozoological nomenclature. In L. Hinton, J. Nicholls, & J. J. Ohala (Eds.), Sound symbolism (pp. 76–93). New York: Cambridge University Press.
- Gal, D., Wheeler, S. C., & Shiv, B. (2011). Cross-modal influences on gustatory perception. Manuscript submitted for publication. Available at http://ssrn.com/abstract=1030197
- Hinton, L., Nichols, J., & Ohala, J. J. (Eds.). (1994). Sound symbolism. Cambridge: Cambridge University Press.
- Jespersen, O. (1922). The symbolic value of the vowel i. Philologica, 1, 1–19.
- Köhler, W. (1929). Gestalt psychology. New York: Liveright.
- Kusnir, F., & Thut, G. (2010, June). When letters evoke colours: Probing for induction of synaesthetic behaviour in non-synaesthetes through explicit versus implicit grapheme–colour associations. Poster presented at the 11th International Multisensory Research Forum meeting, Liverpool, U.K.
- Maurer, D., & Mondloch, C. J. (2005). Neonatal synaesthesia: A reevaluation. In L. C. Robertson & N. Sagiv (Eds.), Synaesthesia: Perspectives from cognitive neuroscience (pp. 193–213). Oxford: Oxford University Press.
- Pan, J.-Y., Yang, H.-J., Faloutsos, C., & Duygulu, P. (2004). Automatic multimedia crossmodal correlation discovery. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 653–658). Seattle: ACM Press.
- Piesse, C. H. (1891). Piesse’s art of perfumery (5th ed.). London: Piesse and Lubin.
- Plato. (1961). In E. Hamilton & H. Cairns (Eds.), The collected dialogues. New York: Pantheon.
- Simner, J., & Ludwig, V. (2009). What colour does that feel? Cross-modal correspondences from touch to colour. Paper presented at the Third International Conference of Synaesthesia and Art, Granada, Spain, April.
- Spence, C. (2010). The color of wine—Part 1. The World of Fine Wine, 28, 122–129.
- Stumpf, K. (1883). Tonpsychologie I [Psychology of the tone]. Leipzig: Hirzel.
Cited by
Sorted by citations
Arbitrariness, iconicity, and systematicity in language
Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.013 · Cited by 494
Store Atmospherics: A Multisensory Perspective
Spence, C. J., Puccinelli, N. M., Grewal, D., & Roggeveen, A. L. (2014) · Psychology and Marketing · doi:10.1002/mar.20709 · Cited by 667
Self-citationDigital Sensory Marketing: Integrating New Technologies into Multisensory Online Experience
Petit, O., Velasco, C., & Spence, C. J. (2018) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2018.07.004 · Cited by 587
Self-citationSpence, C. J. (2011) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.09.004 · Cited by 435
Self-citationMusic–color associations are mediated by emotion
Palmer, S. E., Schloss, K. B., Xu, Z., & Prado-León, L. R. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212562110 · Cited by 434
Metadata
- Authors
- Spence, C.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Spence, Charles
- ORCID
- Spence, Charles
- Venue
- Attention, Perception, & Psychophysics
- Published
- 2011-01-19
- Volume
- 73
- Issue
- 4
- Pages
- 971-995
- ISSN
- 1943-3921 (ISSN-L)
- 1943-393X
- OpenAlex
- W2010927954
- Cited by
- 1,618
- References
- 254
- Citations by year
- 2026: 144 · 2025: 121 · 2024: 128 · 2023: 139 · 2022: 109 · 2021: 124 · 2020: 125 · 2019: 160 · 2018: 123 · 2017: 98 · 2016: 79 · 2015: 95 · 2014: 65 · 2013: 58 · 2012: 33
- FWCI
- 7.16
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Attention Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- cross-modal correspondence, multisensory integration, auditory-visual correspondence, semantic congruence, perceptual binding, feature binding
- MeSH terms
- Association, Attention, Auditory Perception, Bayes Theorem, Discrimination, Psychological, Humans, Psychophysics, Research, Symbolism, Time Perception, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review