On cross-modal similarity: Auditory-visual interactions in speeded discrimination.
Abstract
A series of four experiments explored how cross-modal similarities between sensory attributes in vision and hearing reveal themselves in speeded, two-stimulus discrimination. When subjects responded differentially to stimuli on one modality, speed and accuracy of response were greater on trials accompanied by informationally irrelevant "matching" versus "mismatching" stimuli from the other modality. Cross-modal interactions appeared in (a) responses to dim/bright lights and to dark/light colors accompanied by low-pitched/high-pitched tones; (b) responses to low-pitched/high-pitched tones accompanied by dim/bright lights or by dark/light colors; (c) responses to dim/bright lights, but not to dark/light colors, accompanied by soft/loud sounds; and (d) responses to rounded/sharp forms accompanied by low-pitched/high-pitched tones. These results concur with findings on cross-modal perception, synesthesia, and synesthetic metaphor, which reveal similarities between pitch and brightness, pitch and lightness, loudness and brightness, and pitch and form. The cross-modal interactions in response speed and accuracy may take place at a sensory/perceptual level of processing or after sensory stimuli are encoded semantically.
Cites (22)
- The Measurement of MeaningCharles E. Osgood, George J. Suci, Percy H. Tannenbaum · 1957
- The Senses Considered as Perceptual SystemsWest, Charles K., Gibson, James J. · 1969 · Journal of Aesthetic Education
- The Psychophysics of Sensory FunctionStevens, S. S. · 2012 · Sensory Communication
- On colored-hearing synesthesia: Cross-modal translations of sensory dimensions.Lawrence E. Marks · 1975 · Psychological Bulletin
- The Unity of the Senses: Interrelations Among the ModalitiesLawrence E. Marks · 1978
- Cross-modal equivalence in early infancy: Auditory-visual intensity matching.Lewkowicz, David J., Turkewitz, Gerald · 1980 · Developmental Psychology
- On Associations of Light and Sound: The Mediation of Brightness, Pitch, and LoudnessMarks, Lawrence E. · 1974 · The American Journal of Psychology
- Cross-modality validation of subjective scales for loudness, vibration, and electric shock.S. S. Stevens · 1959 · Journal of Experimental Psychology
- Toward a translational model of Stroop interferenceVirzi, Robert A., Egeth, Howard E. · 1985 · Memory & Cognition
- Cross-modality matching of brightness and loudness.Stevens, J C, Marks, L E · 1965 · Proceedings of the National Academy of Sciences
Cited by (17)
- Dimensional overlap: cognitive basis for stimulus-response compatibility-a model and taxonomyKornblum, Sylvan, Hasbroucq, Thierry, Osman, Allen · 1990 · Psychological Review
- Crossmodal correspondences: A tutorial reviewSpence, Charles · 2011 · Attention, Perception, & Psychophysics
- The role of similarity in categorization: providing a groundworkGoldstone, Robert L. · 1994 · Cognition
- Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All?WARD, J, HUCKSTEP, B, TSAKANIKOS, E · 2006 · Cortex
- Music–color associations are mediated by emotionPalmer, Stephen E., Schloss, Karen B., Xu, Zoe, Prado-León, Lilia R. · 2013 · Proceedings of the National Academy of Sciences
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On cross-modal similarity: Auditory-visual interactions in speeded discrimination. https://app.cochat.ai/papers/10.1037//0096-1523.13.3.384
- The paper
- Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance. https://doi.org/10.1037//0096-1523.13.3.384
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.