On cross-modal similarity: Auditory-visual interactions in speeded discrimination.

Marks, Lawrence E.·1987·Journal of Experimental Psychology: Human Perception and Performance

Abstract

A series of four experiments explored how cross-modal similarities between sensory attributes in vision and hearing reveal themselves in speeded, two-stimulus discrimination. When subjects responded differentially to stimuli on one modality, speed and accuracy of response were greater on trials accompanied by informationally irrelevant "matching" versus "mismatching" stimuli from the other modality. Cross-modal interactions appeared in (a) responses to dim/bright lights and to dark/light colors accompanied by low-pitched/high-pitched tones; (b) responses to low-pitched/high-pitched tones accompanied by dim/bright lights or by dark/light colors; (c) responses to dim/bright lights, but not to dark/light colors, accompanied by soft/loud sounds; and (d) responses to rounded/sharp forms accompanied by low-pitched/high-pitched tones. These results concur with findings on cross-modal perception, synesthesia, and synesthetic metaphor, which reveal similarities between pitch and brightness, pitch and lightness, loudness and brightness, and pitch and form. The cross-modal interactions in response speed and accuracy may take place at a sensory/perceptual level of processing or after sensory stimuli are encoded semantically.

Cites (22)

  1. The Measurement of Meaning
    Charles E. Osgood, George J. Suci, Percy H. Tannenbaum · 1957
  2. The Senses Considered as Perceptual Systems
    West, Charles K., Gibson, James J. · 1969 · Journal of Aesthetic Education
  3. The Psychophysics of Sensory Function
    Stevens, S. S. · 2012 · Sensory Communication
  4. On colored-hearing synesthesia: Cross-modal translations of sensory dimensions.
    Lawrence E. Marks · 1975 · Psychological Bulletin
  5. The Unity of the Senses: Interrelations Among the Modalities
    Lawrence E. Marks · 1978
  6. Cross-modal equivalence in early infancy: Auditory-visual intensity matching.
    Lewkowicz, David J., Turkewitz, Gerald · 1980 · Developmental Psychology
  7. On Associations of Light and Sound: The Mediation of Brightness, Pitch, and Loudness
    Marks, Lawrence E. · 1974 · The American Journal of Psychology
  8. Cross-modality validation of subjective scales for loudness, vibration, and electric shock.
    S. S. Stevens · 1959 · Journal of Experimental Psychology
  9. Toward a translational model of Stroop interference
    Virzi, Robert A., Egeth, Howard E. · 1985 · Memory & Cognition
  10. Cross-modality matching of brightness and loudness.
    Stevens, J C, Marks, L E · 1965 · Proceedings of the National Academy of Sciences

Show all 22 references

Cited by (17)

  1. Dimensional overlap: cognitive basis for stimulus-response compatibility-a model and taxonomy
    Kornblum, Sylvan, Hasbroucq, Thierry, Osman, Allen · 1990 · Psychological Review
  2. Crossmodal correspondences: A tutorial review
    Spence, Charles · 2011 · Attention, Perception, & Psychophysics
  3. The role of similarity in categorization: providing a groundwork
    Goldstone, Robert L. · 1994 · Cognition
  4. Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All?
    WARD, J, HUCKSTEP, B, TSAKANIKOS, E · 2006 · Cortex
  5. Music–color associations are mediated by emotion
    Palmer, Stephen E., Schloss, Karen B., Xu, Zoe, Prado-León, Lilia R. · 2013 · Proceedings of the National Academy of Sciences

See all 362

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: On cross-modal similarity: Auditory-visual interactions in speeded discrimination. https://app.cochat.ai/papers/10.1037//0096-1523.13.3.384
The paper
Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance. https://doi.org/10.1037//0096-1523.13.3.384

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.