The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Multimodal mental imagery
Open accessAbstract
When I am looking at my coffee machine that makes funny noises, this is an instance of multisensory perception - I perceive this event by means of both vision and audition. But very often we only receive sensory stimulation from a multisensory event by means of one sense modality, for example, when I hear the noisy coffee machine in the next room, that is, without seeing it. The aim of this paper is to bring together empirical findings about multimodal perception and empirical findings about (visual, auditory, tactile) mental imagery and argue that on occasions like this, we have multimodal mental imagery: perceptual processing in one sense modality (here: vision) that is triggered by sensory stimulation in another sense modality (here: audition). Multimodal mental imagery is not a rare and obscure phenomenon. The vast majority of what we perceive are multisensory events: events that can be perceived in more than one sense modality - like the noisy coffee machine. And most of the time we are only acquainted with these multisensory events via a subset of the sense modalities involved - all the other aspects of these multisensory events are represented by means of multisensory mental imagery. This means that multisensory mental imagery is a crucial element of almost all instances of everyday perception.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryle, G. (2006) · Theories of Mind · doi:10.5040/9798216413257.ch-2 · Cited by 6,809
Implicit social cognition: Attitudes, self-esteem, and stereotypes
Greenwald, A. G., & Banaji, M. R. (1995) · Psychological Review · doi:10.1037/0033-295x.102.1.4 · Cited by 6,682
Mental Rotation of Three-Dimensional Objects
Shepard, R. N., & Metzler, J. (1971) · Science · doi:10.1126/science.171.3972.701 · Cited by 6,246
Mental Representations: A Dual Coding Approach
Paivio, A. (1986) · Medical Entomology and Zoology · Cited by 5,087
Paivio, A. (2013) · Psychology Press eBooks · doi:10.4324/9781315798868 · Cited by 4,142
Mezei, A., & Paivio, A. (1972) · Leonardo · doi:10.2307/1572599 · Cited by 3,246
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
Mental imagery in associative learning and memory.
Paivio, A. (1969) · Psychological Review · doi:10.1037/h0027272 · Cited by 1,358
Shams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262
Cognition does not affect perception: Evaluating the evidence for “top-down” effects
Firestone, C., & Scholl, B. J. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15000965 · Cited by 1,200
Grill-Spector, K., & Malach, R. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144220 · Cited by 1,184
Pryor, J. (2000) · Noûs · doi:10.1111/0029-4624.00277 · Cited by 1,127
Mental Imagery: Functional Mechanisms and Clinical Applications
Pearson, J., Naselaris, T., Holmes, E. A., & Kosslyn, S. M. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.08.003 · Cited by 1,087
Activation of Auditory Cortex During Silent Lipreading
Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997) · Science · doi:10.1126/science.276.5312.593 · Cited by 1,025
Putting yourself in the skin of a black avatar reduces implicit racial bias
Peck, T. C., Seinfeld, S., Aglioti, S. M., & Slater, M. (2013) · Consciousness and Cognition · doi:10.1016/j.concog.2013.04.016 · Cited by 967
Mimesis as Make-Believe: On the Foundations of the Representational Arts
Howard, V. A., & Binghamton University State University of New York (1993) · International Studies in Philosophy · doi:10.5840/intstudphil1993251117 · Cited by 861
Sensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858
Crossmodal Space and Crossmodal Attention
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.001.0001 · Cited by 791
Skepticism and the Veil of Perception
Huemer, M. (2001) · Rowman & Littlefield Publishers eBooks · doi:10.5040/9798216401605 · Cited by 768
Kosslyn, S. M. (1990) · Cited by 715
Topographical representations of mental images in primary visual cortex
Kosslyn, S. M., Thompson, W. L., Klm, I. J., & Alpert, N. M. (1995) · Nature · doi:10.1038/378496a0 · Cited by 701
Sound alters visual motion perception
Sekuler, R., Sekuler, A. B., & Lau, R. (1997) · Nature · doi:10.1038/385308a0 · Cited by 685
Lives without imagery – Congenital aphantasia
Zeman, A., Dewar, M., & Della Sala, S. (2015) · Cortex · doi:10.1016/j.cortex.2015.05.019 · Cited by 621
Involvement of visual cortex in tactile discrimination of orientation
Zangaladze, A., Epstein, C. M., Grafton, S. T., & Sathian, K. (1999) · Nature · doi:10.1038/44139 · Cited by 508
Carroll, N., & Walton, K. L. (1995) · The Philosophical Quarterly · doi:10.2307/2219853 · Cited by 486
The Routledge Handbook of Philosophy of Imagination
(2016) · Routledge eBooks · doi:10.4324/9781315657905 · Cited by 483
Vividness of mental imagery: Individual variability can be measured objectively
Cui, X., Jeter, C. B., Yang, D., Montague, P. R., & Eagleman, D. M. (2007) · Vision Research · doi:10.1016/j.visres.2006.11.013 · Cited by 478
Cognitive Penetration of Colour Experience: Rethinking the Issue in Light of an Indirect Mechanism
MACPHERSON, F. (2012) · Philosophy and Phenomenological Research · doi:10.1111/j.1933-1592.2010.00481.x · Cited by 461
Visual mental imagery induces retinotopically organized activation of early visual areas
Slotnick, S. D., Thompson, W. L., & Kosslyn, S. M. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi035 · Cited by 458
Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All?
WARD, J., HUCKSTEP, B., & TSAKANIKOS, E. (2006) · Cortex · doi:10.1016/s0010-9452(08)70352-6 · Cited by 435
Mental Concerts: Musical Imagery and Auditory Cortex
Zatorre, R. J., & Halpern, A. R. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.013 · Cited by 420
Haptic study of three-dimensional objects activates extrastriate visual areas
James, T. W., Humphrey, G. K., Gati, J. S., Servos, P., Menon, R. S., & Goodale, M. A. (2002) · Neuropsychologia · doi:10.1016/s0028-3932(02)00017-9 · Cited by 418
Sound-Driven Synaptic Inhibition in Primary Visual Cortex
Iurilli, G., Ghezzi, D., Olcese, U., Lassi, G., Nazzaro, C., Tonini, R., Tucci, V., Benfenati, F., & Medini, P. (2012) · Neuron · doi:10.1016/j.neuron.2011.12.026 · Cited by 415
The functional impact of mental imagery on conscious perception
Pearson, J., Clifford, C. W. G., & Tong, F. (2008) · Current Biology · doi:10.1016/j.cub.2008.05.048 · Cited by 409
The development of implicit intergroup cognition
Dunham, Y., Baron, A. S., & Banaji, M. R. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.04.006 · Cited by 390
Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words
Nunn, J. A., Gregory, L. J., Brammer, M., Williams, S. C. R., Parslow, D. M., Morgan, M. J., Morris, R. G., Bullmore, E. T., Baron-Cohen, S., & Gray, J. A. (2002) · Nature Neuroscience · doi:10.1038/nn818 · Cited by 364
Attention without awareness in blindsight
Kentridge, R. W., Heywood, C. A., & Weiskrantz, L. (1999) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1999.0850 · Cited by 362
(2019) · Perspectives on Moral Responsibility · doi:10.7591/9781501721564-002 · Cited by 361
Individual Differences among Grapheme-Color Synesthetes: Brain-Behavior Correlations
Hubbard, E. M., Arman, A. C., Ramachandran, V. S., & Boynton, G. M. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.008 · Cited by 355
Sound alters activity in human V1 in association with illusory visual perception
Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D., & Rees, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.016 · Cited by 343
Tonotopic Organization in Human Auditory Cortex Revealed by Progressions of Frequency Sensitivity
Talavage, T. M., Sereno, M. I., Melcher, J. R., Ledden, P. J., Rosen, B. R., & Dale, A. M. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01125.2002 · Cited by 341
James, E. L., Bonsall, M. B., Hoppitt, L., Tunbridge, E. M., Geddes, J. R., Milton, A. L., & Holmes, E. A. (2015) · Psychological Science · doi:10.1177/0956797615583071 · Cited by 333
Perception and imagination: amodal perception as mental imagery
Nanay, B. (2010) · Philosophical Studies · doi:10.1007/s11098-009-9407-5 · Cited by 325
Self-citationPrimary auditory cortex activation by visual speech: an fMRI study at 3???T
Pekkola, J., Ojanen, V., Autti, T., J????skel??inen, I. P., M??tt??nen, R., Tarkiainen, A., & Sams, M. (2005) · NeuroReport · doi:10.1097/00001756-200502080-00010 · Cited by 306
Neural Plasticity and Consciousness
Hurley, S., & Noë, A. (2003) · Biology and Philosophy · doi:10.1023/a:1023308401356 · Cited by 304
The cognitive neuroscience of mental imagery
Kosslyn, S. M., Behrmann, M., & Jeannerod, M. (1995) · Neuropsychologia · doi:10.1016/0028-3932(95)00067-d · Cited by 285
Multisensory Interactions within Human Primary Cortices Revealed by BOLD Dynamics
Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J.-P., Maeder, P. P., Clarke, S., & Meuli, R. A. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl077 · Cited by 285
The Psychology of Multimodal Perception
BERTELSON, P., & GELDER, B. D. (2004) · Crossmodal Space and Crossmodal Attention · doi:10.1093/acprof:oso/9780198524861.003.0007 · Cited by 284
Neuronal Correlates of Perception, Imagery, and Memory for Familiar Tunes
Herholz, S. C., Halpern, A. R., & Zatorre, R. J. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00216 · Cited by 274
Holmes, E. A., James, E. L., Kilford, E. J., & Deeprose, C. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013706 · Cited by 273
Zeman, A. Z. J., Della Sala, S., Torrens, L. A., Gountouna, V.-E., McGonigle, D. J., & Logie, R. H. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.08.024 · Cited by 273
Cognitive Penetrability and Perceptual Justification*
Siegel, S. (2012) · Noûs · doi:10.1111/j.1468-0068.2010.00786.x · Cited by 260
Cognitive Contributions to the Perception of Spatial and Temporal Events
(1999) · Advances in Psychology · doi:10.1016/s0166-4115(99)x8001-0 · Cited by 259
Brain Plasticity: ‘Visual’ Acuity of Blind Persons via the Tongue
Sampaio, E., Maris, S., & Bach-y-Rita, P. (2001) · Brain Research · doi:10.1016/s0006-8993(01)02667-1 · Cited by 258
Cornil, Y., & Chandon, P. (2016) · Journal of Marketing Research · doi:10.1509/jmr.14.0299 · Cited by 257
Olfactomotor activity during imagery mimics that during perception
Bensafi, M., Porter, J., Pouliot, S., Mainland, J., Johnson, B., Zelano, C., Young, N., Bremner, E., Aframian, D., Khan, R., et al. (2003) · Nature Neuroscience · doi:10.1038/nn1145 · Cited by 240
Lexical-gustatory synaesthesia: linguistic and conceptual factors
Ward, J., & Simner, J. (2003) · Cognition · doi:10.1016/s0010-0277(03)00122-7 · Cited by 224
Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping
Bertelson, P. (1999) · Advances in Psychology · doi:10.1016/s0166-4115(99)80034-x · Cited by 203
Organization of visual areas in macaque and human cerebral cortex
Essen, D. C. V. (2003) · Medical Entomology and Zoology · Cited by 202
Attention and perceptual content
Nanay, B. (2010) · Analysis · doi:10.1093/analys/anp165 · Cited by 196
Self-citationWilliams, A. D., Blackwell, S. E., Mackenzie, A., Holmes, E. A., & Andrews, G. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033247 · Cited by 195
Optimism and mental imagery: A possible cognitive marker to promote well-being?
Blackwell, S. E., Rius-Ottenheim, N., Schulte-van Maaren, Y. W. M., Carlier, I. V. E., Middelkoop, V. D., Zitman, F. G., Spinhoven, P., Holmes, E. A., & Giltay, E. J. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2012.09.047 · Cited by 193
“Top-Down” Effects Where None Should Be Found: The El Greco Fallacy in Perception Research
Firestone, C., & Scholl, B. J. (2014) · Psychological Science · doi:10.1177/0956797613485092 · Cited by 183
Smaller Primary Visual Cortex Is Associated with Stronger, but Less Precise Mental Imagery
Bergmann, J., Genç, E., Kohler, A., Singer, W., & Pearson, J. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv186 · Cited by 177
Phantom perception: voluntary and involuntary nonretinal vision
Pearson, J., & Westbrook, F. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.004 · Cited by 161
Perceptual content and the content of mental imagery
Nanay, B. (2015) · Philosophical Studies · doi:10.1007/s11098-014-0392-y · Cited by 160
Self-citationRatner, K. G., Dotsch, R., Wigboldus, D. H. J., van Knippenberg, A., & Amodio, D. M. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0036498 · Cited by 144
What colour does that feel? Tactile–visual mapping and the development of cross-modality
Ludwig, V. U., & Simner, J. (2012) · Cortex · doi:10.1016/j.cortex.2012.04.004 · Cited by 144
Perceiving and desiring: a new look at the cognitive penetrability of experience
Stokes, D. (2011) · Philosophical Studies · doi:10.1007/s11098-010-9688-8 · Cited by 144
Object Perception: Vision and Audition
O’Callaghan, C. (2008) · Philosophy Compass · doi:10.1111/j.1747-9991.2008.00145.x · Cited by 133
SEEING WHAT YOU HEAR: CROSS‐MODAL ILLUSIONS AND PERCEPTION
O’Callaghan, C. (2008) · Philosophical Issues · doi:10.1111/j.1533-6077.2008.00150.x · Cited by 130
Vivid visual mental imagery in the absence of the primary visual cortex
Bridge, H., Harrold, S., Holmes, E. A., Stokes, M. G., & Kennard, C. (2011) · Journal of Neurology · doi:10.1007/s00415-011-6299-z · Cited by 126
Nánay, B. (2016) · PhilPapers (PhilPapers Foundation) · doi:10.4324/9781315657905.ch9 · Cited by 122
Hallucination as mental imagery
Nánay, B. (2016) · PhilPapers (PhilPapers Foundation) · Cited by 118
Visual Imagery as the Simulation of Vision
Currie, G. (1995) · Mind & Language · doi:10.1111/j.1468-0017.1995.tb00004.x · Cited by 117
Beyond visual imagery: How modality-specific is enhanced mental imagery in synesthesia?
Spiller, M. J., Jonas, C. N., Simner, J., & Jansari, A. S. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.10.010 · Cited by 106
Intrusive memories to traumatic footage: the neural basis of their encoding and involuntary recall
Clark, I. A., Holmes, E. A., Woolrich, M. W., & Mackay, C. E. (2016) · Psychological Medicine · doi:10.1017/s0033291715002007 · Cited by 100
Sensory Substitution and Multimodal Mental Imagery
Nánay, B. (2017) · Perception · doi:10.1177/0301006617699225 · Cited by 100
Phillips, I. B. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137286734_14 · Cited by 97
How to (and how not to) think about top-down influences on visual perception
Teufel, C., & Nánay, B. (2016) · Consciousness and Cognition · doi:10.1016/j.concog.2016.05.008 · Cited by 91
ERP evidence of visualization at early stages of visual processing
Page, J. W., Duhamel, P., & Crognale, M. A. (2010) · Brain and Cognition · doi:10.1016/j.bandc.2010.11.001 · Cited by 88
Top-down influence on the visual cortex of the blind during sensory substitution
Murphy, M. C., Nau, A. C., Fisher, C., Kim, S.-G., Schuman, J. S., & Chan, K. C. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.11.021 · Cited by 82
Murphy, S. E., O'Donoghue, M. C., Drazich, E., Blackwell, S. E., Nobre, A. C., & Holmes, E. A. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.07.059 · Cited by 81
Sensory Integration and the Unity of Consciousness
(2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262027786.001.0001 · Cited by 78
Berna, C., Tracey, I., & Holmes, E. A. (2012) · Journal of Experimental Psychopathology · doi:10.5127/jep.017911 · Cited by 77
Hertrich, I., Dietrich, S., & Ackermann, H. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21421 · Cited by 75
Visual cortical networks: of mice and men
Katzner, S., & Weigelt, S. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.019 · Cited by 70
The neural basis of illusory gustatory sensations: Two rare cases of lexical–gustatory synaesthesia
Jones, C. L., Gray, M. A., Minati, L., Simner, J., Critchley, H., & Ward, J. (2011) · Journal of Neuropsychology · doi:10.1111/j.1748-6653.2011.02013.x · Cited by 70
Slofstra, C., Nauta, M. H., Holmes, E. A., & Bockting, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160235 · Cited by 70
The cross-modal double flash illusion depends on featural similarity between cross-modal inducers
Roseboom, W., Kawabe, T., & Nishida, S. (2013) · Scientific Reports · doi:10.1038/srep03437 · Cited by 68
Nánay, B. (2017) · The Monist · doi:10.1093/monist/onx024 · Cited by 52
The Hidden Image: A Defense of Unconscious Imagining and Its Importance
Church, J. (2008) · American imago · doi:10.1353/aim.0.0024 · Cited by 48
The automaticity of vantage point shifts within a synaesthetes’ spatial calendar
Jarick, M., Jensen, C., Dixon, M. J., et al. (2011) · Journal of Neuropsychology · doi:10.1111/j.1748-6653.2011.02011.x · Cited by 47
Grounding desire and motivated behavior: a theoretical framework and empirical evidence
Papies, E. K., & Barsalou, L. W. (2015) · Cited by 46
O’Callaghan, C. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262027786.003.0004 · Cited by 36
Ventriloquism: A case of crossmodal perceptual grouping
Bertelson, P., Ascherleben, G., Bachmann, T., & Müssler, J. (1999) · Research portal (Tilburg University) · Cited by 32
Cited by
Aphantasia and autism: An investigation of mental imagery vividness
King, R., Buxton, H., & Tyndall, I. (2024) · Consciousness and Cognition · doi:10.1016/j.concog.2024.103749 · Cited by 23
Metadata
- Authors
- Nanay, B.
- Venue
- Cortex
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 105
- Pages
- 125-134
- ISSN
- 0010-9452 (ISSN-L)
- OpenAlex
- W2736142580
- Cited by
- 299
- References
- 96
- FWCI
- 20.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.