Multisensory constraints on awareness
Open accessAbstract
Given that multiple senses are often stimulated at the same time, perceptual awareness is most likely to take place in multisensory situations. However, theories of awareness are based on studies and models established for a single sense (mostly vision). Here, we consider the methodological and theoretical challenges raised by taking a multisensory perspective on perceptual awareness. First, we consider how well tasks designed to study unisensory awareness perform when used in multisensory settings, stressing that studies using binocular rivalry, bistable figure perception, continuous flash suppression, the attentional blink, repetition blindness and backward masking can demonstrate multisensory influences on unisensory awareness, but fall short of tackling multisensory awareness directly. Studies interested in the latter phenomenon rely on a method of subjective contrast and can, at best, delineate conditions under which individuals report experiencing a multisensory object or two unisensory objects. As there is not a perfect match between these conditions and those in which multisensory integration and binding occur, the link between awareness and binding advocated for visual information processing needs to be revised for multisensory cases. These challenges point at the need to question the very idea of multisensory awareness.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A holistic picture of perceptual representation cannot be constructed without understanding multisensory interactions.
“The literature on multimodal interactions (see e.g. Deroy, Chen & Spence, 2014; Driver & Spence, 2000; Koelewijn, Bronkhorst & Theeuwes, 2010; Kristjánsson, Thorvaldsson, & Kristjánsson, 2014; Stein & Meredith, 1993) makes clear that a holistic picture of perceptual representation cannot be constructed without understanding multisensory interactions.”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Deroy, Chen & Spence, 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Nagel, T. (1974) · The Philosophical Review · doi:10.2307/2183914 · Cited by 7,440 · see citing works
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · see citing works
Rubber hands ‘feel’ touch that eyes see
Botvinick, M., & Cohen, J. (1998) · Nature · doi:10.1038/35784 · Cited by 4,410 · see citing works
Temporary suppression of visual processing in an RSVP task: An attentional blink?
Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.18.3.849 · Cited by 2,276 · see citing works
Detecting awareness in the vegetative state
Owen, A. M., Coleman, M. R., Boly, M., Davis, M. H., Laureys, S., & Pickard, J. D. (2006) · Science · doi:10.1126/science.1130197 · Cited by 1,978 · see citing works
Merging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906 · see citing works
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,897 · see citing works
Features and Objects: The Fourteenth Bartlett Memorial Lecture
Treisman, A. (1988) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/02724988843000104 · Cited by 1,751 · see citing works
(1990) · CaltechAUTHORS (California Institute of Technology) · Cited by 1,661 · see citing works
Temporary suppression of visual processing in an RSVP task: an attentional blink?
Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.18.3.849 · Cited by 1,649 · see citing works
Temporal binding and the neural correlates of sensory awareness.
Engel, A. K., & Singer, W. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01568-0 · Cited by 1,372 · see citing works
Shams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262 · see citing works
Divided attention: Evidence for coactivation with redundant signals
Miller, J. O. (1982) · Cognitive Psychology · doi:10.1016/0010-0285(82)90010-x · Cited by 1,204 · see citing works
Treisman, A. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80070-5 · Cited by 1,157 · see citing works
Blake, R., & Logothetis, N. K. (2002) · Nature reviews. Neuroscience · doi:10.1038/nrn701 · Cited by 1,073 · see citing works
Continuous flash suppression reduces negative afterimages
Tsuchiya, N., & Christof Koch, A. (2005) · Nature Neuroscience · doi:10.1038/nn1500 · Cited by 978 · see citing works
(2004) · Medical Entomology and Zoology · Cited by 978 · see citing works
Self-citationActivity changes in early visual cortex reflect monkeys' percepts during binocular rivalry
Leopold, D., & Logothetis, N. (1996) · Nature · doi:10.1038/379549a0 · Cited by 961 · see citing works
The Handbook of Multisensory Processes
(2004) · doi:10.7551/mitpress/3422.001.0001 · Cited by 948 · see citing works
In the Theater of Consciousness
Baars, B. J. (1997) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195102659.001.1 · Cited by 878 · see citing works
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828 · see citing works
Levelt, W. J. M. (1968) · MPG.PuRe (Max Planck Society) · Cited by 809 · see citing works
Features and Objects in Visual Processing
Treisman, A. (1986) · Scientific American · doi:10.1038/scientificamerican1186-114b · Cited by 806 · see citing works
Feature binding, attention and object perception
Treisman, A. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0284 · Cited by 754 · see citing works
Helmholtz's treatise on physiological optics
Southall, J. P. C. (1924) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(24)90484-4 · Cited by 701 · see citing works
Perceptual consciousness overflows cognitive access
Block, N. J. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.001 · Cited by 699 · see citing works
Sound alters visual motion perception
Sekuler, R., Sekuler, A. B., & Lau, R. (1997) · Nature · doi:10.1038/385308a0 · Cited by 695 · see citing works
Neural bases of binocular rivalry
Tong, F., Meng, M., & Blake, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.09.003 · Cited by 689 · see citing works
The multisensory perception of flavor
Auvray, M., & Spence, C. (2008) · Consciousness and Cognition · doi:10.1016/j.concog.2007.06.005 · Cited by 685 · see citing works
Self-citationRepetition blindness: Type recognition without token individuation
Kanwisher, N. (1987) · Cognition · doi:10.1016/0010-0277(87)90016-3 · Cited by 678 · see citing works
Is perception discrete or continuous?
VanRullen, R., & Koch, C. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00095-0 · Cited by 662 · see citing works
Cortical responses to invisible objects in the human dorsal and ventral pathways
Fang, F., & He, S. (2005) · Nature Neuroscience · doi:10.1038/nn1537 · Cited by 479 · see citing works
In the theater of consciousness: the workspace of the mind
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0579 · Cited by 469 · see citing works
The Oxford Handbook of Perceptual Organization
Lier, R. J. V., Gerbino, W., & Wagemans, J. (2015) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199686858.001.0001 · Cited by 466 · see citing works
Involuntary orienting to sound improves visual perception
McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000) · Nature · doi:10.1038/35038085 · Cited by 464 · see citing works
Enhancement of visual perception by crossmodal visuo-auditory interaction
Frassinetti, F., Bolognini, N., & Làdavas, E. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1262-y · Cited by 448 · see citing works
Meng, M., & Tong, F. (2004) · Journal of Vision · doi:10.1167/4.7.2 · Cited by 417 · see citing works
The functional impact of mental imagery on conscious perception
Pearson, J., Clifford, C. W. G., & Tong, F. (2008) · Current Biology · doi:10.1016/j.cub.2008.05.048 · Cited by 409 · see citing works
Bayne, T. (2010) · doi:10.1093/acprof:oso/9780199215386.001.0001 · Cited by 402 · see citing works
Crossmodal binding through neural coherence: implications for multisensory processing
Senkowski, D., Schneider, T. R., Foxe, J. J., & Engel, A. K. (2008) · Trends in Neurosciences · doi:10.1016/j.tins.2008.05.002 · Cited by 383 · see citing works
Multisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383 · see citing works
The contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink
Shapiro, K. L., Martin, E., Arend, I. C., Johnston, S. J., & Klein, C. (2008) · Journal of Vision · doi:10.1167/8.6.1 · Cited by 368 · see citing works
Fetsch, C. R., DeAngelis, G. C., & Angelaki, D. E. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3503 · Cited by 304 · see citing works
Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. J. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 298 · see citing works
Self-citationUnifying multisensory signals across time and space
Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., & Schirillo, J. A. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1899-9 · Cited by 291 · see citing works
Spence, C. J., & Parise, C. (2009) · Consciousness and Cognition · doi:10.1016/j.concog.2009.12.001 · Cited by 279 · see citing works
Self-citationGallace, A., & Spence, C. J. (2014) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199644469.001.0001 · Cited by 269 · see citing works
Self-citationNeural events and perceptual awareness
Kanwisher, N. (2001) · Cognition · doi:10.1016/s0010-0277(00)00125-6 · Cited by 253 · see citing works
Multisensory Integration: Space, Time and Superadditivity
Holmes, N. P., & Spence, C. J. (2005) · Current Biology · doi:10.1016/j.cub.2005.08.058 · Cited by 253 · see citing works
Self-citationPriming from the Attentional Blink: A Failure to Extract Visual Tokens but Not Visual Types
Shapiro, K. L., Driver, J., Ward, R. D., & Sorensen, R. E. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00689.x · Cited by 232 · see citing works
Neural Synergy Between Kinetic Vision and Touch
Blake, R., Sobel, K. V., & James, T. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00691.x · Cited by 225 · see citing works
The Unity of ConsciousnessBinding, Integration, and Dissociation
Axel Cleeremans, B., & Frith, C. (2003) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198508571.001.0001 · Cited by 224 · see citing works
Visual Factors in Auditory Localization
Jackson, C. V. (1953) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215308416626 · Cited by 213 · see citing works
Bolognini, N., Frassinetti, F., Serino, A., & Làdavas, E. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-2005-z · Cited by 209 · see citing works
Clark, A. (2014) · Cited by 209 · see citing works
Voluntary control and the dynamics of perceptual bi-stability
van Ee, R., van Dam, L. C. J., & Brouwer, G. J. (2004) · Vision Research · doi:10.1016/j.visres.2004.07.030 · Cited by 208 · see citing works
When Correlation Implies Causation in Multisensory Integration
Parise, C., Spence, C. J., & Ernst, M. O. (2011) · Current Biology · doi:10.1016/j.cub.2011.11.039 · Cited by 207 · see citing works
Self-citationIn Touch with the Future: The Sense of Touch from Cognitive Neuroscience to Virtual Reality
Lloyd, D. M. (2014) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres_r_00182 · Cited by 195 · see citing works
Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule
Spence, C. J. (2013) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12121 · Cited by 186 · see citing works
Self-citationBoring, E. G. (1930) · The American Journal of Psychology · doi:10.2307/1415447 · Cited by 176 · see citing works
Endogenous attention prolongs dominance durations in binocular rivalry
Chong, S. C., Tadin, D., & Blake, R. (2005) · Journal of Vision · doi:10.1167/5.11.6 · Cited by 168 · see citing works
Consciousness and the structure of neuronal representations
The American Association for Research into Nervous and Mental Diseases, & Singer, W. (1998) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1998.0335 · Cited by 164 · see citing works
Primary sensory cortices contain distinguishable spatial patterns of activity for each sense
Liang, M., Mouraux, A., Hu, L., & Iannetti, G. D. (2013) · Nature Communications · doi:10.1038/ncomms2979 · Cited by 161 · see citing works
An Auditory Analogue of the Visual Reversible Figure
Warren, R. M., & Gregory, R. L. (1958) · The American Journal of Psychology · doi:10.2307/1420267 · Cited by 155 · see citing works
The representation of grammatical categories in the brain
Shapiro, K. A., & Caramazza, A. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00060-3 · Cited by 154 · see citing works
Multisensory Congruency as a Mechanism for Attentional Control over Perceptual Selection
van Ee, R., van Boxtel, J. J. A., Parker, A. L., & Alais, D. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0873-09.2009 · Cited by 147 · see citing works
Crossmodal semantic priming by naturalistic sounds and spoken words enhances visual sensitivity.
Chen, Y., & Spence, C. J. (2011) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0024329 · Cited by 146 · see citing works
Self-citationSemantic confusion regarding the development of multisensory integration: a practical solution
Stein, B. E., Burr, D. C., Constantinidis, C., Laurienti, P. J., Meredith, M. A., Perrault, T. J., Ramachandran, R., Röder, B., Rowland, B. A., Sathian, K., et al. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07206.x · Cited by 146 · see citing works
Multistability in perception: binding sensory modalities, an overview
Schwartz, J., Grimault, N., Hupé, J., Moore, B. C. J., & Pressnitzer, D. (2012) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2011.0254 · Cited by 146 · see citing works
Grouping visual features during binocular rivalry
Alais, D., & Blake, R. (1999) · Vision Research · doi:10.1016/s0042-6989(99)00146-7 · Cited by 142 · see citing works
Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites
Fairhall, S. L., & Macaluso, E. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06688.x · Cited by 137 · see citing works
Attention, Awareness, and the Perception of Auditory Scenes
Snyder, J., Gregg, M. K., Weintraub, D. M., & Alain, C. (2011) · Front. Psychology · doi:10.3389/fpsyg.2012.00015 · Cited by 132 · see citing works
Multisensory Integration and Attention in Developmental Dyslexia
Harrar, V., Tammam, J., Pérez-Bellido, A., Pitt, A., Stein, J. F., & Spence, C. J. (2014) · Current Biology · doi:10.1016/j.cub.2014.01.029 · Cited by 132 · see citing works
Self-citationTouch disambiguates rivalrous perception at early stages of visual analysis
Lunghi, C., Binda, P., & Morrone, M. C. (2010) · Current Biology · doi:10.1016/j.cub.2009.12.015 · Cited by 120 · see citing works
Modality-specific auditory and visual temporal processing deficits
Soto‐Faraco, S., & Spence, C. J. (2002) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/02724980143000136 · Cited by 120 · see citing works
Self-citationBayesian priors are encoded independently from likelihoods in human multisensory perception
Beierholm, U., Quartz, S. R., & Shams, L. B. (2009) · Journal of Vision · doi:10.1167/9.5.23 · Cited by 110 · see citing works
Deconstructing the McGurk–MacDonald illusion.
Soto‐Faraco, S., & Alsius, A. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0013483 · Cited by 110 · see citing works
Noise and Correlations in Parallel Perceptual Decision Making
Otto, T. U., & Mamassian, P. (2012) · Current Biology · doi:10.1016/j.cub.2012.05.031 · Cited by 110 · see citing works
Spence, C. J., & Deroy, O. D. (2012) · Springer eBooks · doi:10.1007/978-1-4614-5879-1_9 · Cited by 106 · see citing works
Self-citationVisual perception: rivalry and consciousness
Crick, F. (1996) · Nature · doi:10.1038/379485a0 · Cited by 101 · see citing works
Bistability for audiovisual stimuli: Perceptual decision is modality specific.
Hupé, J., Joffo, L., & Pressnitzer, D. (2008) · Journal of Vision · doi:10.1167/8.7.1 · Cited by 95 · see citing works
The Colavita Visual Dominance Effect
Spence, C. J., Parise, C., & Chen, Y. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-34 · Cited by 92 · see citing works
Self-citationThe function of consciousness in multisensory integration
Palmer, T. D., & Ramsey, A. K. (2012) · Cognition · doi:10.1016/j.cognition.2012.08.003 · Cited by 91 · see citing works
Helmholtz's treatise on physiological optics
Leffmann, H. (1925) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(25)90392-4 · Cited by 89 · see citing works
Chen, Y., & Spence, C. J. (2011) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0025638 · Cited by 85 · see citing works
Self-citationDetection of Audiovisual Speech Correspondences Without Visual Awareness
Alsius, A., & Munhall, K. G. (2013) · Psychological Science · doi:10.1177/0956797612457378 · Cited by 80 · see citing works
Bleeping you out of the blink: Sound saves vision from oblivion
Olivers, C. N. L., & der Burg, E. V. (2008) · Brain Research · doi:10.1016/j.brainres.2008.01.070 · Cited by 73 · see citing works
The effect of normal aging on closed contour shape discrimination
McKendrick, A. M. (2010) · Journal of Vision · doi:10.1167/10.2.1 · Cited by 72 · see citing works
Audiovisual interactions in binocular rivalry.
Conrad, V., Bartels, A., Kleiner, M., & Noppeney, U. (2010) · Journal of Vision · doi:10.1167/10.10.27 · Cited by 71 · see citing works
Phenomenal and access consciousness in olfaction
Stevenson, R. J. (2009) · Consciousness and Cognition · doi:10.1016/j.concog.2009.09.005 · Cited by 69 · see citing works
Chen, Y., Yeh, S., & Spence, C. J. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00212 · Cited by 69 · see citing works
Self-citationTouch Interacts with Vision during Binocular Rivalry with a Tight Orientation Tuning
Lunghi, C., & Alais, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0058754 · Cited by 66 · see citing works
Consciousness and perceptual binding
Treisman, A. (2003) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198508571.003.0005 · Cited by 63 · see citing works
Zmigrod, S., & Hommel, B. (2011) · Consciousness and Cognition · doi:10.1016/j.concog.2011.01.011 · Cited by 56 · see citing works
Touch and the body: The role of the somatosensory cortex in tactile awareness
Gallace, A., & Spence, C. J. (2010) · Psyche · Cited by 55 · see citing works
Self-citationFulkerson, M. (2011) · Philosophical Psychology · doi:10.1080/09515089.2011.556610 · Cited by 52 · see citing works
Nostril-Specific Olfactory Modulation of Visual Perception in Binocular Rivalry
Zhou, W., Zhang, X., Chen, J., Wang, L., & Chen, D. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2649-12.2012 · Cited by 51 · see citing works
Extraordinary Experiences during Cross-Modal Perception
Holt‐Hansen, K. (1976) · Perceptual and Motor Skills · doi:10.2466/pms.1976.43.3f.1023 · Cited by 51 · see citing works
O’Callaghan, C. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195309799.013.0005 · Cited by 44 · see citing works
eChen, Y.-C., eYeh, S.-L., & eSpence, C. (2011) · Frontiers in Psychology · Cited by 44 · see citing works
Assessing the effects of audiovisual semantic congruency on the perception of a bistable figure.
Hsiao, J., Chen, Y.-C., Spence, C., & Yeh, S.-L. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2012.02.001 · Cited by 39 · see citing works
Self-citationThe apparent movement between visual and acoustic stimulus and the problem of intermodal relations
Zapparoli, G. C., & Reatto, L. L. (1969) · Acta Psychologica · doi:10.1016/0001-6918(69)90019-5 · Cited by 34 · see citing works
Audiovisual Integration of Speech in a Bistable Illusion
Munhall, K. G., ten Hove, M., Brammer, M. J., & Paré, M. (2009) · Current Biology · doi:10.1016/j.cub.2009.03.019 · Cited by 33 · see citing works
Cross-modal perceptual organization
Spence, C. J. (2014) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199686858.013.015 · Cited by 31 · see citing works
Self-citationConrad, V., Kleiner, M., Bartels, A., Hartcher-O’Brien, J., Bülthoff, H., & Noppeney, U. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070710 · Cited by 31 · see citing works
Catch the moment: multisensory enhancement of rapid visual events by sound
Chen, Y., & Yeh, S. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1831-4 · Cited by 30 · see citing works
Self-citationMultistability, cross-modal binding and the additivity of conjoined grouping principles
Kubovy, M., & Yu, M. (2012) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2011.0365 · Cited by 29 · see citing works
Audiovisual semantic interference and attention: Evidence from the attentional blink paradigm
der Burg, E. V., Brederoo, S., Nieuwenstein, M. R., Theeuwes, J., & Olivers, C. N. L. (2010) · Acta Psychologica · doi:10.1016/j.actpsy.2010.01.010 · Cited by 20 · see citing works
Spatial Attention and Audiovisual Processing
Santangelo, V., & Macaluso, E. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0031 · Cited by 20 · see citing works
Olfaction modulates visual perception in binocular rivalry
Zhou, W., Jiang, Y., He, S., & Chen, D. (2010) · Current Biology · doi:10.1016/j.cub.2010.05.059 · Cited by 19 · see citing works
Visual contribution to the multistable perception of speech
Sato, M., Basirat, A., & Schwartz, J. (2007) · Perception & Psychophysics · doi:10.3758/bf03192952 · Cited by 19 · see citing works
Conscious Awareness in Patients in Vegetative States: Myth or Reality?
Celesia, G. G. (2013) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-013-0395-7 · Cited by 18 · see citing works
Visual events modulated by sound in repetition blindness
Chen, Y., & Yeh, S. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.2.404 · Cited by 18 · see citing works
Self-citationSpence, C. J., & Ngo, M. K. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0030 · Cited by 17 · see citing works
Self-citationIntramodal and Cross-Modal Perceptual Grouping
Spence, C. J., & Chen, Y. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0024 · Cited by 15 · see citing works
Self-citationMultisensory Integration: A Functional Role for Inter-Area Synchronization?
Bauer, M. (2008) · Current Biology · doi:10.1016/j.cub.2008.06.051 · Cited by 12 · see citing works
Fujisaki, W., Kitazawa, S., & Nishida, S. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0026 · Cited by 11 · see citing works
Spence, C. J., Deroy, O. D., & Bremner, A. (2013) · Multisensory Research · doi:10.1163/22134808-000s0036 · Cited by 10 · see citing works
Self-citationThe Colavita Visual Dominance Effect -- The Neural Bases of Multisensory Processes
Murray, M. M., & Mt, W. (2012) · Cited by 8 · see citing works
Standing out in a crowd: Item discriminability increases attentional resolution
Lanagan‐Leitzel, L. K., Fine, E. M., Chen, P., & Moore, C. M. (2005) · Journal of Vision · doi:10.1167/5.8.1004 · Cited by 7 · see citing works
Synchrony, Binding, and Consciousness
van Leeuwen, C. (2007) · Theory & Psychology · doi:10.1177/0959354307083493 · Cited by 3 · see citing works
Commentary: Multisensory Convergence: Where It All Begins
Meredith, M. A. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0004 · Cited by 3 · see citing works
Binaral Rivalry in the Presence of Visual Perceptual and Semantic Influences
Chen, J., Zhou, W., & Chen, D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047317 · Cited by 1 · see citing works
Yang, Y., & Yeh, S. (2011) · i-Perception · doi:10.1068/ic840 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- [1]Marcel AJ. 2003. Introspective report. J. Conscious. Stud. 10, 167–186. [Google Scholar]
- [37]Alais D, Blake R. (eds). 2005. Binocular rivalry. Cambridge, MA: MIT Press. [Google Scholar]
- [92]Navarra J. 2003. Visual speech interference in an auditory shadowing task: the dubbed movie effect. In Proc. 15th International Congress of Phonetic Sciences, Barcelona, Spain (ed. Solé MJ.), pp. 1–4. Barcelona, Spain: ICPhS Organizing Committee. [Google Scholar]
- [105]Deroy O. In press. Multisensory integration and the many unities of consciousness. In Multisensory integration and the unity of consciousness (eds Bennett D, Hill C.). Cambridge, MA: MIT Press. [Google Scholar]
- [109]Spence C, Smith B, Auvray M. In press. Confusing tastes and flavours. In Perception and its modalities (eds Matthen M, Biggs S, Stokes D.). Oxford, UK: Oxford University Press. [Google Scholar]
- [112]Wagemans J. (ed.) In press. The Oxford handbook of perceptual organization. Oxford, UK: Oxford University Press. [Google Scholar]
Cited by
Sorted by citations
Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness
Blanke, O., Slater, M., & Serino, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.029 · Cited by 698 · see citing works
Information integration without awareness
Mudrik, L., Faivre, N., & Koch, C. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.009 · Cited by 277 · see citing works
Pitts, M. A., Lutsyshyna, L. A., & Hillyard, S. A. (2018) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2017.0348 · Cited by 135 · see citing works
Designing sensory-substitution devices: Principles, pitfalls and potential1
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160647 · Cited by 116 · see citing works
Rethinking the senses and their interactions: the case for sensory pluralism
Fulkerson, M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01426 · Cited by 118 · see citing works
The Complex Interplay Between Multisensory Integration and Perceptual Awareness
Deroy, O., Faivre, N., Lunghi, C., Spence, C., Aller, M., & Noppeney, U. (2016) · Multisensory Research · doi:10.1163/22134808-00002529 · Cited by 51 · see citing works
Self-citationA Multisensory Philosophy of Perception
O’Callaghan, C. (2019) · doi:10.1093/oso/9780198833703.001.0001 · Cited by 70 · see citing works
Visual consciousness and bodily self-consciousness
Faivre, N., Salomon, R., & Blanke, O. (2015) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000160 · Cited by 50 · see citing works
Consciousness is more than meets the eye: a call for a multisensory study of subjective experience†
Faivre, N., Arzi, A., Lunghi, C., & Salomon, R. (2017) · Neuroscience of Consciousness · doi:10.1093/nc/nix003 · Cited by 44 · see citing works
Zoomed out: digital media use and depersonalization experiences during the COVID-19 lockdown
Ciaunica, A., McEllin, L. S., Kiverstein, J. D., D, V. G. M., Hohwy, J., & Wozniak, M. M. (2022) · Scientific Reports · doi:10.1038/s41598-022-07657-8 · Cited by 41 · see citing works
The cerebral bases of the bouba-kiki effect
Peiffer‐Smadja, N., & Cohen, L. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.11.033 · Cited by 41 · see citing works
Grades of Multisensory Awareness
O’Callaghan, C. (2017) · Mind & Language · doi:10.1111/mila.12137 · Cited by 40 · see citing works
Bodily self-consciousness and its disorders
Ronchi, R., Park, H.-D., & Blanke, O. (2018) · Handbook of clinical neurology · doi:10.1016/b978-0-444-63622-5.00015-2 · Cited by 39 · see citing works
Perceptual Consciousness as a Mental Activity
Schellenberg, S. (2017) · Noûs · doi:10.1111/nous.12209 · Cited by 36 · see citing works
Spence, C. J. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn214 · Cited by 36 · see citing works
Self-citationAuditory and visual scene analysis: an overview
Kondo, H. M., van Loon, A. M., Kawahara, J., & Moore, B. C. J. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0099 · Cited by 35 · see citing works
A spatially collocated sound thrusts a flash into awareness
Aller, M., Giani, A. S., Conrad, V., Watanabe, M., & Noppeney, U. (2015) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2015.00016 · Cited by 34 · see citing works
Congruent tactile stimulation reduces the strength of visual suppression during binocular rivalry
Lunghi, C., & Alais, D. (2015) · Scientific Reports · doi:10.1038/srep09413 · Cited by 34 · see citing works
Attention periodically samples competing stimuli during binocular rivalry
Davidson, M., Alais, D., Tsuchiya, N., & van Boxtel, J. J. A. (2018) · eLife · doi:10.7554/elife.40868 · Cited by 34 · see citing works
Kumar, G., Halder, T., Jaiswal, A. K., Mukherjee, A., Roy, D., & Banerjee, A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01558 · Cited by 32 · see citing works
Multisensory processing and perceptual consciousness: Part II
BRISCOE, R. E. (2017) · Philosophy Compass · doi:10.1111/phc3.12423 · Cited by 31 · see citing works
The clear and not so clear signatures of perceptual reality in the Bayesian brain
Deroy, O. D., & Rappe, S. (2022) · Consciousness and Cognition · doi:10.1016/j.concog.2022.103379 · Cited by 25 · see citing works
Self-citationPhenomenology and the Norms of Perception
Doyon, M. (2024) · doi:10.1093/9780191993527.001.0001 · Cited by 26 · see citing works
Bodily awareness and novel multisensory features
BRISCOE, R. E. (2019) · Synthese · doi:10.1007/s11229-019-02156-2 · Cited by 24 · see citing works
An invisible touch: Body-related multisensory conflicts modulate visual consciousness
Salomon, R., Galli, G., Łukowska, M., Faivre, N., Bello‐Ruiz, J., & Blanke, O. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.10.034 · Cited by 22 · see citing works
Mroczko-Wąsowicz, A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01593 · Cited by 21 · see citing works
Touch Accelerates Visual Awareness
Lunghi, C., Verde, L. L., & Alais, D. (2017) · i-Perception · doi:10.1177/2041669516686986 · Cited by 20 · see citing works
Farmer, H., Cataldo, A., Adel, N., Wignall, E. L., Gallese, V., Deroy, O. D., Hamilton, A. F. D. C., & Ciaunica, A. (2020) · Multisensory Research · doi:10.1163/22134808-bja10038 · Cited by 18 · see citing works
Self-citationInvisible Flashes Alter Perceived Sound Location
Delong, P., Aller, M., Giani, A. S., Rohe, T., Conrad, V., Watanabe, M., & Noppeney, U. (2018) · Scientific Reports · doi:10.1038/s41598-018-30773-3 · Cited by 18 · see citing works
Noel, J.-P., Simon, D., Thelen, A., Maier, A., Blake, R., & Wallace, M. T. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01247 · Cited by 17 · see citing works
A dynamical framework to relate perceptual variability with multisensory information processing
Thakur, B., Mukherjee, A., Sen, A., & Banerjee, A. (2016) · Scientific Reports · doi:10.1038/srep31280 · Cited by 17 · see citing works
Perceptual awareness and its neural basis: bridging experimental and theoretical paradigms
Raffone, A., Srinivasan, N., & van Leeuwen, C. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0203 · Cited by 16 · see citing works
Moors, P., Huygelier, H., Wagemans, J., Lee, D.-W., & van Ee, R. (2015) · i-Perception · doi:10.1068/i0678 · Cited by 14 · see citing works
Fjældstad, A. W., van Hartevelt, T. J., & Kringelbach, M. L. (2016) · Elsevier eBooks · doi:10.1016/b978-0-08-100350-3.00011-0 · Cited by 12 · see citing works
Auditory–visual integration during nonconscious perception
Ching, A. S. M., Kim, J., & Davis, C. (2019) · Cortex · doi:10.1016/j.cortex.2019.02.014 · Cited by 10 · see citing works
Unconscious multisensory integration: behavioral and neural evidence from subliminal stimuli
Frumento, S., Preatoni, G., Chee, L., Gemignani, A., Ciotti, F., Menicucci, D., & Raspopović, S. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1396946 · Cited by 9 · see citing works
Why There Is a Vestibular Sense, or How Metacognition Individuates the Senses
Garzorz, I. T., & Deroy, O. D. (2020) · Multisensory Research · doi:10.1163/22134808-bja10026 · Cited by 7 · see citing works
Self-citationCiaunica, A., McEllin, L. S., Kiverstein, J. D., D, V. G. M., Hohwy, J., & Wozniak, M. M. (2021) · doi:10.31234/osf.io/8jver · Cited by 7 · see citing works
Farmer, H., Cataldo, A., Adel, N., Wignall, E. L., Gallese, V., Deroy, O. D., Hamilton, A. F. D. C., & Ciaunica, A. (2019) · doi:10.31234/osf.io/xrp7y · Cited by 8 · see citing works
Self-citationCognitive control and consciousness in open biological systems
Kriete, A. (2025) · Biosystems · doi:10.1016/j.biosystems.2025.105457 · Cited by 6 · see citing works
Automatic auditory disambiguation of visual awareness
Plass, J., Guzman-Martinez, E., Ortega, L., Suzuki, S., & Grabowecky, M. (2017) · Attention Perception & Psychophysics · doi:10.3758/s13414-017-1355-0 · Cited by 6 · see citing works
Multisensory perceptual awareness: Categorical or graded?
Noel, J., Faivre, N., Magosso, E., Blanke, O., Alais, D., & Wallace, M. T. (2019) · Cortex · doi:10.1016/j.cortex.2019.05.018 · Cited by 6 · see citing works
Can Biological Quantum Networks Solve NP‐Hard Problems?
Wendin, G. P. (2019) · Advanced Quantum Technologies · doi:10.1002/qute.201800081 · Cited by 5 · see citing works
Perceptual Consciousness as a Mental Activity
Schellenberg, S. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780198827702.003.0007 · Cited by 5 · see citing works
Recent progress in the study of consciousness and multisensory integration
Jiang, Y., Liu, R., & Wang, L. (2015) · Chinese Science Bulletin (Chinese Version) · doi:10.1360/n972015-00666 · Cited by 4 · see citing works
The structure of audio–visual consciousness
Skrzypulec, B. (2019) · Synthese · doi:10.1007/s11229-019-02195-9 · Cited by 4 · see citing works
Getting in Touch with the Lost Self: Vicarious and Affective Touch in DepersonalisationPreprint
Ciaunica, A., Mathew, J., Deroy, O. D., & Fairhurst, M. T. (2022) · SSRN Electronic Journal · doi:10.31234/osf.io/4pnyq · Cited by 4 · see citing works
Self-citationHanke, S., & Niedeggen, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309425 · Cited by 3 · see citing works
Montoya, S., & Badde, S. (2023) · Cognition · doi:10.1016/j.cognition.2023.105528 · Cited by 3 · see citing works
The hidden structure of consciousness
Forti, B. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1344033 · Cited by 3 · see citing works
Structure of perceptual objects: introduction to the Synthese topical collection
Vernazzani, A., Skrzypulec, B., & Schlicht, T. (2020) · Synthese · doi:10.1007/s11229-020-02862-2 · Cited by 3 · see citing works
Görsel Yanılsamalar Bağlamında Görsel Algının Esasları
Ayhan, İ., & Ünal, G. (2020) · Nesne Psikoloji Dergisi · doi:10.7816/nesne-08-18-11 · Cited by 2 · see citing works
Ciaunica, A., Mathew, J., Deroy, O. D., & Fairhurst, M. T. (2023) · Research Square · doi:10.21203/rs.3.rs-2628739/v1 · Cited by 2 · see citing works
Self-citationO’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0003 · Cited by 1 · see citing works
Husserl’s Normative Account of Perception
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0001 · Cited by 1 · see citing works
di, L. A. C. L. C., Maura, G., Marcoli, M., & Guidolin, D. (2018) · Istituto Lombardo - Accademia di Scienze e Lettere - Incontri di Studio · doi:10.4081/incontri.2018.427
Seeing objects helps us better hear the sounds they makePreprint
Man, K., de Melo, G. M., Damásio, A. R., & Kaplan, J. (2018) · doi:10.31234/osf.io/4bcr6
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0002
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0006
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0005
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0004
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0001
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.003.0007
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.002.0004
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.002.0005
O’Callaghan, C. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198833703.002.0003
Bodily Self-Awareness and Agency
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0003
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0007
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.002.0005
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0005
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0006
Perceptual Normativity in Merleau-Ponty
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0002
Doyon, M. (2024) · Oxford University Press eBooks · doi:10.1093/9780191993527.003.0004
Emulating sensation by bridging neuromorphic computing and multisensory integration
Bikić, A., & Pernice, W. H. P. (2025) · Patterns · doi:10.1016/j.patter.2025.101238
Sensory Substitution Through Vibrotactile Stimulation
Kristjansson, A. K., Makarov, I. M., Yeganeh, N., & Unnþórsson, R. (2026) · Signals and communication technology · doi:10.1007/978-3-031-91550-5_8
Multisensory consciousness: Does it exist?
Spence, C. J., & Stefano, N. D. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29258-3.00010-0
Self-citationInvisible flashes bias spatial coding in the auditory systemPreprint
Delong, P., Plèche, C., & Noppeney, U. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.11.705146
Drowsiness Alters the Neural Dynamics But Not the Core Computations of Multisensory Integration
Alameda, C., Avancini, C., Sanabria, D., Bekinschtein, T. A., & Ciria, L. F. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.0363-26.2026
- Authors
- Deroy, O., Chen, Y.-C., & Spence, C.
- Affiliations
- University of London (GB)
- McMaster University (CA)
- University of Oxford (GB)
- Corresponding author
- Deroy, Ophelia
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2014-05-05
- Volume
- 369
- Issue
- 1641
- Pages
- 20130207
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- PMC
- PMC3965162
- OpenAlex
- W2171629471
- Cited by
- 78
- References
- 123
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 12 · 2023: 2 · 2022: 3 · 2021: 1 · 2020: 4 · 2019: 17 · 2018: 10 · 2017: 7 · 2016: 6 · 2015: 6 · 2014: 4
- FWCI
- 1.03
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Philosophical Transactions of the Royal Society B Biological Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Arts and Humanities Research Council (AH/L007053/1)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Philosophy and Theoretical Science
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- perceptual awareness, multisensory integration, multisensory binding, binocular rivalry, continuous flash suppression, attentional blink, repetition blindness, backward masking, visual processing
- MeSH terms
- Awareness, Consciousness, Humans, Models, Psychological, Perception, Perceptual Masking, Vision Disparity, Attentional Blink
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
