Consciousness is more than meets the eye: a call for a multisensory study of subjective experience†
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Over the last 30 years, our understanding of the neurocognitive bases of consciousness has improved, mostly through studies employing vision. While studying consciousness in the visual modality presents clear advantages, we believe that a comprehensive scientific account of subjective experience must not neglect other exteroceptive and interoceptive signals as well as the role of multisensory interactions for perceptual and self-consciousness. Here, we briefly review four distinct lines of work which converge in documenting how multisensory signals are processed across several levels and contents of consciousness. Namely, how multisensory interactions occur when consciousness is prevented because of perceptual manipulations (i.e. subliminal stimuli) or because of low vigilance states (i.e. sleep, anesthesia), how interactions between exteroceptive and interoceptive signals give rise to bodily self-consciousness, and how multisensory signals are combined to form metacognitive judgments. By describing the interactions between multisensory signals at the perceptual, cognitive, and metacognitive levels, we illustrate how stepping out the visual comfort zone may help in deriving refined accounts of consciousness, and may allow cancelling out idiosyncrasies of each sense to delineate supramodal mechanisms involved during consciousness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How do you feel — now? The anterior insula and human awareness
(Bud) Craig, A. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2555 · Cited by 6,657 · cited 1×
“In parallel, several theories have suggested a central role for interoceptive signals arising from respiratory and cardiac activity in BSC (Damasio 1999; Craig 2009; Seth 2013; Park and Tallon-Baudry 2014).”
BackgroundRubber hands ‘feel’ touch that eyes see
Botvinick, M., & Cohen, J. (1998) · Nature · doi:10.1038/35784 · Cited by 4,410 · cited 1×
“…hand/body give rise to illusory ownership over the virtual hand [rubber hand illusion (RHI)] or body [full body illusion (FBI)] as measured by subjective responses as well as neural and physiological measurements [Botvinick and Cohen (1998); reviewed in Blanke (2012) and Kilteni et al. (2015)].”
MethodOhayon, M. M., Carskadon, M. A., Guilleminault, C., & Vitiello, M. V. (2004) · Sleep · doi:10.1093/sleep/27.7.1255 · Cited by 3,349
Philosophical conceptions of the self: implications for cognitive science.
Gallagher, S. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01417-5 · Cited by 2,881 · cited 1×
“Recent research on BSC has uncovered that the implicit and prereflective experience of the self is related to processing of bodily signals in multisensory brain systems [for reviews see Blanke (2012); Blanke et al. (2015); Ehrsson (2012); Gallagher (2000)].”
BackgroundExperimental and theoretical approaches to conscious processing
Dehaene, S., & Changeux, J.-P. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.018 · Cited by 2,573
The distinct modes of vision offered by feedforward and recurrent processing
Lamme, V. A. F., & Roelfsema, P. R. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01657-x · Cited by 2,338
From presence to consciousness through virtual reality.
Sanchez-Vives, M. V., & Slater, M. (2005) · Nature reviews. Neuroscience · doi:10.1038/nrn1651 · Cited by 1,831
Interoceptive inference, emotion, and the embodied self
Seth, A. K. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.007 · Cited by 1,816 · cited 1×
“In parallel, several theories have suggested a central role for interoceptive signals arising from respiratory and cardiac activity in BSC (Damasio 1999; Craig 2009; Seth 2013; Park and Tallon-Baudry 2014).”
BackgroundNeural correlates of consciousness: progress and problems
Koch, C., Massimini, M., Boly, M., & Tononi, G. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.22 · Cited by 1,600 · cited 4×
“…of sensory signals of completely different nature (i.e. electromagnetic, mechanical, or chemical, respectively), followed by the processing of subsequent neural activity by a common mechanism referred to as a neural correlate of consciousness (NCC: Crick and Koch 1990a; Koch et al. 2016).”
BackgroundInfluentialFleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 1×
“This capacity, long known as a specific form of introspection and now referred to as metacognition is measured by asking volunteers to perform a perceptual or memory task (firstorder task), followed by a confidence judgment regarding their own performance [second-order task; Fleming and Lau (2014)].”
MethodVideo ergo sum: manipulating bodily self-consciousness
Lenggenhager, B., Tadi, T., Metzinger, T., & Blanke, O. (2007) · Science · doi:10.1126/science.1143439 · Cited by 1,265
Multisensory brain mechanisms of bodily self-consciousness.
Blanke, O. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3292 · Cited by 1,147
First person experience of body transfer in virtual reality
Slater, M., Spanlang, B., Sanchez-Vives, M. V., & Blanke, O. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010564 · Cited by 1,090
The conscious access hypothesis: origins and recent evidence
Baars, B. J. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01819-2 · Cited by 994 · cited 1×
“Based on the apparent multisensory nature of conscious experiences, it has been argued that conscious processing plays a role in merging together inputs from different sensory modalities (Baars 2002).”
The experimental induction of out-of-body experiences
Ehrsson, H. H. (2007) · Science · doi:10.1126/science.1142175 · Cited by 959
The neural correlate of (un)awareness: lessons from the vegetative state
Laureys, S. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.10.010 · Cited by 813
Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness
Blanke, O., Slater, M., & Serino, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.029 · Cited by 698
Suzuki, K., Garfinkel, S. N., Critchley, H. D., & Seth, A. K. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.08.014 · Cited by 476
Virtual hand illusion induced by visuomotor correlations
Sanchez-Vives, M. V., Spanlang, B., Frisoli, A., Bergamasco, M., & Slater, M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010381 · Cited by 441 · cited 2×
“Others have used sensorimotor correlations giving rise to the sense of agency to establish a sense of ownership over a hand (Sanchez-Vives et al. 2010; Tsakiris et al. 2010; Salomon et al. 2016) or a body (Slater et al.”
BackgroundAre there levels of consciousness?
Bayne, T., Hohwy, J., & Owen, A. M. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.009 · Cited by 438
The Cambridge Handbook of Consciousness
(2007) · doi:10.1017/cbo9780511816789 · Cited by 394
Spontaneous fluctuations in neural responses to heartbeats predict visual detection
Park, H.-D., Correia, S., Ducorps, A., & Tallon-Baudry, C. (2014) · Nature Neuroscience · doi:10.1038/nn.3671 · Cited by 349 · cited 1×
“Notably, Park et al. (2014) have shown that spontaneous fluctuations of neural responses to cardiac events (heartbeat evoked responses) are predictive of stimulus visibility.”
BackgroundMetacognition: computation, biology and function
Fleming, S. M., Dolan, R. J., & Frith, C. D. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0021 · Cited by 344 · cited 1×
“Another crucial aspect of mental life that relates to the self is our capacity to monitor our own percepts, thoughts, or memories (Koriat 2006; Fleming et al. 2012).”
BackgroundInformation integration without awareness
Mudrik, L., Faivre, N., & Koch, C. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.009 · Cited by 277 · cited 1×
“Although often discussed in philosophy, this crucial aspect of phenomenology has remained outside of empirical focus until recently, with notable current theories stressing the importance of consciousness for information integration [reviewed in Mudrik et al. (2014)].”
BackgroundSelf-citationAspell, J. E., Heydrich, L., Marillier, G., Lavanchy, T., Herbelin, B., & Blanke, O. (2013) · Psychological Science · doi:10.1177/0956797613498395 · Cited by 257 · cited 2×
“saw their hand/body flashing synchronously with their heartbeat, they reported illusory ownership over the seen limb/body compared with an asynchronous condition (Aspell et al. 2013; Suzuki et al. 2013).”
BackgroundThe neural subjective frame: from bodily signals to perceptual consciousness
Park, H.-D., & Tallon-Baudry, C. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0208 · Cited by 246
Body ownership causes illusory self-attribution of speaking and influences subsequent real speaking
Banakou, D., & Slater, M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414936111 · Cited by 223 · cited 1×
“Others have used sensorimotor correlations giving rise to the sense of agency to establish a sense of ownership over a hand (Sanchez-Vives et al. 2010; Tsakiris et al. 2010; Salomon et al. 2016) or a body (Slater et al. 2010; Banakou and Slater 2014).”
BackgroundNeural correlates of auditory perceptual awareness under informational masking
Gutschalk, A., Micheyl, C., & Oxenham, A. J. (2008) · PLoS Biology · doi:10.1371/journal.pbio.0060138 · Cited by 201
Multisensory Integration of Natural Odors and Sounds in the Auditory Cortex
Cohen, L., Rothschild, G., & Mizrahi, A. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.019 · Cited by 192
Transient modulations of neural responses to heartbeats covary with bodily self-consciousness
Park, H.-D., Bernasconi, F., Bello-Ruiz, J., Pfeiffer, C., Salomon, R., & Blanke, O. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0311-16.2016 · Cited by 169
Self-citationCanales-Johnson, A., Silva, C., Huepe, D., Rivera-Rei, Á., Noreika, V., Garcia, M. D. C., Silva, W., Ciraolo, C., Vaucheret, E., Sedeño, L., et al. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv076 · Cited by 146
Salomon, R., Noel, J.-P., Łukowska, M., Faivre, N., Metzinger, T., Serino, A., & Blanke, O. (2017) · Cognition · doi:10.1016/j.cognition.2017.05.028 · Cited by 142
Self-citationBehavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition
Faivre, N., Filevich, E., Solovey, G., Kühn, S., & Blanke, O. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0322-17.2017 · Cited by 129
Self-citationSel, A., Azevedo, R. T., & Tsakiris, M. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw296 · Cited by 111 · cited 2×
“when facial stimuli are modulated by heartbeat (Sel et al. 2016), and learning of interoceptive motor tracking have been reported (Canales-Johnson et al.”
BackgroundConfidence as a Common Currency between Vision and Audition
de Gardelle, V., Le Corre, F., & Mamassian, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147901 · Cited by 95
Multisensory constraints on awareness
Deroy, O., Chen, Y.-C., & Spence, C. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0207 · Cited by 78 · cited 2×
“Beyond independent subjective experiences in distinct sensory modalities, one may consider consciousness as a holistic experience made of numerous sensory signals bound together (Nagel 1971; Revonsuo 1999; Bayne and Chalmers 2003; Deroy et al. 2014; O’Callaghan 2017; but see Spence and Bayne 2014).”
BackgroundVisual consciousness and bodily self-consciousness
Faivre, N., Salomon, R., & Blanke, O. (2015) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000160 · Cited by 50
Self-citation
Cited by
Salomon, R., Noel, J.-P., Łukowska, M., Faivre, N., Metzinger, T., Serino, A., & Blanke, O. (2017) · Cognition · doi:10.1016/j.cognition.2017.05.028 · Cited by 142
Self-citationThe first prior: From co-embodiment to co-homeostasis in early life
Ciaunica, A., Constant, A., Preissl, H., & Fotopoulou, K. (2021) · Consciousness and Cognition · doi:10.1016/j.concog.2021.103117 · Cited by 105
First-person view of one’s body in immersive virtual reality: Influence on episodic memory
Bréchet, L., Mange, R., Herbelin, B., Theillaud, Q., Gauthier, B., Serino, A., & Blanke, O. (2019) · PLOS ONE · doi:10.1371/journal.pone.0197763 · Cited by 85
Noel, J.-P., Simon, D., Thelen, A., Maier, A., Blake, R., & Wallace, M. T. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01247 · Cited by 17
“…al., 2014), or even when participants are unconscious (Arzi et al., 2012; Ikeda & Morotomi, 1996; Beh & Barratt, 1965), evidence for multisensory integration in the complete absence of perceptual awareness (without prior training) is conspicuously lacking (Faivre et al., 2017; Noel et al., 2015).”
Metadata
- Authors
- Faivre, N., Arzi, A., Lunghi, C., & Salomon, R.
- Venue
- Neuroscience of Consciousness
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-01-01
- Volume
- 2017
- Issue
- 1
- Pages
- nix003-nix003
- ISSN
- 2057-2107 (ISSN-L)
- OpenAlex
- W2596207255
- Cited by
- 43
- References
- 37
- FWCI
- 3.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.