Multisensory Presence in Virtual Reality: Possibilities & Limitations
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Perception in the real world is inherently multisensory, often involving visual, auditory, tactile, olfactory, gustatory, and, on occasion, nociceptive (i.e., painful) stimulation. In fact, the vast majority of life’s most enjoyable experiences involve the stimulation of several senses simultaneously. Outside of the entertainment industry, however, the majority of virtual reality (VR) applications thus far have involved the stimulation of only one, or at most two, senses, typically vision, audition, and, on occasion, touch/haptics. That said, the research that has been conducted to date has convincingly shown that increasing the number of senses stimulated in a VR simulator can dramatically enhance a user’s ‘sense of presence’, their enjoyment, and even their memory for the encounter/experience. What is more, given that the technology has been improving rapidly, and the costs associated with VR systems are continuing to come down, it seems increasingly likely that truly multisensory VR should be with us soon (albeit 50 years after Heilig, 1962, originally introduced Sensorama). However, it is important to note that there are both theoretical and practical limitations to the stimulation of certain senses in VR. In this chapter, after having defined the concept of ‘neurally-inspired VR’, we highlight some of the most exciting potential applications associated with engaging more of a user’s senses while in a simulated environment. We then review the key technical challenges associated with stimulating multiple senses in a VR setting. We focus on the particular problems associated with the stimulation of the senses of touch, smell, and taste. We also highlight the problems associated with the limited bandwidth of human sensory perception and the psychological costs associated with users having to divide their attention between multiple sensory modalities simultaneously. Finally, we discuss how the findings provided by the extant research in the cognitive neurosciences might help to overcome, at least in part, some of the cognitive and technological limitations affecting the development of multisensory VR systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How do you feel? Interoception: The sense of the physiological condition of the body
Craig, A. D. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn894 · Cited by 6,006
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Slater, M., & Wilbur, S. (1997) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1997.6.6.603 · Cited by 3,034
Multiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Merging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
Experiencing physical warmth promotes interpersonal warmth
Williams, L. E., & Bargh, J. A. (2008) · Science · doi:10.1126/science.1162548 · Cited by 1,429
Video ergo sum: manipulating bodily self-consciousness
Lenggenhager, B., Tadi, T., Metzinger, T., & Blanke, O. (2007) · Science · doi:10.1126/science.1143439 · Cited by 1,265
Cited by
Nature’s Chemical Signatures in Human Olfaction: A Foodborne Perspective for Future Biotechnology
Dunkel, A., Steinhaus, M., Kotthoff, M., Nowak, B., Krautwurst, D., Schieberle, P., & Hofmann, T. (2014) · Angewandte Chemie International Edition · doi:10.1002/anie.201309508 · Cited by 549
Digital Sensory Marketing: Integrating New Technologies into Multisensory Online Experience
Petit, O., Velasco, C., & Spence, C. (2019) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2018.07.004 · Cited by 504
Self-citationMoseley, G. L., Gallace, A., & Spence, C. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.03.013 · Cited by 448
Self-citationSenses of place: architectural design for the multisensory mind
Spence, C. (2020) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-020-00243-4 · Cited by 380
Self-citationVirtual reality applications for the built environment: Research trends and opportunities
Zhang, Y., Liu, H., Kang, S.-C., & Al-Hussein, M. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103311 · Cited by 361
Metadata
- Authors
- Gallace, A., Ngo, M. K., Sulaitis, J., & Spence, C.
- Venue
- Multiple Sensorial Media Advances and Applications
- Publisher
- IGI Global
- Published
- 2012
- Pages
- 1-38
- OpenAlex
- W1505968235
- Cited by
- 137
- References
- 33
- FWCI
- 16.18
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multisensory Presence in Virtual Reality: Possibilities & Limitations. https://app.cochat.ai/papers/10.4018/978-1-60960-821-7.ch001
- The paper
- Gallace, A., Ngo, M. K., Sulaitis, J., & Spence, C. (2012). Multisensory Presence in Virtual Reality: Possibilities & Limitations. Multiple Sensorial Media Advances and Applications. https://doi.org/10.4018/978-1-60960-821-7.ch001
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.