A Systematic Review of Physiological Measurements, Factors, Methods, and Applications in Virtual Reality
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Measurements of physiological parameters provide an objective, often non-intrusive, and (at least semi-)automatic evaluation and utilization of user behavior. In addition, specific hardware devices of Virtual Reality (VR) often ship with built-in sensors, i.e. eye-tracking and movements sensors. Hence, the combination of physiological measurements and VR applications seems promising. Several approaches have investigated the applicability and benefits of this combination for various fields of applications. However, the range of possible application fields, coupled with potentially useful and beneficial physiological parameters, types of sensor, target variables and factors, and analysis approaches and techniques is manifold. This article provides a systematic overview and an extensive state-of-the-art review of the usage of physiological measurements in VR. We identified 1,119 works that make use of physiological measurements in VR. Within these, we identified 32 approaches that focus on the classification of characteristics of experience, common in VR applications. The first part of this review categorizes the 1,119 works by field of application, i.e. therapy, training, entertainment, and communication and interaction, as well as by the specific target factors and variables measured by the physiological parameters. An additional category summarizes general VR approaches applicable to all specific fields of application since they target typical VR qualities. In the second part of this review, we analyze the target factors and variables regarding the respective methods used for an automatic analysis and, potentially, classification. For example, we highlight which measurement setups have been proven to be sensitive enough to distinguish different levels of arousal, valence, anxiety, stress, or cognitive workload in the virtual realm. This work may prove useful for all researchers wanting to use physiological data in VR and who want to have a good overview of prior approaches taken, their benefits and potential drawbacks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Measuring Presence in Virtual Environments: A Presence Questionnaire
Witmer, B. G., & Singer, M. J. (1998) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474698565686 · Cited by 6,371
Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness
Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0303_3 · Cited by 5,457
Rubber hands ‘feel’ touch that eyes see
Botvinick, M., & Cohen, J. (1998) · Nature · doi:10.1038/35784 · Cited by 4,410
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 1×
“Therefore, in the past many studies have found correlations between anxiety levels and numerous features of cardiovascular activity and EDA measurements (Kreibig, 2010).”
BackgroundKubios HRV–heart rate variability analysis software.
Tarvainen, M. P., Niskanen, J.-P., Lipponen, J. A., Ranta-aho, P. O., & Karjalainen, P. A. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.07.024 · Cited by 2,720
POSNER, J., RUSSELL, J. A., & PETERSON, B. S. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050340 · Cited by 2,602
Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature
Kim, H.-G., Cheon, E.-J., Bai, D.-S., Lee, Y. H., & Koo, B.-H. (2018) · Psychiatry Investigation · doi:10.30773/pi.2017.08.17 · Cited by 2,308
A review of classification algorithms for EEG-based brain–computer interfaces: A 10 year update
Lotte, F., Bougrain, L., Cichocki, A., Clerc, M., Congedo, M., Rakotomamonjy, A., & Yger, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aab2f2 · Cited by 2,239
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940
Flawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865
A discussion of cybersickness in virtual environments
LaViola, J. J. (2000) · ACM SIGCHI Bulletin · doi:10.1145/333329.333344 · Cited by 1,426
Depth of Presence in Virtual Environments
Slater, M., Usoh, M., & Steed, A. (1994) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1994.3.2.130 · Cited by 1,342
Review on cybersickness in applications and visual displays
Rebenitsch, L., & Owen, C. (2016) · Virtual Reality · doi:10.1007/s10055-016-0285-9 · Cited by 971
Projecting sensations to external objects: evidence from skin conductance response
Armel, K. C., & Ramachandran, V. S. (2003) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2003.2364 · Cited by 854
Vanderlei (2009) · doi:10.1590/s0102-76382009000200018 · Cited by 744
Towards a digital body: the virtual arm illusion
Slater, M. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.006.2008 · Cited by 570
Relaxation with immersive natural scenes presented using virtual reality
Anderson, A. P., Mayer, M. D., Fellows, A. M., Cowan, D. R., Hegel, M. T., & Buckey, J. C. (2017) · Aerospace Medicine and Human Performance · doi:10.3357/amhp.4747.2017 · Cited by 419
Integrative Action of the Autonomic Nervous System: Neurobiology of Homeostasis
Jänig, W. (2006) · doi:10.1017/cbo9780511541667 · Cited by 409
Threatening a rubber hand that you feel is yours elicits a cortical anxiety response.
Ehrsson, H. H., Wiech, K., Weiskopf, N., Dolan, R. J., & Passingham, R. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610011104 · Cited by 390
Melillo, P., Bracale, M., & Pecchia, L. (2011) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-10-96 · Cited by 328
Hogervorst, M. A., Brouwer, A.-M., & van Erp, J. B. F. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00322 · Cited by 292
Alian, A. A., & Shelley, K. H. (2014) · Best Practice & Research Clinical Anaesthesiology · doi:10.1016/j.bpa.2014.08.006 · Cited by 289
Automatic identification of artifacts in electrodermal activity data
Taylor, S., Jaques, N., Chen, W., Fedor, S., Sano, A., & Picard, R. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318762 · Cited by 279
The effect of stress on core and peripheral body temperature in humans
Vinkers, C. H., Penning, R., Hellhammer, J., Verster, J. C., Klaessens, J. H. G. M., Olivier, B., & Kalkman, C. J. (2013) · Stress · doi:10.3109/10253890.2013.807243 · Cited by 220
Anxiety and respiratory patterns: their relationship during mental stress and physical load
Masaoka, Y., & Homma, I. (1997) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(97)00052-4 · Cited by 188
Blum, J., Rockstroh, C., & Göritz, A. S. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02172 · Cited by 183
Eliciting positive, negative and mixed emotional states: A film library for affective scientists
Samson, A. C., Kreibig, S. D., Soderstrom, B., Wade, A. A., & Gross, J. J. (2016) · Cognition and Emotion · doi:10.1080/02699931.2015.1031089 · Cited by 155
Christensen, J. C., Estepp, J. R., Wilson, G. F., & Russell, C. A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.091 · Cited by 144
Anxiety level recognition for virtual reality therapy system using physiological signals
Šalkevicius, J., Damaševičius, R., Maskeliunas, R., & Laukienė, I. (2019) · Electronics · doi:10.3390/electronics8091039 · Cited by 135
Kahlon, S., Lindner, P., & Nordgreen, T. (2019) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-019-0307-y · Cited by 130
Improving the Intensive Care Patient Experience With Virtual Reality—A Feasibility Study
Ong, T. L., Ruppert, M. M., Akbar, M., Rashidi, P., Ozrazgat-Baslanti, T., Bihorac, A., & Suvajdzic, M. (2020) · Critical Care Explorations · doi:10.1097/cce.0000000000000122 · Cited by 80
Felnhofer, A., Kothgassner, O. D., Hetterle, T., Beutl, L., Hlavacs, H., & Kryspin-Exner, I. (2014) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2013.0472 · Cited by 70
In AI We Trust: Investigating the Relationship between Biosignals, Trust and Cognitive Load in VR
Gupta, K., Hajika, R., Pai, Y. S., Duenser, A., Lochner, M., & Billinghurst, M. (2019) · 25th ACM Symposium on Virtual Reality Software and Technology · doi:10.1145/3359996.3364276 · Cited by 59
Costa, R. T. D., Carvalho, M. R. D., Ribeiro, P., & Nardi, A. E. (2018) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2017-2270 · Cited by 48
Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VR
Rahman, Y., Asish, S. M., Fisher, N. P., Bruce, E. C., Kulshreshth, A. K., & Borst, C. W. (2020) · 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr46266.2020.00009 · Cited by 45
Breuninger, C., Sláma, D. M., Krämer, M., Schmitz, J., & Tuschen-Caffier, B. (2017) · Cognitive Therapy and Research · doi:10.1007/s10608-016-9814-9 · Cited by 33
Shiban, Y., Peperkorn, H., Alpers, G. W., Pauli, P., & Mühlberger, A. (2016) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2015.11.002 · Cited by 31
Impact of Tactile and Visual Feedback on Breathing Rhythm and User Experience in VR Exergaming
Greinacher, R., Kojic, T., Meier, L., Parameshappa, R. G., Moller, S., & Voigt-Antons, J.-N. (2020) · 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex48832.2020.9123141 · Cited by 20
Cited by
Badeja, D., Schier, F., McGinity, M., & Hoyer, J. (2026) · Psychotherapy Research · doi:10.1080/10503307.2025.2534978 · Cited by 2
“…presence has also been identified as a crucial facilitator of VR’s potential to evoke behavioural (Slater, 2009), physiological (Diemer et al., 2014; Halbig & Latoschik, 2021) and affective (Somarathna et al., 2022) responses resembling those observable in real life – even when the virtual is…”
Metadata
- Authors
- Halbig, A., & Latoschik, M. E.
- Venue
- Frontiers in Virtual Reality
- Publisher
- Frontiers Media SA
- Published
- 2021-07-14
- Volume
- 2
- ISSN
- 2673-4192 (ISSN-L)
- OpenAlex
- W3191913108
- Cited by
- 163
- References
- 41
- FWCI
- 1.98
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.