The DOI matches its Crossref record; 99 of the 99 references it cites were found in a registry or an index; 7 of the 67 sources its claims cite were checked for support.
The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence
Open accessAbstract
Real-world experience is typically multimodal. Evidence indicates that the facilitation in the detection of multisensory stimuli is modulated by the perceptual load, the amount of information involved in the processing of the stimuli. Here, we used a realistic virtual reality environment while concomitantly acquiring Electroencephalography (EEG) and Galvanic Skin Response (GSR) to investigate how multisensory signals impact target detection in two conditions, high and low perceptual load. Different multimodal stimuli (auditory and vibrotactile) were presented, alone or in combination with the visual target. Results showed that only in the high load condition, multisensory stimuli significantly improve performance, compared to visual stimulation alone. Multisensory stimulation also decreases the EEG-based workload. Instead, the perceived workload, according to the "NASA Task Load Index" questionnaire, was reduced only by the trimodal condition (i.e., visual, auditory, tactile). This trimodal stimulation was more effective in enhancing the sense of presence, that is the feeling of being in the virtual environment, compared to the bimodal or unimodal stimulation. Also, we show that in the high load task, the GSR components are higher compared to the low load condition. Finally, the multimodal stimulation (Visual-Audio-Tactile-VAT and Visual-Audio-VA) induced a significant decrease in latency, and a significant increase in the amplitude of the P300 potentials with respect to the unimodal (visual) and visual and tactile bimodal stimulation, suggesting a faster and more effective processing and detection of stimuli if auditory stimulation is included. Overall, these findings provide insights into the relationship between multisensory integration and human behavior and cognition.
Overview
CoChat Summary
## TL;DR
In an immersive VR target-detection task with 18 healthy male volunteers, multisensory cues improved performance only under high perceptual load, while also reducing EEG-based workload and increasing presence. P300 measures and skin conductance supported the view that higher multisensory integration and higher load changed stimulus processing, arousal, and user experience.
## Key findings
- In the performance LMM, perceptual load had a significant main effect: performance was lower in the high-load than the low-load condition (marginal R² = 0.53; conditional R² = 0.67).
- There was a significant Condition × Task interaction for performance: in the high-load condition only, bimodal and trimodal stimulation improved performance versus visual-only, with VA p = 0.003, VAT p < 0.001, and VT p = 0.037.
- Sense of presence increased with multisensory integration and with load: VAT produced higher presence than V (p = 0.007) and VT (p = 0.026), VA was higher than V (p = 0.048), and high load increased presence by β = 0.559 (p = 0.0118).
- EEG findings showed multisensory benefits in stimulus processing: P300 amplitude increased for VA and VAT versus V and VT (all p-values < 0.001 or < 0.01), while P300 latency increased for VA and VAT versus V and VT; high load also increased latency by β = 0.44.
- Workload measures diverged by instrument: the EEG-based workload index decreased for VAT and VT versus V (β = 0.333, p = 0.002; β = 0.319, p = 0.006), while NASA-TLX showed a significant reduction only for VAT versus V (p = 0.025).
- Skin conductance increased under high load for both tonic and phasic components: tonic β = 0.995 (p = 0.004) and phasic β = 1.02 (p < 0.0001).
## Methods
- The study used a counterbalanced VR experiment with a target-detection driving task under 2 perceptual-load conditions (low vs high) and 4 sensory tasks: V, VA, VT, and VAT.
- Participants were 18 healthy male volunteers, mean age 26.5 ± 3.2 years, with normal or corrected-to-normal vision.
- Outcomes included behavioral performance (#HitT and TimeD), subjective workload (NASA-TLX), presence questionnaire scores, EEG-derived workload (WEEG), P300 amplitude/latency, and GSR-based arousal measures; analysis used linear mixed-effects models with subject random effects and post hoc Tukey tests.
## Limitations
- The paper states that perceptual load may have intrinsically increased cognitive load, and that the design did not allow disentangling cognitive from perceptual load; further studies are needed.
- The sample included only 18 participants and only male volunteers, which the paper says was done to reduce variability due to putative gender effects.
- The text makes evident that the study used a highly controlled VR task, so generalization to other settings is uncertain; this is an inference from the experimental design, not a limitation explicitly stated in the paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
4 Valid · 2 Not valid · 30 Not checked · 54 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The electrodermal response permits to assess the level of arousal: previous studies demonstrated its utility as an objective measure of anxiety under threatening situations or of body illusions29–31.”
§ The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence > Introduction
What the sources say
- Supportedcites [29] Petkova, V. & Ehrsson, H. If I were you: perceptual illusion of body swapping. PLoS ONE 3, e3832 (2008). source
The Results section, under “Physiological evidence for owning a new body,” explicitly uses skin conductance response as an objective measure of anxiety during a threat. The Discussion links threat-evoked skin conductance responses to autonomic arousal and emotional reactions, supporting the claim that electrodermal response can assess arousal in this context. Page numbers are not provided in our copy. (LLM, conf=0.91)
- Not matchedcites [30] Gonzalez-Franco, M., Perez-Marcos, D., Spanlang, B. & Slater, M. in 2010 IEEE virtual reality conference (VR). 111–114 (IEEE).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [31] Slater, M., Spanlang, B., Sanchez-Vives, M. V. & Blanke, O. First person experience of body transfer in virtual reality. PLoS ONE 5, e10564 (2010). source
The Discussion states that skin conductance measures arousal, supporting the claim that electrodermal response can assess arousal. It distinguishes arousal from its emotional valence, which the measure does not identify. (LLM, conf=0.94)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Through EEG measures, we extracted features (i) in the time domain (i.e., ERPs analysis, in particular P300 ERPs) and (ii) in the frequency domain (i.e., EEG frequency bands), both modulated the difficulty of the task variations32–34.”
§ The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence > Introduction
What the sources say
- Not checked — no full text of the sourcecites [32] Arico, P. et al. A passive brain-computer interface application for the mental workload assessment on professional air traffic controllers during realistic air traffic control tasks. Prog. Brain Res. 228, 295–328. https://doi.org/10.1016/bs.pbr.2016.04.021 (2016). source
- Partly supportedcites [33] Di Flumeri, G. et al. EEG-based mental workload neurometric to evaluate the impact of different traffic and road conditions in real driving settings. Front. Hum. Neurosci. 12, 509. https://doi.org/10.3389/fnhum.2018.00509 (2018). sourceExperimental — accuracy not yet measured
Materials and Methods (The Data Collection; page not provided) describes theta and alpha frequency-band features, and Results (Experimental Design Validation; page not provided) reports that an EEG-band indicator increased significantly on the harder road segment. The cited paper does not report P300 ERP or other time-domain features being modulated by task difficulty. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [34] Aloise, F. et al. Asynchronous gaze-independent event-related potential-based brain–computer interface. Artif. Intell. Med. 59, 61–69 (2013). source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Results showed that only in the high load condition, multisensory stimuli significantly improve performance, compared to visual stimulation alone.”
§ The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This trimodal stimulation was more effective in enhancing the sense of presence, that is the feeling of being in the virtual environment, compared to the bimodal or unimodal stimulation.”
§ The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Instead, the perceived workload, according to the “NASA Task Load Index” questionnaire, was reduced only by the trimodal condition (i.e., visual, auditory, tactile).”
§ The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
37 more claims
Create a free account to see all 90 claims and to verify the 7 references still open.
- It may state two separate claims as one. 30
- Probably not a substantial claim. 23
- The quote only partly states this claim. 1
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
de Boor, C. (1978) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-6333-3 · Cited by 11,944
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis
Klimesch, W. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00056-3 · Cited by 6,889
Zhang, J.-H., Chung, T. D. Y., & Oldenburg, K. R. (1999) · SLAS Discovery · doi:10.1177/108705719900400206 · Cited by 6,847
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526
Population Marginal Means in the Linear Model: An Alternative to Least Squares Means
Searle, S. R., Speed, F. M., & Milliken, G. A. (1980) · The American Statistician · doi:10.1080/00031305.1980.10483031 · Cited by 2,215
Research works printed but not linked: 6
- Gonzalez-Franco, M., Perez-Marcos, D., Spanlang, B. & Slater, M. in 2010 IEEE virtual reality conference (VR). 111–114 (IEEE).
- Cartocci, G. et al. in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 1654–1657 (IEEE).
- Fox, J. & Weisberg, S. An R Companion to Applied Regression (Third) (Sage, Thousand Oaks CA, 2019).
- Lenth, R. & Lenth, M. R. Package ‘lsmeans’. Am. Stat. 34(4), 216–221 (2018).
- Osaka, M. et al. in 2012 ICME International Conference on Complex Medical Engineering (CME). 717–721 (IEEE).
- Slater, M., Brogni, A. & Steed, A. in Presence 2003: The 6th Annual International Workshop on Presence. (Citeseer).
Cited by
Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data
Lee, C., Yang, T., Chen, Z., Su, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00150 · Cited by 149
“Research in cross-modal learning [33], [34] and neuroscience [35], [36] suggests that intermediate fusion usually facilitates modeling, so we transform single-modal representations to a compact multi-modal representation via intermediate fusion.”
An Online Framework for Cognitive Load Assessment in Industrial Tasks
Lagomarsino, M., Lorenzini, M., Momi, E. D., & Ajoudani, A. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2022.102380 · Cited by 130
“Researchers use high-resolution EDA for indexing variations in sympathetic arousal associated with emotion, cognition, and attention [28, 29] and today represents one of the preferred metrics for stress [30].”
BackgroundMethodLagomarsino, M., Lorenzini, M., Balatti, P., Momi, E. D., & Ajoudani, A. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3182811 · Cited by 85
“As in [26], we computed the mean value of the SCL and the mean amplitude of the SCR peaks to investigate the stress induced by the entire task on participants.”
BackgroundMethodValidation of a Light EEG-Based Measure for Real-Time Stress Monitoring during Realistic Driving
Sciaraffa, N., Flumeri, G. D., Germano, D., Giorgi, A., Florio, A. D., Borghini, G., Vozzi, A., Ronca, V., Varga, R., van Gasteren, M., et al. (2022) · Brain Sciences · doi:10.3390/brainsci12030304 · Cited by 69
Self-citationVozzi, A., Ronca, V., Aricò, P., Borghini, G., Sciaraffa, N., Cherubino, P., Trettel, A., Babiloni, F., & Flumeri, G. D. (2021) · Sensors · doi:10.3390/s21186088 · Cited by 78
Self-citation
Metadata
- Authors
- Marucci, M., Di Flumeri, G., Borghini, G., Sciaraffa, N., Scandola, M., Pavone, E. F., Babiloni, F., Betti, V., & Aricò, P.
- Affiliations
- Sapienza University of Rome (IT)
- Fondazione Santa Lucia (IT)
- University of Verona (IT)
- Corresponding author
- Marucci, Matteo
- ORCID
- Venue
- Scientific Reports
- Published
- 2021-03-01
- Volume
- 11
- Issue
- 1
- Pages
- 4831-4831
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC7921449
- OpenAlex
- W3135027244
- Cited by
- 170
- References
- 99
- Citations by year
- 2026: 35 · 2025: 38 · 2024: 39 · 2023: 30 · 2022: 20 · 2021: 8
- FWCI
- 23.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- IRIS Research product catalog (Sapienza University of Rome) (submittedVersion, cc-by)
- Funders
- European Commission (699379)
- H2020 European Research Council (759651)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- multisensory integration, perceptual load, virtual reality, target detection, workload, presence, P300, skin conductance, auditory stimulation, vibrotactile stimulation, multimodal stimuli, NASA-TLX
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence. https://app.cochat.ai/papers/10.1038/s41598-021-84196-8
- The paper
- Marucci, M., Di Flumeri, G., Borghini, G., Sciaraffa, N., Scandola, M., Pavone, E. F., Babiloni, F., Betti, V., & Aricò, P. (2021). The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence. Scientific Reports. https://doi.org/10.1038/s41598-021-84196-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.