CoChat

Seeing other perspectives: evaluating the use of virtual and augmented reality to simulate visual impairments (OpenVisSim)

Open access

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.

Abstract

Simulations of visual impairment are used to educate and inform the public. However, evidence regarding their accuracy remains lacking. Here we evaluated the effectiveness of modern digital technologies to simulate the everyday difficulties caused by glaucoma. 23 normally sighted adults performed two everyday tasks that glaucoma patients often report difficulties with: a visual search task in which participants attempted to locate a mobile phone in virtual domestic environments (virtual reality (VR)), and a visual mobility task in which participants navigated a physical, room-scale environment, while impairments were overlaid using augmented reality (AR). On some trials, a gaze-contingent simulated scotoma—generated using perimetric data from a real patient with advanced glaucoma—was presented in either the superior or inferior hemifield. The main outcome measure was task completion time. Eye and head movements were also tracked and used to assess individual differences in looking behaviors. The results showed that the simulated impairments substantially impaired performance in both the VR (visual search) and AR (visual mobility) tasks (both P < 0.001). Furthermore, and in line with previous patient data: impairments were greatest when the simulated Visual Field Loss (VFL) was inferior versus superior (P < 0.001), participants made more eye and head movements in the inferior VFL condition (P < 0.001), and participants rated the inferior VFL condition as more difficult (P < 0.001). Notably, the difference in performance between the inferior and superior conditions was almost as great as the difference between a superior VFL and no impairment at all (VR: 71%; AR: 70%). We conclude that modern digital simulators are able to replicate and objectively quantify some of the key everyday difficulties associated with visual impairments. Advantages, limitations, and possible applications of current technologies are discussed. Instructions are also given for how to freely obtain the software described (OpenVisSim).

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41746-020-0242-6

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Simulations of sight loss. a Example of a conventional depiction of peripheral vision loss (e.g., glaucoma) using a crude method of occlusion. Such simulations are typically regarded as unrealistic by patients2; b Peripheral vision loss as simulated in OpenVisSim. Clinical visual field data from static automated perimetry is used to construct a gaze-contingent field map, which specifies the amount of blur to apply to each pixel. See Methods for details; c Examples of other potential image manipulations supported by OpenVisSim (not evaluated in the present paper). Additional visual disturbances, such as nystagmus, non-stationary warping, dynamic noise, and binocular misalignment (strabismus), are also supported, but cannot be easily illustrated using individual static images. For a video demonstrating many of these effects, see Supplementary Video 1.
Fig. 1 Simulations of sight loss. a Example of a conventional depiction of peripheral vision loss (e.g., glaucoma) using a crude method of occlusion. Such simulations are typically regarded as unrealistic by patients2; b Peripheral vision loss as simulated in OpenVisSim. Clinical visual field data from static automated perimetry is used to construct a gaze-contingent field map, which specifies the amount of blur to apply to each pixel. See Methods for details; c Examples of other potential image manipulations supported by OpenVisSim (not evaluated in the present paper). Additional visual disturbances, such as nystagmus, non-stationary warping, dynamic noise, and binocular misalignment (strabismus), are also supported, but cannot be easily illustrated using individual static images. For a video demonstrating many of these effects, see Supplementary Video 1.CC BY · PubMed Central
Fig. 2 VR search task methods. a Hardware: The Fove0 VR headset with integrated eye tracking, which was worn throughout. b Task: Example screenshots from the VR simulator, while performing the Object Search task. Virtual rooms were configured into a complete ‘suburban style’ house. Depending on the player location, it was often possible to see into other rooms, connecting hallways, etc. For added realism the outdoor scenes were also rendered and could be seen from those rooms with external windows (see top-right panel). On each trial, the target phone (highlighted in the bottom-left panel) was placed at a random location. Examples of the superior and inferior VFL (right-eye only) are depicted in the bottom-middle and bottom-right panels, respectively (NB: the red crosshair indicates current their point of fixation and was not visible to participants). c The empirical perimetric data used to generate the simulated VFL. The superior field-loss measurements were made using Static Automated Perimetry, using a single observer with an established diagnosis of glaucoma (see Methods). The inferior loss is the exact mirror inverse of the superior. See Supplementary Video 2 for an example trial.
Fig. 2 VR search task methods. a Hardware: The Fove0 VR headset with integrated eye tracking, which was worn throughout. b Task: Example screenshots from the VR simulator, while performing the Object Search task. Virtual rooms were configured into a complete ‘suburban style’ house. Depending on the player location, it was often possible to see into other rooms, connecting hallways, etc. For added realism the outdoor scenes were also rendered and could be seen from those rooms with external windows (see top-right panel). On each trial, the target phone (highlighted in the bottom-left panel) was placed at a random location. Examples of the superior and inferior VFL (right-eye only) are depicted in the bottom-middle and bottom-right panels, respectively (NB: the red crosshair indicates current their point of fixation and was not visible to participants). c The empirical perimetric data used to generate the simulated VFL. The superior field-loss measurements were made using Static Automated Perimetry, using a single observer with an established diagnosis of glaucoma (see Methods). The inferior loss is the exact mirror inverse of the superior. See Supplementary Video 2 for an example trial.CC BY · PubMed Central
Fig. 3 AR Visual Mobility task methods. a Hardware: The modified HTC Vive headset, with ZEDmini stereoscopic cameras and integrated Tobii eye-tracking. b Task: Screenshots from four simultaneous camera feeds, recorded during a typical trial of the Visual Mobility task. The participant’s task was to trace an approximately ‘s’ shaped route (green line) from the start point [S] to the finish point [F]. The configuration of the blue partitions, and the exact location of the two foam obstacles (shown in bottom left panel), was varied randomly between trials. An experimenter followed the observer at a safe-distance in case of any trips or accidents. See Bainbridge et al.59 for further details. c The simulated VFL conditions were the same as in the main experiment (Fig. 2). See Supplementary Video 3 for an example trial.
Fig. 3 AR Visual Mobility task methods. a Hardware: The modified HTC Vive headset, with ZEDmini stereoscopic cameras and integrated Tobii eye-tracking. b Task: Screenshots from four simultaneous camera feeds, recorded during a typical trial of the Visual Mobility task. The participant’s task was to trace an approximately ‘s’ shaped route (green line) from the start point [S] to the finish point [F]. The configuration of the blue partitions, and the exact location of the two foam obstacles (shown in bottom left panel), was varied randomly between trials. An experimenter followed the observer at a safe-distance in case of any trips or accidents. See Bainbridge et al.59 for further details. c The simulated VFL conditions were the same as in the main experiment (Fig. 2). See Supplementary Video 3 for an example trial.CC BY · PubMed Central
Fig. 4 Performance on VR search task. a Response time as a function of impairment type (box-and-whisker plots, showing median, interquartile range, and range). Black dots indicate individual participants. P values relate to Wilcoxon signed-rank tests (i.e., non-parametric repeated measures t-tests; see body text for statistics). b Scatter plot showing the cumulative distance traveled by each participant’s head and eyes in a single trial, averaged across all trials. Note the separation between each of the three conditions. c Self-reported difficulty ratings. Lines indicate individual participants, with those who rated the Inferior condition as more difficult highlighted by purple solid line. Black bars indicate group-means and 95% confidence intervals (CI95%). d Group-median response times, ±CI95%. These data are the same as those in panel A, but are here broken down into individual six-trial blocks to assess the consistency of the effect, and possible learning or fatigue.
Fig. 4 Performance on VR search task. a Response time as a function of impairment type (box-and-whisker plots, showing median, interquartile range, and range). Black dots indicate individual participants. P values relate to Wilcoxon signed-rank tests (i.e., non-parametric repeated measures t-tests; see body text for statistics). b Scatter plot showing the cumulative distance traveled by each participant’s head and eyes in a single trial, averaged across all trials. Note the separation between each of the three conditions. c Self-reported difficulty ratings. Lines indicate individual participants, with those who rated the Inferior condition as more difficult highlighted by purple solid line. Black bars indicate group-means and 95% confidence intervals (CI95%). d Group-median response times, ±CI95%. These data are the same as those in panel A, but are here broken down into individual six-trial blocks to assess the consistency of the effect, and possible learning or fatigue.CC BY · PubMed Central
Fig. 5 Looking behaviors during VR search task. a Eyeball orientation in each condition. Each plot is a 3D histogram showing the estimated gaze vector, as measured every 8.3 msec throughout the experiment (~500,000 data points per plot, data averaged across eyes, data from all 19 participants included). These histograms show that participants tended to look downwards in the Superior VFL condition, and upwards in the Inferior VFL condition. b Gaze elevation (in normalized screen units, 0–1) as a function of time for each participant, and the group-mean value across all participants (bottom-right). The 0.5 point indicates the midline of the head-mounted display screen (central fixation). A value of 0.75 indicates fixation around the upper quarter of the screen (+14° above the midline). c Response time as a function of gaze-elevation. Circles represent individual participants (one data-point per participant, per condition). The black curve indicates the best-fitting quadratic model (weighted sum of squares, fitted using bisquare weights).
Fig. 5 Looking behaviors during VR search task. a Eyeball orientation in each condition. Each plot is a 3D histogram showing the estimated gaze vector, as measured every 8.3 msec throughout the experiment (~500,000 data points per plot, data averaged across eyes, data from all 19 participants included). These histograms show that participants tended to look downwards in the Superior VFL condition, and upwards in the Inferior VFL condition. b Gaze elevation (in normalized screen units, 0–1) as a function of time for each participant, and the group-mean value across all participants (bottom-right). The 0.5 point indicates the midline of the head-mounted display screen (central fixation). A value of 0.75 indicates fixation around the upper quarter of the screen (+14° above the midline). c Response time as a function of gaze-elevation. Circles represent individual participants (one data-point per participant, per condition). The black curve indicates the best-fitting quadratic model (weighted sum of squares, fitted using bisquare weights).CC BY · PubMed Central
Fig. 6 Performance on AR visual. Panels show maze completions times under a Photopic and b Mesopic lighting conditions. Each line indicates a single participant (same individuals in both conditions).
Fig. 6 Performance on AR visual. Panels show maze completions times under a Photopic and b Mesopic lighting conditions. Each line indicates a single participant (same individuals in both conditions).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 59 references

Research works printed but not linked: 2

  1. Geisler, W. S. & Perry, J. S. in Proceedings of the 2002 symposium on Eye tracking research & applications. 83–87 (2002).
  2. Peli, E. in Visual Instrumentation: Optical Design And Engineering Principles (ed. Mouroulis, P.) 205–276 (McGraw-Hill New York, 1999).

Cited by

See all 91

Metadata

Authors
Jones, P. R., Somoskeöy, T., Chow-Wing-Bom, H., & Crabb, D. P.
Affiliations
  • University of London (GB)
  • NIHR Moorfields Biomedical Research Centre (GB)
Corresponding author
Jones, Pete R.
Venue
npj Digital Medicine
Published
2020-03-10
Volume
3
Issue
1
Pages
32-32
ISSN
2398-6352 (ISSN-L)
OpenAlex
W3010216189
Cited by
79
References
59
Citations by year
2026: 8 · 2025: 21 · 2024: 11 · 2023: 12 · 2022: 6 · 2021: 17 · 2020: 3
FWCI
7.53
Type
journal article
Language
en
Open access
Licence
Locations
  • npj Digital Medicine (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • City Research Online (City University London) (acceptedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UCL Discovery (University College London) (submittedVersion)
Funders
Fight for Sight UK (1854/1855)
Topics
  • Health Sciences › Medicine › Ophthalmology › Glaucoma and retinal disorders
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
  • Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Impairment Studies
Keywords
glaucoma, visual impairment simulation, virtual reality, augmented reality, visual field defects, visual search, eye movements, head movement, accessibility education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Seeing other perspectives: evaluating the use of virtual and augmented reality to simulate visual impairments (OpenVisSim). https://app.cochat.ai/papers/10.1038/s41746-020-0242-6
The paper
Jones, P. R., Somoskeöy, T., Chow-Wing-Bom, H., & Crabb, D. P. (2020). Seeing other perspectives: evaluating the use of virtual and augmented reality to simulate visual impairments (OpenVisSim). npj Digital Medicine. https://doi.org/10.1038/s41746-020-0242-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.