Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index; 2 of the 14 sources its claims cite were checked for support.

Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality

Open access
Lang, Florian, Machulla, Tonja · 2021 · Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

Abstract

Partial vision loss occurs in several medical conditions and affects persons of all ages. It compromises many daily activities, such as reading, cutting vegetables, or identifying and accurately pressing buttons, e.g., on ticket machines or ATMs. Touchscreen interfaces pose a particular challenge because they lack haptic feedback from interface elements and often require people with impaired vision to rely on others for help. We propose a smartglasses-based solution to utilize the user’s residual vision. Together with visually-impaired individuals, we designed assistive augmentations for touchscreen interfaces and evaluated their suitability to guide attention towards interface elements and to increase the accuracy of manual inputs. We show that augmentations improve interaction performance and decrease cognitive load, particularly for unfamiliar interface layouts.

Overview

CoChat Summary

TL;DR

This paper evaluates five AR visual augmentations for helping people with low vision press touchscreen buttons more accurately and quickly. It finds that augmentations improve task completion and reduce perceived workload overall, but the best design varies across individuals and interface familiarity.

Key findings

  • For UnfamiliarLayout, task completion time decreased significantly with augmentation: 5.7 s in baseline vs. 3.5 s with augmentation. For FamiliarLayout, time also decreased from 2.7 s to 1.9 s, but this was not significant.
  • Error rates dropped with augmentation in both scenarios: FamiliarLayout 0.33 → 0.19 and UnfamiliarLayout 0.24 → 0.18; the paper says this reduction was significant for FamiliarLayout.
  • NASA-TLX workload was lower with augmentation: 33% lower in FamiliarLayout and 41% lower in UnfamiliarLayout (46 → 30 and 55 → 36, respectively; p = 0.08 and p = 0.01). Mental demand and effort were also reduced; for UnfamiliarLayout, temporal and physical demand were additionally reduced.
  • No augmentation type clearly outperformed the others at the group level: the paper reports no significant differences among augmentations, though preferences differed by participant; for example, 5/13 preferred Circle, 5/13 preferred SimpleCross, and 3/13 preferred Star.

Methods

  • Design: Within-subject study with two scenarios: FamiliarLayout (a keyboard-like layout) and UnfamiliarLayout (same grid size/appearance but randomized letters). Each scenario had six conditions: baseline plus five augmentations.
  • Sample/data: 16 participants (8 female, 8 male; mean age 54.9 years, SD 18.2), all with visual impairment; three participants could not use the technology as intended and were handled with a demonstration-like approach, and four participants could not complete baseline but completed augmented conditions.
  • Analysis: Measured task completion time, error rate, and NASA-TLX workload; used planned contrasts, pairwise Welch t-tests, and Wilcoxon signed-rank tests for NASA-TLX.

Limitations

  • The paper states that the HoloLens augmentable field of view is limited to 30° horizontally and 17.5° vertically, and that the device is heavy and quite large; it also notes that improved tracking close to a surface is needed.
  • The authors note the approach may not suit people with large central visual field defects, those with difficulty perceiving screen-spanning augmentations as a whole, or those who need close-up inspection of the interface.
  • Evident from the text: there is substantial interindividual variability, and some participants could not perceive the baseline interface at all, which means baseline comparisons used a reduced subset of participants for RQ1 and RQ3.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3489849.3489873

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

2 Valid · 0 Not valid · 5 Not checked · 86 Own results and interpretations

39 more claims

Create a free account to see all 93 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 20
  • It may state two separate claims as one. 34
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Not confirmedz = 1.48reported p = .08 · recomputed p = .139

    “(Z=1.48,p = .08”

  • Not confirmedz = 2.31reported p = .01 · recomputed p = .021

    “Z=2.31, p = .01”

  • Not confirmedz = 2reported p = .03 · recomputed p = .046

    “Z=2.0, p = .03”

  • Not confirmedz = 2reported p = .03 · recomputed p = .046

    “;Z=2.0, p = .03”

  • Not confirmedz = 1.6reported p = .06 · recomputed p = .110

    “Z=1.6, p = .06”

5 of 8 · the rest aren’t loaded

3 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 28 references

Research works printed but not linked: 6

  1. Anhong Guo Xiang Chen Haoran Qi Samuel White Suman Ghosh Chieko Asakawa and Jeffrey Bigham. 2016. VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World. 651-664. https://doi.org/10.1145/2984511.2984518 · DOI · Paper page
  2. Albouys Perrois Jérémy Jeremy Laviole Carine Briant and Anke Brock. 2018. Towards a Multisensory Augmented Reality Map for Blind and Low Vision People: a Participatory Design Approach. 1-14. https://doi.org/10.1145/3173574.3174203 · DOI · Paper page
  3. Patrick Renner and Thies Pfeiffer. 2017. Attention guiding techniques using peripheral vision and eye tracking for feedback in augmented-reality-based assistance systems. 186-194. https://doi.org/10.1109/3DUI.2017.7893338 · DOI
  4. Lee Stearns Victor DeSouza Jessica Yin Leah Findlater and Jon Froehlich. 2017. Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera. 361-362. https://doi.org/10.1145/3132525.3134812 · DOI
  5. Yuhang Zhao Sarit Szpiro and Shiri Azenkot. 2015. ForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision. 239-249. https://doi.org/10.1145/2700648.2809865 · DOI · Paper page
  6. Yuhang Zhao Sarit Szpiro Jonathan Knighten and Shiri Azenkot. 2016. CueSee: exploring visual cues for people with low vision to facilitate a visual search task. 73-84. https://doi.org/10.1145/2971648.2971730 · DOI · Paper page

Cited by

See all 32

Metadata

Authors
Lang, F., & Machulla, T.
Affiliations
  • LMU Munich, Germany
  • TU Dortmund University (DE)
Venue
Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology
Publisher
ACM
Published
2021-12-08
Pages
1-10
OpenAlex
W3215040104
Cited by
32
References
28
Citations by year
2026: 6 · 2025: 13 · 2024: 5 · 2023: 5 · 2022: 3
FWCI
1.01
Type
conference paper
Language
en
Open access
Locations
ACM Symposium on Virtual Reality Software and Technology (VRST) (publishedVersion, cc-by-nc-sa)
Funders
  • Bundesministerium für Bildung und Forschung (16SV8102 IDeA)
  • H2020 European Research Council (683008 AMPLIFY)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
Keywords
low vision, augmented reality, smart glasses, assistive technology, touch screen interface, haptic feedback, attention guidance, cognitive load, user interface layout, visual impairment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality. https://app.cochat.ai/papers/10.1145/3489849.3489873
The paper
Lang, F., & Machulla, T. (2021). Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality. Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. https://doi.org/10.1145/3489849.3489873

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.