Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 224 of the 229 references it cites were found in a registry or an index; 30 of the 150 sources its claims cite were checked for support.

Designing sensory-substitution devices: Principles, pitfalls and potential1

Open access
Kristjánsson, Árni, Moldoveanu, Alin, Jóhannesson, Ómar I., Balan, Oana, Spagnol, Simone, Valgeirsdóttir, Vigdís Vala, Unnthorsson, Rúnar · 2016 · Restorative Neurology and Neuroscience

Abstract

An exciting possibility for compensating for loss of sensory function is to augment deficient senses by conveying missing information through an intact sense. Here we present an overview of techniques that have been developed for sensory substitution (SS) for the blind, through both touch and audition, with special emphasis on the importance of training for the use of such devices, while highlighting potential pitfalls in their design. One example of a pitfall is how conveying extra information about the environment risks sensory overload. Related to this, the limits of attentional capacity make it important to focus on key information and avoid redundancies. Also, differences in processing characteristics and bandwidth between sensory systems severely constrain the information that can be conveyed. Furthermore, perception is a continuous process and does not involve a snapshot of the environment. Design of sensory substitution devices therefore requires assessment of the nature of spatiotemporal continuity for the different senses. Basic psychophysical and neuroscientific research into representations of the environment and the most effective ways of conveying information should lead to better design of sensory substitution systems. Sensory substitution devices should emphasize usability, and should not interfere with other inter- or intramodal perceptual function. Devices should be task-focused since in many cases it may be impractical to convey too many aspects of the environment. Evidence for multisensory integration in the representation of the environment suggests that researchers should not limit themselves to a single modality in their design. Finally, we recommend active training on devices, especially since it allows for externalization, where proximal sensory stimulation is attributed to a distinct exterior object.

Overview

CoChat Summary

TL;DR

This review argues that sensory substitution devices for blindness should be designed around psychophysical limits, attentional capacity, task focus, and multisensory integration, with active training to promote externalization. It surveys haptic and auditory approaches and highlights pitfalls such as sensory overload, bandwidth mismatches, and insufficient basic research.

Key findings

  • Sensory bandwidth differs greatly: the optic nerve contains over 1 million fibers versus around 30,000 in the auditory nerve, and vision has four orders of magnitude greater bandwidth than haptic perception; two-point tactile thresholds range from ∼3–4 mm on the fingers to over 40 mm on the thighs and calves.
  • Training and externalization are central: Bach-y-Rita et al. (1969) found object recognition after 5–15 h of training; Sampaio et al. (2001) reported tongue-SSD acuity of 20/860 on average, doubling after 9 h of training; Striem-Amit et al. (2012a) used 73 h of vOICe training, with 55% showing acuity above the blindness threshold; Auvray et al. (2007) found object identification after 15 h of vOICe training.
  • Design should avoid sensory overload and task-irrelevant information; attentional limits and within-modality interference mean devices should convey critical information and not interfere with natural audition, while multisensory integration suggests combining haptics and audition may help.
  • Neural evidence indicates that “visual” areas can serve supramodal functions in blind users, with activation of regions such as LOC, VWFA, and FFA during tactile or auditory tasks, and active interaction may produce more visual-cortex activity than passive processing.

Methods

  • Design: narrative review/overview of sensory substitution for blindness through touch and audition, emphasizing training, design pitfalls, and potential.
  • Data or sample: synthesizes prior psychophysical, neuroimaging, TMS, animal-deprivation, and SSD studies; no new empirical sample is reported.
  • Main analysis: thematic discussion of principles, pitfalls, and potential, including bandwidth, attention, externalization, multisensory integration, and training.

Limitations

  • The paper states that the literature lacks clear and precise training guidelines for SSDs and that no studies have yet addressed training systematically; evidence for enhanced brain capacity through training is scarce, and video-game/brain-training claims are confounded or task-specific.
  • The paper notes controversy over whether blind individuals have better tactile acuity and caveats that multisensory integration can be worse with impaired senses, with visual experience possibly needed for crossmodal calibration.
  • Evident from the text: as a narrative review, it does not report a systematic search or selection protocol or primary data, and many conclusions rely on cited studies with varying designs and populations.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3233/rnn-160647

Cites

224 of 224 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

26 Valid · 4 Not valid · 74 Not checked · 40 Own results and interpretations

86 more claims · 18 with their cited sources checked

Create a free account to see all 144 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 30
  • It may state two separate claims as one. 32

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 229 references

Research works printed but not linked: 5

  1. Grimes, 1996, Vancouver studies in cognitive science: 5. Perception, 89
  2. Neisser, 1967, Cognitive Psychology.
  3. Stein, 1993, The Merging of the Senses.
  4. Weinstein, 1968, The Skin Senses, 195
  5. Wurtz, 2000, of neural science, 523

Cited by

See all 117

Metadata

Authors
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R.
Affiliations
  • Laboratory of Visual Perception and Visuomotor control, University of Iceland, Faculty of Psychology, School of Health Sciences, Reykjavik, Iceland
  • Universitatea Națională de Știință și Tehnologie Politehnica București (RO)
  • University of Iceland (IS)
  • Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, School of Engineering and Natural Sciences, Reykjavik, Iceland
Venue
Restorative Neurology and Neuroscience
Published
2016-09-21
Volume
34
Issue
5
Pages
769-787
ISSN
  • 0922-6028 (ISSN-L)
  • 1878-3627
OpenAlex
W2510919644
Cited by
116
References
229
Citations by year
2026: 13 · 2025: 14 · 2024: 6 · 2023: 16 · 2022: 14 · 2021: 14 · 2020: 9 · 2019: 12 · 2018: 14 · 2017: 4
FWCI
1.07
Type
journal article
Language
en
Open access
Locations
  • Restorative Neurology and Neuroscience (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • AirIuav (Università Iuav di Venezia) (submittedVersion, other-oa)
  • Opin vísindi (Opin vísindi) (submittedVersion, cc-by-nc)
Funders
European Commission (HORIZON2020, 643636)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
Keywords
sensory substitution, blind people, sensory deprivation, sensory overload, attentional capacity, spatiotemporal continuity, multisensory integration, device training, externalization, usability
MeSH terms
Biofeedback, Psychology, Humans, Perception, Psychophysics, Sensation Disorders, Sensory Aids, Neuroimaging

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Designing sensory-substitution devices: Principles, pitfalls and potential1. https://app.cochat.ai/papers/10.3233/rnn-160647
The paper
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016). Designing sensory-substitution devices: Principles, pitfalls and potential1. Restorative Neurology and Neuroscience. https://doi.org/10.3233/rnn-160647

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.