Designing sensory-substitution devices: Principles, pitfalls and potential1
Open accessThe DOI matches its Crossref record; 224 of the 229 references it cites were found in a registry or an index; 30 of the 150 sources its claims cite were checked for support.
Abstract
An exciting possibility for compensating for loss of sensory function is to augment deficient senses by conveying missing information through an intact sense. Here we present an overview of techniques that have been developed for sensory substitution (SS) for the blind, through both touch and audition, with special emphasis on the importance of training for the use of such devices, while highlighting potential pitfalls in their design. One example of a pitfall is how conveying extra information about the environment risks sensory overload. Related to this, the limits of attentional capacity make it important to focus on key information and avoid redundancies. Also, differences in processing characteristics and bandwidth between sensory systems severely constrain the information that can be conveyed. Furthermore, perception is a continuous process and does not involve a snapshot of the environment. Design of sensory substitution devices therefore requires assessment of the nature of spatiotemporal continuity for the different senses. Basic psychophysical and neuroscientific research into representations of the environment and the most effective ways of conveying information should lead to better design of sensory substitution systems. Sensory substitution devices should emphasize usability, and should not interfere with other inter- or intramodal perceptual function. Devices should be task-focused since in many cases it may be impractical to convey too many aspects of the environment. Evidence for multisensory integration in the representation of the environment suggests that researchers should not limit themselves to a single modality in their design. Finally, we recommend active training on devices, especially since it allows for externalization, where proximal sensory stimulation is attributed to a distinct exterior object.
Overview
CoChat Summary
TL;DR
This review argues that sensory substitution devices for blindness should be designed around psychophysical limits, attentional capacity, task focus, and multisensory integration, with active training to promote externalization. It surveys haptic and auditory approaches and highlights pitfalls such as sensory overload, bandwidth mismatches, and insufficient basic research.
Key findings
- Sensory bandwidth differs greatly: the optic nerve contains over 1 million fibers versus around 30,000 in the auditory nerve, and vision has four orders of magnitude greater bandwidth than haptic perception; two-point tactile thresholds range from ∼3–4 mm on the fingers to over 40 mm on the thighs and calves.
- Training and externalization are central: Bach-y-Rita et al. (1969) found object recognition after 5–15 h of training; Sampaio et al. (2001) reported tongue-SSD acuity of 20/860 on average, doubling after 9 h of training; Striem-Amit et al. (2012a) used 73 h of vOICe training, with 55% showing acuity above the blindness threshold; Auvray et al. (2007) found object identification after 15 h of vOICe training.
- Design should avoid sensory overload and task-irrelevant information; attentional limits and within-modality interference mean devices should convey critical information and not interfere with natural audition, while multisensory integration suggests combining haptics and audition may help.
- Neural evidence indicates that “visual” areas can serve supramodal functions in blind users, with activation of regions such as LOC, VWFA, and FFA during tactile or auditory tasks, and active interaction may produce more visual-cortex activity than passive processing.
Methods
- Design: narrative review/overview of sensory substitution for blindness through touch and audition, emphasizing training, design pitfalls, and potential.
- Data or sample: synthesizes prior psychophysical, neuroimaging, TMS, animal-deprivation, and SSD studies; no new empirical sample is reported.
- Main analysis: thematic discussion of principles, pitfalls, and potential, including bandwidth, attention, externalization, multisensory integration, and training.
Limitations
- The paper states that the literature lacks clear and precise training guidelines for SSDs and that no studies have yet addressed training systematically; evidence for enhanced brain capacity through training is scarce, and video-game/brain-training claims are confounded or task-specific.
- The paper notes controversy over whether blind individuals have better tactile acuity and caveats that multisensory integration can be worse with impaired senses, with visual experience possibly needed for crossmodal calibration.
- Evident from the text: as a narrative review, it does not report a systematic search or selection protocol or primary data, and many conclusions rely on cited studies with varying designs and populations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
26 Valid · 4 Not valid · 74 Not checked · 40 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Brown, Simpson and Proulx (2014) found that there is an upper limit to representation of auditory objects due to intrinsic limits of transmission in auditory cortical areas.”
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > Key general considerations for sensory substitution
What the sources say
- Partly supportedcites Brown, Simpson and Proulx (2014) sourceExperimental — accuracy not yet measured
The Discussion reports an apparent 8 × 8-pixel ceiling in object recognition by naïve sensory-substitution users and proposes that limits in the ascending auditory hierarchy may explain it. It does not establish intrinsic cortical transmission limits as the cause; the authors describe that explanation as a postulate. Page numbers are not provided in our copy. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Such evidence suggests that the loss of one perceptual channel can be compensated for by higher resolution activity in another (Gougoux et al., 2004; Stevens & Weaver, 2009).”
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > Neural evidence regarding sensory substitution
What the sources say
- Not checked — no full text of the sourcecites Gougoux et al., 2004 source
- Partly supportedcites Stevens & Weaver, 2009 sourceExperimental — accuracy not yet measured
The paper’s discussion of early-onset blindness (page unavailable in our copy) reports superior auditory abilities, including greater temporal and spectral processing, and proposes that auditory cortical plasticity may contribute. Its own results concern altered activity during passive listening, not a measured increase in auditory resolution. The claim also generalizes from vision and hearing to any pair of perceptual channels. (LLM, conf=0.84)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The literature on multimodal interactions (see e.g. Deroy, Chen & Spence, 2014; Driver & Spence, 2000; Koelewijn, Bronkhorst & Theeuwes, 2010; Kristjánsson, Thorvaldsson, & Kristjánsson, 2014; Stein & Meredith, 1993) makes clear that a holistic picture of perceptual representation cannot be constructed without understanding multisensory interactions.”
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > Research on similarities and differences between perceptual processing in different modalities
What the sources say
- Supportedcites Deroy, Chen & Spence, 2014 source
The Introduction argues that the paradigmatic case of perceptual awareness is likely to be multisensory and criticizes theories that study awareness one sense at a time. This supports the citing sentence’s broad point that an account of perception needs to consider multisensory interactions; the paper does not assume that those interactions always produce a unified percept. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites Driver & Spence, 2000 source
- Not matchedcites Stein & Meredith, 1993
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although this presents many challenges, a feedback system that codes the environment through haptics and audition in conjunction may compensate for the drawbacks of using only each individual sense if strengths are strategically utilized and weaknesses avoided (Shull & Damian, 2015).”
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > The possibility of combining haptics and audition for sensory substitution
What the sources say
- Partly supportedcites Shull & Damian, 2015 sourceExperimental — accuracy not yet measured
The “Vision aid for the blind” section (page not provided) describes haptic feedback that conveys information about objects and obstacles in the environment. The Conclusions (page not provided) advocate combining multiple haptic modalities, but the copy does not say that jointly coding the environment through haptics and audition compensates for the drawbacks of either sense alone. (LLM, conf=0.83)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Neural activity related to multisensory interactions can be seen surprisingly close to cortical areas typically considered unimodal (Driver & Noesselt, 2008).”
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > Research on similarities and differences between perceptual processing in different modalities
What the sources say
- Supportedcites Driver & Noesselt, 2008 source
The section ‘Different Accounts and Possible Architectures for Multisensory Influences on “Sensory-Specific” Processing’ describes multisensory zones adjacent to sensory-specific cortex and rapid multisensory effects in and around auditory cortex. This supports the claim that such activity occurs close to areas traditionally considered unimodal; no page number is supplied in our copy. (LLM, conf=0.92)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
86 more claims · 18 with their cited sources checked
Create a free account to see all 144 claims and every source verdict.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 32
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > Neural evidence regarding sensory substitution
“Poirier et al. (2007; see also Renier et al., 2005) show how tactile stimulation can cause activity change in visual areas.”
§ Designing sensory-substitution devices: Principles, pitfalls and potential1 > References
“Poirier C., De Volder A., Tranduy D., & Scheiber C.,. 2007 Pattern recognition using a device substituting audition for vision in blindfolded sighted subjects.”
Citations
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 11×
“Furthermore, recruitment of unused visual cortex can help with compensation for the loss of vision (Pasqualotto & Proulx, 2012; Merabet & PascualLeone, 2010).”
BackgroundInfluentialHearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 2×
“The McGurk effect is another example of a multimodal illusion where lip movements and heard speech interact (McGurk & MacDonald, 1976).”
BackgroundControlled and automatic human information processing: I. Detection, search, and attention.
Schneider, W., & Shiffrin, R. M. (1977) · Psychological Review · doi:10.1037/0033-295x.84.1.1 · Cited by 5,902 · cited 1×
“Humans can only process a limited amount of the information hitting their senses at a given time, since attentional capacity is severely limited (Broadbent, 1958; Treisman, 1960; Neisser, 1967; Most et al., 2005; Kristjánsson, 2006; Schneider & Shiffrin, 1977).”
BackgroundHumans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844 · cited 1×
“In another study, Ernst and Banks (2002) observed that while both haptics and vision conveyed accurate information about the height of a bar this was much less reliable for touch than vision.”
Background(2016) · Interpersonal Communication · doi:10.4324/9781315506173-8 · Cited by 4,693
Broadbent, D. E. (1958) · doi:10.1037/10037-000 · Cited by 4,337
PENFIELD, W., & BOLDREY, E. (1937) · Brain · doi:10.1093/brain/60.4.389 · Cited by 4,188 · cited 2×
“They found that cross-modal plasticity developed rapidly and that the occipital cortex was involved in tactile discrimination.”
BackgroundHenry, M. A. (1995) · The Journal of the American Dental Association · doi:10.14219/jada.archive.1995.0108 · Cited by 3,416
The period of susceptibility to the physiological effects of unilateral eye closure in kittens
Hubel, D. H., & Wiesel, T. N. (1970) · The Journal of Physiology · doi:10.1113/jphysiol.1970.sp009022 · Cited by 3,030 · cited 1×
“The brain is capable of considerable reorganization of neural function (Held et al., 2011; Rauschecker, 1995), while younger brains are typically more flexible (Hubel & Wiesel, 1970; Merabet & Pascual-Leone, 2010).”
BackgroundTo See or not to See: The Need for Attention to Perceive Changes in Scenes
Rensink, R. A., O'Regan, J. K., & Clark, J. J. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00427.x · Cited by 2,338
(1999) · Cited by 2,243
Increased Cortical Representation of the Fingers of the Left Hand in String Players
Elbert, T., Pantev, C., Wienbruch, C., Rockstroh, B., & Taub, E. (1995) · Science · doi:10.1126/science.270.5234.305 · Cited by 2,054
Cohen, L., Dehaene, S., Naccache, L., Lehéricy, S., Dehaene-Lambertz, G., Hénaff, M.-A., & Michel, F. (2000) · Brain · doi:10.1093/brain/123.2.291 · Cited by 1,954 · cited 4×
“The Visual Form Word Area (VWFA; Cohen et al., 2000; Sigurdardottir et al., 2015) was activated in the blind when they processed letter soundscapes, following a 2 h training session (see also Reich et al., 2011).”
BackgroundMethodInfluentialThe plastic human brain cortex
Pascual-Leone, A., Amedi, A., Fregni, F., & Merabet, L. B. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144216 · Cited by 1,929 · cited 2×
“Extensive practice on particular dimensions can lead to structural changes in neural mechanisms (Pascual-Leone et al., 2005), such as Braille (Hamilton & PascualLeone, 1998; Pascual-Leone & Torres, 1993) and music (Elbert et al.”
BackgroundMack, A., & Rock, I. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/3707.001.0001 · Cited by 1,593
Gibson, J. J. (1962) · Psychological Review · doi:10.1037/h0046962 · Cited by 1,435 · cited 2×
“But they also emphasize that effective resolution can be increased through patterns of stimulation (Gibson, 1962; Loomis et al., 2012; Novich & Eagleman, 2015).”
BackgroundShams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262
Activation of the primary visual cortex by Braille reading in blind subjects
Sadato, N., Pascual-Leone, A., Grafman, J., Ibañez, V., Deiber, M.-P., Dold, G., & Hallett, M. (1996) · Nature · doi:10.1038/380526a0 · Cited by 1,253 · cited 1×
“Blind participants show activation of primary and secondary visual cortex from tactile stimulation during Braille reading (Sadato et al., 1996).”
BackgroundContextual cues in selective listening
Treisman, A. M. (1960) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216008416732 · Cited by 1,067 · cited 2×
“Humans can only process a limited amount of the information hitting their senses at a given time, since attentional capacity is severely limited (Broadbent, 1958; Treisman, 1960; Neisser, 1967; Most et al., 2005; Kristjánsson, 2006; Schneider & Shiffrin, 1977).”
BackgroundPutting brain training to the test
Owen, A. M., Hampshire, A., Grahn, J. A., Stenton, R., Dajani, S., Burns, A. S., Howard, R. J., & Ballard, C. G. (2010) · Nature · doi:10.1038/nature09042 · Cited by 1,056 · cited 2×
“Although promising, on closer look, the video-game literature is fraught with confounds, ambiguities and overclaims regarding causal influences of such training (Boot, Blakely, & Simons, 2011; Kristjánsson, 2013), and benefits from braintraining games appear to be task specific (Owen et al., 2010).”
BackgroundControl strategies for active lower extremity prosthetics and orthotics: a review
Tucker, M. R., Olivier, J., Pagel, A., Bleuler, H., Bouri, M., Lambercy, O., Millán, J. D. R., Riener, R., Vallery, H., & Gassert, R. (2015) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-12-1 · Cited by 1,047
Development of the brain depends on the visual environment
BLAKEMORE, C., & COOPER, G. F. (1970) · Nature · doi:10.1038/228477a0 · Cited by 1,005 · cited 2×
“Also, echolocation has been found to lead to activity in higher order visual areas, for various tasks such as material processing (Milne et al., 2015), and motion (Thaler et al., 2014).”
BackgroundVision substitution by tactile image projection
BACH-Y-RITA, P., COLLINS, C. C., SAUNDERS, F. A., WHITE, B., & SCADDEN, L. (1969) · Nature · doi:10.1038/221963a0 · Cited by 956 · cited 1×
“In a pioneering study, Bach-Y-Rita et al. (1969) developed a chair that conveyed tactile stimulation based on a 20 by 20 stimulation grid applied to participants’ backs.”
BackgroundDriver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940 · cited 1×
“Neural activity related to multisensory interactions can be seen surprisingly close to cortical areas typically considered unimodal (Driver & Noesselt, 2008).”
BackgroundFunctional relevance of cross-modal plasticity in blind humans
Cohen, L. G., Celnik, P., Pascual-Leone, A., Corwell, B., Faiz, L., Dambrosia, J., Honda, M., Sadato, N., Gerloff, C., Catala´, M. D., et al. (1997) · Nature · doi:10.1038/38278 · Cited by 911 · cited 1×
“Additionally, neural disruption of visual cortex with TMS interferes with Braille reading (Cohen et al., 1997; Kupers et al., 2007).”
Background(1983) · Medical Entomology and Zoology · Cited by 909
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · cited 1×
“The vOICe sonic imaging system (Meijer, 1992; OIC: “Oh, I see”), transforms elements of a digital image of the environment into a sound pattern.”
MethodSensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · cited 3×
“The pattern of stimulation may be detected and perceptual interpretation can functionally result in better resolution than 2-point thresholds dictate (Bach-Y-Rita & Kercel, 2003).”
BackgroundResultVision Science: Photons to Phenomenology
Lindsey, D. T. (2000) · Optometry and Vision Science · doi:10.1097/00006324-200005000-00008 · Cited by 855
Increased auditory cortical representation in musicians
Pantev, C., Oostenveld, R., Engelien, A., Ross, B., Roberts, L. E., & Hoke, M. (1998) · Nature · doi:10.1038/33918 · Cited by 853 · cited 2×
“, 1995) and cortical representations for musical tones are enlarged in experienced musicians (Pantev et al., 1998; Schlaug et al., 1997).”
BackgroundSubretinal electronic chips allow blind patients to read letters and combine them to words
Zrenner, E., Bartz-Schmidt, K. U., Benav, H., Besch, D., Bruckmann, A., Gabel, V.-P., Gekeler, F., Greppmaier, U., Harscher, A., Kibbel, S., et al. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.1747 · Cited by 819 · cited 1×
“, 2001), retinal prostheses (Zrenner et al., 2010) and 55% showed acuity higher than the threshold for blindness (see also Levy-Tzedek, Riemer, & Amedi, 2014).”
BackgroundIn Vivo Evidence of Structural Brain Asymmetry in Musicians
Schlaug, G., Jäncke, L., Huang, Y., & Steinmetz, H. (1995) · Science · doi:10.1126/science.7839149 · Cited by 789
Neural reorganization following sensory loss: the opportunity of change
Merabet, L. B., & Pascual-Leone, A. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2758 · Cited by 751 · cited 4×
“At the same time, however, the human nervous system shows impressive flexibility (Merabet & Pascual-Leone, 2010).”
BackgroundInfluentialA trial studying approach to predict college achievement
Meijer, R. R., & Niessen, A. S. M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00887 · Cited by 711
Change-blindness as a result of ‘mudsplashes’
O'Regan, J. K., Rensink, R. A., & Clark, J. J. (1999) · Nature · doi:10.1038/17953 · Cited by 676
Exercising your brain: A review of human brain plasticity and training-induced learning.
Green, C. S., & Bavelier, D. (2008) · Psychology and Aging · doi:10.1037/a0014345 · Cited by 660 · cited 1×
“An example of this is the recent trend for brain-training games (Green & Bavelier, 2008).”
BackgroundA selective review of selective attention research from the past century
Driver, J. (2001) · British Journal of Psychology · doi:10.1348/000712601162103 · Cited by 658 · cited 1×
“A lot of information goes unnoticed because selective attention filters it out (Broadbent, 1958; see e.g. Driver, 2001 for review).”
BackgroundWearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey
Dakopoulos, D., & Bourbakis, N. G. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2021255 · Cited by 654
Plasticity of the sensorimotor cortex representation of the reading finger in Braille readers
Pascual-Leone, A., & Torres, F. (1993) · Brain · doi:10.1093/brain/116.1.39 · Cited by 651 · cited 1×
“…dimensions can lead to structural changes in neural mechanisms (Pascual-Leone et al., 2005), such as Braille (Hamilton & PascualLeone, 1998; Pascual-Leone & Torres, 1993) and music (Elbert et al., 1995) and cortical representations for musical tones are enlarged in experienced musicians…”
BackgroundVisuo-haptic object-related activation in the ventral visual pathway
Amedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001) · Nature Neuroscience · doi:10.1038/85201 · Cited by 630
Introduction to Research Topic – Binocular Rivalry: A Gateway to Studying Consciousness
Maier, A., Panagiotaropoulos, T. I., Tsuchiya, N., & Keliris, G. A. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00263 · Cited by 629
Compensatory plasticity and sensory substitution in the cerebral cortex
Rauschecker, J. P. (1995) · Trends in Neurosciences · doi:10.1016/0166-2236(95)93948-w · Cited by 590
Multisensory integration and the body schema: Close to hand and within reach
Maravita, A., Spence, C., & Driver, J. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00449-4 · Cited by 578 · cited 2×
“, 2005; Hartcher-O’Brien & Auvray, 2014), so that the haptic pressure picked up by mechanical receptors on the hand is experienced as occurring at the tip of the cane, making use of the “out-of-body” illusion (Maravita et al., 2003).”
BackgroundBrain plasticity through the life span: Learning to learn and action video games
Bavelier, D., Green, C. S., Pouget, A., & Schrater, P. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152832 · Cited by 541 · cited 2×
“Another example is the literature on videogame training, where it has been claimed that playing first-person action video-games can enhance attentional abilities and that this learning transfers readily to other tasks (Bavelier et al., 2012, Spence & Feng, 2010).”
BackgroundWhat You See Is What You Set: Sustained Inattentional Blindness and the Capture of Awareness.
Most, S. B., Scholl, B. J., Clifford, E. R., & Simons, D. J. (2005) · Psychological Review · doi:10.1037/0033-295x.112.1.217 · Cited by 521 · cited 2×
“Humans can only process a limited amount of the information hitting their senses at a given time, since attentional capacity is severely limited (Broadbent, 1958; Treisman, 1960; Neisser, 1967; Most et al., 2005; Kristjánsson, 2006; Schneider & Shiffrin, 1977).”
BackgroundThe Cutaneous "Rabbit": A Perceptual Illusion
Geldard, F. A., & Sherrick, C. E. (1972) · Science · doi:10.1126/science.178.4057.178 · Cited by 517 · cited 1×
“The cutaneous rabbit illusion (Geldard & Sherrick, 1972) involves a rapid repeated stimulation sequence at several locations on the skin that causes the perception of stimulation at intervening spaces between the locations that are actually stimulated.”
BackgroundInvolvement of visual cortex in tactile discrimination of orientation
Zangaladze, A., Epstein, C. M., Grafton, S. T., & Sathian, K. (1999) · Nature · doi:10.1038/44139 · Cited by 508 · cited 1×
“Zangaladze et al. (1999) found that TMS to regions typically considered primarily visual disrupted tactile discrimination.”
BackgroundVideo Games and Spatial Cognition
Spence, I., & Feng, J. (2010) · Review of General Psychology · doi:10.1037/a0019491 · Cited by 504 · cited 2×
“Another example is the literature on videogame training, where it has been claimed that playing first-person action video-games can enhance attentional abilities and that this learning transfers readily to other tasks (Bavelier et al., 2012, Spence & Feng, 2010).”
BackgroundVisual intelligence: how we create what we see
(1999) · Choice Reviews Online · doi:10.5860/choice.36-6574 · Cited by 495 · cited 1×
“Perhaps most importantly, this holistic representation of the environment is influenced by perceptual interpretation (Hoffmann, 1998; Palmer, 1999; Rock, 1983).”
BackgroundA Positron Emission Tomographic Study of Auditory Localization in the Congenitally Blind
Weeks, R., Horwitz, B., Aziz-Sultan, A., Tian, B., Wessinger, C. M., Cohen, L. G., Hallett, M., & Rauschecker, J. P. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-07-02664.2000 · Cited by 490 · cited 1×
“Sound source discrimination, auditory motion discrimination, auditory change detection and sound localization all result in occipital activations in blind subjects (Kujala et al., 2005; Poirier et al., 2006; Voss et al., 2008; Weeks et al., 2000).”
BackgroundWaypoint navigation with a vibrotactile waist belt
Erp, J. B. F. V., Veen, H. A. H. C. V., Jansen, C., & Dobbins, T. (2005) · ACM Transactions on Applied Perception · doi:10.1145/1060581.1060585 · Cited by 477 · cited 5×
“We note that promising GPS-based sensory substitution devices exist (Loomis et al., 1998, 2005; Marston et al., 2006, 2007; van Erp et al., 2005) but fall beyond the current scope.”
BackgroundMethodInfluentialDo Action Video Games Improve Perception and Cognition?
Boot, W. R., Blakely, D. P., & Simons, D. J. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00226 · Cited by 472
Multisensory perception: Beyond modularity and convergence
Driver, J., & Spence, C. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00740-5 · Cited by 465 · cited 3×
“The literature on multimodal interactions (see e.g. Deroy, Chen & Spence, 2014; Driver & Spence, 2000; Koelewijn, Bronkhorst & Theeuwes, 2010; Kristjánsson, Thorvaldsson, & Kristjánsson, 2014; Stein & Meredith, 1993) makes clear that a holistic picture of perceptual representation cannot be…”
BackgroundInfluentialConvergence of Visual and Tactile Shape Processing in the Human Lateral Occipital Complex
Amedi, A. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.11.1202 · Cited by 452 · cited 1×
“In Amedi et al. (2001, 2002) the lateral occipital complex (LOC), an area involved in visual object perception, was also activated during haptic object perception in sighted individuals This was not the case for participants who simply learned associations between objects and soundscapes.”
BackgroundShape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · cited 1×
“Amedi et al. (2007) demonstrated that a congenitally blind and a late-blind subject could identify objects by recognizing their shape from visual-to-auditory encodings provided by the vOICe.”
BackgroundDifferent activation patterns in the visual cortex of late and congenitally blind subjects
Buchel, C. (1998) · Brain · doi:10.1093/brain/121.3.409 · Cited by 426 · cited 2×
“The visual and the parietal cortices are also activated during Braille reading (Büchel et al., 1998) in the congenitally blind, together with the parietal association areas, the superior visual association cortex and the cerebellum.”
BackgroundPitch discrimination in the early blind
Gougoux, F., Lepore, F., Lassonde, M., Voss, P., Zatorre, R. J., & Belin, P. (2004) · Nature · doi:10.1038/430309a · Cited by 422
In Sight, Out of Mind: When Object Representations Fail
Simons, D. J. (1996) · Psychological Science · doi:10.1111/j.1467-9280.1996.tb00378.x · Cited by 379 · cited 2×
“…at noticing large changes to otherwise identical visual scenes if the changed scene is alternatively presented with the original scene at a rapid rate with another visual event in between (O’Regan, Rensink, & Clark, 1999; Rensink, O’Regan, & Clark, 1997; see also Mack & Rock, 1998; Simons, 1996).”
BackgroundNavigation system for the blind: Auditory display modes and guidance
Loomis, J. M., Golledge, R. G., & Klatzky, R. L. (1998) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474698565677 · Cited by 366 · cited 1×
“We note that promising GPS-based sensory substitution devices exist (Loomis et al., 1998, 2005; Marston et al., 2006, 2007; van Erp et al., 2005) but fall beyond the current scope.”
BackgroundIs visual information integrated across successive fixations in reading?
McConkie, G. W., & Zola, D. (1979) · Perception & Psychophysics · doi:10.3758/bf03202990 · Cited by 348 · cited 1×
“Observers making eye movements across a visual scene miss large changes in the scene during eye movements (Grimes, 1996; McConkie & Zola, 1979) and are surprisingly inept at noticing large changes to otherwise identical visual scenes if the changed scene is alternatively presented with the original…”
BackgroundForm perception with a 49-point electrotactile stimulus array on the tongue: a technical note.
Bach‐y‐Rita, P., Kaczmarek, K. A., Tyler, M. E., & Garcia-Lara, J. (1998) · PubMed · Cited by 338
Brain mechanisms in sensory substitution
Krieg, W. J. S. (1973) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(73)90016-3 · Cited by 335
Response amplification in sensory-specific cortices during crossmodal binding
Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D., & David, A. S. (1999) · NeuroReport · doi:10.1097/00001756-199908200-00033 · Cited by 331 · cited 2×
“These areas play a fundamental role in visual spatial representation and topographical learning in sighted individuals performing comparable tasks.”
BackgroundPtito, M. (2005) · Brain · doi:10.1093/brain/awh380 · Cited by 310
Attention and the multiple stages of multisensory integration: A review of audiovisual studies
Koelewijn, T., Bronkhorst, A., & Theeuwes, J. (2010) · Acta Psychologica · doi:10.1016/j.actpsy.2010.03.010 · Cited by 306
A ventral visual stream reading center independent of visual experience
Reich, L., Szwed, M., Cohen, L., & Amedi, A. (2011) · Current Biology · doi:10.1016/j.cub.2011.01.040 · Cited by 295 · cited 3×
“The Visual Form Word Area (VWFA; Cohen et al., 2000; Sigurdardottir et al., 2015) was activated in the blind when they processed letter soundscapes, following a 2 h training session (see also Reich et al., 2011).”
BackgroundMethodStriem-Amit, E., Cohen, L., Dehaene, S., & Amedi, A. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.026 · Cited by 294 · cited 2×
“Striem-Amit et al. (2012a) designed a visual-toauditory version of the Snellen visual acuity E-chart, testing it on eight congenitally and one early-onset blind subjects who received training with the vOICe system for 73 hours, in weekly training sessions.”
MethodThe newly sighted fail to match seen with felt
Held, R., Ostrovsky, Y., de Gelder, B., Gandhi, T., Ganesh, S., Mathur, U., & Sinha, P. (2011) · Nature Neuroscience · doi:10.1038/nn.2795 · Cited by 284 · cited 1×
“The brain is capable of considerable reorganization of neural function (Held et al., 2011; Rauschecker, 1995), while younger brains are typically more flexible (Hubel & Wiesel, 1970; Merabet & Pascual-Leone, 2010).”
BackgroundExtended multisensory space in blind cane users
Serino, A., Bassolino, M., Farnè, A., & Làdavas, E. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01952.x · Cited by 282
Development of Soft-Actuator-Based Wearable Tactile Display
Koo, I. M., Jung, K., Koo, J. C., Nam, J.-D., Lee, Y. K., & Choi, H. R. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.921561 · Cited by 277 · cited 1×
“Koo et al. (2008) developed a vibration device for the fingertips (see also Shah et al., 2006) but such methods may fail the usability test (Dakopolous & Bourbakis, 2010).”
MethodAuvray, M., Hanneton, S., & O'Regan, J. K. (2007) · Perception · doi:10.1068/p5631 · Cited by 268
Auditory compensation for early blindness in cat cerebral cortex
Rauschecker, J., & Korte, M. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-10-04538.1993 · Cited by 266 · cited 1×
“Cortical areas responsive to audition expand in visually deprived cats (Rauschecker & Korte, 1993) and their neurons become more sharply tuned to location on the azimuth (Korte & Rauschecker, 1993; see also Rauschecker & Kniepert, 1994; King & Parsons, 1999).”
BackgroundBrain Plasticity: ‘Visual’ Acuity of Blind Persons via the Tongue
Sampaio, E., Maris, S., & Bach-y-Rita, P. (2001) · Brain Research · doi:10.1016/s0006-8993(01)02667-1 · Cited by 258 · cited 1×
“Participants performed better than in experiments with tactile SSDs (Chebat et al., 2007, Sampaio et al., 2001), retinal prostheses (Zrenner et al., 2010) and 55% showed acuity higher than the threshold for blindness (see also Levy-Tzedek, Riemer, & Amedi, 2014).”
BackgroundSathian, K., Zangaladze, A., Hoffman, J. M., & Grafton, S. T. (1997) · Neuroreport · doi:10.1097/00001756-199712220-00008 · Cited by 252 · cited 2×
“Ortiz et al. (2011) argue that the magnitude of activity in visual cortex with tactile stimulation correlates with observers’ experiences of illusory flashing lights (phosphenes).”
BackgroundImpairment of auditory spatial localization in congenitally blind human subjects
Gori, M., Sandini, G., Martinoli, C., & Burr, D. C. (2014) · Brain · doi:10.1093/brain/awt311 · Cited by 252 · cited 1×
“Gori et al. (2014) tested the ability of blind participants to judge the relative position of a sound source in a sequence of three spatially separated sounds.”
BackgroundVisual experiences in the blind induced by an auditory sensory substitution device
Ward, J., & Meijer, P. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2009.10.006 · Cited by 247 · cited 3×
“Ward and Meijer (2010) found that two blind users of the vOICe reported visual-like perception (externalization) acquired over several months of use.”
BackgroundResultLiu, Y.-C. (2001) · Ergonomics · doi:10.1080/00140130010011369 · Cited by 246 · cited 2×
“All this highlights the need for a deeper understanding of the psychophysical properties of the perceptual channels in question, and raises questions such as whether such illusions may be affected with training.”
BackgroundHaptic wearables as sensory replacement, sensory augmentation and trainer – a review
Shull, P. B., & Damian, D. D. (2015) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-015-0055-z · Cited by 245 · cited 4×
“Although this presents many challenges, a feedback system that codes the environment through haptics and audition in conjunction may compensate for the drawbacks of using only each individual sense if strengths are strategically utilized and weaknesses avoided (Shull & Damian, 2015).”
BackgroundMethodInfluentialCentral Auditory Skills in Blind and Sighted Subjects
Muchnik, C., Efrati, M., Nemeth, E., Malin, M., & Hildesheimer, M. (1991) · Scandinavian Audiology · doi:10.3109/01050399109070785 · Cited by 236
Fundamentals of Sensory Physiology
(1986) · Springer eBooks · doi:10.1007/978-3-642-82598-9 · Cited by 234
White, B. W., Saunders, F. A., Scadden, L., Bach-Y-Rita, P., & Collins, C. C. (1970) · Perception & Psychophysics · doi:10.3758/bf03210126 · Cited by 232
Maidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
Auditory motion perception activates visual motion areas in early blind subjects
Poirier, C., Collignon, O., Scheiber, C., Renier, L., Vanlierde, A., Tranduy, D., Veraart, C., & De Volder, A. G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.036 · Cited by 227 · cited 1×
“Sound source discrimination, auditory motion discrimination, auditory change detection and sound localization all result in occipital activations in blind subjects (Kujala et al., 2005; Poirier et al., 2006; Voss et al., 2008; Weeks et al., 2000).”
BackgroundBeyond sensory substitution—learning the sixth sense
Nagel, S. K., Carl, C., Kringe, T., Märtin, R., & König, P. (2005) · Journal of Neural Engineering · doi:10.1088/1741-2560/2/4/r02 · Cited by 225 · cited 3×
“Notably, training may be especially important for successful externalization (see section 2.3), which is, in all likelihood, beneficial for successful sensory substitution.”
BackgroundMethodInfluentialMaravita, A., Husain, M., Clarke, K., & Driver, J. (2001) · Neuropsychologia · doi:10.1016/s0028-3932(00)00150-0 · Cited by 222 · cited 2×
“Maravita et al. showed that through training, tools can become externalized so that visual-tactile interaction extends into far space (Maravita et al., 2001) and representations can change following active tooluse, which can extend the participants’ representation of peripersonal space (Maravita,…”
BackgroundMagnetically induced phosphenes in sighted, blind and blindsighted observers
Cowey, A., & Walsh, V. (2000) · NeuroReport · doi:10.1097/00001756-200009280-00044 · Cited by 221 · cited 2×
“They found that cross-modal plasticity developed rapidly and that the occipital cortex was involved in tactile discrimination.”
BackgroundThe multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219 · cited 1×
“The brain is not just a sensory-machine that responds separately to specific stimuli or sensory modalities but rather a complex “task-machine”, that can partially restore function with input from other senses (Maidenbaum et al., 2014a; Murray et al., 2016).”
BackgroundEye and Brain: The Psychology of Seeing - Fifth Edition
Gregory, R. L. (1998) · Princeton University Press eBooks · doi:10.1515/9781400866861 · Cited by 216
Capelle, C., Trullemans, C., Arno, P., & Veraart, C. (1998) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.720206 · Cited by 210 · cited 1×
“The PSVA sensory substitution device (Arno et al., 2001; Capelle et al., 1998), involves images captured by a miniature head-mounted TV camera that are simplified at high-resolution centrally but lower resolution peripherally (analogous to the human retina).”
BackgroundGori, M., Sandini, G., Martinoli, C., & Burr, D. (2010) · Current Biology · doi:10.1016/j.cub.2009.11.069 · Cited by 205 · cited 2×
“…participants, suggesting that multisensory integration may differ in the congenitally blind, perhaps because they have better auditory discrimination abilities than sighted people or because vision plays a role in crossmodal calibra- tion (Gori et al., 2010; Occelli, Spence & Zampini, 2013).”
BackgroundAbboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130338 · Cited by 199 · cited 5×
“In the image-to-sound conversion algorithm of EyeMusic (Abboud et al., 2014) higher musical notes represent pixels located higher on the y-axis, the delay of sound presentation corresponds to the location of a pixel on the x-axis (a larger delay for the sounds from the right and a smaller one for the sounds from the l…”
BackgroundInfluentialCortical plasticity associated with Braille learning
Hamilton, R. H., & Pascual-Leone, A. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01172-3 · Cited by 195
The cognitive and neural correlates of “tactile consciousness”: A multisensory perspective
Gallace, A., & Spence, C. J. (2007) · Consciousness and Cognition · doi:10.1016/j.concog.2007.01.005 · Cited by 194 · cited 1×
“There is no reason to think that this issue of continuity differs fundamentally between the senses (see e.g. Gallace & Spence, 2008), although particular details may differ.”
BackgroundFunctional connectivity of visual cortex in the blind follows retinotopic organization principles
Striem-Amit, E., Ovadia-Caro, S., Caramazza, A., Margulies, D. S., Villringer, A., & Amedi, A. (2015) · Brain · doi:10.1093/brain/awv083 · Cited by 194 · cited 1×
“An intriguing possibility is that precise localization provided by retinotopic visual cortex may allow more accurate auditory (or haptic) localization if visual areas are recruited by audition (Striem-Amit et al., 2015; Wang et al., 2015).”
BackgroundEarly but not late-blindness leads to enhanced auditory perception
Wan, C. Y., Wood, A. G., Reutens, D. C., & Wilson, S. J. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.08.016 · Cited by 192 · cited 1×
“Wan et al. (2010) tested congenitally, early and late-blind participants finding enhanced auditory capacities only for those who became blind early.”
BackgroundThe role of visual experience for the neural basis of spatial cognition
Pasqualotto, A., & Proulx, M. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.008 · Cited by 192 · cited 3×
“The necessity of experience for calibration, and the evidence of considerable neural reorganization (such as following late-onset blindness), presents important challenges for sensory substitution (see discussion in Pasqualotto & Proulx, 2012).”
BackgroundNeural correlates of virtual route reCognition in congenital blindness
Kupers, R., Chebat, D. R., Madsen, K. H., Paulson, O. B., & Ptito, M. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1006199107 · Cited by 187 · cited 2×
“Kupers et al. (2010) measured neuronal activity as blind participants used an SSD involving stimulation of the tongue finding that the parahippocampus and visual cortex were highly activated.”
BackgroundMethodPerception of material from contact sounds
Klatzky, R. L., Pai, D. K., & Krotkov, E. P. (2000) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474600566907 · Cited by 187
Listening with eye and hand: Cross-modal contributions to speech perception.
Fowler, C. A., & Dekle, D. J. (1991) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.17.3.816 · Cited by 183 · cited 1×
“Interestingly, for the current context, Fowler and Dekle (1991) found a tactile/auditory McGurk effect when auditory syllables were presented along with a haptic representation of the syllables.”
BackgroundVisual experience is necessary for the development of multisensory integration
Wallace, M. T., Perrault, T. J., Hairston, W. D., & Stein, B. E. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.2535-04.2004 · Cited by 183 · cited 2×
“Vision may be necessary for successful cross-calibration (Hötting & Röder, 2009; Occelli et al., 2013; Wallace et al., 2004).”
BackgroundKellogg, W. N. (1962) · Science · doi:10.1126/science.137.3528.399 · Cited by 169 · cited 1×
“In a pioneering study, Kellogg (1962) found that blind particpants could use echolocation to detect size differences (see also Ammons, Worchel & Dallenbach, 1953).”
BackgroundChange deafness: The inability to detect changes between two voices.
Vitevitch, M. S. (2003) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.29.2.333 · Cited by 166 · cited 1×
“Such attentional limitations also occur for haptic perception (Gallace, Tan & Spence, 2006) and audition (Vitevitch, 2003), showing how this is a universal principle of attention and perception.”
BackgroundAlexia for Braille following bilateral occipital stroke in an early blind woman
Hamilton, R., Keenan, J. P., Catala, M., & Pascual-Leone, A. (2000) · Neuroreport · doi:10.1097/00001756-200002070-00003 · Cited by 165
The Technology of Binaural Listening
(2013) · Springer eBooks · doi:10.1007/978-3-642-37762-4 · Cited by 164 · cited 2×
“, 2014), for instance, encoding obstacle direction to sound through spatial audio (Blauert, 2013; Geronazzo et al., 2016) and/or appropriate haptic rendering techniques (van Erp et al.”
BackgroundVoss, P., Gougoux, F., Zatorre, R. J., Lassonde, M., & Lepore, F. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.12.020 · Cited by 161 · cited 1×
“Sound source discrimination, auditory motion discrimination, auditory change detection and sound localization all result in occipital activations in blind subjects (Kujala et al., 2005; Poirier et al., 2006; Voss et al., 2008; Weeks et al., 2000).”
BackgroundGiordano, B. L., & McAdams, S. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2149839 · Cited by 158 · cited 1×
“…from objects causing sound themselves, such as dimensions (Carello, Anderson, & Kunkler-Peck, 1998; Lakatos, McAdams, & Caussá, 1997; Houben, Kohlrausch, & Hermes, 2004), shape (Kunkler-Peck & Turvey, 2000; Grassi, 2005), or material (Klatzky, Pai, & Krotkov, 2000; Giordano & McAdams, 2006).”
Loomis, J. M., Marston, J. R., Golledge, R. G., & Klatzky, R. L. (2005) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x0509900404 · Cited by 156 · cited 1×
“We note that promising GPS-based sensory substitution devices exist (Loomis et al., 1998, 2005; Marston et al., 2006, 2007; van Erp et al., 2005) but fall beyond the current scope.”
BackgroundRicciardi, E., Bonino, D., Pellegrini, S., & Pietrini, P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.10.006 · Cited by 154
Perception of object length by sound
Carello, C., Anderson, K. L., & Kunkler-Peck, A. J. (1998) · Psychological Science · doi:10.1111/1467-9280.00040 · Cited by 153
Enteropathogenic E. coli translocated intimin receptor, Tir, interacts directly with α-actinin
Goosney, D. L., DeVinney, R., Pfuetzner, R. A., Frey, E. A., Strynadka, N. C. J., & Finlay, B. B. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00543-1 · Cited by 150
A blind mobility aid modeled after echolocation of bats
Ifukube, T., Sasaki, T., & Peng, C. (1991) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.81565 · Cited by 150
Novich, S. D., & Eagleman, D. M. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4346-1 · Cited by 148 · cited 4×
“In another study, Ernst and Banks (2002) observed that while both haptics and vision conveyed accurate information about the height of a bar this was much less reliable for touch than vision.”
BackgroundInfluentialMultisensory perceptual learning and sensory substitution
Proulx, M. J., Brown, D. J., Pasqualotto, A., & Meijer, P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.11.017 · Cited by 148 · cited 1×
“For example, evidence of multisensory perceptual learning (Proulx et al., 2014) is encouraging for the idea of multisensory sensory substitution.”
BackgroundArno, P., De Volder, A. G., Vanlierde, A., Wanet-Defalque, M.-C., Streel, E., Robert, A., Sanabria-Bohórquez, S., & Veraart, C. (2001) · NeuroImage · doi:10.1006/nimg.2000.0731 · Cited by 148 · cited 3×
“Arno et al. (2001), found that visual to auditory encoding of camera-based images resulted in occipital activation in blind subjects.”
BackgroundMethodAuditory spatial tuning of cortical neurons is sharpened in cats with early blindness
Korte, M., & Rauschecker, J. P. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.4.1717 · Cited by 146 · cited 1×
“Cortical areas responsive to audition expand in visually deprived cats (Rauschecker & Korte, 1993) and their neurons become more sharply tuned to location on the azimuth (Korte & Rauschecker, 1993; see also Rauschecker & Kniepert, 1994; King & Parsons, 1999).”
BackgroundAuditory Localization Behaviour in Visually Deprived Cats
Rauschecker, J. P., & Kniepert, U. (1994) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1994.tb00256.x · Cited by 144 · cited 1×
“Cortical areas responsive to audition expand in visually deprived cats (Rauschecker & Korte, 1993) and their neurons become more sharply tuned to location on the azimuth (Korte & Rauschecker, 1993; see also Rauschecker & Kniepert, 1994; King & Parsons, 1999).”
BackgroundA Navigation Aid for the Blind Using Tactile-Visual Sensory Substitution
Johnson, L. A., & Higgins, C. M. (2006) · 2006 International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2006.259473 · Cited by 137 · cited 1×
“While cueing direction by location worked well, conveying distance in this way was not successful (for other implementations see Cosgun, Sisbot & Christensen, 2014; Johnson & Higgins, 2006; Segond et al., 2013).”
BackgroundThe representation of auditory source characteristics: Simple geometric form
Lakatos, S., McAdams, S. E., & Caussé, R. (1997) · Perception & Psychophysics · doi:10.3758/bf03214206 · Cited by 137
Hearing cheats touch, but less in congenitally blind than in sighted individuals
Hötting, K., & Röder, B. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01501010.x · Cited by 136 · cited 5×
“There are various examples of how information from one modality influences, or even alters, our perception of stimuli in another modality (McGurk & McDonald, 1976; Shams, Kamitani, & Shimojo, 2000; Hötting & Röder, 2004), showing how important integration from different sensory modalities can be.”
BackgroundInfluentialPurves, D., Augustine, G. J., Fitzpatrick, D., Katz, L. C., LaMantia, A., McNamara, J. O., & Williams, S. M. (2001) · Cited by 132
The “EyeCane”, a new electronic travel aid for the blind: Technology, behavior & swift learning
Maidenbaum, S., Hanassy, S., Abboud, S., Buchs, G., Chebat, D.-R., Levy-Tzedek, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130351 · Cited by 132 · cited 5×
“The EyeCane (Maidenbaum et al., 2014b) provides distance estimation and obstacle detection through narrow-beam infrared sensors.”
BackgroundInfluentialNavigation with a sensory substitution device in congenitally blind individuals
Chebat, D.-R., Schneider, F. C., Kupers, R., & Ptito, M. (2011) · Neuroreport · doi:10.1097/wnr.0b013e3283462def · Cited by 132 · cited 1×
“The Tongue Display Unit (TDU; BachY-Rita et al., 1998; see also Chebat et al., 2011; Tang & Beebe, 2006) is a tactile-to-vision SSD that translates images into tongue stimulation.”
BackgroundDo we hear size or sound? Balls dropped on plates
Grassi, M. (2005) · Perception & Psychophysics · doi:10.3758/bf03206491 · Cited by 131 · cited 2×
“…from objects causing sound themselves, such as dimensions (Carello, Anderson, & Kunkler-Peck, 1998; Lakatos, McAdams, & Caussá, 1997; Houben, Kohlrausch, & Hermes, 2004), shape (Kunkler-Peck & Turvey, 2000; Grassi, 2005), or material (Klatzky, Pai, & Krotkov, 2000; Giordano & McAdams, 2006).”
BackgroundThe cutaneous rabbit illusion affects human primary sensory cortex somatotopically
Blankenburg, F., Ruff, C. C., Deichmann, R., Rees, G., & Driver, J. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040069 · Cited by 131
RENIER, L., COLLIGNON, O., POIRIER, C., TRANDUY, D., VANLIERDE, A., BOL, A., VERAART, C., & DEVOLDER, A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.01.047 · Cited by 128 · cited 2×
“Poirier et al. (2007; see also Renier et al., 2005) show how tactile stimulation can cause activity change in visual areas.”
BackgroundKunkler-Peck, A. J., & Turvey, M. T. (2000) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.26.1.279 · Cited by 126
Loomis, J. M., Marston, J. R., Golledge, R. G., et al. (2018) · PubMed · doi:10.1184/r1/6617567 · Cited by 125
Cortical activity during tactile exploration of objects in blind and sighted humans
Amedi, A., Raz, N., Azulay, H., Malach, R., & Zohary, E. (2010) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2010-0503 · Cited by 125 · cited 2×
“Amedi et al. (2010) found that tactile object identification activated visual object-recognition regions within LOC in blind individuals similarly as for sighted controls.”
BackgroundAugmented reality audio for mobile and wearable appliances
Härmä, A., Jakka, J., Tikander, M., Karjalainen, M., Lokki, T., Hiipakka, J., & Lorho, G. (2004) · Research Publications (Maastricht University) · Cited by 124
A Navigation Aid for the Blind Using Tactile-Visual Sensory Substitution
Johnson, L. A., & Higgins, C. M. (2006) · 2006 International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2006.4398897 · Cited by 123
Alary, F., Duquette, M., Goldstein, R., Elaine Chapman, C., Voss, P., La Buissonnière-Ariza, V., & Lepore, F. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.03.014 · Cited by 120 · cited 2×
“For example, Alary et al. (2009) found no difference in tactile grating orientation discrimination or vibration frequency judgment between blind and sighted participants, while blind participants outperformed the sighted on a texture discrimination task.”
BackgroundAuditory and auditory-tactile processing in congenitally blind humans
Hötting, K., & Röder, B. (2009) · Hearing Research · doi:10.1016/j.heares.2009.07.012 · Cited by 120 · cited 1×
“Vision may be necessary for successful cross-calibration (Hötting & Röder, 2009; Occelli et al., 2013; Wallace et al., 2004).”
Background‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution
Striem-Amit, E., Guendelman, M., & Amedi, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033136 · Cited by 117 · cited 2×
“Striem-Amit et al. (2012a) designed a visual-toauditory version of the Snellen visual acuity E-chart, testing it on eight congenitally and one early-onset blind subjects who received training with the vOICe system for 73 hours, in weekly training sessions.”
MethodCross-modal plasticity of tactile perception in blindness
Sathian, K., & Stilla, R. (2010) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2010-0534 · Cited by 115
Changes in occipital cortex activity in early blind humans using a sensory substitution device
De Volder, A. G., Catalan-Ahumada, M., Robert, A., Bol, A., Labar, D., Coppens, A., Michel, C., & Veraart, C. (1999) · Brain Research · doi:10.1016/s0006-8993(99)01275-5 · Cited by 114 · cited 4×
“Interestingly, StriemAmit et al. (2015) show that even without visual input functional organization of visual cortex follows retinotopic organizational principles (see also Wang et al., 2015).”
BackgroundMethodInfluentialKunkler-Peck, A. J., & Turvey, M. T. (2000) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.26.1.279 · Cited by 113
There is something out there: Distal attribution in sensory substitution, twenty years later
AUVRAY, M., HANNETON, S., LENAY, C., & O'REGAN, K. (2005) · Journal of Integrative Neuroscience · doi:10.1142/s0219635205001002 · Cited by 112 · cited 2×
“While the cane, however useful, has many drawbacks, it hammers home the important point that sensory substitution devices can become externalized (also called distal attribution; Auvray et al., 2005; Hartcher-O’Brien & Auvray, 2014), so that the haptic pressure picked up by mechanical receptors on the hand is experien…”
BackgroundThe failure to detect tactile change: A tactile analogue of visual change blindness
Gallace, A., Tan, H. Z., & Spence, C. J. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03193847 · Cited by 111
A Breakdown in Simultaneous Information Processing
Haines, R. F. (1991) · Presbyopia Research · doi:10.1007/978-1-4757-2131-7_17 · Cited by 110 · cited 1×
“An informative example of how attentional focus can have profound implications for technological design comes from a study where information from flight instruments in the cockpit of a passenger-jet was projected onto the windshield of the cockpit (Haines, 1991).”
BackgroundThe postnatal development of the visual cortex and the influence of environment
Wiesel, T. N. (1982) · Bioscience Reports · doi:10.1007/bf01119299 · Cited by 110
Teaching the blind to find their way by playing video games
Merabet, L. B., Connors, E. C., Halko, M. A., & Sánchez, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044958 · Cited by 109 · cited 1×
“And there is indeed promising evidence regarding the use of virtual training environments such as virtual mazes or video-games in sensory substitution (Lahav, Schloerb, & Srinivasan; 2012; Merabet et al., 2012; Levy-Tzedek et al., 2016; Maidenbaum et al., 2014c; Maidenbaum & Amedi, 2015).”
BackgroundAssistive Technology for Blindness and Low Vision
(2018) · CRC Press eBooks · doi:10.1201/9781315216935 · Cited by 107
Rapid learning in attention shifts: A review
Kristjánsson, Á. (2006) · Visual Cognition · doi:10.1080/13506280544000039 · Cited by 100
Self-citationNavigation using sensory substitution in real and virtual mazes
Chebat, D.-R., Maidenbaum, S., & Amedi, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126307 · Cited by 99
“Visual” Cortex Responds to Spoken Language in Blind Children
Bedny, M., Richardson, H., & Saxe, R. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0634-15.2015 · Cited by 98
Improved auditory spatial acuity in visually deprived ferrets
King, A. J., & Parsons, C. H. (1999) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.1999.00821.x · Cited by 95 · cited 1×
“Cortical areas responsive to audition expand in visually deprived cats (Rauschecker & Korte, 1993) and their neurons become more sharply tuned to location on the azimuth (Korte & Rauschecker, 1993; see also Rauschecker & Kniepert, 1994; King & Parsons, 1999).”
BackgroundLong-lasting crossmodal cortical reorganization triggered by brief postnatal visual deprivation
Collignon, O., Dormal, G., de Heering, A., Lepore, F., Lewis, T. L., & Maurer, D. (2015) · Current Biology · doi:10.1016/j.cub.2015.07.036 · Cited by 94 · cited 1×
“Finally, we note that certain “visual” functions are heavily influenced by at what time the visual deprivation occurs and by the date of sight restoration (Collignon et al., 2015; McKyton et al., 2015).”
BackgroundSensory substitution as an artificially acquired synaesthesia
Ward, J., & Wright, T. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.07.007 · Cited by 94
Sensory Augmentation for the Blind
Kärcher, S. M., Fenzlaff, S., Hartmann, D., Nagel, S. K., & König, P. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00037 · Cited by 93 · cited 3×
“Kärcher et al. (2012) argue that even though sensory substitution devices can be beneficial for navigation and orientation in the environment, they place a strain on attentional resources, which may detract from attention paid to other aspects of the environment.”
BackgroundInfluentialIs there a future for sensory substitution outside academic laboratories?
Elli, G. V., Benetti, S., & Collignon, O. (2014) · Multisensory Research · doi:10.1163/22134808-00002460 · Cited by 90 · cited 1×
“Ease of use, comfort level, mobility and appearance need to be seriously considered if the blind are to be expected to use a particular device (Dakopolous & Bourbakis, 2010; Elli et al., 2014; Shull & Damian, 2015).”
BackgroundMcDaniel, T., Krishna, S., Balasubramanian, V., Colbry, D., & Panchanathan, S. (2008) · 2008 IEEE International Workshop on Haptic Audio visual Environments and Games · doi:10.1109/have.2008.4685291 · Cited by 90 · cited 1×
“One promising way involves conveying vibration through a belt to the participants based on information from video cameras (McDaniel et al., 2008).”
BackgroundTactile-‘visual’ acuity of the tongue in early blind individuals
Chebat, D.-R., Rainville, C., Kupers, R., & Ptito, M. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3282f2a63 · Cited by 88
Lacey, S., Flueckiger, P., Stilla, R., Lava, M., & Sathian, K. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.081 · Cited by 88 · cited 1×
“Touch can even modulate visual imagery (Lacey et al., 2010).”
Phosphene induction and the generation of saccadic eye movements by striate cortex
Tehovnik, E. J., Slocum, W. M., Carvey, C. E., & Schiller, P. H. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00736.2004 · Cited by 87 · cited 2×
“They found that cross-modal plasticity developed rapidly and that the occipital cortex was involved in tactile discrimination.”
BackgroundEcho-detection ability of the blind: Size and distance factors
Rice, C. E., Feinstein, S. H., & Schusterman, R. J. (1965) · Journal of Experimental Psychology · doi:10.1037/h0022215 · Cited by 85
Top-down influence on the visual cortex of the blind during sensory substitution
Murphy, M. C., Nau, A. C., Fisher, C., Kim, S.-G., Schuman, J. S., & Chan, K. C. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.11.021 · Cited by 82 · cited 1×
“Importantly, active interaction with auditory sensory substitution stimuli seems to cause more neural activity in the visual cortex than passive processing (Murphy et al., 2016).”
BackgroundProulx, M. J., Stoerig, P., Ludowig, E., & Knoll, I. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001840 · Cited by 81 · cited 3×
“…O’Regan (2007) found that following 15 hours of training with the vOICe, participants could identify objects on a table, including new objects (see Proulx et al., 2008 for similar conclusions), while Kim and Zatorre (2008) found that their participants were able to associate objects and…”
BackgroundResultInfluentialThaler, L., Milne, J. L., Arnott, S. R., Kish, D., & Goodale, M. A. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00501.2013 · Cited by 81 · cited 2×
“Kupers et al. (2010) measured neuronal activity as blind participants used an SSD involving stimulation of the tongue finding that the parahippocampus and visual cortex were highly activated.”
BackgroundMethodEye and brain: The psychology of seeing, 2nd ed.
Gregory, R. L. (1973) · Cited by 81
The role of blind humans’ visual cortex in auditory change detection
Kujala, T., Palva, M. J., Salonen, O., Alku, P., Huotilainen, M., Järvinen, A., & Näätänen, R. (2005) · Neuroscience Letters · doi:10.1016/j.neulet.2004.12.070 · Cited by 79 · cited 1×
“Sound source discrimination, auditory motion discrimination, auditory change detection and sound localization all result in occipital activations in blind subjects (Kujala et al., 2005; Poirier et al., 2006; Voss et al., 2008; Weeks et al., 2000).”
BackgroundThe limits of shape recognition following late emergence from blindness
McKyton, A., Ben-Zion, I., Doron, R., & Zohary, E. (2015) · Current Biology · doi:10.1016/j.cub.2015.06.040 · Cited by 79 · cited 1×
“Finally, we note that certain “visual” functions are heavily influenced by at what time the visual deprivation occurs and by the date of sight restoration (Collignon et al., 2015; McKyton et al., 2015).”
Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., & Amedi, A. (2012) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2012-110219 · Cited by 79 · cited 1×
“In Levy-Tzedek et al. (2012), blindfolded participants were trained on EyeMusic in order to improve their ability to perform fast and accurate movements towards targets.”
An oral tactile interface for blind navigation
Tang, H. N., & Beebe, D. J. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2005.862696 · Cited by 79 · cited 1×
“The Tongue Display Unit (TDU; BachY-Rita et al., 1998; see also Chebat et al., 2011; Tang & Beebe, 2006) is a tactile-to-vision SSD that translates images into tongue stimulation.”
BackgroundTeng, S., & Whitney, D. (2011) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1110500103 · Cited by 79 · cited 1×
“Teng and Whitney (2011) found that sighted novices quickly learned to discriminate size and position through echolocation with notable precision (see also Kolarik et al., 2014).”
Multisensory constraints on awareness
Deroy, O., Chen, Y.-C., & Spence, C. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0207 · Cited by 78
Functional characteristics of auditory cortex in the blind
Stevens, A. A., & Weaver, K. E. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.07.041 · Cited by 77 · cited 4×
“On the other hand, the early blind outperform the sighted in pitch discrimination (Gougoux et al., 2004) and also show better temporal resolution for auditory stimuli (Muchnick et al., 1991; Stevens & Weaver, 2009).”
BackgroundInfluentialAmmons, C. H., Worchel, P., & Dallenbach, K. M. (1953) · The American Journal of Psychology · doi:10.2307/1418950 · Cited by 75
rTMS of the occipital cortex abolishes Braille reading and repetition priming in blind subjects
Kupers, R., Pappens, M., de Noordhout, A. M., Schoenen, J., Ptito, M., & Fumal, A. (2007) · Neurology · doi:10.1212/01.wnl.0000255958.60530.11 · Cited by 74 · cited 1×
“Additionally, tactile motion discrimination activates dorsal visual stream areas in the congenitally blind (Ptito et al., 2009).”
Background, A., & Ackrill, J. L. (1987) · Medical Entomology and Zoology · Cited by 73
Evaluation of spatial displays for navigation without sight
Marston, J. R., Loomis, J. M., Klatzky, R. L., Golledge, R. G., & Smith, E. L. (2006) · ACM Transactions on Applied Perception · doi:10.1145/1141897.1141900 · Cited by 73 · cited 1×
“We note that promising GPS-based sensory substitution devices exist (Loomis et al., 1998, 2005; Marston et al., 2006, 2007; van Erp et al., 2005) but fall beyond the current scope.”
BackgroundImpaired recognition of faces and objects in dyslexia: Evidence for ventral stream dysfunction?
Sigurdardottir, H. M., Ívarsson, E., Kristinsdóttir, K., & Kristjánsson, Á. (2015) · Neuropsychology · doi:10.1037/neu0000188 · Cited by 73 · cited 4×
“The Visual Form Word Area (VWFA; Cohen et al., 2000; Sigurdardottir et al., 2015) was activated in the blind when they processed letter soundscapes, following a 2 h training session (see also Reich et al., 2011).”
InfluentialHow well do you see what you hear? The acuity of visual-to-auditory sensory substitution
Haigh, A., Brown, D. J., Meijer, P., & Proulx, M. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00330 · Cited by 72
Nonvisual Route following with Guidance from a Simple Haptic or Auditory Display
Marston, J. R., Loomis, J. M., Klatzky, R. L., & Golledge, R. G. (2007) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x0710100403 · Cited by 71 · cited 1×
“We note that promising GPS-based sensory substitution devices exist (Loomis et al., 1998, 2005; Marston et al., 2006, 2007; van Erp et al., 2005) but fall beyond the current scope.”
BackgroundOn Mobility Aids for the Blind
Collins, C. C. (1985) · Springer eBooks · doi:10.1007/978-94-017-1400-6_4 · Cited by 70 · cited 1×
“To avoid sensory overload only vital information should be conveyed, to guarantee that the SSD does not obstruct perception of the natural soundscape, nor contradict it (Collins, 1985).”
BackgroundWang, X., Peelen, M. V., Han, Z., He, C., Caramazza, A., & Bi, Y. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3914-14.2015 · Cited by 68 · cited 1×
“An intriguing possibility is that precise localization provided by retinotopic visual cortex may allow more accurate auditory (or haptic) localization if visual areas are recruited by audition (Striem-Amit et al., 2015; Wang et al., 2015).”
BackgroundAlary, F., Goldstein, R., Duquette, M., Chapman, C. E., Voss, P., & Lepore, F. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1327-7 · Cited by 66 · cited 1×
“In Alary et al. (2008), the blind outperformed the sighted on haptic-angle discrimination.”
BackgroundNeither touch nor vision: Sensory substitution as artificial synaesthesia?
Farina, M. (2013) · Biology & Philosophy · doi:10.1007/s10539-013-9377-z · Cited by 66 · cited 1×
“Ward and Wright (2014) argue that sensory substitution with good externalization might even be considered a form of acquired synesthesia (see also Farina, 2013).”
BackgroundRecruitment of the middle temporal area by tactile motion in congenital blindness
Ptito, M., Matteau, I., Gjedde, A., & Kupers, R. (2009) · Neuroreport · doi:10.1097/wnr.0b013e3283279909 · Cited by 65 · cited 1×
“Additionally, tactile motion discrimination activates dorsal visual stream areas in the congenitally blind (Ptito et al., 2009).”
BackgroundOrtiz, T., Poch, J., Santos, J. M., Requena, C., Martínez, A. M., Ortiz-Terán, L., Turrero, A., Barcia, J., Nogales, R., Calvo, A., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023264 · Cited by 63
Generalized Learning of Visual-to-Auditory Substitution in Sighted Individuals
Kim, J.-K., & Zatorre, R. J. (2008) · Brain Research · doi:10.1016/j.brainres.2008.06.038 · Cited by 62
Tactile perception recruits functionally related visual areas in the late-blind
Goyal, M. S., Hansen, P. J., & Blakemore, C. B. (2006) · NeuroReport · doi:10.1097/01.wnr.0000227990.23046.fe · Cited by 61
The case for causal influences of action videogame play upon vision and attention
Kristjánsson, Á. (2013) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-013-0427-z · Cited by 61 · cited 2×
“Although promising, on closer look, the video-game literature is fraught with confounds, ambiguities and overclaims regarding causal influences of such training (Boot, Blakely, & Simons, 2011; Kristjánsson, 2013), and benefits from braintraining games appear to be task specific (Owen et al.”
BackgroundThe Information Capacity of the Human Fingertip
Kokjer, K. (1987) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1987.289337 · Cited by 61 · cited 2×
“Investigations of the capacity of the visual system reveal that it has four orders of magnitude greater bandwidth than haptic perception (Kokjer, 1987; Schmidt, 1981) while the information capacity of the human ear falls between these two estimates (Bialek et al., 1993; Dudel, 1986; Proulx et al.,…”
Interactive spatial sonification for non-visual exploration of virtual maps
Geronazzo, M., Bedin, A., Brayda, L. G., Campus, C., & Avanzini, F. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.08.004 · Cited by 59 · cited 2×
“, 2014), for instance, encoding obstacle direction to sound through spatial audio (Blauert, 2013; Geronazzo et al., 2016) and/or appropriate haptic rendering techniques (van Erp et al.”
BackgroundDesigning Rehabilitation Programs for Neglect: Could 2 Be More Than 1+1?
Saevarsson, S., Halsband, U., & Kristjánsson, Á. (2011) · Applied Neuropsychology · doi:10.1080/09084282.2010.547774 · Cited by 59
Self-citationBits and brains: Information flow in the nervous system
Bialek, W., DeWeese, M., Rieke, F., & Warland, D. (1993) · Physica A Statistical Mechanics and its Applications · doi:10.1016/0378-4371(93)90563-j · Cited by 57 · cited 1×
“Investigations of the capacity of the visual system reveal that it has four orders of magnitude greater bandwidth than haptic perception (Kokjer, 1987; Schmidt, 1981) while the information capacity of the human ear falls between these two estimates (Bialek et al., 1993; Dudel, 1986; Proulx et al., 2016; Wurtz & Kandel…”
BackgroundEvaluation of RU-Netra ¿ Tactile Feedback Navigation System For The Visually Impaired
Shah, C., Bouzit, M., Youssef, M., & Vasquez, L. (2006) · 2006 International Workshop on Virtual Rehabilitation · doi:10.1109/iwvr.2006.1707530 · Cited by 56 · cited 1×
“Koo et al. (2008) developed a vibration device for the fingertips (see also Shah et al., 2006) but such methods may fail the usability test (Dakopolous & Bourbakis, 2010).”
MethodRicciardi, E., Handjaras, G., & Pietrini, P. (2014) · Experimental Biology and Medicine · doi:10.1177/1535370214538740 · Cited by 54 · cited 1×
“There is now good evidence that brain regions considered primarily devoted to a particular sense also respond to stimulation from other senses (Proulx et al., 2016; Ricciardi et al., 2014a; see section 3).”
BackgroundPerception of the size and speed of rolling balls by sound
Houben, M. M. J., Kohlrausch, A., & Hermes, D. J. (2004) · Speech Communication · doi:10.1016/j.specom.2004.03.004 · Cited by 49
Cosgun, A., Sisbot, E. A., & Christensen, H. I. (2014) · IEEE Haptics Symposium · doi:10.1109/haptics.2014.6775483 · Cited by 47
A comparison of tactile and blurred visual form perception
Apkarian-Stielau, P., & Loomis, J. M. (1975) · Perception & Psychophysics · doi:10.3758/bf03211213 · Cited by 46 · cited 2×
“Spatial localization accuracy is at least an order of magnitude poorer for haptics than for vision (Apkarian-Stielau & Loomis, 1975; Loomis & Apkarian-Stielau, 1976).”
BackgroundPattern recognition using a device substituting audition for vision in blindfolded sighted subjects
Poirier, C., De Volder, A., Tranduy, D., & Scheiber, C. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.09.018 · Cited by 46 · cited 1×
“Another example is the literature on videogame training, where it has been claimed that playing first-person action video-games can enhance attentional abilities and that this learning transfers readily to other tasks (Bavelier et al., 2012, Spence & Feng, 2010).”
BackgroundAuditory Sensory Substitution is Intuitive and Automatic with Texture Stimuli
Stiles, N. R. B., & Shimojo, S. (2015) · Scientific Reports · doi:10.1038/srep15628 · Cited by 45 · cited 2×
“Note that sensory substitution may not require training if crossmodal mappings are strategically utilized (Stiles & Shimojo, 2015).”
BackgroundActivation of the hippocampal complex during tactile maze solving in congenitally blind subjects
Gagnon, L., Schneider, F. C., Siebner, H. R., Paulson, O. B., Kupers, R., & Ptito, M. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.03.022 · Cited by 45
Auditory, tactile, and audiotactile information processing following visual deprivation
Occelli, V., Spence, C., & Zampini, M. (2013) · Psychological Bulletin · doi:10.1037/a0028416 · Cited by 43 · cited 4×
“Occelli et al. (2013) highlight that loss of vision may affect the establishment of peripersonal spatial coordinates, that then affects haptic and auditory processing.”
BackgroundInfluentialAcquisition of Visual Perception in Blind Adults Using the BrainPort Artificial Vision Device
Nau, A. C., Pintar, C., Arnoldussen, A., & Fisher, C. (2015) · The American Journal of Occupational Therapy · doi:10.5014/ajot.2015.011809 · Cited by 42 · cited 1×
“Kupers et al. (2010; see also Nau et al., 2015) trained and tested the virtual navigational skills of ten congenitally blind and ten blindfolded sighted controls in an active (route navigation) and passive (route recognition) task using the TDU.”
MethodProulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., & Brown, D. J. (2015) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-150541 · Cited by 36 · cited 5×
“…evidence suggests that there is great potential in sensory substitution methods (see Bach-y-Rita & Kercel, 2003; Merabet & Pascual-Leone, 2010; Proulx et al., 2016; Shull & Damian, 2015; Nagel et al., 2005, for reviews), such devices are still not in widespread use (Elli, Benetti & Collignon…”
BackgroundMethodInfluentialBlind subjects construct conscious mental images of visual scenes encoded in musical form
Cronly–Dillon, J., Persaud, K. C., & Blore, R. (2000) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2000.1273 · Cited by 35
Lahav, O., Schloerb, D. W., & Srinivasan, M. A. (2012) · Disability and Rehabilitation: Assistive Technology · doi:10.3109/17483107.2011.635327 · Cited by 34
The role of visual deprivation and experience on the performance of sensory substitution devices
Stronks, H. C., Nau, A. C., Ibbotson, M. R., & Barnes, N. (2015) · Brain Research · doi:10.1016/j.brainres.2015.06.033 · Cited by 31 · cited 2×
“The literature does not provide clear and precise training guidelines regarding SSDs, although good evidence suggests that training is important for successful sensory substitution (Stronks et al., 2015).”
Background
Research works printed but not linked: 5
- Grimes, 1996, Vancouver studies in cognitive science: 5. Perception, 89
- Neisser, 1967, Cognitive Psychology.
- Stein, 1993, The Merging of the Senses.
- Weinstein, 1968, The Skin Senses, 195
- Wurtz, 2000, of neural science, 523
Cited by
Human augmentation: Past, present and future
Raisamo, R., Rakkolainen, I., Majaranta, P., Salminen, K., Rantala, J., & Farooq, A. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.05.008 · Cited by 236
“Augmented senses can also enable sensory substitution or sensory prosthesis, in which information from one sense can be mediated through a different sense (see examples of sensory substitution: Kristjánsson et al., 2016; Wright et al., 2015).”
BackgroundEXTENDED REALITY (XR) ENVIRONMENTS
Stanney, K. M., Nye, H., Haddad, S. D., Hale, K. S., Padron, C. K., & Cohn, J. V. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch30 · Cited by 93
Developments in the human machine interface technologies and their applications: a review
Singh, H. P., & Kumar, P. (2021) · Journal of Medical Engineering & Technology · doi:10.1080/03091902.2021.1936237 · Cited by 73
E-Skins: Biomimetic Sensing and Encoding for Upper Limb Prostheses
Iskarous, M. M., & Thakor, N. V. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2939369 · Cited by 60
“[17] Á.”
BackgroundInfluentialHoffmann, R., Valgeirsdóttir, V. V., Jóhannesson, Ó. I., Unnþórsson, R., & Kristjansson, A. K. (2018) · Experimental Brain Research · doi:10.1007/s00221-018-5387-z · Cited by 54
Self-citation
Metadata
- Authors
- Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R.
- Affiliations
- Laboratory of Visual Perception and Visuomotor control, University of Iceland, Faculty of Psychology, School of Health Sciences, Reykjavik, Iceland
- Universitatea Națională de Știință și Tehnologie Politehnica București (RO)
- University of Iceland (IS)
- Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, School of Engineering and Natural Sciences, Reykjavik, Iceland
- Venue
- Restorative Neurology and Neuroscience
- Publisher
- SAGE Publications
- Published
- 2016-09-21
- Volume
- 34
- Issue
- 5
- Pages
- 769-787
- ISSN
- 0922-6028 (ISSN-L)
- 1878-3627
- PMC
- PMC5044782
- OpenAlex
- W2510919644
- Cited by
- 116
- References
- 229
- Citations by year
- 2026: 13 · 2025: 14 · 2024: 6 · 2023: 16 · 2022: 14 · 2021: 14 · 2020: 9 · 2019: 12 · 2018: 14 · 2017: 4
- FWCI
- 1.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Restorative Neurology and Neuroscience (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- AirIuav (Università Iuav di Venezia) (submittedVersion, other-oa)
- Opin vísindi (Opin vísindi) (submittedVersion, cc-by-nc)
- Funders
- European Commission (HORIZON2020, 643636)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- sensory substitution, blind people, sensory deprivation, sensory overload, attentional capacity, spatiotemporal continuity, multisensory integration, device training, externalization, usability
- MeSH terms
- Biofeedback, Psychology, Humans, Perception, Psychophysics, Sensation Disorders, Sensory Aids, Neuroimaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.