Simplification of Visual Rendering in Simulated Prosthetic Vision Facilitates Navigation
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Visual neuroprostheses are still limited and simulated prosthetic vision (SPV) is used to evaluate potential and forthcoming functionality of these implants. SPV has been used to evaluate the minimum requirement on visual neuroprosthetic characteristics to restore various functions such as reading, objects and face recognition, object grasping, etc. Some of these studies focused on obstacle avoidance but only a few investigated orientation or navigation abilities with prosthetic vision. The resolution of current arrays of electrodes is not sufficient to allow navigation tasks without additional processing of the visual input. In this study, we simulated a low resolution array (15 × 18 electrodes, similar to a forthcoming generation of arrays) and evaluated the navigation abilities restored when visual information was processed with various computer vision algorithms to enhance the visual rendering. Three main visual rendering strategies were compared to a control rendering in a wayfinding task within an unknown environment. The control rendering corresponded to a resizing of the original image onto the electrode array size, according to the average brightness of the pixels. In the first rendering strategy, vision distance was limited to 3, 6, or 9 m, respectively. In the second strategy, the rendering was not based on the brightness of the image pixels, but on the distance between the user and the elements in the field of view. In the last rendering strategy, only the edges of the environments were displayed, similar to a wireframe rendering. All the tested renderings, except the 3 m limitation of the viewing distance, improved navigation performance and decreased cognitive load. Interestingly, the distance-based and wireframe renderings also improved the cognitive mapping of the unknown environment. These results show that low resolution implants are usable for wayfinding if specific computer vision algorithms are used to select and display appropriate information regarding the environment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The sensations produced by electrical stimulation of the visual cortex
Brindley, G. S., & Lewin, W. S. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008519 · Cited by 1,170 · cited 1×
“of the visual system, such as the primary visual cortex (2), the optic nerve (3), and the retina (4).”
BackgroundInterim results from the international trial of Second Sight's visual prosthesis
Humayun, M. S., Dorn, J. D., da Cruz, L., Dagnelie, G., Sahel, J.-A., Stanga, P. E., Cideciyan, A. V., Duncan, J. L., Eliott, D., Filley, E., et al. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2011.09.028 · Cited by 700 · cited 1×
“We also added a 10% dropout rate to simulate electrode malfunction (6).”
BackgroundDobelle, W. H., Mladejovsky, M. G., & Girvin, J. P. (1974) · Science · doi:10.1126/science.183.4123.440 · Cited by 440
Mobility performance with a pixelized vision system.
Cha, K., Horch, K. W., & Normann, R. A. (1992) · Vision Research · doi:10.1016/0042-6989(92)90229-c · Cited by 226
The functional performance of the Argus II retinal prosthesis
Stronks, H. C., & Dagnelie, G. (2014) · Expert Review of Medical Devices · doi:10.1586/17434440.2014.862494 · Cited by 189 · cited 2×
“The array consisted of 18 3 15 phosphenes, a resolution that is in line with the announcement of the next generation of Second Sight’s epiretinal implant (8).”
BackgroundMethodSimulating prosthetic vision: I. Visual models of phosphenes
Chen, S. C., Suaning, G. J., Morley, J. W., & Lovell, N. H. (2009) · Vision Research · doi:10.1016/j.visres.2009.02.003 · Cited by 172 · cited 1×
“Design of the prosthetic renderings All the renderings provided the same visual span (24 3 178), close to the visual span of retinal implants (33).”
BackgroundMobility and low contrast trip hazard avoidance using augmented depth
McCarthy, C., Walker, J. G., Lieby, P., Scott, A., & Barnes, N. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/1/016003 · Cited by 49
Cited by
Semantic and structural image segmentation for prosthetic vision
Sanchez-Garcia, M., Martinez-Cantin, R., & Guerrero, J. J. (2020) · PLOS ONE · doi:10.1371/journal.pone.0227677 · Cited by 62
End-to-end optimization of prosthetic vision
de Ruyter van Steveninck, J., Güçlü, U., van Wezel, R., & van Gerven, M. (2022) · Journal of Vision · doi:10.1167/jov.22.2.20 · Cited by 54
de Ruyter van Steveninck, J., van Gestel, T., Koenders, P., van der Ham, G., Vereecken, F., Güçlü, U., van Gerven, M., Güçlütürk, Y., & van Wezel, R. (2022) · Journal of Vision · doi:10.1167/jov.22.2.1 · Cited by 51
Deep Learning–Based Scene Simplification for Bionic Vision
Han, N., Srivastava, S., Xu, A., Klein, D., & Beyeler, M. (2021) · Augmented Humans Conference 2021 · doi:10.1145/3458709.3458982 · Cited by 45
van der Grinten, M., de Ruyter van Steveninck, J., Lozano, A., Pijnacker, L., Rueckauer, B., Roelfsema, P., van Gerven, M., van Wezel, R., Güçlü, U., & Güçlütürk, Y. (2024) · eLife · doi:10.7554/elife.85812 · Cited by 39
“…using visuotopic maps ( Wong et al., 2010 ; Li, 2013 ; Srivastava et al., 2009 ; Paraskevoudi and Pezaris, 2021 ), simulating noise and electrode dropout ( Dagnelie et al., 2007 ), or using varying levels of brightness ( Vergnieux et al., 2017 ; Sanchez-Garcia et al., 2022 ; Parikh et al., 2013 ).”
BackgroundMethodOptimization of Neuroprosthetic Vision via End-to-end Deep Reinforcement Learning
Küçükoğlu, B., Rueckauer, B., Ahmad, N., de Ruyter van Steveninck, J., Güçlü, U., & van Gerven, M. (2022) · doi:10.1101/2022.02.25.482017 · Cited by 25
“Previous implementations of simulated prosthetic vision use preprocessing techniques such as pixelization [8], feature extraction techniques to highlight the most relevant parts of the image based on saliency cues [9], environmental structure [10], or edge filtering [12, 13, 14].”
MethodPrecise control of neural activity using dynamically optimized electrical stimulation
Shah, N. P., Phillips, A., Madugula, S., Lotlikar, A., Gogliettino, A. R., Hays, M. R., Grosberg, L., Brown, J., Dusi, A., Tandon, P., et al. (2024) · eLife · doi:10.7554/elife.83424 · Cited by 15
End-to-end optimization of prosthetic vision
de Ruyter van Steveninck, J., Güçlü, U., van Wezel, R., & van Gerven, M. (2020) · doi:10.1101/2020.12.19.423601 · Cited by 54
van der Grinten, M., de Ruyter van Steveninck, J., Lozano, A., Pijnacker, L., Rückauer, B., Roelfsema, P., van Gerven, M., van Wezel, R., Güçlü, U., & Güçlütürk, Y. (2022) · doi:10.1101/2022.12.23.521749 · Cited by 39
Deep Learning--Based Scene Simplification for Bionic Vision
Han, N., Srivastava, S., Xu, A., Klein, D., & Beyeler, M. (2021) · arXiv · doi:10.48550/arxiv.2102.00297 · Cited by 4
Visual Prostheses in the Era of Artificial Intelligence Technology
Sarbout, I., Gungor, A., Ounissi, M., Zaher, S., Ptito, M., Kupers, R., Racoceanu, D., & Milea, D. (2025) · Eye and Brain · doi:10.2147/eb.s524322 · Cited by 3
“Other features included contrast information, 73,76 semantic information, 80,82,83 depth information, 76,79,81 surface normal, 84 convolutional filters, 73,75,77 and the use of clip-art style images.”
Metadata
- Authors
- Vergnieux, V., Macé, M. J.-M., & Jouffrais, C.
- Venue
- Artificial Organs
- Publisher
- Wiley
- Published
- 2017-03-21
- Volume
- 41
- Issue
- 9
- Pages
- 852-861
- ISSN
- 0160-564X (ISSN-L)
- OpenAlex
- W2601877418
- Cited by
- 30
- References
- 7
- FWCI
- 0.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.