Simulated Prosthetic Vision: The Benefits of Computer‐Based Object Recognition and Localization
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Clinical trials with blind patients implanted with a visual neuroprosthesis showed that even the simplest tasks were difficult to perform with the limited vision restored with current implants. Simulated prosthetic vision (SPV) is a powerful tool to investigate the putative functions of the upcoming generations of visual neuroprostheses. Recent studies based on SPV showed that several generations of implants will be required before usable vision is restored. However, none of these studies relied on advanced image processing. High‐level image processing could significantly reduce the amount of information required to perform visual tasks and help restore visuomotor behaviors, even with current low‐resolution implants. In this study, we simulated a prosthetic vision device based on object localization in the scene. We evaluated the usability of this device for object recognition, localization, and reaching. We showed that a very low number of electrodes (e.g., nine) are sufficient to restore visually guided reaching movements with fair timing (10 s) and high accuracy. In addition, performance, both in terms of accuracy and speed, was comparable with 9 and 100 electrodes. Extraction of high level information (object recognition and localization) from video images could drastically enhance the usability of current visual neuroprosthesis. We suggest that this method—that is, localization of targets of interest in the scene—may restore various visuomotor behaviors. This method could prove functional on current low‐resolution implants. The main limitation resides in the reliability of the vision algorithms, which are improving rapidly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
The sensations produced by electrical stimulation of the visual cortex
Brindley, G. S., & Lewin, W. S. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008519 · Cited by 1,170
Visual perception in a blind subject with a chronic microelectronic retinal prosthesis
Humayun, M. S., Weiland, J. D., Fujii, G. Y., Greenberg, R., Williamson, R., Little, J., Mech, B., Cimmarusti, V., Van Boemel, G., Dagnelie, G., et al. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00457-7 · Cited by 856
Interim results from the international trial of Second Sight's visual prosthesis
Humayun, M. S., Dorn, J. D., da Cruz, L., Dagnelie, G., Sahel, J.-A., Stanga, P. E., Cideciyan, A. V., Duncan, J. L., Eliott, D., Filley, E., et al. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2011.09.028 · Cited by 700
Schmidt, E. M., Bak, M. J., Hambrecht, F. T., Kufta, C. V., O'Rourke, D. K., & Vallabhanath, P. (1996) · Brain · doi:10.1093/brain/119.2.507 · Cited by 672
Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS
Stingl, K., Bartz-Schmidt, K. U., Besch, D., Braun, A., Bruckmann, A., Gekeler, F., Greppmaier, U., Hipp, S., Hörtdörfer, G., Kernstock, C., et al. (2013) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2013.0077 · Cited by 473
Dobelle, W. H., Mladejovsky, M. G., & Girvin, J. P. (1974) · Science · doi:10.1126/science.183.4123.440 · Cited by 440
Pattern recognition with the optic nerve visual prosthesis
Veraart, C., Wanet‐Defalque, M., Gérard, B., Vanlierde, A., & Delbeke, J. (2003) · Artificial Organs · doi:10.1046/j.1525-1594.2003.07305.x · Cited by 259
Mobility performance with a pixelized vision system.
Cha, K., Horch, K. W., & Normann, R. A. (1992) · Vision Research · doi:10.1016/0042-6989(92)90229-c · Cited by 226
What blindness can tell us about seeing again: merging neuroplasticity and neuroprostheses
Merabet, L. B., Rizzo, J. F., Amedi, A., Somers, D. C., & Pascual-Leone, A. (2005) · Nature reviews. Neuroscience · doi:10.1038/nrn1586 · Cited by 179
Simulating prosthetic vision: I. Visual models of phosphenes
Chen, S. C., Suaning, G. J., Morley, J. W., & Lovell, N. H. (2009) · Vision Research · doi:10.1016/j.visres.2009.02.003 · Cited by 172
Temporal properties of visual perception on electrical stimulation of the retina
Pérez Fornos, A., Sommerhalder, J., da Cruz, L., Sahel, J. A., Mohand-Said, S., Hafezi, F., & Pelizzone, M. (2012) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.11-9344 · Cited by 113
Simulation of artificial vision: I. Eccentric reading of isolated words, and perceptual learning
Sommerhalder, J., Oueghlani, E., Bagnoud, M., Leonards, U., Safran, A. B., & Pelizzone, M. (2003) · Vision Research · doi:10.1016/s0042-6989(02)00481-9 · Cited by 111
Dagnelie, G., Barnett, D., Humayun, M. S., & Thompson, R. W. (2006) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.05-0157 · Cited by 90
Cited by
Semantic and structural image segmentation for prosthetic vision
Sanchez-Garcia, M., Martinez-Cantin, R., & Guerrero, J. J. (2020) · PLOS ONE · doi:10.1371/journal.pone.0227677 · Cited by 62
Immersive Virtual Reality Simulations of Bionic Vision
Kasowski, J., & Beyeler, M. (2022) · Augmented Humans 2022 · doi:10.1145/3519391.3522752 · Cited by 22
“Others focused on slightly more complex tasks such as letter [56], word [38], face [11, 14], and object recognition [33, 50, 55].”
BackgroundIndoor scenes understanding for visual prosthesis with fully convolutional networks
Sanchez-Garcia, M., Martinez-Cantin, R., & Guerrero, J. (2019) · Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0007257602180225 · Cited by 16
A computational model to design wide field-of-view optic nerve neuroprostheses
Micera, S., Romeni, S., De Luca, D., Pierantoni, L., Toni, L., Marino, G., & Moccia, S. (2023) · doi:10.21203/rs.3.rs-3218482/v1 · Cited by 2
Metadata
- Authors
- Macé, M. J. ‐., Guivarch, V., Denis, G., & Jouffrais, C.
- Venue
- Artificial Organs
- Publisher
- Wiley
- Published
- 2015-04-20
- Volume
- 39
- Issue
- 7
- Pages
- E102-13
- ISSN
- 0160-564X (ISSN-L)
- 1525-1594
- OpenAlex
- W2118638852
- Cited by
- 16
- References
- 15
- FWCI
- 0.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.