Retinotopic to spatiotopic mapping in blind patients implanted with the Argus II retinal prosthesis
Open accessAbstract
Purpose: To quantify the precision of mapping from retinotopic (retina-centered) to spatiotopic (world-centered) coordinates in blind humans implanted with a retinal prosthesis device. Additionally, to demonstrate that an eye tracker can be calibrated on sightless patients based on the percept from a visual implant. Methods: We directly activated epiretinal electrodes to create retinotopic stimuli and recorded the location of the percept at world-based coordinates. In contrast to normal Argus II use where stimulation is a function of the captured scene's image, in this research we directly controlled the waveform in each electrode and measured the percept's location using a trackable handheld marker. For eye tracking, pupil images were recorded with a timestamp synchronized to the stimulation and marker positions. Results: Remapping of the measured world locations to the position of the electrodes on the retina is feasible by accounting for eye orientation at the onset of stimulation. Transformation of pupil images to the eye's orientation (i.e., eye tracker calibration) can be done by solving for the variables that minimize the spread of the remapped retinal electrode locations. After mapping to retinal coordinates based on eye positions, the measured precision of pointing was 2° to 3°, which is comparable to open-loop pointing in sighted individuals. Conclusions: The brain accurately maps the artificial vision induced by a retinal prosthesis based on instantaneous gaze position. Remapping based on eye position is feasible and will increase visual stability in prosthetic vision.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In blind patients implanted with retinal prostheses, the brain shifts the location of electrically-elicited percepts based on eye position.
“In blind patients implanted with retinal prostheses, the brain shifts the location of electrically-elicited percepts based on the eye position [12,13].”
From Eye movements and the perceived location of phosphenes generated by intracranial primary visual cortex stimulation in the blind (2021) · cites this paper as [12]
The brain of a blind subject shifts the location of a percept elicited by electrical stimulation of a retinal location based on the instantaneous eye position at the time of the stimulation, as demonstrated with the Argus II retinal prosthesis system.
“This finding is similar to results obtained using the Argus II retinal prosthesis system [12] which demonstrated that the brain of a blind subject shifts the location of a percept elicited by electrical stimulation of a retinal location based on the instantaneous eye position at the time of the stimulation.”
From Eye movements and the perceived location of phosphenes generated by intracranial primary visual cortex stimulation in the blind (2021) · cites this paper as [12]
Voluntary and involuntary eye movements affect the spatial localisation of the phosphene elicited by retinal and cortical stimulation, even after years of blindness.
“They affect the spatial localisation of the phosphene elicited by retinal [200] and cortical [101] stimulation, even after years of blindness.”
From Advances in visual prostheses: engineering and biological challenges (2022) · cites this paper as [200]
Mislocalization may be due to eye movements affecting phosphene location or to inconsistencies in phosphene size and brightness.
“Mislocalization can be attributed to eye movements that influence the location of the phosphene (Sabbah et al. 2014; Caspi et al. 2017; 2021), or inconsistencies in phosphene size and brightness.”
From Sequential epiretinal stimulation improves discrimination in simple shape discrimination tasks only (2022) · cites this paper as Caspi et al. 2017
Cites
Davies, D. L., & Bouldin, D. W. (1979) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1979.4766909 · Cited by 9,145 · see citing works
Convergence Properties of the Nelder--Mead Simplex Method in Low Dimensions
Lagarias, J. C., Reeds, J. A., Wright, M. H., & Wright, P. E. (1998) · SIAM Journal on Optimization · doi:10.1137/s1052623496303470 · Cited by 7,449 · see citing works
The updating of the representation of visual space in parietal cortex by intended eye movements
Duhamel, J.-R., Colby, C. L., & Goldberg, M. E. (1992) · Science · doi:10.1126/science.1553535 · Cited by 1,966 · see citing works
Encoding of Spatial Location by Posterior Parietal Neurons
Andersen, R., Essick, G. K., & Siegel, R. M. (1985) · Science · doi:10.1126/science.4048942 · Cited by 1,413 · see citing works
Visual field maps in human cortex.
Wandell, B. A., Dumoulin, S. O., & Brewer, A. A. (2007) · Neuron · doi:10.1016/j.neuron.2007.10.012 · Cited by 1,231 · see citing works
Visual perception in a blind subject with a chronic microelectronic retinal prosthesis
Humayun, M. S., Weiland, J. D., Fujii, G. Y., Greenberg, R., Williamson, R., Little, J., Mech, B., Cimmarusti, V., Van Boemel, G., Dagnelie, G., et al. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00457-7 · Cited by 856 · see citing works
Self-citationSubretinal electronic chips allow blind patients to read letters and combine them to words
Zrenner, E., Bartz-Schmidt, K. U., Benav, H., Besch, D., Bruckmann, A., Gabel, V.-P., Gekeler, F., Greppmaier, U., Harscher, A., Kibbel, S., et al. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.1747 · Cited by 819 · see citing works
Interim results from the international trial of Second Sight's visual prosthesis
Humayun, M. S., Dorn, J. D., da Cruz, L., Dagnelie, G., Sahel, J.-A., Stanga, P. E., Cideciyan, A. V., Duncan, J. L., Eliott, D., Filley, E., et al. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2011.09.028 · Cited by 700 · see citing works
Self-citationSelective suppression of the magnocellular visual pathway during saccadic eye movements
Burr, D. C., Morrone, M. C., & Ross, J. (1994) · Nature · doi:10.1038/371511a0 · Cited by 685 · see citing works
Neuronal mechanisms of visual stability
Wurtz, R. H. (2008) · Vision Research · doi:10.1016/j.visres.2008.03.021 · Cited by 587 · see citing works
Influence of the thalamus on spatial visual processing in frontal cortex
Sommer, M. A., & Wurtz, R. H. (2006) · Nature · doi:10.1038/nature05279 · Cited by 520 · see citing works
Gaze-centered remapping of remembered visual space in an open-loop pointing task
Henriques, D. Y. P., Klier, E. M., Smith, M. A., Lowy, D., & Crawford, J. D. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-04-01583.1998 · Cited by 403 · see citing works
Photovoltaic restoration of sight with high visual acuity
Lorach, H., Goetz, G., Smith, R., Lei, X., Mandel, Y., Kamins, T. I., Mathieson, K., Huie, P., Harris, J. S., Sher, A., et al. (2015) · Nature Medicine · doi:10.1038/nm.3851 · Cited by 341 · see citing works
Non-linear projection of the retinal image in a wide-angle schematic eye.
Drasdo, N., & Fowler, C. W. (1974) · British Journal of Ophthalmology · doi:10.1136/bjo.58.8.709 · Cited by 306 · see citing works
Proprioceptive knowledge of eye position
Steinbach, M. J. (1987) · Vision Research · doi:10.1016/0042-6989(87)90103-9 · Cited by 301 · see citing works
Bock, O. (1986) · Experimental Brain Research · doi:10.1007/bf00340484 · Cited by 249 · see citing works
The proprioceptive representation of eye position in monkey primary somatosensory cortex
Wang, X., Zhang, M., Cohen, I. S., & Goldberg, M. E. (2007) · Nature Neuroscience · doi:10.1038/nn1878 · Cited by 223 · see citing works
Demonstration of artificial visual percepts generated through thalamic microstimulation
Pezaris, J. S., & Reid, R. C. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608563104 · Cited by 195 · see citing works
Nanduri, D., Fine, I., Horsager, A., Boynton, G. M., Humayun, M. S., Greenberg, R. J., & Weiland, J. D. (2012) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.11-8401 · Cited by 163 · cited 1× · see citing works
“The activation of the fiber tracts might create an elongated percept along the axon.(23) Thus, the percept can be moved along the direction of the axons underneath the electrode causing relocation of the location of the percept.”
BackgroundThe Role of Ocular Muscle Proprioception in Visual Localization of Targets
Gauthier, G. M., Nommay, D., & Vercher, J. (1990) · Science · doi:10.1126/science.2367852 · Cited by 156 · see citing works
Toward the development of a cortically based visual neuroprosthesis
Normann, R. A., Greger, B. A., House, P., Romero, S. F., Pelayo, F., & Fernandez, E. (2009) · Journal of Neural Engineering · doi:10.1088/1741-2560/6/3/035001 · Cited by 143 · see citing works
Neuronal mechanisms for visual stability: progress and problems
Wurtz, R. H., Joiner, W. M., & Berman, R. A. (2011) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2010.0186 · Cited by 140 · see citing works
Factors Affecting Perceptual Threshold in Argus II Retinal Prosthesis Subjects
Ahuja, A. K., Yeoh, J., Dorn, J. D., Caspi, A., Wuyyuru, V., McMahon, M. J., Humayun, M. S., Greenberg, R. J., daCruz, L., & Argus II Study Group (2013) · Translational Vision Science & Technology · doi:10.1167/tvst.2.4.1 · Cited by 123 · see citing works
Self-citationThe non-visual impact of eye orientation on eye-hand coordination
Enright, J. T. (1995) · Vision Research · doi:10.1016/0042-6989(94)00260-s · Cited by 100 · see citing works
Oculomotor function in the rhesus monkey after deafferentation of the extraocular muscles
Lewis, R. F., Zee, D. S., Hayman, M., & Tamargo, R. J. (2001) · Experimental Brain Research · doi:10.1007/s002210100876 · Cited by 99 · see citing works
The Argus™ II retinal prosthesis: Factors affecting patient selection for implantation
Ahuja, A., & Behrend, M. R. (2013) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2013.01.002 · Cited by 82 · see citing works
PREFERRED RETINAL LOCUS IN MACULAR DISEASE
Greenstein, V. C., Santos, R. A. V., Tsang, S. H., et al. (2008) · Retina · doi:10.1097/iae.0b013e31817c1b47 · Cited by 77 · see citing works
The role of peripheral vision in saccade planning: Learning from people with tunnel vision
Luo, G., Vargas-Martı́n, F., & Peli, E. (2008) · Journal of Vision · doi:10.1167/8.14.25 · Cited by 75 · see citing works
SiC protective coating for photovoltaic retinal prosthesis
Lei, X., Kane, S. R., Cogan, S. F., Lorach, H., Galambos, L., Huie, P., Mathieson, K., Kamins, T. I., Harris, J. S., & Palanker, D. (2016) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/4/046016 · Cited by 64 · see citing works
Stability of the Visual World during Eye Drift
Poletti, M., Listorti, C., & Rucci, M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1925-10.2010 · Cited by 54 · see citing works
Optimal Multimodal Integration in Spatial Localization
Poletti, M., Burr, D. C., & Rucci, M. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0523-13.2013 · Cited by 53 · see citing works
Preliminary report on a retinal stimulator.
Ge, T. (1956) · PubMed · Cited by 49 · see citing works
Eye Position Representation in Human Anterior Parietal Cortex
Balslev, D., & Miall, R. C. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1513-08.2008 · Cited by 47 · see citing works
Luo, Y. H.-L., Zhong, J. J., Clemo, M., & da Cruz, L. (2016) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2016.07.021 · Cited by 47 · see citing works
Sabbah, N., Authie, C. N., Sanda, N., Mohand-Said, S., Sahel, J.-A., & Safran, A. B. (2014) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.14-15392 · Cited by 45 · see citing works
Oculomotor behavior of blind patients seeing with a subretinal visual implant
Hafed, Z. M., Stingl, K., Bartz-Schmidt, K.-U., Gekeler, F., & Zrenner, E. (2016) · Vision Research · doi:10.1016/j.visres.2015.04.006 · Cited by 43 · see citing works
Motion perception during involuntary eye vibration
Peli, E., & García-Pérez, M. Á. (2003) · Experimental Brain Research · doi:10.1007/s00221-003-1383-y · Cited by 23 · see citing works
A Novel Gaze Tracking Method Based on the Generation of Virtual Calibration Points
Lee, J. H., Heo, H., & Park, K. R. (2013) · Sensors · doi:10.3390/s130810802 · Cited by 17 · see citing works
Hand-Camera Coordination Varies over Time in Users of the Argus® II Retinal Prosthesis System
Barry, M. P., & Dagnelie, G. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00041 · Cited by 17 · see citing works
Wang, L., Yang, L., & Dagnelie, G. (2008) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.07-1346 · Cited by 13 · see citing works
Rine, R. M., & Skavenski, A. A. (1997) · Vision Research · doi:10.1016/s0042-6989(96)00216-7 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
An update on retinal prostheses
Ayton, L. N., Barnes, N., Dagnelie, G., Fujikado, T., Goetz, G., Hornig, R., Jones, B. W., Muqit, M. M. K., Rathbun, D. L., Stingl, K., et al. (2020) · Clinical Neurophysiology · doi:10.1016/j.clinph.2019.11.029 · Cited by 223 · see citing works
Caspi, A., Roy, A., Wuyyuru, V., Rosendall, P. E., Harper, J. W., Katyal, K. D., Barry, M. P., Dagnelie, G., & Greenberg, R. J. (2018) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.17-22377 · Cited by 47 · see citing works
Self-citationAdvances in visual prostheses: engineering and biological challenges
Borda, E., & Ghezzi, D. (2022) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/ac812c · Cited by 44 · see citing works
Paraskevoudi, N., & Pezaris, J. S. (2019) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2018.00073 · Cited by 39 · see citing works
Caspi, A., Barry, M. P., Patel, U. K., Salas, M. A., Dorn, J. D., Roy, A., Niketeghad, S., Greenberg, R. J., & Pouratian, N. (2021) · Brain Stimulation · doi:10.1016/j.brs.2021.04.019 · Cited by 32 · see citing works
Self-citationPetoe, M. A., McCarthy, C. D., Shivdasani, M. N., Sinclair, N. C., Scott, A. F., Ayton, L. N., Barnes, N. M., Guymer, R. H., Allen, P. J., Blamey, P. J., et al. (2017) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.16-21041 · Cited by 23 · see citing works
Advances in neuroscience, not devices, will determine the effectiveness of visual prostheses
Abbasi, B., & Rizzo, J. F. (2021) · Seminars in Ophthalmology · doi:10.1080/08820538.2021.1887902 · Cited by 19 · see citing works
Factors affecting two-point discrimination in argus II patients
Yücel, E. I., Sadeghi, R., Kartha, A., Montezuma, S. R., Dagnelie, G., Rokem, A., Boynton, G. M., Fine, I., & Beyeler, M. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.901337 · Cited by 13 · see citing works
Improvement in reading performance through training with simulated thalamic visual prostheses
Rassia, K. E. K., & Pezaris, J. S. (2018) · Scientific Reports · doi:10.1038/s41598-018-31435-0 · Cited by 13 · see citing works
Sequential epiretinal stimulation improves discrimination in simple shape discrimination tasks only
Christie, B., Sadeghi, R., Kartha, A., Caspi, A., Tenore, F. V., Klatzky, R. L., Dagnelie, G., & Billings, S. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac7326 · Cited by 10 · see citing works
Self-citation
- Authors
- Caspi, A., Roy, A., Dorn, J. D., & Greenberg, R. J.
- Affiliations
- Jerusalem College of Technology (IL)
- Second Sight Medical Products (US)
- Corresponding author
- Caspi, Avi
- Venue
- Investigative Opthalmology & Visual Science
- Published
- 2017-01-09
- Volume
- 58
- Issue
- 1
- Pages
- 119
- ISSN
- 0146-0404 (ISSN-L)
- 1552-5783
- OpenAlex
- W2580322668
- Cited by
- 32
- References
- 41
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 1 · 2022: 4 · 2021: 4 · 2020: 6 · 2019: 4 · 2018: 8 · 2017: 2
- FWCI
- 2.68
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Investigative Ophthalmology & Visual Science (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neural Engineering
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- Argus II retinal prosthesis, blind patients, eye tracking calibration, eye orientation, pointing accuracy, visual stability
- MeSH terms
- Attention, Blindness, Female, Fixation, Ocular, Humans, Male, Orientation, Photic Stimulation, Retina, Saccades, Time Factors, Visual Cortex, Visual Perception, Visual Prosthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
