Optimization of Electrical Stimulation for a High-Fidelity Artificial Retina
Abstract
Retinal prostheses aim to restore visual perception in patients blinded by photoreceptor degeneration, by stimulating surviving retinal ganglion cells (RGCs), causing them to send artificial visual signals to the brain. Present-day devices produce limited vision, in part due to indiscriminate and simultaneous activation of many RGCs of different types that normally signal asynchronously. To improve artificial vision, we propose a closed-loop, cellular-resolution device that automatically identifies the types and properties of nearby RGCs, calibrates its stimulation to produce a dictionary of achievable RGC activity patterns, and then uses this dictionary to optimize stimulation patterns based on the incoming visual image. To test this concept, we use a high-density multi-electrode array as a lab prototype, and deliver a rapid sequence of electrical stimuli from the dictionary, progressively assembling a visual image within the visual integration time of the brain. Greedily minimizing the error between the visual stimulus and a linear reconstruction (as a surrogate for perception) yields a real-time algorithm with an efficiency of 96% relative to optimum. This framework also provides insights for developing efficient hardware. For example, using only the most effective 50% of electrodes minimally affects performance, suggesting that an adaptive device configured using measured properties of the patient's retina may permit efficiency with accuracy.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Alternative stimulation strategies have not been validated in vivo in humans using perceptually relevant pulse-train stimulation, and most do not address the substantial day-to-day variability in cortical responses that limits clinical reliability.
“While alternative stimulation strategies have been proposed [25–39], none have been validated in vivo in humans using perceptually relevant pulse-train stimulation, and most do not address the substantial day-to-day variability in cortical responses that limits clinical reliability.”
From Deep Learning–Based Control of Electrically Evoked Activity in Human Visual Cortex (2025) · cites this paper as [26]
Several studies have proposed more sophisticated stimulus encoding strategies to recreate a desired neural activity pattern over a given temporal window, but none of these approaches are able to predict the perceptual consequences of the resulting neural activity.
“Several studies have already proposed more sophisticated stimulus encoding strategies to recreate a desired neural activity pattern over a given temporal window (Shah et al., 2019; Spencer et al., 2019; Ghaffari et al., 2021). However, none of these approaches are able to predict the perceptual consequences of the resulting neural activity.”
From Towards a <i>Smart Bionic Eye</i> : AI-powered artificial vision for the treatment of incurable blindness (2022) · cites this paper as Shah et al., 2019
Cites
Interim results from the international trial of Second Sight's visual prosthesis
Humayun, M. S., Dorn, J. D., da Cruz, L., Dagnelie, G., Sahel, J.-A., Stanga, P. E., Cideciyan, A. V., Duncan, J. L., Eliott, D., Filley, E., et al. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2011.09.028 · Cited by 700 · see citing works
Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS
Stingl, K., Bartz-Schmidt, K. U., Besch, D., Braun, A., Bruckmann, A., Gekeler, F., Greppmaier, U., Hipp, S., Hörtdörfer, G., Kernstock, C., et al. (2013) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2013.0077 · Cited by 473 · see citing works
Functional Asymmetries in ON and OFF Ganglion Cells of Primate Retina
Chichilnisky, E. J., & Kalmar, R. S. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02737.2002 · Cited by 463 · see citing works
Self-citationPhotovoltaic restoration of sight with high visual acuity
Lorach, H., Goetz, G., Smith, R., Lei, X., Mandel, Y., Kamins, T. I., Mathieson, K., Huie, P., Harris, J. S., Sher, A., et al. (2015) · Nature Medicine · doi:10.1038/nm.3851 · Cited by 341 · see citing works
Self-citationThe visibility of transient changes of luminance
Rashbass, C. (1970) · The Journal of Physiology · doi:10.1113/jphysiol.1970.sp009202 · Cited by 238 · see citing works
McDermott, H. J., McKay, C. M., & Vandali, A. E. (1992) · The Journal of the Acoustical Society of America · doi:10.1121/1.402826 · Cited by 219 · see citing works
High-Resolution Electrical Stimulation of Primate Retina for Epiretinal Implant Design
Sekirnjak, C., Hottowy, P., Sher, A., Dąbrowski, W., Litke, A. M., & Chichilnisky, E. J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.5138-07.2008 · Cited by 195 · see citing works
Self-citationFidelity of the Ensemble Code for Visual Motion in Primate Retina
Frechette, E. S., Sher, A., Grivich, M. I., Petrusca, D., Litke, A. M., & Chichilnisky, E. J. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01175.2004 · Cited by 125 · see citing works
Self-citationConservation of temporal information by perceptual systems
Efron, R. (1973) · Perception & Psychophysics · doi:10.3758/bf03211193 · Cited by 104 · see citing works
Spatially patterned electrical stimulation to enhance resolution of retinal prostheses
Jepson, L. H., Hottowy, P., Mathieson, K., Gunning, D. E., Dąbrowski, W., Litke, A. M., & Chichilnisky, E. J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2882-13.2014 · Cited by 103 · see citing works
Self-citationCurrent steering in retinal stimulation via a quasimonopolar stimulation paradigm
Matteucci, P. B., Chen, S. C., Tsai, D., Dodds, C. W. D., Dokos, S., Morley, J. W., Lovell, N. H., & Suaning, G. J. (2013) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.13-11653 · Cited by 79 · cited 1× · see citing works
“For example, the impact of different electrical stimulation patterns such as current steering [17], [19], [20] and local return [21], [22] can be directly compared by evaluating the quality of the final inferred visual image.”
BackgroundFunctional Outcome in Subretinal Electronic Implants Depends on Foveal Eccentricity
Štingl, K., Bartz‐Schmidt, K. U., Gekeler, F., Kusnyerik, Á., Sachs, H. G., & Zrenner, E. (2013) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.13-12835 · Cited by 73 · see citing works
Activation of ganglion cells and axon bundles using epiretinal electrical stimulation
Grosberg, L. E., Ganesan, K., Goetz, G. A., Madugula, S. S., Bhaskhar, N., Fan, V., Li, P., Hottowy, P., Dabrowski, W., Sher, A., et al. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00750.2016 · Cited by 70 · cited 2× · see citing works
“Dictionary elements that stimulated cells along their axons, with somas off the electrode array, were removed due to their unknown receptive field locations and thus uncertain contribution to stimulus reconstruction [7].”
BackgroundHottowy, P., Skoczeń, A., Gunning, D. E., Kachiguine, S., Mathieson, K., Sher, A., Wiącek, P., Litke, A. M., & Dąbrowski, W. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/6/066005 · Cited by 67 · see citing works
Self-citationVirtual electrodes by current steering in retinal prostheses
Dumm, G., Fallon, J. B., Williams, C. E., & Shivdasani, M. N. (2014) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.14-15391 · Cited by 63 · see citing works
Abramian, M., Lovell, N. H., Morley, J. W., Suaning, G. J., & Dokos, S. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/3/035004 · Cited by 52 · see citing works
Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays
Mena, G. E., Grosberg, L. E., Madugula, S. S., Hottowy, P., Litke, A. M., Cunningham, J. P., Chichilnisky, E. J., & Paninski, L. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005842 · Cited by 51 · see citing works
Self-citationGuo, T., Yang, C. Y., Tsai, D., Muralidharan, M., Suaning, G. J., Morley, J. W., Dokos, S., & Lovell, N. H. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00168 · Cited by 43 · see citing works
Epiretinal stimulation with local returns enhances selectivity at cellular resolution
Fan, V. H., Grosberg, L. E., Madugula, S. S., Hottowy, P., Dąbrowski, W., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaeef1 · Cited by 43 · see citing works
Self-citationOptimizing stimulation protocols for prosthetic vision based on retinal anatomy
Beyeler, M., Nanduri, D., Weiland, J. D., et al. (2018) · Journal of Vision · doi:10.1167/18.10.205 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Stimulation strategies for improving the resolution of retinal prostheses
Tong, W., Meffin, H., Garrett, D. J., & Ibbotson, M. R. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00262 · Cited by 66 · see citing works
Reconstruction of natural images from responses of primate retinal ganglion cells
Brackbill, N., Rhoades, C., Kling, A., Shah, N. P., Sher, A., Litke, A. M., & Chichilnisky, E. (2020) · eLife · doi:10.7554/elife.58516 · Cited by 57 · see citing works
Self-citationHigh-Fidelity Reproduction of Visual Signals by Electrical Stimulation in the Central Primate Retina
Gogliettino, A. R., Madugula, S. S., Grosberg, L. E., Vilkhu, R. S., Brown, J., Nguyen, H., Kling, A., Hottowy, P., Dąbrowski, W., Sher, A., et al. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.1091-22.2023 · Cited by 30 · see citing works
Self-citationBeyeler, M., & Sanchez-Garcia, M. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/aca69d · Cited by 34 · see citing works
“In line with research practices in the human–computer interaction (HCI) community, the first step is to identify the information needs of the end user through a series of qualitative and quantitative studies.”
Retinal Stimulator ASIC Architecture Based on a Joint Power and Data Optical Link
Lemaire, W., Benhouria, M., Koua, K., Besrour, M., Gauthier, L.-P., Martin-Hardy, G., Rossignol, T., Roy, S., & Fontaine, R. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2020.3045141 · Cited by 32 · see citing works
Focal electrical stimulation of human retinal ganglion cells for vision restoration
Madugula, S. S., Gogliettino, A. R., Zaidi, M., Aggarwal, G., Kling, A., Shah, N. P., Brown, J. B., Vilkhu, R., Hays, M. R., Nguyen, H., et al. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/aca5b5 · Cited by 26 · see citing works
Self-citationHuman-in-the-loop optimization of visual prosthetic stimulation
Fauvel, T., & Chalk, M. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac7615 · Cited by 15 · see citing works
An actor-model framework for visual sensory encoding
Leong, F., Rahmani, B., Psaltis, D., Moser, C., & Ghezzi, D. (2024) · Nature Communications · doi:10.1038/s41467-024-45105-5 · Cited by 8 · see citing works
A Deep Learning-based in silico Framework for Optimization on Retinal Prosthetic Stimulation
Wu, Y., Karetić, I., Stegmaier, J., Walter, P., & Merhof, D. (2023) · 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) · doi:10.1109/embc40787.2023.10340288 · Cited by 6 · see citing works
Neural Activity Shaping in Visual Prostheses with Deep Learning
Castro, D., Grayden, D. B., Meffin, H., & Spencer, M. (2023) · doi:10.1101/2023.12.20.572123 · Cited by 4 · see citing works
Human-in-the-loop optimization of visual prosthetic stimulation
Fauvel, T., & Chalk, M. (2021) · doi:10.1101/2021.11.24.469867 · Cited by 15 · see citing works
High-fidelity reproduction of visual signals by electrical stimulation in the central primate retina
Gogliettino, A. R., Madugula, S. S., Grosberg, L. E., Vilkhu, R. S., Brown, J., Nguyen, H., Kling, A., Hottowy, P., Dąbrowski, W., Sher, A., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.24.493162 · Cited by 30 · see citing works
Self-citationDeep Learning–Based Control of Electrically Evoked Activity in Human Visual Cortex
Moure, P., Granley, J., Grani, F., Soo, L., Lozano, A., López-Peco, R., Villamarin-Ortiz, A., Soto-Sanchez, C., Liu, S.-C., Beyeler, M., et al. (2025) · bioRxiv · doi:10.1101/2025.09.24.678361
- Authors
- Shah, N. P., Madugula, S., Grosberg, L., Mena, G., Tandon, P., Hottowy, P., Sher, A., Litke, A., Mitra, S., & Chichilnisky, E. J.
- Affiliations
- Stanford University (US)
- Harvard University (US)
- University of California, Santa Cruz (US)
- ORCID
- Venue
- 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)
- Publisher
- IEEE
- Published
- 2019-03
- Pages
- 714-718
- ISSN
- 1948-3554 (ISSN-L)
- OpenAlex
- W2945793360
- Cited by
- 32
- References
- 20
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 8 · 2022: 6 · 2021: 4 · 2020: 7 · 2019: 1
- FWCI
- 18.12
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- International IEEE/EMBS Conference on Neural Engineering (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neural Engineering
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Retinal Development and Disorders
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- retinal prosthesis, artificial retina, retinal ganglion cells, closed-loop stimulation, microelectrode arrays, visual perception, linear reconstruction, electrode efficiency, adaptive stimulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review