Reconstruction of natural images from responses of primate retinal ganglion cells
Open accessPublished version of a preprint
Abstract
The visual message conveyed by a retinal ganglion cell (RGC) is often summarized by its spatial receptive field, but in principle also depends on the responses of other RGCs and natural image statistics. This possibility was explored by linear reconstruction of natural images from responses of the four numerically-dominant macaque RGC types. Reconstructions were highly consistent across retinas. The optimal reconstruction filter for each RGC – its visual message – reflected natural image statistics, and resembled the receptive field only when nearby, same-type cells were included. ON and OFF cells conveyed largely independent, complementary representations, and parasol and midget cells conveyed distinct features. Correlated activity and nonlinearities had statistically significant but minor effects on reconstruction. Simulated reconstructions, using linear-nonlinear cascade models of RGC light responses that incorporated measured spatial properties and nonlinearities, produced similar results. Spatiotemporal reconstructions exhibited similar spatial properties, suggesting that the results are relevant for natural vision.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
At the retinal level, as experimental sampling of the population of neurons converges to a complete tiling, the reconstruction filters generated by the optimal reconstruction filter approach come to resemble receptive fields as measured using white noise stimuli.
“However, at the retinal level it has been found that as experimental sampling of the population of neurons converges to a complete tiling, the reconstruction filters generated by this approach come to resemble receptive fields as measured using white noise stimuli.”
From A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts (2024) · cites this paper as [91]
Linear averaging may, in practice, capture the essential structure of how neuronal messages are encoded by the brain.
“Thus our linear averaging may, in practice, capture the essential structure of how neuronal messages are encoded by the brain91.”
From A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts (2024) · cites this paper as [91]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892 · see citing works
Spikes: Exploring the Neural Code
Rieke, F. M., Warland, D., van Steveninck, R. R. D. R., & Bialek, W. (1996) · Medical Entomology and Zoology · Cited by 2,844 · see citing works
DISCHARGE PATTERNS AND FUNCTIONAL ORGANIZATION OF MAMMALIAN RETINA
Kuffler, S. W. (1953) · Journal of Neurophysiology · doi:10.1152/jn.1953.16.1.37 · Cited by 2,609 · see citing works
What the frog's eye tells the frog's brain
Lettvin, J., Maturana, H., McCulloch, W., & Pitts, W. (1959) · Proceedings of the IRE · doi:10.1109/jrproc.1959.287207 · Cited by 1,990 · see citing works
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · see citing works
Spatio-temporal correlations and visual signalling in a complete neuronal population
Pillow, J. W., Shlens, J., Paninski, L., Sher, A., Litke, A. M., Chichilnisky, E. J., & Simoncelli, E. P. (2008) · Nature · doi:10.1038/nature07140 · Cited by 1,315 · see citing works
Self-citationThe Neuronal Organization of the Retina
Masland, R. H. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.002 · Cited by 1,155 · see citing works
Bialek, W., Rieke, F. M., van Steveninck, R. R. D. R., & Warland, D. K. (1991) · Science · doi:10.1126/science.2063199 · Cited by 1,001 · see citing works
Statistics of natural images: Scaling in the woods
Ruderman, D., & Bialek, W. (1994) · Physical Review Letters · doi:10.1103/physrevlett.73.814 · Cited by 954 · see citing works
Naselaris, T., Kay, K., Nishimoto, S., & Gallant, J. L. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 894 · see citing works
A simple white noise analysis of neuronal light responses
Chichilnisky, E. J. (2001) · Network Computation in Neural Systems · doi:10.1080/net.12.2.199.213 · Cited by 788 · see citing works
Self-citationWhy is image quality assessment so difficult?
Wang, Z., Bovik, A. C., & Lu, L. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745362 · Cited by 787 · see citing works
Linear Algebra and its Applications
(1980) · Elsevier eBooks · doi:10.1016/c2013-0-11558-9 · Cited by 753 · see citing works
A simple white noise analysis of neuronal light responses
Chichilnisky, E. J. (2001) · Network Computation in Neural Systems · doi:10.1080/713663221 · Cited by 705 · see citing works
Self-citationRapid Neural Coding in the Retina with Relative Spike Latencies
Gollisch, T., & Meister, M. (2008) · Science · doi:10.1126/science.1149639 · Cited by 663 · see citing works
2005 IEEE International Conference on Acoustics, Speech, and Signal Processing
(2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2005.1415922 · Cited by 629 · see citing works
Functional properties of ganglion cells of the rhesus monkey retina.
de Monasterio, F. M., & Gouras, P. (1975) · The Journal of Physiology · doi:10.1113/jphysiol.1975.sp011086 · Cited by 617 · see citing works
Cardinal rules: visual orientation perception reflects knowledge of environmental statistics
Girshick, A. R., Landy, M. S., & Simoncelli, E. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2831 · Cited by 613 · see citing works
Bayesian Reconstruction of Natural Images from Human Brain Activity
Naselaris, T., Prenger, R., Kay, K., Oliver, M., & Gallant, J. L. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.006 · Cited by 499 · see citing works
Perry, V. H., & Cowey, A. (1985) · Vision Research · doi:10.1016/0042-6989(85)90004-5 · Cited by 498 · see citing works
Dendritic field size and morphology of midget and parasol ganglion cells of the human retina.
Dacey, D. M., & Petersen, M. R. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.20.9666 · Cited by 495 · see citing works
The structure and precision of retinal spike trains
Berry, M. J., Warland, D. K., & Meister, M. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.10.5411 · Cited by 490 · see citing works
The mosaic of midget ganglion cells in the human retina
Dacey, D. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-12-05334.1993 · Cited by 480 · see citing works
The Structure of Multi-Neuron Firing Patterns in Primate Retina
Shlens, J., Field, G. D., Gauthier, J. L., Grivich, M. I., Petrusca, D., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1282-06.2006 · Cited by 471 · see citing works
Self-citationFunctional Asymmetries in ON and OFF Ganglion Cells of Primate Retina
Chichilnisky, E. J., & Kalmar, R. S. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02737.2002 · Cited by 463 · see citing works
Self-citationIdentification of cone mechanisms in monkey ganglion cells
Gouras, P. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008667 · Cited by 433 · see citing works
Decoding Visual Information From a Population of Retinal Ganglion Cells
Warland, D. K., Reinagel, P., & Meister, M. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.5.2336 · Cited by 415 · see citing works
Functional connectivity in the retina at the resolution of photoreceptors
Field, G. D., Gauthier, J. L., Sher, A., Greschner, M., Machado, T. A., Jepson, L. H., Shlens, J., Gunning, D. E., Mathieson, K., Dąbrowski, W., et al. (2010) · Nature · doi:10.1038/nature09424 · Cited by 354 · see citing works
Self-citationConcerted Signaling by Retinal Ganglion Cells
Meister, M., Lagnado, L., & Baylor, D. A. (1995) · Science · doi:10.1126/science.270.5239.1207 · Cited by 345 · see citing works
Fireworks in the Primate Retina
Dacey, D. M., Peterson, B. B., Robinson, F. R., & Gamlin, P. D. (2003) · Neuron · doi:10.1016/s0896-6273(02)01143-1 · Cited by 321 · see citing works
Linear algebra and its applications
Strang, G. (1976) · Cited by 320 · see citing works
Retinal ganglion cells act largely as independent encoders
Nirenberg, S., Carcieri, S., Jacobs, A. L., & Latham, P. E. (2001) · Nature · doi:10.1038/35079612 · Cited by 316 · see citing works
Mosaic Arrangement of Ganglion Cell Receptive Fields in Rabbit Retina
DeVries, S. H., & Baylor, D. A. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.4.2048 · Cited by 313 · see citing works
ImageNet: Constructing a large-scale image database
Fei-Fei, L., Deng, J., & Li, K. (2010) · Journal of Vision · doi:10.1167/9.8.1037 · Cited by 295 · see citing works
Properties of concentrically organized X and Y ganglion cells of macaque retina
de Monasterio, F. M. (1978) · Journal of Neurophysiology · doi:10.1152/jn.1978.41.6.1394 · Cited by 286 · see citing works
Litke, A. M., Bezayiff, N., Chichilnisky, E. J., Cunningham, W. R., Dąbrowski, W., Grillo, A. A., Grivich, M., Gryboś, P., Hottowy, P., Kachiguine, S., et al. (2004) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2004.832706 · Cited by 279 · see citing works
Self-citationDecoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations
Vargas-Irwin, C. E., Shakhnarovich, G., Yadollahpour, P., Mislow, J. M. K., Black, M. J., & Donoghue, J. P. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5443-09.2010 · Cited by 270 · see citing works
Retinal limits to the detection and resolution of gratings
Thibos, L. N., Cheney, F. E., & Walsh, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.001524 · Cited by 260 · see citing works
The relationship between visual resolution and cone spacing in the human fovea
Rossi, E. A., & Roorda, A. (2010) · Nature Neuroscience · doi:10.1038/nn.2465 · Cited by 255 · see citing works
Spatio‐temporal interactions in cat retinal ganglion cells showing linear spatial summation.
Enroth‐Cugell, C., Robson, J. G., Schweitzer‐Tong, D. E., & Watson, A. B. (1983) · The Journal of Physiology · doi:10.1113/jphysiol.1983.sp014806 · Cited by 254 · see citing works
Reconstruction of Natural Scenes from Ensemble Responses in the Lateral Geniculate Nucleus
Stanley, G. B., Li, F. F., & Dan, Y. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-18-08036.1999 · Cited by 240 · see citing works
Redundancy in the Population Code of the Retina
Puchalla, J., Schneidman, E., Harris, R. A., & Berry, M. J. (2005) · Neuron · doi:10.1016/j.neuron.2005.03.026 · Cited by 226 · see citing works
Temporal Encoding of Spatial Information during Active Visual Fixation
Kuang, X., Poletti, M., Victor, J. D., & Rucci, M. (2012) · Current Biology · doi:10.1016/j.cub.2012.01.050 · Cited by 219 · see citing works
Precision of Spike Trains in Primate Retinal Ganglion Cells
Uzzell, V., & Chichilnisky, E. J. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01171.2003 · Cited by 192 · see citing works
Self-citationField, G. D., Sher, A., Gauthier, J. L., Greschner, M., Shlens, J., Litke, A. M., & Chichilnisky, E. J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.3437-07.2007 · Cited by 185 · see citing works
Self-citationInteractions between ganglion cells in cat retina
Mastronarde, D. N. (1983) · Journal of Neurophysiology · doi:10.1152/jn.1983.49.2.350 · Cited by 163 · see citing works
Retinal origin of orientation maps in visual cortex.
Paik, S.-B., & Ringach, D. L. (2011) · Nature Neuroscience · doi:10.1038/nn.2824 · Cited by 161 · see citing works
Derrington, A. M., & Lennie, P. (1982) · The Journal of Physiology · doi:10.1113/jphysiol.1982.sp014457 · Cited by 156 · see citing works
Correlated Firing in Rabbit Retinal Ganglion Cells
DeVries, S. H. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.2.908 · Cited by 142 · see citing works
Noise correlations improve response fidelity and stimulus encoding
Cafaro, J., & Rieke, F. M. (2010) · Nature · doi:10.1038/nature09570 · Cited by 135 · see citing works
The receptive field organization of X-cells in the cat: Spatiotemporal coupling and asymmetry
Dawis, S. M., Shapley, R. M., Kaplan, E., & Tranchina, D. (1984) · Vision Research · doi:10.1016/0042-6989(84)90109-3 · Cited by 129 · see citing works
Fidelity of the Ensemble Code for Visual Motion in Primate Retina
Frechette, E. S., Sher, A., Grivich, M. I., Petrusca, D., Litke, A. M., & Chichilnisky, E. J. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01175.2004 · Cited by 125 · see citing works
Self-citationDirection-Selective Circuits Shape Noise to Ensure a Precise Population Code
Zylberberg, J., Cafaro, J., Turner, M. H., Shea‐Brown, E., & Rieke, F. M. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.019 · Cited by 123 · see citing works
The receptive field of the primate P retinal ganglion cell, I: Linear dynamics
Benardete, E. A., & Kaplan, E. (1997) · Visual Neuroscience · doi:10.1017/s0952523800008853 · Cited by 122 · see citing works
High-sensitivity rod photoreceptor input to the blue-yellow color opponent pathway in macaque retina
Field, G. D., Greschner, M., Gauthier, J. L., Rangel, C., Shlens, J., Sher, A., MARSHAK, D. W., Litke, A. M., & Chichilnisky, E. J. (2009) · Nature Neuroscience · doi:10.1038/nn.2353 · Cited by 115 · see citing works
Self-citationSpatial resolution across the macaque retina
Merigan, W. H., & Katz, L. M. (1990) · Vision Research · doi:10.1016/0042-6989(90)90107-v · Cited by 102 · see citing works
Electronic approaches to restoration of sight
Goetz, G. A., & Palanker, D. (2016) · Reports on Progress in Physics · doi:10.1088/0034-4885/79/9/096701 · Cited by 99 · see citing works
Portelli, G., Barrett, J. M., Hilgen, G., Masquelier, T., Maccione, A., Marco, S. D., Berdondini, L., Kornprobst, P., & Sernagor, E. (2016) · eNeuro · doi:10.1523/eneuro.0134-15.2016 · Cited by 97 · see citing works
Population decoding of motor cortical activity using a generalized linear model with hidden states
Lawhern, V. J., Wu, W. L., Hatsopoulos, N. G., & Paninski, L. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2010.03.024 · Cited by 92 · see citing works
Synaptic Rectification Controls Nonlinear Spatial Integration of Natural Visual Inputs
Turner, M. H., & Rieke, F. M. (2016) · Neuron · doi:10.1016/j.neuron.2016.05.006 · Cited by 91 · see citing works
Mapping nonlinear receptive field structure in primate retina at single cone resolution
Freeman, J., Field, G. D., Li, P. H., Greschner, M., Gunning, D. E., Mathieson, K., Sher, A., Litke, A. M., Paninski, L., Simoncelli, E. P., et al. (2015) · eLife · doi:10.7554/elife.05241 · Cited by 90 · see citing works
Self-citationDOVES: a database of visual eye movements
Bovik, A. C., Cormack, L. K., van der Linde, I., & Rajashekar, U. (2009) · Spatial Vision · doi:10.1163/156856809787465636 · Cited by 89 · see citing works
Neural Mechanisms Mediating Motion Sensitivity in Parasol Ganglion Cells of the Primate Retina
Manookin, M. B., Patterson, S. S., & Linehan, C. M. (2018) · Neuron · doi:10.1016/j.neuron.2018.02.006 · Cited by 82 · see citing works
Steady discharges of macaque retinal ganglion cells
Troy, J. B., & Lee, B. B. (1994) · Visual Neuroscience · doi:10.1017/s0952523800011159 · Cited by 77 · see citing works
2002 IEEE International Conference on Acoustics, Speech, and Signal Processing
(2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.1005100 · Cited by 76 · see citing works
On the Origin of the Functional Architecture of the Cortex
Ringach, D. L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000251 · Cited by 73 · see citing works
Correlated firing among major ganglion cell types in primate retina
Greschner, M., Shlens, J., Bakolitsa, C., Field, G. D., Gauthier, J. L., Jepson, L. H., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2010) · The Journal of Physiology · doi:10.1113/jphysiol.2010.193888 · Cited by 71 · see citing works
Self-citationReconstruction of natural visual scenes from neural spikes with deep neural networks
Zhang, Y., Jia, S., Zheng, Y., Yu, Z., Tian, Y., Ma, S., Huang, T., & Liu, J. K. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.01.033 · Cited by 59 · see citing works
Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina
Rhoades, C. E., Shah, N. P., Manookin, M. B., Brackbill, N., Kling, A., Goetz, G., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2019) · Neuron · doi:10.1016/j.neuron.2019.05.036 · Cited by 58 · see citing works
Self-citationA thesaurus for a neural population code
Ganmor, E., Segev, R., & Schneidman, E. (2015) · eLife · doi:10.7554/elife.06134 · Cited by 56 · see citing works
Uniform Signal Redundancy of Parasol and Midget Ganglion Cells in Primate Retina
Gauthier, J. L., Field, G. D., Sher, A., Shlens, J., Greschner, M., Litke, A. M., & Chichilnisky, E. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.5294-08.2009 · Cited by 53 · see citing works
Self-citationNeural Networks for Efficient Bayesian Decoding of Natural Images from Retinal NeuronsPreprint
Parthasarathy, N., Batty, E., Falcon, W., Rutten, T., Rajpal, M., Chichilnisky, E. J., & Paninski, L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/153759 · Cited by 52 · see citing works
Self-citationNonlinear decoding of a complex movie from the mammalian retina
Botella‐Soler, V., Deny, S., Martius, G., Marre, O., & Tkačik, G. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006057 · Cited by 51 · see citing works
Broad Thorny Ganglion Cells: A Candidate for Visual Pursuit Error Signaling in the Primate Retina
Puller, C., Manookin, M. B., Jay Neitz, A., Rieke, F. M., & Neitz, M. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4369-14.2015 · Cited by 50 · see citing works
Computing Complex Visual Features with Retinal Spike Times
Gütig, R., Gollisch, T., Sompolinsky, H., & Meister, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053063 · Cited by 47 · see citing works
Functional diversity among sensory neurons from efficient coding principles
Gjorgjieva, J., Meister, M., & Sompolinsky, H. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007476 · Cited by 37 · see citing works
The receptive field of the primate P retinal ganglion cell, II: Nonlinear dynamics
Benardete, E. A., & Kaplan, E. (1997) · Visual Neuroscience · doi:10.1017/s0952523800008865 · Cited by 34 · see citing works
Optimization of Electrical Stimulation for a High-Fidelity Artificial Retina
Shah, N. P., Madugula, S., Grosberg, L., Mena, G., Tandon, P., Hottowy, P., Sher, A., Litke, A., Mitra, S., & Chichilnisky, E. J. (2019) · 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner.2019.8716987 · Cited by 32 · see citing works
Self-citationIgnoring correlated activity causes a failure of retinal population codes
Ruda, K., Zylberberg, J., & Field, G. D. (2020) · Nature Communications · doi:10.1038/s41467-020-18436-2 · Cited by 32 · see citing works
Simulation of visual perception and learning with a retinal prosthesis
Golden, J. R., Erickson-Davis, C. R., Cottaris, N. P., Parthasarathy, N., Rieke, F. M., Brainard, D. H., Wandell, B. A., & Chichilnisky, E. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaf270 · Cited by 29 · see citing works
Self-citationNonlinear Decoding of Natural Images From Large-Scale Primate Retinal Ganglion Recordings
Kim, Y. J., Brackbill, N., Batty, E., Lee, J., Mitelut, C., Tong, W. L., Chichilnisky, E. J., & Paninski, L. (2021) · Neural Computation · doi:10.1162/neco_a_01395 · Cited by 26 · see citing works
Self-citationMosaics and Territories of Cat Retinal Ganglion Cells
Wässle, H., Peichl, L., & Boycott, B. B. (1983) · Progress in brain research · doi:10.1016/s0079-6123(08)60019-9 · Cited by 25 · see citing works
Meytlis, M., Nichols, Z. C., & Nirenberg, S. (2012) · Vision Research · doi:10.1016/j.visres.2012.07.007 · Cited by 18 · see citing works
Nonlinear decoding of natural images from large-scale primate retinal ganglion recordingsPreprint
Kim, Y. J., Brackbill, N., Batty, E., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.09.07.285742 · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning approaches for neural decoding across architectures and recording modalities
Livezey, J. A., & Glaser, J. I. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa355 · Cited by 84 · see citing works
High-Fidelity Reproduction of Visual Signals by Electrical Stimulation in the Central Primate Retina
Gogliettino, A. R., Madugula, S. S., Grosberg, L. E., Vilkhu, R. S., Brown, J., Nguyen, H., Kling, A., Hottowy, P., Dąbrowski, W., Sher, A., et al. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.1091-22.2023 · Cited by 30 · see citing works
Self-citationNonlinear Decoding of Natural Images From Large-Scale Primate Retinal Ganglion Recordings
Kim, Y. J., Brackbill, N., Batty, E., Lee, J., Mitelut, C., Tong, W. L., Chichilnisky, E. J., & Paninski, L. (2021) · Neural Computation · doi:10.1162/neco_a_01395 · Cited by 26 · see citing works
Self-citationNeural Decoding of Visual Information Across Different Neural Recording Modalities and Approaches
Zhang, Y., Yu, Z., Liu, J. K., & Huang, T. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1335-2 · Cited by 24 · see citing works
Retinal Encoding of Natural Scenes
Karamanlis, D., Schreyer, H. M., & Gollisch, T. (2022) · Annual Review of Vision Science · doi:10.1146/annurev-vision-100820-114239 · Cited by 23 · see citing works
Robust Decoding of Rich Dynamical Visual Scenes With Retinal Spikes
Yu, Z., Bu, T., Zhang, Y., Jia, S., Huang, T., & Liu, J. K. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3351120 · Cited by 21 · see citing works
In vivo chromatic and spatial tuning of foveolar retinal ganglion cells in Macaca fascicularis
Godat, T., Cottaris, N. P., Patterson, S. S., Kohout, K., Parkins, K., Yang, Q., Strazzeri, J. M., McGregor, J. E., Brainard, D. H., Merigan, W. H., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0278261 · Cited by 20 · see citing works
Fine, I., & Boynton, G. M. (2024) · Scientific Reports · doi:10.1038/s41598-024-65337-1 · Cited by 19 · see citing works
Encoding Taste: From Receptors to Perception
Roper, S. D. (2021) · Handbook of experimental pharmacology · doi:10.1007/164_2021_559 · Cited by 18 · see citing works
A machine learning framework to optimize optic nerve electrical stimulation for vision restoration
Romeni, S., Zoccolan, D., & Micera, S. (2021) · Patterns · doi:10.1016/j.patter.2021.100286 · Cited by 17 · see citing works
Wu, E. G., Brackbill, N., Rhoades, C. E., Kling, A., Gogliettino, A. R., Shah, N. P., Sher, A., Litke, A. M., Simoncelli, E. P., & Chichilnisky, E. J. (2024) · Nature Communications · doi:10.1038/s41467-024-52304-7 · Cited by 17 · see citing works
Self-citationToward a personalized closed-loop stimulation of the visual cortex: Advances and challenges
Grani, F., Soto-Sánchez, C., Fimia, A., & Fernández, E. (2022) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2022.1034270 · Cited by 16 · see citing works
Italiano, M. L., Guo, T., Lovell, N. H., & Tsai, D. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac72c2 · Cited by 16 · see citing works
Precise control of neural activity using dynamically optimized electrical stimulation
Shah, N. P., Phillips, A., Madugula, S., Lotlikar, A., Gogliettino, A. R., Hays, M. R., Grosberg, L., Brown, J., Dusi, A., Tandon, P., et al. (2024) · eLife · doi:10.7554/elife.83424 · Cited by 15 · see citing works
Self-citationDecoding Pixel-Level Image Features From Two-Photon Calcium Signals of Macaque Visual Cortex
Zhang, Y., Bu, T., Zhang, J., Tang, S., Yu, Z., Liu, J. K., & Huang, T. (2022) · Neural Computation · doi:10.1162/neco_a_01498 · Cited by 14 · see citing works
Decoding dynamic visual scenes across the brain hierarchy
Chen, Y., Beech, P., Yin, Z., Jia, S., Zhang, J., Yu, Z., & Liu, J. K. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012297 · Cited by 12 · see citing works
Mohammadi, M., Carriot, J., Mackrous, I., Cullen, K. E., & Chacron, M. J. (2024) · PLoS Biology · doi:10.1371/journal.pbio.3002623 · Cited by 12 · see citing works
Automatic Identification of Axon Bundle Activation for Epiretinal Prosthesis
Tandon, P., Bhaskhar, N., Shah, N. P., Madugula, S. S., Grosberg, L. E., Fan, V. H., Hottowy, P., Sher, A., Litke, A. M., Chichilnisky, E. J., et al. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3128486 · Cited by 11 · see citing works
Self-citationWu, E. G., Brackbill, N., Rhoades, C. E., Kling, A., Gogliettino, A. R., Shah, N. P., Sher, A., Litke, A. M., Simoncelli, E. P., & Chichilnisky, E. J. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.12.552902 · Cited by 11 · see citing works
Self-citationSchottdorf, M., & Lee, B. B. (2021) · The Journal of Physiology · doi:10.1113/jp281200 · Cited by 10 · see citing works
Madugula, S. S., Vilkhu, R. S., Shah, N. P., Grosberg, L. E., Kling, A., Gogliettino, A. R., Nguyen, H., Hottowy, P., Sher, A., Litke, A. M., et al. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.1023-22.2023 · Cited by 10 · see citing works
Self-citationInferring light responses of primate retinal ganglion cells using intrinsic electrical signatures
Zaidi, M. H., Aggarwal, G., Shah, N. P., Karniol-Tambour, O., Goetz, G. A., Madugula, S. S., Gogliettino, A. R., Wu, E. G., Kling, A., Brackbill, N., et al. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/ace657 · Cited by 8 · see citing works
Self-citationFusion of ANNs as decoder of retinal spike trains for scene reconstruction
Li, W., Raj, A. N. J., Tjahjadi, T., & Zhuang, Z. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03402-w · Cited by 8 · see citing works
Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRIPreprint
Livezey, J. A., & Glaser, J. I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09687 · Cited by 7 · see citing works
A thin-film optogenetic visual prosthesisPreprint
Knudsen, E. B., Zappitelli, K. M., Brown, J., Reeder, J. T., Smith, K. S., Rostov, M., Choi, J., Rochford, A. E., Slager, N., Miura, S. K., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.31.526482 · Cited by 7 · see citing works
Functional diversity in the output of the primate retinaPreprint
Kling, A., Cooler, S., Manookin, M. B., Rhoades, C. E., Brackbill, N., Field, G. D., Rieke, F. M., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.31.621339 · Cited by 7 · see citing works
Self-citationHernández-Toloza, J. E., Xu, Y., Mendum, T. A., Siedler, B. S., Casey, R., Wu, H., Williams, K. J., Hingley‐Wilson, S., & McFadden, J. (2025) · Scientific Reports · doi:10.1038/s41598-025-04038-9 · Cited by 5 · see citing works
High-contrast "gaudy" images improve the training of deep neural network models of visual cortexPreprint
Cowley, B. R., & Pillow, J. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11412 · Cited by 5 · see citing works
Wu, E. G., Brackbill, N., Sher, A., Litke, A. M., Simoncelli, E. P., & Chichilnisky, E. J. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.19.492737 · Cited by 4 · see citing works
Self-citationGogliettino, A. R., Cooler, S., Vilkhu, R. S., Brackbill, N., Rhoades, C. E., Wu, E. G., Kling, A., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.22.586353 · Cited by 4 · see citing works
Self-citationLearning Low-Dimensional Generalizable Natural Features from Retina Using a U-Net
Wang, S., Hoshal, B. D., de Laittre, E. A., Marre, O., Berry, M., & Palmer, S. (2022) · neural information processing systems · doi:10.52202/068431-0825 · Cited by 3 · see citing works
Rapid Selectivity to Natural Images Across Layers of Primate V1Preprint
Chen, X., Zhu, S., Bai, K., Xia, R., Kong, N. C. L., Norcia, A. M., & Moore, T. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.01.23.477422 · Cited by 3 · see citing works
Chen, Q., Ingram, N. T., Baudin, J., Angueyra, J. M., Sinha, R., & Rieke, F. M. (2024) · eLife · doi:10.7554/elife.93795 · Cited by 3 · see citing works
High-fidelity reproduction of visual signals by electrical stimulation in the central primate retina
Gogliettino, A. R., Madugula, S. S., Grosberg, L. E., Vilkhu, R. S., Brown, J., Nguyen, H., Kling, A., Hottowy, P., Dąbrowski, W., Sher, A., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.24.493162 · Cited by 30 · see citing works
Self-citationPartitioned Temporal Dithering for Efficient Epiretinal Electrical Stimulation
Lotlikar, A., Shah, N. P., Gogliettino, A. R., Vilkhu, R. S., Madugula, S. S., Grosberg, L. E., Hottowy, P., Sher, A., Litke, A. M., Chichilnisky, E. J., et al. (2023) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner52421.2023.10123787 · Cited by 2 · see citing works
Self-citationNokura, T., Okada, R., Yamamasu, S., Yasukawa, S., & Hayashida, Y. (2023) · IEEE International Symposium on Computational Intelligence and Informatics (CINTI) · doi:10.1109/cinti59972.2023.10381907 · Cited by 2 · see citing works
Chen, Q., Ingram, N. T., Baudin, J., Angueyra, J. M., Sinha, R., & Rieke, F. M. (2024) · eLife · doi:10.7554/elife.93795.3 · Cited by 2 · see citing works
Light-adaptation clamp: a tool to predictably manipulate photoreceptor light responsesPreprint
Chen, Q., Ingram, N. T., Baudin, J., Angueyra, J. M., Sinha, R., & Rieke, F. M. (2024) · eLife · doi:10.7554/elife.93795.1 · Cited by 2 · see citing works
Movie reconstruction from mouse visual cortex activityPreprint
Bauer, J., Margrie, T. W., & Claudia Clopath, A. (2025) · eLife · doi:10.7554/elife.105081.1 · Cited by 2 · see citing works
Movie reconstruction from mouse visual cortex activity
Bauer, J., Margrie, T. W., & Claudia Clopath, A. (2026) · eLife · doi:10.1101/2024.06.19.599691 · Cited by 1 · see citing works
So, H. M., & Wetzstein, G. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00485 · Cited by 1 · see citing works
Automatic Identification and Avoidance of Axon Bundle Activation for Epiretinal ProsthesisPreprint
Tandon, P., Bhaskhar, N., Shah, N. P., Madugula, S. S., Grosberg, L. E., Fan, V. H., Hottowy, P., Sher, A., Litke, A. M., Chichilnisky, E. J., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.03.429317 · Cited by 1 · see citing works
Self-citationMovie reconstruction from mouse visual cortex activityPreprint
Bauer, J., Margrie, T. W., & Claudia Clopath, A. (2025) · eLife · doi:10.7554/elife.105081.2 · Cited by 1 · see citing works
How nonlinear processing shapes natural stimulus encoding in the retina
Karamanlis, D. (2022) · doi:10.53846/goediss-9262
Chen, Q., Ingram, N. T., Baudin, J., Angueyra, J. M., Sinha, R., & Rieke, F. M. (2024) · eLife · doi:10.7554/elife.93795.2.sa0
Chen, Q., Ingram, N. T., Baudin, J., Angueyra, J. M., Sinha, R., & Rieke, F. M. (2024) · eLife · doi:10.7554/elife.93795.2
Xu, Y., Wu, Z., & Wang, H. (2024) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2024.110292
Movie reconstruction from mouse visual cortex activityPreprint
Bauer, J., Margrie, T. W., & Claudia Clopath, A. (2025) · eLife · doi:10.7554/elife.105081
Cell-type specific repertoire of responses to natural scenes in primate retinal ganglion cells
Kling, A., Brackbill, N., Rhoades, C. E., Gogliettino, A. R., Sher, A., Litke, A. M., & Chichilnisky, E. J. (2025) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2025.1600167
Self-citationHigh - quality decoding of RGB images from the neuronal signals of the pigeon optic tectum
Dong, Z., Xiang, Y., & Wang, S. (2025) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2025.110595
A bio-inspired module for improving semantic segmentation model’s robustness
Wang, Y., Li, B., Todo, Y., & Tang, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132276
A standard model for the vertebrate retina
Meister, M. (2026) · Vision Research · doi:10.1016/j.visres.2026.108895 · Cited by 8 · see citing works
Partial input loss differentially modifies neural pathwaysPreprint
Lee, J. Y., Yang, J., Harris, S. C., John, J. V., Stone, N. S., Santina, L. D., Kastner, D. B., & Dunn, F. A. (2026) · eLife · doi:10.7554/elife.112552
Partial input loss differentially modifies neural pathwaysPreprint
Lee, J. Y., Yang, J., Harris, S. C., John, J. V., Stone, N. S., Santina, L. D., Kastner, D. B., & Dunn, F. A. (2026) · eLife · doi:10.7554/elife.112552.1
- Authors
- Brackbill, N., Rhoades, C., Kling, A., Shah, N. P., Sher, A., Litke, A. M., & Chichilnisky, E.
- Affiliations
- Stanford University (US)
- Stanford Medicine (US)
- University of California, Santa Cruz (US)
- Corresponding author
- Brackbill, Nora
- ORCID
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2020-11-04
- Volume
- 9
- ISSN
- 2050-084X (ISSN-L)
- PMC
- PMC7752138
- OpenAlex
- W3095078854
- Cited by
- 57
- References
- 85
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 18 · 2023: 7 · 2022: 11 · 2021: 6 · 2020: 3
- FWCI
- 3.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- eLife (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (NSF IGERT 0801700, GRFP DGE-114747, CRCNS Grant IIS-1430348)
- National Eye Institute (F31EY027166, R01-EY029247)
- Pew Charitable Trusts (Fellowship in Biomedical Sciences)
- John Chen (Donation)
- National Institutes of Health (R01EY017992, R01-EY029247, CRCNS Grant IIS-1430348)
- Wu Tsai Neurosciences Institute
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Retinal Development and Disorders
- Keywords
- retinal ganglion cells, natural image reconstruction, receptive fields, macaque retina, ON and OFF cells, parasol cells, midget cells, linear reconstruction, natural image statistics, correlated neuronal activity
- MeSH terms
- Animals, Macaca fascicularis, Macaca mulatta, Microelectrodes, Photic Stimulation, Retina, Retinal Ganglion Cells, Vision, Ocular
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
