Natural Image Statistics and Neural Representation
Abstract
▪ Abstract It has long been assumed that sensory neurons are adapted, through both evolutionary and developmental processes, to the statistical properties of the signals to which they are exposed. Attneave (1954) , Barlow (1961) proposed that information theory could provide a link between environmental statistics and neural responses through the concept of coding efficiency. Recent developments in statistical modeling, along with powerful computational tools, have enabled researchers to study more sophisticated statistical models for visual images, to validate these models empirically against large sets of data, and to begin experimentally testing the efficient coding hypothesis for both individual neurons and populations of neurons.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Computational neuroscience has developed mathematical models of elementary computational components including sensory coding, normalization, working memory, evidence accumulation and decision mechanisms, and motor control.
“These include components for sensory coding29,30, normalization31, working memory32, evidence accumulation and decision mechanisms33–35, and motor control36.”
From Cognitive computational neuroscience (2018) · cites this paper as [30]
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486 · see citing works
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,150 · see citing works
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · see citing works
Self-citationSparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642 · see citing works
Self-citationA Fast Fixed-Point Algorithm for Independent Component Analysis
Hyvärinen, A., & Erkki Oja, A. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1483 · Cited by 3,373 · see citing works
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241 · see citing works
Some informational aspects of visual perception.
Attneave, F. (1954) · Psychological Review · doi:10.1037/h0054663 · Cited by 2,938 · see citing works
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Hérault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,550 · see citing works
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835 · see citing works
A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients
Portilla, J., & Simoncelli, E. P. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026553619983 · Cited by 1,806 · see citing works
Self-citationThe “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 1,592 · see citing works
Optimal unsupervised learning in a single-layer linear feedforward neural network
Sanger, T. D. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90044-0 · Cited by 1,506 · see citing works
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425 · see citing works
Sparse Coding and Decorrelation in Primary Visual Cortex During Natural Vision
Vinje, W. E., & Gallant, J. L. (2000) · Science · doi:10.1126/science.287.5456.1273 · Cited by 1,288 · see citing works
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207 · see citing works
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183 · see citing works
Pyramid-based texture analysis/synthesis
Heeger, D. J., & Bergen, J. R. (1995) · ACM SIGGRAPH Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) · doi:10.1145/218380.218446 · Cited by 1,116 · see citing works
Independent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106 · see citing works
Predictive coding: a fresh view of inhibition in the retina
Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1982.0085 · Cited by 1,042 · see citing works
A Simple Coding Procedure Enhances a Neuron's Information Capacity
Laughlin, S. B. (1981) · Zeitschrift für Naturforschung C · doi:10.1515/znc-1981-9-1040 · Cited by 1,015 · see citing works
Bialek, W., Rieke, F. M., van Steveninck, R. R. D. R., & Warland, D. K. (1991) · Science · doi:10.1126/science.2063199 · Cited by 1,001 · see citing works
Statistics of natural images: Scaling in the woods
Ruderman, D., & Bialek, W. (1994) · Physical Review Letters · doi:10.1103/physrevlett.73.814 · Cited by 954 · see citing works
Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex
Carandini, M., Heeger, D. J., & Movshon, J. A. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08621.1997 · Cited by 926 · see citing works
Julesz, B. (1962) · IEEE Transactions on Information Theory · doi:10.1109/tit.1962.1057698 · Cited by 900 · see citing works
Evaluation of linear models of surface spectral reflectance with small numbers of parameters
Maloney, L. T. (1986) · Journal of the Optical Society of America A · doi:10.1364/josaa.3.001673 · Cited by 752 · see citing works
Statistics of cone responses to natural images: implications for visual coding
Ruderman, D., Cronin, T. W., & Chiao, C. (1998) · Journal of the Optical Society of America A · doi:10.1364/josaa.15.002036 · Cited by 715 · see citing works
What Does the Retina Know about Natural Scenes?
Atick, J. J., & Redlich, A. (1992) · Neural Computation · doi:10.1162/neco.1992.4.2.196 · Cited by 706 · see citing works
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (2011) · Network: Computation in Neural Systems · doi:10.3109/0954898x.2011.638888 · Cited by 679 · see citing works
Edge co-occurrence in natural images predicts contour grouping performance
Geisler, W. S., Perry, J. S., Super, B. J., & Gallogly, D. P. (2001) · Vision Research · doi:10.1016/s0042-6989(00)00277-7 · Cited by 678 · see citing works
Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling
Zhu, S. C., Wu, Y., & Mumford, D. B. (1998) · International Journal of Computer Vision · doi:10.1023/a:1007925832420 · Cited by 659 · see citing works
Where do we Stand on Maximum Entropy
Jaynes, E. T. (1979) · Medical Entomology and Zoology · Cited by 652 · see citing works
Adaptive Rescaling Maximizes Information Transmission
Brenner, N., Bialek, W., & van Steveninck, R. R. D. R. (2000) · Neuron · doi:10.1016/s0896-6273(00)81205-2 · Cited by 650 · see citing works
Source separation using higher order moments
Cardoso, J.-F. (2003) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1989.266878 · Cited by 565 · see citing works
Adaptation of retinal processing to image contrast and spatial scale
Smirnakis, S. M., Berry, M. J., Warland, D. K., Bialek, W., & Meister, M. (1997) · Nature · doi:10.1038/386069a0 · Cited by 548 · see citing works
Forming sparse representations by local anti-Hebbian learning
Földiák, P. (1990) · Biological Cybernetics · doi:10.1007/bf02331346 · Cited by 546 · see citing works
Hyvärinen, A., & Hoyer, P. O. (2000) · Neural Computation · doi:10.1162/089976600300015312 · Cited by 533 · see citing works
Image compression via joint statistical characterization in the wavelet domain
Buccigrossi, R. W., & Simoncelli, E. P. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.806616 · Cited by 526 · see citing works
Self-citationTrichromacy, opponent colours coding and optimum colour information transmission in the retina
Buchsbaum, G., & Gottschalk, A. (1983) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1983.0090 · Cited by 513 · see citing works
Attias, H. T. (1999) · Neural Computation · doi:10.1162/089976699300016458 · Cited by 501 · see citing works
Adaptation-Induced Plasticity of Orientation Tuning in Adult Visual Cortex
Dragoi, V., Sharma, J., & Sur, M. (2000) · Neuron · doi:10.1016/s0896-6273(00)00103-3 · Cited by 495 · see citing works
Bonds, A. B. (1989) · Visual Neuroscience · doi:10.1017/s0952523800004314 · Cited by 477 · see citing works
Dan, Y., Atick, J. J., & Reid, R. C. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-10-03351.1996 · Cited by 476 · see citing works
Rapid Adaptation in Visual Cortex to the Structure of Images
Müller, J. R., Metha, A. B., Krauskopf, J., & Lennie, P. (1999) · Science · doi:10.1126/science.285.5432.1405 · Cited by 458 · see citing works
Statistics of natural time-varying images
Dong, D. W., & Atick, J. J. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x_6_3_003 · Cited by 457 · see citing works
Responses of neurons in primary and inferior temporal visual cortices to natural scenes
Baddeley, R. J., Abbott, L. F., Booth, M. C. A., Sengpiel, F., Freeman, T., Wakeman, E. A., & Rolls, E. T. (1997) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1997.0246 · Cited by 431 · see citing works
Natural scene statistics at the centre of gaze
Reinagel, P., & Zador, A. M. (1999) · Network Computation in Neural Systems · doi:10.1088/0954-898x_10_4_304 · Cited by 426 · see citing works
Origins of scaling in natural images
Ruderman, D. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00008-4 · Cited by 358 · see citing works
Rieke, F., Bodnar, D. A., & Bialek, W. (1995) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1995.0204 · Cited by 321 · see citing works
Probabilistic framework for the adaptation and comparison of image codes
Lewicki, M. S., & Olshausen, B. A. (1999) · Journal of the Optical Society of America A · doi:10.1364/josaa.16.001587 · Cited by 307 · see citing works
Self-citationOn a common circle: Natural scenes and Gestalt rules
Sigman, M., Cecchi, G., Gilbert, C. D., & Magnasco, M. O. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.4.1935 · Cited by 301 · see citing works
Lennie, P., & D’Zmura, M. (1988) · PubMed · Cited by 291 · see citing works
Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex
Rao, R. P. N., & Ballard, D. H. (1997) · Neural Computation · doi:10.1162/neco.1997.9.4.721 · Cited by 290 · see citing works
Statistical models for images: compression, restoration and synthesis
Simoncelli, E. P. (2002) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.1997.680530 · Cited by 272 · see citing works
Self-citationA theory of maximizing sensory information
van Hateren, J. H. (1992) · Biological Cybernetics · doi:10.1007/bf00203134 · Cited by 267 · see citing works
Adaptation and decorrelation in the cortex
Barlow, H. B., & Földiák, P. (1989) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 263 · see citing works
Figure-ground discrimination by relative movement in the visual system of the fly
Reichardt, W., & Poggio, T. (1979) · Biological Cybernetics · doi:10.1007/bf00337434 · Cited by 258 · see citing works
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x_3_1_008 · Cited by 239 · see citing works
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/2/009 · Cited by 234 · see citing works
The `Ideal Homunculus': decoding neural population signals
Oram, M. W., Földiák, P., Perrett, D. I., Oram, M. W., & Sengpiel, F. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01216-2 · Cited by 221 · see citing works
Visual adaptation as optimal information transmission
Wainwright, M. J. (1999) · Vision Research · doi:10.1016/s0042-6989(99)00101-7 · Cited by 216 · see citing works
Cortical neurons: Isolation of contrast gain control
Geisler, W. S., & Albrecht, D. G. (1992) · Vision Research · doi:10.1016/0042-6989(92)90196-p · Cited by 211 · see citing works
Human discrimination of fractal images
Knill, D. C., Field, D., & Kerstent, D. (1990) · Journal of the Optical Society of America A · doi:10.1364/josaa.7.001113 · Cited by 193 · see citing works
Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus
Dong, D. W., & Atick, J. J. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x_6_2_003 · Cited by 183 · see citing works
Spatiotemporal contrast sensitivity of early vision
van Hateren, J. H. (1993) · Vision Research · doi:10.1016/0042-6989(93)90163-q · Cited by 160 · see citing works
Entropy reduction and decorrelation in visual coding by oriented neural receptive fields
Daugman, J. G. (1989) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.16456 · Cited by 152 · see citing works
The human visual system is optimised for processing the spatial information in natural visual images
Párraga, C. A., Troscianko, T., & Tolhurst, D. J. (2000) · Current Biology · doi:10.1016/s0960-9822(99)00262-6 · Cited by 151 · see citing works
Predictability and redundancy of natural images
Kersten, D. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002395 · Cited by 150 · see citing works
Human colour perception and its adaptation
Webster, M. A. (1996) · Network Computation in Neural Systems · doi:10.1088/0954-898x_7_4_002 · Cited by 145 · see citing works
Wainwright, M. J., Schwartz, O., & Simoncelli, E. P. (2002) · Cited by 139 · see citing works
Self-citationWhat is the Goal of Sensory Coding?
Field, D. J. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.003.0008 · Cited by 134 · see citing works
Pattern adaptation and cross-orientation interactions in the primary visual cortex
Carandini, M., Movshon, J. A., & Ferster, D. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00069-0 · Cited by 130 · see citing works
Temporal Low-Order Statistics of Natural Sounds
Attias, H. T., & Schreiner, C. E. (1996) · Cited by 103 · see citing works
What does post-adaptation color appearance reveal about cortical color representation?
Atick, J. J., Zhaoping, L., & Redlich, A. (1993) · Vision Research · doi:10.1016/0042-6989(93)90065-5 · Cited by 94 · see citing works
Olshausen, B. A. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/5583.003.0018 · Cited by 89 · see citing works
Self-citationCoding Time-Varying Signals Using Sparse, Shift-Invariant Representations
Lewicki, M. S., & B, T. J. S. A. (1998) · Cited by 84 · see citing works
Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus
Dong, D. W., & Atick, J. J. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/2/003 · Cited by 72 · see citing works
On a common circle: Natural scenes and Gestalt rules
Sigman, M. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.031571498 · Cited by 71 · see citing works
Natural Image Statistics and Divisive Normalization
Wainwright, M. J., Schwartz, O., & Simoncelli, E. P. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/5583.003.0015 · Cited by 71 · see citing works
Self-citationChromaticity coordinates of frequency-limited functions
Buchsbaum, G., & Gottschalk, A. (1984) · Journal of the Optical Society of America A · doi:10.1364/josaa.1.000885 · Cited by 54 · see citing works
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/1/008 · Cited by 52 · see citing works
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.003.0017 · Cited by 49 · see citing works
The role of early retinal lateral inhibition: More than maximizing luminance information
Balboa, R. M., & Grzywacz, N. M. (2000) · Visual Neuroscience · doi:10.1017/s0952523800171081 · Cited by 45 · see citing works
BCM network develops orientation selectivity and ocular dominance in natural scene environment
Shouval, H. Z., Intratorj, N., & Cooper, L. N. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00087-4 · Cited by 39 · see citing works
Statistical dependence between orientation filter outputs used in a human-vision-based image code
Wegmann, B., & Zetzsche, C. (1990) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.24279 · Cited by 38 · see citing works
Coding of Naturalistic Stimuli by Auditory Midbrain Neurons
Attias, H. T., & Schreiner, C. E. (1997) · Cited by 38 · see citing works
Human colour perception and its adaptation
Webster, M. (1996) · Network Computation in Neural Systems · doi:10.1088/0954-898x/7/4/002 · Cited by 37 · see citing works
Emergence of Topography and Complex Cell Properties from Natural Images using Extensions of ICA
Hyvärinen, A., & Hoyer, P. O. (1999) · Cited by 34 · see citing works
Natural Sound Statistics and Divisive Normalization in the Auditory System
Schwartz, O., & Simoncelli, E. P. (2000) · Cited by 31 · see citing works
Self-citationDong, D. W., & Dong, D. W. (1994) · Cited by 16 · see citing works
Adaptive filter model for striate cortical processing of spatial information
Dagnelie, G. (1986) · Annual Meeting Optical Society of America · doi:10.1364/oam.1986.thn8 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · see citing works
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · see citing works
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104 · see citing works
Geometric Deep Learning: Going beyond Euclidean data
Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., & Vandergheynst, P. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2693418 · Cited by 3,661 · see citing works
Wu, Y., & He, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_1 · Cited by 3,601 · see citing works
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383267 · Cited by 3,453 · see citing works
Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175 · see citing works
Conditional Image Synthesis With Auxiliary Classifier GANsPreprint
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 2,968 · see citing works
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906 · see citing works
A Naturalistic Open Source Movie for Optical Flow Evaluation
Butler, D. J., Wulff, J., Stanley, G. B., & Black, M. J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33783-3_44 · Cited by 1,842 · see citing works
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · see citing works
Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality
Moorthy, A. K., & Bovik, A. C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2147325 · Cited by 1,763 · see citing works
Neural correlations, population coding and computation
Averbeck, B. B., Latham, P. E., & Pouget, A. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1888 · Cited by 1,743 · see citing works
End-to-end Optimized Image CompressionPreprint
Ballé, J., Laparra, V., & Simoncelli, E. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01704 · Cited by 1,477 · see citing works
Self-citationThe Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · see citing works
Sparse coding of sensory inputs
Olshausen, B. A., & Field, D. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.07.007 · Cited by 1,404 · see citing works
Self-citationAn information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399 · see citing works
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · see citing works
Information content weighting for perceptual image quality assessment
Wang, Z., & Li, Q. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2092435 · Cited by 1,304 · see citing works
Identifying natural images from human brain activity
Kay, K., Naselaris, T., Prenger, R., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,272 · see citing works
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269 · see citing works
Evaluating the Visualization of What a Deep Neural Network Has Learned
Samek, W., Binder, A., Montavon, G., Lapuschkin, S., & Muller, K.-R. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2599820 · Cited by 1,164 · see citing works
Burge, T. (2010) · doi:10.1093/acprof:oso/9780199581405.001.0001 · Cited by 1,137 · see citing works
Topics in semantic representation
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.211 · Cited by 1,122 · see citing works
Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding
Sigurdsson, G. A., Varol, G., Wang, X., Farhadi, A., Laptev, I., & Gupta, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_31 · Cited by 1,098 · see citing works
Kriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093 · see citing works
Language as shaped by the brain.
Christiansen, M. H., & Chater, N. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x08004998 · Cited by 821 · see citing works
A Learned Representation For Artistic StylePreprint
Dumoulin, V., Shlens, J., & Kudlur, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07629 · Cited by 1,033 · see citing works
Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency
Sendur, L., & Selesnick, I. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.804091 · Cited by 1,008 · see citing works
Stand-Alone Self-Attention in Vision Models
Ramachandran, P., Parmar, N., Vaswani, A., Bello, I., Levskaya, A., & Shlens, J. (2019) · arXiv · doi:10.48550/arxiv.1906.05909 · Cited by 977 · see citing works
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967 · see citing works
Pros and cons of GAN evaluation measures
Borji, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.009 · Cited by 963 · see citing works
Communication in neuronal networks
Laughlin, S. B., & Sejnowski, T. J. (2003) · Science · doi:10.1126/science.1089662 · Cited by 950 · see citing works
Self-Attention Graph PoolingPreprint
Lee, J., Lee, I., & Kang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08082 · Cited by 869 · see citing works
Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging
Choi, L. K., You, J., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2456502 · Cited by 867 · see citing works
Statistics of natural image categories
Torralba, A. B., & Oliva, A. (2003) · Network Computation in Neural Systems · doi:10.1088/0954-898x_14_3_302 · Cited by 845 · see citing works
Natural signal statistics and sensory gain control
Schwartz, O., & Simoncelli, E. P. (2001) · Nature Neuroscience · doi:10.1038/90526 · Cited by 835 · see citing works
Self-citationMapping Human Whole-Brain Structural Networks with Diffusion MRI
Hagmann, P., Kurant, M., Gigandet, X., Thiran, P., Wedeen, V. J., Meuli, R., & Thiran, J.-P. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000597 · Cited by 788 · see citing works
ConViT: improving vision transformers with soft convolutional inductive biases
d’Ascoli, S., Touvron, H., Leavitt, M. L., Morcos, A. S., Biroli, G., & Sagun, L. (2022) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ac9830 · Cited by 782 · see citing works
Visual Perception and the Statistical Properties of Natural Scenes
Geisler, W. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085632 · Cited by 732 · see citing works
Components of bottom-up gaze allocation in natural images
Peters, R. J., Iyer, A., Itti, L., & Christof Koch, A. (2005) · Vision Research · doi:10.1016/j.visres.2005.03.019 · Cited by 730 · see citing works
Fractional differentiation by neocortical pyramidal neurons
Lundstrom, B. N., Higgs, M. H., Spain, W. J., & Fairhall, A. L. (2008) · Nature Neuroscience · doi:10.1038/nn.2212 · Cited by 677 · see citing works
Friston, K. J., & Stephan, K. E. (2007) · Synthese · doi:10.1007/s11229-007-9237-y · Cited by 673 · see citing works
Statistical learning of new visual feature combinations by infants
Fiser, J., & Aslin, R. N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.232472899 · Cited by 637 · see citing works
Optimal Predictions in Everyday Cognition
Griffiths, T. L., & Tenenbaum, J. B. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01780.x · Cited by 637 · see citing works
Objective Quality Assessment of Tone-Mapped Images
Yeganeh, H., & Wang, Z. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2221725 · Cited by 630 · see citing works
Smith, E. C., & Lewicki, M. S. (2006) · Nature · doi:10.1038/nature04485 · Cited by 625 · see citing works
The Natural Statistics of Audiovisual Speech
Chandrasekaran, C., Wieckowski, A. T., Stillittano, S., Caplier, A., & Ghazanfar, A. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000436 · Cited by 614 · see citing works
End-to-End Blind Image Quality Assessment Using Deep Neural Networks
Ma, K., Liu, W., Zhang, K., Duanmu, Z., Wang, Z., & Zuo, W. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2774045 · Cited by 613 · see citing works
Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study
Borji, A., Sihite, D. N., & Itti, L. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2210727 · Cited by 602 · see citing works
Reliability of cortical activity during natural stimulation
Hasson, U., Malach, R., & Heeger, D. J. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.10.011 · Cited by 597 · see citing works
High-dimensional geometry of population responses in visual cortex
Stringer, C., Pachitariu, M., Steinmetz, N. A., Carandini, M., & Harris, K. D. (2019) · Nature · doi:10.1038/s41586-019-1346-5 · Cited by 591 · see citing works
Image statistics and the perception of surface qualities
Motoyoshi, I., Nishida, S., Sharan, L., & Adelson, E. H. (2007) · Nature · doi:10.1038/nature05724 · Cited by 590 · see citing works
Do We Know What the Early Visual System Does?
Carandini, M., Demb, J. B., Mante, V., Tolhurst, D. J., Dan, Y., Olshausen, B. A., Gallant, J. L., & Rust, N. C. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3726-05.2005 · Cited by 586 · see citing works
Self-citationConvolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Lindsay, G. W. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01544 · Cited by 571 · see citing works
The case for and against muscle synergies
Tresch, M. C., & Jarc, A. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.09.002 · Cited by 568 · see citing works
Representation of statistical properties
Chong, S. C., & Treisman, A. (2003) · Vision Research · doi:10.1016/s0042-6989(02)00596-5 · Cited by 560 · see citing works
Spike avalanches in vivo suggest a driven, slightly subcritical brain state
Priesemann, V. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00108 · Cited by 559 · see citing works
Why is Real-World Visual Object Recognition Hard?
Pinto, N., Cox, D., & DiCarlo, J. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040027 · Cited by 537 · see citing works
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535 · see citing works
Jones, M., & Love, B. C. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10003134 · Cited by 533 · see citing works
Modulation spectra of natural sounds and ethological theories of auditory processing
Singh, N. C., & Theunissen, F. E. (2003) · The Journal of the Acoustical Society of America · doi:10.1121/1.1624067 · Cited by 519 · see citing works
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L. S., & Fritz, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 491 · see citing works
On Advances in Statistical Modeling of Natural Images
Srivastava, A., Lee, A. B., Simoncelli, E. P., & Zhu, S. (2003) · Journal of Mathematical Imaging and Vision · doi:10.1023/a:1021889010444 · Cited by 483 · see citing works
Self-citationWark, B., Lundstrom, B. N., & Fairhall, A. L. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.07.001 · Cited by 482 · see citing works
Brain-inspired replay for continual learning with artificial neural networks
van de Ven, G. M., Siegelmann, H. T., & Tolias, A. S. (2020) · Nature Communications · doi:10.1038/s41467-020-17866-2 · Cited by 474 · see citing works
The impact of microsaccades on vision: towards a unified theory of saccadic function
Martínez‐Conde, S., Otero‐Millan, J., & Macknik, S. L. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3405 · Cited by 466 · see citing works
The Oxford Handbook of Perceptual Organization
Lier, R. J. V., Gerbino, W., & Wagemans, J. (2015) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199686858.001.0001 · Cited by 466 · see citing works
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency
Golestaneh, S. A., Dadsetan, S., & Kitani, K. M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00404 · Cited by 465 · see citing works
An integrative model of tinnitus based on a central gain controlling neural sensitivity
Noreña, A. J. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.11.003 · Cited by 445 · see citing works
A Real-World Size Organization of Object Responses in Occipitotemporal Cortex
Konkle, T., & Oliva, A. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.036 · Cited by 444 · see citing works
Coordinating perceptually grounded categories through language: A case study for colour
steels, L., & belpaeme, T. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000087 · Cited by 440 · see citing works
Central gain control in tinnitus and hyperacusis
Auerbach, B. D., Rodrigues, P. V., & Salvi, R. J. (2014) · Frontiers in Neurology · doi:10.3389/fneur.2014.00206 · Cited by 439 · see citing works
Reduced-reference image quality assessment using a wavelet-domain natural image statistic model
Wang, Z., & Simoncelli, E. P. (2005) · SPIE Proceedings · doi:10.1117/12.597306 · Cited by 438 · see citing works
Self-citationChatterjee, P., & Milanfar, P. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2037087 · Cited by 414 · see citing works
How Close Are We to Understanding V1?
Olshausen, B. A., & Field, D. J. (2005) · Neural Computation · doi:10.1162/0899766054026639 · Cited by 411 · see citing works
Self-citationFrom Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality
Ying, Z., Niu, H., Gupta, P., Mahajan, D., Ghadiyaram, D., & Bovik, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00363 · Cited by 406 · see citing works
A review of the evolution of animal colour vision and visual communication signals
Osorio, D., & Vorobyev, M. (2008) · Vision Research · doi:10.1016/j.visres.2008.06.018 · Cited by 401 · see citing works
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397 · see citing works
Spatial Structure and Symmetry of Simple-Cell Receptive Fields in Macaque Primary Visual Cortex
Ringach, D. L. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.1.455 · Cited by 396 · see citing works
A Bayesian observer model constrained by efficient coding can explain 'anti-Bayesian' percepts
Wei, X.-X., & Stocker, A. A. (2015) · Nature Neuroscience · doi:10.1038/nn.4105 · Cited by 387 · see citing works
Bullot, N. J., & Reber, R. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000489 · Cited by 387 · see citing works
Exploiting local and global patch rarities for saliency detection
Borji, A., & Itti, L. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247711 · Cited by 385 · see citing works
Visual adaptation: Neural, psychological and computational aspects
Clifford, C. W. G., Webster, M. A., Stanley, G. B., Stocker, A. A., Kohn, A., Sharpee, T. O., & Schwartz, O. (2007) · Vision Research · doi:10.1016/j.visres.2007.08.023 · Cited by 374 · see citing works
Blind Image Quality Assessment via Deep Learning
Hou, W., Gao, X., Tao, D., & Li, X. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2336852 · Cited by 370 · see citing works
From Behavior to Neural Dynamics: An Integrated Theory of Attention
Buschman, T. J., & Kästner, S. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.017 · Cited by 362 · see citing works
Space and time in visual context
Schwartz, O., Hsu, A., & Dayan, P. (2007) · Nature reviews. Neuroscience · doi:10.1038/nrn2155 · Cited by 360 · see citing works
Implicit Perceptual Anticipation Triggered by Statistical Learning
Turk‐Browne, N. B., Scholl, B. J., Johnson, M. K., & Chun, M. M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0858-10.2010 · Cited by 360 · see citing works
Correlations and Neuronal Population Information
Kohn, A., Coen-Cagli, R., Kanitscheider, I., & Pouget, A. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013851 · Cited by 360 · see citing works
Two-Level Approach for No-Reference Consumer Video Quality Assessment
Korhonen, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2923051 · Cited by 354 · see citing works
Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
Zhang, W., Ma, K., Zhai, G., & Yang, X. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3061932 · Cited by 353 · see citing works
Keep it real: rethinking the primacy of experimental control in cognitive neuroscience
Nastase, S. A., Goldstein, A., & Hasson, U. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117254 · Cited by 349 · see citing works
Natural Stimulus Statistics Alter the Receptive Field Structure of V1 Neurons
David, S. V., Vinje, W. E., & Gallant, J. L. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1422-04.2004 · Cited by 345 · see citing works
No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics
Fang, Y., Ma, K., Wang, Z., Lin, W., Fang, Z., & Zhai, G. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2372333 · Cited by 343 · see citing works
From QoS to QoE: A Tutorial on Video Quality Assessment
Chen, Y., Wu, K., & Zhang, Q. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2363139 · Cited by 342 · see citing works
Depth estimation from image structure
Torralba, A. B., & Oliva, A. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033214 · Cited by 341 · see citing works
Understanding the retinal basis of vision across species
Baden, T., Euler, T., & Berens, P. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0242-1 · Cited by 334 · see citing works
Ecological statistics of Gestalt laws for the perceptual organization of contours
Elder, J. H., & Goldberg, R. M. (2002) · Journal of Vision · doi:10.1167/2.4.5 · Cited by 333 · see citing works
Sparse Modeling for Image and Vision Processing
Mairal, J. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781680830095 · Cited by 332 · see citing works
COMPLETE FUNCTIONAL CHARACTERIZATION OF SENSORY NEURONS BY SYSTEM IDENTIFICATION
Wu, M. C., David, S. V., & Gallant, J. L. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113024 · Cited by 332 · see citing works
- Authors
- Simoncelli, E. P., & Olshausen, B. A.
- Affiliations
- Howard Hughes Medical Institute (US)
- University of California, Davis (US)
- Venue
- Annual Review of Neuroscience
- Publisher
- Annual Reviews
- Published
- 2001-03
- Volume
- 24
- Issue
- 1
- Pages
- 1193-1216
- ISSN
- 0147-006X (ISSN-L)
- 1545-4126
- OpenAlex
- W2151035455
- Cited by
- 2,460
- References
- 87
- Citations by year
- 2026: 99 · 2025: 135 · 2024: 114 · 2023: 130 · 2022: 117 · 2021: 133 · 2020: 108 · 2019: 136 · 2018: 107 · 2017: 98 · 2016: 118 · 2015: 110 · 2014: 122 · 2013: 124 · 2012: 93
- FWCI
- 4.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annual Review of Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (5r29mh057921-05)
- National Institute of Mental Health (R29-MH57921)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- natural image statistics, efficient coding hypothesis, coding efficiency, neural representations, sensory adaptation, information theory, population coding, visual neurons
- MeSH terms
- Animals, Brain Mapping, Environment, Humans, Image Processing, Computer-Assisted, Neurons, Pattern Recognition, Visual, Visual Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review