The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions
Open accessAbstract
We propose a method that allows for a rigorous statistical analysis of neural responses to natural stimuli that are nongaussian and exhibit strong correlations. We have in mind a model in which neurons are selective for a small number of stimulus dimensions out of a high-dimensional stimulus space, but within this subspace the responses can be arbitrarily nonlinear. Existing analysis methods are based on correlation functions between stimuli and responses, but these methods are guaranteed to work only in the case of gaussian stimulus ensembles. As an alternative to correlation functions, we maximize the mutual information between the neural responses and projections of the stimulus onto low-dimensional subspaces. The procedure can be done iteratively by increasing the dimensionality of this subspace. Those dimensions that allow the recovery of all of the information between spikes and the full unprojected stimuli describe the relevant subspace. If the dimensionality of the relevant subspace indeed is small, it becomes feasible to map the neuron's input-output function even under fully natural stimulus conditions. These ideas are illustrated in simulations on model visual and auditory neurons responding to natural scenes and sounds, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Numerical recipes in Pascal: the art of scientific computing
(1990) · Choice Reviews Online · doi:10.5860/choice.27-5158 · Cited by 11,811
Numerical Recipes in C: The Art of Scientific Computing.
Birchenhall, C., Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · The Economic Journal · doi:10.2307/2234664 · Cited by 4,355
ASH, R. B. (1966) · Cited by 3,990
Spikes: Exploring the Neural Code
Rieke, F. M., Warland, D., van Steveninck, R. R. D. R., & Bialek, W. (1996) · Medical Entomology and Zoology · Cited by 2,844
Self-citationThe information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626 · cited 2×
“This makes the proposed method of looking for the RS complimentary to the clustering of stimuli conditional on a spike done in the information bottleneck method (Tishby et al., 1999); see also (Dimitrov & Miller, 2001).”
MethodSelf-citationNatural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 2×
“…the full dynamic range of neural responses may require using stimulus ensembles which approximate those occurring in nature (Rieke et al., 1997; Simoncelli & Olshausen, 2001), and it is an attractive hypothesis that the neural representation of these natural signals may be optimized in some…”
BackgroundResultReliability of spike timing in neocortical neurons
Mainen, Z. F., & Sejnowski, T. J. (1995) · Science · doi:10.1126/science.7770778 · Cited by 1,950
Estimation of entropy and mutual information
Paninski, L. (2003) · Neural Computation · doi:10.1162/089976603321780272 · Cited by 1,442 · cited 4×
“The true value I spike can be found either by subtracting an expected bias value, which is of the order of ∼ 1 / ( P (spike) N 2 ln 2) (Treves & Panzeri, 1995; Panzeri & Treves, 1996; Pola et al., 2002; Paninski, 2003b), or by extrapolating to N → ∞ (Brenner et al., 2000b; Strong et al., 1998).”
BackgroundMethodInfluentialSparse Coding and Decorrelation in Primary Visual Cortex During Natural Vision
Vinje, W. E., & Gallant, J. L. (2000) · Science · doi:10.1126/science.287.5456.1273 · Cited by 1,275
Nonlinear multivariate analysis of neurophysiological signals
Pereda, E., Quiroga, R. Q., & Bhattacharya, J. (2005) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2005.10.003 · Cited by 1,076
The statistics of natural images
Ruderman, D. (1994) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/5/4/006 · Cited by 941
Statistics of natural images: Scaling in the woods
Ruderman, D. L., & Bialek, W. (1994) · Physical Review Letters · doi:10.1103/physrevlett.73.814 · Cited by 920
Self-citationEfficiency and ambiguity in an adaptive neural code
Fairhall, A. L., Lewen, G. D., Bialek, W., & de Ruyter van Steveninck, R. R. (2001) · Nature · doi:10.1038/35090500 · Cited by 845
Self-citationEntropy and information in neural spike trains
Strong, S. P., Koberle, R., de Ruyter van Steveninck, R. R., & Bialek, W. (1998) · Physical Review Letters · doi:10.1103/physrevlett.80.197 · Cited by 791
Self-citationA simple white noise analysis of neuronal light responses
Chichilnisky, E. J. (2001) · Network Computation in Neural Systems · doi:10.1080/net.12.2.199.213 · Cited by 770
Keshner, M. S. (1982) · Proceedings of the IEEE · doi:10.1109/proc.1982.12282 · Cited by 759
Reproducibility and Variability in Neural Spike Trains
de Ruyter van Steveninck, R. R., Lewen, G. D., Strong, S. P., Koberle, R., & Bialek, W. (1997) · Science · doi:10.1126/science.275.5307.1805 · Cited by 702
Self-citationA simple white noise analysis of neuronal light responses
Chichilnisky, E. J. (2001) · Network: Computation in Neural Systems · doi:10.1080/713663221 · Cited by 670
Adaptive Rescaling Maximizes Information Transmission
Brenner, N., Bialek, W., & de Ruyter van Steveninck, R. (2000) · Neuron · doi:10.1016/s0896-6273(00)81205-2 · Cited by 647
Self-citationRedundancy reduction revisited
Barlow, H. (2001) · Network: Computation in Neural Systems · doi:10.1080/net.12.3.241.253 · Cited by 620
‘1/fnoise’ in music and speech
VOSS, R. F., & CLARKE, J. (1975) · Nature · doi:10.1038/258317a0 · Cited by 604
Adaptation of retinal processing to image contrast and spatial scale
Smirnakis, S. M., Berry, M. J., Warland, D. K., Bialek, W., & Meister, M. (1997) · Nature · doi:10.1038/386069a0 · Cited by 547
Self-citationSpectral-Temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural Sounds
Theunissen, F. E., Sen, K., & Doupe, A. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02315.2000 · Cited by 547
De Boer, E., & Kuyper, P. (1968) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1968.4502561 · Cited by 454
Responses of neurons in primary and inferior temporal visual cortices to natural scenes
Baddeley, R., Abbott, L. F., Booth, M. C. A., Sengpiel, F., Freeman, T., Wakeman, E. A., & Rolls, E. T. (1997) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1997.0246 · Cited by 431
How Close Are We to Understanding V1?
Olshausen, B. A., & Field, D. J. (2005) · Neural Computation · doi:10.1162/0899766054026639 · Cited by 414
Temporal Coding of Visual Information in the Thalamus
Reinagel, P., & Reid, R. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-14-05392.2000 · Cited by 408
Low Response Variability in Simultaneously Recorded Retinal, Thalamic, and Cortical Neurons
Kara, P., Reinagel, P., & Reid, R. C. (2000) · Neuron · doi:10.1016/s0896-6273(00)00072-6 · Cited by 403
Statistics of natural time-varying images
Dong, D. W., & Atick, J. J. (1995) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_6_3_003 · Cited by 381
The Upward Bias in Measures of Information Derived from Limited Data Samples
Treves, A., & Panzeri, S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.2.399 · Cited by 358
Brenner, N., Strong, S. P., Koberle, R., Bialek, W., & Steveninck, R. R. D. R. V. (2000) · Neural Computation · doi:10.1162/089976600300015259 · Cited by 346
Self-citation(1995) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1995.0204 · Cited by 317
de Ruyter van Steveninck, R., & Bialek, W. (1988) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1988.0055 · Cited by 295
Self-citationA natural approach to studying vision
Felsen, G., & Dan, Y. (2005) · Nature Neuroscience · doi:10.1038/nn1608 · Cited by 285
Odour-plume dynamics influence the brain's olfactory code
Vickers, N. J., Christensen, T. A., Baker, T. C., & Hildebrand, J. G. (2001) · Nature · doi:10.1038/35068559 · Cited by 252
Vinje, W. E., & Gallant, J. L. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02904.2002 · Cited by 251
Reconstruction of Natural Scenes from Ensemble Responses in the Lateral Geniculate Nucleus
Stanley, G. B., Li, F. F., & Dan, Y. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-18-08036.1999 · Cited by 240
Feature Analysis of Natural Sounds in the Songbird Auditory Forebrain
Sen, K., Theunissen, F. E., & Doupe, A. J. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.3.1445 · Cited by 225
Analytical estimates of limited sampling biases in different information measures
Panzeri, S., & Treves, A. (1996) · Network Computation in Neural Systems · doi:10.1088/0954-898x/7/1/006 · Cited by 207
A subspace reverse-correlation technique for the study of visual neurons
Ringach, D. L., Sapiro, G., & Shapley, R. (1997) · Vision Research · doi:10.1016/s0042-6989(96)00247-7 · Cited by 202
Spatial Structure of Complex Cell Receptive Fields Measured with Natural Images
Touryan, J., Felsen, G., & Dan, Y. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.029 · Cited by 194
Isolation of Relevant Visual Features from Random Stimuli for Cortical Complex Cells
Touryan, J., Lau, B., & Dan, Y. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10811.2002 · Cited by 180
The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes
Rolls, E. T., Aggelopoulos, N. C., & Zheng, F. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-01-00339.2003 · Cited by 179
Convergence properties of three spike-triggered analysis techniques
Paninski, L. (2003) · Network Computation in Neural Systems · doi:10.1088/0954-898x_14_3_304 · Cited by 172
Computation in a Single Neuron: Hodgkin and Huxley Revisited
Arcas, B. A. Y., Fairhall, A. L., & Bialek, W. (2003) · Neural Computation · doi:10.1162/08997660360675017 · Cited by 161
Self-citationMapping receptive fields in primary visual cortex
Ringach, D. L. (2004) · The Journal of Physiology · doi:10.1113/jphysiol.2004.065771 · Cited by 149
Coding of Natural Scenes in Primary Visual Cortex
Weliky, M., Fiser, J., Hunt, R. H., & Wagner, D. N. (2003) · Neuron · doi:10.1016/s0896-6273(03)00022-9 · Cited by 144
Analytical estimates of limited sampling biases in different information measures
Panzeri, S., & Treves, A. (1996) · Network: Computation in Neural Systems · doi:10.1080/0954898x.1996.11978656 · Cited by 138
Ringach, D. L., Hawken, M. J., & Shapley, R. M. (2002) · Journal of Vision · doi:10.1167/2.1.2 · Cited by 135
Smyth, D., Willmore, B. D. B., Baker, G. E., Thompson, I. D., & Tolhurst, D. J. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-11-04746.2003 · Cited by 133
Neural coding of naturalistic motion stimuli
Lewen, G. D., Bialek, W., & van Steveninck, R. R. D. R. (2001) · Network Computation in Neural Systems · doi:10.1088/0954-898x/12/3/305 · Cited by 113
Self-citationFeatures and dimensions: Motion estimation in fly visionPreprint
Bialek, W., & van Steveninck, R. R. D. R. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.q-bio/0505003 · Cited by 96
Self-citationOptimal nonlinear codes for the perception of natural colours
von der Twer, T., & MacLeod, D. I. A. (2001) · Network Computation in Neural Systems · doi:10.1080/net.12.3.395.407 · Cited by 90
Representation of complex visual stimuli in the brain
Creutzfeldt, O. D., & Nothdurft, H. (1978) · Die Naturwissenschaften · doi:10.1007/bf00368371 · Cited by 80
Neural coding and decoding: communication channels and quantization
Dimitrov, A. G., & Miller, J. P. (2001) · Network: Computation in Neural Systems · doi:10.1080/net.12.4.441.472 · Cited by 76
Characterizing Neural Gain Control using Spike-triggered Covariance
Schwartz, O., Chichilnisky, E. J., & Simoncelli, E. P. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0039 · Cited by 76
Victor, J. D. (2005) · Nature Neuroscience · doi:10.1038/nn1607 · Cited by 65
van Steveninck, R. R. D. R., Borst, A., & Bialek, W. (2001) · Springer eBooks · doi:10.1007/978-3-642-56550-2_15 · Cited by 24
Self-citationBialek, W. (2007) · Les Houches - Ecole d’Ete de Physique Theorique · doi:10.1007/3-540-45701-1_12 · Cited by 16
Self-citationA Practical Guide to Information Analysis of Spike Trains
Pola, G., Schultz, S. R., Petersen, R. S., & Panzeri, S. (2003) · Springer eBooks · doi:10.1007/978-1-4615-1079-6_10 · Cited by 12
Cited by
Estimation of entropy and mutual information
Paninski, L. (2003) · Neural Computation · doi:10.1162/089976603321780272 · Cited by 1,442
Highly selective receptive fields in mouse visual cortex
Niell, C. M., & Stryker, M. P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.0623-08.2008 · Cited by 1,081
Nonlinear multivariate analysis of neurophysiological signals
Pereda, E., Quiroga, R. Q., & Bhattacharya, J. (2005) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2005.10.003 · Cited by 1,076
Equitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667
“Although substantial difficulties with estimating mutual information on continuous data remain, such estimates have proved useful in a variety of realworld problems in neuroscience (14, 15, 25), molecular biology (16, 17, 26–28), medical imaging (29), and signal processing (13).”
BackgroundDo We Know What the Early Visual System Does?
Carandini, M., Demb, J. B., Mante, V., Tolhurst, D. J., Dan, Y., Olshausen, B. A., Gallant, J. L., & Rust, N. C. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3726-05.2005 · Cited by 600
Self-citation
Metadata
- Authors
- Sharpee, T., Rust, N. C., & Bialek, W.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2004-02-01
- Volume
- 16
- Issue
- 2
- Pages
- 223-250
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2125498357
- Cited by
- 298
- References
- 60
- FWCI
- 6.72
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.