The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
The Upward Bias in Measures of Information Derived from Limited Data Samples
Abstract
Extracting information measures from limited experimental samples, such as those normally available when using data recorded in vivo from mammalian cortical neurons, is known to be plagued by a systematic error, which tends to bias the estimate upward. We calculate here the average of the bias, under certain conditions, as an asymptotic expansion in the inverse of the size of the data sample. The result agrees with numerical simulations, and is applicable, as an additive correction term, to measurements obtained under such conditions. Moreover, we discuss the implications for measurements obtained through other usual procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Edwards, S. F., & Anderson, P. W. (1975) · Journal of Physics F: Metal Physics · doi:10.1088/0305-4608/5/5/017 · Cited by 3,991
Divergence of Perturbation Theory in Quantum Electrodynamics
Dyson, F. J. (1952) · Physical Review · doi:10.1103/physrev.85.631 · Cited by 1,015
Information encoding and the responses of single neurons in the primate temporal visual cortex
Tovee, M. J., Rolls, E. T., Treves, A., & Bellis, R. P. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.2.640 · Cited by 281
Self-citationDecoding cortical neuronal signals: Network models, information estimation and spatial tuning
Kjær, T. W., Hertz, J., & Richmond, B. J. (1994) · Journal of Computational Neuroscience · doi:10.1007/bf00962721 · Cited by 124
Unbiased measures of transmitted information and channel capacity from multivariate neuronal data
Optican, L. M., Gawne, T. J., Richmond, B. J., & Joseph, P. J. (1991) · Biological Cybernetics · doi:10.1007/bf00216963 · Cited by 107
On the bias of information estimates.
Carlton, A. G. (1969) · Psychological Bulletin · doi:10.1037/h0026857 · Cited by 95
Quantitative estimate of the information relayed by the Schaffer collaterals
Treves, A. (1995) · Journal of Computational Neuroscience · doi:10.1007/bf00961437 · Cited by 78
Self-citationMEASURING NATURAL NEURAL PROCESSING WITH ARTIFICIAL NEURAL NETWORKS
Hertz, J., Kjær, T. W., Eskandar, E. N., & Richmond, B. J. (1992) · International Journal of Neural Systems · doi:10.1142/s0129065792000425 · Cited by 33
How much of the hippocampus can be explained by functional constraints?
Treves, A., Skaggs, W. E., & Barnes, C. A. (1996) · Hippocampus · Cited by 31
Self-citationCluster method for analysis of transmitted information in multivariate neuronal data
Chee-Orts, M. N., & Optican, L. M. (1993) · Biological Cybernetics · doi:10.1007/bf00201406 · Cited by 21
Cited by
Neural correlations, population coding and computation
Averbeck, B. B., Latham, P. E., & Pouget, A. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1888 · Cited by 1,743
“Because of data limitations it is not possible to directly compute informatio”
BackgroundEstimation of entropy and mutual information
Paninski, L. (2003) · Neural Computation · doi:10.1162/089976603321780272 · Cited by 1,442
“Treves and Panzeri (1995) and Victor (2000a) both admit that their methods (a divergent expansion of the logarithm in each case) are not rigorous.”
BackgroundMethodInfluentialCausality detection based on information-theoretic approaches in time series analysis
HLAVACKOVASCHINDLER, K., PALUS, M., VEJMELKA, M., & BHATTACHARYA, J. (2007) · Physics Reports · doi:10.1016/j.physrep.2006.12.004 · Cited by 800
Melnikov, A., Murugan, A., Zhang, X., Tesileanu, T., Wang, L., Rogov, P., Feizi, S., Gnirke, A., Callan, C. G., Kinney, J. B., et al. (2012) · Nature Biotechnology · doi:10.1038/nbt.2137 · Cited by 711
Entropy and information in neural spike trains
Strong, S. P., Koberle, R., de Ruyter van Steveninck, R. R., & Bialek, W. (1998) · Physical Review Letters · doi:10.1103/physrevlett.80.197 · Cited by 791
Equitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667
“How to compute such an estimate that does not bias the resulting mutual information value remains an open problem, one that is particularly acute in the undersampled regime (9, 10).”
BackgroundNature and precision of temporal coding in visual cortex: a metric-space analysis
Victor, J. D., & Purpura, K. P. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.2.1310 · Cited by 611
Computational Neuroscience of Vision
Rolls, E., & Deco, G. (2001) · doi:10.1093/acprof:oso/9780198524885.001.0001 · Cited by 553
Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex
Rolls, E. T., & Tovee, M. J. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.2.713 · Cited by 500
Synergy, Redundancy, and Independence in Population Codes
Schneidman, E., Bialek, W., & Berry, M. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-37-11539.2003 · Cited by 497
View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex
Booth, M. (1998) · Cerebral Cortex · doi:10.1093/cercor/8.6.510 · Cited by 464
Metric-space analysis of spike trains: theory, algorithms and application
Victor, J. D., & Purpura, K. P. (1997) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_8_2_003 · Cited by 426
Hand Movement Direction Decoded from MEG and EEG
Waldert, S., Preissl, H., Demandt, E., Braun, C., Birbaumer, N., Aertsen, A., & Mehring, C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5171-07.2008 · Cited by 415
Influence of boundary removal on the spatial representations of the medial entorhinal cortex
Savelli, F., Yoganarasimha, D., & Knierim, J. J. (2008) · Hippocampus · doi:10.1002/hipo.20511 · Cited by 363
How Local Excitation-Inhibition Ratio Impacts the Whole Brain Dynamics
Deco, G., Ponce-Alvarez, A., Hagmann, P., Romani, G. L., Mantini, D., & Corbetta, M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5068-13.2014 · Cited by 389
Posterior parietal cortex represents sensory history and mediates its effects on behaviour
Akrami, A., Kopec, C. D., Diamond, M. E., & Brody, C. D. (2018) · Nature · doi:10.1038/nature25510 · Cited by 380
Correcting for the sampling bias problem in spike train information measures
Panzeri, S., Senatore, R., Montemurro, M. A., & Petersen, R. S. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00559.2007 · Cited by 378
Self-citationIn search of common foundations for cortical computation
Phillips, W. A., & Singer, W. (1997) · Behavioral and Brain Sciences · doi:10.1017/s0140525x9700160x · Cited by 340
Periodicity and Firing Rate As Candidate Neural Codes for the Frequency of Vibrotactile Stimuli
Salinas, E., Hernández, A., Zainos, A., & Romo, R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-14-05503.2000 · Cited by 333
Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions
Sharpee, T., Rust, N. C., & Bialek, W. (2004) · Neural Computation · doi:10.1162/089976604322742010 · Cited by 298
The neuronal encoding of information in the brain
Rolls, E. T., & Treves, A. (2011) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2011.08.002 · Cited by 284
Self-citationA Comprehensive Evaluation of Mutual Information Analysis Using a Fair Evaluation Framework
Whitnall, C., & Oswald, E. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-22792-9_18 · Cited by 283
Rolls, E. T., Treves, A., & Tovee, M. J. (1997) · Experimental Brain Research · doi:10.1007/pl00005615 · Cited by 254
Self-citationInformation and efficiency in the nervous system-a synthesis.
Sengupta, B., Stemmler, M. B., & Friston, K. J. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003157 · Cited by 212
“Although, sophisticated machine learning tools try to estimate mutual information from limited data [53–55], the numerics of mutual information are fraught with difficulties.”
BackgroundAnalytical estimates of limited sampling biases in different information measures
Panzeri, S., & Treves, A. (1996) · Network: Computation in Neural Systems · doi:10.1080/0954898x.1996.11978656 · Cited by 138
Self-citationAuditory Cortical Detection and Discrimination Correlates with Communicative Significance
Liu, R. C., & Schreiner, C. E. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0050173 · Cited by 130
“tions in the information estimates [30,31], the randomized”
BackgroundNeural coding and decoding: communication channels and quantization
Dimitrov, A. G., & Miller, J. P. (2001) · Network: Computation in Neural Systems · doi:10.1080/net.12.4.441.472 · Cited by 76
“Due to the high dimensionality of the sets involved, such a relation is extremely difficult to quantify [17, 33, 38].”
BackgroundQuantifying gender bias towards politicians in cross-lingual language models
Stańczak, K., Ray Choudhury, S., Pimentel, T., Cotterell, R., & Augenstein, I. (2023) · PLOS ONE · doi:10.1371/journal.pone.0277640 · Cited by 13
“Note that due to the relatively small number of politicians identified in the other gender group, we restrict ourselves to two binary genders in this generative latent-variable setting.”
Sampling bias corrections for discrete and Gaussian partial information decompositions
Lorenz, G. M., Engel, N. M., Koçillari, L., Celotto, M., Orsenigo, D., Curreli, S., Malerba, S. B., Engel, A. K., Kayser, C., Fellin, T., et al. (2026) · Patterns · doi:10.1016/j.patter.2026.101619 · Cited by 9
Self-citation
Metadata
- Authors
- Treves, A., & Panzeri, S.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 1995-03
- Volume
- 7
- Issue
- 2
- Pages
- 399-407
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2151387592
- Cited by
- 358
- References
- 10
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.