Fundamental limits on persistent activity in networks of noisy neurons
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Neural noise limits the fidelity of representations in the brain. This limitation has been extensively analyzed for sensory coding. However, in short-term memory and integrator networks, where noise accumulates and can play an even more prominent role, much less is known about how neural noise interacts with neural and network parameters to determine the accuracy of the computation. Here we analytically derive how the stored memory in continuous attractor networks of probabilistically spiking neurons will degrade over time through diffusion. By combining statistical and dynamical approaches, we establish a fundamental limit on the network’s ability to maintain a persistent state: The noise-induced drift of the memory state over time within the network is strictly lower-bounded by the accuracy of estimation of the network’s instantaneous memory state by an ideal external observer. This result takes the form of an information-diffusion inequality. We derive some unexpected consequences: Despite the persistence time of short-term memory networks, it does not pay to accumulate spikes for longer than the cellular time-constant to read out their contents. For certain neural transfer functions, the conditions for optimal sensory coding coincide with those for optimal storage, implying that short-term memory may be co-localized with sensory representation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Irreversibility and heat generation in the computing process
Landauer, R. (1961) · IBM Journal of Research and Development · doi:10.1147/rd.53.0183 · Cited by 4,980
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 1×
“Our results suggest that in continuous attractor neural integrators (8–10, 25, 26, 34), neural noise has a similar effect as noise in the input variable being integrated, justifying the phenomenological approach taken by many (25, 26, 43), who add a Gaussian noise term to the input of an otherwise perfect integrator.”
BackgroundSoftky, W., & Koch, C. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-01-00334.1993 · Cited by 1,689 · cited 1×
“The Poisson model is motivated by the Poisson-like statistics of spike trains in cortical areas (21, 22) and is a simple way of generating the spiking statistics that would be obtained under certain conditions from conductance-based neurons receiving noisy inputs (23, 24).”
MethodDecoding reveals the contents of visual working memory in early visual areas
Harrison, S. A., & Tong, F. (2009) · Nature · doi:10.1038/nature07832 · Cited by 1,347
Synaptic theory of working memory
Mongillo, G., Barak, O., & Tsodyks, M. (2008) · Science · doi:10.1126/science.1150769 · Cited by 1,253 · cited 1×
“The very general nature of the principle underlying the information-diffusion inequality suggests that it may hold for neural models that contain more biophysical detail (24) and include more dynamical time-scales (37); for networks where spike–spike correlations are important and modify the Fisher information (38, 39…”
Experimental verification of Landauer’s principle linking information and thermodynamics
Bérut, A., Arakelyan, A., Petrosyan, A., Ciliberto, S., Dillenschneider, R., & Lutz, E. (2012) · Nature · doi:10.1038/nature10872 · Cited by 1,248 · cited 1×
“More recently, such principles have been explored in man-made computing devices at the nanoscale, where fluctuations become prominent (19, 20).”
BackgroundCompte, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.9.910 · Cited by 1,143
Gene Regulation at the Single-Cell Level
Rosenfeld, N., Young, J. W., Alon, U., Swain, P. S., & Elowitz, M. B. (2005) · Science · doi:10.1126/science.1106914 · Cited by 1,104
Zhang, K. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-06-02112.1996 · Cited by 1,001 · cited 1×
“gi 1⁄4 ∑ j W ijsj þ bi; [8]”
Neuronal correlates of parametric working memory in the prefrontal cortex
Romo, R., Brody, C. D., Hernández, A., & Lemus, L. (1999) · Nature · doi:10.1038/20939 · Cited by 822 · cited 1×
“h1⁄2Θ̂ðTÞ − Θ 2i ≥ 2DðT þ τÞ; [6]”
Cited by
Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory
Wimmer, K., Nykamp, D. Q., Constantinidis, C., & Compte, A. (2014) · Nature Neuroscience · doi:10.1038/nn.3645 · Cited by 470
Chaudhuri, R., Gerçek, B., Pandey, B., Peyrache, A., & Fiete, I. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0460-x · Cited by 373
Self-citationBuzsáki, G. (2019) · doi:10.1093/oso/9780190905385.001.0001 · Cited by 358
Discrete attractor dynamics underlies persistent activity in the frontal cortex
Inagaki, H. K., Fontolan, L., Romani, S., & Svoboda, K. (2019) · Nature · doi:10.1038/s41586-019-0919-7 · Cited by 334
Attractor and integrator networks in the brain
Khona, M., & Fiete, I. R. (2022) · Nature Reviews Neuroscience · doi:10.1038/s41583-022-00642-0 · Cited by 306
Self-citation
Metadata
- Authors
- Burak, Y., & Fiete, I. R.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2012-10-09
- Volume
- 109
- Issue
- 43
- Pages
- 17645-17650
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2014542273
- Cited by
- 137
- References
- 18
- FWCI
- 1.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fundamental limits on persistent activity in networks of noisy neurons. https://app.cochat.ai/papers/10.1073/pnas.1117386109
- The paper
- Burak, Y., & Fiete, I. R. (2012). Fundamental limits on persistent activity in networks of noisy neurons. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1117386109
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.