The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Spin-glass models of neural networks
Abstract
Two dynamical models, proposed by Hopfield and Little to account for the collective behavior of neural networks, are analyzed. The long-time behavior of these models is governed by the statistical mechanics of infinite-range Ising spin-glass Hamiltonians. Certain configurations of the spin system, chosen at random, which serve as memories, are stored in the quenched random couplings. The present analysis is restricted to the case of a finite number p of memorized spin configurations, in the thermodynamic limit. We show that the long-time behavior of the two models is identical, for all temperatures below a transition temperature ${T}_{c}$. The structure of the stable and metastable states is displayed. Below ${T}_{c}$, these systems have 2p ground states of the Mattis type: Each one of them is fully correlated with one of the stored patterns. Below T\ensuremath{\sim}0.46${T}_{c}$, additional dynamically stable states appear. These metastable states correspond to specific mixings of the embedded patterns. The thermodynamic and dynamic properties of the system in the cases of more general distributions of random memories are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Hopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
Tables of Integrals, Series, and Products.
Bello, A. L., Gradshteyn, I. S., Ryzhik, I. M., & Jeffrey, A. (1995) · The Statistician · doi:10.2307/2348458 · Cited by 5,860
Edwards, S. F., & Anderson, P. W. (1975) · Journal of Physics F: Metal Physics · doi:10.1088/0305-4608/5/5/017 · Cited by 3,991
Time-Dependent Statistics of the Ising Model
Glauber, R. J. (1963) · Journal of Mathematical Physics · doi:10.1063/1.1703954 · Cited by 3,619
Infinite-ranged models of spin-glasses
Kirkpatrick, S., & Sherrington, D. (1978) · Physical Review B · doi:10.1103/physrevb.17.4384 · Cited by 1,006
The existence of persistent states in the brain
Little, W. A. (1974) · Mathematical Biosciences · doi:10.1016/0025-5564(74)90031-5 · Cited by 657
Solvable spin systems with random interactions
Mattis, D. C. (1976) · Physics Letters A · doi:10.1016/0375-9601(76)90396-0 · Cited by 412
Collective properties of neural networks: A statistical physics approach
Peretto, P. (1984) · Biological Cybernetics · doi:10.1007/bf00317939 · Cited by 268
Analytic study of the memory storage capacity of a neural network
Little, W. A., & Shaw, G. L. (1978) · Mathematical Biosciences · doi:10.1016/0025-5564(78)90058-5 · Cited by 228
Cited by
Spin glasses: Experimental facts, theoretical concepts, and open questions
Binder, K., & Young, A. P. (1986) · Reviews of Modern Physics · doi:10.1103/revmodphys.58.801 · Cited by 5,177
Machine learning and the physical sciences
Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborová, L. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.045002 · Cited by 2,417
Statistical Physics of Spin Glasses and Information Processing: An Introduction
Nishimori, H. (2001) · doi:10.1093/acprof:oso/9780198509417.001.0001 · Cited by 1,182
Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural Networks
Amit, D. J., Gutfreund, H., & Sompolinsky, H. (1985) · Physical Review Letters · doi:10.1103/physrevlett.55.1530 · Cited by 1,058
Self-citationThe space of interactions in neural network models
Gardner, E. (1988) · Journal of Physics A: Mathematical and General · doi:10.1088/0305-4470/21/1/030 · Cited by 1,047
Stability of analog neural networks with delay
Marcus, C. M., & Westervelt, R. M. (1989) · Physical Review A · doi:10.1103/physreva.39.347 · Cited by 971
A high-bias, low-variance introduction to Machine Learning for physicists
Mehta, P., Bukov, M., Wang, C.-H., Day, A. G. R., Richardson, C., Fisher, C. K., & Schwab, D. J. (2019) · Physics Reports · doi:10.1016/j.physrep.2019.03.001 · Cited by 920
Statistical mechanics of neural networks near saturation
Amit, D. J., Gutfreund, H., & Sompolinsky, H. (1987) · Annals of Physics · doi:10.1016/0003-4916(87)90092-3 · Cited by 849
Self-citationFrom the neuron doctrine to neural networks
Yuste, R. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3962 · Cited by 754
The quest for a Quantum Neural Network
Schuld, M., Sinayskiy, I., & Petruccione, F. (2014) · Quantum Information Processing · doi:10.1007/s11128-014-0809-8 · Cited by 671
Optimal storage properties of neural network models
Gardner, E., & Derrida, B. (1988) · Journal of Physics A: Mathematical and General · doi:10.1088/0305-4470/21/1/031 · Cited by 557
Temporal Association in Asymmetric Neural Networks
Sompolinsky, H., & Kanter, I. (1986) · Physical Review Letters · doi:10.1103/physrevlett.57.2861 · Cited by 547
Self-citationAn Exactly Solvable Asymmetric Neural Network Model
Derrida, B., Gardner, E., & Zippelius, A. (1987) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/4/2/007 · Cited by 541
Time structure of the activity in neural network models
Gerstner, W. (1995) · Physical Review E · doi:10.1103/physreve.51.738 · Cited by 527
Carpenter, S. R., & Brock, W. A. (2008) · Ecology and Society · doi:10.5751/es-02716-130240 · Cited by 484
The Enhanced Storage Capacity in Neural Networks with Low Activity Level
Tsodyks, M. V., & Feigel'man, M. V. (1988) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/6/2/002 · Cited by 439
Statistical neurodynamics of associative memory
Amari, S.-I., & Maginu, K. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90022-6 · Cited by 411
The Hebbian paradigm reintegrated: local reverberations as internal representations
Amit, D. J. (1995) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00040164 · Cited by 388
Self-citationAssociative recall of memory without errors
Kanter, I., & Sompolinsky, H. (1987) · Physical Review A · doi:10.1103/physreva.35.380 · Cited by 379
Self-citationWhat determines the capacity of autoassociative memories in the brain?
Treves, A., & Rolls, E. (1991) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/2/4/004 · Cited by 357
Maximum Storage Capacity in Neural Networks
Gardner, E. (1987) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/4/4/016 · Cited by 353
Information storage in neural networks with low levels of activity
Amit, D. J., Gutfreund, H., & Sompolinsky, H. (1987) · Physical Review A · doi:10.1103/physreva.35.2293 · Cited by 329
Self-citationCollective computational properties of neural networks: New learning mechanisms
Personnaz, L., Guyon, I., & Dreyfus, G. (1986) · Physical Review A · doi:10.1103/physreva.34.4217 · Cited by 328
Sequential state generation by model neural networks.
Kleinfeld, D. (1986) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.83.24.9469 · Cited by 315
Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns
Gerstner, W., Ritz, R., & van Hemmen, J. L. (1993) · Biological Cybernetics · doi:10.1007/bf00199450 · Cited by 288
Dynamics of simple electronic neural networks
Babcock, K. L., & Westervelt, R. M. (1987) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(87)90021-2 · Cited by 270
Unsupervised Generative Modeling Using Matrix Product States
Han, Z.-Y., Wang, J., Fan, H., Wang, L., & Zhang, P. (2018) · Physical Review X · doi:10.1103/physrevx.8.031012 · Cited by 256
Systematic Fluctuation Expansion for Neural Network Activity Equations
Buice, M. A., Cowan, J. D., & Chow, C. C. (2010) · Neural Computation · doi:10.1162/neco.2009.02-09-960 · Cited by 164
Theoretical Neuroscience Rising
Abbott, L. F. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.019 · Cited by 163
Inhibitory connectivity defines the realm of excitatory plasticity
Mongillo, G., Rumpel, S., & Loewenstein, Y. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0226-x · Cited by 148
On a Model of Associative Memory with Huge Storage Capacity
Demircigil, M., Heusel, J., Löwe, M., Upgang, S., & Vermet, F. (2017) · Journal of Statistical Physics · doi:10.1007/s10955-017-1806-y · Cited by 136
Information Perspective to Probabilistic Modeling: Boltzmann Machines versus Born Machines
Cheng, S., Chen, J., & Wang, L. (2018) · Entropy · doi:10.3390/e20080583 · Cited by 104
Dynamics of Memory Representations in Networks with Novelty-Facilitated Synaptic Plasticity
Blumenfeld, B., Preminger, S., Sagi, D., & Tsodyks, M. (2006) · Neuron · doi:10.1016/j.neuron.2006.08.016 · Cited by 79
Perspectives on defining cell types in the brain
Mukamel, E. A., & Ngai, J. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.11.007 · Cited by 56
“A network of neurons, interacting via excitatory and inhibitory synapses, can encode multiple attractor states which can be retrieved through appropriate dynamics [14,15].”
BackgroundOn the Maximum Storage Capacity of the Hopfield Model
Folli, V., Leonetti, M., & Ruocco, G. (2017) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00144 · Cited by 50
Multiplex visibility graphs to investigate recurrent neural network dynamics
Bianchi, F. M., Livi, L., Alippi, C., & Jenssen, R. (2017) · Scientific Reports · doi:10.1038/srep44037 · Cited by 41
Statistical physics of liquid brains
Piñero, J., & Solé, R. (2019) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2018.0376 · Cited by 39
Memory Dynamics in Attractor Networks with Saliency Weights
Tang, H., Li, H., & Yan, R. (2010) · Neural Computation · doi:10.1162/neco.2010.07-09-1050 · Cited by 34
(2023) · doi:10.1038/s42005-023-01416-5 · Cited by 10
Metadata
- Authors
- Amit, D. J., Gutfreund, H., & Sompolinsky, H.
- Venue
- Physical Review A
- Publisher
- American Physical Society (APS)
- Published
- 1985-08-01
- Volume
- 32
- Issue
- 2
- Pages
- 1007-1018
- ISSN
- 0556-2791 (ISSN-L)
- OpenAlex
- W2069129925
- Cited by
- 1,182
- References
- 13
- FWCI
- 24.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.