The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Stability of analog neural networks with delay
Abstract
Continuous-time analog neural networks with symmetric connections will always converge to fixed points when the neurons have infinitely fast response, but can oscillate when a small time delay is present. Sustained oscillation resulting from time delay is relevant to hardware implementations of neural networks where delay due to the finite switching speed of amplifiers can be appreciable compared to the network relaxation time. We analyze the dynamics of continuous-time analog networks with delay, and show that there is a critical delay above which a symmetrically connected network will oscillate. Two different stability analyses are presented for low and high neuron gain. The results are useful as design criteria for building fast but stable electronic networks. We find that for some connection topologies, a delay much smaller than the relaxation time can lead to oscillation, whereas for other topologies, including associative memory networks, even long delays will not produce oscillation. The most oscillation-prone network configuration is the all-inhibitory network; in this configuration, the critical delay for oscillation is smaller than the network relaxation time by a factor of N, the size of the network. Theoretical results are compared with numerical simulations and with experiments performed on a small (eight neurons) electronic network with controllable delay.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Hebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
Hopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
Spin glasses: Experimental facts, theoretical concepts, and open questions
Binder, K., & Young, A. P. (1986) · Reviews of Modern Physics · doi:10.1103/revmodphys.58.801 · Cited by 5,177
Differential-Difference Equations
(1963) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)x6010-8 · Cited by 1,725
On the Distribution of the Roots of Certain Symmetric Matrices
Wigner, E. P. (1958) · The Annals of Mathematics · doi:10.2307/1970008 · Cited by 1,463
Spin-glass models of neural networks
Amit, D. J., Gutfreund, H., & Sompolinsky, H. (1985) · Physical Review A · doi:10.1103/physreva.32.1007 · Cited by 1,182
Chaos in random neural networks
Sompolinsky, H., Crisanti, A., & Sommers, H. J. (1988) · Physical Review Letters · doi:10.1103/physrevlett.61.259 · Cited by 1,061
The existence of persistent states in the brain
Little, W. A. (1974) · Mathematical Biosciences · doi:10.1016/0025-5564(74)90031-5 · Cited by 657
Solvable spin systems with random interactions
Mattis, D. C. (1976) · Physics Letters A · doi:10.1016/0375-9601(76)90396-0 · Cited by 412
Spectrum of Large Random Asymmetric Matrices
Sommers, H. J., Crisanti, A., Sompolinsky, H., & Stein, Y. (1988) · Physical Review Letters · doi:10.1103/physrevlett.60.1895 · Cited by 373
Statistical Mechanics of Probabilistic Cellular Automata
Grinstein, G., Jayaprakash, C., & He, Y. (1985) · Physical Review Letters · doi:10.1103/physrevlett.55.2527 · Cited by 326
Collective properties of neural networks: A statistical physics approach
Peretto, P. (1984) · Biological Cybernetics · doi:10.1007/bf00317939 · Cited by 268
The eigenvalue spectrum of a large symmetric random matrix
Edwards, S. F., & Jones, R. C. (1976) · Journal of Physics A: Mathematical and General · doi:10.1088/0305-4470/9/10/011 · Cited by 260
Decreasing energy functions as a tool for studying threshold networks
Goles-Chacc, E., Fogelman-Soulie, F., & Pellegrin, D. (1985) · Discrete Applied Mathematics · doi:10.1016/0166-218x(85)90029-0 · Cited by 253
Analytic study of the memory storage capacity of a neural network
Little, W. A., & Shaw, G. L. (1978) · Mathematical Biosciences · doi:10.1016/0025-5564(78)90058-5 · Cited by 228
Characteristics of randomly connected threshold-element networks and network systems
Амари, Ш.-И. (1971) · Proceedings of the IEEE · doi:10.1109/proc.1971.8087 · Cited by 152
Delays in physiological systems
der Heiden, U. A. (1979) · Journal of Mathematical Biology · doi:10.1007/bf00275831 · Cited by 133
Critical phenomena in model neural networks
Kürten, K. E. (1988) · Physics Letters A · doi:10.1016/0375-9601(88)90135-1 · Cited by 99
The nature of attractors in an asymmetric spin glass with deterministic dynamics
Gutfreund, H., Reger, J. D., & Young, A. P. (1988) · Journal of Physics A Mathematical and General · doi:10.1088/0305-4470/21/12/020 · Cited by 86
Physicality of the Little model
Frumkin, A., & Moses, E. (1986) · Physical Review A · doi:10.1103/physreva.34.714 · Cited by 20
Statistical Properties of Neural Networks
Shinomoto, S. (1986) · Progress of Theoretical Physics · doi:10.1143/ptp.75.1313 · Cited by 12
Cited by
Neural networks as spatio-temporal pattern-forming systems
Ermentrout, B. (1998) · Reports on Progress in Physics · doi:10.1088/0034-4885/61/4/002 · Cited by 679
A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks
Zhang, H., Wang, Z., & Liu, D. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2317880 · Cited by 654
Delay-independent stability in bidirectional associative memory networks
Gopalsamy, K., & He, X.-Z. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329700 · Cited by 560
Global asymptotic stability of a general class of recurrent neural networks with time-varying delays
Cao, J., & Wang, J. (2003) · IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications · doi:10.1109/tcsi.2002.807494 · Cited by 555
Stability in asymmetric Hopfield nets with transmission delays
Gopalsamy, K., & He, X.-Z. (1994) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(94)90043-4 · Cited by 528
Metadata
- Authors
- Marcus, C. M., & Westervelt, R. M.
- Venue
- Physical Review A
- Publisher
- American Physical Society (APS)
- Published
- 1989-01-01
- Volume
- 39
- Issue
- 1
- Pages
- 347-359
- ISSN
- 0556-2791 (ISSN-L)
- OpenAlex
- W2020174839
- Cited by
- 971
- References
- 22
- FWCI
- 14.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.