The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
How delays affect neural dynamics and learning
Abstract
We investigate the effects of delays on the dynamics and, in particular, on the oscillatory properties of simple neural network models. We extend previously known results regarding the effects of delays on stability and convergence properties. We treat in detail the case of ring networks for which we derive simple conditions for oscillating behavior and several formulas to predict the regions of bifurcation, the periods of the limit cycles and the phases of the different neurons. These results in turn can readily be applied to more complex and more biologically motivated architectures, such as layered networks. In general, the main result is that delays tend to increase the period of oscillations and broaden the spectrum of possible frequencies, in a quantifiable way. Simulations show that the theoretically predicted values are in excellent agreement with the numerically observed behavior. Adaptable delays are then proposed as one additional mechanism through which neural systems could tailor their own dynamics. Accordingly, we derive recurrent backpropagation learning formulas for the adjustment of delays and other parameters in networks with delayed interactions and discuss some possible applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Hopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
Theory of Functional Differential Equations
Hale, J. K. (1977) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-9892-2 · Cited by 6,870
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369
Gray, C. M., König, P., Engel, A. K., & Singer, W. (1989) · Nature · doi:10.1038/338334a0 · Cited by 4,183
Theory and applications of Hopf bifurcation
Hassard, B., Kazarinoff, N. D., & Wan, Y. (1981) · Cambridge University Press eBooks · Cited by 2,520
The Correlation Theory of Brain Function
von der Malsburg, C. (1994) · Physics of Neural Networks · doi:10.1007/978-1-4612-4320-5_2 · Cited by 1,089
Stability of analog neural networks with delay
Marcus, C. M., & Westervelt, R. M. (1989) · Physical Review A · doi:10.1103/physreva.39.347 · Cited by 971
Generalization of back-propagation to recurrent neural networks
Pineda, F. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.2229 · Cited by 931
Learning State Space Trajectories in Recurrent Neural Networks
Pearlmutter, B. A. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.263 · Cited by 656
Backpropagation: Theory, architectures, and applications
Biron, P. V. (1997) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199701)48:1<88::aid-asi10>3.0.co;2-# · Cited by 435
Axonal delay lines for time measurement in the owl's brainstem.
Carr, C. E., & Konishi, M. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.21.8311 · Cited by 322
Coupled oscillators and the design of central pattern generators
Kopell, N., & Ermentrout, G. B. (1988) · Mathematical Biosciences · doi:10.1016/0025-5564(88)90059-4 · Cited by 247
Collective frequencies and metastability in networks of limit-cycle oscillators with time delay
Niebur, E., Schuster, H. G., & Kammen, D. M. (1991) · Physical Review Letters · doi:10.1103/physrevlett.67.2753 · Cited by 209
Global processing of visual stimuli in a neural network of coupled oscillators.
Sompolinsky, H., Golomb, D., & Kleinfeld, D. (1990) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.87.18.7200 · Cited by 182
Computing with Arrays of Coupled Oscillators: An Application to Preattentive Texture Discrimination
Baldi, P., & Meir, R. (1990) · Neural Computation · doi:10.1162/neco.1990.2.4.458 · Cited by 100
Self-citationUnnikrishnan, K. P., Hopfield, J. J., & Tank, D. W. (1991) · IEEE Transactions on Signal Processing · doi:10.1109/78.80888 · Cited by 73
A Theory for Neural Networks with Time Delays
de Vries, B., & Príncipe, J. C. (1990) · neural information processing systems · Cited by 62
A Computer Simulation of Oscillatory Behavior in Primary Visual Cortex
Wilson, M. A., & Bower, J. M. (1991) · Neural Computation · doi:10.1162/neco.1991.3.4.498 · Cited by 59
Cited by
Liu, Y., Wang, Z., & Liu, X. (2006) · Neural Networks · doi:10.1016/j.neunet.2005.03.015 · Cited by 692
A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks
Zhang, H., Wang, Z., & Liu, D. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2317880 · Cited by 654
New results on recurrent network training: unifying the algorithms and accelerating convergence
Atiya, A. F., & Parlos, A. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846741 · Cited by 521
Self-citationNonlinear dynamics and chaos in fractional-order neural networks
Kaslik, E., & Sivasundaram, S. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.030 · Cited by 433
Chaotic attractors in delayed neural networks
Lu, H. (2002) · Physics Letters A · doi:10.1016/s0375-9601(02)00538-8 · Cited by 348
Metadata
- Authors
- Baldi, P., & Atiya, A. F.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 1994-07
- Volume
- 5
- Issue
- 4
- Pages
- 612-621
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2104454795
- Cited by
- 429
- References
- 19
- FWCI
- 4.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.