Evolutionary aspects of reservoir computing
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Reservoir computing (RC) is a powerful computational paradigm that allows high versatility with cheap learning. While other artificial intelligence approaches need exhaustive resources to specify their inner workings, RC is based on a reservoir with highly nonlinear dynamics that does not require a fine tuning of its parts. These dynamics project input signals into high-dimensional spaces, where training linear readouts to extract input features is vastly simplified. Thus, inexpensive learning provides very powerful tools for decision-making, controlling dynamical systems, classification, etc. RC also facilitates solving multiple tasks in parallel, resulting in a high throughput. Existing literature focuses on applications in artificial intelligence and neuroscience. We review this literature from an evolutionary perspective. RC’s versatility makes it a great candidate to solve outstanding problems in biology, which raises relevant questions. Is RC as abundant in nature as its advantages should imply? Has it evolved? Once evolved, can it be easily sustained? Under what circumstances? (In other words, is RC an evolutionarily stable computing paradigm?) To tackle these issues, we introduce a conceptual morphospace that would map computational selective pressures that could select for or against RC and other computing paradigms. This guides a speculative discussion about the questions above and allows us to propose a solid research line that brings together computation and evolution with RC as test model of the proposed hypotheses. This article is part of the theme issue ‘Liquid brains, solid brains: How distributed cognitive architectures process information’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“There was a lot of mutual inspiration between biology and computer science as perceptrons [149], attractor networks [150], or self-organized maps [151] were introduced.”
BackgroundSelf-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Marr, D., & Hildreth, E. (1980) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1980.0020 · Cited by 6,510
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 7×
“Through RC, they proposed a plausible computing strategy that could be the basic operating principle of these circuits [33, 106–108].”
BackgroundMethodInfluentialHarnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811 · cited 1×
“Despite the simplicity of this method, RC-trained RNN have been robustly used for a plethora of tasks including data classification [40– 42], systems control [41, 43–45], time-series prediction [46, 47], uncovering grammar and other linguistic and speech features [41, 48–51] etc.”
MethodReservoir computing approaches to recurrent neural network training
Lukoševičius, M., & Jaeger, H. (2009) · Computer Science Review · doi:10.1016/j.cosrev.2009.03.005 · Cited by 2,956
Being there: putting brain, body, and world together again
(1997) · Choice Reviews Online · doi:10.5860/choice.34-6204 · Cited by 2,631
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639 · cited 4×
“[126] Rigotti M, Barak O, Warden MR, Wang XJ, Daw ND, Miller EK, Fusi S.”
BackgroundMethodInfluentialComputation at the edge of chaos: Phase transitions and emergent computation
Langton, C. G. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90064-v · Cited by 1,527
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Emergent complex neural dynamics
Chialvo, D. R. (2010) · Nature Physics · doi:10.1038/nphys1803 · Cited by 1,165
An experimental unification of reservoir computing methods
Verstraeten, D., Schrauwen, B., D’Haene, M., & Stroobandt, D. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.003 · Cited by 1,135
Differential signaling via the same axon of neocortical pyramidal neurons
Markram, H., Wang, Y., & Tsodyks, M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.9.5323 · Cited by 1,102
Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition
Fukushima, K., & Miyake, S. (1982) · Lecture Notes in Biomathematics · doi:10.1007/978-3-642-46466-9_18 · Cited by 991
How the Body Shapes the Way We Think: A New View of Intelligence
Pfeifer, R., & Bongard, J. (2006) · doi:10.7551/mitpress/3585.001.0001 · Cited by 956
Optimization and applications of echo state networks with leaky- integrator neurons
Jaeger, H., Lukoševičius, M., Popovici, D., & Siewert, U. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.016 · Cited by 948 · cited 1×
“Despite the simplicity of this method, RC-trained RNN have been robustly used for a plethora of tasks including data classification [40– 42], systems control [41, 43–45], time-series prediction [46, 47], uncovering grammar and other linguistic and speech features [41, 48–51] etc.”
MethodReal-Time Computation at the Edge of Chaos in Recurrent Neural Networks
Bertschinger, N., & Natschläger, T. (2004) · Neural Computation · doi:10.1162/089976604323057443 · Cited by 833
Why neurons mix: high dimensionality for higher cognition
Fusi, S., Miller, E. K., & Rigotti, M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.01.010 · Cited by 766
Are Biological Systems Poised at Criticality?
Mora, T., & Bialek, W. (2011) · Journal of Statistical Physics · doi:10.1007/s10955-011-0229-4 · Cited by 734
Thomson, A. M. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.9.936 · Cited by 420 · cited 1×
“An important part of the internal structure, as well as external connections to and from other columns and other parts of the brain (notably the thalamus), appears to be stereotypical [109].”
BackgroundReceptive fields and trigger features of ganglion cells in the visual streak of the rabbit's retina
Levick, W. R. (1967) · The Journal of Physiology · doi:10.1113/jphysiol.1967.sp008140 · Cited by 384
From Replicators to Reproducers: the First Major Transitions Leading to Life
Szathmáry, E., & Maynard Smith, J. (1997) · Journal of Theoretical Biology · doi:10.1006/jtbi.1996.0389 · Cited by 357
The cortex as a central pattern generator
Yuste, R., MacLean, J. N., Smith, J., & Lansner, A. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1686 · Cited by 355
Behaviour-dependent recruitment of long-range projection neurons in somatosensory cortex
Chen, J. L., Carta, S., Soldado-Magraner, J., Schneider, B. L., & Helmchen, F. (2013) · Nature · doi:10.1038/nature12236 · Cited by 334 · cited 2×
“[124] Chen JL, Carta S, Soldado-Magraner J, Schneider BL,”
BackgroundInformation processing via physical soft body
Nakajima, K., Hauser, H., Li, T., & Pfeifer, R. (2015) · Scientific Reports · doi:10.1038/srep10487 · Cited by 324
A reservoir of time constants for memory traces in cortical neurons
Bernacchia, A., Seo, H., Lee, D., & Wang, X.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2752 · Cited by 292 · cited 3×
“We have reviewed some evidence suggesting that it is exploited by several neural circuits [115, 117–121, 124– 127 The two main advantages brought about by RC are: i) very cheap learning and ii) a startling capability for parallel processing.”
BackgroundMethodThe Origin and Nature of Life on Earth: The Emergence of the Fourth Geosphere
Smith, E., & Morowitz, H. J. (2016) · doi:10.1017/cbo9781316348772 · Cited by 215
The algorithmic origins of life
Walker, S. I., & Davies, P. C. W. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2012.0869 · Cited by 196
A soft body as a reservoir: case studies in a dynamic model of octopus-inspired soft robotic arm
Nakajima, K., Hauser, H., Kang, R., Guglielmino, E., Caldwell, D. G., & Pfeifer, R. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00091 · Cited by 180
The evolution of information in the major transitions
Jablonka, E., & Lamb, M. J. (2006) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2005.08.038 · Cited by 176
On the origins of hierarchy in complex networks
Corominas-Murtra, B., Goñi, J., Solé, R. V., & Rodríguez-Caso, C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1300832110 · Cited by 160 · cited 1×
“Mor-phospaces are an insightful picture that has been used to relate instances of natural [155–158] and synthetic [159– 161] complex systems to each other guided by metrics (sometimes rigorous, other times qualitative) that emerge from mathematical models or empirical data.”
BackgroundExploiting short-term memory in soft body dynamics as a computational resource
Nakajima, K., Li, T., Hauser, H., & Pfeifer, R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0437 · Cited by 128
Relating Fisher information to order parameters.
Prokopenko, M., Lizier, J. T., Obst, O., & Wang, X. R. (2011) · Physical Review E · doi:10.1103/physreve.84.041116 · Cited by 122
Bit by bit: The Darwinian basis of life
Joyce, G. F. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001323 · Cited by 45
Joyce, G. F. (2002) · Nature · doi:10.1038/420278a · Cited by 38
Information theory, predictability and the emergence of complex life
Seoane, L. F., & Solé, R. V. (2018) · Royal Society Open Science · doi:10.1098/rsos.172221 · Cited by 33
Self-citationComplexity versus Uncertainty: The Question of Staying Alive
Wagensberg, J. (2000) · Biology and Philosophy · doi:10.1023/a:1006611022472 · Cited by 29 · cited 1×
“Central in this view is the ability of living systems to capitalize on available external information and forecast regularities from their environment [13, 14], a driving force behind life’s progression towards more complex computing capabilities [15].”
Background
Cited by
Physical reservoir computing—an introductory perspective
Nakajima, K. (2020) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ab8d4f · Cited by 422
Solé, R., Moses, M., & Forrest, S. (2019) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2019.0040 · Cited by 93
Learning reservoir dynamics with temporal self-modulation
Sakemi, Y., Nobukawa, S., Matsuki, T., Morie, T., & Aihara, K. (2024) · Communications Physics · doi:10.1038/s42005-023-01500-w · Cited by 16
Evolution of Brains and Computers: The Roads Not Taken
Solé, R., & Seoane, L. F. (2022) · Entropy · doi:10.3390/e24050665 · Cited by 14
“By making reasonable assumptions about relationships between features, we can still make some qualitative assessments about our systems of interest [176,179,180,182].”
BackgroundSelf-citation
Metadata
- Authors
- Seoane, L. F.
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2019-04-22
- Volume
- 374
- Issue
- 1774
- Pages
- 20180377
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2897785922
- Cited by
- 74
- References
- 39
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.