The Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Biological organisms have the ability to respond quickly to an ever-changing world. Because this adaptability is so critical for survival, all vertebrates have sub-cortical structures, which comprise the neuromodulatory systems, to regulate fundamental behavior and drive decision making in response to environmental events. In the vertebrate, there are separate neuromodulators that respond to threats, reward anticipation, novelty, and attentional effort. However, each of these neuromodulatory systems has a similar effect, that is, to cause an organism to be decisive when environmental conditions call for such actions, and allow the organism to be more exploratory when there are no pressing events. In this article, it is proposed that principles of the neuromodulatory system could provide a framework for controlling artificial agents that may improve current artificial agent behavior. These agents would operate autonomously, effectively explore their environment, and be decisive when environmental conditions call for action.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Berridge, C. W., & Waterhouse, B. D. (2003) · Brain Research Reviews · doi:10.1016/s0165-0173(03)00143-7 · Cited by 2,529 · cited 5×
“…(ACh) system by attentional effort (Baxter & Chiba, 1999), the dopaminergic (DA) system by reward anticipation (Schultz, Dayan, & Montague, 1997) and “wanting” (K. C. Berridge, 2004), and the noradrenergic (NE) system by novelty and saliency (C. W. Berridge & Waterhouse, 2003; Yu & Dayan, 2005).”
BackgroundInfluentialTHE AMYGDALA MODULATES THE CONSOLIDATION OF MEMORIES OF EMOTIONALLY AROUSING EXPERIENCES
McGaugh, J. L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144157 · Cited by 2,296
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 1×
“For example, one biologically inspired model of action selection is called the leaky competing accumulator (LCA) model of choice (Bogacz et al., 2007; Usher & McClelland, 2001).”
BackgroundBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762
Sarter, M., Hasselmo, M. E., Bruno, J. P., & Givens, B. (2005) · Brain Research Reviews · doi:10.1016/j.brainresrev.2004.08.006 · Cited by 667
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · cited 1×
“Kenji Doya and colleagues have proposed a theory that encompasses multiple neuromodulatory systems (Doya, 2002, 2008).”
BackgroundNeural basis of deciding, choosing and acting
Schall, J. D. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049054 · Cited by 528
Cited by
Tuning pathological brain oscillations with neurofeedback: a systems neuroscience framework
Ros, T., J. Baars, B., Lanius, R. A., & Vuilleumier, P. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.01008 · Cited by 258
Biological underpinnings for lifelong learning machines
Kudithipudi, D., Aguilar-Simon, M., Babb, J., Bazhenov, M., Blackiston, D., Bongard, J., Brna, A. P., Chakravarthi Raja, S., Cheney, N., Clune, J., et al. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00452-0 · Cited by 236
Self-citationA neural network model of individual differences in task switching abilities
Herd, S. A., O׳Reilly, R. C., Hazy, T. E., Chatham, C. H., Brant, A. M., & Friedman, N. P. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.014 · Cited by 128
Social contracts and human–computer interaction with simulated adapting agents
Craig, A. B., Asher, D. E., Oros, N., Brewer, A. A., & Krichmar, J. L. (2013) · Adaptive Behavior · doi:10.1177/1059712313491612 · Cited by 9
Self-citation
Metadata
- Authors
- Krichmar, J. L.
- Venue
- Adaptive Behavior
- Publisher
- SAGE Publications
- Published
- 2008-12
- Volume
- 16
- Issue
- 6
- Pages
- 385-399
- ISSN
- 1059-7123 (ISSN-L)
- 1741-2633
- OpenAlex
- W2120536063
- Cited by
- 132
- References
- 20
- FWCI
- 16.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World. https://app.cochat.ai/papers/10.1177/1059712308095775
- The paper
- Krichmar, J. L. (2008). The Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World. Adaptive Behavior. https://doi.org/10.1177/1059712308095775
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.