Safety out of control: dopamine and defence
Open accessThe DOI matches its Crossref record; 122 of the 122 references it cites were found in a registry or an index.
Abstract
We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 1×
“A broad class of model-free RL methods, known as temporal difference (TD) methods, use inconsistencies in the values of sampled successive states—a TD prediction error signal—to improve estimates of state values [48].”
The Integrative Action of the Nervous System.
Sherrington, C. (1907) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-190734120-00021 · Cited by 4,136
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Dopamine receptors: from structure to function
MISSALE, C., NASH, S. R., ROBINSON, S. W., JABER, M., & CARON, M. G. (1998) · Physiological Reviews · doi:10.1152/physrev.1998.78.1.189 · Cited by 3,633
The tail suspension test: A new method for screening antidepressants in mice
Steru, L., Chermat, R., Thierry, B., & Simon, P. (1985) · Psychopharmacology · doi:10.1007/bf00428203 · Cited by 3,534
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 1×
“Relevant CSs have been described as acquiring ‘incentive salience’ [65, 92] or ‘incentive motivation’ [93], possibly via the way that their onset leads to TD errors that reflect state predictions [94].”
BackgroundD 1 and D 2 Dopamine Receptor-regulated Gene Expression of Striatonigral and Striatopallidal Neurons
Gerfen, C. R., Engber, T. M., Mahan, L. C., Susel, Z., Chase, T. N., Monsma, F. J., & Sibley, D. R. (1990) · Science · doi:10.1126/science.2147780 · Cited by 2,967
The physiology, signaling, and pharmacology of dopamine receptors
Beaulieu, J.-M., & Gainetdinov, R. R. (2011) · Pharmacological Reviews · doi:10.1124/pr.110.002642 · Cited by 2,763
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationLearned helplessness: Theory and evidence
Maier, S. F., & Seligman, M. E. (1976) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.105.1.3 · Cited by 2,494 · cited 1×
“This, of course, led to the concept of ‘learned helplessness’ [237].”
Background
Cited by
A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System
de Jong, J. W., Afjei, S. A., Pollak Dorocic, I., Peck, J. R., Liu, C., Kim, C. K., Tian, L., Deisseroth, K., & Lammel, S. (2019) · Neuron · doi:10.1016/j.neuron.2018.11.005 · Cited by 511
Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli
Menegas, W., Akiti, K., Amo, R., Uchida, N., & Watabe-Uchida, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0222-1 · Cited by 382
Agency and the Calibration of Motivated Behavior
Moscarello, J. M., & Hartley, C. A. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.06.008 · Cited by 137
Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P. (2017) · Brain · doi:10.1093/brain/awx025 · Cited by 124
“While there is abundant previous work on the mechanisms of reward learning, the mechanisms underlying punishment learning, i.e. learning to avoid punishment, is far less well understood (Lloyd and Dayan, 2016).”
BackgroundA possible evolutionary function of phenomenal conscious experience of pain
Kolodny, O., Moyal, R., & Edelman, S. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab012 · Cited by 31
Metadata
- Authors
- Lloyd, K., & Dayan, P.
- Venue
- Behavioral and Brain Functions
- Published
- 2016-05-23
- Volume
- 12
- Issue
- 1
- Pages
- 15-15
- ISSN
- 1744-9081 (ISSN-L)
- OpenAlex
- W2404197509
- Cited by
- 59
- References
- 122
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Safety out of control: dopamine and defence. https://app.cochat.ai/papers/10.1186/s12993-016-0099-7
- The paper
- Lloyd, K., & Dayan, P. (2016). Safety out of control: dopamine and defence. Behavioral and Brain Functions. https://doi.org/10.1186/s12993-016-0099-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.