The DOI matches its Crossref record; 361 of the 365 references it cites were found in a registry or an index.
Reinforcement learning in depression: A review of computational research
Abstract
Despite being considered primarily a mood disorder, major depressive disorder (MDD) is characterized by cognitive and decision making deficits. Recent research has employed computational models of reinforcement learning (RL) to address these deficits. The computational approach has the advantage in making explicit predictions about learning and behavior, specifying the process parameters of RL, differentiating between model-free and model-based RL, and the computational model-based functional magnetic resonance imaging and electroencephalography. With these merits there has been an emerging field of computational psychiatry and here we review specific studies that focused on MDD. Considerable evidence suggests that MDD is associated with impaired brain signals of reward prediction error and expected value ('wanting'), decreased reward sensitivity ('liking') and/or learning (be it model-free or model-based), etc., although the causality remains unclear. These parameters may serve as valuable intermediate phenotypes of MDD, linking general clinical symptoms to underlying molecular dysfunctions. We believe future computational research at clinical, systems, and cellular/molecular/genetic levels will propel us toward a better understanding of the disease.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“People with depression frequently experience anhedonia, which may result in blunted sensitivity to reward [11-15].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [12]
In the citing paper
“Depression generally has been associated with hyposensitivity to rewards, particularly among those with anhedonic symptoms [11-13,16,17].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [12]
In the citing paper
“Their study was consistent with evidence that reward sensitivity and not learning rates are reduced in anhedonic depression (Huys et al., 2013; Chen et al., 2015).”
From The orbitofrontal cortex: reward, emotion and depression (2020) · cites this paper as Chen et al., 2015
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,720
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(2011) · Cited by 14,317
Feeling and thinking: Preferences need no inferences.
Zajonc, R. B. (1980) · American Psychologist · doi:10.1037/0003-066x.35.2.151 · Cited by 8,094
Shiffrin, R. M., & Schneider, W. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.127 · Cited by 7,335
Effects of stress throughout the lifespan on the brain, behaviour and cognition
Lupien, S. J., McEwen, B. S., Gunnar, M. R., & Heim, C. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2639 · Cited by 6,256
The Endophenotype Concept in Psychiatry: Etymology and Strategic Intentions
Gottesman, I. I., & Gould, T. D. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.4.636 · Cited by 5,615
Stress and the brain: from adaptation to disease
de Kloet, E. R., Joëls, M., & Holsboer, F. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1683 · Cited by 4,621
Research works printed but not linked: 1
- Takahashi, 2007, Salivary alpha-amylase levels and hyperbolic discounting in male humans, Neuroendocrinol. Lett., 28, 17
Cited by
Sorted by citations
Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model
Price, R. B., & Duman, R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0615-x · Cited by 739
The orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474
Mikulska, J., Juszczyk, G., Gawrońska-Grzywacz, M., & Herbet, M. (2021) · Brain Sciences · doi:10.3390/brainsci11101298 · Cited by 450
Mental illness and well‐being: an affect regulation perspective
Gross, J. J., Uusberg, H., & Uusberg, A. (2019) · World Psychiatry · doi:10.1002/wps.20618 · Cited by 277
Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments
Avery, M. C., & Krichmar, J. L. (2017) · Frontiers in Neural Circuits · doi:10.3389/fncir.2017.00108 · Cited by 250
Metadata
- Authors
- Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I.
- Affiliations
- Hokkaido University (JP)
- Corresponding author
- Chen, Chong
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2015-08
- Volume
- 55
- Pages
- 247-267
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W291512641
- Cited by
- 233
- References
- 365
- Citations by year
- 2026: 17 · 2025: 26 · 2024: 34 · 2023: 31 · 2022: 29 · 2021: 19 · 2020: 17 · 2019: 20 · 2018: 10 · 2017: 14 · 2016: 11 · 2015: 4
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuroscience & Biobehavioral Reviews (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Education, Culture, Sports, Science and Technology
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- major depressive disorder, reinforcement learning, computational psychiatry, model-free reinforcement learning, model-based reinforcement learning, reward prediction error, reward sensitivity, endophenotypes, decision-making deficits, cognitive deficits in depression
- MeSH terms
- Animals, Brain, Computer Simulation, Major Depressive Disorder, Humans, Motivation, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
