Cited by 233Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorAnxiety, Depression, Psychometrics, Treatment, Cognitive Processes

The DOI matches its Crossref record; 361 of the 365 references it cites were found in a registry or an index.

Reinforcement learning in depression: A review of computational research

Chen, Chong, Takahashi, Taiki, Nakagawa, Shin, Inoue, Takeshi, Kusumi, Ichiro·2015·Neuroscience & Biobehavioral Reviews

DOI 10.1016/j.neubiorev.2015.05.005

Open this paper in CoChat — free account

Abstract

Despite being considered primarily a mood disorder, major depressive disorder (MDD) is characterized by cognitive and decision making deficits. Recent research has employed computational models of reinforcement learning (RL) to address these deficits. The computational approach has the advantage in making explicit predictions about learning and behavior, specifying the process parameters of RL, differentiating between model-free and model-based RL, and the computational model-based functional magnetic resonance imaging and electroencephalography. With these merits there has been an emerging field of computational psychiatry and here we review specific studies that focused on MDD. Considerable evidence suggests that MDD is associated with impaired brain signals of reward prediction error and expected value ('wanting'), decreased reward sensitivity ('liking') and/or learning (be it model-free or model-based), etc., although the causality remains unclear. These parameters may serve as valuable intermediate phenotypes of MDD, linking general clinical symptoms to underlying molecular dysfunctions. We believe future computational research at clinical, systems, and cellular/molecular/genetic levels will propel us toward a better understanding of the disease.

Integrity signals

Registry

Crossref · 10.1016/j.neubiorev.2015.05.005

Cites

361 of 361 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,720
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Untitled work
(2011) · Cited by 14,317
Feeling and thinking: Preferences need no inferences.
Zajonc, R. B. (1980) · American Psychologist · doi:10.1037/0003-066x.35.2.151 · Cited by 8,094
Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory
Shiffrin, R. M., & Schneider, W. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.127 · Cited by 7,335
Effects of stress throughout the lifespan on the brain, behaviour and cognition
Lupien, S. J., McEwen, B. S., Gunnar, M. R., & Heim, C. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2639 · Cited by 6,256
The Endophenotype Concept in Psychiatry: Etymology and Strategic Intentions
Gottesman, I. I., & Gould, T. D. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.4.636 · Cited by 5,615
Stress and the brain: from adaptation to disease
de Kloet, E. R., Joëls, M., & Holsboer, F. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1683 · Cited by 4,621
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Deep Brain Stimulation for Treatment-Resistant Depression
Mayberg, H. S., Lozano, A. M., Voon, V., McNeely, H. E., Seminowicz, D., Hamani, C., Schwalb, J. M., & Kennedy, S. H. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.014 · Cited by 4,059
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Stress signalling pathways that impair prefrontal cortex structure and function
Arnsten, A. F. T. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2648 · Cited by 3,299
Depression: Causes and treatment
Beck, A. T. (1973) · Behavior Therapy · doi:10.1016/s0005-7894(73)80054-1 · Cited by 3,163
Stress and Depression
Hammen, C. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143938 · Cited by 2,979
Integration of the cognitive and the psychodynamic unconscious
Epstein, S. (1994) · American Psychologist · doi:10.1037/0003-066x.49.8.709 · Cited by 2,883
The physiology, signaling, and pharmacology of dopamine receptors
Beaulieu, J.-M., & Gainetdinov, R. R. (2011) · Pharmacological Reviews · doi:10.1124/pr.110.002642 · Cited by 2,763
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Learned helplessness: Theory and evidence
Maier, S. F., & Seligman, M. E. (1976) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.105.1.3 · Cited by 2,494
Cognition and Depression: Current Status and Future Directions
Gotlib, I. H., & Joormann, J. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.121208.131305 · Cited by 2,420
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
The mesolimbic dopamine reward circuit in depression
Nestler, E. J., & Carlezon, W. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.018 · Cited by 2,059
Animal models of neuropsychiatric disorders
Nestler, E. J., & Hyman, S. E. (2010) · Nature Neuroscience · doi:10.1038/nn.2647 · Cited by 2,023
Dissecting components of reward: ‘liking’, ‘wanting’, and learning
Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2008.12.014 · Cited by 1,942
The brain reward circuitry in mood disorders
Russo, S. J., & Nestler, E. J. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3381 · Cited by 1,870
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774
Central role of the brain in stress and adaptation: Links to socioeconomic status, health, and disease
McEwen, B. S., & Gianaros, P. J. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.05331.x · Cited by 1,715
Modulation of Striatal Projection Systems by Dopamine
Gerfen, C. R., & Surmeier, D. J. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113641 · Cited by 1,700
Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: A meta-analysis and review.
Snyder, H. R. (2013) · Psychological Bulletin · doi:10.1037/a0028727 · Cited by 1,667
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Neurocircuitry of Mood Disorders
Price, J. L., & Drevets, W. C. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.104 · Cited by 1,606
New approaches to antidepressant drug discovery: beyond monoamines
Berton, O., & Nestler, E. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1846 · Cited by 1,589
Reconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579
SUBJECTIVE PROBABILITY AND DELAY
Rachlin, H., Raineri, A., & Cross, D. (1991) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1991.55-233 · Cited by 1,341
Structure and function of declarative and nondeclarative memory systems
Squire, L. R., & Zola, S. M. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.24.13515 · Cited by 1,327
Input-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300
The role of dopamine in the pathophysiology of depression
Dunlop, B. W., & Nemeroff, C. B. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.3.327 · Cited by 1,244
Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder
Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232
States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Rapid regulation of depression-related behaviours by control of midbrain dopamine neurons
Chaudhury, D., Walsh, J. J., Friedman, A. K., Juarez, B., Ku, S. M., Koo, J. W., Ferguson, D., Tsai, H.-C., Pomeranz, L., Christoffel, D. J., et al. (2013) · Nature · doi:10.1038/nature11713 · Cited by 1,156
Depression, Stress, and Anhedonia: Toward a Synthesis and Integrated Model
Pizzagalli, D. A. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185606 · Cited by 1,155
The neurobiology of anhedonia and other reward-related deficits
Der-Avakian, A., & Markou, A. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2011.11.005 · Cited by 1,130
The Brain on Stress: Vulnerability and Plasticity of the Prefrontal Cortex over the Life Course
McEwen, B. S., & Morrison, J. H. (2013) · Neuron · doi:10.1016/j.neuron.2013.06.028 · Cited by 1,079
Dopamine neurons modulate neural encoding and expression of depression-related behaviour
Tye, K. M., Mirzabekov, J. J., Warden, M. R., Ferenczi, E. A., Tsai, H.-C., Finkelstein, J., Kim, S.-Y., Adhikari, A., Thompson, K. R., Andalman, A. S., et al. (2013) · Nature · doi:10.1038/nature11740 · Cited by 1,073
Catechol-O-methyltransferase (COMT): biochemistry, molecular biology, pharmacology, and clinical efficacy of the new selective COMT inhibitors
Männistö, P. T., & Kaakkola, S. (1999) · Pharmacological Reviews · doi:10.1016/s0031-6997(24)01423-6 · Cited by 1,068
Deep Brain Stimulation to Reward Circuitry Alleviates Anhedonia in Refractory Major Depression
Schlaepfer, T. E., Cohen, M. X., Frick, C., Kosel, M., Brodesser, D., Axmacher, N., Joe, A. Y., Kreft, M., Lenartz, D., & Sturm, V. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301408 · Cited by 1,027
Subcallosal cingulate gyrus deep brain stimulation for treatment-resistant depression
Lozano, A. M., Mayberg, H. S., Giacobbe, P., Hamani, C., Craddock, R. C., & Kennedy, S. H. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.034 · Cited by 1,024
Neuroeconomics: decision making and the brain
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5702 · Cited by 1,020
Decision making under stress: A selective review
Starcke, K., & Brand, M. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.02.003 · Cited by 997
Cortico-Basal Ganglia Reward Network: Microcircuitry
Sesack, S. R., & Grace, A. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.93 · Cited by 985
Handbook of depression
Gotlib, I. H., & Hammen, C. L. (2002) · Cited by 980
Goals and Habits in the Brain
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
The Neuropsychopharmacology of Fronto-Executive Function: Monoaminergic Modulation
Robbins, T. W., & Arnsten, A. F. T. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135535 · Cited by 957
A meta-analysis of depression severity and cognitive function
McDermott, L. M., & Ebmeier, K. P. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.04.022 · Cited by 956
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955
The reward positivity: From basic research on reward to a biomarker for depression
Proudfit, G. H. (2015) · Psychophysiology · doi:10.1111/psyp.12370 · Cited by 910
Deep Brain Stimulation of the Ventral Capsule/Ventral Striatum for Treatment-Resistant Depression
Malone, D. A., Dougherty, D. D., Rezai, A. R., Carpenter, L. L., Friehs, G. M., Eskandar, E. N., Rauch, S. L., Rasmussen, S. A., Machado, A. G., Kubu, C. S., et al. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.08.029 · Cited by 897
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Stress dysregulation of drug reward pathways, and the transition to drug dependence
Koob, & Kreek, M. J. (2007) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.05030503 · Cited by 868
Nucleus Accumbens Deep Brain Stimulation Decreases Ratings of Depression and Anxiety in Treatment-Resistant Depression
Bewernick, B. H., Hurlemann, R., Matusch, A., Kayser, S., Grubert, C., Hadrysiewicz, B., Axmacher, N., Lemke, M., Cooper-Mahkorn, D., Cohen, M. X., et al. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.09.013 · Cited by 865
Computational psychiatry
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
The Origins and Current Status of Behavioral Activation Treatments for Depression
Dimidjian, S., Barrera, M., Martell, C., Muñoz, R. F., & Lewinsohn, P. M. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104535 · Cited by 785
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 775
Worth the ‘EEfRT’? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769
Dopaminergic modulation of synaptic transmission in cortex and striatum
Tritsch, N. X., & Sabatini, B. L. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.023 · Cited by 756
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 746
A meta-analysis of cognitive deficits in first-episode Major Depressive Disorder
Lee, R. S. C., Hermens, D. F., Porter, M. A., & Redoblado-Hodge, M. A. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.10.023 · Cited by 737
Stressor controllability and learned helplessness: the roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor.
Maier, S. F., & Watkins, L. R. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.021 · Cited by 737
Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia
Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028813 · Cited by 733
Complexity of dopamine metabolism
Meiser, J., Weindl, D., & Hiller, K. (2013) · Cell Communication and Signaling · doi:10.1186/1478-811x-11-34 · Cited by 726
Rational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722
From prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700
Working memory improvement with non-invasive brain stimulation of the dorsolateral prefrontal cortex: A systematic review and meta-analysis
Brunoni, A. R., & Vanderhasselt, M.-A. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2014.01.008 · Cited by 669
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653
Modulators of decision making
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
The role of D2-autoreceptors in regulating dopamine neuron activity and transmission
Ford, C. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.01.025 · Cited by 630
Antidepressant effect of optogenetic stimulation of the medial prefrontal cortex
Covington, H. E., Lobo, M. K., Maze, I., Vialou, V., Hyman, J. M., Zaman, S., LaPlant, Q., Mouzon, E., Ghose, S., Tamminga, C. A., et al. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1731-10.2010 · Cited by 621
Response, remission and drop-out rates following high-frequency repetitive transcranial magnetic stimulation (rTMS) for treating major depression: a systematic review and meta-analysis of randomized, double-blind and sham-controlled trials
Berlim, M. T., van den Eynde, F., Tovar-Perdomo, S., & Daskalakis, Z. J. (2014) · Psychological Medicine · doi:10.1017/s0033291713000512 · Cited by 620
On the ERN and the significance of errors
Hajcak, G., Moser, J. S., Yeung, N., & Simons, R. F. (2005) · Psychophysiology · doi:10.1111/j.1469-8986.2005.00270.x · Cited by 608
Subcallosal Cingulate Deep Brain Stimulation for Treatment-Resistant Unipolar and Bipolar Depression
Holtzheimer, P. E. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1456 · Cited by 608
The error-related negativity (ERN) and psychopathology: Toward an endophenotype
Olvet, D. M., & Hajcak, G. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.07.003 · Cited by 607
Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal.
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 596
Elevated Monoamine Oxidase A Levels in the Brain: An Explanation for the Monoamine Imbalance of Major Depression
Meyer, J. H., Ginovart, N., Boovariwala, A., Sagrati, S., Hussey, D., Garcia, A., Young, T., Praschak-Rieder, N., Wilson, A. A., & Houle, S. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1209 · Cited by 585
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 581
Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice
Walsh, M. M., & Anderson, J. R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.05.008 · Cited by 577
Reward and Punishment Processing in Depression
Eshel, N., & Roiser, J. P. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.01.027 · Cited by 575
Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance
Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.05.003 · Cited by 557
Opioid receptors: Distinct roles in mood disorders
Lutz, P.-E., & Kieffer, B. L. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2012.11.002 · Cited by 542
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Preuschoff, K. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00115 · Cited by 538
Cognitive Mechanisms of Treatment in Depression
Roiser, J. P., Elliott, R., & Sahakian, B. J. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.183 · Cited by 535
Socioeconomic status and structural brain development
Brito, N. H., & Noble, K. G. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00276 · Cited by 525
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O’Doherty, J. P., Hampton, A. N., & Kim, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 525
What is behavioral activation?
Kanter, J. W., Manos, R. C., Bowe, W. M., Baruch, D. E., Busch, A. M., & Rusch, L. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.04.001 · Cited by 515
Neural Responses to Monetary Incentives in Major Depression
Knutson, B., Bhanji, J. P., Cooney, R. E., Atlas, L. Y., & Gotlib, I. H. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.07.023 · Cited by 496
Working-memory capacity protects model-based learning from stress
Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A., & Daw, N. D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312011110 · Cited by 490
Expected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485
Enhancing depression mechanisms in midbrain dopamine neurons achieves homeostatic resilience
Friedman, A. K., Walsh, J. J., Juarez, B., Ku, S. M., Chaudhury, D., Wang, J., Li, X., Dietz, D. M., Pan, N., Vialou, V. F., et al. (2014) · Science · doi:10.1126/science.1249240 · Cited by 484
Neural correlates of dysfunctional emotion regulation in major depressive disorder. A systematic review of neuroimaging studies
Rive, M. M., van Rooijen, G., Veltman, D. J., .Phillips, M. L., Schene, A. H., & Ruhé, H. G. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.07.018 · Cited by 481
Deep brain stimulation for treatment-resistant depression: follow-up after 3 to 6 years
Kennedy, S. H., Giacobbe, P., Rizvi, S. J., Placenza, F. M., Nishikawa, Y., Mayberg, H. S., & Lozano, A. M. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10081187 · Cited by 481
Chronic Stress Induces Impairment of Spatial Working Memory Because of Prefrontal Dopaminergic Dysfunction
Mizoguchi, K., Yuzurihara, M., Ishige, A., Sasaki, H., Chui, D.-H., & Tabira, T. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-04-01568.2000 · Cited by 481
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480
Reduced Reward Learning Predicts Outcome in Major Depressive Disorder
Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P. A., de Boer, P., Schmidt, M. E., & Claes, S. J. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.10.014 · Cited by 463
Reward processing by the lateral habenula in normal and depressive behaviors
Proulx, C. D., Hikosaka, O., & Malinow, R. (2014) · Nature Neuroscience · doi:10.1038/nn.3779 · Cited by 461
Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J. R., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 460
Defining critical white matter pathways mediating successful subcallosal cingulate deep brain stimulation for treatment-resistant depression
Riva-Posse, P., Choi, K. S., Holtzheimer, P. E., McIntyre, C. C., Gross, R. E., Chaturvedi, A., Crowell, A. L., Garlow, S. J., Rajendra, J. K., & Mayberg, H. S. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.03.029 · Cited by 460
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Neurocognitive Mechanisms in Depression: Implications for Treatment
Clark, L., Chamberlain, S. R., & Sahakian, B. J. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125618 · Cited by 446
Behavioral activation treatments for depression in adults: A meta-analysis and review.
Mazzucchelli, T., Kane, R., & Rees, C. (2009) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01178.x · Cited by 438
From Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429
Treatment-resistant depression: Definitions, review of the evidence, and algorithmic approach
McIntyre, R. S., Filteau, M.-J., Martin, L., Patry, S., Carvalho, A., Cha, D. S., Barakat, M., & Miguelez, M. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.043 · Cited by 421
Linking cognitive aging to alterations in dopamine neurotransmitter functioning: Recent data and future avenues
Bäckman, L., Lindenberger, U., Li, S.-C., & Nyberg, L. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.12.008 · Cited by 414
Dissecting the diversity of midbrain dopamine neurons
Roeper, J. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2013.03.003 · Cited by 395
Anticipatory pleasure predicts motivation for reward in major depression.
Sherdell, L., Waugh, C. E., & Gotlib, I. H. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0024945 · Cited by 394
Regulation of Human Affective Responses by Anterior Cingulate and Limbic µ-Opioid Neurotransmission
Zubieta, J., Ketter, T. A., Bueller, J. A., Xu, Y., Kilbourn, M. R., Young, E. A., & Koeppe, R. A. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.11.1145 · Cited by 390
Dopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381
The ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380
Dialogues on prediction errors
Niv, Y., & Schoenbaum, G. M. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.03.006 · Cited by 377
A habit-goal framework of depressive rumination.
Watkins, E. R., & Nolen–Hoeksema, S. (2014) · Journal of Abnormal Psychology · doi:10.1037/a0035540 · Cited by 374
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374
Hippocampal Representation of Related and Opposing Memories Develop within Distinct, Hierarchically Organized Neural Schemas
McKenzie, S., Frank, A. J., Kinsky, N. R., Porter, B., Rivière, P. D., & Eichenbaum, H. (2014) · Neuron · doi:10.1016/j.neuron.2014.05.019 · Cited by 373
Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control
de Wit, S., Watson, P., Harsay, H. A., Cohen, M. X., van de Vijver, I., & Ridderinkhof, K. R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1088-12.2012 · Cited by 373
Long-term effects of nucleus accumbens deep brain stimulation in treatment-resistant depression: Evidence for sustained efficacy
Bewernick, B. H., Kayser, S., Sturm, V., & Schlaepfer, T. E. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.44 · Cited by 371
Deep Brain Stimulation for Treatment-Resistant Depression: Follow-Up After 3 to 6Years
Ballenger, J. C. (2012) · Yearbook of Psychiatry and Applied Mental Health · doi:10.1016/j.ypsy.2011.08.041 · Cited by 365
The place of dopamine in the cortico-basal ganglia circuit
Haber, S. N. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.10.008 · Cited by 364
Anhedonia and Reward-Circuit Connectivity Distinguish Nonresponders from Responders to Dorsomedial Prefrontal Repetitive Transcranial Magnetic Stimulation in Major Depression
Downar, J. H., Geraci, J., Salomons, T. V., Dunlop, K., Wheeler, S. M., McAndrews, M. P., Bakker, N., Blumberger, D. M., Daskalakis, Z. J., Kennedy, S. H., et al. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.10.026 · Cited by 362
A multicenter pilot study of subcallosal cingulate area deep brain stimulation for treatment-resistant depression: Clinical article
Lozano, A. M., Giacobbe, P., Hamani, C., Rizvi, S. J., Kennedy, S. H., Kolivakis, T. T., Debonnel, G., Sadikot, A. F., Lam, R. W., Howard, A. K., et al. (2012) · Journal of Neurosurgery · doi:10.3171/2011.10.jns102122 · Cited by 356
The neural correlates of reward-related processing in major depressive disorder: A meta-analysis of functional magnetic resonance imaging studies
Zhang, W.-N., Chang, S.-H., Guo, L.-Y., Zhang, K.-L., & Wang, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.039 · Cited by 355
Role of the dopaminergic system in depression
Kapur, S., & Mann, J. J. (1992) · Biological Psychiatry · doi:10.1016/0006-3223(92)90137-o · Cited by 350
Research review: altered reward function in adolescent depression: what, when and how?
Forbes, E. E., & Dahl, R. E. (2012) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02477.x · Cited by 350
Repetitive Transcranial Magnetic Stimulation for Treatment-Resistant Depression: A Systematic Review and Meta-Analysis
Gaynes, B. N., Lloyd, S. W., Lux, L., Gartlehner, G., Hansen, R. A., Brode, S., Jonas, D. E., Evans, T. S., Viswanathan, M., & Lohr, K. N. (2014) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.13r08815 · Cited by 347
Dysregulation of Endogenous Opioid Emotion Regulation Circuitry in Major Depression in Women
Kennedy, S. E., Koeppe, R. A., Young, E. A., & Zubieta, J. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1199 · Cited by 344
Structural and functional alterations to rat medial prefrontal cortex following chronic restraint stress and recovery
Goldwater, D. S., Pavlides, C., Hunter, R. G., Bloss, E. B., Hof, P. R., McEwen, B. S., & Morrison, J. H. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.08.053 · Cited by 333
The mesoaccumbens dopamine in coping with stress
Cabib, S., & Puglisi-Allegra, S. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.012 · Cited by 329
Vesicular neurotransmitter transporters: from bacteria to humans.
Schuldiner, S., Shirvan, A., & Linial, M. (1995) · Physiological Reviews · doi:10.1152/physrev.1995.75.2.369 · Cited by 329
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326
Antidepressant-Like Effects of Medial Prefrontal Cortex Deep Brain Stimulation in Rats
Hamani, C., Diwan, M., Macedo, C. E., Brandão, M. L., Shumake, J., Gonzalez-Lima, F., Raymond, R., Lozano, A. M., Fletcher, P. J., & Nobrega, J. N. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.08.025 · Cited by 324
A meta-analysis of neuropsychological markers of vulnerability to suicidal behavior in mood disorders
Richard-Devantoy, S., Berlim, M. T., & Jollant, F. (2014) · Psychological Medicine · doi:10.1017/s0033291713002304 · Cited by 324
Contributions of the striatum to learning, motivation, and performance: an associative account
Liljeholm, M., & O’Doherty, J. P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.007 · Cited by 317
Functional brain imaging studies of youth depression: A systematic review
Kerestes, R., Davey, C. G., Stephanou, K., Whittle, S., & Harrison, B. J. (2013) · NeuroImage Clinical · doi:10.1016/j.nicl.2013.11.009 · Cited by 317
Blunted neural response to rewards prospectively predicts depression in adolescent girls
Bress, J. N., Foti, D., Kotov, R., Klein, D. N., & Hajcak, G. (2013) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01485.x · Cited by 317
Exploring the roles of approach and avoidance in depression: An integrative model
Trew, J. L. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.07.007 · Cited by 316
A Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299
Dopamine release in the basal ganglia
Rice, M. E., Patel, J. C., & Cragg, S. J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.08.066 · Cited by 295
Stress-induced modulation of instrumental behavior: From goal-directed to habitual control of action
Schwabe, L., & Wolf, O. T. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.12.038 · Cited by 295
THE ROLE OF VESICULAR TRANSPORT PROTEINS IN SYNAPTIC TRANSMISSION AND NEURAL DEGENERATION
Liu, Y., & Edwards, R. H. (1997) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.20.1.125 · Cited by 295
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294
β-Caryophyllene, a CB2 receptor agonist produces multiple behavioral changes relevant to anxiety and depression in mice
Bahi, A., Al Mansouri, S., Al Memari, E., Al Ameri, M., Nurulain, S. M., & Ojha, S. (2014) · Physiology & Behavior · doi:10.1016/j.physbeh.2014.06.003 · Cited by 291
Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., & Siegle, G. J. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.75 · Cited by 289
Emotion and decision-making: affect-driven belief systems in anxiety and depression
Paulus, M. P., & Yu, A. J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.009 · Cited by 287
Dopamine-Mediated Reinforcement Learning Signals in the Striatum and Ventromedial Prefrontal Cortex Underlie Value-Based Choices
Jocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278
Neurobehavioral evidence for changes in dopamine system activity during adolescence
Wahlstrom, D., White, T., & Luciana, M. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.12.007 · Cited by 277
Stress models of depression: forming genetically vulnerable strains
Henn, F. A., & Vollmayr, B. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.019 · Cited by 274
Serotonergic Systems, Anxiety, and Affective Disorder
Lowry, C. A., Hale, M. W., Evans, A. K., Heerkens, J., Staub, D. R., Gasser, P. J., & Shekhar, A. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1410.004 · Cited by 274
Serotonin and beyond: therapeutics for major depression
Blier, P., & Mansari, M. E. (2013) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2012.0536 · Cited by 271
Amping Up Effort: Effects ofd-Amphetamine on Human Effort-Based Decision-Making
Wardle, M. C., Treadway, M. T., Mayo, L. M., Zald, D. H., & de Wit, H. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4387-11.2011 · Cited by 271
Dopamine restores reward prediction errors in old age
Chowdhury, R., Guitart‐Masip, M., Lambert, C., Dayan, P., Huys, Q. J. M., Düzel, E., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3364 · Cited by 267
Update on the pharmacology of selective inhibitors of MAO-A and MAO-B: Focus on modulation of CNS monoamine neurotransmitter release
Finberg, J. P. M. (2014) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2014.02.010 · Cited by 263
Role of kappa-opioid receptors in stress and anxiety-related behavior
Veer, A. V., & Carlezon, W. A. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3195-5 · Cited by 262
Blunted response to feedback information in depressive illness
Steele, J. D., Kumar, P., & Ebmeier, K. P. (2007) · Brain · doi:10.1093/brain/awm150 · Cited by 261
Computational approaches to psychiatry
Stephan, K. E., & Mathys, C. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.007 · Cited by 260
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
Pramipexole versus sertraline in the treatment of depression in Parkinson’s disease
Barone, P., Scarzella, L., Marconi, R., Antonini, A., Morgante, F., Bracco, F., Zappia, M., Musch, B., & and the Depression/Parkinson Italian Study Group (2006) · Journal of Neurology · doi:10.1007/s00415-006-0067-5 · Cited by 247
Representation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246
Regional alterations in the endocannabinoid system in an animal model of depression: effects of concurrent antidepressant treatment
Hill, M. N., Carrier, E. J., McLaughlin, R. J., Morrish, A. C., Meier, S. E., Hillard, C. J., & Gorzalka, B. B. (2008) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2008.05567.x · Cited by 246
The role of the brain reward system in depression
Naranjo, C. A., Tremblay, L. K., & Busto, U. E. (2001) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/s0278-5846(01)00156-7 · Cited by 245
Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans
Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D., & Dolan, R. J. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.009 · Cited by 244
Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis
Chase, H. W., Kumar, P., Eickhoff, S. B., & Dombrovski, A. Y. (2015) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-015-0338-7 · Cited by 242
Parsing Anhedonia
Treadway, M. T., & Zald, D. H. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412474460 · Cited by 241
Deep brain stimulation of the subcallosal cingulate gyrus: further evidence in treatment-resistant major depression
Puigdemont, D., Pérez‐Egea, R., Portella, M. J., Molet, J., de Diego-Adeliño, J., Gironell, A., Raduà, J., Gómez‐Ansón, B., Rodríguez, R. R., Serra-Blasco, M., et al. (2011) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145711001088 · Cited by 238
The Neural Network Underlying Incentive-Based Learning: Implications for Interpreting Circuit Disruptions in Psychiatric Disorders
Haber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230
How Dopamine Enhances an Optimism Bias in Humans
Sharot, T., Guitart‐Masip, M., Korn, C. W., Chowdhury, R., & Dolan, R. J. (2012) · Current Biology · doi:10.1016/j.cub.2012.05.053 · Cited by 227
Contributions of the ventromedial prefrontal cortex to goal-directed action selection
O’Doherty, J. P. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06290.x · Cited by 225
Restoring Mood Balance in Depression: Ketamine Reverses Deficit in Dopamine-Dependent Synaptic Plasticity
Belujon, P., & Grace, A. A. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.04.014 · Cited by 225
Depression: a decision-theoretic analysis
Huys, Q. J. M., Daw, N. D., & Dayan, P. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-033928 · Cited by 221
Atypical Depression: A Reappraisal
Parker, G. B., Roy, K., Mitchell, P. B., Wilhelm, K. A., Malhi, G. S., & Hadži-Pavlović, D. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.9.1470 · Cited by 220
The dorsal raphe nucleus—From silver stainings to a role in depression
Michelsen, K. A., Schmitz, C., & Steinbusch, H. W. M. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.01.002 · Cited by 214
Noradrenergic modulation of cognition: Therapeutic implications
Chamberlain, S. R., & Robbins, T. W. (2013) · Journal of Psychopharmacology · doi:10.1177/0269881113480988 · Cited by 211
Corticostriatal Output Gating during Selection from Working Memory
Chatham, C. H., Frank, M. J., & Badre, D. (2014) · Neuron · doi:10.1016/j.neuron.2014.01.002 · Cited by 207
Model-Based Cognitive Neuroscience Approaches to Computational Psychiatry
Wiecki, T. V., Poland, J. S., & Frank, M. J. (2015) · Clinical Psychological Science · doi:10.1177/2167702614565359 · Cited by 207
Lethal forethought: delayed reward discounting differentiates high-and low-lethality suicide attempts in old age
Dombrovski, A. Y., Szanto, K., Siegle, G. J., Wallace, M. L., Forman, S. D., Sahakian, B., Reynolds, C. F., & Clark, L. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.12.025 · Cited by 198
The lateral habenula in addiction and depression: an anatomical, synaptic and behavioral overview
Lecca, S., Meye, F. J., & Mameli, M. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12480 · Cited by 196
Depression‐resistant endophenotype in mice overexpressing cannabinoid CB 2 receptors
García‐Gutiérrez, M., Pérez‐Ortiz, J., Gutiérrez‐Adán, A., & Manzanares, J. (2010) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2010.00819.x · Cited by 196
Approach and avoidance learning in patients with major depression and healthy controls: relation to anhedonia
Chase, H., Frank, M., Michael, A., Bullmore, E., Sahakian, B., & Robbins, T. (2009) · Psychological Medicine · doi:10.1017/s0033291709990468 · Cited by 194
Reward/punishment reversal learning in older suicide attempters
Dombrovski, A. Y., Clark, L., Siegle, G. J., Butters, M. A., Ichikawa, N., Sahakian, B. J., & Szanto, K. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09030407 · Cited by 193
Depression: from psychopathology to pathophysiology
Belzung, C., Willner, P., & Philippot, P. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.08.013 · Cited by 192
Impacts of stress and sex hormones on dopamine neurotransmission in the adolescent brain
Sinclair, D., Purves-Tyson, T. D., Allen, K. M., & Weickert, C. S. (2014) · Psychopharmacology · doi:10.1007/s00213-013-3415-z · Cited by 191
Cannabinoid receptor 1 (CNR1) gene: Impact on antidepressant treatment response and emotion processing in Major Depression
Domschke, K., Dannlowski, U., Ohrmann, P., Lawford, B. R., Bauer, J., Kugel, H., Heindel, W. L., Young, R. M., Morris, C. P., Arolt, V., et al. (2008) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2008.05.003 · Cited by 189
An update on the connections of the ventral mesencephalic dopaminergic complex
Yetnikoff, L., Lavezzi, H. N., Reichard, R. A., & Zahm, D. S. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.04.010 · Cited by 189
Neural response to reward as a predictor of increases in depressive symptoms in adolescence
Morgan, J. K., Olino, T. M., McMakin, D. L., Ryan, N. D., & Forbes, E. E. (2013) · Neurobiology of Disease · doi:10.1016/j.nbd.2012.03.039 · Cited by 185
Mapping brain circuits of reward and motivation: In the footsteps of Ann Kelley
Richard, J. M., Castro, D. C., DiFeliceantonio, A. G., Robinson, M. J. F., & Berridge, K. C. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.12.008 · Cited by 183
Intermediate phenotypes in psychiatric disorders
Rasetti, R., & Weinberger, D. R. (2011) · Current Opinion in Genetics & Development · doi:10.1016/j.gde.2011.02.003 · Cited by 181
Functional Expression of Brain Neuronal CB2 Cannabinoid Receptors Are Involved in the Effects of Drugs of Abuse and in Depression
Onaivi, E. S., Ishiguro, H., Gong, J., Sejal, P., Meozzi, P. A., Myers, L., Perchuk, A., Mora, Z., Tagliaferro, P. A., Gardner, E., et al. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1432.036 · Cited by 181
Decision Making: From Neuroscience to Psychiatry
Lee, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.008 · Cited by 178

Research works printed but not linked: 1

Takahashi, 2007, Salivary alpha-amylase levels and hyperbolic discounting in male humans, Neuroendocrinol. Lett., 28, 17

Sorted by citations

Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model
Price, R. B., & Duman, R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0615-x · Cited by 739
The orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474
HPA Axis in the Pathomechanism of depression and schizophrenia: new therapeutic strategies based on its participation
Mikulska, J., Juszczyk, G., Gawrońska-Grzywacz, M., & Herbet, M. (2021) · Brain Sciences · doi:10.3390/brainsci11101298 · Cited by 450
Mental illness and well‐being: an affect regulation perspective
Gross, J. J., Uusberg, H., & Uusberg, A. (2019) · World Psychiatry · doi:10.1002/wps.20618 · Cited by 277
Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments
Avery, M. C., & Krichmar, J. L. (2017) · Frontiers in Neural Circuits · doi:10.3389/fncir.2017.00108 · Cited by 250

See all 233

Authors: Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I.
Affiliations: Hokkaido University (JP)
Corresponding author: Chen, Chong
ORCID: Chen, Chong
Nakagawa, Shin
Inoue, Takeshi
Kusumi, Ichiro
Venue: Neuroscience & Biobehavioral Reviews
Publisher: Elsevier BV
Published: 2015-08
Volume: 55
Pages: 247-267
ISSN: 0149-7634 (ISSN-L)
DOI: 10.1016/j.neubiorev.2015.05.005
OpenAlex: W291512641
Cited by: 233
References: 365
Citations by year: 2026: 17 · 2025: 26 · 2024: 34 · 2023: 31 · 2022: 29 · 2021: 19 · 2020: 17 · 2019: 20 · 2018: 10 · 2017: 14 · 2016: 11 · 2015: 4
FWCI: 1.29
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Neuroscience & Biobehavioral Reviews (publishedVersion)
PubMed (publishedVersion)
Funders: Ministry of Education, Culture, Sports, Science and Technology
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Keywords: major depressive disorder, reinforcement learning, computational psychiatry, model-free reinforcement learning, model-based reinforcement learning, reward prediction error, reward sensitivity, endophenotypes, decision-making deficits, cognitive deficits in depression
MeSH terms: Animals, Brain, Computer Simulation, Major Depressive Disorder, Humans, Motivation, Reinforcement, Psychology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Reinforcement learning in depression: A review of computational research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks