Reinforcement learning in depression: a review of computational research
Abstract
Despite being considered primarily a mood disorder, major depressive disorder (MDD) is characterized by cognitive and decision making deficits. Recent research has employed computational models of reinforcement learning (RL) to address these deficits. The computational approach has the advantage in making explicit predictions about learning and behavior, specifying the process parameters of RL, differentiating between model-free and model-based RL, and the computational model-based functional magnetic resonance imaging and electroencephalography. With these merits there has been an emerging field of computational psychiatry and here we review specific studies that focused on MDD. Considerable evidence suggests that MDD is associated with impaired brain signals of reward prediction error and expected value ('wanting'), decreased reward sensitivity ('liking') and/or learning (be it model-free or model-based), etc., although the causality remains unclear. These parameters may serve as valuable intermediate phenotypes of MDD, linking general clinical symptoms to underlying molecular dysfunctions. We believe future computational research at clinical, systems, and cellular/molecular/genetic levels will propel us toward a better understanding of the disease.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
People with depression frequently experience anhedonia, which may result in blunted sensitivity to reward.
“People with depression frequently experience anhedonia, which may result in blunted sensitivity to reward [11-15].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [12]
Depression generally has been associated with hyposensitivity to rewards, particularly among those with anhedonic symptoms.
“Depression generally has been associated with hyposensitivity to rewards, particularly among those with anhedonic symptoms [11-13,16,17].”
From Examining the effectiveness of gamification in mental health apps for depression: Systematic review and meta-analysis (2021) · cites this paper as [12]
Their study was consistent with evidence that reward sensitivity and not learning rates are reduced in anhedonic depression.
“Their study was consistent with evidence that reward sensitivity and not learning rates are reduced in anhedonic depression (Huys et al., 2013; Chen et al., 2015).”
From The orbitofrontal cortex: reward, emotion and depression (2020) · cites this paper as Chen et al., 2015
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524 · see citing works
Prospect theory: An analysis of decision under risk
Kahneman, D. J., & Tversky, A. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609220.014 · Cited by 32,700 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
(2011) · Cited by 14,317 · see citing works
Feeling and thinking: Preferences need no inferences.
Zajonc, R. B. (1980) · American Psychologist · doi:10.1037/0003-066x.35.2.151 · Cited by 8,094 · see citing works
Shiffrin, R. M., & Schneider, W. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.127 · Cited by 7,335 · see citing works
Effects of stress throughout the lifespan on the brain, behaviour and cognition
Lupien, S. J., McEwen, B. S., Gunnar, M. R., & Heim, C. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2639 · Cited by 6,256 · see citing works
The Endophenotype Concept in Psychiatry: Etymology and Strategic Intentions
Gottesman, I. I., & Gould, T. D. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.4.636 · Cited by 5,615 · see citing works
Stress and the brain: from adaptation to disease
de Kloet, E. R., Joëls, M., & Holsboer, F. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1683 · Cited by 4,621 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Deep Brain Stimulation for Treatment-Resistant Depression
Mayberg, H. S., Lozano, A. M., Voon, V., McNeely, H. E., Seminowicz, D., Hamani, C., Schwalb, J. M., & Kennedy, S. H. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.014 · Cited by 4,059 · see citing works
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718 · see citing works
Stress signalling pathways that impair prefrontal cortex structure and function
Arnsten, A. F. T. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2648 · Cited by 3,299 · see citing works
Depression: Causes and treatment
Beck, A. T. (1973) · Behavior Therapy · doi:10.1016/s0005-7894(73)80054-1 · Cited by 3,162 · see citing works
Hammen, C. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143938 · Cited by 2,979 · see citing works
Integration of the cognitive and the psychodynamic unconscious
Epstein, S. (1994) · American Psychologist · doi:10.1037/0003-066x.49.8.709 · Cited by 2,883 · see citing works
The physiology, signaling, and pharmacology of dopamine receptors
Beaulieu, J.-M., & Gainetdinov, R. R. (2011) · Pharmacological Reviews · doi:10.1124/pr.110.002642 · Cited by 2,763 · see citing works
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
Learned helplessness: Theory and evidence
Maier, S. F., & Seligman, M. E. (1976) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.105.1.3 · Cited by 2,494 · see citing works
Cognition and Depression: Current Status and Future Directions
Gotlib, I. H., & Joormann, J. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.121208.131305 · Cited by 2,420 · see citing works
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347 · see citing works
The mesolimbic dopamine reward circuit in depression
Nestler, E. J., & Carlezon, W. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.018 · Cited by 2,059 · see citing works
Animal models of neuropsychiatric disorders
Nestler, E. J., & Hyman, S. E. (2010) · Nature Neuroscience · doi:10.1038/nn.2647 · Cited by 2,023 · see citing works
Dissecting components of reward: ‘liking’, ‘wanting’, and learning
Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2008.12.014 · Cited by 1,942 · see citing works
The brain reward circuitry in mood disorders
Russo, S. J., & Nestler, E. J. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3381 · Cited by 1,870 · see citing works
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779 · see citing works
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · see citing works
McEwen, B. S., & Gianaros, P. J. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.05331.x · Cited by 1,715 · see citing works
Modulation of Striatal Projection Systems by Dopamine
Gerfen, C. R., & Surmeier, D. J. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113641 · Cited by 1,700 · see citing works
Snyder, H. R. (2013) · Psychological Bulletin · doi:10.1037/a0028727 · Cited by 1,667 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Neurocircuitry of Mood Disorders
Price, J. L., & Drevets, W. C. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.104 · Cited by 1,606 · see citing works
New approaches to antidepressant drug discovery: beyond monoamines
Berton, O., & Nestler, E. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1846 · Cited by 1,589 · see citing works
Reconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579 · see citing works
SUBJECTIVE PROBABILITY AND DELAY
Rachlin, H., Raineri, A., & Cross, D. (1991) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1991.55-233 · Cited by 1,341 · see citing works
Structure and function of declarative and nondeclarative memory systems
Squire, L. R., & Zola, S. M. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.24.13515 · Cited by 1,327 · see citing works
Input-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300 · see citing works
The role of dopamine in the pathophysiology of depression
Dunlop, B. W., & Nemeroff, C. B. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.3.327 · Cited by 1,244 · see citing works
Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · see citing works
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works
Rapid regulation of depression-related behaviours by control of midbrain dopamine neurons
Chaudhury, D., Walsh, J. J., Friedman, A. K., Juarez, B., Ku, S. M., Koo, J. W., Ferguson, D., Tsai, H.-C., Pomeranz, L., Christoffel, D. J., et al. (2013) · Nature · doi:10.1038/nature11713 · Cited by 1,156 · see citing works
Depression, Stress, and Anhedonia: Toward a Synthesis and Integrated Model
Pizzagalli, D. A. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185606 · Cited by 1,155 · see citing works
The neurobiology of anhedonia and other reward-related deficits
Der-Avakian, A., & Markou, A. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2011.11.005 · Cited by 1,130 · see citing works
The Brain on Stress: Vulnerability and Plasticity of the Prefrontal Cortex over the Life Course
McEwen, B. S., & Morrison, J. H. (2013) · Neuron · doi:10.1016/j.neuron.2013.06.028 · Cited by 1,079 · see citing works
Dopamine neurons modulate neural encoding and expression of depression-related behaviour
Tye, K. M., Mirzabekov, J. J., Warden, M. R., Ferenczi, E. A., Tsai, H.-C., Finkelstein, J., Kim, S.-Y., Adhikari, A., Thompson, K. R., Andalman, A. S., et al. (2013) · Nature · doi:10.1038/nature11740 · Cited by 1,073 · see citing works
Männistö, P. T., & Kaakkola, S. (1999) · Pharmacological Reviews · doi:10.1016/s0031-6997(24)01423-6 · Cited by 1,068 · see citing works
Deep Brain Stimulation to Reward Circuitry Alleviates Anhedonia in Refractory Major Depression
Schlaepfer, T. E., Cohen, M. X., Frick, C., Kosel, M., Brodesser, D., Axmacher, N., Joe, A. Y., Kreft, M., Lenartz, D., & Sturm, V. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301408 · Cited by 1,027 · see citing works
Subcallosal cingulate gyrus deep brain stimulation for treatment-resistant depression
Lozano, A. M., Mayberg, H. S., Giacobbe, P., Hamani, C., Craddock, R. C., & Kennedy, S. H. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.034 · Cited by 1,024 · see citing works
Neuroeconomics: decision making and the brain
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5702 · Cited by 1,020 · see citing works
Cortico-Basal Ganglia Reward Network: Microcircuitry
Sesack, S. R., & Grace, A. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.93 · Cited by 985 · see citing works
Gotlib, I. H., & Hammen, C. L. (2002) · Cited by 980 · see citing works
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
The Neuropsychopharmacology of Fronto-Executive Function: Monoaminergic Modulation
Robbins, T. W., & Arnsten, A. F. T. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135535 · Cited by 957 · see citing works
A meta-analysis of depression severity and cognitive function
McDermott, L. M., & Ebmeier, K. P. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.04.022 · Cited by 956 · see citing works
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955 · see citing works
The reward positivity: From basic research on reward to a biomarker for depression
Proudfit, G. H. (2015) · Psychophysiology · doi:10.1111/psyp.12370 · Cited by 910 · see citing works
Deep Brain Stimulation of the Ventral Capsule/Ventral Striatum for Treatment-Resistant Depression
Malone, D. A., Dougherty, D. D., Rezai, A. R., Carpenter, L. L., Friehs, G. M., Eskandar, E. N., Rauch, S. L., Rasmussen, S. A., Machado, A. G., Kubu, C. S., et al. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.08.029 · Cited by 897 · see citing works
Decision making under stress: A selective review
Starcke, K., & Brand, M. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.02.003 · Cited by 892 · see citing works
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885 · see citing works
Stress dysregulation of drug reward pathways, and the transition to drug dependence
Koob, & Kreek, M. J. (2007) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.05030503 · Cited by 868 · see citing works
Bewernick, B. H., Hurlemann, R., Matusch, A., Kayser, S., Grubert, C., Hadrysiewicz, B., Axmacher, N., Lemke, M., Cooper-Mahkorn, D., Cohen, M. X., et al. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.09.013 · Cited by 865 · see citing works
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809 · see citing works
The Origins and Current Status of Behavioral Activation Treatments for Depression
Dimidjian, S., Barrera, M., Martell, C., Muñoz, R. F., & Lewinsohn, P. M. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104535 · Cited by 785 · see citing works
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769 · see citing works
Dopaminergic modulation of synaptic transmission in cortex and striatum
Tritsch, N. X., & Sabatini, B. L. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.023 · Cited by 756 · see citing works
A meta-analysis of cognitive deficits in first-episode Major Depressive Disorder
Lee, R. S. C., Hermens, D. F., Porter, M. A., & Redoblado-Hodge, M. A. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.10.023 · Cited by 737 · see citing works
Maier, S. F., & Watkins, L. R. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.021 · Cited by 737 · see citing works
Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028813 · Cited by 733 · see citing works
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 724 · see citing works
Rational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722 · see citing works
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 715 · see citing works
From prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700 · see citing works
Brunoni, A. R., & Vanderhasselt, M.-A. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2014.01.008 · Cited by 669 · see citing works
Complexity of dopamine metabolism
Meiser, J., Weindl, D., & Hiller, K. (2013) · Cell Communication and Signaling · doi:10.1186/1478-811x-11-34 · Cited by 665 · see citing works
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · see citing works
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · see citing works
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634 · see citing works
Antidepressant effect of optogenetic stimulation of the medial prefrontal cortex
Covington, H. E., Lobo, M. K., Maze, I., Vialou, V., Hyman, J. M., Zaman, S., LaPlant, Q., Mouzon, E., Ghose, S., Tamminga, C. A., et al. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1731-10.2010 · Cited by 621 · see citing works
Berlim, M. T., van den Eynde, F., Tovar-Perdomo, S., & Daskalakis, Z. J. (2014) · Psychological Medicine · doi:10.1017/s0033291713000512 · Cited by 620 · see citing works
On the ERN and the significance of errors
Hajcak, G., Moser, J. S., Yeung, N., & Simons, R. F. (2005) · Psychophysiology · doi:10.1111/j.1469-8986.2005.00270.x · Cited by 608 · see citing works
Subcallosal Cingulate Deep Brain Stimulation for Treatment-Resistant Unipolar and Bipolar Depression
Holtzheimer, P. E. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1456 · Cited by 608 · see citing works
Meyer, J. H., Ginovart, N., Boovariwala, A., Sagrati, S., Hussey, D., Garcia, A., Young, T., Praschak-Rieder, N., Wilson, A. A., & Houle, S. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1209 · Cited by 585 · see citing works
The role of D2-autoreceptors in regulating dopamine neuron activity and transmission
Ford, C. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.01.025 · Cited by 584 · see citing works
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 578 · see citing works
Reward and Punishment Processing in Depression
Eshel, N., & Roiser, J. P. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.01.027 · Cited by 575 · see citing works
The error-related negativity (ERN) and psychopathology: Toward an endophenotype
Olvet, D. M., & Hajcak, G. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.07.003 · Cited by 574 · see citing works
Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.05.003 · Cited by 557 · see citing works
Opioid receptors: Distinct roles in mood disorders
Lutz, P.-E., & Kieffer, B. L. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2012.11.002 · Cited by 542 · see citing works
Neural Basis of Reinforcement Learning and Decision Making
Lee, D., Seo, H., & Jung, M. W. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150512 · Cited by 542 · see citing works
Walsh, M. M., & Anderson, J. R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.05.008 · Cited by 541 · see citing works
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Preuschoff, K. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00115 · Cited by 538 · see citing works
Cognitive Mechanisms of Treatment in Depression
Roiser, J. P., Elliott, R., & Sahakian, B. J. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.183 · Cited by 535 · see citing works
Socioeconomic status and structural brain development
Brito, N. H., & Noble, K. G. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00276 · Cited by 525 · see citing works
What is behavioral activation?
Kanter, J. W., Manos, R. C., Bowe, W. M., Baruch, D. E., Busch, A. M., & Rusch, L. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.04.001 · Cited by 515 · see citing works
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O’Doherty, J. P., Hampton, A. N., & Kim, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 509 · see citing works
Neural Responses to Monetary Incentives in Major Depression
Knutson, B., Bhanji, J. P., Cooney, R. E., Atlas, L. Y., & Gotlib, I. H. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.07.023 · Cited by 496 · see citing works
Expected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485 · see citing works
Enhancing depression mechanisms in midbrain dopamine neurons achieves homeostatic resilience
Friedman, A. K., Walsh, J. J., Juarez, B., Ku, S. M., Chaudhury, D., Wang, J., Li, X., Dietz, D. M., Pan, N., Vialou, V. F., et al. (2014) · Science · doi:10.1126/science.1249240 · Cited by 484 · see citing works
Rive, M. M., van Rooijen, G., Veltman, D. J., .Phillips, M. L., Schene, A. H., & Ruhé, H. G. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.07.018 · Cited by 481 · see citing works
Deep brain stimulation for treatment-resistant depression: follow-up after 3 to 6 years
Kennedy, S. H., Giacobbe, P., Rizvi, S. J., Placenza, F. M., Nishikawa, Y., Mayberg, H. S., & Lozano, A. M. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10081187 · Cited by 481 · see citing works
Mizoguchi, K., Yuzurihara, M., Ishige, A., Sasaki, H., Chui, D.-H., & Tabira, T. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-04-01568.2000 · Cited by 481 · see citing works
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480 · see citing works
Working-memory capacity protects model-based learning from stress
Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A., & Daw, N. D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312011110 · Cited by 472 · see citing works
Reward processing by the lateral habenula in normal and depressive behaviors
Proulx, C. D., Hikosaka, O., & Malinow, R. (2014) · Nature Neuroscience · doi:10.1038/nn.3779 · Cited by 461 · see citing works
Riva-Posse, P., Choi, K. S., Holtzheimer, P. E., McIntyre, C. C., Gross, R. E., Chaturvedi, A., Crowell, A. L., Garlow, S. J., Rajendra, J. K., & Mayberg, H. S. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.03.029 · Cited by 460 · see citing works
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456 · see citing works
Neurocognitive Mechanisms in Depression: Implications for Treatment
Clark, L., Chamberlain, S. R., & Sahakian, B. J. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125618 · Cited by 446 · see citing works
Reduced Reward Learning Predicts Outcome in Major Depressive Disorder
Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P. A., de Boer, P., Schmidt, M. E., & Claes, S. J. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.10.014 · Cited by 443 · see citing works
Behavioral activation treatments for depression in adults: A meta-analysis and review.
Mazzucchelli, T., Kane, R., & Rees, C. (2009) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01178.x · Cited by 438 · see citing works
Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J. R., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 430 · see citing works
From Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429 · see citing works
Treatment-resistant depression: Definitions, review of the evidence, and algorithmic approach
McIntyre, R. S., Filteau, M.-J., Martin, L., Patry, S., Carvalho, A., Cha, D. S., Barakat, M., & Miguelez, M. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.043 · Cited by 421 · see citing works
Bäckman, L., Lindenberger, U., Li, S.-C., & Nyberg, L. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.12.008 · Cited by 414 · see citing works
Dopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385 · see citing works
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381 · see citing works
The ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380 · see citing works
Regulation of Human Affective Responses by Anterior Cingulate and Limbic µ-Opioid Neurotransmission
Zubieta, J., Ketter, T. A., Bueller, J. A., Xu, Y., Kilbourn, M. R., Young, E. A., & Koeppe, R. A. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.11.1145 · Cited by 377 · see citing works
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374 · see citing works
McKenzie, S., Frank, A. J., Kinsky, N. R., Porter, B., Rivière, P. D., & Eichenbaum, H. (2014) · Neuron · doi:10.1016/j.neuron.2014.05.019 · Cited by 373 · see citing works
de Wit, S., Watson, P., Harsay, H. A., Cohen, M. X., van de Vijver, I., & Ridderinkhof, K. R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1088-12.2012 · Cited by 373 · see citing works
Dissecting the diversity of midbrain dopamine neurons
Roeper, J. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2013.03.003 · Cited by 372 · see citing works
Bewernick, B. H., Kayser, S., Sturm, V., & Schlaepfer, T. E. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.44 · Cited by 371 · see citing works
Anticipatory pleasure predicts motivation for reward in major depression.
Sherdell, L., Waugh, C. E., & Gotlib, I. H. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0024945 · Cited by 369 · see citing works
Deep Brain Stimulation for Treatment-Resistant Depression: Follow-Up After 3 to 6Years
Ballenger, J. C. (2012) · Yearbook of Psychiatry and Applied Mental Health · doi:10.1016/j.ypsy.2011.08.041 · Cited by 365 · see citing works
The place of dopamine in the cortico-basal ganglia circuit
Haber, S. N. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.10.008 · Cited by 364 · see citing works
Lozano, A. M., Giacobbe, P., Hamani, C., Rizvi, S. J., Kennedy, S. H., Kolivakis, T. T., Debonnel, G., Sadikot, A. F., Lam, R. W., Howard, A. K., et al. (2012) · Journal of Neurosurgery · doi:10.3171/2011.10.jns102122 · Cited by 356 · see citing works
Zhang, W.-N., Chang, S.-H., Guo, L.-Y., Zhang, K.-L., & Wang, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.039 · Cited by 355 · see citing works
Dialogues on prediction errors
Niv, Y., & Schoenbaum, G. M. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.03.006 · Cited by 355 · see citing works
Role of the dopaminergic system in depression
Kapur, S., & Mann, J. J. (1992) · Biological Psychiatry · doi:10.1016/0006-3223(92)90137-o · Cited by 350 · see citing works
Research review: altered reward function in adolescent depression: what, when and how?
Forbes, E. E., & Dahl, R. E. (2012) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02477.x · Cited by 350 · see citing works
Gaynes, B. N., Lloyd, S. W., Lux, L., Gartlehner, G., Hansen, R. A., Brode, S., Jonas, D. E., Evans, T. S., Viswanathan, M., & Lohr, K. N. (2014) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.13r08815 · Cited by 347 · see citing works
A habit-goal framework of depressive rumination.
Watkins, E. R., & Nolen–Hoeksema, S. (2014) · Journal of Abnormal Psychology · doi:10.1037/a0035540 · Cited by 342 · see citing works
Dysregulation of Endogenous Opioid Emotion Regulation Circuitry in Major Depression in Women
Kennedy, S. E., Koeppe, R. A., Young, E. A., & Zubieta, J. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1199 · Cited by 339 · see citing works
Downar, J. H., Geraci, J., Salomons, T. V., Dunlop, K., Wheeler, S. M., McAndrews, M. P., Bakker, N., Blumberger, D. M., Daskalakis, Z. J., Kennedy, S. H., et al. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.10.026 · Cited by 338 · see citing works
Goldwater, D. S., Pavlides, C., Hunter, R. G., Bloss, E. B., Hof, P. R., McEwen, B. S., & Morrison, J. H. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.08.053 · Cited by 333 · see citing works
The mesoaccumbens dopamine in coping with stress
Cabib, S., & Puglisi-Allegra, S. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.012 · Cited by 329 · see citing works
Vesicular neurotransmitter transporters: from bacteria to humans.
Schuldiner, S., Shirvan, A., & Linial, M. (1995) · Physiological Reviews · doi:10.1152/physrev.1995.75.2.369 · Cited by 329 · see citing works
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Antidepressant-Like Effects of Medial Prefrontal Cortex Deep Brain Stimulation in Rats
Hamani, C., Diwan, M., Macedo, C. E., Brandão, M. L., Shumake, J., Gonzalez-Lima, F., Raymond, R., Lozano, A. M., Fletcher, P. J., & Nobrega, J. N. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.08.025 · Cited by 324 · see citing works
Richard-Devantoy, S., Berlim, M. T., & Jollant, F. (2014) · Psychological Medicine · doi:10.1017/s0033291713002304 · Cited by 324 · see citing works
Contributions of the striatum to learning, motivation, and performance: an associative account
Liljeholm, M., & O’Doherty, J. P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.007 · Cited by 317 · see citing works
Blunted neural response to rewards prospectively predicts depression in adolescent girls
Bress, J. N., Foti, D., Kotov, R., Klein, D. N., & Hajcak, G. (2013) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01485.x · Cited by 317 · see citing works
Exploring the roles of approach and avoidance in depression: An integrative model
Trew, J. L. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.07.007 · Cited by 316 · see citing works
Functional brain imaging studies of youth depression: A systematic review
Kerestes, R., Davey, C. G., Stephanou, K., Whittle, S., & Harrison, B. J. (2013) · NeuroImage Clinical · doi:10.1016/j.nicl.2013.11.009 · Cited by 307 · see citing works
A Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299 · see citing works
THE ROLE OF VESICULAR TRANSPORT PROTEINS IN SYNAPTIC TRANSMISSION AND NEURAL DEGENERATION
Liu, Y., & Edwards, R. H. (1997) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.20.1.125 · Cited by 295 · see citing works
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294 · see citing works
Bahi, A., Al Mansouri, S., Al Memari, E., Al Ameri, M., Nurulain, S. M., & Ojha, S. (2014) · Physiology & Behavior · doi:10.1016/j.physbeh.2014.06.003 · Cited by 291 · see citing works
Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., & Siegle, G. J. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.75 · Cited by 289 · see citing works
Emotion and decision-making: affect-driven belief systems in anxiety and depression
Paulus, M. P., & Yu, A. J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.009 · Cited by 287 · see citing works
Dopamine release in the basal ganglia
Rice, M. E., Patel, J. C., & Cragg, S. J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.08.066 · Cited by 281 · see citing works
Jocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278 · see citing works
Neurobehavioral evidence for changes in dopamine system activity during adolescence
Wahlstrom, D., White, T., & Luciana, M. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.12.007 · Cited by 277 · see citing works
Stress models of depression: forming genetically vulnerable strains
Henn, F. A., & Vollmayr, B. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.019 · Cited by 274 · see citing works
Stress-induced modulation of instrumental behavior: From goal-directed to habitual control of action
Schwabe, L., & Wolf, O. T. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.12.038 · Cited by 270 · see citing works
Dopamine restores reward prediction errors in old age
Chowdhury, R., Guitart‐Masip, M., Lambert, C., Dayan, P., Huys, Q. J. M., Düzel, E., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3364 · Cited by 267 · see citing works
Serotonergic Systems, Anxiety, and Affective Disorder
Lowry, C. A., Hale, M. W., Evans, A. K., Heerkens, J., Staub, D. R., Gasser, P. J., & Shekhar, A. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1410.004 · Cited by 265 · see citing works
Finberg, J. P. M. (2014) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2014.02.010 · Cited by 263 · see citing works
Blunted response to feedback information in depressive illness
Steele, J. D., Kumar, P., & Ebmeier, K. P. (2007) · Brain · doi:10.1093/brain/awm150 · Cited by 261 · see citing works
Computational approaches to psychiatry
Stephan, K. E., & Mathys, C. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.007 · Cited by 260 · see citing works
Amping Up Effort: Effects ofd-Amphetamine on Human Effort-Based Decision-Making
Wardle, M. C., Treadway, M. T., Mayo, L. M., Zald, D. H., & de Wit, H. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4387-11.2011 · Cited by 258 · see citing works
Serotonin and beyond: therapeutics for major depression
Blier, P., & Mansari, M. E. (2013) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2012.0536 · Cited by 257 · see citing works
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257 · see citing works
Role of kappa-opioid receptors in stress and anxiety-related behavior
Veer, A. V., & Carlezon, W. A. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3195-5 · Cited by 254 · see citing works
Pramipexole versus sertraline in the treatment of depression in Parkinson’s disease
Barone, P., Scarzella, L., Marconi, R., Antonini, A., Morgante, F., Bracco, F., Zappia, M., Musch, B., & and the Depression/Parkinson Italian Study Group (2006) · Journal of Neurology · doi:10.1007/s00415-006-0067-5 · Cited by 247 · see citing works
Representation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246 · see citing works
Hill, M. N., Carrier, E. J., McLaughlin, R. J., Morrish, A. C., Meier, S. E., Hillard, C. J., & Gorzalka, B. B. (2008) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2008.05567.x · Cited by 246 · see citing works
The role of the brain reward system in depression
Naranjo, C. A., Tremblay, L. K., & Busto, U. E. (2001) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/s0278-5846(01)00156-7 · Cited by 245 · see citing works
Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D., & Dolan, R. J. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.009 · Cited by 244 · see citing works
Puigdemont, D., Pérez‐Egea, R., Portella, M. J., Molet, J., de Diego-Adeliño, J., Gironell, A., Raduà, J., Gómez‐Ansón, B., Rodríguez, R. R., Serra-Blasco, M., et al. (2011) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145711001088 · Cited by 235 · see citing works
Haber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230 · see citing works
Contributions of the ventromedial prefrontal cortex to goal-directed action selection
O’Doherty, J. P. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06290.x · Cited by 225 · see citing works
Belujon, P., & Grace, A. A. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.04.014 · Cited by 225 · see citing works
Chase, H. W., Kumar, P., Eickhoff, S. B., & Dombrovski, A. Y. (2015) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-015-0338-7 · Cited by 225 · see citing works
Treadway, M. T., & Zald, D. H. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412474460 · Cited by 224 · see citing works
Depression: a decision-theoretic analysis
Huys, Q. J. M., Daw, N. D., & Dayan, P. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-033928 · Cited by 221 · see citing works
Atypical Depression: A Reappraisal
Parker, G. B., Roy, K., Mitchell, P. B., Wilhelm, K. A., Malhi, G. S., & Hadži-Pavlović, D. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.9.1470 · Cited by 220 · see citing works
How Dopamine Enhances an Optimism Bias in Humans
Sharot, T., Guitart‐Masip, M., Korn, C. W., Chowdhury, R., & Dolan, R. J. (2012) · Current Biology · doi:10.1016/j.cub.2012.05.053 · Cited by 216 · see citing works
The dorsal raphe nucleus—From silver stainings to a role in depression
Michelsen, K. A., Schmitz, C., & Steinbusch, H. W. M. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.01.002 · Cited by 214 · see citing works
Dombrovski, A. Y., Szanto, K., Siegle, G. J., Wallace, M. L., Forman, S. D., Sahakian, B., Reynolds, C. F., & Clark, L. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.12.025 · Cited by 198 · see citing works
The lateral habenula in addiction and depression: an anatomical, synaptic and behavioral overview
Lecca, S., Meye, F. J., & Mameli, M. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12480 · Cited by 196 · see citing works
Depression‐resistant endophenotype in mice overexpressing cannabinoid CB <sub>2</sub> receptors
García‐Gutiérrez, M., Pérez‐Ortiz, J., Gutiérrez‐Adán, A., & Manzanares, J. (2010) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2010.00819.x · Cited by 196 · see citing works
Chase, H., Frank, M., Michael, A., Bullmore, E., Sahakian, B., & Robbins, T. (2009) · Psychological Medicine · doi:10.1017/s0033291709990468 · Cited by 194 · see citing works
Noradrenergic modulation of cognition: Therapeutic implications
Chamberlain, S. R., & Robbins, T. W. (2013) · Journal of Psychopharmacology · doi:10.1177/0269881113480988 · Cited by 193 · see citing works
Corticostriatal Output Gating during Selection from Working Memory
Chatham, C. H., Frank, M. J., & Badre, D. (2014) · Neuron · doi:10.1016/j.neuron.2014.01.002 · Cited by 193 · see citing works
Reward/punishment reversal learning in older suicide attempters
Dombrovski, A. Y., Clark, L., Siegle, G. J., Butters, M. A., Ichikawa, N., Sahakian, B. J., & Szanto, K. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09030407 · Cited by 193 · see citing works
Impacts of stress and sex hormones on dopamine neurotransmission in the adolescent brain
Sinclair, D., Purves-Tyson, T. D., Allen, K. M., & Weickert, C. S. (2014) · Psychopharmacology · doi:10.1007/s00213-013-3415-z · Cited by 191 · see citing works
Model-Based Cognitive Neuroscience Approaches to Computational Psychiatry
Wiecki, T. V., Poland, J. S., & Frank, M. J. (2015) · Clinical Psychological Science · doi:10.1177/2167702614565359 · Cited by 191 · see citing works
Domschke, K., Dannlowski, U., Ohrmann, P., Lawford, B. R., Bauer, J., Kugel, H., Heindel, W. L., Young, R. M., Morris, C. P., Arolt, V., et al. (2008) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2008.05.003 · Cited by 189 · see citing works
Neural response to reward as a predictor of increases in depressive symptoms in adolescence
Morgan, J. K., Olino, T. M., McMakin, D. L., Ryan, N. D., & Forbes, E. E. (2013) · Neurobiology of Disease · doi:10.1016/j.nbd.2012.03.039 · Cited by 185 · see citing works
Forbes, E. E., Olino, T. M., Ryan, N. D., Birmaher, B., Axelson, D., Moyles, D. L., & Dahl, R. E. (2010) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.10.1.107 · Cited by 178 · see citing works
Onaivi, E. S., Ishiguro, H., Gong, J., Sejal, P., Meozzi, P. A., Myers, L., Perchuk, A., Mora, Z., Tagliaferro, P. A., Gardner, E., et al. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1432.036 · Cited by 178 · see citing works
Intermediate phenotypes in psychiatric disorders
Rasetti, R., & Weinberger, D. R. (2011) · Current Opinion in Genetics & Development · doi:10.1016/j.gde.2011.02.003 · Cited by 176 · see citing works
Mapping brain circuits of reward and motivation: In the footsteps of Ann Kelley
Richard, J. M., Castro, D. C., DiFeliceantonio, A. G., Robinson, M. J. F., & Berridge, K. C. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.12.008 · Cited by 175 · see citing works
Hamani, C., Machado, D. C., Hipólide, D. C., Dubiela, F. P., Suchecki, D., de Macedo, C. E. A., Tescarollo, F. C., Martins, U., Covolan, L., & Nóbrega, J. N. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.08.025 · Cited by 172 · see citing works
An update on the connections of the ventral mesencephalic dopaminergic complex
Yetnikoff, L., Lavezzi, H. N., Reichard, R. A., & Zahm, D. S. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.04.010 · Cited by 172 · see citing works
Flagged first, then by citations
3 of the 365 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model
Price, R. B., & Duman, R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0615-x · Cited by 721 · see citing works
The orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474 · see citing works
Mikulska, J., Juszczyk, G., Gawrońska-Grzywacz, M., & Herbet, M. (2021) · Brain Sciences · doi:10.3390/brainsci11101298 · Cited by 450 · see citing works
Mental illness and well‐being: an affect regulation perspective
Gross, J. J., Uusberg, H., & Uusberg, A. (2019) · World Psychiatry · doi:10.1002/wps.20618 · Cited by 248 · see citing works
Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments
Avery, M. C., & Krichmar, J. L. (2017) · Frontiers in Neural Circuits · doi:10.3389/fncir.2017.00108 · Cited by 231 · see citing works
Why not try harder? Computational approach to motivation deficits in neuro-psychiatric diseases
Pessiglione, M., Vinckier, F., Bouret, S., Jean Daunizeau, A., & Bouc, R. L. (2017) · Brain · doi:10.1093/brain/awx278 · Cited by 230 · see citing works
Reward-Processing Behavior in Depressed Participants Relative to Healthy Volunteers
Halahakoon, D. C., Kieslich, K., O’Driscoll, C., Nair, A., Lewis, G., & Roiser, J. P. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.2139 · Cited by 222 · see citing works
Smith, R. S., Kuplicki, R., Feinstein, J. S., Forthman, K. L., Stewart, J. L., Paulus, M. P., Tulsa 1000 investigators, & Khalsa, S. S. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008484 · Cited by 195 · see citing works
Chen, C., Nakagawa, S., An, Y., Ito, K., Kitaichi, Y., & Kusumi, I. (2016) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2016.12.001 · Cited by 191 · see citing works
Chen, C., & Nakagawa, S. (2023) · Ageing Research Reviews · doi:10.1016/j.arr.2023.101868 · Cited by 156 · see citing works
Deep Learning and Neural Networks: Decision-Making Implications
Taherdoost, H. (2023) · Symmetry · doi:10.3390/sym15091723 · Cited by 139 · see citing works
Dopaminergic Enhancement of Striatal Response to Reward in Major Depression
Admon, R., Kaiser, R. H., Dillon, D. G., Beltzer, M., Goer, F., Olson, D. P., Vitaliano, G. D., & Pizzagalli, D. A. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010111 · Cited by 136 · see citing works
The neural underpinnings of cognitive flexibility and their disruption in psychotic illness
Waltz, J. A. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2016.06.005 · Cited by 122 · see citing works
Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P. (2017) · Brain · doi:10.1093/brain/awx025 · Cited by 124 · see citing works
Nakagawa, T., Koan, I., Chen, C., Matsubara, T., Hagiwara, K., Lei, H., Hirotsu, M., Yamagata, H., & Nakagawa, S. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17020614 · Cited by 124 · see citing works
Self-citationQuantum reinforcement learning during human decision-making
Li, J., Dong, D., Wei, Z., Liu, Y., Pan, Y., Nori, F., & Zhang, X. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0804-2 · Cited by 122 · see citing works
Brown, V. M., Zhu, L., Solway, A., Wang, J. M., McCurry, K. L., King-Casas, B., & Chiu, P. H. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.1844 · Cited by 112 · see citing works
Computational neuroscience approach to biomarkers and treatments for mental disorders
Yahata, N., Kasai, K., & Kawato, M. (2016) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12502 · Cited by 126 · see citing works
Dowd, E. C., Frank, M. J., Collins, A. G. E., Gold, J. M., & Barch, D. M. (2016) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.05.005 · Cited by 98 · see citing works
Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I. (2021) · JMIR Mental Health · doi:10.2196/32199 · Cited by 95 · see citing works
“People with depression frequently experience anhedonia, which may result in blunted sensitivity to reward [11-15].”
BackgroundPhysical activity and mental health; it is more than just a prescription
Rebar, A. L., & Taylor, A. H. (2017) · Mental health and physical activity · doi:10.1016/j.mhpa.2017.10.004 · Cited by 85 · see citing works
Effects of transcranial direct current stimulation for treating depression: A modeling study
Csifcsák, G., Boayue, N. M., Puonti, O., Thielscher, A., & Mittner, M. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.077 · Cited by 79 · see citing works
Computational Neuroscience Approach to Psychiatry: A Review on Theory-driven Approaches
Khaleghi, A., Mohammadi, M. R., Shahi, K., & Nasrabadi, A. M. (2022) · Clinical Psychopharmacology and Neuroscience · doi:10.9758/cpn.2022.20.1.26 · Cited by 82 · see citing works
Amygdala-cortical collaboration in reward learning and decision making
Wassum, K. M. (2022) · eLife · doi:10.7554/elife.80926 · Cited by 76 · see citing works
Chen, C., Nakagawa, S., Kitaichi, Y., An, Y., Omiya, Y., Song, N., Koga, M., Kato, A., Inoue, T., & Kusumi, I. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.03.008 · Cited by 78 · see citing works
Liu, W., Roiser, J. P., Wang, L.-Z., Zhu, Y.-H., Huang, J., Neumann, D. L., Shum, D., Cheung, E. F. C., & Chan, R. C. K. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.050 · Cited by 78 · see citing works
Risk preference dynamics around life events
Kettlewell, N. (2019) · Journal of Economic Behavior and Organization · doi:10.1016/j.jebo.2019.04.018 · Cited by 40 · see citing works
Treadway, M. T., Admon, R., Arulpragasam, A. R., Mehta, M., Douglas, S., Vitaliano, G. D., Olson, D. P., Cooper, J. A., & Pizzagalli, D. A. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.02.1183 · Cited by 71 · see citing works
Reward and punishment reversal-learning in major depressive disorder.
Mukherjee, D., Filipowicz, A. L. S., Vo, K. D., Satterthwaite, T. D., & Kable, J. W. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000641 · Cited by 70 · see citing works
Sias, A. C., Jafar, Y., Goodpaster, C. M., Ramírez-Armenta, K., Wrenn, T. M., Griffin, N. K., Patel, K., Lamparelli, A. C., Sharpe, M. J., & Wassum, K. M. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01586-7 · Cited by 73 · see citing works
Reward systems and cognitions in Major Depressive Disorder
Cléry-Melin, M.-L., Jollant, F., & Gorwood, P. A. P. M. (2018) · CNS Spectrums · doi:10.1017/s1092852918001335 · Cited by 68 · see citing works
Chen, C., & Nakagawa, S. (2023) · Advances in Clinical and Experimental Medicine · doi:10.17219/acem/171565 · Cited by 68 · see citing works
Gut inference: A computational modelling approach
Smith, R. S., Mayeli, A., Taylor, S., Zoubi, O. A., Naegele, J., & Khalsa, S. S. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108152 · Cited by 68 · see citing works
Scholl, J., & Klein-Flügge, M. C. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.09.050 · Cited by 62 · see citing works
Recent advances in the study of the comorbidity of depressive and anxiety disorders
Chen, C. (2022) · Advances in Clinical and Experimental Medicine · doi:10.17219/acem/147441 · Cited by 68 · see citing works
Biased belief updating in depression
Kube, T. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102298 · Cited by 61 · see citing works
Depression, Risk Preferences, and Risk-Taking Behavior
Cobb‐Clark, D. A., Dahmann, S. C., & Kettlewell, N. (2020) · The Journal of Human Resources · doi:10.3368/jhr.58.1.0419-10183r1 · Cited by 53 · see citing works
Major Depression Impairs the Use of Reward Values for Decision-Making
Rupprechter, S., Stankevicius, A., Huys, Q. J. M., Steele, J. D., & Seriès, P. (2018) · Scientific Reports · doi:10.1038/s41598-018-31730-w · Cited by 51 · see citing works
Fu, Z., Zhou, S., Burger, H., Bockting, C. L. H., & Williams, A. D. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.058 · Cited by 44 · see citing works
Depressive symptoms are associated with blunted reward learning in social contexts
Safra, L., Chevallier, C., & Palminteri, S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007224 · Cited by 40 · see citing works
Servaas, M. N., Riese, H., Renken, R. J., Wichers, M., Bastiaansen, J. A., Figueroa, C. A., Geugies, H., Mocking, R. J. T., Geerligs, L., Marsman, J.-B. C., et al. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.65 · Cited by 39 · see citing works
Moutoussis, M., Rutledge, R. B., Prabhu, G., Hrynkiewicz, L., Lam, J., Ousdal, O. T., Guitart‐Masip, M., Fonagy, P., & Dolan, R. J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0201451 · Cited by 42 · see citing works
Song, J., Hou, X., Hu, X., Lu, C., Liu, C., Wang, J., Liu, W., Teng, L., & Wang, D. (2015) · Chemico-Biological Interactions · doi:10.1016/j.cbi.2015.10.001 · Cited by 40 · see citing works
Multiple Facets of Value-Based Decision Making in Major Depressive Disorder
Mukherjee, D., Lee, S., Kazinka, R., Satterthwaite, T. D., & Kable, J. W. (2020) · Scientific Reports · doi:10.1038/s41598-020-60230-z · Cited by 42 · see citing works
Colich, N. L., Ho, T. C., Ellwood-Lowe, M. E., Foland‐Ross, L. C., Sacchet, M. D., LeMoult, J., & Gotlib, I. H. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx073 · Cited by 38 · see citing works
Paulus, M. P., Stein, M. B., Craske, M. G., Bookheimer, S. Y., Taylor, C. T., Simmons, A. N., Sidhu, N. K., Young, K. S., & Fan, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.12.046 · Cited by 36 · see citing works
Who are the placebo responders? A cross-sectional cohort study for psychological determinants
Wang, Y., Chan, E., Dorsey, S. G., Campbell, C. M., & Colloca, L. (2021) · Pain · doi:10.1097/j.pain.0000000000002478 · Cited by 39 · see citing works
Vinckier, F., Jaffré, C., Gauthier, C., Smajda, S., Abdel-Ahad, P., Bouc, R. L., Jean Daunizeau, A., Fefeu, M., Borderies, N., Plaze, M., et al. (2022) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2022.07.011 · Cited by 39 · see citing works
McCutcheon, R. A., Bloomfield, M. A. P., Dahoun, T., Mehta, M., & Howes, O. D. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2018.12.011 · Cited by 35 · see citing works
Hughes, B. W., Siemsen, B. M., Tsvetkov, E., Berto, S., Kumar, J., Cornbrooks, R. G., Akiki, R. M., Cho, J. Y., Carter, J. S., Snyder, K. K., et al. (2023) · eLife · doi:10.7554/elife.75631 · Cited by 34 · see citing works
Frey, A.-L., & McCabe, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.049 · Cited by 35 · see citing works
Enhancing the psychometric properties of the Iowa gambling task using full generative modeling
Sullivan-Toole, H., Haines, N., Dale, K., & Olino, T. M. (2022) · Computational Psychiatry · doi:10.5334/cpsy.89 · Cited by 35 · see citing works
Formalising social representation to explain psychiatric symptoms
Barnby, J. M., Dayan, P., & Bell, V. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.12.004 · Cited by 34 · see citing works
The computational psychiatry of antisocial behaviour and psychopathy
Pauli, R., & Lockwood, P. L. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104995 · Cited by 34 · see citing works
Computational models of subjective feelings in psychiatryPreprint
Kao, C.-H., Feng, G., Hur, J. K., Jarvis, H., & Rutledge, R. B. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.105008 · Cited by 46 · see citing works
Revisiting the role of computational neuroimaging in the era of integrative neuroscience
Loosen, A. M., Kato, A., & Gu, X. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01946-8 · Cited by 34 · see citing works
Yang, X., Guo, Z., Lü, J., Zhao, B., Fei, Y., Li, J., Jiang, H., Sun, L., Wang, Y., Sun, Y., et al. (2017) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2017/2357653 · Cited by 27 · see citing works
Xu, T., Zhou, X., Kanen, J. W., Wang, L., Li, J., Chen, Z., Zhang, R., Jiao, G., Zhou, F., Zhao, W., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02001-6 · Cited by 26 · see citing works
Invasive Computational Psychiatry
Sáez, I., & Gu, X. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.09.032 · Cited by 25 · see citing works
Single Photon in Hierarchical Architecture for Physical Decision Making: Photon Intelligence
Naruse, M., Berthel, M., Drezet, A., Huant, S., Hori, H., & Kim, S.-J. (2016) · ACS Photonics · doi:10.1021/acsphotonics.6b00742 · Cited by 25 · see citing works
Model-based estimation of subjective values using choice tasks with probabilistic feedback
Katahira, K., Yuki, S., & Okanoya, K. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.05.005 · Cited by 24 · see citing works
Rutherford, B. R., Slifstein, M., Chen, C., Abi‐Dargham, A., Brown, P. J., Wall, M. W., Vanegas‐Arroyave, N., Stern, Y., Bailey, V. S., Valente, E., et al. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.04.007 · Cited by 24 · see citing works
RetractedHaynos, A. F., Widge, A. S., Anderson, L. M., & Redish, A. D. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01320-9 · Cited by 24 · see citing works
Csifcsák, G., Melsæter, E., & Mittner, M. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01515 · Cited by 24 · see citing works
Wilkinson, M. P., Slaney, C., Mellor, J. R., & Robinson, E. S. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0260444 · Cited by 22 · see citing works
Rmus, M., Pan, T.-F., Xia, L., & Collins, A. G. E. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012119 · Cited by 21 · see citing works
Depression, Risk Preferences and Risk-Taking BehaviorPreprint
Cobb‐Clark, D. A., Dahmann, S. C., & Kettlewell, N. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3390275 · Cited by 21 · see citing works
Network changes in insula and amygdala connectivity accompany implicit suicidal associations
Ballard, E. D., Gilbert, J. R., Fields, J. S., Nugent, A. C., & Zarate, C. A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.577628 · Cited by 20 · see citing works
Vandendriessche, H., Demmou, A., Bavard, S., Yadak, J., Lemogne, C., Mauras, T., & Palminteri, S. (2022) · Psychological Medicine · doi:10.1017/s0033291722001593 · Cited by 19 · see citing works
Computational models as statistical tools
Durstewitz, D., Koppe, G., & Toutounji, H. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.07.004 · Cited by 19 · see citing works
Karvelis, P., Charlton, C. E., Allohverdi, S. G., Bedford, P., Hauke, D. J., & Diaconescu, A. O. (2022) · Network Neuroscience · doi:10.1162/netn_a_00233 · Cited by 19 · see citing works
Lei, H., Chen, C., Hagiwara, K., Kusumi, I., Tanabe, H., Inoue, T., & Nakagawa, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.808918 · Cited by 19 · see citing works
Hakamata, Y., Hori, H., Mizukami, S., Izawa, S., Yoshida, F., Moriguchi, Y., Hanakawa, T., Inoue, Y., & Tagaya, H. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1196235 · Cited by 20 · see citing works
Transdiagnostic inflexible learning dynamics explain deficits in depression and schizophrenia
Kirschner, H., Nassar, M. R., Fischer, A. G., Frodl, T., Meyer-Lotz, G., Froböse, S., Seidenbecher, S., Klein, T. A., & Ullsperger, M. (2023) · Brain · doi:10.1093/brain/awad362 · Cited by 20 · see citing works
Psychometric Properties and Validation of the EMOTICOM Test Battery in a Healthy Danish Population
Dam, V., Thystrup, C. K., Jensen, P., Bland, A., Mortensen, E. L., Elliott, R., Sahakian, B., Knudsen, G., Frokjaer, V., & Stenbæk, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02660 · Cited by 14 · see citing works
Katahira, K., & Toyama, A. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008738 · Cited by 17 · see citing works
The neuroanatomy of social trust predicts depression vulnerability
Fermin, A. S. R., Kiyonari, T., Matsumoto, Y., Takagishi, H., Li, Y., Ryota Kanai, C., Sakagami, M., Akaishi, R., Ichikawa, N., Takamura, M., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-20443-w · Cited by 19 · see citing works
Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders
Liebenow, B., Jones, R., DiMarco, E. K., Trattner, J. D., Humphries, J. B., Sands, L. P., Spry, K. P., Johnson, C. K., Farkas, E. B., Jiang, A., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.886297 · Cited by 19 · see citing works
Representation of Anticipated Rewards and Punishments in the Human Brain
Ben‐Zion, Z., & Levy, I. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022324-042614 · Cited by 20 · see citing works
Can Understanding Reward Help Illuminate Anhedonia?
Kaya, S., & McCabe, C. (2019) · Current Behavioral Neuroscience Reports · doi:10.1007/s40473-019-00186-1 · Cited by 16 · see citing works
Pessimistically biased perception in panic disorder during risk learning
Kim, M., Kim, S., Lee, K., & Jeong, B. (2020) · Depression and Anxiety · doi:10.1002/da.23007 · Cited by 17 · see citing works
Liu, Q., Zhong, R., Ji, X., Law, S., Xiao, F., Wei, Y., Fang, S., Kong, X., Zhang, X., Yao, S., et al. (2022) · Depression and Anxiety · doi:10.1002/da.23291 · Cited by 20 · see citing works
Signed and unsigned effects of prediction error on memory: Is it a matter of choice?
Pupillo, F., & Bruckner, R. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105371 · Cited by 16 · see citing works
Sex difference in the weighting of expected uncertainty under chronic stress
Lei, H., Mochizuki, Y., Chen, C., Hagiwara, K., Hirotsu, M., Matsubara, T., & Nakagawa, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-88155-1 · Cited by 15 · see citing works
Effects of subclinical depression on prefrontal–striatal model-based and model-free learning
Heo, S., Sung, Y., & Lee, S. W. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009003 · Cited by 16 · see citing works
Maladaptive Avoidance Learning in the Orbitofrontal Cortex in Adolescents With Major Depression
Willinger, D., Karipidis, I. I., Neuer, S., Emery, S., Rauch, C., Häberling, I. S., Berger, G. E., Walitza, S., & Brem, S. (2021) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.06.005 · Cited by 16 · see citing works
Spatiotemporal Precision of Neuroimaging in Psychiatry
McFadyen, J., & Dolan, R. J. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.08.016 · Cited by 15 · see citing works
Zühlsdorff, K., López‐Cruz, L., Dutcher, E. G., Jones, J. A., Pama, C., Sawiak, S. J., Khan, S. A., Milton, A. L., Robbins, T. W., Bullmore, E. T., et al. (2022) · Neurobiology of Stress · doi:10.1016/j.ynstr.2022.100507 · Cited by 15 · see citing works
Ruffini, G., Castaldo, F., Lopez-Sola, E., Sanchez-Todo, R., & Vohryzek, J. (2024) · Entropy · doi:10.3390/e26110953 · Cited by 18 · see citing works
The pursuit of happiness: A reinforcement learning perspective on habituation and comparisons
Dubey, R., Griffiths, T. L., & Dayan, P. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010316 · Cited by 16 · see citing works
Nonlinear Probability Weighting in Depression and Anxiety: Insights From Healthy Young Adults
Hagiwara, K., Mochizuki, Y., Chen, C., Lei, H., Hirotsu, M., Matsubara, T., & Nakagawa, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.810867 · Cited by 13 · see citing works
Greenwald, M. K., Moses, T. E. H., Lundahl, L. H., & Roehrs, T. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1103739 · Cited by 13 · see citing works
The association of positive emotions with absenteeism and presenteeism in Japanese workers
Chen, C., Okubo, R., Hagiwara, K., Mizumoto, T., Nakagawa, S., & Tabuchi, T. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.10.091 · Cited by 15 · see citing works
The Reason Why rTMS and tDCS Are Efficient in Treatments of Depression
Čukić, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02923 · Cited by 13 · see citing works
Liu, X., Wang, N., Gu, L., Guo, J., Wang, J., & Luo, F. (2019) · Pain Research and Management · doi:10.1155/2019/6760121 · Cited by 14 · see citing works
Suzuki, S., Yamashita, Y., & Katahira, K. (2021) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.13279 · Cited by 12 · see citing works
On the Complexity of Brain Disorders: A Symptom-Based Approach
Moustafa, A. A., Phillips, J. R., Kéri, S., Misiak, B., & Frydecka, D. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00016 · Cited by 14 · see citing works
Applying Reinforcement Learning to Rodent Stress Research
Liao, C., & Kwan, A. C. (2021) · Chronic Stress · doi:10.1177/2470547020984732 · Cited by 13 · see citing works
The habenula in mood disorders: A systematic review of human studies
Fortin, J., Lafleur, M., Parisien, C., & Hétu, S. (2025) · Molecular Psychiatry · doi:10.1038/s41380-025-03105-x · Cited by 13 · see citing works
Kwon, M., Lee, S. H., & Ahn, W. (2022) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2022.12.003 · Cited by 12 · see citing works
- Authors
- Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I.
- Affiliations
- Hokkaido University (JP)
- Corresponding author
- Chen, Chong
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2015-08
- Volume
- 55
- Pages
- 247-267
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W291512641
- Cited by
- 233
- References
- 365
- Citations by year
- 2026: 17 · 2025: 26 · 2024: 34 · 2023: 31 · 2022: 29 · 2021: 19 · 2020: 17 · 2019: 20 · 2018: 10 · 2017: 14 · 2016: 11 · 2015: 4
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuroscience & Biobehavioral Reviews (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Education, Culture, Sports, Science and Technology
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- major depressive disorder, reinforcement learning, computational psychiatry, model-free reinforcement learning, model-based reinforcement learning, reward prediction error, reward sensitivity, endophenotypes, decision-making deficits, cognitive deficits in depression
- MeSH terms
- Animals, Brain, Computer Simulation, Major Depressive Disorder, Humans, Motivation, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
