Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making
Open accessAbstract
Considerable evidence has emerged to implicate ventromedial prefrontal cortex in encoding expectations of future reward during value-based decision making. However, the nature of the learned associations upon which such representations depend is much less clear. Here, we aimed to determine whether expected reward representations in this region could be driven by action-outcome associations, rather than being dependent on the associative value assigned to particular discriminative stimuli. Subjects were scanned with functional magnetic resonance imaging while performing 2 variants of a simple reward-related decision task. In one version, subjects made choices between 2 different physical motor responses in the absence of discriminative stimuli, whereas in the other version, subjects chose between 2 different stimuli that were randomly assigned to different responses on a trial-by-trial basis. Using an extension of a reinforcement learning algorithm, we found activity in ventromedial prefrontal cortex tracked expected future reward during the action-based task as well as during the stimulus-based task, indicating that value representations in this region can be driven by action-outcome associations. These findings suggest that ventromedial prefrontal cortex may play a role in encoding the value of chosen actions irrespective of whether those actions denote physical motor responses or more abstract decision options.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In humans, anterior cingulate cortex activation is related to learning action-outcome associations but not stimulus-outcome associations.
“Neuroimaging studies in humans confirm that activations in anterior cingulate cortex are related to the learning of action-outcome associations, but not to learning stimulus-outcome associations (100).”
From Localization of Dysfunction in Major Depressive Disorder: Prefrontal Cortex and Amygdala (2011) · cites this paper as [100]
In humans, there is evidence for representation of both outcomes and actions in PFm and MFa.
“In humans, there is evidence for the representation of both outcomes and actions in PFm and MFa.”
From Localization of Dysfunction in Major Depressive Disorder: Prefrontal Cortex and Amygdala (2011) · cites this paper as [100]
Tasks involving instrumental actions recruit both ventral and dorsal striatum.
“whereas tasks involving instrumental actions have been shown to recruit both ventral and dorsal striatum [27,29,30].”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B., & Joliot, M. (2002) · NeuroImage · doi:10.1006/nimg.2001.0978 · Cited by 16,319 · see citing works
Insensitivity to future consequences following damage to human prefrontal cortex
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994) · Cognition · doi:10.1016/0010-0277(94)90018-3 · Cited by 6,128 · see citing works
Spatial registration and normalization of images
Friston, K. J., Ashburner, J., Frith, C., Poline, J.-B., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 3,744 · see citing works
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Self-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426 · see citing works
Self-citationThe Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Functional Magnetic Resonance Imaging
Walsh, A. (2014) · Encyclopedia of Criminal Justice Ethics · doi:10.4135/9781452274102.n135 · Cited by 1,225 · see citing works
Picard, N., & Strick, P. L. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(01)00266-5 · Cited by 1,184 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Action sets and decisions in the medial frontal cortex
RUSHWORTH, M., WALTON, M., KENNERLEY, S., & BANNERMAN, D. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.07.009 · Cited by 1,004 · see citing works
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · see citing works
Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
Schoenbaum, G. M., Chiba, A. A., & Gallagher, M. (1998) · Nature Neuroscience · doi:10.1038/407 · Cited by 849 · see citing works
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · see citing works
Optimized EPI for fMRI studies of the orbitofrontal cortex
Deichmann, R., Gottfried, J. A., Hutton, C., & Turner, R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00073-9 · Cited by 821 · see citing works
Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04563.2002 · Cited by 784 · see citing works
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Wallis, J. D., & Miller, E. K. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02922.x · Cited by 628 · see citing works
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611 · see citing works
Self-citationTemporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Self-citationDetermining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529 · see citing works
Self-citationHampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
Self-citationSchoenbaum, G., Setlow, B., Saddoris, M. P., & Gallagher, M. (2003) · Neuron · doi:10.1016/s0896-6273(03)00474-4 · Cited by 484 · see citing works
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 447 · see citing works
Self-citationInteractions between decision making and performance monitoring within prefrontal cortex
Walton, M. E., Devlin, J. T., & Rushworth, M. F. S. (2004) · Nature Neuroscience · doi:10.1038/nn1339 · Cited by 440 · see citing works
Medial prefrontal cell activity signaling prediction errors of action values
Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007) · Nature Neuroscience · doi:10.1038/nn1890 · Cited by 440 · see citing works
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · see citing works
Self-citationThe neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Clark, L., Cools, R., & Robbins, T. W. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00284-7 · Cited by 439 · see citing works
Dorris, M. C., & Glimcher, P. W. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.009 · Cited by 428 · see citing works
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384 · see citing works
Orbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning
Ostlund, S. B., & Balleine, B. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5443-06.2007 · Cited by 379 · cited 1× · see citing works
“However, accumulating evidence from rodent lesion studies suggests that at least in the rodent brain, regions of prefrontal cortex involved in mediating stimulusoutcome (or Pavlovian) learning are distinct and dissociable from those regions involved in mediating action-outcome (or goal-directed learning) (Balleine et…”
BackgroundIMAGING VALUATION MODELS IN HUMAN CHOICE
Montague, P. R., King‐Casas, B., & Cohen, J. D. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112903 · Cited by 371 · see citing works
Functional organization of the medial frontal cortex
Rushworth, M. F., Buckley, M. J., Behrens, T. E., Walton, M. E., & Bannerman, D. M. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.03.001 · Cited by 353 · see citing works
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
Ostlund, S. B., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-05.2005 · Cited by 291 · see citing works
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 287 · see citing works
Decoding the neural substrates of reward-related decision making with functional MRI
Hampton, A. N., & O’Doherty, J. P. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0606297104 · Cited by 279 · see citing works
Self-citationContributions of the Amygdala to Reward Expectancy and Choice Signals in Human Prefrontal Cortex
Hampton, A. N., Adolphs, R., Tyszka, J. M., & O'Doherty, J. P. (2007) · Neuron · doi:10.1016/j.neuron.2007.07.022 · Cited by 213 · see citing works
Self-citationBlair, K. S., Marsh, A. A., Morton, J., Vythilingam, M., Jones, M., Mondillo, K., Pine, D. C., Drevets, W. C., & Blair, J. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1640-06.2006 · Cited by 164 · see citing works
Decision-making and the frontal lobes
Volz, K. G., Schubotz, R. I., & von Cramon, D. Y. (2006) · Current Opinion in Neurology · doi:10.1097/01.wco.0000236621.83872.71 · Cited by 90 · see citing works
Hoshi, E., Sawamura, H., & Tanji, J. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01201.2004 · Cited by 67 · see citing works
Sohn, J.-W., & Lee, D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2982-07.2007 · Cited by 62 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- von Neumann J, Morgenstern O. 1944. Theories of Games and economic behavior. Princeton (NJ): Princeton University Press.
Cited by
Sorted by citations
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718 · see citing works
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
Self-citationThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · see citing works
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works
Self-citationFrontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111 · see citing works
Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916 · see citing works
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706 · see citing works
Emotion and the prefrontal cortex: an integrative review
Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017) · Psychological Bulletin · doi:10.1037/bul0000096 · Cited by 745 · see citing works
Boorman, E. D., Behrens, T. E. J., Woolrich, M. W., & Rushworth, M. F. S. (2009) · Neuron · doi:10.1016/j.neuron.2009.05.014 · Cited by 665 · see citing works
Gillan, C. M., Papmeyer, M., Morein-Zamir, S., Sahakian, B. J., Fineberg, N. A., Robbins, T. W., & de Wit, S. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10071062 · Cited by 609 · see citing works
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618 · see citing works
Expected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485 · see citing works
Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex
Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1206608109 · Cited by 476 · see citing works
How the brain integrates costs and benefits during decision making
Basten, U., Biele, G., Heekeren, H. R., & Fiebach, C. J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0908104107 · Cited by 466 · see citing works
Neural representations of subjective reward value
Peters, J., & Büchel, C. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.04.031 · Cited by 405 · see citing works
Peters, J., & Büchel, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3489-09.2009 · Cited by 400 · see citing works
de Wit, S., Watson, P., Harsay, H. A., Cohen, M. X., van de Vijver, I., & Ridderinkhof, K. R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1088-12.2012 · Cited by 373 · see citing works
Contributions of the striatum to learning, motivation, and performance: an associative account
Liljeholm, M., & O’Doherty, J. P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.007 · Cited by 317 · see citing works
Self-citationYour Brain on Google: Patterns of Cerebral Activation during Internet Searching
Small, G. W., Moody, T. D., Siddarth, P., & Bookheimer, S. Y. (2009) · The American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e3181953a02 · Cited by 306 · see citing works
Jocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278 · see citing works
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301 · see citing works
Self-citationConnectivity-based parcellation of the human orbitofrontal cortex
Kahnt, T., Chang, L. J., Park, S. Q., Heinzle, J., & Haynes, J.-D. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0257-12.2012 · Cited by 299 · see citing works
Emotion and decision-making: affect-driven belief systems in anxiety and depression
Paulus, M. P., & Yu, A. J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.009 · Cited by 287 · see citing works
Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., & Siegle, G. J. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.75 · Cited by 289 · see citing works
Medial frontal cortex: From self-generated action to reflection on one's own performance
Passingham, R. E., Bengtsson, S. L., & Lau, H. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.001 · Cited by 252 · see citing works
Contributions of the ventromedial prefrontal cortex to goal-directed action selection
O’Doherty, J. P. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06290.x · Cited by 225 · see citing works
Hauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.018 · Cited by 203 · see citing works
Localization of Dysfunction in Major Depressive Disorder: Prefrontal Cortex and Amygdala
Murray, E. A., Wise, S. P., & Drevets, W. C. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.09.041 · Cited by 208 · see citing works
Morris, L. S., Kundu, P., Dowell, N., Mechelmans, D. J., Favre, P., Irvine, M. A., Robbins, T. W., Daw, N., Bullmore, E. T., Harrison, N. A., et al. (2016) · Cortex · doi:10.1016/j.cortex.2015.11.004 · Cited by 198 · see citing works
Corticostriatal Control of Goal-Directed Action Is Impaired in Schizophrenia
Morris, R. W., Quail, S., Griffiths, K. R., Green, M. J., & Balleine, B. W. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.06.005 · Cited by 197 · see citing works
de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1639-09.2009 · Cited by 200 · see citing works
Bouret, S., & Richmond, B. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0049-10.2010 · Cited by 192 · see citing works
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176 · see citing works
Camille, N., Tsuchida, A., & Fellows, L. K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3164-11.2011 · Cited by 195 · see citing works
Tsuchida, A., Doll, B. B., & Fellows, L. K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1958-10.2010 · Cited by 188 · see citing works
“(2008) for lesion mapping with binomial behavioral data but uses the Wilcoxon–Mann–Whitney probability to estimate power for continuous behavioral data (Gläscher et al., 2009).”
MethodHeterogeneous reward signals in prefrontal cortex
Wallis, J. D., & Kennerley, S. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.009 · Cited by 186 · see citing works
Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement
Noonan, M. P., Kolling, N., Walton, M. E., & Rushworth, M. F. S. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08023.x · Cited by 169 · see citing works
How do negative emotions impair self-control? A neural model of negative urgency
Chester, D. S., Lynam, D. R., Milich, R., Powell, D. K., Andersen, A. H., & DeWall, C. N. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.024 · Cited by 170 · see citing works
Hauser, T. U., Iannaccone, R., Ball, J., Mathys, C., Brandeis, D., Walitza, S., & Brem, S. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1093 · Cited by 168 · see citing works
Assessing inter individual differences with task related functional neuroimaging
Lebreton, M., Bavard, S., Daunizeau, J., & Palminteri, S. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0681-8 · Cited by 160 · see citing works
Dopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112 · see citing works
Liljeholm, M., Tricomi, E., O'Doherty, J. P., & Balleine, B. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3354-10.2011 · Cited by 130 · see citing works
Self-citationGriffiths, K. R., Morris, R. W., & Balleine, B. W. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00101 · Cited by 118 · see citing works
Sonuga-Barke, E. J. S., & Fairchild, G. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.04.004 · Cited by 124 · see citing works
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118 · see citing works
Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104 · see citing works
Self-citationNeural correlates of reversal learning in severe mood dysregulation and pediatric bipolar disorder
Adleman, N. E., Kayser, R., Dickstein, D., Blair, R. J. R., Pine, D., & Leibenluft, E. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.011 · Cited by 106 · see citing works
Hauser, T. U., Iannaccone, R., Dolan, R. J., Ball, J., Hättenschwiler, J., Drechsler, R., Rufer, M., Brandeis, D., Walitza, S., & Brem, S. (2017) · Psychological Medicine · doi:10.1017/s0033291716003305 · Cited by 86 · see citing works
Smolker, H. R., Depue, B. E., Reineberg, A. E., Orr, J. M., & Banich, M. T. (2015) · Brain Structure and Function · doi:10.1007/s00429-014-0723-y · Cited by 77 · see citing works
D'Cruz, A.-M., Mosconi, M. W., Ragozzino, M. E., Cook, E. H., & Sweeney, J. A. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.161 · Cited by 77 · see citing works
Bernacer, J., Corlett, P. R., Ramachandra, P., McFarlane, B., Turner, D. C., Clark, L., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12070978 · Cited by 77 · see citing works
Action-specific value signals in reward-related regions of the human brain
FitzGerald, T. H. B., Friston, K. J., & Dolan, R. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3254-12.2012 · Cited by 68 · see citing works
Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61 · see citing works
Medial prefrontal cortex: adding value to imagined scenarios
Lin, W.-J., Horner, A. J., Bisby, J. A., & Burgess, N. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00836 · Cited by 40 · see citing works
Leveraging cognitive neuroscience for making and breaking real-world habits
Buabang, E. K., Donegan, K. R., Rafei, P., & Gillan, C. M. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.10.006 · Cited by 34 · see citing works
Coello, Y., Quesque, F., Gigliotti, M.-F., Ott, L., & Bruyelle, J.-L. (2018) · PLOS ONE · doi:10.1371/journal.pone.0196874 · Cited by 35 · see citing works
Colas, J. T., O’Doherty, J. P., & Grafton, S. T. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011950 · Cited by 6 · see citing works
Self-citationVahedi, J., Bahic, A., Chaliani, I., Schilbach, L., Ciupka‐Schön, B., Bellebaum, C., Pietrowsky, R., & Peterburs, J. (2025) · Psychophysiology · doi:10.1111/psyp.70142 · Cited by 3 · see citing works
- Authors
- Gläscher, J., Hampton, A. N., & O'Doherty, J. P.
- Affiliations
- California Institute of Technology (US)
- ORCID
- Gläscher, Jan
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-06-11
- Volume
- 19
- Issue
- 2
- Pages
- 483-495
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- PMC
- PMC2626172
- OpenAlex
- W2088135927
- Cited by
- 387
- References
- 52
- Citations by year
- 2026: 5 · 2025: 18 · 2024: 20 · 2023: 11 · 2022: 22 · 2021: 19 · 2020: 27 · 2019: 18 · 2018: 16 · 2017: 31 · 2016: 34 · 2015: 16 · 2014: 35 · 2013: 27 · 2012: 22
- FWCI
- 11.41
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- Funders
- National Institute of Mental Health (R03MH075763)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- ventromedial prefrontal cortex, expected reward, action-outcome associations, value-based decision making, reinforcement learning, motor response
- MeSH terms
- Algorithms, Cues, Data Interpretation, Statistical, Decision Making, Discrimination, Psychological, Female, Humans, Image Processing, Computer-Assisted, Functional Laterality, Learning, Magnetic Resonance Imaging, Male, Models, Neurological, Oxygen, Photic Stimulation, Psychomotor Performance, Reversal Learning, Reward, Logistic Models, Prefrontal Cortex, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
