CoChat
Sign Up
Cited by 230Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorMemory and Neural Mechanisms

The Neural Network Underlying Incentive-Based Learning: Implications for Interpreting Circuit Disruptions in Psychiatric Disorders

Open access
Haber, Suzanne N., Behrens, Timothy E.J.·2014·Neuron
DOI 10.1016/j.neuron.2014.08.031PMC PMC4255982
Open this paper in CoChat — free accountOpen PDF

Abstract

Coupling stimuli and actions with positive or negative outcomes facilitates the selection of appropriate actions. Several brain regions are involved in the development of goal-directed behaviors and habit formation during incentive-based learning. This Review focuses on higher cognitive control of decision making and the cortical and subcortical structures and connections that attribute value to stimuli, associate that value with choices, and select an action plan. Delineating the connectivity between these areas is fundamental for understanding how brain regions work together to evaluate stimuli, develop actions plans, and modify behavior, as well as for elucidating the pathophysiology of psychiatric diseases.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.neuron.2014.08.031

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The corpus callosum carries white matter bundles containing axons from prefrontal cortex and striatal regions.

    “The corpus callosum carries white matter bundles containing axons from prefrontal cortex and striatal regions [90].”

    From Linking haploinsufficiency of the autism- and schizophrenia-associated gene Cyfip1 with striatal-limbic-cortical network dysfunction and cognitive inflexibility (2024) · cites this paper as [90]

    The OFC and Insula and vmPFC sections describe bundles of prefrontal axons reaching or entering the corpus callosum. They do not say the callosum carries axons from striatal regions; the vmPFC section instead describes a separate bundle entering the striatum. Page numbers are unavailable in our copy. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • A similar division between an emotional and a non-emotional dimension can be discerned in the dopamine system as for the prefrontal and BG circuits.

    “A similar division between an “emotional” and a “non-emotional” dimension can also be discerned in the dopamine system as for the prefrontal and BG circuits (Williams and Goldman-Rakic, 1998; Björklund and Dunnett, 2007; Haber and Behrens, 2014; Figures 10A,B).”

    From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Haber and Behrens, 2014

  • The distinction between OFC/rACC (including vmPFC) and dlPFC/cACC is mirrored in the circuits linking PFC/ACC with BG.

    “In line with this idea, the distinction between OFC/rACC (including vmPFC) and dlPFC/cACC is mirrored in the circuits linking PFC/ACC with BG (Graybiel, 2008; Haber and Knutson, 2010; Haber and Behrens, 2014).”

    From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Haber and Behrens, 2014

  • rACC/vmPFC and OFC are particularly strongly connected with ventral striatum, while cACC and dlPFC are strongly connected with dorsal striatum in a graded manner.

    “While rACC/vmPFC and OFC are particularly strongly connected with ventral striatum, the cACC and dlPFC are strongly connected with dorsal striatum in a graded manner (Graybiel, 2008; Haber and Knutson, 2010; Haber and Behrens, 2014).”

    From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Haber and Behrens, 2014

  • The PFC-BG-thalamus-PFC circuit is organized as parallel loops that are both segregated and integrated.

    “The PFC-BG-thalamus-PFC circuit is organized as parallel loops that are both segregated and integrated (Graybiel, 2008; Haber and Knutson, 2010; Haber and Behrens, 2014).”

    From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Haber and Behrens, 2014

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 192 · Cited by 230

Research works printed but not linked: 148

  1. Alexander WH Brown JW 2011 Medial prefrontal cortex as an action-outcome predictor Nat Neurosci 14 1338 1344 21926982 PMC3183374
  2. Alexander GE Crutcher MD DeLong MR 1990 Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, “prefrontal” and “limbic” functions Prog Brain Res 85 119 146 2094891
  3. Apicella P Scarnati E Schultz W 1991 Tonically discharging neurons of monkey striatum respond to preparatory and rewarding stimuli Exp Brain Res 84 672 675 1864338
  4. Averbeck BB Lehman J Jacobson M Haber SN 2014 Estimates of projection overlap and zones of convergence within Frontal-Striatal Circuits J Neurosci 34 9497 9505 25031393 PMC4099536
  5. Baliki MN Mansour A Baria AT Huang L Berger SE Fields HL Apkarian AV 2013 Parceling human accumbens into putative core and shell dissociates encoding of values for reward and pain J Neurosci 33 16383 16393 24107968 PMC3792469
  6. Barbas H 2007 Specialized elements of orbitofrontal cortex in primates Ann N Y Acad Sci 1121 10 32 17698996
  7. Barron HC Dolan RJ Behrens TE 2013 Online evaluation of novel choices by simultaneous representation of multiple memories Nat Neurosci 16 1492 1498 24013592 PMC4001211
  8. Bartra O McGuire JT Kable JW 2013 The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value Neuroimage 76 412 427 23507394 PMC3756836
  9. Beckmann M Johansen-Berg H Rushworth MF 2009 Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization J Neurosci 29 1175 1190 19176826 PMC6665147
  10. Belin D Everitt BJ 2008 Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum Neuron 57 432 441 18255035
  11. Bonnici HM Chadwick MJ Lutti A Hassabis D Weiskopf N Maguire EA 2012 Detecting representations of recent and remote autobiographical memories in vmPFC and hippocampus J Neurosci 32 16982 16991 23175849 PMC3507449
  12. Boorman ED Behrens TE Woolrich MW Rushworth MF 2009 How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action Neuron 62 733 743 19524531
  13. Boorman ED Rushworth MF Behrens TE 2013 Ventromedial pre-frontal and anterior cingulate cortex adopt choice and default reference frames during sequential multi-alternative choice J Neurosci 33 2242 2253 23392656 PMC3743024
  14. Bouret S Richmond BJ 2010 Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys J Neurosci 30 8591 8601 20573905 PMC2942083
  15. Burke KA Franz TM Miller DN Schoenbaum G 2008 The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards Nature 454 340 344 18563088 PMC2727745
  16. Camille N Griffiths CA Vo K Fellows LK Kable JW 2011a Ventromedial frontal lobe damage disrupts value maximization in humans J Neurosci 31 7527 7532 21593337 PMC3122333
  17. Carmichael ST Price JL 1995a Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys J Comp Neurol 363 615 641 8847421
  18. Carmichael ST Price JL 1995b Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys J Comp Neurol 363 642 664 8847422
  19. Chiavaras MM Petrides M 2000 Orbitofrontal sulci of the human and macaque monkey brain J Comp Neurol 422 35 54 10842217
  20. Chikama M McFarland NR Amaral DG Haber SN 1997 Insular cortical projections to functional regions of the striatum correlate with cortical cytoarchitectonic organization in the primate J Neurosci 17 9686 9705 9391023 PMC6573402
  21. Chowdhury R Guitart-Masip M Lambert C Dayan P Huys Q Düzel E Dolan RJ 2013 Dopamine restores reward prediction errors in old age Nat Neurosci 16 648 653 23525044 PMC3672991
  22. Cisek P 2007 Cortical mechanisms of action selection: the affordance competition hypothesis Philos Trans R Soc Lond B Biol Sci 362 1585 1599 17428779 PMC2440773
  23. Cisek P 2012 Making decisions through a distributed consensus Curr Opin Neurobiol 22 927 936 22683275
  24. Clithero JA Rangel A 2013 Informatic parcellation of the network involved in the computation of subjective value Soc Cogn Affect Neurosci Published online August 21, 2013. http://dx.doi.org/10.1093/scan/nst106 PMC4158359 23887811 · DOI · Paper page
  25. Cohen JD McClure SM Yu AJ 2007 Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration Philos Trans R Soc Lond B Biol Sci 362 933 942 17395573 PMC2430007
  26. Cohen MX Schoene-Bake JC Elger CE Weber B 2009 Connectivity-based segregation of the human striatum predicts personality characteristics Nat Neurosci 12 32 34 19029888
  27. Cromwell HC Schultz W 2003 Effects of expectations for different reward magnitudes on neuronal activity in primate striatum J Neurophysiol 89 2823 2838 12611937
  28. D’Ardenne K McClure SM Nystrom LE Cohen JD 2008 BOLD responses reflecting dopaminergic signals in the human ventral tegmental area Science 319 1264 1267 18309087
  29. Daw ND O’Doherty JP Dayan P Seymour B Dolan RJ 2006 Cortical substrates for exploratory decisions in humans Nature 441 876 879 16778890 PMC2635947
  30. Dayan P Niv Y Seymour B Daw ND 2006 The misbehavior of value and the discipline of the will Neural Netw 19 1153 1160 16938432
  31. Del Casale A Kotzalidis GD Rapinesi C Serata D Ambrosi E Simonetti A Pompili M Ferracuti S Tatarelli R Girardi P 2011 Functional neuroimaging in obsessive-compulsive disorder Neuropsychobiology 64 61 85 21701225
  32. Delgado MR Miller MM Inati S Phelps EA 2005 An fMRI study of reward-related probability learning Neuroimage 24 862 873 15652321
  33. Doeller CF Barry C Burgess N 2010 Evidence for grid cells in a human memory network Nature 463 657 661 20090680 PMC3173857
  34. Draganski B Kherif F Klöppel S Cook PA Alexander DC Parker GJ Deichmann R Ashburner J Frackowiak RS 2008 Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia J Neurosci 28 7143 7152 18614684 PMC6670486
  35. Everitt BJ Robbins TW 2005 Neural systems of reinforcement for drug addiction: from actions to habits to compulsion Nat Neurosci 8 1481 1489 16251991
  36. Everitt BJ Belin D Economidou D Pelloux Y Dalley JW Robbins TW 2008 Review. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction Philos Trans R Soc Lond B Biol Sci 363 3125 3135 18640910 PMC2607322
  37. Feldman RP Alterman RL Goodrich JT 2001 Contemporary psychosurgery and a look to the future J Neurosurg 95 944 956 11765838
  38. Fellows LK Farah MJ 2003 Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm Brain 126 1830 1837 12821528
  39. Fitzgerald KD Welsh RC Gehring WJ Abelson JL Himle JA Liberzon I Taylor SF 2005 Error-related hyperactivity of the anterior cingulate cortex in obsessive-compulsive disorder Biol Psychiatry 57 287 294 15691530
  40. Fox MD Snyder AZ Vincent JL Corbetta M Van Essen DC Raichle ME 2005 The human brain is intrinsically organized into dynamic, anticorrelated functional networks Proc Natl Acad Sci USA 102 9673 9678 15976020 PMC1157105
  41. Frankle WG Laruelle M Haber SN 2006 Prefrontal cortical projections to the midbrain in primates: evidence for a sparse connection Neuropsychopharmacology 31 1627 1636 16395309
  42. Freedman LJ Insel TR Smith Y 2000 Subcortical projections of area 25 (subgenual cortex) of the macaque monkey J Comp Neurol 421 172 188 10813780
  43. Frith CD Friston K Liddle PF Frackowiak RS 1991 Willed action and the prefrontal cortex in man: a study with PET Proc Biol Sci 244 241 246 1679944
  44. Fudge JL Haber SN 2001 Bed nucleus of the stria terminalis and extended amygdala inputs to dopamine subpopulations in primates Neuroscience 104 807 827 11440812
  45. Fudge JL Kunishio K Walsh P Richard C Haber SN 2002 Amygdaloid projections to ventromedial striatal subterritories in the primate Neuroscience 110 257 275 11958868
  46. Giménez-Amaya JM McFarland NR de las Heras S Haber SN 1995 Organization of thalamic projections to the ventral striatum in the primate J Comp Neurol 354 127 149 7542290
  47. Goldman-Rakic PS Bergson C Krimer LS Lidow MS Williams SM Williams GV 1999 The primate mesocortical dopamine system Handbook of Chemical Neuroanatomy Chapter V Bloom FE Bjorklund A Hokfelt T Amsterdam Elsevier Science 403 428
  48. Goldstein RZ Volkow ND 2002 Drug addiction and its underlying neurobiological basis: neuroimaging evidence for the involvement of the frontal cortex Am J Psychiatry 159 1642 1652 12359667 PMC1201373
  49. Groenewold NA Opmeer EM de Jonge P Aleman A Costafreda SG 2013 Emotional valence modulates brain functional abnormalities in depression: evidence from a meta-analysis of fMRI studies Neurosci Biobehav Rev 37 152 163 23206667
  50. Guitart-Masip M Chowdhury R Sharot T Dayan P Duzel E Dolan RJ 2012 Action controls dopaminergic enhancement of reward representations Proc Natl Acad Sci USA 109 7511 7516 22529363 PMC3358848
  51. Haber SN 1987 Anatomical relationship between the basal ganglia and the basal nucleus of Meynert in human and monkey forebrain Proc Natl Acad Sci USA 84 1408 1412 3469674 PMC304439
  52. Haber SN Lynd E Klein C Groenewegen HJ 1990 Topographic organization of the ventral striatal efferent projections in the rhesus monkey: an anterograde tracing study J Comp Neurol 293 282 298 19189717
  53. Haber SN Lynd-Balta E Mitchell SJ 1993 The organization of the descending ventral pallidal projections in the monkey J Comp Neurol 329 111 128 8454722
  54. Haber SN Fudge JL McFarland NR 2000 Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum J Neurosci 20 2369 2382 10704511 PMC6772499
  55. Haber SN Kim KS Mailly P Calzavara R 2006 Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning J Neurosci 26 8368 8376 16899732 PMC6673798
  56. Hamilton JP Etkin A Furman DJ Lemus MG Johnson RF Gotlib IH 2012 Functional neuroimaging of major depressive disorder: a meta-analysis and new integration of base line activation and neural response data Am J Psychiatry 169 693 703 22535198 PMC11889638
  57. Hampton AN Bossaerts P O’Doherty JP 2006 The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans J Neurosci 26 8360 8367 16899731 PMC6673813
  58. Hare TA Camerer CF Knoepfle DT Rangel A 2010 Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition J Neurosci 30 583 590 20071521 PMC6633003
  59. Harlow JM 1848 Passage of an iron rod through the head Boston Med Surg J 39 389 393 PMC9904626 37319500
  60. Hassani OK Cromwell HC Schultz W 2001 Influence of expectation of different rewards on behavior-related neuronal activity in the striatum J Neurophysiol 85 2477 2489 11387394
  61. Hayden BY Pearson JM Platt ML 2011b Neuronal basis of sequential foraging decisions in a patchy environment Nat Neurosci 14 933 939 21642973 PMC3553855
  62. Haynes WI Haber SN 2013 The organization of prefrontal-subthalamic inputs in primates provides an anatomical substrate for both functional specificity and integration: implications for Basal Ganglia models and deep brain stimulation J Neurosci 33 4804 4814 23486951 PMC3755746
  63. Heimer L 1978 The olfactory cortex and the ventral striatum Limbic Mechanisms Livingston KE Hornykiewicz O New York Plenum Press 95 187
  64. Hollerman JR Schultz W 1998 Dopamine neurons report an error in the temporal prediction of reward during learning Nat Neurosci 1 304 309 10195164
  65. Hunt LT Kolling N Soltani A Woolrich MW Rushworth MF Behrens TE 2012 Mechanisms underlying cortical activity during value-guided choice Nat Neurosci 15 470 476 S1 S3 22231429 PMC3378494
  66. Hunt LT Woolrich MW Rushworth MF Behrens TE 2013 Trial-type dependent frames of reference for value comparison PLoS Comput Biol 9 e1003225 24068906 PMC3772056
  67. Iversen SD Mishkin M 1970 Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity Exp Brain Res 11 376 386 4993199
  68. Izquierdo A Suda RK Murray EA 2004 Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency J Neurosci 24 7540 7548 15329401 PMC6729636
  69. Janowski V Camerer C Rangel A 2013 Empathic choice involves vmPFC value signals that are modulated by social processing implemented in IPL Soc Cogn Affect Neurosci 8 201 208 22349798 PMC3575723
  70. Jbabdi S Lehman JF Haber SN Behrens TE 2013 Human and monkey ventral prefrontal fibers use the same organizational principles to reach their targets: tracing versus tractography J Neurosci 33 3190 3201 23407972 PMC3602794
  71. Jocham G Hunt LT Near J Behrens TE 2012 A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex Nat Neurosci 15 960 961 22706268 PMC4050076
  72. Kable JW Glimcher PW 2009 The neurobiology of decision: consensus and controversy Neuron 63 733 745 19778504 PMC2765926
  73. Kasanetz F Riquelme LA Della-Maggiore V O’Donnell P Murer MG 2008 Functional integration across a gradient of corticostriatal channels controls UP state transitions in the dorsal striatum Proc Natl Acad Sci USA 105 8124 8129 18523020 PMC2430370
  74. Keedwell PA Chapman R Christiansen K Richardson H Evans J Jones DK 2012 Cingulum white matter in young women at risk of depression: the effect of family history and anhedonia Biol Psychiatry 72 296 302 22386005
  75. Kelley AE Berridge KC 2002 The neuroscience of natural rewards: relevance to addictive drugs J Neurosci 22 3306 3311 11978804 PMC6758373
  76. Kennerley SW Walton ME Behrens TE Buckley MJ Rushworth MF 2006 Optimal decision making and the anterior cingulate cortex Nat Neurosci 9 940 947 16783368
  77. Kennerly D Richter KM Good V Compton J Ballard DJ 2011 Journey to no preventable risk: the Baylor Health Care System patient safety experience Am J Med Qual 26 43 52 20935271
  78. Klein-Flügge MC Barron HC Brodersen KH Dolan RJ Behrens TE 2013 Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex J Neurosci 33 3202 3211 23407973 PMC3586675
  79. Kolling N Behrens TE Mars RB Rushworth MF 2012 Neural mechanisms of foraging Science 336 95 98 22491854 PMC3440844
  80. Koob GF Volkow ND 2010 Neurocircuitry of addiction Neuropsychopharmacology 35 217 238 19710631 PMC2805560
  81. Kringelbach ML Rolls ET 2003 Neural correlates of rapid reversal learning in a simple model of human social interaction Neuroimage 20 1371 1383 14568506
  82. Lavoie B Parent A 1994 Pedunculopontine nucleus in the squirrel monkey: cholinergic and glutamatergic projections to the substantia nigra J Comp Neurol 344 232 241 7915727
  83. Leckman JF Grice DE Boardman J Zhang H Vitale A Bondi C Alsobrook J Peterson BS Cohen DJ Rasmussen SA 1997 Symptoms of obsessive-compulsive disorder Am J Psychiatry 154 911 917 9210740
  84. Lee SW Shimojo S O’Doherty JP 2014 Neural computations underlying arbitration between model-based and model-free learning Neuron 81 687 699 24507199 PMC3968946
  85. Lehman JF Greenberg BD McIntyre CC Rasmussen SA Haber SN 2011 Rules ventral prefrontal cortical axons use to reach their targets: implications for diffusion tensor imaging tractography and deep brain stimulation for psychiatric illness J Neurosci 31 10392 10402 21753016 PMC3445013
  86. Levy R Friedman HR Davachi L Goldman-Rakic PS 1997 Differential activation of the caudate nucleus in primates performing spatial and nonspatial working memory tasks J Neurosci 17 3870 3882 9133405 PMC6573717
  87. Lewis DA 1992 The catecholaminergic innervation of primate prefrontal cortex J Neural Transm Suppl 36 179 200 1527517
  88. Lochner C Fouché JP du Plessis S Spottiswoode B Seedat S Fineberg N Chamberlain SR Stein DJ 2012 Evidence for fractional anisotropy and mean diffusivity white matter abnormalities in the internal capsule and cingulum in patients with obsessive-compulsive disorder J Psychiatry Neurosci 37 193 199 22297066 PMC3341411
  89. May P McHaffie JG Stanford TR Jiang H Costello MG Coizet V Hayes LM Haber SN Redgrave P 2009 Tectonigral projections in the primate: a pathway for pre-attentive sensory input to midbrain dopaminergic neurons Eur J Neurosci 29 575 587 19175405 PMC2856337
  90. Mayberg HS Lozano AM Voon V McNeely HE Seminowicz D Hamani C Schwalb JM Kennedy SH 2005 Deep brain stimulation for treatment-resistant depression Neuron 45 651 660 15748841
  91. McEnaney KW Butter CM 1969 Perseveration of responding and nonresponding in monkeys with orbital frontal ablations J Comp Physiol Psychol 68 558 561 4981118
  92. Meredith GE Pattiselanno A Groenewegen HJ Haber SN 1996 Shell and core in monkey and human nucleus accumbens identified with antibodies to calbindin-D28k J Comp Neurol 365 628 639 8742307
  93. Mesulam MM Mufson EJ 1993 The insula of reil in man and monkey Cerebral Cortex Peters A Jones EG New York Plenum Press 179 225
  94. Morecraft RJ Geula C Mesulam M-M 1992 Cytoarchitecture and neural afferents of orbitofrontal cortex in the brain of the monkey J Comp Neurol 323 341 358 1460107
  95. Morecraft RJ Stilwell-Morecraft KS Cipolloni PB Ge J McNeal DW Pandya DN 2012 Cytoarchitecture and cortical connections of the anterior cingulate and adjacent somatomotor fields in the rhesus monkey Brain Res Bull 87 457 497 22240273 PMC3295893
  96. Mori S Matsuura T Takino T Sano Y 1987 Light and electron microscopic immunohistochemical studies of serotonin nerve fibers in the substantia nigra of the rat, cat and monkey Anat Embryol (Berl) 176 13 18 3300422
  97. Nicolle A Klein-Flügge MC Hunt LT Vlaev I Dolan RJ Behrens TE 2012 An agent independent axis for executed and modeled choice in medial prefrontal cortex Neuron 75 1114 1121 22998878 PMC3458212
  98. O’Doherty J Rolls ET Francis S Bowtell R McGlone F Kobal G Renner B Ahne G 2000 Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex Neuroreport 11 893 897 10757540
  99. Olds J Milner P 1954 Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain J Comp Physiol Psychol 47 419 427 13233369
  100. Ongür D Price JL 2000 The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans Cereb Cortex 10 206 219 10731217
  101. Ongür D An X Price JL 1998 Prefrontal cortical projections to the hypothalamus in macaque monkeys J Comp Neurol 401 480 505 9826274
  102. Padoa-Schioppa C Assad JA 2006 Neurons in the orbitofrontal cortex encode economic value Nature 441 223 226 16633341 PMC2630027
  103. Padoa-Schioppa C Assad JA 2008 The representation of economic value in the orbitofrontal cortex is invariant for changes of menu Nat Neurosci 11 95 102 18066060 PMC2646102
  104. Papez JW 1995 A proposed mechnaism of emotion, 1937 J Neuropsychiatry Clin Neurosci 7 103 112 7711480
  105. Parent A Gravel S Boucher R 1981 The origin of forebrain afferents to the habenula in rat, cat and monkey Brain Res Bull 6 23 38 7470948
  106. Passingham RE Bengtsson SL Lau HC 2010 Medial frontal cortex: from self-generated action to reflection on one’s own performance Trends Cogn Sci 14 16 21 19969501 PMC2806969
  107. Pasupathy A Miller EK 2005 Different time courses of learning-related activity in the prefrontal cortex and striatum Nature 433 873 876 15729344
  108. Percheron G Filion M 1991 Parallel processing in the basal ganglia: up to a point Trends Neurosci 14 55 59 1708537
  109. Petrides M Pandya DN 1994 Comparative architectonic analysis of the human and macaque frontal cortex Handbook of Neuropsychology Boller F Grafman J Amsterdam Elsevier 17 58
  110. Phillips AG Fibiger HC 1978 The role of dopamine in maintaining intracranial self-stimulation in the ventral tegmentum, nucleus accumbens, and medial prefrontal cortex Can J Psychol 32 58 66 737577
  111. Pizzagalli DA Holmes AJ Dillon DG Goetz EL Birk JL Bogdan R Dougherty DD Iosifescu DV Rauch SL Fava M 2009 Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder Am J Psychiatry 166 702 710 19411368 PMC2735451
  112. Porrino LJ Lyons D Smith HR Daunais JB Nader MA 2004 Cocaine self-administration produces a progressive involvement of limbic, association, and sensorimotor striatal domains J Neurosci 24 3554 3562 15071103 PMC6729741
  113. Porrino LJ Smith HR Nader MA Beveridge TJ 2007 The effects of cocaine: a shifting target over the course of addiction Prog Neuropsychopharmacol Biol Psychiatry 31 1593 1600 17900777 PMC2211431
  114. Quilodran R Rothé M Procyk E 2008 Behavioral shifts and action valuation in the anterior cingulate cortex Neuron 57 314 325 18215627
  115. Raichle ME MacLeod AM Snyder AZ Powers WJ Gusnard DA Shulman GL 2001 A default mode of brain function Proc Natl Acad Sci USA 98 676 682 11209064 PMC14647
  116. Rangel A Hare T 2010 Neural computations associated with goal-directed choice Curr Opin Neurobiol 20 262 270 20338744
  117. Rempel-Clower NL Barbas H 1998 Topographic organization of connections between the hypothalamus and prefrontal cortex in the rhesus monkey J Comp Neurol 398 393 419 9714151
  118. Rudebeck PH Murray EA 2011 Balkanizing the primate orbitofrontal cortex: distinct subregions for comparing and contrasting values Ann N Y Acad Sci 1239 1 13 22145870 PMC3951748
  119. Rudebeck PH Behrens TE Kennerley SW Baxter MG Buckley MJ Walton ME Rushworth MF 2008 Frontal cortex subregions play distinct roles in choices between actions and stimuli J Neurosci 28 13775 13785 19091968 PMC6671924
  120. Rudebeck PH Saunders RC Prescott AT Chau LS Murray EA 2013 Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating Nat Neurosci 16 1140 1145 23792944 PMC3733248
  121. Rushworth MF Kolling N Sallet J Mars RB 2012 Valuation and decision-making in frontal cortex: one or many serial or parallel systems? Curr Opin Neurobiol 22 946 955 22572389
  122. Schlösser RG Wagner G Schachtzabel C Peikert G Koch K Reichenbach JR Sauer H 2010 Fronto-cingulate effective connectivity in obsessive compulsive disorder: a study with fMRI and dynamic causal modeling Hum Brain Mapp 31 1834 1850 20162605 PMC6871164
  123. Schultz W 2002 Getting formal with dopamine and reward Neuron 36 241 263 12383780
  124. Selemon LD Goldman-Rakic PS 1985 Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey J Neurosci 5 776 794 2983048 PMC6565017
  125. Shadlen M Kiani R Hanks T Churchland A 2008 Neurobiology of Decision Making: An Intentional Framework Better Than Conscious? Decision Making, the Human Mind, and Implications For Institutions Singer CEW Cambridge MIT Press
  126. Shields DC Asaad W Eskandar EN Jain FA Cosgrove GR Flaherty AW Cassem EH Price BH Rauch SL Dougherty DD 2008 Prospective assessment of stereotactic ablative surgery for intractable major depression Biol Psychiatry 64 449 454 18486107
  127. Siegle GJ Steinhauer SR Thase ME Stenger VA Carter CS 2002 Can’t shake that feeling: event-related fMRI assessment of sustained amygdala activity in response to emotional information in depressed individuals Biol Psychiatry 51 693 707 11983183
  128. Spooren WPJM Lynd-Balta E Mitchell S Haber SN 1996 Ventral pallidostriatal pathway in the monkey: evidence for modulation of basal ganglia circuits J Comp Neurol 370 295 312 8799857
  129. Sugrue LP Corrado GS Newsome WT 2004 Matching behavior and the representation of value in the parietal cortex Science 304 1782 1787 15205529
  130. Surguladze S Brammer MJ Keedwell P Giampietro V Young AW Travis MJ Williams SC Phillips ML 2005 A differential pattern of neural response toward sad versus happy facial expressions in major depressive disorder Biol Psychiatry 57 201 209 15691520
  131. Takahashi YK Roesch MR Wilson RC Toreson K O’Donnell P Niv Y Schoenbaum G 2011 Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex Nat Neurosci 14 1590 1597 22037501 PMC3225718
  132. Takikawa Y Kawagoe R Hikosaka O 2002 Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons J Neurophysiol 87 508 515 11784766
  133. Tanaka SC Doya K Okada G Ueda K Okamoto Y Yamawaki S 2004 Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops Nat Neurosci 7 887 893 15235607
  134. Togao O Yoshiura T Nakao T Nabeyama M Sanematsu H Nakagawa A Noguchi T Hiwatashi A Yamashita K Nagao E 2010 Regional gray and white matter volume abnormalities in obsessive-compulsive disorder: a voxel-based morphometry study Psychiatry Res 184 29 37 20833001
  135. Tziortzi AC Haber SN Searle GE Tsoumpas C Long CJ Shotbolt P Douaud G Jbabdi S Behrens TE Rabiner EA 2014 Connectivity-based functional analysis of dopamine release in the striatum using diffusion-weighted MRI and positron emission tomography Cereb Cortex 24 1165 1177 23283687 PMC3977617
  136. Ullsperger M von Cramon DY 2003 Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging J Neurosci 23 4308 4314 12764119 PMC6741115
  137. Volkow ND Fowler JS 2000 Addiction, a disease of compulsion and drive: involvement of the orbitofrontal cortex Cereb Cortex 10 318 325 10731226
  138. Volkow ND Wang GJ Telang F Fowler JS Logan J Childress AR Jayne M Ma Y Wong C 2006 Cocaine cues and dopamine in dorsal striatum: mechanism of craving in cocaine addiction J Neurosci 26 6583 6588 16775146 PMC6674019
  139. Volkow ND Fowler JS Wang GJ Telang F Logan J Jayne M Ma Y Pradhan K Wong C Swanson JM 2010 Cognitive control of drug craving inhibits brain reward regions in cocaine abusers Neuroimage 49 2536 2543 19913102 PMC2818484
  140. Wallis JD 2010 Polar exploration Nat Neurosci 13 7 8 20033080
  141. Walton ME Devlin JT Rushworth MF 2004 Interactions between decision making and performance monitoring within prefrontal cortex Nat Neurosci 7 1259 1265 15494729
  142. Walton ME Behrens TE Buckley MJ Rudebeck PH Rushworth MF 2010 Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning Neuron 65 927 939 20346766 PMC3566584
  143. Watanabe K Lauwereyns J Hikosaka O 2003 Neural correlates of rewarded and unrewarded eye movements in the primate caudate nucleus J Neurosci 23 10052 10057 14602819 PMC6740860
  144. Williams SM Goldman-Rakic PS 1998 Widespread origin of the primate mesofrontal dopamine system Cereb Cortex 8 321 345 9651129
  145. Wise RA 2002 Brain reward circuitry: insights from unsensed incentives Neuron 36 229 240 12383779
  146. Wittmann BC Schott BH Guderian S Frey JU Heinze HJ Düzel E 2005 Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation Neuron 45 459 467 15694331
  147. Wunderlich K Beierholm UR Bossaerts P O’Doherty JP 2011 The human prefrontal cortex mediates integration of potential causes behind observed outcomes J Neurophysiol 106 1558 1569 21697443 PMC3174823
  148. Záborszky L Cullinan WE 1992 Projections from the nucleus accumbens to cholinergic neurons of the ventral pallidum: a correlated light and electron microscopic double-immunolabeling study in rat Brain Res 570 92 101 1617433

Authors
Haber, S. N., & Behrens, T. E. J.
Affiliations
  • University of Rochester Medicine (US)
  • Wellcome Centre for Human Neuroimaging (GB)
Corresponding author
Haber, Suzanne N.
ORCID
Venue
Neuron
Publisher
Elsevier BV
Published
2014-09
Volume
83
Issue
5
Pages
1019-1039
ISSN
0896-6273 (ISSN-L)
DOI
10.1016/j.neuron.2014.08.031
PMC
PMC4255982
OpenAlex
W2104907299
Cited by
230
References
192
Citations by year
2026: 12 · 2025: 17 · 2024: 15 · 2023: 14 · 2022: 16 · 2021: 22 · 2020: 21 · 2019: 19 · 2018: 26 · 2017: 28 · 2016: 20 · 2015: 17 · 2014: 3
FWCI
2.19
Type
journal article
Language
en
Open access
Licence
Locations
  • Neuron (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • Wellcome Trust (091593, WT088313AIa)
  • National Institutes of Health (5p50mh086400-05)
  • National Institute of Mental Health (R01MH073111, P-50-MH-086400, MH086400, MH73111, P50MH086404, MH086404, R01MH045573)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords
reward processing, goal-directed behavior, habit formation, decision-making, cognitive control, neural circuits, cortical-subcortical connectivity, value attribution, action selection, mental illness, pathophysiology
MeSH terms
Brain, Brain Mapping, Humans, Learning Disabilities, Motivation, Nerve Net, Neural Pathways

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review