Temporally Dissociable Contributions of Human Medial Prefrontal Subregions to Reward-Guided Learning
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
In decision making, dorsal and ventral medial prefrontal cortex show a sensitivity to key decision variables, such as reward prediction errors. It is unclear whether these signals reflect parallel processing of a common synchronous input to both regions, for example from mesocortical dopamine, or separate and consecutive stages in reward processing. These two perspectives make distinct predictions about the relative timing of feedback-related activity in each of these regions, a question we address here. To reconstruct the unique temporal contribution of dorsomedial (dmPFC) and ventromedial prefrontal cortex (vmPFC) to simultaneously measured EEG activity in human subjects, we developed a novel trialwise fMRI-informed EEG analysis that allows dissociating correlated and overlapping sources. We show that vmPFC uniquely contributes a sustained activation profile shortly after outcome presentation, whereas dmPFC contributes a later and more peaked activation pattern. This temporal dissociation is expressed mainly in the alpha band for a vmPFC signal, which contrasts with a theta based dmPFC signal. Thus, our data show reward-related vmPFC and dmPFC responses have distinct time courses and unique spectral profiles, findings that support distinct functional roles in a reward-processing network. SIGNIFICANCE STATEMENT: Multiple subregions of the medial prefrontal cortex are known to be involved in decision making and learning, and expose similar response patterns in fMRI. Here, we used a novel approach to analyzing simultaneous EEG-fMRI that allows to dissociate the individual time courses of brain regions. We find that vmPFC and dmPFC have distinguishable time courses and time-frequency patterns.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726 · cited 4×
“As a consequence, decision-making studies often restrict themselves to single event-related components, such as the feedback-related negativity (FRN; Holroyd and Coles, 2002; Walsh and Anderson, 2012) or frontal midline theta (Cohen, 2011; Cavanagh and Frank, 2014; Cavanagh and Shackman, 2015), both traditionally asso…”
BackgroundMethodInfluentialLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927 · cited 1×
“vmPFC and dmPFC form two key regions implicated in decision making and reward learning. vmPFC is consistently activated in functional MRI studies of reward processing and decisionmaking (Levy and Glimcher, 2012; Bartra et al., 2013; Clithero and Rangel, 2014).”
BackgroundMiltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.788 · Cited by 1,530
Event-related brain potentials in the study of visual selective attention
Hillyard, S. A., & Anllo-Vento, L. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.781 · Cited by 1,525 · cited 3×
“Source localization of the N1 to occipitotemporal areas in proximity of our functional ROI is widely reported (Hillyard and Anllo-Vento, 1998; Brem et al., 2006).”
BackgroundThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · cited 2×
“vmPFC is consistently activated in functional MRI studies of reward processing and decisionmaking (Levy and Glimcher, 2012; Bartra et al., 2013; Clithero and Rangel, 2014).”
BackgroundA Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI
Allen, P. J., Josephs, O., & Turner, R. (2000) · NeuroImage · doi:10.1006/nimg.2000.0599 · Cited by 1,301 · cited 1×
“We performed MR-artifact removal using sliding average subtraction (Allen et al., 2000), and in-built cardioballistic artifact removal with manual inspection.”
MethodConflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117 · cited 2×
“…choice (Bouret and Richmond, 2010; Strait et al., 2014). dmPFC is likewise activated in fMRI studies of reinforcement learning and action selection (Behrens et al., 2007; Botvinick, 2007; Hare et al., 2011; Vickery et al., 2011; Kolling et al., 2012; Boorman et al., 2013; Economides et al., 2014).”
BackgroundFrontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111
Medial prefrontal cortex as an action-outcome predictor
Alexander, W. H., & Brown, J. W. (2011) · Nature Neuroscience · doi:10.1038/nn.2921 · Cited by 1,000
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 2×
“Combined with evidence from single-unit recording and lesion studies (Kennerley et al., 2006; Seo and Lee, 2009; Sheth et al., 2012), this has led to the idea that dmPFC subserves a role in learning from outcomes, as well as in deploying learnt values in action selection (Alexander and Brown, 2011; Rushworth et al.”
BackgroundChoice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866 · cited 2×
“Two key subregions are a ventral portion beneath the genu of the corpus callosum (vmPFC; in particular medial area 10) and a dorsal portion that encompasses dorsal anterior cingulate cortex (dmPFC; in particular area 24, sometimes referred to as dACC; Ongür and Price, 2000; Rushworth and Behrens, 2008; Haber and Behre…”
BackgroundValue, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
Rossion, B., Gauthier, I., Tarr, M. J., Despland, P., Bruyer, R., Linotte, S., & Crommelinck, M. (2000) · Neuroreport · doi:10.1097/00001756-200001170-00014 · Cited by 738
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Fellows, L. K. (2003) · Brain · doi:10.1093/brain/awg180 · Cited by 631 · cited 1×
“Lesions to this region elicit alterations in subjects’ decision making behavior as well as in learning from reinforcement (Fellows and Farah, 2003, 2007).”
BackgroundKolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629 · cited 1×
“…choice (Bouret and Richmond, 2010; Strait et al., 2014). dmPFC is likewise activated in fMRI studies of reinforcement learning and action selection (Behrens et al., 2007; Botvinick, 2007; Hare et al., 2011; Vickery et al., 2011; Kolling et al., 2012; Boorman et al., 2013; Economides et al., 2014).”
BackgroundMultiple sparse priors for the M/EEG inverse problem.
Friston, K., Harrison, L., Daunizeau, J., Kiebel, S., Phillips, C., Trujillo-Barreto, N., Henson, R., Flandin, G., & Mattout, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.048 · Cited by 589 · cited 2×
“This is well in line with the visual N1/N170 component, often associated with activation in occipitotemporal regions (Hillyard and Anllo-Vento, 1998; Brem et al., 2006; Friston et al., 2008).”
BackgroundMethodA new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507 · cited 1×
“The medial prefrontal wall is important for reward-guided decision making, including learning and evaluating the incentive value of cues and actions (Rushworth et al., 2007, 2011; Schoenbaum et al., 2009; Wallis and Kennerley, 2010; Alexander and Brown, 2011; O’Doherty, 2011).”
BackgroundUncertainty in perception and the Hierarchical Gaussian Filter
Mathys, C. D., Lomakina, E. I., Daunizeau, J., Iglesias, S., Brodersen, K. H., Friston, K. J., & Stephan, K. E. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00825 · Cited by 465
Mechanisms underlying cortical activity during value-guided choice
Hunt, L. T., Kolling, N., Soltani, A., Woolrich, M. W., Rushworth, M. F. S., & Behrens, T. E. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3017 · Cited by 454
Self-citationHuman dorsal anterior cingulate cortex neurons mediate ongoing behavioural adaptation
Sheth, S. A., Mian, M. K., Patel, S. R., Asaad, W. F., Williams, Z. M., Dougherty, D. D., Bush, G., & Eskandar, E. N. (2012) · Nature · doi:10.1038/nature11239 · Cited by 441
Single-trial EEG–fMRI reveals the dynamics of cognitive function
Debener, S., Ullsperger, M., Siegel, M., & Engel, A. K. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.09.010 · Cited by 428
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · cited 2×
“1D) are similar to those identified using classic reinforcement learning models as shown in previous studies (Gläscher et al., 2009; Hauser et al., 2015).”
MethodHierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342
Fellows, L. K., & Farah, M. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl176 · Cited by 337 · cited 1×
“Lesions to this region elicit alterations in subjects’ decision making behavior as well as in learning from reinforcement (Fellows and Farah, 2003, 2007).”
BackgroundEichele, T., Specht, K., Moosmann, M., Jongsma, M. L. A., Quiroga, R. Q., Nordby, H., & Hugdahl, K. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0505508102 · Cited by 308
Reward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294 · cited 1×
“Single-unit recordings also provide evidence suggestive of a role in motivation and choice (Bouret and Richmond, 2010; Strait et al., 2014). dmPFC is likewise activated in fMRI studies of reinforcement learning and action selection (Behrens et al., 2007; Botvinick, 2007; Hare et al., 2011; Vickery…”
BackgroundThe Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects
FitzGerald, T. H. B., Seymour, B., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0717-09.2009 · Cited by 279
Self-citationHaber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230
Contributions of the ventromedial prefrontal cortex to goal-directed action selection
O’Doherty, J. P. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06290.x · Cited by 225
Inferring on the intentions of others by hierarchical Bayesian learning
Diaconescu, A. O., Mathys, C., Weber, L. A. E., Daunizeau, J., Kasper, L., Lomakina, E. I., Fehr, E., & Stephan, K. E. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003810 · Cited by 219 · cited 1×
“This model has been shown to outperform standard reinforcement learning models in many instances (Iglesias et al., 2013; Diaconescu et al., 2014; Hauser et al., 2014a; Vossel et al., 2014).”
MethodEvidence for developmental changes in the visual word processing network beyond adolescence
Brem, S., Bucher, K., Halder, P., Summers, P., Dietrich, T., Martin, E., & Brandeis, D. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.09.023 · Cited by 219
Self-citationConflict monitoring and error processing: New insights from simultaneous EEG–fMRI
Iannaccone, R., Hauser, T. U., Staempfli, P., Walitza, S., Brandeis, D., & Brem, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.10.028 · Cited by 210 · cited 4×
“With this linear regression analysis, we only account for linear relationships between an EEG and BOLD signal, as in previous EEG-informed fMRI analyses (Debener et al., 2005; Eichele et al., 2005; Baumeister et al., 2014; Becker et al., 2014; Boecker et al., 2014; Hauser et al., 2014a,b; Iannaccone et al., 2015).”
MethodSelf-citationHauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.018 · Cited by 203 · cited 2×
“Data from 17 of the subjects has been reported previously using different analysis methods (Hauser et al., 2014b, 2015).”
MethodSelf-citationBouret, S., & Richmond, B. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0049-10.2010 · Cited by 192 · cited 2×
“Single-unit recordings also provide evidence suggestive of a role in motivation and choice (Bouret and Richmond, 2010; Strait et al., 2014). dmPFC is likewise activated in fMRI studies of reinforcement learning and action selection (Behrens et al., 2007; Botvinick, 2007; Hare et al., 2011; Vickery…”
BackgroundHeterogeneous reward signals in prefrontal cortex
Wallis, J. D., & Kennerley, S. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.009 · Cited by 186 · cited 1×
“The medial prefrontal wall is important for reward-guided decision making, including learning and evaluating the incentive value of cues and actions (Rushworth et al., 2007, 2011; Schoenbaum et al., 2009; Wallis and Kennerley, 2010; Alexander and Brown, 2011; O’Doherty, 2011).”
BackgroundHauser, T. U., Iannaccone, R., Ball, J., Mathys, C., Brandeis, D., Walitza, S., & Brem, S. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1093 · Cited by 168
Self-citationBoecker, R., Holz, N. E., Buchmann, A. F., Blomeyer, D., Plichta, M. M., Wolf, I., Baumeister, S., Meyer-Lindenberg, A., Banaschewski, T., Brandeis, D., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0104185 · Cited by 157
Self-citationSpatial attention, precision, and Bayesian inference: a study of saccadic response speed
Vossel, S., Mathys, C., Daunizeau, J., Bauer, M., Driver, J., Friston, K. J., & Stephan, K. E. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs418 · Cited by 146 · cited 1×
“This model has been shown to outperform standard reinforcement learning models in many instances (Iglesias et al., 2013; Diaconescu et al., 2014; Hauser et al., 2014a; Vossel et al., 2014).”
Method
Cited by
The PhysIO Toolbox for Modeling Physiological Noise in fMRI Data
Kasper, L., Bollmann, S., Diaconescu, A. O., Hutton, C., Heinzle, J., Iglesias, S., Hauser, T. U., Sebold, M., Manjaly, Z.-M., Pruessmann, K. P., et al. (2017) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.10.019 · Cited by 409
Self-citationUnexpected arousal modulates the influence of sensory noise on confidence
Allen, M., Frank, D., Schwarzkopf, D. S., Fardo, F., Winston, J. S., Hauser, T. U., & Rees, G. (2016) · eLife · doi:10.7554/elife.18103 · Cited by 182
“05 cluster-extent correction, n = 500 permutations, height threshold t = 2) (Hayasaka et al., 2004; Hunt et al., 2013; Hauser et al., 2015) using custom code in MATLAB.”
MethodSelf-citationHauser, T. U., Moutoussis, M., Iannaccone, R., Brem, S., Walitza, S., Drechsler, R., Dayan, P., & Dolan, R. J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005440 · Cited by 85
Self-citationHauser, T. U., Iannaccone, R., Dolan, R. J., Ball, J., Hättenschwiler, J., Drechsler, R., Rufer, M., Brandeis, D., Walitza, S., & Brem, S. (2017) · Psychological Medicine · doi:10.1017/s0033291716003305 · Cited by 86
“2011) and the ventromedial prefrontal cortex (vmPFC) (Kennerley et al. 2011; Hauser et al. 2015a).”
BackgroundSelf-citation
Metadata
- Authors
- Hauser, T. U., Hunt, L. T., Iannaccone, R., Walitza, S., Brandeis, D., Brem, S., & Dolan, R. J.
- Venue
- Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2015-08-12
- Volume
- 35
- Issue
- 32
- Pages
- 11209-11220
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1932380198
- Cited by
- 46
- References
- 44
- FWCI
- 2.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.