Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 209

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI

Open access
Badre, D., Frank, M. J.·2012·Cerebral Cortex

Abstract

The frontal lobes may be organized hierarchically such that more rostral frontal regions modulate cognitive control operations in caudal regions. In our companion paper (Frank MJ, Badre D. 2011. Mechanisms of hierarchical reinforcement learning in corticostriatal circuits I: computational analysis. 22:509-526), we provide novel neural circuit and algorithmic models of hierarchical cognitive control in cortico-striatal circuits. Here, we test key model predictions using functional magnetic resonance imaging (fMRI). Our neural circuit model proposes that contextual representations in rostral frontal cortex influence the striatal gating of contextual representations in caudal frontal cortex. Reinforcement learning operates at each level, such that the system adaptively learns to gate higher order contextual information into rostral regions. Our algorithmic Bayesian "mixture of experts" model captures the key computations of this neural model and provides trial-by-trial estimates of the learner's latent hypothesis states. In the present paper, we used these quantitative estimates to reanalyze fMRI data from a hierarchical reinforcement learning task reported in Badre D, Kayser AS, D'Esposito M. 2010. Frontal cortex and the discovery of abstract action rules. Neuron. 66:315--326. Results validate key predictions of the models and provide evidence for an individual cortico-striatal circuit for reinforcement learning of hierarchical structure at a specific level of policy abstraction. These findings are initially consistent with the proposal that hierarchical control in frontal cortex may emerge from interactions among nested cortico-striatal circuits at different levels of abstraction.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/cercor/bhr117

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 27

  1. Badre, 2007, Journal of Cognitive Neuroscience, 19, 2082, 10.1162/jocn.2007.19.12.2082 · DOI · Paper page
  2. Badre, 2009, Nature neuroscience, 12, 515, 10.1038/nn.2277 · DOI · Paper page
  3. Badre, 2010, 66, 315, 10.1016/j.neuron.2010.03.025 · DOI · Paper page
  4. 2004, 41, 473
  5. Brown, 2004, Neural networks : the official journal of the International Neural Network Society, 17, 471, 10.1016/j.neunet.2003.08.006 · DOI · Paper page
  6. Bunge, 2004, Cognitive, Affective, & Behavioral Neuroscience, 4, 564, 10.3758/CABN.4.4.564 · DOI · Paper page
  7. Cohen, 2009, Behavioural brain research, 199, 141, 10.1016/j.bbr.2008.09.029 · DOI · Paper page
  8. Dale, 1999, Human brain mapping, 8, 109, 10.1002/(SICI)1097-0193(1999)8:2/3<109::AID-HBM7>3.0.CO;2-W · doi:10.1002/(sici)1097-0193(1999)8:2/3<109::aid-hbm7>3.0.co;2-w
  9. Draganski, 2008, Journal of Neuroscience, 28, 7143, 10.1523/JNEUROSCI.1486-08.2008 · DOI
  10. Frank, 2005, Journal of Cognitive Neuroscience, 17, 51, 10.1162/0898929052880093 · DOI · Paper page
  11. Frank, 2006, Behavioral neuroscience, 120, 497, 10.1037/0735-7044.120.3.497 · DOI · Paper page
  12. 2001, 30, 319
  13. Gruber, 2006, Journal of computational neuroscience, 20, 153, 10.1007/s10827-005-5705-x · DOI · Paper page
  14. Inase, 1999, Brain research, 833, 191, 10.1016/S0006-8993(99)01531-0 · DOI · Paper page
  15. KEMP, 1970, Brain, 93, 525, 10.1093/brain/93.3.525 · DOI · Paper page
  16. 2006, 50, 963
  17. Koechlin, 2003, Science, 302, 1181, 10.1126/science.1088545 · DOI · Paper page
  18. 2004, Cerebral Cortex, 14, 1302, 10.1093/cercor/bhh091 · DOI · Paper page
  19. Leh ricy, 2004, Annals of neurology, 55, 522, 10.1002/ana.20030 · DOI · Paper page
  20. 2003, 38, 339
  21. Miller, 2001, Annual review of neuroscience, 24, 167, 10.1146/annurev.neuro.24.1.167 · DOI · Paper page
  22. 2003, 38, 329
  23. 2006, Neural Computation, 18, 283, 10.1162/089976606775093909 · DOI · Paper page
  24. Pessiglione, 2006, Nature; Physical Science (London), 442, 1042, 10.1038/nature05051 · DOI · Paper page
  25. Schonberg, 2010, 49, 772, 10.1016/j.neuroimage.2009.08.011 · DOI
  26. Shen, 2008, Science, 321, 848, 10.1126/science.1160575 · DOI · Paper page
  27. Voon, 2010, 65, 135, 10.1016/j.neuron.2009.12.027 · DOI · Paper page

Cited by

See all 209

Metadata

Authors
Badre, D., & Frank, M. J.
Venue
Cerebral Cortex
Published
2011-06-21
Volume
22
Issue
3
Pages
527-536
ISSN
  • 1047-3211 (ISSN-L)
  • 1460-2199
OpenAlex
W2119842714
Cited by
209
References
12
FWCI
4.97
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI. https://app.cochat.ai/papers/10.1093/cercor/bhr117
The paper
Badre, D., & Frank, M. J. (2012). Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI. Cerebral Cortex. https://doi.org/10.1093/cercor/bhr117

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.