The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning
Open accessAbstract
What are the neural dynamics of choice processes during reinforcement learning? Two largely separate literatures have examined dynamics of reinforcement learning (RL) as a function of experience but assuming a static choice process, or conversely, the dynamics of choice processes in decision making but based on static decision values. Here we show that human choice processes during RL are well described by a drift diffusion model (DDM) of decision making in which the learned trial-by-trial reward values are sequentially sampled, with a choice made when the value signal crosses a decision threshold. Moreover, simultaneous fMRI and EEG recordings revealed that this decision threshold is not fixed across trials but varies as a function of activity in the subthalamic nucleus (STN) and is further modulated by trial-by-trial measures of decision conflict and activity in the dorsomedial frontal cortex (pre-SMA BOLD and mediofrontal theta in EEG). These findings provide converging multimodal evidence for a model in which decision threshold in reward-based tasks is adjusted as a function of communication from pre-SMA to STN when choices differ subtly in reward values, allowing more time to choose the statistically more rewarding option.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726 · cited 3×
“…have applied DM models to reward-based decisions, where the rate of evidence accumulation for one option over the other was proportional to the relative differences in reward values of those options (Krajbich et al., 2010; Cavanagh et al., 2011; Ratcliff and Frank, 2012; Cavanagh and Frank, 2014).”
BackgroundMethodSelf-citationVisual fixations and the computation and comparison of value in simple choice
Krajbich, I., Armel, C., & Rangel, A. (2010) · Nature Neuroscience · doi:10.1038/nn.2635 · Cited by 1,408
A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI
Allen, P. J., Josephs, O., & Turner, R. (2000) · NeuroImage · doi:10.1006/nimg.2000.0599 · Cited by 1,301
Aron, A. R., Behrens, T. E., Smith, S., Frank, M. J., & Poldrack, R. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0519-07.2007 · Cited by 982
Self-citationHemodynamic Signals Correlate Tightly with Synchronized Gamma Oscillations
Niessing, J., Ebisch, B., Schmidt, K. E., Niessing, M., Singer, W., & Galuske, R. A. W. (2005) · Science · doi:10.1126/science.1110948 · Cited by 806
Stewart, N., Chater, N., & Brown, G. D. A. (2006) · Cognitive Psychology · doi:10.1016/j.cogpsych.2005.10.003 · Cited by 737
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706
Self-citationNeurophysiology of the BOLD fMRI Signal in Awake Monkeys
Goense, J. B. M., & Logothetis, N. K. (2008) · Current Biology · doi:10.1016/j.cub.2008.03.054 · Cited by 583
Cited by
Diffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630
“Other tasks that have more interdisciplinary relationships include stop signal tasks [137,138], conflict tasks [70,71], reinforcement learning [69,139], preferential choice and value-based decisions (Box 7), and social decisions [140,141] (Box 7).”
BackgroundComputational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Self-citationHassani, S. A., Oemisch, M., Balcarras, M., Westendorff, S., Ardid, S., van der Meer, M. A., Tiesinga, P., & Womelsdorf, T. (2017) · Scientific Reports · doi:10.1038/srep40606 · Cited by 360
Frontosubthalamic Circuits for Control of Action and Cognition
Aron, A. R., Herz, D. M., Brown, P., Forstmann, B. U., & Zaghloul, K. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2348-16.2016 · Cited by 291
The drift diffusion model as the choice rule in reinforcement learning
Pedersen, M. L., Frank, M. J., & Biele, G. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1199-y · Cited by 283
Self-citation
Metadata
- Authors
- Frank, M. J., Gagne, C., Nyhus, E., Masters, S., Wiecki, T. V., Cavanagh, J. F., & Badre, D.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2015-01-14
- Volume
- 35
- Issue
- 2
- Pages
- 485-494
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1983818070
- Cited by
- 241
- References
- 12
- FWCI
- 14.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning. https://app.cochat.ai/papers/10.1523/jneurosci.2036-14.2015
- The paper
- Frank, M. J., Gagne, C., Nyhus, E., Masters, S., Wiecki, T. V., Cavanagh, J. F., & Badre, D. (2015). fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.2036-14.2015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.