Stable representations of decision variables for flexible behavior

Bari, Bilal A.; Grossman, Cooper D.; Lubin, Emily E.; Rajagopalan, Adithya E.; Cressy, Jianna I.; Cohen, Jeremiah Y.

doi:10.1016/j.neuron.2019.06.001

Cited by 173Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorNeural dynamics and brain function

Stable representations of decision variables for flexible behavior

Open access

Bari, Bilal A., Grossman, Cooper D., Lubin, Emily E., Rajagopalan, Adithya E., Cressy, Jianna I., Cohen, Jeremiah Y.·2019·Neuron

DOI 10.1016/j.neuron.2019.06.001PMC PMC7169950

Open this paper in CoChat — free account Open PDF

Abstract

Decisions occur in dynamic environments. In the framework of reinforcement learning, the probability of performing an action is influenced by decision variables. Discrepancies between predicted and obtained rewards (reward prediction errors) update these variables, but they are otherwise stable between decisions. Although reward prediction errors have been mapped to midbrain dopamine neurons, it is unclear how the brain represents decision variables themselves. We trained mice on a dynamic foraging task in which they chose between alternatives that delivered reward with changing probabilities. Neurons in the medial prefrontal cortex, including projections to the dorsomedial striatum, maintained persistent firing rate changes over long timescales. These changes stably represented relative action values (to bias choices) and total action values (to bias response times) with slow decay. In contrast, decision variables were weakly represented in the anterolateral motor cortex, a region necessary for generating choices. Thus, we define a stable neural mechanism to drive flexible behavior.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.neuron.2019.06.001

Cites

90 of 90 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Brain regions recruited by the dynamic foraging task are not required for the dynamic Pavlovian task.
“Also, the dynamic foraging task engages regions of the brain that are not necessary for the dynamic Pavlovian task.43”
From Serotonin neurons modulate learning rate through uncertainty (2022) · cites this paper as [43]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Fiji: an open-source platform for biological-image analysis
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2019 · Cited by 66,890 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
A robust and high-throughput Cre reporting and characterization system for the whole mouse brain
Madisen, L., Zwingman, T. A., Sunkin, S. M., Oh, S. W., Zariwala, H. A., Gu, H., Ng, L. L., Palmiter, R. D., Hawrylycz, M. J., Jones, A. R., et al. (2010) · Nature Neuroscience · doi:10.1038/nn.2467 · Cited by 6,907 · see citing works
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · see citing works
Neuro-dynamic Programming
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601 · see citing works
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 3,153 · see citing works
Independent optical excitation of distinct neural populations
Klapoetke, N. C., Murata, Y., Kim, S. S., Pulver, S. R., Birdsey-Benson, A., Cho, Y. K., Morimoto, T. K., Chuong, A. S., Carpenter, E. J., Tian, Z., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2836 · Cited by 2,344 · see citing works
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering
Quiroga, R. Q., Nadasdy, Z., & Ben-Shaul, Y. (2004) · Neural Computation · doi:10.1162/089976604774201631 · Cited by 2,119 · see citing works
Untitled work
(1986) · Cited by 2,022 · see citing works
Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639 · see citing works
Rapid, reversible activation of AgRP neurons drives feeding behavior in mice
Krashes, M. J., Koda, S., Ye, C., Rogan, S. C., Adams, A. C., Cusher, D. S., Maratos-Flier, E., Roth, B. L., & Lowell, B. B. (2011) · Journal of Clinical Investigation · doi:10.1172/jci46229 · Cited by 1,578 · see citing works
Spontaneous behaviors drive multidimensional, brainwide activity
Stringer, C., Pachitariu, M., Steinmetz, N., Reddy, C. B., Carandini, M., & Harris, K. D. (2019) · Science · doi:10.1126/science.aav7893 · Cited by 1,510 · see citing works
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · see citing works
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318 · see citing works
Self-citation
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Synaptic theory of working memory
Mongillo, G., Barak, O., & Tsodyks, M. (2008) · Science · doi:10.1126/science.1150769 · Cited by 1,253 · see citing works
A Designer AAV Variant Permits Efficient Retrograde Access to Projection Neurons
Tervo, D. G. R., Hwang, B., Viswanathan, S., Gaj, T., Lavzin, M., Ritola, K., Lindo, S. E., Michael, S. C., Кулешова, Е. П., Ojala, D. S., et al. (2016) · Neuron · doi:10.1016/j.neuron.2016.09.021 · Cited by 1,170 · see citing works
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · see citing works
Transgenic mice for intersectional targeting of neural sensors and effectors with high specificity and performance
Madisen, L., Garner, A. R., Shimaoka, D., Chuong, A. S., Klapoetke, N. C., Li, L., van der Bourg, A., Niino, Y., Egolf, L., Monetti, C., et al. (2015) · Neuron · doi:10.1016/j.neuron.2015.02.022 · Cited by 1,114 · see citing works
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030 · see citing works
Neuro-Dynamic Programming
(2010) · Springer eBooks · doi:10.1007/978-0-387-30164-8_588 · Cited by 978 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Choice-specific sequences in parietal cortex during a virtual-navigation decision task
Harvey, C. D., Coen, P., & Tank, D. W. (2012) · Nature · doi:10.1038/nature10918 · Cited by 916 · see citing works
Mesolimbic dopamine signals the value of work
Hamid, A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Weele, C. M. V., Kennedy, R. T., Aragona, B. J., & Berke, J. D. (2015) · Nature Neuroscience · doi:10.1038/nn.4173 · Cited by 815 · see citing works
Flow of cortical activity underlying a tactile decision in mice
Guo, Z. V., Li, N., Huber, D., Ophir, E., Gutnisky, D., Ting, J. T., Feng, G., & Svoboda, K. (2014) · Neuron · doi:10.1016/j.neuron.2013.10.020 · Cited by 715 · cited 1× · see citing works
“ALM (the tongue premotor cortex), which is necessary for generating reward-guided licks (Komiyama et al., 2010; Guo et al., 2014; Li et al., 2015).”
Background
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Quantitative measures of cluster quality for use in extracellular recordings
Schmitzer-Torbert, N. C., Jackson, J. C., Henze, D. A., Harris, K., & Redish, A. D. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2004.09.066 · Cited by 642 · see citing works
Prefrontal cortex as a meta-reinforcement learning system
Wang, J. X., Kurth-Nelson, Z., Kumaran, D., Tirumala, D., Soyer, H., Leibo, J. Z., Hassabis, D., & Botvinick, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0147-8 · Cited by 596 · see citing works
A motor cortex circuit for motor planning and movement
Li, N., Chen, T.-W., Guo, Z. V., Gerfen, C., & Svoboda, K. (2015) · Nature · doi:10.1038/nature14178 · Cited by 578 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485 · see citing works
A whole-brain atlas of inputs to serotonergic neurons of the dorsal and median raphe nuclei
Pollak Dorocic, I., Fürth, D., Xuan, Y., Johansson, Y., Pozzi, L., Silberberg, G., Carlén, M., & Meletis, K. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.002 · Cited by 451 · see citing works
Learning-related fine-scale specificity imaged in motor cortex circuits of behaving mice
Komiyama, T., Sato, T. R., O’Connor, D. H., Zhang, Y.-X., Huber, D., Hooks, B. M., Gabitto, M., & Svoboda, K. (2010) · Nature · doi:10.1038/nature08897 · Cited by 447 · see citing works
Noradrenaline and Dopamine Neurons in the Reward/Effort Trade-Off: A Direct Electrophysiological Comparison in Behaving Monkeys
Varazzani, C., San‐Galli, A., Gilardeau, S., & Bouret, S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0454-15.2015 · Cited by 446 · see citing works
Medial prefrontal cell activity signaling prediction errors of action values
Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007) · Nature Neuroscience · doi:10.1038/nn1890 · Cited by 440 · see citing works
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 411 · see citing works
Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value
Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., & Wilbrecht, L. (2012) · Nature Neuroscience · doi:10.1038/nn.3188 · Cited by 399 · see citing works
Serotonergic neurons signal reward and punishment on multiple timescales
Cohen, J. Y., Amoroso, M. W., & Uchida, N. (2015) · eLife · doi:10.7554/elife.06346 · Cited by 388 · see citing works
Self-citation
Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making
Sul, J. H., Kim, H., Huh, N., Lee, D., & Jung, M. W. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.033 · Cited by 372 · see citing works
PINP: A New Method of Tagging Neuronal Populations for Identification during In Vivo Electrophysiological Recording
Lima, S. Q., Hromádka, T., Znamenskiy, P., & Zador, A. M. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006099 · Cited by 356 · see citing works
Determination of antidromic excitation by the collision test: Problems of interpretation
Fuller, J. H., & Schlag, J. D. (1976) · Brain Research · doi:10.1016/0006-8993(76)90284-5 · Cited by 341 · see citing works
Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target
Parker, N. F., Cameron, C. M., Taliaferro, J. P., Lee, J., Choi, J. Y., Davidson, T. J., Daw, N. D., & Witten, I. B. (2016) · Nature Neuroscience · doi:10.1038/nn.4287 · Cited by 340 · see citing works
Presynaptic partners of dorsal raphe serotonergic and GABAergic neurons
Weissbourd, B., Ren, J., DeLoach, K. E., Guenthner, C. J., Miyamichi, K., & Luo, L. (2014) · Neuron · doi:10.1016/j.neuron.2014.06.024 · Cited by 337 · see citing works
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia
Ito, M., & Doya, K. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.6157-08.2009 · Cited by 287 · see citing works
Evolutionary Conservation of the Basal Ganglia as a Common Vertebrate Mechanism for Action Selection
Stephenson‐Jones, M., Samuelsson, E., Ericsson, J., Robertson, B., & Grillner, S. E. (2011) · Current Biology · doi:10.1016/j.cub.2011.05.001 · Cited by 286 · see citing works
Organization of monosynaptic inputs to the serotonin and dopamine neuromodulatory systems
Ogawa, S. K., Cohen, J. Y., Hwang, D., Uchida, N., & Watabe-Uchida, M. (2014) · Cell Reports · doi:10.1016/j.celrep.2014.06.042 · Cited by 249 · see citing works
Self-citation
OPTIMIZATION AND THE MATCHING LAW AS ACCOUNTS OF INSTRUMENTAL BEHAVIOR
Baum, W. M. (1981) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1981.36-387 · Cited by 249 · see citing works
Role of Striatum in Updating Values of Chosen Actions
Kim, H., Sul, J. H., Huh, N., Lee, D., & Jung, M. W. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2728-09.2009 · Cited by 225 · see citing works
Activation of Dorsal Raphe Serotonergic Neurons Promotes Waiting but Is Not Reinforcing
Fonseca, M. S., Murakami, M., & Mainen, Z. F. (2015) · Current Biology · doi:10.1016/j.cub.2014.12.002 · Cited by 210 · see citing works
Single‐unit recording from antidromically activated optic radiation neurones
Bishop, P. O., Burke, W. J., & Davis, R. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006943 · Cited by 197 · see citing works
Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice
Cai, X., Kim, S., & Lee, D. (2011) · Neuron · doi:10.1016/j.neuron.2010.11.041 · Cited by 182 · see citing works
Action Selection and Action Value in Frontal-Striatal Circuits
Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 161 · see citing works
Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction
Li, J., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6316-10.2011 · Cited by 149 · see citing works
Choice, difficulty, and confidence in the brain
Rolls, E. T., Grabenhorst, F., & Deco, G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.073 · Cited by 148 · see citing works
Persistent Activity in Neural Networks with Dynamic Synapses
Barak, O., & Tsodyks, M. V. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030035 · Cited by 136 · see citing works
Evidence for Hyperbolic Temporal Discounting of Reward in Control of Movements
Haith, A. M., Reppert, T. R., & Shadmehr, R. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0424-12.2012 · Cited by 129 · see citing works
The dorsomedial striatum encodes net expected return, critical for energizing performance vigor
Wang, A. Y., Miura, K., & Uchida, N. (2013) · Nature Neuroscience · doi:10.1038/nn.3377 · Cited by 128 · see citing works
Activation of serotonin neurons promotes active persistence in a probabilistic foraging task
Lottem, E., Banerjee, D., Vertechi, P., Sarra, D., Lohuis, M. N. O., & Mainen, Z. F. (2018) · Nature Communications · doi:10.1038/s41467-018-03438-y · Cited by 128 · see citing works
A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses
Soltani, A., & Wang, X. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.5159-05.2006 · Cited by 127 · see citing works
Modulation of Saccade Vigor during Value-Based Decision Making
Reppert, T. R., Lempert, K. M., Glimcher, P. W., & Shadmehr, R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2621-15.2015 · Cited by 121 · see citing works
The functional logic of corticostriatal connections
Shipp, S. (2017) · Brain Structure and Function · doi:10.1007/s00429-016-1250-9 · Cited by 118 · see citing works
Distinct Neural Representation in the Dorsolateral, Dorsomedial, and Ventral Parts of the Striatum during Fixed- and Free-Choice Tasks
Ito, M., & Doya, K. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.1962-14.2015 · Cited by 114 · see citing works
Dynamic Encoding of Action Selection by the Medial Striatum
Kimchi, E. Y., & Laubach, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.5206-08.2009 · Cited by 114 · see citing works
Neural correlates of stimulus-response and response-outcome associations in dorsolateral versus dorsomedial striatum
Stalnaker, T. A. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00012 · Cited by 110 · see citing works
Emergence of Context-Dependent Variability across a Basal Ganglia Network
Woolley, S. C., Rajan, R., Joshua, M., & Doupe, A. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.01.039 · Cited by 109 · see citing works
Control of movement vigor and decision making during foraging
Yoon, T., Geary, R., Ahmed, A. A., & Shadmehr, R. (2018) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.1812979115 · Cited by 108 · see citing works
Cell-Type-Specific D1 Dopamine Receptor Modulation of Projection Neurons and Interneurons in the Prefrontal Cortex
Anastasiades, P. G., Boada, C. M., & Carter, A. G. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy299 · Cited by 106 · see citing works
Dynamic Flexibility in Striatal-Cortical Circuits Supports Reinforcement Learning
Gerraty, R. T., Davidow, J. Y., Foerde, K., Galván, A., Bassett, D. S., & Daphna Shohamy, A. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.2084-17.2018 · Cited by 102 · see citing works
Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex
Ebitz, R. B., Albarran, E., & Moore, T. (2017) · Neuron · doi:10.1016/j.neuron.2017.12.007 · Cited by 101 · see citing works
Distinct Sources of Deterministic and Stochastic Components of Action Timing Decisions in Rodent Frontal Cortex
Murakami, M., Shteingart, H., Loewenstein, Y., & Mainen, Z. F. (2017) · Neuron · doi:10.1016/j.neuron.2017.04.040 · Cited by 90 · see citing works
The Role of Orbitofrontal–Amygdala Interactions in Updating Action–Outcome Valuations in Macaques
Fiuzat, E. C., Rhodes, S. E. V., & Murray, E. A. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1839-16.2017 · Cited by 85 · see citing works
A dynamic code for economic object valuation in prefrontal cortex neurons
Tsutsui, K., Fabian Grabenhorst, B., Kobayashi, S., & Schultz, W. (2016) · Nature Communications · doi:10.1038/ncomms12554 · Cited by 83 · see citing works
Cell-Type-Specific Contributions of Medial Prefrontal Neurons to Flexible Behaviors
Nakayama, H., Ibáñez-Tallon, I., & Heintz, N. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.3537-17.2018 · Cited by 78 · see citing works
Signals for Previous Goal Choice Persist in the Dorsomedial, but Not Dorsolateral Striatum of Rats
Kim, H., Lee, D., & Jung, M. W. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2422-12.2013 · Cited by 73 · see citing works
Action and Outcome Activity State Patterns in the Anterior Cingulate Cortex
Hyman, J. M., Whitman, J., Emberly, E. G., Woodward, T. S., & Seamans, J. K. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs104 · Cited by 70 · see citing works
Adaptive Encoding of Outcome Prediction by Prefrontal Cortex Ensembles Supports Behavioral Flexibility
Arco, A. D., Park, J., Wood, J. T., Kim, Y., & Moghaddam, B. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0450-17.2017 · Cited by 59 · see citing works
Striatal action-value neurons reconsidered
Elber-Dorozko, L., & Loewenstein, Y. (2018) · eLife · doi:10.7554/elife.34248 · Cited by 53 · see citing works
Action-outcome relationships are represented differently by medial prefrontal and orbitofrontal cortex neurons during action execution
Simon, N. W., Wood, J. T., & Moghaddam, B. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00884.2015 · Cited by 50 · see citing works
When Does Reward Maximization Lead to Matching Law?
Sakai, Y., & Fukai, T. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003795 · Cited by 38 · see citing works
Model-based reinforcement learning under concurrent schedules of reinforcement in rodentsPreprint
Huh, N., Jo, S., Kim, H., Sul, J. H., & Jung, M. W. (2009) · Learning & Memory · doi:10.1101/lm.1295509 · Cited by 30 · see citing works
The Eye of the Laboratory Mouse Remains Anatomically Adapted for Natural Conditions
Shupe, J. M., Kristan, D. M., Austad, S. N., & Stenkamp, D. L. (2005) · Brain Behavior and Evolution · doi:10.1159/000088857 · Cited by 21 · see citing works
Corticostriatal circuit mechanisms of value-based action selection: Implementation of reinforcement learning algorithms and beyond
Morita, K., Jitsev, J., & Morrison, A. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.05.017 · Cited by 15 · see citing works
Distinct Functions of the Primate Putamen Direct and Indirect Pathways in Adaptive Outcome-Based Action Selection
Ueda, Y., Yamanaka, K., Noritake, A., Enomoto, K., Matsumoto, N., Yamada, H., Samejima, K., Inokawa, H., Hori, Y., Nakamura, K., et al. (2017) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2017.00066 · Cited by 15 · see citing works
Neurons in the cingulate motor area signal context-based and outcome-based volitional selection of action
Iwata, J.-I., Shima, K., Tanji, J., & Mushiake, H. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3442-3 · Cited by 9 · see citing works

Flagged first, then by citations

1 of the 91 references couldn’t be matched to a known paper.

Sorted by citations

The role of the medial prefrontal cortex in cognition, ageing and dementia
Jobson, D. D., Hase, Y., Clarkson, A. N., & Kalaria, R. N. (2021) · Brain Communications · doi:10.1093/braincomms/fcab125 · Cited by 338 · see citing works
The mouse prefrontal cortex: Unity in diversity
Le Merre, P., Ährlund-Richter, S., & Carlén, M. (2021) · Neuron · doi:10.1016/j.neuron.2021.03.035 · Cited by 207 · see citing works
A brain-wide map of neural activity during complex behaviour
Meshulam, L., Angelaki, D. E., Benson, J., McRoberts, I., Noel, J., Arlandis, J., Bonacchi, N., Bougrova, K., Catarino, J. A., Cazettes, F., et al. (2025) · Nature · doi:10.1038/s41586-025-09235-0 · Cited by 210 · see citing works
Dopamine, Updated: Reward Prediction Error and Beyond
Lerner, T. N., Holloway, A. L., & Seiler, J. L. (2020) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2020.10.012 · Cited by 178 · see citing works
Serotonin neurons modulate learning rate through uncertainty
Grossman, C. D., Bari, B. A., & Cohen, J. Y. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.006 · Cited by 164 · see citing works
Self-citation
Spatiotemporal dynamics of noradrenaline during learned behaviour
Breton‐Provencher, V., Drummond, G. T., Feng, J., Li, Y., & Sur, M. (2022) · Nature · doi:10.1038/s41586-022-04782-2 · Cited by 135 · see citing works
Differential Encoding in Prefrontal Cortex Projection Neuron Classes Across Cognitive Tasks
Lui, J. H., Nguyen, N. D., Grutzner, S. M., Darmanis, S., Peixoto, D., Wagner, M. J., Allen, W. E., Kebschull, J. M., Richman, E. B., Ren, J., et al. (2020) · Cell · doi:10.1016/j.cell.2020.11.046 · Cited by 121 · see citing works
Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates
Monosov, I. E., Haber, S. N., Leuthardt, E. C., & Jezzini, A. (2020) · Current Biology · doi:10.1016/j.cub.2020.10.009 · Cited by 118 · see citing works
Prefrontal deep projection neurons enable cognitive flexibility via persistent feedback monitoring
Spellman, T., Svei, M., Kaminsky, J. C., Manzano-Nieves, G., & Liston, C. M. (2021) · Cell · doi:10.1016/j.cell.2021.03.047 · Cited by 115 · see citing works
Complementary task representations in hippocampus and prefrontal cortex for generalizing the structure of problems
Samborska, V., Butler, J. L., Walton, M. E., Behrens, T. E. J., & Akam, T. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01149-8 · Cited by 133 · see citing works
Transient and Persistent Representations of Odor Value in Prefrontal Cortex
Wang, P. Y., Boboilă, C., Chin, M., Higashi-Howard, A., Shamash, P., Wu, Z., Stein, N. P., Abbott, L. F., & Axel, R. (2020) · Neuron · doi:10.1016/j.neuron.2020.07.033 · Cited by 107 · see citing works
A quantitative reward prediction error signal in the ventral pallidum
Ottenheimer, D. J., Bari, B. A., Sutlief, E., Fraser, K. M., Kim, T. H., Richard, J. M., Cohen, J. Y., & Janak, P. H. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0688-5 · Cited by 81 · see citing works
Self-citation
Sex differences in learning from exploration
Chen, C. S., Knep, E., Han, A., Ebitz, R. B., & Grissom, N. M. (2021) · eLife · doi:10.7554/elife.69748 · Cited by 90 · see citing works
Neural circuitry of information seeking
Bromberg-Martin, E. S., & Monosov, I. E. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.07.006 · Cited by 89 · see citing works
Divergent Strategies for Learning in Males and Females
Chen, C. S., Ebitz, R. B., Bindas, S. R., Redish, A. D., Hayden, B. Y., & Grissom, N. M. (2020) · Current Biology · doi:10.1016/j.cub.2020.09.075 · Cited by 84 · see citing works
Meta-reinforcement learning via orbitofrontal cortex
Hattori, R., Hedrick, N. G., Jain, A., Chen, S., You, H., Hattori, M., Choi, J., Lim, B. K., Yasuda, R., & Komiyama, T. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01485-3 · Cited by 70 · see citing works
Mice exhibit stochastic and efficient action switching during probabilistic decision making
Beron, C. C., Neufeld, S. Q., Linderman, S. W., & Sabatini, B. L. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2113961119 · Cited by 61 · see citing works
Silences, spikes and bursts: Three‐part knot of the neural code
Friedenberger, Z., Harkin, E. F., Tóth, K., & Naud, R. (2023) · The Journal of Physiology · doi:10.1113/jp281510 · Cited by 57 · see citing works
Prefrontal Cortical Projection Neurons Targeting Dorsomedial Striatum Control Behavioral Inhibition
Terra, H., Bruinsma, B., de Kloet, S. F., van der Roest, M., Pattij, T., & Mansvelder, H. D. (2020) · Current Biology · doi:10.1016/j.cub.2020.08.031 · Cited by 53 · see citing works
Dopamine-independent effect of rewards on choices through hidden-state inference
Blanco-Pozo, M., Akam, T. E., & Walton, M. E. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01542-x · Cited by 70 · see citing works
Two types of locus coeruleus norepinephrine neurons drive reinforcement learningPreprint
Su, Z., & Cohen, J. Y. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.08.519670 · Cited by 50 · see citing works
Self-citation
Green supply chain management practices and triple bottom line performance: Insights from an emerging economy with a mediating and moderating model
Huang, X., Ullah, M., Wang, L., Ullah, F., & Khan, R. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.120575 · Cited by 52 · see citing works
Thyroid hormone remodels cortex to coordinate body-wide metabolism and exploration
Hochbaum, D. R., Hulshof, L., Urke, A., Wang, W., Dubinsky, A. C., Farnsworth, H. C., Hakim, R., Lin, S., Kleinberg, G., Robertson, K., et al. (2024) · Cell · doi:10.1016/j.cell.2024.07.041 · Cited by 54 · see citing works
Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior
Rudebeck, P. H., & Izquierdo, A. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01140-0 · Cited by 48 · see citing works
Context-dependent persistency as a coding mechanism for robust and widely distributed value coding
Hattori, R., & Komiyama, T. (2021) · Neuron · doi:10.1016/j.neuron.2021.11.001 · Cited by 47 · see citing works
A neural substrate of sex-dependent modulation of motivation
Cox, J., Minerva, A. R., Fleming, W., Zimmerman, C. A., Hayes, C. L., Zorowitz, S., Bandi, A., Ornelas, S., McMannon, B., Parker, N. F., et al. (2023) · Nature Neuroscience · doi:10.1038/s41593-022-01229-9 · Cited by 40 · see citing works
Striatum-projecting prefrontal cortex neurons support working memory maintenance
Wilhelm, M., Sych, Y., Fomins, A., Warren, J. L. A., Lewis, C., Capdevila, L. S., Boehringer, R., Amadei, E. A., Grewe, B. F., O’Connor, E. C., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-42777-3 · Cited by 39 · see citing works
Robust and distributed neural representation of action values
Shin, E. J., Jang, Y., Kim, S., Kim, H., Cai, X., Lee, H., Sul, J. H., Lee, S., Chung, Y., Lee, D., et al. (2021) · eLife · doi:10.7554/elife.53045 · Cited by 38 · see citing works
A stable, distributed code for cue value in mouse cortex during reward learning
Ottenheimer, D. J., Hjort, M. M., Bowen, A. J., Steinmetz, N. A., & Stuber, G. D. (2023) · eLife · doi:10.7554/elife.84604 · Cited by 37 · see citing works
Distributed processing for value-based choice by prelimbic circuits targeting anterior-posterior dorsal striatal subregions in male mice
Choi, K., Piasini, E., Díaz-Hernández, E., Cifuentes, L. V., Henderson, N. T., Holly, E. N., Subramaniyan, M., Gerfen, C. R., & Fuccillo, M. V. (2023) · Nature Communications · doi:10.1038/s41467-023-36795-4 · Cited by 34 · see citing works
Mixtures of strategies underlie rodent behavior during reversal learning
Le, N. M., Yıldırım, M., Wang, Y., 杉原, 弘., Jazayeri, M., & Sur, M. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011430 · Cited by 41 · see citing works
Recent Advances at the Interface of Neuroscience and Artificial Neural Networks
Cohen, Y., Engel, T. A., Langdon, C., Lindsay, G. W., Ott, T., Peters, M. A. K., Shine, J. M., Breton‐Provencher, V., & Ramaswamy, S. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1503-22.2022 · Cited by 38 · see citing works
Neuronal representations of reward-predicting cues and outcome history with movement in the frontal cortex
Kondo, M., & Matsuzaki, M. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.108704 · Cited by 31 · see citing works
The learning of prospective and retrospective cognitive maps within neural circuits
Namboodiri, V. M. K., & Stuber, G. D. (2021) · Neuron · doi:10.1016/j.neuron.2021.09.034 · Cited by 31 · see citing works
Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making
Grossman, C. D., & Cohen, J. Y. (2022) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092021-125059 · Cited by 27 · see citing works
Self-citation
Cognition and the single neuron: How cell types construct the dynamic computations of frontal cortex
Christensen, A. J., Ott, T., & Kepecs, Á. (2022) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2022.102630 · Cited by 25 · see citing works
Reward expectations direct learning and drive operant matching in Drosophila
Rajagopalan, A. E., Darshan, R., Hibbard, K. L., Fitzgerald, J. E., & Turner, G. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2221415120 · Cited by 29 · see citing works
Self-citation
An opponent striatal circuit for distributional reinforcement learning
Lowet, A. S., Qiao, Z., Meng, M., Matias, S., Drugowitsch, J., & Uchida, N. (2025) · Nature · doi:10.1038/s41586-024-08488-5 · Cited by 29 · see citing works
Entropy-based metrics for predicting choice behavior based on local response to reward
Trepka, E. B., Spitmaan, M., Bari, B. A., Costa, V. D., Cohen, J. Y., & Soltani, A. (2021) · Nature Communications · doi:10.1038/s41467-021-26784-w · Cited by 27 · see citing works
Self-citation
From Neurons to Cognition: Technologies for Precise Recording of Neural Activity Underlying Behavior
Roth, R. H., & Ding, J. (2020) · BME Frontiers · doi:10.34133/2020/7190517 · Cited by 24 · see citing works
From predictive models to cognitive models: Separable behavioral processes underlying reward learning in the ratPreprint
Miller, K. J., Botvinick, M., & Brody, C. D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/461129 · Cited by 25 · see citing works
Complementary task representations in hippocampus and prefrontal cortex for generalising the structure of problemsPreprint
Samborska, V., Butler, J. L., Walton, M. E., Behrens, T. E. J., & Akam, T. E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.03.05.433967 · Cited by 25 · see citing works
The neural basis of delayed gratification
Gao, Z., Wang, H., Lu, C., Lu, T., Froudist‐Walsh, S., Chen, M., Wang, X., Hu, J., & Sun, W. (2021) · Science Advances · doi:10.1126/sciadv.abg6611 · Cited by 24 · see citing works
Distinct Roles of Parvalbumin- and Somatostatin-Expressing Neurons in Flexible Representation of Task Variables in the Prefrontal Cortex
Jeong, H., Kim, D., Song, M. J., Paik, S., & Jung, M. W. (2019) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101773 · Cited by 22 · see citing works
Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework
Harkin, E. F., Lynn, M. B., Payeur, A., Boucher, J.-F., Caya-Bissonnette, L., Cyr, D., Stewart, C. A., Longtin, A., Naud, R., & Béïque, J.-C. (2023) · eLife · doi:10.7554/elife.72951 · Cited by 21 · see citing works
Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys
Woo, J. H., Aguirre, C. G., Bari, B. A., Tsutsui, K., Fabian Grabenhorst, B., Cohen, J. Y., Schultz, W., Izquierdo, A., & Soltani, A. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-022-01059-z · Cited by 21 · see citing works
Self-citation
Disruption of Nrxn1α within excitatory forebrain circuits drives value-based dysfunction
Alabi, O. O., Davatolhagh, M. F., Robinson, M., Fortunato, M. P., Cifuentes, L. V., Kable, J. W., & Fuccillo, M. V. (2020) · eLife · doi:10.7554/elife.54838 · Cited by 21 · see citing works
Representation learning in the artificial and biological neural networks underlying sensorimotor integration
Suhaimi, A. M. M., Lim, A. W. H., Chia, X. W., Li, C., & Makino, H. (2022) · Science Advances · doi:10.1126/sciadv.abn0984 · Cited by 21 · see citing works
Temporal Dynamics Underlying Prelimbic Prefrontal Cortical Regulation of Action Selection and Outcome Evaluation during Risk/Reward Decision-Making
Bercovici, D. A., Princz‐Lebel, O., Schumacher, J. D., Lo, V. M., & Floresco, S. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0802-22.2022 · Cited by 21 · see citing works
Enhancer-AAVs allow genetic access to oligodendrocytes and diverse populations of astrocytes across speciesPreprint
Mich, J. K., Sunil, S., Johansen, N., Martinez, R. A., Liu, J., Gore, B. B., Mahoney, J. T., Leytze, M., Ben‐Simon, Y., Bertagnolli, D., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.20.558718 · Cited by 21 · see citing works
Reward integration in prefrontal-cortical and ventral-hippocampal nucleus accumbens inputs cooperatively modulates engagement
Iyer, E. S., Vitaro, P., Wu, S. S., Muir, J., Tse, Y. C., Cvetkovska, V., & Bagot, R. C. (2025) · Nature Communications · doi:10.1038/s41467-025-58858-4 · Cited by 19 · see citing works
Undermatching Is a Consequence of Policy Compression
Bari, B. A., & Gershman, S. J. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1003-22.2022 · Cited by 18 · see citing works
Self-citation
Hierarchical control over foraging behavior by anterior cingulate cortex
Alejandro, R. J., & Holroyd, C. B. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105623 · Cited by 17 · see citing works
Competitive integration of time and reward explains value-sensitive foraging decisions and frontal cortex ramping dynamics
Bukwich, M., Campbell, M. G., Zoltowski, D. M., Kingsbury, L., Tomov, M. S., Stern, J., Kim, H. R., Drugowitsch, J., Linderman, S. W., & Uchida, N. (2025) · Neuron · doi:10.1016/j.neuron.2025.07.008 · Cited by 17 · see citing works
Open-Source Joystick Manipulandum for Decision-Making, Reaching, and Motor Control Studies in Mice
Belsey, P. P., Nicholas, M. A., & Yttri, E. A. (2020) · eNeuro · doi:10.1523/eneuro.0523-19.2020 · Cited by 14 · see citing works
Confidence in Decision-Making during Probabilistic Tactile Learning Related to Distinct Thalamo–Prefrontal Pathways
Wang, B., & Pleger, B. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa073 · Cited by 14 · see citing works
Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility
van der Merwe, R. K., Nadel, J. A., Copes‐Finke, D., Pawelko, S. S., Scott, J. S., Ghanem, M. M., Fox, M., Morehouse, C., McLaughlin, R., Maddox, C., et al. (2023) · European Journal of Neuroscience · doi:10.1111/ejn.15910 · Cited by 14 · see citing works
A push for examining subjective experience in value-based decision-making
Schreiner, D. C., Yalcinbas, E. A., & Gremel, C. M. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.020 · Cited by 15 · see citing works
Aversive stimuli bias corticothalamic responses to motivationally significant cues
Lucantonio, F., Kim, E., Su, Z., Chang, A. J., Bari, B. A., & Cohen, J. Y. (2021) · eLife · doi:10.7554/elife.57634 · Cited by 14 · see citing works
Self-citation
Pupil Correlates of Decision Variables in Mice Playing a Competitive Mixed-Strategy Game
Wang, H., Ortega, H. K., Atilgan, H., Murphy, C. E., & Kwan, A. C. (2022) · eNeuro · doi:10.1523/eneuro.0457-21.2022 · Cited by 14 · see citing works
Distributed processing for action control by prelimbic circuits targeting anterior-posterior dorsal striatal subregionsPreprint
Choi, K., Piasini, E., Cifuentes, L. V., Díaz-Hernández, E., Henderson, N. T., Subramaniyan, M., Gerfen, C. R., & Fuccillo, M. V. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.12.01.469698 · Cited by 14 · see citing works
Brain mechanism of foraging: Reward-dependent synaptic plasticity versus neural integration of values
Pereira, U., Hou, H., Svoboda, K., & Wang, X. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2318521121 · Cited by 13 · see citing works
Applying Reinforcement Learning to Rodent Stress Research
Liao, C., & Kwan, A. C. (2021) · Chronic Stress · doi:10.1177/2470547020984732 · Cited by 13 · see citing works
Change point estimation by the mouse medial frontal cortex during probabilistic reward learningPreprint
Murphy, C. E., Wang, H., Ortega, H. K., Kwan, A. C., & Atilgan, H. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.26.493245 · Cited by 12 · see citing works
The role of blended learning in improving medical students’ academic performance: evidence from Pakistan
Ashraf, M. A., Tsegay, S. M., Gull, N., Saeed, M., & Dawood, H. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1425659 · Cited by 11 · see citing works
Reward foraging task and model-based analysis reveal how fruit flies learn value of available options
Seidenbecher, S. E., Sanders, J. I., von Philipsborn, A. C., & Kvitsiani, D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239616 · Cited by 11 · see citing works
Separable Influences of Reward on Visual Processing and Choice
Soltani, A., Rakhshan, M., Schafer, R. J., Burrows, B. E., & Moore, T. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01647 · Cited by 11 · see citing works
Serotonin predictively encodes valuePreprint
Harkin, E. F., Grossman, C. D., Cohen, J. Y., Béïque, J.-C., & Naud, R. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.19.558526 · Cited by 11 · see citing works
Self-citation
Choice-selective sequences dominate in cortical relative to thalamic inputs to nucleus accumbens, providing a potential substrate for credit assignmentPreprint
Parker, N. F., Baidya, A., Cox, J., Haetzel, L. M., Zhukovskaya, A., Murugan, M., Engelhard, B., Goldman, M. S., & Witten, I. B. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/725382 · Cited by 9 · see citing works
Dopamine-independent state inference mediates expert reward guided decision makingPreprint
Blanco-Pozo, M., Akam, T. E., & Walton, M. E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.25.449995 · Cited by 10 · see citing works
Subthreshold basis for reward-predictive persistent activity in mouse prefrontal cortex
Kim, E., Bari, B. A., & Cohen, J. Y. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.109082 · Cited by 9 · see citing works
Self-citation
Prefrontal Cortical to Mediodorsal Thalamus Projection Neurons Regulate Posterror Adaptive Control of Behavior
Bruinsma, B., Pattij, T., & Mansvelder, H. D. (2022) · eNeuro · doi:10.1523/eneuro.0254-22.2022 · Cited by 9 · see citing works
Reinforcement learning modeling reveals a reward-history-dependent strategy underlying reversal learning in squirrel monkeys.
Bari, B. A., Moerke, M. J., Jedema, H. P., Effinger, D. P., Cohen, J. Y., & Bradberry, C. W. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000492 · Cited by 9 · see citing works
Self-citation
Connectivity underlying motor cortex activity during naturalistic goal-directed behaviorPreprint
Finkelstein, A., Daie, K., Rózsa, M., Darshan, R., & Svoboda, K. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.25.568673 · Cited by 9 · see citing works
Rule-based modulation of a sensorimotor transformation across cortical areas
Chang, Y.-T., Finkel, E. A., Xu, D., & O’Connor, D. H. (2023) · eLife · doi:10.7554/elife.92620 · Cited by 8 · see citing works
A pathway toward sustainable development of export sector in Pakistan: sustainable HRM practices, green business innovation, green human capital, and perceived organizational support
Amjad, F., Baig, S. A., Basit, A., & Usman, M. (2024) · Journal of the Textile Institute · doi:10.1080/00405000.2024.2418149 · Cited by 8 · see citing works
Connectivity underlying motor cortex activity during goal-directed behaviour
Finkelstein, A., Daie, K., Rózsa, M., Darshan, R., & Svoboda, K. (2025) · Nature · doi:10.1038/s41586-025-09758-6 · Cited by 8 · see citing works
Choice history effects in mice and humans improve reward harvesting efficiency
López-Yépez, J. S., Martin, J., Hulme, O. J., & Kvitsiani, D. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009452 · Cited by 9 · see citing works
Automating licking bias correction in a two-choice delayed match-to-sample task to accelerate learning
Do, J., Jung, M. W., & Lee, D. (2023) · Scientific Reports · doi:10.1038/s41598-023-49862-z · Cited by 8 · see citing works
Neural activity in anterior insula at drinking onset and licking relates to compulsion-like alcohol consumption
Starski, P. A., Morningstar, M. D., Katner, S. N., Frasier, R. M., Sergio, T. D. O., Wean, S. E., Lapish, C. C., & Hopf, F. W. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1490-23.2023 · Cited by 8 · see citing works
Persistent decision-making in mice, monkeys and humans
Laurie, V.-J., Shourkeshti, A., Chen, C. S., Herman, A. B., Grissom, N. M., & Ebitz, R. B. (2026) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2025.1983 · Cited by 8 · see citing works
Medial prefrontal cortex suppresses reward-seeking behavior with risk of punishment by reducing sensitivity to reward
Nishio, M., Kondo, M., Yoshida, E., & Matsuzaki, M. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1412509 · Cited by 7 · see citing works
Is training important for employee innovative behaviors: mediating role of knowledge sharing and hiding
Budur, T. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2024.2386671 · Cited by 7 · see citing works
The Role of the Rat Prefrontal Cortex and Sex Differences in Decision-Making
Palmer, J. A., White, S. R., Lopez, K. C., & Laubach, M. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.0550-24.2024 · Cited by 7 · see citing works
Using lickometry to infer differential contributions of salience network regions during compulsion-like alcohol drinking
Starski, P. A., Sergio, T. D. O., & Hopf, F. W. (2023) · Addiction Neuroscience · doi:10.1016/j.addicn.2023.100102 · Cited by 7 · see citing works
Mouse frontal cortex nonlinearly encodes stimuli, choices, and outcomes
Wool, L. E., Lak, A., Carandini, M., & Harris, K. D. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.19693.1 · Cited by 6 · see citing works
Neural coding of choice and outcome are modulated by uncertainty in orbitofrontal but not secondary motor cortex
Romero-Sosa, J. L., Yeghikian, A., Wikenheiser, A. M., Blair, H. T., & Izquierdo, A. (2025) · Nature Communications · doi:10.1038/s41467-025-63866-5 · Cited by 6 · see citing works
Frontostriatal circuit dysfunction leads to cognitive inflexibility in neuroligin-3 R451C knockin mice
Shen, L., Fan, C., Wang, H., Li, X., Zeng, J.-L., Lan, P.-X., Li, H., Zhang, B., Hu, C., Xu, J., et al. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02505-9 · Cited by 6 · see citing works
Secondary motor cortex tracks decision value during the learning of a non-instructed task
Augusto, E., Kouskoff, V., Chenouard, N., Giraudet, M., Peltier, L., de Miranda, A., Louis, A., Alonso, L., & Gambino, F. (2025) · Cell Reports · doi:10.1016/j.celrep.2024.115152 · Cited by 7 · see citing works
Autism-associated Scn2a haploinsufficiency disrupts in vivo dendritic signaling and impairs flexible decision-making
Wu, H., Shen, L., Indajang, J., Savalia, N. K., Johnson, T. G., Qu, J., Bender, K. J., & Kwan, A. C. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2508836122 · Cited by 6 · see citing works
Over-representation of fundamental decision variables in the prefrontal cortex underlies decision bias
Ohnuki, T., Osako, Y., Manabe, H., Sakurai, Y., & Hirokawa, J. (2021) · Neuroscience Research · doi:10.1016/j.neures.2021.07.002 · Cited by 4 · see citing works
Neuron-type specificity of dorsal raphe projections to ventral tegmental areaPreprint
Chang, A. J., Wang, L., Lucantonio, F., Adams, M., Lemire, A. L., Dudman, J. T., & Cohen, J. Y. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.06.425641 · Cited by 6 · see citing works
Self-citation
A stable, distributed code for cue value in mouse cortex during reward learningPreprint
Ottenheimer, D. J., Hjort, M. M., Bowen, A. J., Steinmetz, N. A., & Stuber, G. D. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.13.499930 · Cited by 7 · see citing works
Integrator dynamics in the cortico-basal ganglia loop for flexible motor timing
Yang, Z., Inagaki, M., Gerfen, C. R., Fontolan, L., & Inagaki, H. (2025) · Nature · doi:10.1038/s41586-025-09778-2 · Cited by 10 · see citing works
Dynamic Foraging Behavior Performance Is Not Affected byScn2aHaploinsufficiency
Schamiloglu, S., Wu, H., Zhou, M., Kwan, A. C., & Bender, K. J. (2023) · eNeuro · doi:10.1523/eneuro.0367-23.2023 · Cited by 5 · see citing works
A decision-space model explains context-specific decision-making
Beck, D. W., Heaton, C. N., Davila, L. D., Rakocevic, L. I., Drammis, S. M., Tyulmankov, D., Giri, A., Beck, S. U., Zhang, Q., Pokojovy, M., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-61466-x · Cited by 5 · see citing works
Distinct representations of economic variables across regions and projections of the frontal cortex
Majumdar, A., Ashcroft, C. A., Fritsche, M., Tan, S., Zatka-Haas, P., Fölsz, O., Walker, N., Mistry, L., Rominto, A. M., Tvrdic, M., et al. (2025) · Neuron · doi:10.1016/j.neuron.2025.09.027 · Cited by 5 · see citing works
Dynamic decision making and value computations in medial frontal cortex
Bari, B. A., & Cohen, J. Y. (2021) · International review of neurobiology · doi:10.1016/bs.irn.2020.12.001 · Cited by 6 · see citing works
Self-citation
Complementary roles of serotonin and dopamine in model-based learning
Taira, M., & Sharpe, M. J. (2024) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2024.101464 · Cited by 6 · see citing works
Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice
Gutiérrez‐Castellanos, N., Sarra, D., Godinho, B., & Mainen, Z. F. (2024) · eLife · doi:10.7554/elife.93485 · Cited by 5 · see citing works

Time-dependent deployment of medial prefrontal cortical representations in male mice
López-Yépez, J. S., Barta, A., Martin, J., Moltesen, M., Woo, T.-F., Hulme, O. J., Demir, E., & Kvitsiani, D. (2026) · Nature Communications · doi:10.1038/s41467-025-68215-0
Whole-Brain Neural Dynamics of Probabilistic Reward Prediction
Bach, D. R., Symmonds, M., Barnes, G. R., & Dolan, R. J. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.2943-16.2017 · Cited by 24 · see citing works
Representation of actions and outcomes in medial prefrontal cortex during delayed conditional decision-making: Population analyses of single neuron activity
Francoeur, M. J., & Mair, R. G. (2018) · Brain and Neuroscience Advances · doi:10.1177/2398212818773865 · Cited by 10 · see citing works
Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task
Onos, K. D., Francoeur, M. J., Wormwood, B. A., Miller, R. L. A., Gibson, B. M., & Mair, R. G. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149019 · Cited by 14 · see citing works
Stable and dynamic representations of value in the prefrontal cortex
Enel, P., Wallis, J. D., & Rich, E. L. (2020) · eLife · doi:10.7554/elife.54313 · Cited by 50 · see citing works

Authors: Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y.
Affiliations: Johns Hopkins University (US)
Corresponding author: Cohen, Jeremiah Y.
ORCID: Bari, Bilal A.
Grossman, Cooper D.
Lubin, Emily E.
Rajagopalan, Adithya E.
Cressy, Jianna I.
Cohen, Jeremiah Y.
Venue: Neuron
Publisher: Elsevier BV
Published: 2019-09
Volume: 103
Issue: 5
Pages: 922-933.e7
ISSN: 0896-6273 (ISSN-L)
DOI: 10.1016/j.neuron.2019.06.001
PMC: PMC7169950
OpenAlex: W2953886068
Cited by: 173
References: 91
Citations by year: 2026: 19 · 2025: 25 · 2024: 25 · 2023: 30 · 2022: 20 · 2021: 30 · 2020: 19 · 2019: 3 · 2018: 1
FWCI: 10.46
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
www.elsevier.com/open-access/userlicense/1.0/ (vor, 369 d)
Locations: Neuron (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Neurological Disorders and Stroke
Brain and Behavior Research Foundation
Esther A. and Joseph Klingenstein Fund
National Institute on Drug Abuse
Whitehall Foundation
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
Keywords: decision variables, behavioral flexibility, reward prediction error, medial prefrontal cortex, dorsomedial striatum, choice bias, reaction time (psychology), dopamine, mice
MeSH terms: Animals, Appetitive Behavior, Decision Making, Motor Cortex, Neural Pathways, Neurons, Probability, Reinforcement, Psychology, Reward, Neostriatum, Prefrontal Cortex, Mice, Electrophysiological Phenomena

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Stable representations of decision variables for flexible behavior

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks