Performance in a GO/NOGO perceptual task reflects a balance between impulsive and instrumental components of behaviour
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
In recent years, simple GO/NOGO behavioural tasks have become popular due to the relative ease with which they can be combined with technologies such as in vivo multiphoton imaging. To date, it has been assumed that behavioural performance can be captured by the average performance across a session, however this neglects the effect of motivation on behaviour within individual sessions. We investigated the effect of motivation on mice performing a GO/NOGO visual discrimination task. Performance within a session tended to follow a stereotypical trajectory on a Receiver Operating Characteristic (ROC) chart, beginning with an over-motivated state with many false positives, and transitioning through a more or less optimal regime to end with a low hit rate after satiation. Our observations are reproduced by a new model, the Motivated Actor-Critic, introduced here. Our results suggest that standard measures of discriminability, obtained by averaging across a session, may significantly underestimate behavioural performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inhibition and impulsivity: behavioral and neural basis of response control
Bari, A., & Robbins, T. W. (2013) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2013.06.005 · Cited by 1,921
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · cited 1×
“In the case of rodent lick-based tasks, licks can represent both an active indication of choice or the manifestation of an acquired 'adjunctive' consummatory behaviour, or Pavlovian response (Rescorla and Solomon 1967; Falk 1971; Schultz 2006; Dayan and Berridge 2014).”
BackgroundTwo-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 1×
“In the case of rodent lick-based tasks, licks can represent both an active indication of choice or the manifestation of an acquired 'adjunctive' consummatory behaviour, or Pavlovian response (Rescorla and Solomon 1967; Falk 1971; Schultz 2006; Dayan and Berridge 2014).”
BackgroundThe mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418 · cited 3×
“Response vigour, or the rate at which instrumental actions are undertaken, has recently been used as a readout of motivational state (Niv et al. 2007; Salamone and Correa 2012).”
BackgroundTonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 4×
“Response vigour, or the rate at which instrumental actions are undertaken, has recently been used as a readout of motivational state (Niv et al. 2007; Salamone and Correa 2012).”
BackgroundInfluentialMotivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · cited 1×
“Highly motivated but inefficient animals, on the other hand, may show a more general increase in instrumental response (Dickinson and Balleine 1994) by increasing licking indiscriminately in all time-periods.”
BackgroundA Cortical Circuit for Gain Control by Behavioral State
Fu, Y., Tucciarone, J. M., Espinosa, J. S., Sheng, N., Darcy, D. P., Nicoll, R. A., Huang, Z. J., & Stryker, M. P. (2014) · Cell · doi:10.1016/j.cell.2014.01.050 · Cited by 937
Long-range and local circuits for top-down modulation of visual cortex processing
Zhang, S., Xu, M., Kamigaki, T., Hoang Do, J. P., Chang, W.-C., Jenvay, S., Miyamichi, K., Luo, L., & Dan, Y. (2014) · Science · doi:10.1126/science.1254126 · Cited by 804 · cited 1×
“This paradigm has been commonly used in recent years to draw inferences about sensory computations (Lee et Zhang et al. 2014).”
MethodActivation of specific interneurons improves V1 feature selectivity and visual perception
Lee, S.-H., Kwan, A. C., Zhang, S., Phoumthipphavong, V., Flannery, J. G., Masmanidis, S. C., Taniguchi, H., Huang, Z. J., Zhang, F., Boyden, E. S., et al. (2012) · Nature · doi:10.1038/nature11312 · Cited by 593 · cited 2×
“…of Figure 2b (purple) demonstrates that mean d′ across the session, the most commonly used behavioural sensitivity measure (Andermann et al. 2010; Lee et al. 2012; Pinto et al. 2013), substantially underestimates the true discrimination ability of the mice, with a d′ of 0.76 ± 0.04 for the group.”
BackgroundMethodInfluentialChoosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536
Fast modulation of visual perception by basal forebrain cholinergic neurons
Pinto, L., Goard, M. J., Estandian, D., Xu, M., Kwan, A. C., Lee, S.-H., Harrison, T. C., Feng, G., & Dan, Y. (2013) · Nature Neuroscience · doi:10.1038/nn.3552 · Cited by 529 · cited 1×
“…of Figure 2b (purple) demonstrates that mean d′ across the session, the most commonly used behavioural sensitivity measure (Andermann et al. 2010; Lee et al. 2012; Pinto et al. 2013), substantially underestimates the true discrimination ability of the mice, with a d′ of 0.76 ± 0.04 for the group.”
BackgroundInfluentialLearning-related fine-scale specificity imaged in motor cortex circuits of behaving mice
Komiyama, T., Sato, T. R., O’Connor, D. H., Zhang, Y.-X., Huber, D., Hooks, B. M., Gabitto, M., & Svoboda, K. (2010) · Nature · doi:10.1038/nature08897 · Cited by 447
Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
Dayan, P., & Berridge, K. C. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0277-8 · Cited by 357 · cited 2×
“…it likely that a Pavlovian response is enhanced by the display of the visual stimulus at the start of trials, as it has previously been suggested that Pavlovian responses can undergo a generalisation effect that dissociates them from the specific details of a stimulus (Dayan and Berridge 2014).”
BackgroundAberman, J. E., & Salamone, J. D. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00004-4 · Cited by 263 · cited 1×
“Pre-feeding has previously been described as an effective short-term manipulation of motivation for reward incentive and responding (Salamone et al. 1991; Aberman and Salamone 1999).”
BackgroundSmith, K. S., Virkud, A., Deisseroth, K., & Graybiel, A. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1216264109 · Cited by 173 · cited 1×
“Approach behaviour towards appetitive reinforcers can interfere with the interpretation of paradigms that use spatially separated levers and/or maze-choice arms in operant chambers for freely moving animals (Smith et al. 2012; Goltstein et al. 2013).”
BackgroundBasolateral amygdala lesions facilitate reward choices after negative feedback in rats
Izquierdo, A., Darling, C., Manos, N., Pozos, H., Kim, C., Ostrander, S., Cazares, V., Stepp, H., & Rudebeck, P. H. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4942-12.2013 · Cited by 63
Conditioned associations and economic decision biases.
Guitart-Masip, M., Talmi, D., & Dolan, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.021 · Cited by 36 · cited 1×
“Reinforcement learning theory assumes that an animal optimises behaviour according to the value placed on the goal of an action under different levels of deprivation (Dayan and Niv 2008; Guitart-Masip et al. 2010).”
Background
Cited by
Estimation of Current and Future Physiological States in Insular Cortex
Livneh, Y., Sugden, A. U., Madara, J. C., Essner, R. A., Flores, V. I., Sugden, L. A., Resch, J. M., Lowell, B. B., & Andermann, M. L. (2020) · Neuron · doi:10.1016/j.neuron.2019.12.027 · Cited by 209
A genetically defined insula-brainstem circuit selectively controls motivational vigor
Deng, H., Xiao, X., Yang, T., Ritola, K., Hantman, A., Li, Y., Huang, Z. J., & Li, B. (2021) · Cell · doi:10.1016/j.cell.2021.11.019 · Cited by 75
A transthalamic pathway crucial for perception
Mo, C., McKinnon, C., & Murray Sherman, S. (2024) · Nature Communications · doi:10.1038/s41467-024-50163-w · Cited by 30
Metadata
- Authors
- Berditchevskaia, A., Cazé, R. D., & Schultz, S. R.
- Venue
- Scientific Reports
- Published
- 2016-06-07
- Volume
- 6
- Issue
- 1
- Pages
- 27389-27389
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2415053651
- Cited by
- 73
- References
- 17
- FWCI
- 1.96
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.