Cognitive Neurostimulation: Learning to Volitionally Sustain Ventral Tegmental Area Activation
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
SUMMARY Activation of the ventral tegmental area (VTA) and mesolimbic networks is essential to motivation, performance, and learning. Humans routinely attempt to motivate themselves, with unclear efficacy or impact on VTA networks. Using fMRI, we found untrained participants’ motivational strategies failed to consistently activate VTA. After real-time VTA neurofeedback training, however, participants volitionally induced VTA activation without external aids, relative to baseline, Pre-Test, and control groups. VTA self-activation was accompanied by increased mesolimbic network connectivity. Among two comparison groups (no neurofeedback, false neurofeedback) and an alternate neurofeedback group (nucleus accumbens), none sustained activation in target regions of interest nor increased VTA functional connectivity. The results comprise two novel demonstrations: learning and generalization after VTA neurofeedback training and the ability to sustain VTA activation without external reward or reward cues. These findings suggest theoretical alignment of ideas about motivation and midbrain physiology and the potential for generalizable interventions to improve performance and learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · cited 2×
“While it has been theorized that midbrain dopamine is the biological substrate of all forms of motivation (Bromberg-Martin et al., 2010; Salamone and Correa, 2012), only a few studies have examinedmotivation not driven by extrinsic incentives, i.”
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 5×
“…view of dopamine neuron physiology as either tonic or phasic has guided the field for many years, converging evidence across methodologies (Fiorillo et al., 2003; Howe et al., 2013; Totah et al., 2013) suggests a third type of dopamine response profile: a sustained, ramping signal evident…”
InfluentialThe hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983
Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control
Cools, R., & D'Esposito, M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.028 · Cited by 1,673
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418 · cited 5×
“Dopamine is widely implicated in mental health (reviewed in Maia and Frank, 2011; Montague et al., 2004) and adaptive behavior (reviewed in Braver et al., 2014; Salamone and Correa, 2012; Schultz, 2007; Shohamy and Adcock, 2010; Treadway et al., 2012).”
InfluentialMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · cited 5×
“…drive the VTA; this challenging criterion has not been met in prior studies of midbrain physiology in humans or animals (Adcock et al., 2006; Ballard et al., 2011; D'Ardenne et al., 2008; Fiorillo et al., 2003; Schultz, 2007; Sulzer et al., 2013; Takahashi et al., 2011; Wittmann et al., 2005).”
InfluentialTonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 3×
“…2004), agency (Leotti and Delgado, 2011), effort allocation (Botvinick et al., 2009; Hall et al., 2001), response vigor (Beierholm et al., 2013; Niv et al., 2007), cognitive control (Braver and Barch, 2002), and action initiation (Nishino et al., 1987; Roitman et al., 2004; Stuber et al.,…”
Reward-motivated learning: mesolimbic activation precedes memory formation
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.036 · Cited by 977 · cited 3×
“…cues) that are known to drive the VTA; this challenging criterion has not been met in prior studies of midbrain physiology in humans or animals (Adcock et al., 2006; Ballard et al., 2011; D'Ardenne et al., 2008; Fiorillo et al., 2003; Schultz, 2007; Sulzer et al., 2013; Takahashi et al.,…”
Self-citationComputational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Neuromodulation of neuronal circuits: back to the future
Marder, E. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.010 · Cited by 904
Evaluating Dopamine Reward Pathway in ADHD: Clinical Implications
Volkow, N. D., Wang, G.-J., Kollins, S. H., Wigal, T. L., Newcorn, J. H., Telang, F., Fowler, J. S., Zhu, W., Logan, J., Ma, Y., et al. (2009) · JAMA · doi:10.1001/jama.2009.1308 · Cited by 728 · cited 1×
“…(Lou et al., 2011; Pessoa and Engelmann , 2010), invigoration of motor responses (Beierholm et al., 2013; Niv et al., 2007), improved attention (Volkow et al., 2009), working memory (Cools and D'Esposito, 2011; Goldman-Rakic, 1997), and long-term memory encoding (Lisman et al., 2011; Shohamy…”
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · cited 1×
“…2004), agency (Leotti and Delgado, 2011), effort allocation (Botvinick et al., 2009; Hall et al., 2001), response vigor (Beierholm et al., 2013; Niv et al., 2007), cognitive control (Braver and Barch, 2002), and action initiation (Nishino et al., 1987; Roitman et al., 2004; Stuber et al., 2005).”
Wittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H.-J., & Düzel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.010 · Cited by 698 · cited 2×
“…activation here were internally generated, complementing the corpus of research on midbrain responses to external stimuli (Adcock et al., 2006; Ballard et al., 2011; D'Ardenne et al., 2008; Fiorillo et al., 2003; Schultz, 2007; Sulzer et al., 2013; Takahashi et al., 2011; Wittmann et al., 2005).”
BOLD responses reflecting dopaminergic signals in the human ventral tegmental area
D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008) · Science · doi:10.1126/science.1150605 · Cited by 661
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., & Graybiel, A. M. (2013) · Nature · doi:10.1038/nature12475 · Cited by 565 · cited 2×
“…cognitive strategies—distinct from responses to external incentives—would correspond to a sustained temporal profile of activation, paralleling non-transient changes in animals during anticipation of extrinsic reward and cues (Fiorillo et al., 2003; Howe et al., 2013; Totah et al., 2013).”
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496
A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP
Lisman, J., Grace, A. A., & Duzel, E. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.07.006 · Cited by 465 · cited 1×
“…2011; Pessoa and Engelmann , 2010), invigoration of motor responses (Beierholm et al., 2013; Niv et al., 2007), improved attention (Volkow et al., 2009), working memory (Cools and D'Esposito, 2011; Goldman-Rakic, 1997), and long-term memory encoding (Lisman et al., 2011; Shohamy and Adcock, 2010).”
Motivation Deficit in ADHD is Associated with Dysfunction of the Dopamine Reward Pathway
Volkow, N. D., Wang, G.-J., Newcorn, J. H., Kollins, S. H., Wigal, T. L., Telang, F., Fowler, J. S., Goldstein, R. Z., Klein, N., Logan, J., et al. (2011) · Molecular Psychiatry · doi:10.1038/mp.2010.97 · Cited by 429 · cited 1×
“If VTA-NAcc connectivity correlates with success, enhancing it could help individuals persevere in accomplishing difficult tasks (e.g., working on a challenging math problem; Volkow et al., 2011).”
Dopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385
Neural basis of the undermining effect of monetary reward on intrinsic motivation
Murayama, K., Matsumoto, M., Izuma, K., & Matsumoto, K. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1013305107 · Cited by 365 · cited 1×
“…(Bromberg-Martin et al., 2010; Salamone and Correa, 2012), only a few studies have examined motivation not driven by extrinsic incentives, i.e., intrinsic motivation, or behavior pursued due to inherent pleasure in an activity (Lee and Reeve, 2013; Lee et al., 2012; Murayama et al., 2010).”
Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., & Everitt, B. J. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01577.x · Cited by 355
The Yin and Yang of dopamine release: a new perspective
GOTO, Y., OTANI, S., & GRACE, A. (2007) · Neuropharmacology · doi:10.1016/j.neuropharm.2007.07.007 · Cited by 342
Leotti, L. A., & Delgado, M. R. (2011) · Psychological Science · doi:10.1177/0956797611417005 · Cited by 318 · cited 1×
“…behavior, including motivation (Salamone and Correa, 2012), valuation (Wimmer et al., 2012), action contingency (Tricomi et al., 2004), agency (Leotti and Delgado, 2011), effort allocation (Botvinick et al., 2009; Hall et al., 2001), response vigor (Beierholm et al., 2013; Niv et al., 2007),…”
Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., & Schoenbaum, G. (2011) · Nature Neuroscience · doi:10.1038/nn.2957 · Cited by 280 · cited 2×
“…activation here were internally generated, complementing the corpus of research on midbrain responses to external stimuli (Adcock et al., 2006; Ballard et al., 2011; D'Ardenne et al., 2008; Fiorillo et al., 2003; Schultz, 2007; Sulzer et al., 2013; Takahashi et al., 2011; Wittmann et al., 2005).”
Embedding reward signals into perception and cognition
Pessoa, L. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00017 · Cited by 279 · cited 2×
“Potential benefits of learning to sustain dopamine release include increased perceptual signal to noise (Lou et al., 2011; Pessoa and Engelmann , 2010), invigoration of motor responses (Beierholm et al., 2013; Niv et al., 2007), improved attention (Volkow et al., 2009), working memory (Cools and…”
Stuber, G. D., Roitman, M. F., Phillips, P. E. M., Carelli, R. M., & Wightman, R. M. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300619 · Cited by 217
Dopamine, uncertainty and TD learning
Niv, Y., Duff, M. O., & Dayan, P. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-6 · Cited by 153
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111 · cited 1×
“…projections in a broad array of functional components of volitional behavior, including motivation (Salamone and Correa, 2012), valuation (Wimmer et al., 2012), action contingency (Tricomi et al., 2004), agency (Leotti and Delgado, 2011), effort allocation (Botvinick et al., 2009; Hall…”
Control of nucleus accumbens activity with neurofeedback
Greer, S. M., Trujillo, A. J., Glover, G. H., & Knutson, B. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.073 · Cited by 92
Positive and negative modulation of word learning by reward anticipation
Callan, D. E., & Schweighofer, N. (2008) · Human Brain Mapping · doi:10.1002/hbm.20383 · Cited by 79
Cited by
Closed-loop brain training: the science of neurofeedback
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., Weiskopf, N., Blefari, M. L., Rana, M., Oblak, E., et al. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.164 · Cited by 1,306
Ros, T., Enriquez-Geppert, S., Zotev, V., Young, K. D., Wood, G., Whitfield-Gabrieli, S., Wan, F., Vuilleumier, P., Vialatte, F., Van De Ville, D., et al. (2020) · Brain · doi:10.1093/brain/awaa009 · Cited by 399
Causal mapping of human brain function
Siddiqi, S. H., Kording, K. P., Parvizi, J., & Fox, M. D. (2022) · Nature Reviews Neuroscience · doi:10.1038/s41583-022-00583-8 · Cited by 338
Neurofeedback with fMRI: A critical systematic review
Thibault, R. T., MacPherson, A., Lifshitz, M., Roth, R. R., & Raz, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.071 · Cited by 312
Ermakova, A. O., Knolle, F., Justicia, A., Bullmore, E. T., Jones, P. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0056-2 · Cited by 91
Metadata
- Authors
- MacInnes, J. J., Dickerson, K. C., Chen, N.-K., & Adcock, R. A.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2016-03
- Volume
- 89
- Issue
- 6
- Pages
- 1331-1342
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2288200935
- Cited by
- 101
- References
- 31
- FWCI
- 6.19
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.