The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
A computational psychiatry approach identifies how alpha-2A noradrenergic agonist Guanfacine affects feature-based reinforcement learning in the macaque
Open accessAbstract
Noradrenaline is believed to support cognitive flexibility through the alpha 2A noradrenergic receptor (a2A-NAR) acting in prefrontal cortex. Enhanced flexibility has been inferred from improved working memory with the a2A-NA agonist Guanfacine. But it has been unclear whether Guanfacine improves specific attention and learning mechanisms beyond working memory, and whether the drug effects can be formalized computationally to allow single subject predictions. We tested and confirmed these suggestions in a case study with a healthy nonhuman primate performing a feature-based reversal learning task evaluating performance using Bayesian and Reinforcement learning models. In an initial dose-testing phase we found a Guanfacine dose that increased performance accuracy, decreased distractibility and improved learning. In a second experimental phase using only that dose we examined the faster feature-based reversal learning with Guanfacine with single-subject computational modeling. Parameter estimation suggested that improved learning is not accounted for by varying a single reinforcement learning mechanism, but by changing the set of parameter values to higher learning rates and stronger suppression of non-chosen over chosen feature information. These findings provide an important starting point for developing nonhuman primate models to discern the synaptic mechanisms of attention and learning functions within the context of a computational neuropsychiatry framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“∝ − p f p R C f p f ( ) ( , ) ( ), (7) t t t t 1: 1: 1 ”
Daselaar, S. M. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.013.2009 · Cited by 1,501
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329
Millan, M. J., Agid, Y., Brüne, M., Bullmore, E. T., Carter, C. S., Clayton, N. S., Connor, R., Davis, S., Deakin, B., DeRubeis, R. J., et al. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3628 · Cited by 1,292
Computational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Role of locus coeruleus in attention and behavioral flexibility
Aston-Jones, G., Rajkowski, J., & Cohen, J. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00140-7 · Cited by 900
Rational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 722
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Mather, M., Clewett, D., Sakaki, M., & Harley, C. W. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15000667 · Cited by 695
Wang, M., Ramos, B. P., Paspalas, C. D., Shu, Y., Simen, A., Duque, A., Vijayraghavan, S., Brennan, A., Dudley, A., Nou, E., et al. (2007) · Cell · doi:10.1016/j.cell.2007.03.015 · Cited by 672
Disorders of compulsivity: A common bias towards learning habits
Voon, V, Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., Schreiber, L. R. N., Gillan, C., Fineberg, N. A., Sahakian, B. J., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.44 · Cited by 643
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642
Scahill, L., Chappell, P. B., Kim, Y. S., Schultz, R. T., Katsovich, L., Shepherd, E., Arnsten, A. F. T., Cohen, D. J., & Leckman, J. F. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.7.1067 · Cited by 588
(1962) · Medical Journal of Australia · doi:10.5694/j.1326-5377.1962.tb27008.x · Cited by 586
Arnsten, A. F. T., Wang, M. J., & Paspalas, C. D. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.038 · Cited by 538
Neuronal basis of age-related working memory decline
Wang, M., Gamo, N. J., Yang, Y., Jin, L. E., Wang, X.-J., Laubach, M., Mazer, J. A., Lee, D., & Arnsten, A. F. T. (2011) · Nature · doi:10.1038/nature10243 · Cited by 485
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480
Estimating a State-Space Model from Point Process Observations
Smith, A. C., & Brown, E. N. (2003) · Neural Computation · doi:10.1162/089976603765202622 · Cited by 394
Sallee, F. R., Mcgough, J., Wigal, T., Donahue, J., Lyne, A., & Biederman, J. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e318191769e · Cited by 391
Arnsten, A., Cai, J., & Goldman-Rakic, P. (1988) · The Journal of Neuroscience · doi:10.1523/jneurosci.08-11-04287.1988 · Cited by 391
Dissociable effects of surprise and model update in parietal and anterior cingulate cortex
O’Reilly, J. X., Schüffelgen, U., Cuell, S. F., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1305373110 · Cited by 378
Arnsten, A. F., & Dudley, A. G. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-2 · Cited by 363
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346
Learning latent structure: carving nature at its joints
Gershman, S. J., & Niv, Y. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.008 · Cited by 326
Wang, X.-J., & Krystal, J. H. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.018 · Cited by 312
Computational psychiatry: towards a mathematically informed understanding of mental illness
Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310737 · Cited by 285
Striatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253
fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning
Frank, M. J., Gagne, C., Nyhus, E., Masters, S., Wiecki, T. V., Cavanagh, J. F., & Badre, D. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2036-14.2015 · Cited by 241
Perikaryal and synaptic localization ofα2A-adrenergic receptor-like immunoreactivity
Aoki, C., Go, C.-G., Venkatesan, C., & Kurose, H. (1994) · Brain Research · doi:10.1016/0006-8993(94)91782-5 · Cited by 221
Activation of the noradrenergic system facilitates an attentional shift in the rat
Devauges, V., & Sara, S. J. (1990) · Behavioural Brain Research · doi:10.1016/0166-4328(90)90118-x · Cited by 200
Guanfacine, But Not Clonidine, Improves Planning and Working Memory Performance in Humans
Jäkälä, P. (1999) · Neuropsychopharmacology · doi:10.1016/s0893-133x(98)00127-4 · Cited by 189
Nicotinic α7 receptors enhance NMDA cognitive circuits in dorsolateral prefrontal cortex
Yang, Y., Paspalas, C. D., Jin, L. E., Picciotto, M. R., Arnsten, A. F. T., & Wang, M. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1307849110 · Cited by 188
Arnsten, A. F. T., & Contant, T. A. (1992) · Psychopharmacology · doi:10.1007/bf02245302 · Cited by 168
Inferring Relevance in a Changing World
Wilson, R. C., & Niv, Y. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00189 · Cited by 168
Computational neuroimaging strategies for single patient predictions
Stephan, K. E., Schlagenhauf, F., Huys, Q. J. M., Raman, S., Aponte, E. A., Brodersen, K. H., Rigoux, L., Moran, R. J., Daunizeau, J., Dolan, R. J., et al. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.038 · Cited by 166
Mao, Z.-M., Arnsten, A. F. T., & Li, B.-M. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00139-0 · Cited by 156
Witte, E. A., & Marrocco, R. T. (1997) · Psychopharmacology · doi:10.1007/s002130050351 · Cited by 152
Forebrain norepinephrine: role in controlled information processing in the rat.
Cole, B. J., & Robbins, T. W. (1992) · PubMed · Cited by 137
Inhibition of the norepinephrine transporter improves behavioral flexibility in rats and monkeys
Seu, E., Lang, A., Rivera, R. J., & Jentsch, J. D. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1250-4 · Cited by 128
Franowicz, J. S., & Arnsten, A. F. T. (1998) · Psychopharmacology · doi:10.1007/s002130050533 · Cited by 120
The role of prefrontal catecholamines in attention and working memory
Clark, K., & Noudoost, B. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00033 · Cited by 115
Zhang, J., Rittman, T., Nombela, C., Fois, A. F., Coyle-Gilchrist, I. T. S., Barker, R. A., Hughes, L. E., & Rowe, J. B. (2015) · Brain · doi:10.1093/brain/awv331 · Cited by 109
Long-Range Attention Networks: Circuit Motifs Underlying Endogenously Controlled Stimulus Selection
Womelsdorf, T., & Everling, S. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.08.009 · Cited by 105
Self-citationCallado, L. F., & Stamford, J. A. (1999) · European Journal of Pharmacology · doi:10.1016/s0014-2999(98)00889-9 · Cited by 100
Steere, J. C., & Arnsten, A. F. T. (1997) · Behavioral Neuroscience · doi:10.1037/0735-7044.111.5.883 · Cited by 94
Arnsten, A. F. T., & Goldman-Rakic, P. S. (1990) · Neurobiology of Aging · doi:10.1016/0197-4580(90)90021-q · Cited by 88
Jäkälä, P., Sirviö, J., Riekkinen, M., Koivisto, E., Kejonen, K., Vanhanen, M., & Riekkinen, P. (1999) · Neuropsychopharmacology · doi:10.1016/s0893-133x(98)00055-4 · Cited by 85
Medetomidine, atipamezole, and guanfacine in delayed response performance of aged monkeys
Pia Rämä, A., Linnankoski, I., Tanila, H., Pertovaara, A., & Carlson, S. (1996) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(96)00111-6 · Cited by 77
Lack of effects of guanfacine on executive and memory functions in healthy male volunteers
Müller, U., Clark, L., Lam, M. L., Moore, R. M., Murphy, C. L., Richmond, N. K., Sandhu, R. S., Wilkins, I. A., Menon, D. K., Sahakian, B. J., et al. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0078-4 · Cited by 73
Engberg, G., & Eriksson, E. (1991) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/bf00169548 · Cited by 68
Ji, X.-H., Ji, J.-Z., Zhang, H., & Li, B.-M. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301603 · Cited by 63
Uhlén, S., Muceniece, R., Rangel, N., Tiger, G., & Wikberg, J. E. S. (1995) · Pharmacology & Toxicology · doi:10.1111/j.1600-0773.1995.tb00161.x · Cited by 59
A Computational Cognitive Biomarker for Early-Stage Huntington’s Disease
Wiecki, T. V., Antoniades, C. A., Stevenson, A. D., Kennard, C., Borowsky, B., Owen, G. N., Leavitt, B. R., Roos, R. A. C., Dürr, A., Tabrizi, S. J., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148409 · Cited by 53
α2-Adrenergic Receptors Modify Dendritic Spike Generation Via HCN Channels in the Prefrontal Cortex
Barth, A. M., Vizi, E. S., Zelles, T., & Lendvai, B. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00943.2007 · Cited by 51
Effects of α-2A adrenergic receptor agonist on time and risk preference in primates
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. T., & Lee, D. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2520-0 · Cited by 47
Manipulating Decisiveness in Decision Making: Effects of Clonidine on Hippocampal Search Strategies
Amemiya, S., & Redish, A. D. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.2595-15.2016 · Cited by 42
Yi, F., Liu, S., Luo, F., Zhang, X., & Li, B. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12257 · Cited by 38
Noradrenergic control of error perseveration in medial prefrontal cortex
Caetano, M. S., Jin, L. E., Harenberg, L., Stachenfeld, K., Arnsten, A. F. T., & Laubach, M. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00125 · Cited by 35
Effects of guanfacine on three forms of distraction in the aging macaque
O'Neill, J., Fitten, L. J., Siembieda, D. W., Ortiz, F., & Halgren, E. (2000) · Life Sciences · doi:10.1016/s0024-3205(00)00681-0 · Cited by 32
Kawaura, K., Karasawa, J.-I., Chaki, S., & Hikichi, H. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2014.05.044 · Cited by 29
Bayesian neural adjustment of inhibitory control predicts emergence of problem stimulant use
Harlé, K. M., Stewart, J. L., Zhang, S., Tapert, S. F., Yu, A. J., & Paulus, M. P. (2015) · Brain · doi:10.1093/brain/awv246 · Cited by 27
Balcarras, M., Ardid, S., Kaping, D., Everling, S., & Womelsdorf, T. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00894 · Cited by 25
Self-citationDecamp, E., Clark, K., & Schneider, J. S. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07815.x · Cited by 24
The α2A-Adrenergic Agonist Guanfacine Improves Visuomotor Associative Learning in Monkeys
Wang, M., Ji, J., & Li, B. (2003) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300278 · Cited by 20
Connor, D. F., Arnsten, A. F. T., Pearson, G. S., & Greco, G. F. (2014) · Expert Opinion on Pharmacotherapy · doi:10.1517/14656566.2014.930437 · Cited by 17
Cited by
Short chain fatty acids and its producing organisms: An overlooked therapy for IBD?
Deleu, S., Machiels, K., Raes, J., Verbeke, K., & Vermeire, S. (2021) · eBioMedicine · doi:10.1016/j.ebiom.2021.103293 · Cited by 766
Hamid, B., Zaman, M., Farooq, S., Fatima, S., Sayyed, R. Z., Baba, Z. A., Sheikh, T. A., Reddy, M. S., El Enshasy, H., Gafur, A., et al. (2021) · Sustainability · doi:10.3390/su13052856 · Cited by 389
Luijendijk, E., Gleeson, T., & Moosdorf, N. (2020) · Nature Communications · doi:10.1038/s41467-020-15064-8 · Cited by 366
Mohammad, T., Mathur, Y., & Hassan, M. I. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa279 · Cited by 311
Boutet, A., Madhavan, R., Elias, G. J. B., Joel, S. E., Gramer, R., Ranjan, M., Paramanandam, V., Xu, D., Germann, J., Loh, A., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-23311-9 · Cited by 301
Metadata
- Authors
- Hassani, S. A., Oemisch, M., Balcarras, M., Westendorff, S., Ardid, S., van der Meer, M. A., Tiesinga, P., & Womelsdorf, T.
- Venue
- Scientific Reports
- Published
- 2017-01-16
- Volume
- 7
- Issue
- 1
- Pages
- 40606-40606
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2578577905
- Cited by
- 360
- References
- 69
- FWCI
- 20.20
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.