Computational psychopharmacology: a translational and pragmatic approach
Open accessThe DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
RATIONALE: Psychopharmacology needs novel quantitative measures and theoretical approaches based on computational modelling that can be used to help translate behavioural findings from experimental animals to humans, including patients with neuropsychiatric disorders. OBJECTIVES: This brief review exemplifies this approach when applied to recent published studies of the effects of manipulating central dopaminergic and serotoninergic systems in rodents and marmoset monkeys, and possible comparisons with healthy human volunteers receiving systemic agents or patients with depression and schizophrenia. METHODS: Behavioural effects of central depletions of dopamine or serotonin in monkeys in probabilistic learning paradigms are characterised further by computational modelling methods and related to rodent and human data. RESULTS: Several examples are provided of the power of computational modelling to derive new measures and reappraise conventional explanations of regional neurotransmitter depletion and other drug effects, whilst enhancing construct validation in patient groups. Specifically, effects are shown on such parameters as 'stimulus stickiness' and 'side stickiness', which occur over and above effects on standard parameters of reinforcement learning, reminiscent of some early innovations in data analysis in psychopharmacology. CONCLUSIONS: Computational modelling provides a useful methodology for further detailed analysis of behavioural mechanisms that are affected by pharmacological manipulations across species and will aid the translation of experimental findings to understand the therapeutic effects of medications in neuropsychiatric disorders, as well as facilitating future drug discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 1×
“However, reinforcement learning theory has provided us with a number of algorithms that adequately support learning, ranging from agent-based approaches (Russell and Norvig 1995; Sutton and Barto 1998) to more psychologically motivated models such as that of Rescorla and Wagner (1972) for Pavlovian conditioning.”
BackgroundReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
(1966) · Medical Entomology and Zoology · Cited by 10,293
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,661
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 3×
“There were effects on appetitive but not aversive learning, possibly consistent with Schultz ’ s findings in monkeys (Schultz et al. 1997).”
BackgroundResultSignal detection theory and psychophysics
Ingleby, J. D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,509
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Implications of Normal Brain Development for the Pathogenesis of Schizophrenia
Weinberger, D. R. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800190080012 · Cited by 3,724 · cited 1×
“…prefrontal cortex in marmoset monkeys (Clarke et al. 2014) to model some of the presumed changes occurring in schizophrenia, which have been proposed to reflect a reciprocal balance between cortical DA un-deractivity and subcortical DA over-activity (Weinberger 1987; Meyer-Lindenberg et al. 2002).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“Thus, Schultz et al. (1997), based on such previously hypothesised mechanisms (Montague et al. 1996), were able to show in rhesus monkeys that the phasic firing of mid-brain DA neurons in response to conditioned stimuli (CSs) associated with reward provided the neuronal substrate of prediction…”
BackgroundAbstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003 · cited 1×
“Such paradigms have revealed activity during learning and reversal in such structures as the orbitofrontal and ventrolateral prefrontal cortex and the ventral striatum, which are in receipt of dopaminergic afferents (O’Doherty et al. 2001; Cools et al. 2002).”
BackgroundArtificial Intelligence: A Modern Approach
Russell, S., & Norvig, P. (1995) · Cited by 1,753
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · cited 7×
“Sulpiride had very clear-cut effects that were similar in several ways to those of haloperidol in the study by Pessiglione et al. (2006).”
BackgroundResultInfluentialCohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121 · cited 4×
“The reduced side bias may even reflect an increased tendency to ‘ exploration ’ (c.f. Cohen et al. 2007), analogous to effects of systemic d-amphetamine to increase response switching in an uncertain environment (Evenden and Robbins 1983) and also to the strategies of acute psychotic patients…”
BackgroundInfluentialAnimal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100
Anderson, I., Ferrier, I., Baldwin, R., Cowen, P., Howard, L., Lewis, G., Matthews, K., McAllister-Williams, R., Peveler, R., Scott, J., et al. (2008) · Journal of Psychopharmacology · doi:10.1177/0269881107088441 · Cited by 908 · cited 1×
“Other studies have focused on possible neurochemical correlates of this apparently heightened reactivity to negative feedback, specifically mediated by serotonin — guided by the fact that depression often responds to selective serotonin re-uptake inhibitors (SSRIs) (Anderson et al. 2008).”
BackgroundAnimal Intelligence. Experimental Studies
Thorndike, E. L., & Jelliffe (1912) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-191205000-00016 · Cited by 817
Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04563.2002 · Cited by 784 · cited 4×
“Such paradigms have revealed activity during learning and reversal in such structures as the orbitofrontal and ventrolateral prefrontal cortex and the ventral striatum, which are in receipt of dopaminergic afferents (O ’ Doherty et al. 2001; Cools et al. 2002).”
BackgroundInfluentialSelf-citationGenetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683 · cited 2×
“Moreover, based on previous behavioural findings relating genetic polymorphisms to learning parameters, including reversal (Frank et al. 2007; Jocham et al. 2009; den Ouden et al. 2013), we also stratified the population of human volunteers by recruiting individuals with and without the DA D2 receptor Taq1A polymorphi…”
BackgroundReduced prefrontal activity predicts exaggerated striatal dopaminergic function in schizophrenia
Meyer-Lindenberg, A., Miletich, R. S., Kohn, P. D., Esposito, G., Carson, R. E., Quarantelli, M., Weinberger, D. R., & Berman, K. F. (2002) · Nature Neuroscience · doi:10.1038/nn804 · Cited by 652 · cited 1×
“…prefrontal cortex in marmoset monkeys (Clarke et al. 2014) to model some of the presumed changes occurring in schizophrenia, which have been proposed to reflect a reciprocal balance between cortical DA un-deractivity and subcortical DA over-activity (Weinberger 1987; Meyer-Lindenberg et al. 2002).”
BackgroundDisorders of compulsivity: A common bias towards learning habits
Voon, V, Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., Schreiber, L. R. N., Gillan, C., Fineberg, N. A., Sahakian, B. J., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.44 · Cited by 643
Self-citationCognitive Inflexibility After Prefrontal Serotonin Depletion
Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., & Roberts, A. C. (2004) · Science · doi:10.1126/science.1094987 · Cited by 632 · cited 2×
“…(2012) found that acute dietary tryptophan depletion in healthy human volunteers tended to increase stimulus stickiness, and the findings may also contribute to our understanding of the effects of orbitofrontal 5-HT loss on deterministic visual reversal learning in marmosets (Clarke et al. 2004).”
BackgroundSelf-citationThe role of D2-autoreceptors in regulating dopamine neuron activity and transmission
Ford, C. P. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.01.025 · Cited by 590 · cited 1×
“For example, DA D2 autoreceptors inhibit DA neuronal firing and DA release from dopaminergic neurons; thus, DA D2 antagonists can increase DA release via presynaptic (autoreceptor) mechanisms (see Ford 2014).”
BackgroundNeurochemical Modulation of Response Inhibition and Probabilistic Learning in Humans
Chamberlain, S. R., Müller, U., Blackwell, A. D., Clark, L., Robbins, T. W., & Sahakian, B. J. (2006) · Science · doi:10.1126/science.1121218 · Cited by 573 · cited 1×
“Chamberlain et al. (2006) reported that low doses of the SSRI citalopram impaired performance on a probabilistic learning paradigm in healthy volunteers.”
BackgroundSelf-citationThompson, J., Thomas, N., Singleton, A., Piggot, M., Lloyd, S., Perry, E. K., Morris, C. M., Perry, R. H., Ferrier, I. N., & Court, J. A. (1997) · Pharmacogenetics · doi:10.1097/00008571-199712000-00006 · Cited by 553 · cited 1×
“…2009; den Ouden et al. 2013), we also stratified the population of human volunteers by recruiting individuals with and without the DA D2 receptor Taq1A polymorphism, as the minor A1 allele has been associated with a reduction of up to 30% of striatal DA D2 receptor density (Thompson et al. 1997).”
BackgroundFrank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472 · cited 1×
“Support for Michael Frank ’ s modelling of D2 receptor actions has depended to some extent on interpreting the effects of haloperidol as working in part at DA D2 autoreceptors (e.g. Frank and O ’ Reilly 2006).”
BackgroundFrank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009) · Nature Neuroscience · doi:10.1038/nn.2342 · Cited by 471 · cited 2×
“…related to chang-es in tonic DA function in the basal ganglia (Humphries et al. 2012) and from genetic evidence in humans, exploration has been shown to be affected by polymorphisms of the enzyme catechol-O -methyl transferase, which regulates DA in the human prefrontal cortex (Frank et al. 2009).”
BackgroundTrial-by-trial data analysis using computational models
Daw, N. D. (2011) · Decision Making, Affect, and Learning · doi:10.1093/acprof:oso/9780199600434.003.0001 · Cited by 456 · cited 2×
“The two-stage Markov decision-making task introduced by Daw (2011) enables a direct comparison to be made of effects of drugs or neurochemical manipulations on model-based versus model-free learning, in the same individual.”
BackgroundInfluence of Phasic and Tonic Dopamine Release on Receptor Activation
Dreyer, J. K., Herrik, K. F., Berg, R. W., & Hounsgaard, J. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1894-10.2010 · Cited by 423 · cited 1×
“However, it should not be forgotten that D2 receptors have been linked with tonic rather than phasic modes of dopamine function and that the prediction errors are supposed to be a function of the latter (Dreyer et al. 2010).”
BackgroundWaltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331 · cited 1×
“Indeed, other studies of patients with schizophrenia using a similar probabilistic reversal learning procedure (e.g. Waltz and Gold 2007; Waltz et al. 2007, 2013; Schlagenhauf et al. 2014) have also shown changes in parameters of reinforcement learning, illustrating the translational potential of…”
BackgroundWaltz, J. A., Frank, M. J., Robinson, B. M., & Gold, J. M. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.09.042 · Cited by 327 · cited 1×
“Indeed, other studies of patients with schizophrenia using a similar probabilistic reversal learning procedure (e.g. Waltz and Gold 2007; Waltz et al. 2007, 2013; Schlagenhauf et al. 2014) have also shown changes in parameters of reinforcement learning, illustrating the translational potential of…”
BackgroundBari, A., Theobald, D. E., Caprioli, D., Mar, A. C., Aidoo-Micah, A., Dalley, J. W., & Robbins, T. W. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.233 · Cited by 325 · cited 2×
“In order to test these effects more mechanistically in a rodent model, Bari et al. (2010) designed a spatial version of the probabilistic reversal task in which reinforcement was assigned according to 80:20 and 20:80 contingencies.”
BackgroundSelf-citationMURPHY, F. C., MICHAEL, A., ROBBINS, T. W., & SAHAKIAN, B. J. (2003) · Psychological Medicine · doi:10.1017/s0033291702007018 · Cited by 298 · cited 3×
“This strongly suggests again that a manipulation of 5-HT can have asymmetrical effects on reward and aversive processing, as suggested by the original observations on patients with depression (Murphy et al. 2003) and some of the pharmacological studies of 5-HT function.”
BackgroundResultInfluentialSelf-citationDopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294 · cited 1×
“Wunderlich et al. (2012) reported, perhaps surprisingly, that a dose of L-DOPA selectively enhanced model-based learning, perhaps as a consequence of its actions in the ventral striatum (Deserno et al. 2015).”
BackgroundGronau, Q. F., Sarafoglou, A., Matzke, D., Ly, A., Boehm, U., Marsman, M., Leslie, D. S., Forster, J. J., Wagenmakers, E.-J., & Steingroever, H. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.09.005 · Cited by 284
Dissociable Effects of Dopamine and Serotonin on Reversal Learning
den Ouden, H. E. M., Daw, N. D., Fernandez, G., Elshout, J. A., Rijpkema, M., Hoogman, M., Franke, B., & Cools, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.030 · Cited by 255 · cited 1×
“…previous behavioural findings relating genetic polymorphisms to learning parameters, including reversal (Frank et al. 2007; Jocham et al. 2009; den Ouden et al. 2013), we also stratified the population of human volunteers by recruiting individuals with and without the DA D2 receptor Taq1A…”
BackgroundStriatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253 · cited 2×
“…antagonists certainly affect probabilistic reinforcement learning parameters in healthy volunteers, as we have described above, the study by Schlagenhauf et al. 2014) confirmed that the behavioural deficits in probabilistic reversal were also present in unmedicated patients with…”
BackgroundMethodSerotonin Selectively Modulates Reward Value in Human Decision-Making
Seymour, B., Daw, N. D., Roiser, J. P., Dayan, P., & Dolan, R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0053-12.2012 · Cited by 252 · cited 1×
“Seymour et al. (2012) found that acute dietary tryptophan depletion in healthy human volunteers tended to increase stimulus stickiness, and the findings may also contribute to our understanding of the effects of orbitofrontal 5-HT loss on deterministic visual reversal learning in marmosets (Clarke…”
BackgroundDeserno, L., Huys, Q. J. M., Boehme, R., Buchert, R., Heinze, H.-J., Grace, A. A., Dolan, R. J., Heinz, A., & Schlagenhauf, F. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417219112 · Cited by 233 · cited 1×
“Wunderlich et al. (2012) reported, perhaps surprisingly, that a dose of L-DOPA selectively enhanced model-based learning, perhaps as a consequence of its actions in the ventral striatum (Deserno et al. 2015).”
BackgroundNeural basis of abnormal response to negative feedback in unmedicated mood disorders
Taylor Tavares, J. V., Clark, L., Furey, M. L., Williams, G. B., Sahakian, B. J., & Drevets, W. C. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.05.049 · Cited by 229 · cited 3×
“This aberrant shifting behaviour is obviously disadvantageous and was later shown to occur in unmedicated patients with depression in an fMRI setting, where it was correlated with the absence of a deactivation in the amygdala that usually occurs in control subjects in this task (and also with a possibly regulatory abs…”
BackgroundMehta, M. A., Sahakian, B. J., McKenna, P. J., & Robbins, T. W. (1999) · Psychopharmacology · doi:10.1007/s002130051102 · Cited by 223 · cited 2×
“selective D2/3 receptor antagonists such as sulpiride (Mehta et al. 1999).”
BackgroundSelf-citationDopaminergic control of the exploration-exploitation trade-off via the basal ganglia
Humphries, M. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00009 · Cited by 206 · cited 1×
“From a computational perspective, exploration versus exploitation has been related to chang-es in tonic DA function in the basal ganglia (Humphries et al. 2012) and from genetic evidence in humans, exploration has been shown to be affected by polymorphisms of the enzyme catechol-O -methyl…”
BackgroundDopamine DRD2 Polymorphism Alters Reversal Learning and Associated Neural Activity
Jocham, G., Klein, T. A., Neumann, J., von Cramon, D. Y., Reuter, M., & Ullsperger, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5195-08.2009 · Cited by 181 · cited 2×
“Moreover, based on previous behavioural findings relating genetic polymorphisms to learning parameters, including reversal (Frank et al. 2007; Jocham et al. 2009; den Ouden et al. 2013), we also stratified the population of human volunteers by recruiting individuals with and without the DA D2 receptor Taq1A polymorphi…”
BackgroundEvenden, J. L., & Robbins, T. W. (1983) · Psychopharmacology · doi:10.1007/bf00427498 · Cited by 151 · cited 2×
“analogous to effects of systemic d-amphetamine to increase response switching in an uncertain environment (Evenden and Robbins 1983) and also to the strategies of acute psychotic”
BackgroundSelf-citationReimold, M., Batra, A., Knobel, A., Smolka, M. N., Zimmer, A., Mann, K. F., Solbach, C., Reischl, G., Schwärzler, F., Gründer, G., et al. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002149 · Cited by 148 · cited 1×
“…of medication are a major source of evidence in support of the serotoninergic hypothesis of depression, which has some additional limited support from PETstudies of the status of 5-HT receptors and the 5-HT transporter in major depressive disorder (e.g. Reimold et al. 2008; Kaufman et al. 2015).”
ResultStereotyped responding by schizophrenic patients on a two-choice guessing task
Frith, C. D., & Done, D. J. (1983) · Psychological Medicine · doi:10.1017/s0033291700051485 · Cited by 137 · cited 2×
“…to ‘ exploration ’ (c.f. Cohen et al. 2007), analogous to effects of systemic d-amphetamine to increase response switching in an uncertain environment (Evenden and Robbins 1983) and also to the strategies of acute psychotic patients exposed to a random 2-choice guessing game (Frith and Done 1983).”
BackgroundRole of Dopamine D2 Receptors in Human Reinforcement Learning
Eisenegger, C., Naef, M., Linssen, A., Clark, L., Gandamaneni, P. K., Müller, U., & Robbins, T. W. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.84 · Cited by 134 · cited 2×
“Such a result would also validate the sensitivity of the probabilistic learning paradigm employed by Pessiglione et al. (2006) and Eisenegger et al. (2014), which may possibly be more sensitive to effects on β than α .”
BackgroundSelf-citationTHE MODIFICATION OF DRUG EFFECTS ON BEHAVIOR BY EXTERNAL DISCRIMINATIVE STIMULI
Laties, V. G. (1972) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)29309-0 · Cited by 130 · cited 1×
“Bernard Weiss and Victor Laties (Weiss and Gott 1972; Laties 1972) also pioneered the use of sophisticated variables to characterise drug effects and several investigators have employed microanalyses of behaviour to look for understanding at the level of ongoing sequential changes in behaviour.”
Waltz, J. A., Kasanova, Z., Ross, T. J., Salmeron, B. J., McMahon, R. P., Gold, J. M., & Stein, E. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057257 · Cited by 122 · cited 3×
“Indeed, other studies of patients with schizophrenia using a similar probabilistic reversal learning procedure (e.g. Waltz and Gold 2007; Waltz et al. 2007, 2013; Schlagenhauf et al. 2014) have also shown changes in parameters of reinforcement learning, illustrating the translational potential of…”
BackgroundAbi-Dargham, A., Xu, X., Thompson, J. L., Gil, R., Kegeles, L. S., Urban, N., Narendran, R., Hwang, D.-R., Laruelle, M., & Slifstein, M. (2012) · Journal of Psychopharmacology · doi:10.1177/0269881111409265 · Cited by 120 · cited 1×
“This focuses attention on prefrontal cortical D1 receptors which have been reported to be upregulated in unmedicated schizophrenia and may reflect a compensatory response to disorder-related down-regulation of prefrontal DA (Abi-Dargham et al. 2012).”
BackgroundUnilateral Lesions of the Dorsal Striatum in Rats Disrupt Responding in Egocentric Space
Brasted, P. J., Humby, T., Dunnett, S. B., & Robbins, T. W. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-22-08919.1997 · Cited by 105 · cited 1×
“By contrast, the side stickiness parameter correlated better with D2 receptor binding in the body of the caudate, which is consistent with the role of the dorsal striatum in egocentric spatial processing (e.g. Brasted et al. 1997).”
ResultSelf-citationKanen, J. W., Ersche, K. D., Fineberg, N. A., Robbins, T. W., & Cardinal, R. N. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05325-w · Cited by 101 · cited 3×
“This task has increasingly been employed to make comparisons between patient groups and healthy controls, commonly finding that there is a shift towards model-free learning, for example in stimulant dependence or OCD (e.g. Voon et al. 2015).”
BackgroundSelf-citationSkandali, N., Rowe, J. B., Voon, V., Deakin, J. B., Cardinal, R. N., Cormack, F., Passamonti, L., Bevan-Jones, W. R., Regenthal, R., Chamberlain, S. R., et al. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0229-z · Cited by 89 · cited 1×
“Skandali et al. (2018) recently followed up these findings in a similar group of volunteers to show increased shifting in response to negative feedback.”
Self-citationRygula, R., Clarke, H. F., Cardinal, R. N., Cockcroft, G. J., Xia, J., Dalley, J. W., Robbins, T. W., & Roberts, A. C. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu102 · Cited by 85 · cited 1×
“Delta rule with “stimulus stickiness” and “side stickiness” (Clarke et al. 2014; Rygula et al. 2014) Psychopharmacology”
Self-citationValence-dependent influence of serotonin depletion on model-based choice strategy
Worbe, Y., Palminteri, S., Savulich, G., Daw, N. D., Fernandez-Egea, E., Robbins, T. W., & Voon, V (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.46 · Cited by 75 · cited 1×
“Worbe et al. (2016) modified the task to include a parallel set of contingencies to avoid loss (in addition to the usual ones for gain) and studied the effects of acute dietary tryptophan depletion.”
BackgroundSelf-citationKaufman, J., Sullivan, G. M., Yang, J., Ogden, R. T., Miller, J. M., Oquendo, M. A., Mann, J. J., Parsey, R. V., & DeLorenzo, C. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.15 · Cited by 74 · cited 1×
“…of medication are a major source of evidence in support of the serotoninergic hypothesis of depression, which has some additional limited support from PETstudies of the status of 5-HT receptors and the 5-HT transporter in major depressive disorder (e.g. Reimold et al. 2008; Kaufman et al. 2015).”
ResultMehta, M. A., Montgomery, A. J., Kitamura, Y., & Grasby, P. M. (2007) · Psychopharmacology · doi:10.1007/s00213-007-0947-0 · Cited by 71 · cited 1×
“Later studies by Mehta et al. (2008) showed that the commonly used dose of 400 mg sulpiride occupies only about 30% of striatal D2 receptors.”
MethodThe facilitation of discrimination performance by physostigmine sulphate
Warburton, D. M., & Brown, K. (1972) · Psychopharmacology · doi:10.1007/bf00422808 · Cited by 60 · cited 1×
“Warburton and Brown (1972) introduced such methods into psychopharma-cology to show that cholinergic agents such as physotigmine, at least at some doses in rats, improved d ’ with no effects on β , suggesting that the drug enhanced visual attention.”
MethodKoek, W., & Slangen, J. L. (1983) · Psychopharmacology · doi:10.1007/bf00427954 · Cited by 58 · cited 1×
“For example, Koek and Slangen (1984), using a measure of the conditional tendency to repeat responding [p(rep)], found that amphetamine had a tendency to increase response repetition that overshadowed its effects on discrimination per se.”
MethodClarke, H. F., Cardinal, R. N., Rygula, R., Hong, Y. T., Fryer, T. D., Sawiak, S. J., Ferrari, V., Cockcroft, G., Aigbirhio, F. I., Robbins, T. W., et al. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0718-14.2014 · Cited by 54 · cited 6×
“A second example of the use of computational approaches to understanding effects on learning of dopamine manipulation comes from an attempt to determine the functional sequelae of DA depletion from the prefrontal cortex in marmoset monkeys (Clarke et al. 2014) to model some of the presumed”
BackgroundMethodInfluentialSelf-citationA MICROANALYSIS OF DRUG EFFECTS ON FIXED-RATIO PERFORMANCE IN PIGEONS
Weiss, B., & Gott, C. T. (1972) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)29103-0 · Cited by 44 · cited 1×
“Bernard Weiss and Victor Laties (Weiss and Gott 1972; Laties 1972) also pioneered the use of sophisticated variables to characterise drug effects and several investigators have employed microanalyses of behaviour to look for understanding at the level of ongoing sequential changes in behaviour.”
BackgroundA New Understanding of Mental Disorders: Computational Models for Dimensional Psychiatry
Heinz, A. (2017) · The MIT Press eBooks · doi:10.7551/mitpress/9780262036894.001.0001 · Cited by 40 · cited 1×
“‘ Computational psychopharmacology ’ , like computational psychiatry (Heinz 2017), is a young and nascent field that seems to be worthy of further development, especially in a translational context that links the two.”
BackgroundHorst, N. K., Jupp, B., Roberts, A. C., & Robbins, T. W. (2019) · Neuropsychopharmacology · doi:10.1038/s41386-018-0272-9 · Cited by 38 · cited 1×
“Recently, we were able to report tri-phasic effects of intra-caudate quinpirole on reversal learning in monkeys, with low and high doses impairing performance and intermediate doses significantly improving learning (in terms of errors to criterion) (Horst et al. 2019).”
BackgroundSelf-citationA New Understanding of Mental Disorders: Computational Models for Dimensional Psychiatry
Heinz, A. (2017) · Cited by 21
Koek, W., & Slangen, J. L. (1984) · Psychopharmacology · doi:10.1007/bf00428543 · Cited by 17
Sahgal, A., & Clincke, G. (1985) · Psychopharmacology · doi:10.1007/bf00432725 · Cited by 13 · cited 2×
“Consideration of these local strategic tendencies appeared likely to explain some of the behavioural choices of the marmoset, as had earlier been acknowledged by the type of analysis advocated by Sahgal and Clincke (1985) described above.”
Background
Cited by
Prefrontal cortex and depression
Pizzagalli, D. A., & Roberts, A. C. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01101-7 · Cited by 667
Individual differences in computational psychiatry: A review of current challenges
Karvelis, P., Paulus, M. P., & Diaconescu, A. O. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105137 · Cited by 105
“…tell us why certain computational measures are predictive of clinical outcomes or how different treatments are affecting the underlying computational processes (Lan and Browning, 2022; Reiter et al., 2021; Nair et al., 2020; Iglesias et al., 2017; Robbins and Cardinal, 2019; Hauser et al., 2022).”
Roberts, C., Sahakian, B. J., & Robbins, T. W. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.001 · Cited by 65
Self-citationLuo, Q., Kanen, J. W., Bari, A., Skandali, N., Langley, C., Knudsen, G. M., Alsiö, J., Phillips, B. U., Sahakian, B. J., Cardinal, R. N., et al. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01762-6 · Cited by 29
Self-citationStupart, O., Robbins, T. W., & Dalley, J. W. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06275-6 · Cited by 35
“Computational modelling based on reinforcement learning theory can also be applied to both human and experimental animal performance on the PRL task (Robbins and Cardinal 2019).”
MethodSelf-citation
Metadata
- Authors
- Robbins, T. W., & Cardinal, R. N.
- Affiliations
- University of Cambridge (GB)
- Corresponding author
- Robbins, Trevor W.
- Venue
- Psychopharmacology
- Published
- 2019-07-04
- Volume
- 236
- Issue
- 8
- Pages
- 2295-2305
- ISSN
- 0033-3158 (ISSN-L)
- 1432-2072
- PMC
- PMC6695356
- OpenAlex
- W2953994914
- Cited by
- 25
- References
- 66
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 4 · 2022: 5 · 2021: 6 · 2020: 5 · 2019: 1
- FWCI
- 0.56
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Psychopharmacology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- University of Cambridge
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Keywords
- computational modelling, dopamine depletion, serotonin depletion, probabilistic learning, reinforcement learning, marmoset monkey, rodent models, translational research, depression, schizophrenia, neuropsychiatric disorders, drug discovery
- MeSH terms
- Animals, Depressive Disorder, Dopamine, Humans, Learning, Psychopharmacology, Reinforcement, Psychology, Schizophrenia, Serotonin, Computational Biology, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.