Probabilistic reward- and punishment-based learning in opioid addiction: Experimental and computational data
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Addiction is the continuation of a habit in spite of negative consequences. A vast literature gives evidence that this poor decision-making behavior in individuals addicted to drugs also generalizes to laboratory decision making tasks, suggesting that the impairment in decision-making is not limited to decisions about taking drugs. In the current experiment, opioid-addicted individuals and matched controls with no history of illicit drug use were administered a probabilistic classification task that embeds both reward-based and punishment-based learning trials, and a computational model of decision making was applied to understand the mechanisms describing individuals’ performance on the task. Although behavioral results showed thatopioid-addicted individuals performed as well as controls on both reward- and punishment-based learning, the modeling results suggested subtle differences in how decisions were made between the two groups. Specifically, the opioid-addicted group showed decreased tendency to repeat prior responses, meaning that they were more likely to “chase reward” when expectancies were violated, whereas controls were more likely to stick with a previously-successful response rule, despite occasional expectancy violations. This tendency to chase short-term reward, potentially at the expense of developing rules that maximize reward over the long term, may be a contributing factor to opioid addiction. Further work is indicated to better understand whether this tendency arises as a result of brain changes in the wake of continued opioid use/abuse, or might be a pre-existing factor that may contribute to risk for addiction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 1×
“RL theories suggest that actions are chosen to best maximize rewards (or reward value) in a given state (Barto, Sutton, & Anderson, 1983; Sutton, 1988; Widrow, Gupta, & Maitra, 1973).”
BackgroundDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“…in animals DA neurons respond especially to unexpected rewards (Hollerman & Schultz, 1998; Schultz, 1998), as well as to stimuli that signal upcoming or predicted reward (Fiorillo, Tobler, & Schultz, 2003) and reduce firing in response to omission of expected reward (Hollerman & Schultz, 1998).”
BackgroundBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Dopamine in drug abuse and addiction: results from imaging studies and treatment implications
Volkow, N. D., Fowler, J. S., Wang, G.-J., & Swanson, J. M. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001507 · Cited by 1,101 · cited 1×
“Such a difference would be plausible, given that reward-based prediction error signals in the critic have been linked to dopamine, and given that the ‘high’ induced by addictive drugs is directly proportional to increased DA (Volkow, Fowler, Wang, & Swanson, 2004).”
BackgroundHuys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002410 · Cited by 439
Neuropsychological consequences of chronic opioid use: a quantitative review and meta-analysis.
Baldacchino, A., Balfour, D. J. K., Passetti, F., Humphris, G., & Matthews, K. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.06.006 · Cited by 263 · cited 1×
“In fact, one recent meta-analysis suggests that the only neuropsychological domains that are reliably impaired across studies of chronic opioid exposure are those involving working memory, cognitive impulsivity, and cognitive flexibility (Baldacchino, Balfour, Passetti, Humphris, & Matthews, 2012).”
BackgroundHaber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230
Discontinuation of Buprenorphine Maintenance Therapy: Perspectives and Outcomes
Bentzley, B. S., Barth, K. S., Back, S. E., & Book, S. W. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.12.011 · Cited by 176 · cited 1×
“…such as methadone and buprenorphine; however, a recent review of outcomes following buprenorphine maintenance therapy reported that, in every study examined, 1 month following discontinuation of treatment rates of relapse to illicit opioid use exceeded 50% (Bentzley, Barth, Back, & Book, 2015).”
BackgroundInfluentialHerzallah, M. M., Moustafa, A. A., Natsheh, J. Y., Abdellatif, S. M., Taha, M. B., Tayem, Y. I., Sehwail, M. A., Amleh, I., Petrides, G., Myers, C. E., et al. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00067 · Cited by 77 · cited 2×
“…to better understand decision-making impairments in various psychiatric and neurological patient groups (Bódi et al., 2009; Chase et al., 2010; Frank, Seeberger, & O'Reilly, 2004; Herzallah et al., 2013; Myers et al., 2013; Piray et al., 2014; Prevost, McCabe, Jessup, Bossaerts, & O'Doherty, 2011).”
BackgroundSelf-citationGeneral functioning predicts reward and punishment learning in schizophrenia
Somlai, Z., Moustafa, A. A., Kéri, S., Myers, C. E., & Gluck, M. A. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.07.028 · Cited by 45 · cited 1×
“…reward and punishment learning in individuals with anxiety vulnerability (Sheynin et al., 2013), and correlation between reward-based (but not punishment-based) learning and negative (but not positive) symptoms in schizophrenia (Gold et al., 2012; Somlai, Moustafa, Keri, Myers, & Gluck, 2011).”
BackgroundSelf-citation
Cited by
The empirical status of predictive coding and active inference
Hodson, R., Mehta, M., & Smith, R. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105473 · Cited by 69
Intolerance of uncertainty in opioid dependency–Relationship with trait anxiety and impulsivity
Garami, J., Haber, P., Myers, C. E., Allen, M. T., Misiak, B., Frydecka, D., & Moustafa, A. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181955 · Cited by 45
Taylor, S., Lavalley, C. A., Hakimi, N., Stewart, J. L., Ironside, M., Zheng, H., White, E., Guinjoan, S., Paulus, M. P., & Smith, R. (2023) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2023.110945 · Cited by 15
Metadata
- Authors
- Myers, C. E., Sheynin, J., Balsdon, T., Luzardo, A., Beck, K. D., Hogarth, L., Haber, P., & Moustafa, A. A.
- Venue
- Behavioural Brain Research
- Publisher
- Elsevier BV
- Published
- 2016-01
- Volume
- 296
- Pages
- 240-248
- ISSN
- 0166-4328 (ISSN-L)
- OpenAlex
- W1629104599
- Cited by
- 64
- References
- 10
- FWCI
- 3.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.