Biases in the Explore–Exploit Tradeoff in Addictions: The Role of Avoidance of Uncertainty
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
We focus on exploratory decisions across disorders of compulsivity, a potential dimensional construct for the classification of mental disorders. Behaviors associated with the pathological use of alcohol or food, in alcohol use disorders (AUD) or binge-eating disorder (BED), suggest a disturbance in explore-exploit decision-making, whereby strategic exploratory decisions in an attempt to improve long-term outcomes may diminish in favor of more repetitive or exploitatory choices. We compare exploration vs exploitation across disorders of natural (obesity with and without BED) and drug rewards (AUD). We separately acquired resting state functional MRI data using a novel multi-echo planar imaging sequence and independent components analysis from healthy individuals to assess the neural correlates underlying exploration. Participants with AUD showed reduced exploratory behavior across gain and loss environments, leading to lower-yielding exploitatory choices. Obese subjects with and without BED did not differ from healthy volunteers but when compared with each other or to AUD subjects, BED had enhanced exploratory behaviors particularly in the loss domain. All subject groups had decreased exploration or greater uncertainty avoidance to losses compared with rewards. More exploratory decisions in the context of reward were associated with frontal polar and ventral striatal connectivity. For losses, exploration was associated with frontal polar and precuneus connectivity. We further implicate the relevance and dimensionality of constructs of compulsivity across disorders of both natural and drug rewards.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The precuneus: a review of its functional anatomy and behavioural correlates
Cavanna, A. E., & Trimble, M. R. (2006) · Brain · doi:10.1093/brain/awl004 · Cited by 5,128
Conn : A Functional Connectivity Toolbox for Correlated and Anticorrelated Brain Networks
Whitfield-Gabrieli, S., & Nieto-Castanon, A. (2012) · Brain Connectivity · doi:10.1089/brain.2012.0073 · Cited by 4,885 · cited 1×
“CONN-fMRI Functional Connectivity toolbox (Whitfield-Gabrieli and Nieto-Castanon, 2012) for Statistical Parametric Mapping SPM8 (http://www.fil.ion.ucl.ac.uk/spm/software/spm8/) was used for functional connectivity analysis.”
MethodStop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans
Aron, A. R., Fletcher, P. C., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2003) · Nature Neuroscience · doi:10.1038/nn1003 · Cited by 1,771
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · cited 1×
“These findings potentially reflect the asymmetrical influence of gains and losses on choice behaviour 21 imposed by the strength of loss aversion as a consistent mediator of choice 22 .”
Anterior prefrontal cortex: insights into function from anatomy and neuroimaging
Ramnani, N., & Owen, A. M. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1343 · Cited by 1,170 · cited 2×
“The current findings suggest that while assignment of perceived agency to actions and encoding and organizing of intentions is mediated by the precuneus, it may interact with the FPC 6 which in turn processes internally-generated goals for behavioural control 9,43 .”
The Neural Basis of Inhibition in Cognitive Control
Aron, A. R. (2007) · The Neuroscientist · doi:10.1177/1073858407299288 · Cited by 1,098
Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry
Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.009 · Cited by 1,003 · cited 1×
“Compulsivity can be described as repetitions of deleterious choices, which remain insensitive to changes in outcome contingencies and occur despite negative consequences 11,12 .”
Plasticity of reward neurocircuitry and the ‘dark side’ of drug addiction
Koob, G. F., & Le Moal, M. (2005) · Nature Neuroscience · doi:10.1038/nn1105-1442 · Cited by 963 · cited 1×
“These findings in AUD and smokers may be consistent with the negative reinforcement model of addiction 32,33 whereby a negative context may drive exploitative repetitive behaviours to avoid losses.”
Boorman, E. D., Behrens, T. E. J., Woolrich, M. W., & Rushworth, M. F. S. (2009) · Neuron · doi:10.1016/j.neuron.2009.05.014 · Cited by 665 · cited 3×
“Although recent evidence implicates both FPC and inferior parietal cortex in exploratory choices 5,46 , we did not find significant correlations for inferior parietal cortex.”
Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes
Slotnick, S. D., Moo, L. R., Segal, J. B., & Hart, J. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00082-x · Cited by 654 · cited 2×
“05 assuming an individual-voxel Type I error of p= 0.01 (Slotnick et al, 2003)) revealed that exploration in the context of reward was positively correlated with FPC and ventral striatal connectivity (peak coordinates x y z=− 22, 21, − 10 mm; cluster size= 32; Z= 4.38, Figure 2).”
MethodInfluentialDisorders of compulsivity: A common bias towards learning habits
Voon, V, Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., Schreiber, L. R. N., Gillan, C., Fineberg, N. A., Sahakian, B. J., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.44 · Cited by 643
Self-citationKolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2012) · Science · doi:10.1126/science.1216930 · Cited by 629
Thinking of the future and past: the roles of the frontal pole and the medial temporal lobes
Okuda, J., Fujii, T., Ohtake, H., Tsukiura, T., Tanji, K., Suzuki, K., Kawashima, R., Fukuda, H., Itoh, M., & Yamadori, A. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00179-4 · Cited by 607
Humans use directed and random exploration to solve the explore–exploit dilemma.
Wilson, R. C., Geana, A., White, J. M., Ludvig, E. A., & Cohen, J. D. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0038199 · Cited by 580
Integrated strategy for improving functional connectivity mapping using multiecho fMRI
Kundu, P., Brenowitz, N. D., Voon, V., Worbe, Y., Vértes, P. E., Inati, S. J., Saad, Z. S., Bandettini, P. A., & Bullmore, E. T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1301725110 · Cited by 399
Self-citationNeurobiology of dysregulated motivational systems in drug addiction
Edwards, S., & Koob, G. F. (2010) · Future Neurology · doi:10.2217/fnl.10.14 · Cited by 157 · cited 2×
“Reduced exploration, or more repetitive choices, in the face of losses is consistent with theories that neuroadaptive systems driving aversive states lead to repetitive drug-seeking behaviours 26 .”
Connectivity-based parcellation of the human frontal pole with diffusion tensor imaging
Liu, H., Qin, W., Li, W., Fan, L., Wang, J., Jiang, T., & Yu, C. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4882-12.2013 · Cited by 108
Alcohol stress response dampening: selective reduction of anxiety in the face of uncertain threat
Hefner, K. R., & Curtin, J. J. (2012) · Journal of Psychopharmacology · doi:10.1177/0269881111416691 · Cited by 74 · cited 1×
“…environment dovetail with findings suggesting that the effects of alcohol are selective for uncertainty-related anxiety rather than certainty-related fear (Hefner and Curtin, 2012), the former being hypothesized to drive the negative-reinforcement cycle of alcohol use (Edwards and Koob, 2010).”
Background
Cited by
A Primer on Foraging and the Explore/Exploit Trade-Off for Psychiatry Research
Addicott, M. A., Pearson, J. M., Sweitzer, M. M., Barack, D. L., & Platt, M. L. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.108 · Cited by 219
Intolerance of uncertainty in eating disorders: a systematic review and meta-analysis
Brown, M., Robinson, L., Campione, G. C., Wuensch, K., Hildebrandt, T., & Micali, N. (2017) · European Eating Disorders Review · doi:10.1002/erv.2523 · Cited by 173
Lloyd, A., Roiser, J. P., Skeen, S., Freeman, Z., Badalova, A., Agunbiade, A., Busakhwe, C., DeFlorio, C., Marcu, A., Pirie, H., et al. (2024) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-024-01186-9 · Cited by 17
Metadata
- Authors
- Morris, L. S., Baek, K., Kundu, P., Harrison, N. A., Frank, M. J., & Voon, V.
- Venue
- Neuropsychopharmacology
- Published
- 2015-07-15
- Volume
- 41
- Issue
- 4
- Pages
- 940-948
- ISSN
- 0893-133X (ISSN-L)
- 1740-634X
- OpenAlex
- W1668652500
- Cited by
- 65
- References
- 19
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.