The DOI matches its Crossref record; 69 of the 70 references it cites were found in a registry or an index; none of the 29 sources its claims cite is checked for support yet.
Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees
Open accessAbstract
When planning a series of actions, it is usually infeasible to consider all potential future sequences; instead, one must prune the decision tree. Provably optimal pruning is, however, still computationally ruinous and the specific approximations humans employ remain unknown. We designed a new sequential reinforcement-based task and showed that human subjects adopted a simple pruning strategy: during mental evaluation of a sequence of choices, they curtailed any further evaluation of a sequence as soon as they encountered a large loss. This pruning strategy was Pavlovian: it was reflexively evoked by large losses and persisted even when overwhelmingly counterproductive. It was also evident above and beyond loss aversion. We found that the tendency towards Pavlovian pruning was selectively predicted by the degree to which subjects exhibited sub-clinical mood disturbance, in accordance with theories that ascribe Pavlovian behavioural inhibition, via serotonin, a role in mood disorders. We conclude that Pavlovian behavioural inhibition shapes highly flexible, goal-directed choices in a manner that may be important for theories of decision-making in mood disorders.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
Humans planning sequences prune decision trees by curtailing evaluation after large losses, a Pavlovian response that persists even when counterproductive. Computational modeling shows this specific pruning is distinct from general discounting and loss aversion, and correlates with subclinical depressive symptoms.
Key findings
- Subjects adopted a simple pruning strategy: they stopped evaluating a sequence when they encountered a large loss, even when this was costly. In group −140 pruning was never disadvantageous, but in groups −70 and −100 it was increasingly counterproductive, yet subjects continued to prune.
- The most parsimonious model was “Pruning & Learned,” which separated general pruning from specific pruning after large punishments. Specific pruning exceeded general pruning in 14/15, 12/16, and 14/15 subjects in the −70, −100, and −140 groups, respectively. This model correctly predicted 91% of choices; the full look-ahead model predicted 77% of choices and had a mean predictive probability of 0.71.
- Pruning was evident above and beyond loss aversion. Subjects were approximately 1.4 times more sensitive to punishments than to equal-sized rewards, but adding loss aversion to the best model did not improve parsimony.
- BDI score positively correlated with the specific pruning parameter, but not with general pruning. A negative correlation between BDI and reward sensitivity did not survive correction for multiple comparisons. NEO agreeableness positively correlated with the Learned Pavlovian influence and survived full correction for 60 comparisons; no significant correlation with NEO neuroticism was found.
Methods
- Forty-six volunteers (23 female, mean age 23.84 years) were recruited and screened; groups received different large losses: −70 (n=15), −100 (n=16), and −140 (n=15). Subjects learned a deterministic six-state transition matrix, then completed two blocks of 24 choice episodes with sequence lengths of 2–8; the first block was discarded and the second analyzed. On half the trials, subjects planned their last 2–4 moves together without intermittent feedback.
- Computational models included full look-ahead, discounting, pruning (general and specific), learned Pavlovian attraction/repulsion, loss aversion, and a habitual SARSA model. Models were fit with Bayesian model fitting and compared using integrated Bayesian Information Criterion at the group level.
- Psychometric correlates were assessed with a weighted hierarchical multivariate regression, orthogonalizing age, sex, IQ, Digit Span, NEO measures, STAI, and BDI.
Limitations
- The paper states that the sample was healthy volunteers with only very mild depressive symptoms, so the BDI correlation cannot be taken as direct evidence that mildly raised BDI scores measure vulnerability to depression; predictions about clinical depression and serotonin depletion remain to be tested. It also states that no significant correlation with NEO neuroticism was found.
- The paper notes that in group −140 there was always an optimal sequence avoiding the large loss, making that group’s behavioral statistic difficult to interpret; at depths of 6 or more, the number of events was small, limiting power; and some missing age/STAI data excluded subjects from psychometric analyses.
- Evident from the text: the task uses a fixed deterministic transition matrix and specific reinforcement structure, and the conclusions depend on the fitted model space; model comparison did not support separate group differences in pruning despite apparent behavioral differences.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 29 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Again, we applied Bayesian model comparison and found strong evidence for such a separation (Figure 4C).”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Decision making structure
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that BDI was positively correlated with the specific pruning parameter ().”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Psychometric correlates
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The BDI validly measures sub-clinical depressive symptoms/mood disturbance.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, this effect was specific in that there was no such correlation with general pruning .”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Psychometric correlates
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The BDI validly measures sub-clinical depressive symptoms/mood disturbance.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Subjects were significantly seduced by the effect of these past rewards (or repulsed by punishments), again in a way that was counterproductive to optimal control.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Subjects were worse at choosing optimal sequences when the depth was greater.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We designed a new sequential reinforcement-based task and showed that human subjects adopted a simple pruning strategy: during mental evaluation of a sequence of choices, they curtailed any further evaluation of a sequence as soon as they encountered a large loss.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“subjects also showed a substantial increase in their propensity to prune in the face of a large negative outcome (parameter in the model).”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The large losses in the task are aversive/punishing events capable of evoking Pavlovian behavioural inhibition.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found a positive correlation between NEO agreeableness and the weight of the ‘Learned Pavlovian’ influence which survived full correction for 60 comparisons .”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Psychometric correlates
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That is, the tendency to excise subtrees lying below punishments persisted even when counterproductive in terms of outcomes.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Introduction
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It was striking that subjects were no less likely to prune (Figure 2C–D) even when we rendered it increasingly disadvantageous (moving from group −140 to group −70),.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- It may state two separate claims as one. 24
- Probably not a substantial claim. 18
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Specific pruning exceeded general pruning across subjects, but there was no main effect of group and no interaction.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Pruning estimates
Strength:plain· not yet calibratedn = 15Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was also a negative correlation between BDI score and reward sensitivity , although this did not survive correction for multiple comparisons ().”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Psychometric correlates
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Rests on an assumption: The BDI validly measures sub-clinical depressive symptoms/mood disturbance.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Computational models which accounted for close to 90% of choices verified that the nature of pruning corresponded to the Pavlovian reflexive account in detail.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Introduction
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Next, subjects could transition through losses early on in the tree, but were more reluctant to do so when they appeared deeper in the tree.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This model ascribed the higher action value to the subjects' actual choices a total of 77% of the time (fraction of choices predicted), which is significantly better than chance (fixed effect binomial ).”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Decision making structure
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In terms of net earnings, pruning is never advantageous (pruned values are never better than the optimal lookahead values); but pruning does not always result in losses (white areas). It is most disadvantageous in the −70 group, and it is never disadvantageous in the −140 group because there is always an equally good alternative choice sequence which avoids transitions through large losses.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Introduction
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, in the second and third experimental groups subjects incurred increasingly large costs for this pruning strategy (Figure 2D,E); yet, they continued to deploy it.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Introduction
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This was not predicted by the pruning model: paired t-tests showed significant differences between empirical and predicted choice probabilities for each of the three groups: , ; , ; and , , for groups −70, −100 and −140 respectively.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Decision making structure
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 4B,C show that this model (Pruning and Learned) provided the most parsimonious account of the data despite two additional parameters, and Figures 4D–E show that the addition of the Learned parameters allowed the model to capture more faithfully the transition probabilities out of state 6. The blue bars in Figure 4A display the probability that this model chose the same action as subjects (c”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Results > Decision making structure
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“we did not observe correlations with NEO neuroticism, which is an established risk factor for depression [47].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [47] KS Kendler, 1993, The prediction of major depression in women: toward an integrated etiologic model., Am J Psychiatry source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We used a novel sequential decision-making task in conjunction with a sophisticated computational analysis that fitted a high proportion of healthy subjects' choices.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Conclusion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Loss aversion is a specific phenomenon in behavioural economics, whereby subjects are more strongly opposed to a given probability of losing a certain amount than to winning that same amount [26].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
What the sources say
- Not checked yetcites [26] A Tversky, 1991, Loss aversion in riskless choice: A reference-dependent model., Q J Econ source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Also, if the pruning we observed was just a signature of loss aversion, one would have expected the extent of pruning not to be the same across groups.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This pruning strategy was Pavlovian: it was reflexively evoked by large losses and persisted even when overwhelmingly counterproductive.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The large losses in the task are aversive/punishing events capable of evoking Pavlovian behavioural inhibition.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This persistence suggests that pruning was reflexively evoked in response to punishments and relatively insensitive to the ultimate outcomes.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Introduction
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The large losses in the task are aversive/punishing events capable of evoking Pavlovian behavioural inhibition.
None of the sources cited for this claim have been checked yet.
In the paper
“On the one hand, drugs that putatively increase serotonin by inhibiting the serotonin reuptake mechanism are effective for both acutely treating [28], and preventing relapse of [29], depression.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [28] A Cipriani, 2009, Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis., Lancet source
- Not checked yetcites [29] JR Geddes, 2003, Relapse prevention with antidepressant drug treatment in depressive disorders: a systematic review., Lancet source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“To the extent to which loss aversion can be described as an inflexible, reactive, response to an aversive stimulus, it may represent a third instance of Pavlovian responses to losses interfering with goal-directed decisions in this task [27].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion
What the sources say
- Not checked yetcites [27] M Guitart-Masip, 2010, Conditioned associations and economic decision biases., Neuroimage source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The model suggested that subjects prone to depression exhibit decision making that is more reliant on serotonergic function, expressed as excess pruning, but that the depressed state itself is characterised by a low serotonin state and thus a loss of pruning.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [17] P Dayan, 2008, Serotonin, inhibition, and negative mood., PLoS Comput Biol source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Third, learned helplessness, which can be interpreted in goal-directed terms [17], depends critically on pre- and infralimbic cortex in rats [38], and is known to be mediated by serotonin [39].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [17] P Dayan, 2008, Serotonin, inhibition, and negative mood., PLoS Comput Biol source
- Not checked yetcites [38] J Amat, 2005, Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus., Nat Neurosci source
- Not checked yetcites [39] SF Maier, 2005, Stressor controllability and learned helplessness: the roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor., Neurosci Biobehav Rev source
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Dayan and Huys [17] explained this paradox by suggesting that people who experienced high levels of serotonin and thus exaggerated Pavlovian behavioural inhibition during early development [32] would be most sensitive to the effects of any interference with this inhibition in adulthood secondary to a drop in serotonin levels [33], [34].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [17] P Dayan, 2008, Serotonin, inhibition, and negative mood., PLoS Comput Biol source
- Not checked yetcites [32] MS Ansorge, 2004, Early-life blockade of the 5-HT transporter alters emotional behavior in adult mice., Science source
- Not checked yetcites [33] JP Roiser, 2006, Serotonin transporter polymorphism mediates vulnerability to loss of incentive motivation following acute tryptophan depletion., Neuropsychopharmacology source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One possible explanation for this apparent discrepancy is that although the OTT requires sequences of moves to be evaluated, there is no obvious aversive point at which Pavlovian pruning might be invoked.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
- Rests on an assumption: The one-touch Tower of London (OTT) task engages goal-directed processing.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, the inhibitory consequences of serotonin could account for both its predisposing qualities on a developmental time-scale, and more acute relief during depressive episodes.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“The impairment relative to controls grows with the difficulty of the problem; and depressed subjects also spend increasing amounts of time thinking about the harder problems, without showing improved choices [50].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [50] GM Goodwin, 1997, Neuropsychological and neuroimaging evidence for the involvement of the frontal lobes in depression., J Psychopharmacol source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The stronger dependence on serotonin in at-risk subjects would explain why only they are sensitive to the mood effects of tryptophan depletion [34], and why individuals with a polymorphism in the serotonin transporter gene that reduces serotonin uptake are more liable to develop mood disturbance, especially following serotonin depletion [41], [42].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [34] HG Ruhé, 2007, Mood is indirectly related to serotonin, norepinephrine and dopamine levels in humans: a meta-analysis of monoamine depletion studies., Mol Psychiatry source
- Not checked yetcites [41] JP Roiser, 2006, Serotonin transporter polymorphism mediates vulnerability to loss ofincentive motivation following acute tryptophan depletion., Neuropsychopharmacology source
- Not checked yetcites [42] A Neumeister, 2002, Association between serotonin transporter gene promoter polymorphism (5HTTLPR) and behavioral responses to tryptophan depletion in healthy women with and without family history of depression., Arch Gen Psychiatry source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Contrary to this, there is a recent report that mood manipulation, but not acute tryptophan depletion, impairs processing on the one-touch Tower of London (OTT) task [40], which should certainly engage goal-directed processing.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [40] OJ Robinson, 2009, A double dissociation in the roles of serotonin and mood in healthy subjects., Biol Psychiatry source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Genetic variation in the serotonin transporter allele modulates functional coupling between amygdala and rostral cingulate cortex [36].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
What the sources say
- Not checked yetcites [36] L Pezawas, 2005, 5-HTTLPR polymorphism impacts human cingulate-amygdala interactions: a genetic susceptibility mechanism for depression., Nat Neuosci source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That is, this theory predicts excessive pruning to occur in subjects at risk for depression, and reduced pruning to occur during a depressive episode.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Pruning, serotonin and depression
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“One subjects' age information, and one subject's STAI information were lost. These subjects were excluded from the psychometric correlation analyses.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Methods > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This allowed us to unpack a central facet of effective computation, pruning.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Discussion > Conclusion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Reaching training criterion was mandatory to move on to the main task.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Methods > Task
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The study was conducted in accord with the Helsinki declaration and approved by the UCL Graduate School Ethics Committee.”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Methods > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The absence of axis-I psychopathology and alcohol- or substance abuse/dependence was confirmed with the Mini International Neuropsychiatric Inventory [53].”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Methods > Participants
What the sources say
- Not checked yetcites [53] DV Sheehan, 1998, The mini-international neuropsychiatric interview (m.i.n.i.): the development and validation of a structured diagnostic psychiatric interview for dsm-iv and icd-10., J Clin Psychiatry
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Subjects who were assigned to the different groups, were matched for age, IQ and sex (all , one-way ANOVA).”
§ Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees > Methods > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
The large losses in the task are aversive/punishing events capable of evoking Pavlovian behavioural inhibition.
“We term this heuristic pruning a “Pavlovian” response because it is invoked, as an immediate consequence of encountering the large loss, when searching the tree in one's mind.”
The paper relies on this without support.
The BDI validly measures sub-clinical depressive symptoms/mood disturbance.
“We found that BDI was positively correlated with the specific pruning parameter ().”
The authors state this as an assumption.
Actions are independent given the stimuli, and thus factorize over trials.
“We assume that actions are independent (given the stimuli, which we omit for notational clarity), and thus factorize over trials.”
The authors state this as an assumption.
The value of each choice depends on how many choices are left after it, but not on the choices preceding it.
“we emphasize that the value of each choice depends on how many choices are left after , but not on the choices preceding it.”
The paper relies on this without support.
The one-touch Tower of London (OTT) task engages goal-directed processing.
“Contrary to this, there is a recent report that mood manipulation, but not acute tryptophan depletion, impairs processing on the one-touch Tower of London (OTT) task [40], which should certainly engage goal-directed processing.”
The paper relies on this without support.
The pruning parameter mediates the inhibition of iterative thought processes.
“if serotonin indeed mediates behavioural inhibition in the face of punishments [10], [12]–[14] then it is a strong prediction that the pruning parameter , which mediates the inhibition of iterative thought processes, should be related to, and modulated by, serotonergic activity.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other related search tasks have found behavioral evidence for these calculations and have started to look at heuristics for pruning the tree, a necessity when it gets too wide or deep (Huys et al., 2012).”
From Goals and Habits in the Brain (2013) · cites this paper as Huys et al., 2012
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(1970) · Cited by 24,983
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,191
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407
Watkins, C., & Dayan, P. (1992) · Machine-mediated learning · doi:10.1023/a:1022676722315 · Cited by 14,277
Self-citationKass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
(1998) · PubMed · Cited by 10,216
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Self-citation
Flagged first, then by citations
1 of the 70 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 201–300 of 435
Pietrzak, M., Yngve, A., Hamilton, J. P., Asratian, A., Gauffin, E., Löfberg, A., Gustavson, S., Persson, E., Capusan, A. J., Leggio, L., et al. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01821-6 · Cited by 15
Human inference in changing environments with temporal structure.
Prat-Carrabin, A., Wilson, R. C., Cohen, J. D., & Azeredo da Silveira, R. (2021) · Psychological Review · doi:10.1037/rev0000276 · Cited by 16
“Both these inference strategies reduce the memory load in the inference problem by stochastically trimming the posterior, in a fashion akin to the ‘pruning’ model proposed by [82] in the context of a decision-tree task.”
MethodSpontaneous mind wandering impairs model-based decision making
Liu, S., Rabovsky, M., & Schad, D. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0279532 · Cited by 15
Liakoni, V., Lehmann, M. P., Modirshanechi, A., Brea, J., Lutti, A., Wulfram Gerstner, B., & Preuschoff, K. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118780 · Cited by 16
What to Choose Next? A Paradigm for Testing Human Sequential Decision Making
Tartaglia, E. M., Clarke, A., & Herzog, M. H. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00312 · Cited by 14
A Computational Neuroscience Perspective on the Change Process in Psychotherapy
Smith, R. P., Lane, R. D., Nadel, L., & Moutoussis, M. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190881511.003.0015 · Cited by 13
Thompson, D. J., Weissbecker, I., Cash, E. D., Simpson, D. M., Daup, M., & Sephton, S. E. (2015) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-015-9270-4 · Cited by 13
Simulating future value in intertemporal choice
Solway, A., Lohrenz, T. M., & Montague, P. R. (2017) · Scientific Reports · doi:10.1038/srep43119 · Cited by 13
Excessive deliberation in social anxietyPreprint
Hunter, L. E., Meer, E. A., Gillan, C. M., Hsu, M., & Daw, N. D. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/522433 · Cited by 13
Emotion regulation from an action-control perspective
Bramson, B., Toni, I., & Roelofs, K. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105397 · Cited by 18
Aster, H.-C., Waltmann, M., Busch, A., Romanos, M., Gamer, M., van Noort, B. M., Beck, A., Kappel, V., & Deserno, L. (2024) · NeuroImage Clinical · doi:10.1016/j.nicl.2024.103588 · Cited by 16
Velasco, P. F., Griesbauer, E., Brunec, I. K., Morley, J. G., Manley, E., McNamee, D., & Spiers, H. J. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2407814122 · Cited by 14
Discounting future reward in an uncertain world.
Story, G. W., Kurth-Nelson, Z. L., Moutoussis, M., Iigaya, K., Will, G., Hauser, T. U., Blain, B., Vlaev, I., & Dolan, R. J. (2023) · Decision · doi:10.1037/dec0000219 · Cited by 17
Hippocampal and Prefrontal Processing of Network Topology to Simulate the Future
(2017) · Conscious Cities Anthology · doi:10.33797/cca17.01.12 · Cited by 12
Computational Models of Post‐traumatic Stress Disorder (PTSD)
Radell, M. L., Myers, C., Sheynin, J., & Moustafa, A. A. (2018) · doi:10.1002/9781119159193.ch4 · Cited by 12
Humans adaptively deploy forward and backward prediction
Sharp, P. B., & Eldar, E. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01930-8 · Cited by 12
Interactive cognitive maps support flexible behavior under threat
Wise, T., Charpentier, C. J., Dayan, P., & Mobbs, D. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.113008 · Cited by 11
Self-citationBayesian Approaches to Learning and Decision-Making
Huys, Q. J. M. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809825-7.00010-9 · Cited by 12
Self-citationFlexibility to contingency changes distinguishes habitual and goal-directed strategies in humans
Lee, J. J., & Keramati, M. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005753 · Cited by 11
Improving Human Decision-making by Discovering Efficient Strategies for Hierarchical Planning
Consul, S., Heindrich, L., Stojcheski, J., & Lieder, F. (2022) · Computational Brain & Behavior · doi:10.1007/s42113-022-00128-3 · Cited by 13
Reiter, A. M. F., Koch, S., Schröger, E., Hinrichs, H., Heinze, H., Deserno, L., & Schlagenhauf, F. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00957 · Cited by 11
Towards a theory of heuristic and optimal planning for sequential information searchPreprint
Nelson, J. D., Meder, B., & Jones, M. (2018) · doi:10.31234/osf.io/bxdf4 · Cited by 13
Huys, Q. J. M. (2013) · Springer eBooks · doi:10.1007/978-1-4614-7320-6_501-1 · Cited by 11
Self-citationKatahira, K., Oba, T., & Toyama, A. (2024) · Psychonomic Bulletin & Review · doi:10.3758/s13423-024-02490-8 · Cited by 13
Lausi, G., Cricenti, C., Mari, E., Burrai, J., Quaglieri, A., Giannini, A. M., & Barchielli, B. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1367489 · Cited by 10
Antonov, G. K., & Dayan, P. (2025) · Nature Communications · doi:10.1038/s41467-025-56731-y · Cited by 10
Self-citationAdaptive planning depth in human problem-solving
Eluchans, M., Lancia, G. L., Maselli, A., D’Alessandro, M., Gordon, J. R., & Pezzulo, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.241161 · Cited by 11
Geurts, D. E. M., den Ouden, H. E. M., Janssen, L., Swart, J. C., Froböse, M. I., Cools, R., & Speckens, A. E. M. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.938082 · Cited by 15
Suboptimal learning of tactile-spatial predictions in patients with complex regional pain syndrome
Brown, C. A., Scholtes, I., Shenker, N., & Lee, M. (2019) · Pain · doi:10.1097/j.pain.0000000000001730 · Cited by 10
Computational Neural Mechanisms of Goal-Directed Planning and Problem Solving
Fine, J. M., Zarr, N., & Brown, J. W. (2020) · Computational Brain & Behavior · doi:10.1007/s42113-020-00095-7 · Cited by 9
Csifcsák, G., Bjørkøy, J., Kuyateh, S., Reithe, H., & Mittner, M. (2021) · eNeuro · doi:10.1523/eneuro.0041-21.2021 · Cited by 10
Shimizu, N., Mochizuki, Y., Chen, C., Hagiwara, K., Matsumoto, K., Oda, Y., Hirotsu, M., Okabe, E., Matsubara, T., & Nakagawa, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.930466 · Cited by 10
Grosskurth, E. D., Bach, D. R., Economides, M., Huys, Q. J. M., & Holper, L. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007443 · Cited by 10
Self-citationA Social Inference Model of Idealization and DevaluationPreprint
Story, G. W., Smith, R. S., Moutoussis, M., Berwian, I. M., Nolte, T., Bilek, E., & Dolan, R. J. (2021) · doi:10.31234/osf.io/yvu2b · Cited by 10
Social conformity is a heuristic when individual risky decision-making is disrupted
Orloff, M. A., Chung, D., Gu, X., Wang, X., Gao, Z., Song, G., C.Tatineni, C., Xu, S., Casas, B. R., & Chiu, P. H. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012602 · Cited by 10
Knowledge of information cascades through social networks facilitates strategic gossip
Xia, A., Teoh, Y. Y., Nassar, M. R., Bhandari, A., & FeldmanHall, O. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02241-2 · Cited by 9
Decision-Making and Abuse, What Relationship in Victims of Violence?
Lausi, G., Burrai, J., Baldi, M., Ferlazzo, F., Ferracuti, S., Giannini, A. M., & Barchielli, B. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20105879 · Cited by 11
Behavioural signatures of backward planning in animals
Afsardeir, A., & Keramati, M. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13851 · Cited by 9
Watarai, M., Hagiwara, K., Mochizuki, Y., Chen, C., Mizumoto, T., Kawashima, C., Koga, T., Okabe, E., & Nakagawa, S. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01117-0 · Cited by 11
Opening Burton's Clock: Psychiatric insights from computational cognitive modelsPreprint
Bennett, D., & Niv, Y. (2018) · doi:10.31234/osf.io/y2vzu · Cited by 12
SSRIs modulate asymmetric learning from reward and punishmentPreprint
Michely, J., Eldar, E., Erdman, A., Martin, I. M., & Dolan, R. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.21.108266 · Cited by 9
Malamud, J., Lewis, G., Moutoussis, M., Duffy, L., Bone, J. K., Srinivasan, R., Lewis, G., & Huys, Q. J. M. (2024) · Psychological Medicine · doi:10.1017/s0033291724000837 · Cited by 8
Self-citationLondon taxi drivers exploit neighbourhood boundaries for hierarchical route planning
Griesbauer, E., Velasco, P. F., Coutrot, A., Wiener, J. M., Morley, J. G., McNamee, D., Manley, E., & Spiers, H. J. (2024) · Cognition · doi:10.1016/j.cognition.2024.106014 · Cited by 9
Huang, L. T., Wang, C., Ge, R., Ni, H., & Zhao, S. (2017) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2017.03.005 · Cited by 8
Dynamic integration of forward planning and heuristic preferences during multiple goal pursuit
Ott, F., Marković, D., Strobel, A., & Kiebel, S. J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007685 · Cited by 8
Chen, P., Ong, D. C., Ng, J. C., & Coppola, B. P. (2021) · AERA Open · doi:10.1177/2332858420986180 · Cited by 10
Inappropriate emotions, marginalization, and feeling better
Kurth, C. (2022) · Synthese · doi:10.1007/s11229-022-03619-9 · Cited by 10
Model based control can give rise to devaluation insensitive choice
Garrett, N., Allan, S., & Daw, N. D. (2023) · Addiction Neuroscience · doi:10.1016/j.addicn.2023.100070 · Cited by 7
An empirical solution to the puzzle of weakness of will
Haas, J. (2018) · Synthese · doi:10.1007/s11229-018-1712-0 · Cited by 10
Asking the Right Questions About the Psychology of Human Inquiry: Nine Open ChallengesPreprint
Coenen, A., Nelson, J. D., & Gureckis, T. M. (2017) · doi:10.31234/osf.io/h457v · Cited by 9
Toro‐Serey, C., Kane, G. A., & McGuire, J. T. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-021-00972-z · Cited by 7
Political reinforcement learners
Schulz, L., & Bhui, R. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.12.001 · Cited by 8
Pavlovian impatience: The anticipation of immediate rewards increases approach behaviour
Burghoorn, F., Scheres, A., Monterosso, J. R., Guo, M., LUO, S. H., Karin Roelofs, A., & Figner, B. (2024) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-024-01236-2 · Cited by 11
Pawlowsch-Instrumentelle Transfereffekte bei Alkoholabhängigkeit
Genauck, A., Huys, Q. J. M., Heinz, A., & Rapp, M. A. (2013) · SUCHT - Zeitschrift für Wissenschaft und Praxis / Journal of Addiction Research and Practice · doi:10.1024/0939-5911.a000256 · Cited by 7
Self-citationMusic and Video Gaming during Breaks: Influence on Habitual versus Goal-Directed Decision Making
Liu, S., Schad, D. J., Kuschpel, M. S., Rapp, M. A., & Heinz, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150165 · Cited by 7
Opening Burton’s Clock: Psychiatric Insights from Computational Cognitive Models
Bennett, D., & Niv, Y. (2020) · The MIT Press eBooks · doi:10.7551/mitpress/11442.003.0049 · Cited by 16
Neural signatures of model-free learning when avoiding harm to self and otherPreprint
Lockwood, P. L., Klein-Flügge, M. C., Abdurahman, A., & Crockett, M. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/718106 · Cited by 7
The roles of online and offline replay in planningPreprint
Eldar, E., Lièvre, G., Dayan, P., & Dolan, R. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.26.009571 · Cited by 10
Self-citationBhatia, S., van Baal, S. T., Wang, F., & Walasek, L. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2406489122 · Cited by 10
Separable cognitive and motor decline tracked across adult life-span for goal-directed navigation
Lancia, G. L., D’Alessandro, M., Eluchans, M., Ibáñez-Berganza, M., Spiers, H. J., & Pezzulo, G. (2025) · iScience · doi:10.1016/j.isci.2025.113441 · Cited by 6
Panitz, M., Deserno, L., Kaminski, E., Villringer, A., Sehm, B., & Schlagenhauf, F. (2022) · Cerebral Cortex Communications · doi:10.1093/texcom/tgac006 · Cited by 7
Diminished State Space Theory of Human Aging
Eppinger, B., Ruel, A., & Bolenz, F. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231204811 · Cited by 6
Raufelder, D., Boehme, R., Romund, L., Golde, S., Lorenz, R. C., Gleich, T., & Beck, A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00655 · Cited by 6
The detour problem in a stochastic environment: Tolman revisited
Fakhari, P., Khodadadi, A., & Busemeyer, J. R. (2017) · Cognitive Psychology · doi:10.1016/j.cogpsych.2017.12.002 · Cited by 6
Is Synchronic Self-Control Possible?
Haas, J. (2020) · Review of Philosophy and Psychology · doi:10.1007/s13164-020-00490-w · Cited by 6
Gambling on an empty stomach: Hunger modulates preferences for learned but not described risks
van Swieten, M. M. H., Bogacz, R., & Manohar, S. (2023) · Brain and Behavior · doi:10.1002/brb3.2978 · Cited by 5
The Role of Serotonin in Aversive Inhibition: Behavioural, Cognitive and Neural Perspectives
Robinson, O. J., & Roiser, J. P. (2015) · Psychopathology Review · doi:10.5127/pr.034013 · Cited by 6
Self-citationOff the shortest path: Betweenness on street network level to study pedestrian movement
Law, S., & Traunmueller, M. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317950 · Cited by 6
Models and Methods for Reinforcement Learning
Dayan, P., & Nakahara, H. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn513 · Cited by 6
Self-citationHuman Inference in Changing Environments with Temporal StructurePreprint
Prat-Carrabin, A., Wilson, R. C., Cohen, J. D., & da Silveira, R. A. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/720516 · Cited by 6
Multi-Step Planning in the BrainPreprint
Miller, K. J., & Venditto, S. J. C. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kv86m · Cited by 8
Experience-based risk taking is primarily shaped by prior learning rather than by decision-making
Erdman, A., Gouwy, A., Sananes, G., Salman, M., Eizenstien, L., Eliav, S., & Eldar, E. (2025) · Nature Communications · doi:10.1038/s41467-025-61609-0 · Cited by 6
How to divide and conquer the world, one step at a time
Daniel, R., Schuck, N. W., & Niv, Y. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1500975112 · Cited by 5
Chen, C., Mochizuki, Y., Hagiwara, K., Hirotsu, M., Matsubara, T., & Nakagawa, S. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.08.003 · Cited by 5
Neville, V., Mendl, M., Paul, E. S., Seriès, P., & Dayan, P. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01137-w · Cited by 5
Self-citationMochizuki, Y., Harasawa, N., Aggarwal, M., Chen, C., & Fukuda, H. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012080 · Cited by 5
Machine Morality: From Harm-Avoidance to Human-Robot Cooperation
Freire, I. T., Urikh, D., Arsiwalla, X. D., & Verschure, P. F. M. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64313-3_13 · Cited by 5
Opitz, A., Ghin, F., Hubert, J., Verster, J. C., Beste, C., & Stock, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-90803-5 · Cited by 5
Loss Aversion Correlates With the Propensity to Deploy Model-Based Control
Solway, A., Lohrenz, T. M., & Montague, P. R. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00915 · Cited by 5
Exploration Versus Exploitation
Powell, W. B. (2011) · Wiley series in probability and statistics · doi:10.1002/9781118029176.ch12 · Cited by 7
Huys, Q. J. M. (2015) · Springer eBooks · doi:10.1007/978-1-4614-6675-8_501 · Cited by 5
Self-citationReward-Based Learning, Model-Based and Model-Free
Huys, Q. J. M., Cruickshank, A., & Seriès, P. (2015) · Springer eBooks · doi:10.1007/978-1-4614-6675-8_674 · Cited by 6
Self-citationCsifcsák, G., Melsæter, E., & Mittner, M. (2019) · doi:10.31234/osf.io/jpq6f · Cited by 6
Huys, Q. J. M. (2022) · Springer eBooks · doi:10.1007/978-1-0716-1006-0_501 · Cited by 6
Self-citationThyroid hormone rewires cortical circuits to coordinate body-wide metabolism and exploratory drivePreprint
Hochbaum, D. R., Dubinsky, A. C., Farnsworth, H. C., Hulshof, L., Kleinberg, G., Urke, A., Wang, W., Hakim, R., Robertson, K., Park, C., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.10.552874 · Cited by 5
Addressing low statistical power in computational modelling studies in psychology and neuroscience
Piray, P. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02348-6 · Cited by 6
Computational mechanisms underlying multi-step planning deficits in methamphetamine use disorder
Lavalley, C. A., Mehta, M., Taylor, S., Chuning, A. E., Stewart, J. L., Huys, Q. J. M., Khalsa, S. S., Paulus, M. P., & Smith, R. S. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03390-8 · Cited by 4
Self-citationNorman, R. L. (2016) · NeuroQuantology · doi:10.14704/nq.2016.14.2.949 · Cited by 4
Individually irrational pruning is essential for ecological rationality in a social context
Zendehrouh, S., & Ahmadabadi, M. N. (2020) · Cognitive Psychology · doi:10.1016/j.cogpsych.2020.101272 · Cited by 5
The Effect of Reward Magnitude on Different Types of Exploration in Human Reinforcement Learning
Shimomura, K., & Morita, K. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00224-6 · Cited by 4
Looking deeper into the algorithms underlying human planning
Kuperwajs, I., Russek, E. M., Mattar, M. G., Ma, W. J., & Griffiths, T. L. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.06.006 · Cited by 5
Neurobiology and computational structure of decision-making in addiction
Huys, Q. J. M., Beck, A., Dayan, P., & Heinz, A. (2014) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-91433 · Cited by 4
Self-citationAdaptive search space pruning in complex strategic problems
Amir, O., Tyomkin, L., & Hart, Y. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010358 · Cited by 4
The Component Processes of Complex Planning Follow Distinct Developmental Trajectories
Ma, I., Phaneuf-Hadd, C. V., van Opheusden, B., Ma, W. J., & Hartley, C. A. (2023) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2023.1330-0 · Cited by 4
Prospective planning and retrospective learning in a large-scale combinatorial game
Kuperwajs, I., van Opheusden, B., & Ma, W. J. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1164-0 · Cited by 4
Klein-Flügge, M. C., Jensen, D. E. A., Takagi, Y., Verhagen, L., Smith, S. M., & Rushworth, M. F. S. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.08.980995 · Cited by 4
Dynamic reinforcement learning reveals time-dependent shifts in strategy during reward learningPreprint
Venditto, S. J. C., Miller, K. J., Brody, C. D., & Daw, N. D. (2024) · eLife · doi:10.7554/elife.97612.2 · Cited by 4
Relevance of Probabilistic Reversal Learning for Adolescent Drinking Trajectories
Fröhner, J. H., Waltmann, M., Reiter, A. M. F., Kräplin, A., & Smolka, M. N. (2025) · Addiction Biology · doi:10.1111/adb.70026 · Cited by 3
Learning to Move and Plan like the Knight: Sequential Decision Making with a Novel Motor Mapping
Velázquez-Vargas, C. A., & Taylor, J. A. (2025) · Computational Brain & Behavior · doi:10.1007/s42113-025-00245-9 · Cited by 4
Holton, E., van Opheusden, B., Grohn, J., Ward, H., Grogan, J. P., Lockwood, P. L., Ma, I., Ma, W. J., & Manohar, S. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1814-24.2025 · Cited by 3
Metadata
- Authors
- Huys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- University College London (GB)
- Gatsby Computational Neuroscience Unit (GB)
- Corresponding author
- Huys, Quentin J. M.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-03-08
- Volume
- 8
- Issue
- 3
- Pages
- e1002410
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3297555
- OpenAlex
- W2059569317
- Semantic Scholar
- 09c66a4231400ba276c92700fe993d6c185bc4ac
- Cited by
- 439
- References
- 70
- Citations by year
- 2026: 16 · 2025: 35 · 2024: 32 · 2023: 42 · 2022: 38 · 2021: 30 · 2020: 33 · 2019: 32 · 2018: 44 · 2017: 34 · 2016: 27 · 2015: 27 · 2014: 29 · 2013: 11 · 2012: 5
- FWCI
- 17.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Staff Publications Online (The Tavistock and Portman) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Gatsby Charitable Foundation
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- decision tree pruning, goal-directed behavior, sequential decision making, loss aversion, serotonin, mood disorders, reinforcement learning, human decision-making
- MeSH terms
- Algorithms, Computer Simulation, Decision Making, Goals, Humans, Models, Neurological, Reinforcement, Psychology, Task Performance and Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
