Value-Based Choice, Contingency Learning, and Suicidal Behavior in Mid- and Late-Life Depression
Open accessAbstract
Background Suicidal behavior is associated with impaired decision making in contexts of uncertainty. Existing studies, however, do not definitively address whether suidice attempers have 1) impairment in learning from experience or 2) impairment in choice based on comparison of estimated option values. Our reinforcement learning model-based behavioral study tested these hypotheses directly in middle-aged and older suicide attempters representative of those who die by suicide.Methods Two samples (sample 1, n = 135; sample 2, n = 125) of suicide attempters with depression (n attempters = 54 and 39, respectively), suicide ideators, nonsuicidal patients with depression, and healthy control participants completed a probabilistic three-choice decision-making task. A second experiment in sample 2 experimentally dissociated long-term learned value from reward magnitude. Analyses combined computational reinforcement learning and mixed-effects models of decision times and choices.Results With regard to learning, suicide attempters (vs. all comparison groups) were less sensitive to one-back reinforcement, as indicated by a reduced effect on both choices and decision times. Learning deficits scaled with attempt lethality and were partially explained by poor cognitive control. With regard to value-based choice, suicide attempters (vs. all comparison groups) displayed abnormally long decision times when choosing between similarly valued options and were less able to distinguish between the best and second-best options. Group differences in value-based choice were robust to controlling for cognitive performance, comorbidities, impulsivity, psychotropic exposure, and possible brain damage from attempts.Conclusions Serious suicidal behavior is associated with impaired reward learning, likely undermining the search for alternative solutions. Attempted suicide is associated with impaired value comparison during the choice process, potentially interfering with the consideration of deterrents and alternatives in a crisis.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
High-lethality attempters have greater impairment of reward learning, which hampers the search for alternative solutions.
“High-lethality attempters have greater impairment of reward learning, hampering the search for alternative solutions (34), but they have less delayed discounting (i.e., they can suppress the desire for immediate satisfaction in favor of delayed reward) (35) and perform better on an object alternation task, indicating greater executive control and response organization (25).”
From A brain-centric model of suicidal behavior (2020) · cites this paper as [34]
High-lethality suicide attempters are generally more deliberate and planned than low-lethality attempters.
“Decision making differs in high-lethality suicide attempters relative to low-lethality attempters because the former are generally more deliberate and planned.”
From A brain-centric model of suicidal behavior (2020) · cites this paper as [34]
Learning deficits in suicide attempters scale with attempt lethality and are partly explained by impaired cognitive control.
“These learning deficits scale with attempt lethality and are partially explained by impaired cognitive control (34), the most consistent deficit found in suicide attempters (17, 22, 24).”
From A brain-centric model of suicidal behavior (2020) · cites this paper as [34]
Mental pain and suicidality have been associated with many cognitive function impairments, including decision-making.
“mental pain and suicidality have been associated with many cognitive function impairments,36 including decision-making.37”
From “Nothing Hurts Less Than Being Dead”: Psychological Pain in Case Descriptions of Psychiatric Euthanasia and Assisted Suicide from the Netherlands: « Rien ne fait moins mal qu’être mort »: La douleur psychologique dans les descriptions de cas d’euthanasie et de suicide assisté psychiatrique aux Pays-Bas (2020) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Fitting Linear Mixed-Effects Models Using <b>lme4</b>
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835 · see citing works
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · see citing works
Advances in Neural Information Processing Systems 27 (NIPS 2014)
Zhong, M., Goddard, N., & Sutton, C. A. (2014) · Cited by 2,440 · see citing works
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,142 · see citing works
Bayesian Cognitive Modeling: A Practical Course
Lee, M. D., & Wagenmakers, E.-J. (2014) · doi:10.1017/cbo9781139087759 · Cited by 1,795 · see citing works
Diffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630 · cited 1× · see citing works
“How might these deficits facilitate suicidal behavior? We view the choice between suicide and its alternatives as a temporally unfolding decision process (30,31).”
Background(2013) · Cited by 1,351 · see citing works
Sutton, R. S. (1990) · Elsevier eBooks · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,348 · see citing works
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077 · see citing works
Motivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909 · see citing works
Yuan, P., & Raz, N. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.02.005 · Cited by 608 · see citing works
Impaired decision making in suicide attempters
Jollant, F., Bellivier, F., Leboyer, M., Astruc, B., Torres, S., Verdier, R., Castelnau, D., Malafosse, A., & Courtet, P. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.2.304 · Cited by 541 · see citing works
Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex
Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1206608109 · Cited by 476 · see citing works
Classification of suicidal behaviors: I. Quantifying intent and medical lethality
(1975) · American Journal of Psychiatry · doi:10.1176/ajp.132.3.285 · Cited by 460 · see citing works
The Oxford Handbook of Computational and Mathematical Psychology
Busemeyer, J., Townsend, J., & Wang, Z. (2015) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199957996.001.0001 · Cited by 402 · see citing works
Walton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. S. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.027 · Cited by 397 · see citing works
VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data
Daunizeau, J., Adam, V., & Rigoux, L. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003441 · Cited by 385 · see citing works
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · see citing works
Keilp, J. G., Gorlyn, M., Russell, M., Oquendo, M. A., Burke, A. K., Harkavy-Friedman, J., & Mann, J. J. (2013) · Psychological Medicine · doi:10.1017/s0033291712001419 · Cited by 350 · see citing works
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · see citing works
Richard-Devantoy, S., Berlim, M. T., & Jollant, F. (2014) · Psychological Medicine · doi:10.1017/s0033291713002304 · Cited by 324 · see citing works
Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., & Siegle, G. J. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.75 · Cited by 289 · see citing works
Self-citationEye tracking and pupillometry are indicators of dissociable latent decision processes.
Cavanagh, J. F., Wiecki, T. V., Kochar, A., & Frank, M. J. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0035813 · Cited by 289 · see citing works
The drift diffusion model as the choice rule in reinforcement learning
Pedersen, M. L., Frank, M. J., & Biele, G. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1199-y · Cited by 272 · see citing works
De Leo, D., Padoani, W., Scocco, P., Lie, D., Bille‐Brahe, U., Arensman, E., Hjelmeland, H., Crepet, P., Haring, C., Hawton, K., et al. (2001) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.337 · Cited by 233 · see citing works
Liu, R. T., Trout, Z. M., Hernandez, E. M., Cheek, S. M., & Gerlus, N. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.09.019 · Cited by 201 · see citing works
Dombrovski, A. Y., Szanto, K., Siegle, G. J., Wallace, M. L., Forman, S. D., Sahakian, B., Reynolds, C. F., & Clark, L. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.12.025 · Cited by 198 · see citing works
Self-citationReward/punishment reversal learning in older suicide attempters
Dombrovski, A. Y., Clark, L., Siegle, G. J., Butters, M. A., Ichikawa, N., Sahakian, B. J., & Szanto, K. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09030407 · Cited by 193 · see citing works
Self-citationRecent advances in differentiating suicide attempters from suicide ideators
Klonsky, E. D., Qiu, T., & Saffer, B. Y. (2017) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000294 · Cited by 193 · see citing works
Impairment in risk-sensitive decision-making in older suicide attempters with depression.
Clark, L., Dombrovski, A. Y., Siegle, G. J., Butters, M. A., Shollenberger, C. L., Sahakian, B. J., & Szántó, K. (2011) · Psychology and Aging · doi:10.1037/a0021646 · Cited by 175 · see citing works
Self-citationNoonan, M. P., Chau, B. K. H., Rushworth, M. F. S., & Fellows, L. K. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0692-17.2017 · Cited by 167 · see citing works
Describing and measuring the pathway to suicide attempts: A preliminary study
Millner, A. J., Lee, M. D., & Nock, M. K. (2017) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12284 · Cited by 161 · see citing works
Proceedings of the seventh international conference (1990) on Machine learning
Morgan, M. B. (1990) · Cited by 140 · see citing works
McGirr, A., Dombrovski, A. Y., Butters, M. A., Clark, L., & Szanto, K. (2012) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2011.10.001 · Cited by 127 · see citing works
Self-citationImpaired Executive Function in Contemplated and Attempted Suicide in Late Life
Gujral, S., Dombrovski, A. Y., Butters, M. A., Clark, L., Reynolds, C. F., & Szántó, K. (2013) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2013.01.025 · Cited by 90 · see citing works
Self-citationDecision-Making Competence and Attempted Suicide
Szanto, K., de Bruin, W. B., Parker, A. M., Hallquist, M. N., Vanyukov, P. M., & Dombrovski, A. Y. (2015) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15m09778 · Cited by 75 · see citing works
Self-citationRichard-Devantoy, S., Szanto, K., Butters, M. A., Kalkus, J., & Dombrovski, A. Y. (2015) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4138 · Cited by 74 · see citing works
Self-citationMinzenberg, M. J., Lesh, T. A., Niendam, T. A., Yoon, J. H., Cheng, Y., Rhoades, R. N., & Carter, C. S. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.08.049 · Cited by 72 · see citing works
Differential Effects of Executive Functioning on Suicide Attempts
Burton, C. Z., Vella, L., Weller, J. A., & Twamley, E. W. (2011) · Journal of Neuropsychiatry · doi:10.1176/jnp.23.2.jnp173 · Cited by 70 · see citing works
Suicide, lethality, and the psychological autopsy.
SHNEIDMAN, E. S. (1969) · PubMed · Cited by 67 · see citing works
The case against suicide prevention.
SZASZ, T. S. (1986) · American Psychologist · doi:10.1037//0003-066x.41.7.806 · Cited by 63 · see citing works
The case against suicide prevention.
SZASZ, T. S. (1986) · American Psychologist · doi:10.1037/0003-066x.41.7.806 · Cited by 59 · see citing works
Suicide attempters’ Reaction to survival as a risk factor for eventual suicide
Henriques, G., Wenzel, A., Brown, G. K., & Beck, A. T. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.11.2180 · Cited by 55 · see citing works
Algorithm selection by rational metareasoning as a model of human strategy selection
Lieder, F., Plunkett, D., Hamrick, J. B., Russell, S., Hay, N., & Griffiths, T. L. (2014) · doi:10.13140/2.1.2563.1686 · Cited by 41 · see citing works
The cost of social punishment and high-lethality suicide attempts in the second half of life.
Szántó, K., Clark, L., Hallquist, M. N., Vanyukov, P. M., Crockett, M. J., & Dombrovski, A. Y. (2014) · Psychology and Aging · doi:10.1037/a0035339 · Cited by 39 · see citing works
Self-citationNational suicide prevention programme and railway suicide
Beskow, J., Thorson, J., & Öström, M. (1994) · Social Science & Medicine · doi:10.1016/0277-9536(94)90446-4 · Cited by 36 · see citing works
Course of cognitive impairment following attempted suicide in older adults
Gujral, S., Ogbagaber, S., Dombrovski, A. Y., Butters, M. A., Karp, J. F., & Szántó, K. (2015) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4365 · Cited by 32 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [22]Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010): Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron. 65: 927– 39. 20346766 PMC3566584
Cited by
Sorted by citations
A brain-centric model of suicidal behavior
Mann, J. J., & Rizk, M. M. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20081224 · Cited by 214 · see citing works
Biological bases of suicidal behaviours: a narrative review
Lengvenyte, A., Conejero, I., Courtet, P., & Olié, E. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.14635 · Cited by 87 · see citing works
Brown, V. M., Wilson, J., Hallquist, M. N., Szanto, K., & Dombrovski, A. Y. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0632-0 · Cited by 48 · see citing works
Self-citationYang, Y., Chattun, M. R., Yan, R., Zhao, K., Chen, Y., Zhu, R., Shi, J., Wang, X., Lu, Q., & Yao, Z. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00206-4 · Cited by 35 · see citing works
Abnormal stress responsiveness and suicidal behavior: a risk phenotype
Steinberg, L. J., & Mann, J. J. (2020) · Biomarkers in Neuropsychiatry · doi:10.1016/j.bionps.2020.100011 · Cited by 29 · see citing works
Lengvenyte, A., Strumila, R., Courtet, P., Kim, S. Y. H., & Olié, E. (2020) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720931237 · Cited by 13 · see citing works
Suicide prevention and ketamine: insights from computational modeling
Charlton, C. E., Karvelis, P., McIntyre, R. S., & Diaconescu, A. O. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1214018 · Cited by 7 · see citing works
- Authors
- Dombrovski, A. Y., Hallquist, M. N., Brown, V. M., Wilson, J., & Szanto, K.
- Affiliations
- University of Pittsburgh (US)
- Pennsylvania State University (US)
- Corresponding author
- Dombrovski, Alexandre Y.
- Venue
- Biological Psychiatry
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 85
- Issue
- 6
- Pages
- 506-516
- ISSN
- 0006-3223 (ISSN-L)
- PMC
- PMC6380943
- OpenAlex
- W2896058277
- Cited by
- 65
- References
- 48
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 7 · 2023: 9 · 2022: 12 · 2021: 13 · 2020: 13 · 2019: 1 · 2018: 1
- FWCI
- 8.21
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Biological Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (R01MH100095, R01MH048463, K01MH097091, R01MH085651)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Suicide and Self-Harm Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- suicidal behavior, suicide attempters, geriatric depression, value-based choice, contingency learning, reward learning, decision making under uncertainty, decision time, cognitive control, suicidal ideation
- MeSH terms
- Late Onset Disorders, Adult, Age Factors, Aged, Aged, 80 and over, Choice Behavior, Decision Making, Depression, Female, Humans, Learning Disabilities, Male, Middle Aged, Reinforcement, Psychology, Suicide, Attempted, Case-Control Studies, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review