Stress modulates reinforcement learning in younger and older adults.
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Animal research and human neuroimaging studies indicate that stress increases dopamine levels in brain regions involved in reward processing, and stress also appears to increase the attractiveness of addictive drugs. The current study tested the hypothesis that stress increases reward salience, leading to more effective learning about positive than negative outcomes in a probabilistic selection task. Changes to dopamine pathways with age raise the question of whether stress effects on incentive-based learning differ by age. Thus, the present study also examined whether effects of stress on reinforcement learning differed for younger (age 18-34) and older participants (age 65-85). Cold pressor stress was administered to half of the participants in each age group, and salivary cortisol levels were used to confirm biophysiological response to cold stress. After the manipulation, participants completed a probabilistic learning task involving positive and negative feedback. In both younger and older adults, stress enhanced learning about cues that predicted positive outcomes. In addition, during the initial learning phase, stress diminished sensitivity to recent feedback across age groups. These results indicate that stress affects reinforcement learning in both younger and older adults and suggests that stress exerts different effects on specific components of reinforcement learning depending on their neural underpinnings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effects of stress throughout the lifespan on the brain, behaviour and cognition
Lupien, S. J., McEwen, B. S., Gunnar, M. R., & Heim, C. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2639 · Cited by 6,256
Kirschbaum, C., Pirke, K.-M., & Hellhammer, D. H. (2008) · Neuropsychobiology · doi:10.1159/000119004 · Cited by 6,093
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
Salivary cortisol in psychoneuroendocrine research: recent developments and applications
Kirschbaum, C., & Hellhammer, D. H. (1994) · Psychoneuroendocrinology · doi:10.1016/0306-4530(94)90013-2 · Cited by 2,107 · cited 1×
“Samples were frozen immediately after testing at Ϫ30 °C. Levels of cortisol found in saliva are considered good estimates of unbound levels (bioavailable) in plasma (Kirschbaum & Hellhammer, 1994).”
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citationAging and motivated cognition: the positivity effect in attention and memory
Mather, M., & Carstensen, L. L. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.08.005 · Cited by 1,910 · cited 1×
“And second, aging is associated with an increased focus on positive information (Mather & Carstensen, 2005), which may selectively improve memory for positive stimulus-outcome associations in the face of dopamine declines.”
Self-citationChronic stress, drug use, and vulnerability to addiction
Sinha, R. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1441.030 · Cited by 1,904
The principal features and mechanisms of dopamine modulation in the prefrontal cortex
Seamans, J. K., & Yang, C. R. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.05.006 · Cited by 1,592
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106
Top-down suppression deficit underlies working memory impairment in normal aging
Gazzaley, A., Cooney, J. W., Rissman, J., & D'Esposito, M. (2005) · Nature Neuroscience · doi:10.1038/nn1543 · Cited by 934
Pruessner, J. C., Champagne, F., Meaney, M. J., & Dagher, A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3422-03.2004 · Cited by 709
Qin, S., Hermans, E. J., van Marle, H. J. F., Luo, J., & Fernández, G. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.03.006 · Cited by 675 · cited 1×
“Although age differences have not been examined , stress appears to alter brain activation in both of these regions (Pruessner et al., 2008; Wang et al., 2005), and stress-related impairments to working memory have been linked to dorsolateral PFC disruption (Qin et al., 2009).”
Pruessner, J. C., Dedovic, K., Khalili-Mahani, N., Engert, V., Pruessner, M., Buss, C., Renwick, R., Dagher, A., Meaney, M. J., & Lupien, S. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.04.041 · Cited by 593 · cited 1×
“Although age differences have not been examined , stress appears to alter brain activation in both of these regions (Pruessner et al., 2008; Wang et al., 2005), and stress-related impairments to working memory have been linked to dorsolateral PFC disruption (Qin et al., 2009).”
Kudielka, B. M., Schommer, N. C., Hellhammer, D. H., & Kirschbaum, C. (2004) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2003.08.009 · Cited by 566
Perfusion functional MRI reveals cerebral blood flow pattern under psychological stress
Wang, J., Rao, H., Wetmore, G. S., Furlan, P. M., Korczykowski, M., Dinges, D. F., & Detre, J. A. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503082102 · Cited by 513 · cited 2×
“Although age differences have not been examined, stress appears to alter brain activation in both of these regions (Pruessner et al., 2008; Wang et al., 2005), and stress-related impairments to working memory have been linked to dorsolateral PFC disruption (Qin et al.”
Psychosocial stress induces working memory impairments in an n-back paradigm.
Schoofs, D., Preuß, D., & Wolf, O. T. (2008) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2008.02.004 · Cited by 483 · cited 1×
“Others have found similar stress-related impairment to working memory tasks without reinforcement (e.g., Schoofs et al., 2008; Schoofs et al., 2009).”
Bäckman, L., Lindenberger, U., Li, S.-C., & Nyberg, L. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.12.008 · Cited by 414
The Cold Pressor Test and Autonomic Function: A Review and Integration
Lovallo, W. (1975) · Psychophysiology · doi:10.1111/j.1469-8986.1975.tb01289.x · Cited by 409
van den Bos, R., Harteveld, M., & Stoop, H. (2009) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2009.04.016 · Cited by 369
Piazza, P. V., Rougé-Pont, F., Deroche, V, Maccari, S., Simon, H., & Le Moal, M. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.16.8716 · Cited by 346
Acute stress increases sex differences in risk seeking in the balloon analogue risk task.
Lighthall, N. R., Mather, M., & Gorlick, M. A. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006002 · Cited by 300
Self-citationJocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278
Schoofs, D., Wolf, O. T., & Smeets, T. (2009) · Behavioral Neuroscience · doi:10.1037/a0016980 · Cited by 269 · cited 1×
“Others have found similar stress-related impairment to working memory tasks without reinforcement (e.g., Schoofs et al., 2008; Schoofs et al., 2009).”
Frank, M. J., Santamaria, A., O'Reilly, R. C., & Willcutt, E. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301278 · Cited by 227 · cited 2×
“The tendency to learn faster during periods of uncertainty has been shown to relate to prefrontal cortical function dissociable from cumulative learning in this task given genetic and pharmacological manipulations (Doll et al., 2011; Frank, O'Reilly & Curran, 2006; Frank et al., 2007”
Restraint increases dopaminergic burst firing in awake rats
Anstrom, K. K., & Woodward, D. J. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300730 · Cited by 181
Salivary Cortisol Levels and Stress Reactivity in Human Aging
Nicolson, N., Storms, C., Ponds, R., & Sulon, J. (1997) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/52a.2.m68 · Cited by 139
Kudielka, B. M., Schmidt-Reinwald, A. K., Hellhammer, D. H., & Kirschbaum, C. (1999) · Neuroendocrinology · doi:10.1159/000054504 · Cited by 135 · cited 5×
“, & Kirschbaum, C. (2000). Psychosocial stress and HPA”
InfluentialLow cortisol levels and the balance between punishment sensitivity and reward dependency
Honk, J. V., Schutter, D. J. L. G., Hermans, E. J., & Putman, P. (2003) · NeuroReport · doi:10.1097/00001756-200310270-00023 · Cited by 127 · cited 1×
“…our finding that cold pressor stress enhanced positive feedback learning is consistent with an earlier study with college-age adults that found an association between higher basal cortisol levels and reward dependency (greater monetary gains) on the Iowa Gambling Task (van Honk et al., 2003).”
Del Arco, A., Segovia, G., de Blas, M., Garrido, P., Acuña-Castroviejo, D., Pamplona, R., & Mora, F. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.07.024 · Cited by 57
Cited by
Wulf, G., & Lewthwaite, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0999-9 · Cited by 1,238
Working-memory capacity protects model-based learning from stress
Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A., & Daw, N. D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312011110 · Cited by 465
Risk and Reward Are Processed Differently in Decisions Made Under Stress
Mather, M., & Lighthall, N. R. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721411429452 · Cited by 266
Self-citationUpdating beliefs under perceived threat
Garrett, N., González-Garzón, A. M., Foulkes, L., Levita, L., & Sharot, T. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0716-18.2018 · Cited by 109
Worries of the poor: The impact of financial burden on the risk attitudes of micro-entrepreneurs
Dalton, P. S., Nhung, N., & Rüschenpöhler, J. (2020) · Journal of Economic Psychology · doi:10.1016/j.joep.2019.102198 · Cited by 84
Metadata
- Authors
- Lighthall, N. R., Gorlick, M. A., Schoeke, A., Frank, M. J., & Mather, M.
- Venue
- Psychology and Aging
- Published
- 2013-03
- Volume
- 28
- Issue
- 1
- Pages
- 35-46
- ISSN
- 0882-7974 (ISSN-L)
- 1939-1498
- OpenAlex
- W2006601470
- Cited by
- 103
- References
- 30
- FWCI
- 1.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.