The Role of Value Systems in Decision Making
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Values, rewards, and costs play a central role in economic, statistical, and psychological notions of decision making. They also have surprisingly direct neural realizations. This chapter discusses the ways in which different value systems interact with different decision-making systems to fashion and shape affectively appropriate behavior in complex environments. Forms of deliberative and automatic decision making are interpreted as sharing a common purpose rather than serving different or non-normative goals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 2×
“Our view is thus perhaps not completely consistent with some two-systems accounts, for instance, those that attribute a shorter timescale of discounting to the automatic rather than the deliberative system ( McClure et al. 2004).”
BackgroundResultDaw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 6×
“Such values are sometimes called cached ( Daw et al. 2005) because they cache information actually observed about future outcomes in the form of expected utilities.”
BackgroundInfluentialSelf-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 4×
“There is good evidence that a prediction error closely related to this is represented in the activity of dopamine neurons ( Montague et al. 1996; Schultz 1998).”
BackgroundInfluentialSelf-citationAdaptive strategy selection in decision making.
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1988) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.14.3.534 · Cited by 1,955 · cited 2×
“Note that if computational noise can be reduced through the application of (cognitive) effort or processing time, then forms of effort- or time-accuracy trade-offs may ensue (e.g., Payne et al. 1988).”
BackgroundReward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426
Individual choice behavior: A theoretical analysis.
Luce, R. D. (2005) · doi:10.1037/14396-000 · Cited by 1,157 · cited 2×
“One conventional abstraction of this stochastic choice is that the probability of executing action c is determined by competition between Q values, as in a form of Luce choice rule ( Luce 1959) or softmax:”
BackgroundMethodTonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
Self-citationCompetition among multiple memory systems: converging evidence from animal and human brain studies
Poldrack, R. A., & Packard, M. G. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00157-4 · Cited by 880 · cited 2×
“Although different interpretations are possible, there is indeed evidence in rats and humans that the hippocampus, a critical structure for episodic memory, whose storage appears to be under rich neuromodulatory control, may indeed have a key role to play ( Poldrack and Packard 2003 ).”
BackgroundReward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Self-citationOpponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Self-citationParallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · cited 1×
“This has all been reviewed extensively elsewhere (e.g., O’Doherty 2004; Balleine and Killcross 2006 ), including in its ascription by Berridge and Robinson (1998) to the second of their two systems infl uencing choice (“wanting,” which complements liking).”
BackgroundParallel circuits mediating distinct emotional coping reactions to different types of stress
Keay, K. A., & Bandler, R. (2001) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(01)00049-5 · Cited by 512
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251
Self-citation
Cited by
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Self-citationAarts, E., Roelofs, A., Franke, B., Rijpkema, M., Fernández, G., Helmich, R. C., & Cools, R. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.68 · Cited by 157
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
Watanabe, N., Sakagami, M., & Haruno, M. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3400-12.2013 · Cited by 65
“Probabilistic reward learning has been studied intensively in humans and animals as a basic model of learning (Dayan, 2008), and can be understood within the framework of reinforcement learning models (Sutton and Barto, 1998), in which an agent aims to maximize their “reward.””
Background
Metadata
- Authors
- Dayan, P.
- Venue
- Better Than Conscious?
- Publisher
- The MIT Press
- Published
- 2008-05-09
- Pages
- 51-70
- OpenAlex
- W2499073429
- Cited by
- 37
- References
- 16
- FWCI
- 7.96
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.