A Model of Reward- and Effort-Based Optimal Decision Making and Motor Control
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Costs (e.g. energetic expenditure) and benefits (e.g. food) are central determinants of behavior. In ecology and economics, they are combined to form a utility function which is maximized to guide choices. This principle is widely used in neuroscience as a normative model of decision and action, but current versions of this model fail to consider how decisions are actually converted into actions (i.e. the formation of trajectories). Here, we describe an approach where decision making and motor control are optimal, iterative processes derived from the maximization of the discounted, weighted difference between expected rewards and foreseeable motor efforts. The model accounts for decision making in cost/benefit situations, and detailed characteristics of control and goal tracking in realistic motor tasks. As a normative construction, the model is relevant to address the neural bases and pathological aspects of decision making and motor control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“6C,D), amplitude, duration and variability varied in a concerted way that conformed to Fitts’ law [40,41], i.”
BackgroundOptimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · cited 7×
“Signal-dependent noise on object dynamics is necessary for optimal feedback control to implement a minimum intervention principle [10,99]; 2.”
BackgroundMethodInfluentialSignal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498 · cited 2×
“It should be noted that there exist numerous models of Fitts’ law in the literature [30, 44-46].”
MethodForward Models for Physiological Motor Control
Miall, R. C., & Wolpert, D. M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00035-4 · Cited by 2,260
Optimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746 · cited 2×
“for any time tM[t0;tf], where L is a function which generally penalizes large controls (effort) and deviations from a goal state (error; see [92] for a review).”
BackgroundOptimality in human motor performance: Ideal control of rapid aimed movements.
Meyer, D. E., Abrams, R. A., Kornblum, S., Wright, C. E., & Keith Smith, J. E. (1988) · Psychological Review · doi:10.1037/0033-295x.95.3.340 · Cited by 1,406
A computational neuroanatomy for motor control
Shadmehr, R., & Krakauer, J. W. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1280-5 · Cited by 1,187
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 4×
“Accordingly, the cost of time as used in the present model and in previous models [48,49,50,51], seems unlike a classic temporal discounting factor, and could be specific to cost/benefit situations and motor control.”
BackgroundMethodInfluentialThe timing of mentally represented actions
Decety, J., Jeannerod, M., & Prablanc, C. (1989) · Behavioural Brain Research · doi:10.1016/s0166-4328(89)80088-9 · Cited by 791 · cited 1×
“There is strong experimental evidence for the existence of a linear relationship between distance and duration for locomotor displacements ([24-27]; see also [28] with fish).”
BackgroundThe neural mechanisms of inter-temporal decision-making: understanding variability
Peters, J., & Büchel, C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.03.002 · Cited by 693 · cited 1×
“At odds with classical economics theories, it highlights the potential complexity and pervasiveness of the neural processes underlying computation of the cost of time [78,79].”
BackgroundHow the Brain Translates Money into Force: A Neuroimaging Study of Subliminal Motivation
Pessiglione, M., Schmidt, L., Draganski, B., Kalisch, R., Lau, H., Dolan, R. J., & Frith, C. D. (2007) · Science · doi:10.1126/science.1140459 · Cited by 634
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 1×
“This result corresponds to a classic observation in cost/ benefit choice tasks [4,6].”
ResultWhy Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
Mazzoni, P., Hristova, A., & Krakauer, J. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0264-07.2007 · Cited by 557
Risky business: the neuroeconomics of decision making under uncertainty
Platt, M. L., & Huettel, S. A. (2008) · Nature Neuroscience · doi:10.1038/nn2062 · Cited by 556
Separate Valuation Subsystems for Delay and Effort Decision Costs
Prévost, C., Pessiglione, M., Météreau, E., Cléry-Melin, M.-L., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2752-10.2010 · Cited by 499
Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control
Liu, D., & Todorov, E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1110-06.2007 · Cited by 447 · cited 10×
“For Object IIIa, we used the values found in [29] (in S.”
BackgroundMethodInfluentialDecision making, movement planning and statistical decision theory
Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.04.010 · Cited by 314
Decision theory: what “should” the nervous system do?
Körding, K. (2007) · Science · doi:10.1126/science.1142998 · Cited by 313 · cited 1×
“system should do [18], and is thus relevant to address and discuss”
BackgroundMajsak, M. (1998) · Brain · doi:10.1093/brain/121.4.755 · Cited by 177
Get Aroused and Be Stronger: Emotional Facilitation of Physical Effort in the Human Brain
Schmidt, L., Cléry-Melin, M.-L., Lafargue, G., Valabrègue, R., Fossati, P., Dubois, B., & Pessiglione, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1951-09.2009 · Cited by 123
Cited by
Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control
Manohar, S. G., Chong, T. T.-J., Apps, M. A. J., Batla, A., Stamelou, M., Jarman, P. R., Bhatia, K. P., & Husain, M. (2015) · Current Biology · doi:10.1016/j.cub.2015.05.038 · Cited by 317
A Representation of Effort in Decision-Making and Motor Control
Shadmehr, R., Huang, H. J., & Ahmed, A. A. (2016) · Current Biology · doi:10.1016/j.cub.2016.05.065 · Cited by 267
Embodied choice: how action influences perceptual decision making
Lepora, N. F., & Pezzulo, G. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004110 · Cited by 209
Individual Differences in Premotor Brain Systems Underlie Behavioral Apathy
Bonnelle, V., Manohar, S., Behrens, T., & Husain, M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv247 · Cited by 163
“The decision to act then has to be converted into a motor plan for effortful action to take place (Rigoux and Guigon 2012).”
BackgroundAdaptive effort investment in cognitive and physical tasks: A neurocomputational model
Verguts, T., Vassena, E., & Silvetti, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00057 · Cited by 118
Metadata
- Authors
- Rigoux, L., & Guigon, E.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-10-04
- Volume
- 8
- Issue
- 10
- Pages
- e1002716
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2093015950
- Cited by
- 129
- References
- 21
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.