A Model of Reward- and Effort-Based Optimal Decision Making and Motor Control
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Costs (e.g. energetic expenditure) and benefits (e.g. food) are central determinants of behavior. In ecology and economics, they are combined to form a utility function which is maximized to guide choices. This principle is widely used in neuroscience as a normative model of decision and action, but current versions of this model fail to consider how decisions are actually converted into actions (i.e. the formation of trajectories). Here, we describe an approach where decision making and motor control are optimal, iterative processes derived from the maximization of the discounted, weighted difference between expected rewards and foreseeable motor efforts. The model accounts for decision making in cost/benefit situations, and detailed characteristics of control and goal tracking in realistic motor tasks. As a normative construction, the model is relevant to address the neural bases and pathological aspects of decision making and motor control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“6C,D), amplitude, duration and variability varied in a concerted way that conformed to Fitts’ law [40,41], i.”
BackgroundOptimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · cited 7×
“Signal-dependent noise on object dynamics is necessary for optimal feedback control to implement a minimum intervention principle [10,99]; 2.”
BackgroundMethodInfluentialAdaptive representation of dynamics during learning of a motor task
Shadmehr, R., & Mussa-Ivaldi, F. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-05-03208.1994 · Cited by 2,612
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498 · cited 2×
“It should be noted that there exist numerous models of Fitts’ law in the literature [30, 44-46].”
MethodForward Models for Physiological Motor Control
Miall, R. C., & Wolpert, D. M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00035-4 · Cited by 2,260
Optimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746 · cited 2×
“for any time tM[t0;tf], where L is a function which generally penalizes large controls (effort) and deviations from a goal state (error; see [92] for a review).”
BackgroundOptimality in human motor performance: Ideal control of rapid aimed movements.
Meyer, D. E., Abrams, R. A., Kornblum, S., Wright, C. E., & Keith Smith, J. E. (1988) · Psychological Review · doi:10.1037/0033-295x.95.3.340 · Cited by 1,406
A computational neuroanatomy for motor control
Shadmehr, R., & Krakauer, J. W. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1280-5 · Cited by 1,187
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 4×
“Accordingly, the cost of time as used in the present model and in previous models [48,49,50,51], seems unlike a classic temporal discounting factor, and could be specific to cost/benefit situations and motor control.”
BackgroundMethodInfluential
Cited by
Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control
Manohar, S. G., Chong, T. T.-J., Apps, M. A. J., Batla, A., Stamelou, M., Jarman, P. R., Bhatia, K. P., & Husain, M. (2015) · Current Biology · doi:10.1016/j.cub.2015.05.038 · Cited by 317
A Representation of Effort in Decision-Making and Motor Control
Shadmehr, R., Huang, H. J., & Ahmed, A. A. (2016) · Current Biology · doi:10.1016/j.cub.2016.05.065 · Cited by 267
Embodied choice: how action influences perceptual decision making
Lepora, N. F., & Pezzulo, G. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004110 · Cited by 209
Individual Differences in Premotor Brain Systems Underlie Behavioral Apathy
Bonnelle, V., Manohar, S., Behrens, T., & Husain, M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv247 · Cited by 163
“The decision to act then has to be converted into a motor plan for effortful action to take place (Rigoux and Guigon 2012).”
BackgroundAdaptive effort investment in cognitive and physical tasks: A neurocomputational model
Verguts, T., Vassena, E., & Silvetti, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00057 · Cited by 118
Kroemer, N. B., Guevara, A., Ciocanea Teodorescu, I., Wuttig, F., Kobiella, A., & Smolka, M. N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.060 · Cited by 64
Human inference in changing environments with temporal structure.
Prat-Carrabin, A., Wilson, R. C., Cohen, J. D., & Azeredo da Silveira, R. (2021) · Psychological Review · doi:10.1037/rev0000276 · Cited by 16
“Another possible explanation is that even though the new estimate falls on a nearby location, a motor cost prohibits a move if it is not sufficiently extended to be ‘worth it’ [45, 46, 47, 48].”
Background
Metadata
- Authors
- Rigoux, L., & Guigon, E.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-10-04
- Volume
- 8
- Issue
- 10
- Pages
- e1002716
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2093015950
- Cited by
- 129
- References
- 22
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.