Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081
A domain‐specific risk‐attitude scale: measuring risk perceptions and risk behaviors
Weber, E. U., Blais, A., & Betz, N. E. (2002) · Journal of Behavioral Decision Making · doi:10.1002/bdm.414 · Cited by 2,936
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498 · cited 2×
“does take into account – for example, see [19,20].”
BackgroundSelf-citationOptimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746 · cited 2×
“Previous studies have used risk-neutral optimal control models to explain a wide-range of movement phenomena [17,18].”
BackgroundEvidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control
Liu, D., & Todorov, E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1110-06.2007 · Cited by 447 · cited 1×
“Similarly, a single controller can incorporate additional task goals such as a stability requirement [3] or object manipulation [10], and subjects adapted their movement strategy flexibly to the new task requirements as predicted by extended optimal control models.”
BackgroundDecision making, movement planning and statistical decision theory
Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.04.010 · Cited by 314
Cited by
Principles of sensorimotor learning
Wolpert, D. M., Diedrichsen, J., & Flanagan, J. R. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3112 · Cited by 1,391
“However, in some motor tasks subjects can show a tendency to be risk averse or risk seeking; that is, accepting a lower average reward if the variance of the reward is decreased or increased, respectively 23–25 .”
BackgroundSelf-citationComputational Mechanisms of Sensorimotor Control
Franklin, D. W., & Wolpert, D. M. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.006 · Cited by 725
Self-citationKnowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339
Risk-Sensitivity in Sensorimotor Control
Braun, D. A., Nagengast, A. J., & Wolpert, D. M. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00001 · Cited by 325
Self-citationThermodynamics as a theory of decision-making with information-processing costs
Ortega, P. A., & Braun, D. A. (2013) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2012.0683 · Cited by 255
Self-citation
Metadata
- Authors
- Nagengast, A. J., Braun, D. A., & Wolpert, D. M.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-07-15
- Volume
- 6
- Issue
- 7
- Pages
- e1000857
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W1982921646
- Cited by
- 90
- References
- 6
- FWCI
- 4.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty. https://app.cochat.ai/papers/10.1371/journal.pcbi.1000857
- The paper
- Nagengast, A. J., Braun, D. A., & Wolpert, D. M. (2010). Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty. PLoS Computational Biology. https://doi.org/10.1371/journal.pcbi.1000857
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.