Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · cited 2×
“…inducing a dependency, concurrent feedback can also force instantaneous corrections of task-irrelevant errors that appear randomly (Liu and Todorov 2007; Todorov 2004; Todorov and Jordan 2002; Wei and Körding 2009; Wolpert et al. 2011) and originate from noise in the motor system (van Beers 2009).”
BackgroundMultiple resources and performance prediction
Wickens, C. D. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123806 · Cited by 2,621 · cited 3×
“…benefits of multimodal feedback in a task related to sports and rehabilitation deduced from basic research on perception and action (Alais and Burr 2004; Burke et al. 2006; Carson and Kelso 2004; Ernst and Banks 2002; Seitz and Dinse 2007; Shams and Seitz 2008; van Beers et al. 1999; Wickens 2002).”
BackgroundThe Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 5×
“…the potential benefits of multimodal feedback in a task related to sports and rehabilitation deduced from basic research on perception and action (Alais and Burr 2004; Burke et al. 2006; Carson and Kelso 2004; Ernst and Banks 2002; Seitz and Dinse 2007; Shams and Seitz 2008; van Beers et al.…”
BackgroundInfluentialOptimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746 · cited 2×
“…inducing a dependency, concurrent feedback can also force instantaneous corrections of task-irrelevant errors that appear randomly (Liu and Todorov 2007; Todorov 2004; Todorov and Jordan 2002; Wei and Körding 2009; Wolpert et al. 2011) and originate from noise in the motor system (van Beers 2009).”
BackgroundGuadagnoli, M. A., & Lee, T. D. (2004) · Journal of Motor Behavior · doi:10.3200/jmbr.36.2.212-224 · Cited by 1,534 · cited 4×
“, trunk-arm rowing, has a high functional complexity (Guadagnoli and Lee 2004) as the subjects”
BackgroundInfluentialKnowledge of results and motor learning: A review and critical reappraisal.
Salmoni, A. W., Schmidt, R. A., & Walter, C. B. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.3.355 · Cited by 1,438
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416 · cited 31×
“Concurrent feedback can provide guidance through the complex movement and intuitively present the task requirements (Lüttgen and Heuer 2013; Sigrist et al. 2013a).”
BackgroundMethodResultInfluentialSelf-citationPrinciples of sensorimotor learning
Wolpert, D. M., Diedrichsen, J., & Flanagan, J. R. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3112 · Cited by 1,391 · cited 8×
“, to effectively adjust the structure of the task (Braun et al. 2010; Wolpert and Flanagan 2010; Wolpert et al. 2011).”
BackgroundInfluentialImmediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176 · cited 6×
“Thus, the sonification provided redundant information to the visual feedback regarding movement velocity, however, in a more appropriate modality (Huang et al. 2005; Welch and Warren 1980), as audition is made to detect temporal information (Kapur et al. 2005; Kramer 1994).”
BackgroundInfluentialVirtual Environments for Motor Rehabilitation: Review
Holden, M. K. (2005) · CyberPsychology & Behavior · doi:10.1089/cpb.2005.8.187 · Cited by 1,154
Learning of action through adaptive combination of motor primitives
Thoroughman, K. A., & Shadmehr, R. (2000) · Nature · doi:10.1038/35037588 · Cited by 945
Principles derived from the study of simple skills do not generalize to complex skill learning
Wulf, G., & Shea, C. H. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196276 · Cited by 829 · cited 6×
“Since the transfer of conclusions derived from studies on simple, artificial task to complex task learning in sports and rehabilitation is limited (Guadagnoli and Lee 2004; Winstein 1991; Wulf and Shea 2002), it is worth investigating augmented feedback in complex tasks (Krakauer and Mazzoni 2011; Sigrist et al.”
BackgroundInfluentialIntegration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742 · cited 3×
“…benefits of multimodal feedback in a task related to sports and rehabilitation deduced from basic research on perception and action (Alais and Burr 2004; Burke et al. 2006; Carson and Kelso 2004; Ernst and Banks 2002; Seitz and Dinse 2007; Shams and Seitz 2008; van Beers et al. 1999; Wickens 2002).”
BackgroundRehabilitation Robotics: Performance-Based Progressive Robot-Assisted Therapy
Krebs, H. I., Palazzolo, J. J., Dipietro, L., Ferraro, M., Krol, J., Rannekleiv, K., Volpe, B. T., & Hogan, N. (2003) · Autonomous Robots · doi:10.1023/a:1024494031121 · Cited by 714 · cited 1×
“In the transition phase from air to water and vice versa, the amplitude of the violin or purling water sound was faded in or out, respectively.”
BackgroundHuman sensorimotor learning: adaptation, skill, and beyond
Krakauer, J. W., & Mazzoni, P. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.06.012 · Cited by 558 · cited 2×
“…studies on simple, artificial task to complex task learning in sports and rehabilitation is limited (Guadagnoli and Lee 2004; Winstein 1991; Wulf and Shea 2002), it is worth investigating augmented feedback in complex tasks (Krakauer and Mazzoni 2011; Sigrist et al. 2013a; Wolpert et al. 2011).”
BackgroundPatton, J. L., Stoykov, M. E., Kovic, M., & Mussa-Ivaldi, F. A. (2006) · Experimental Brain Research · doi:10.1007/s00221-005-0097-8 · Cited by 469 · cited 3×
“The subject was asked to learn the movement since they would be requested to reproduce the movement trajectory and velocity profile in a subsequent baseline test.”
BackgroundEvidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control
Liu, D., & Todorov, E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1110-06.2007 · Cited by 447 · cited 2×
“Besides inducing a dependency, concurrent feedback can also force instantaneous corrections of task-irrelevant errors that appear randomly (Liu and Todorov 2007; Todorov 2004; Todorov and Jordan 2002; Wei and Körding 2009; Wolpert et al. 2011) and originate from noise in the motor system (van Beers…”
BackgroundRelevance of Error: What Drives Motor Adaptation?
Wei, K., & Körding, K. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90545.2008 · Cited by 422 · cited 5×
“It seems that the visual feedback did not block parallel processing of visual and kinesthetic information (Wei and Körding 2009), calibration of proprioception (Buchanan and Wang 2012; Robin et al.”
BackgroundInfluentialSummary knowledge of results for skill acquisition: Support for the guidance hypothesis.
Schmidt, R. A., Young, D. E., Swinnen, S., & Shapiro, D. C. (1989) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.15.2.352 · Cited by 407 · cited 3×
“4; Table 1), supporting the guidance hypothesis (Salmoni 1984; Schmidt 1991; Schmidt et al. 1989).”
BackgroundFreides, D. (1974) · Psychological Bulletin · doi:10.1037/h0036331 · Cited by 362 · cited 2×
“Spatial information is perceived more precisely through vision than audition (Freides 1974; Welch and Warren 1980) while audition is effective to perceive periodicity, regularity, and speed of motion (Kapur et al. 2005; Kramer 1994).”
BackgroundPatient specific ankle-foot orthoses using rapid prototyping
Mavroidis, C., Ranky, R. G., Sivak, M. L., Patritti, B. L., DiPisa, J., Caddle, A., Gilhooly, K., Govoni, L., Sivak, S., Lancia, M., et al. (2011) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-8-1 · Cited by 361
Advances in the application of information technology to sport performance
Liebermann, D. G., Katz, L., Hughes, M. D., Bartlett, R. M., McClements, J., & Franks, I. M. (2002) · Journal of Sports Sciences · doi:10.1080/026404102320675611 · Cited by 338 · cited 2×
“It is assumed that concurrent feedback facilitates the discovery of skills required for the novel task (Huegel and O’Malley 2010; Liebermann et al. 2002) and the understanding of the novel structure of the task (Braun et al.”
BackgroundIsrael, J. F., Campbell, D. D., Kahn, J. H., & Hornby, T. G. (2006) · Physical Therapy · doi:10.2522/ptj.20050266 · Cited by 322
Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task
Todorov, E., Shadmehr, R., & Bizzi, E. (1997) · Journal of Motor Behavior · doi:10.1080/00222899709600829 · Cited by 314
Emken, J. L., & Reinkensmeyer, D. J. (2005) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2004.843173 · Cited by 300 · cited 1×
“As learning is error-driven (Thoroughman and Shadmehr 2000), an optimal amplification of the perceived movement error accelerates the learning process (Cesqui et al. 2008; Emken and Reinkensmeyer 2005; Milot et al. 2010; Patton et al. 2006, 2013).”
BackgroundA common framework for perceptual learning
Seitz, A. R., & Dinse, H. R. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.02.004 · Cited by 276 · cited 5×
“On the one hand, studies on cross-modal integration suggest that multimodal feedback enhances perception (Seitz and Dinse 2007) and action (Carson and Kelso 2004), which may facilitate learning.”
BackgroundInfluentialFeedback After Good Trials Enhances Learning
Chiviacowsky, S., & Wulf, G. (2007) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2007.10599402 · Cited by 265
Social Neuroscience: Mirror Neurons Recorded in Humans
Keysers, C., & Gazzola, V. (2010) · Current Biology · doi:10.1016/j.cub.2010.03.013 · Cited by 262 · cited 2×
“Perception of sound and action is strongly linked (Chen et al. 2008; Keysers and Gazzola 2010; Zatorre et al. 2007), whereby a sound can imply movements (Schaffert et al. 2011).”
BackgroundHaptics in Education: Exploring an Untapped Sensory Modality
Minogue, J., & Jones, M. G. (2006) · Review of Educational Research · doi:10.3102/00346543076003317 · Cited by 255 · cited 2×
“Haptic feedback is the only bidirectional modality (Hale and Stanney 2004; Minogue and Jones 2006), i.e., it can physically alter, disturb, or assist the movement of the subject.”
BackgroundSound Facilitates Visual Learning
Seitz, A. R., Kim, R., & Shams, L. (2006) · Current Biology · doi:10.1016/j.cub.2006.05.048 · Cited by 243
Hale, K. S., & Stanney, K. M. (2004) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2004.1274059 · Cited by 236
Information feedback for skill acquisition: Instantaneous knowledge of results degrades learning.
Swinnen, S. P., Schmidt, R. A., Nicholson, D. E., & Shapiro, D. C. (1990) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.16.4.706 · Cited by 222 · cited 1×
“Self-estimation was found to be important for motor learning (Guadagnoli and Kohl 2001; Liu and Wrisberg 1997; Swinnen et al. 1990).”
BackgroundBraun, D. A., Mehring, C., & Wolpert, D. M. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.08.031 · Cited by 210 · cited 4×
“It is supposed that the haptic reactive feedback can force the subject to remember how counterforces can be avoided in the next movement trial, i.e., to effectively adjust the structure of the task (Braun et al. 2010; Wolpert and Flanagan 2010; Wolpert et al. 2011).”
BackgroundInfluentialMotor Learning with Augmented Feedback: Modality-Dependent Behavioral and Neural Consequences
Ronsse, R., Puttemans, V., Coxon, J. P., Goble, D. J., Wagemans, J., Wenderoth, N., & Swinnen, S. P. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq209 · Cited by 193
Self-controlled practice enhances motor learning: implications for physiotherapy
Wulf, G. (2007) · Physiotherapy · doi:10.1016/j.physio.2006.08.005 · Cited by 184 · cited 3×
“Furthermore, motor learning should force the internalization of proprioceptive information of correct movements (Chiviacowsky and Wulf 2007; Winstein 1991).”
BackgroundMethodMovement Sonification: Effects on Perception and Action
Effenberg, A. O. (2005) · IEEE Multimedia · doi:10.1109/mmul.2005.31 · Cited by 177 · cited 2×
“Movement sonification has already been demonstrated to enhance the perception (Effenberg 2005; Schmitz et al. 2013); performance (Schaffert et al. 2011), and learning of dynamic/temporal aspects of a movement (Chollet et al. 1992).”
BackgroundHaptic Guidance Can Enhance Motor Learning of a Steering Task
Crespo, L. M., & Reinkensmeyer, D. J. (2008) · Journal of Motor Behavior · doi:10.3200/jmbr.40.6.545-557 · Cited by 166 · cited 3×
“As 1 3 concluded by others (Marchal-Crespo and Reinkensmeyer 2008a), it remains challenging to design effective and unambiguous haptic augmented feedback on top of rendered task forces in a virtual scenario.”
BackgroundBenefits of Stimulus Congruency for Multisensory Facilitation of Visual Learning
Kim, R. S., Seitz, A. R., & Shams, L. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001532 · Cited by 148
Milot, M.-H., Marchal-Crespo, L., Green, C. S., Cramer, S. C., & Reinkensmeyer, D. J. (2010) · Experimental Brain Research · doi:10.1007/s00221-009-2014-z · Cited by 139 · cited 4×
“Recent studies have applied haptic guidance to effectively teach dynamic or timing aspects of a movement (Lüttgen and Heuer 2012a, b, 2013, Marchal-Crespo et al. 2010, 2013; Milot et al. 2010).”
BackgroundInfluentialSelf-citationLearning a Partial-Weight-Bearing Skill: Effectiveness of Two Forms of Feedback
Winstein, C. J., Pohl, P. S., Cardinale, C., Green, A., Scholtz, L., & Waters, C. S. (1996) · Physical Therapy · doi:10.1093/ptj/76.9.985 · Cited by 130 · cited 1×
“However, performance dropped dramatically when the feedback was withdrawn (Schmidt and Wulf 1997; van der Linden et al. 1993; Winstein et al. 1996).”
BackgroundVander Linden, D. W., Cauraugh, J. H., & Greene, T. A. (1993) · Physical Therapy · doi:10.1093/ptj/73.2.79 · Cited by 127
Governing coordination: behavioural principles and neural correlates
Carson, R. G., & Kelso, J. A. S. (2004) · Experimental Brain Research · doi:10.1007/s00221-003-1726-8 · Cited by 107
Guadagnoli, M. A., & Kohl, R. M. (2001) · Journal of Motor Behavior · doi:10.1080/00222890109603152 · Cited by 107
Secoli, R., Milot, M.-H., Rosati, G., & Reinkensmeyer, D. J. (2011) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-8-21 · Cited by 107 · cited 3×
“As reported by others (Schaffert et al. 2011; Secoli et al. 2011), the auditory feedback guided the focus on a specific aspect, in this case toward the movement velocity as intended.”
BackgroundKovacs, A. J., & Shea, C. H. (2011) · Acta Psychologica · doi:10.1016/j.actpsy.2010.12.004 · Cited by 99 · cited 1×
“However, concurrent feedback has been found to be effective for learning more complex tasks (Kovacs and Shea 2011; Marschall et al. 2007; Sigrist et al. 2013b; Snodgrass et al. 2010, Swinnen et al. 1997; Todorov et al. 1997; Wishart et al. 2002; Wulf et al. 1998, 1999).”
BackgroundWishart, L. R., Lee, T. D., Cunningham, S. J., & Murdoch, J. E. (2002) · Acta Psychologica · doi:10.1016/s0001-6918(02)00036-7 · Cited by 87
Liu, J., & Wrisberg, C. A. (1997) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1997.10607990 · Cited by 64 · cited 1×
“Self-estimation was found to be important for motor learning (Guadagnoli and Kohl 2001; Liu and Wrisberg 1997; Swinnen et al. 1990).”
BackgroundAuditory Imagery Contains More Than Audition
Hubbard, T. L. (2013) · Multisensory Imagery · doi:10.1007/978-1-4614-5879-1_12 · Cited by 59
Specificity of practice: Interaction between concurrent sensory information and terminal feedback.
Blandin, Y., Toussaint, L., & Shea, C. H. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.34.4.994 · Cited by 57 · cited 2×
“The target movement was fit to a typical training stroke rate of 24 strokes per minute.”
BackgroundMethodInteractive Multimodal Biofeedback for Task-Oriented Neural Rehabilitation
Huang, H., Ingalls, T., Olson, L., Ganley, K., Rikakis, T., & He, J. (2005) · 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference · doi:10.1109/iembs.2005.1616988 · Cited by 55
Real-time feedback improves accuracy of manually applied forces during cervical spine mobilisation
Snodgrass, S. J., Rivett, D. A., Robertson, V. J., & Stojanovski, E. (2010) · Manual Therapy · doi:10.1016/j.math.2009.05.011 · Cited by 52
Specificity of Learning in a Video-Aiming Task: Modifying the Salience of Dynamic Visual Cues
Robin, C., Toussaint, L., Blandin, Y., & Proteau, L. (2005) · Journal of Motor Behavior · doi:10.3200/jmbr.37.5.367-376 · Cited by 45 · cited 3×
“Ideally, feedback designs should therefore guide the subject toward the target movement without diminishing kinesthetic information processing (Robin et al. 2005; Wei and Körding 2009).”
BackgroundVisual and Auditory Augmented Concurrent Feedback in a Complex Motor Task
Sigrist, R. (2011) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres_a_00032 · Cited by 36 · cited 2×
“…parameters of the feedback designs (e.g., deviation threshold for trace, mapping function of sonification, gains of the haptic reactive feedback) were set based on the best knowledge gained from a systematic evaluation of feedback in pilot studies and prior studies (Sigrist et al. 2011, 2013b).”
MethodSelf-citationBenefits of Blocked Over Serial Feedback on Complex Motor Skill Learning
Wulf, G., Hörger, M., & Shea, C. H. (1999) · Journal of Motor Behavior · doi:10.1080/00222899909601895 · Cited by 35 · cited 1×
“However, concurrent feedback has been found to be effective for learning more complex tasks (Kovacs and Shea 2011; Marschall et al. 2007; Sigrist et al. 2013b; Snodgrass et al. 2010, Swinnen et al. 1997; Todorov et al. 1997; Wishart et al. 2002; Wulf et al. 1998, 1999).”
BackgroundOn the Use of Divergent Force Fields in Robot-Mediated Neurorehabilitation
Cesqui, B., Aliboni, S., Mazzoleni, S., Carrozza, M. C., Posteraro, F., & Micera, S. (2008) · 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics · doi:10.1109/biorob.2008.4762927 · Cited by 34
Assistance or challenge? Filling a gap in user-cooperative control
Rauter, G., Sigrist, R., Marchal-Crespo, L., Vallery, H., Riener, R., & Wolf, P. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094832 · Cited by 24
Self-citation
Cited by
A systematic review of the application of interactive virtual reality to sport
Neumann, D. L., Moffitt, R. L., Thomas, P. R., Loveday, K., Watling, D. P., Lombard, C. L., Antonova, S., & Tremeer, M. A. (2018) · Virtual Reality · doi:10.1007/s10055-017-0320-5 · Cited by 351
Fujii, S., Lulic, T., & Chen, J. L. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00251 · Cited by 49
Frid, E., Moll, J., Bresin, R., & Sallnäs Pysander, E.-L. (2019) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-018-0264-4 · Cited by 19
“It can be particularly useful for exploration of data that changes over time, for example in inspection of body movement data, and has proved to have positive effects on motor learning [12,13,49].”
Metadata
- Authors
- Sigrist, R., Rauter, G., Marchal-Crespo, L., Riener, R., & Wolf, P.
- Venue
- Experimental Brain Research
- Published
- 2014-12-16
- Volume
- 233
- Issue
- 3
- Pages
- 909-925
- ISSN
- 0014-4819 (ISSN-L)
- 1432-1106
- OpenAlex
- W2130461445
- Cited by
- 158
- References
- 57
- FWCI
- 4.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.