Humans Can Integrate Augmented Reality Feedback in Their Sensorimotor Control of a Robotic Hand
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Tactile feedback is pivotal for grasping and manipulation in humans. Providing functionally effective sensory feedback to prostheses users is an open challenge. Past paradigms were mostly based on vibro- or electrotactile stimulations. However, the tactile sensitivity on the targeted body parts (usually the forearm) is greatly less than that of the hand/fingertips, restricting the amount of information that can be provided through this channel. Visual feedback is the most investigated technique in motor learning studies, where it showed positive effects in learning both simple and complex tasks; however, it was not exploited in prosthetics due to technological limitations. Here, we investigated if visual information provided in the form of augmented reality (AR) feedback can be integrated by able-bodied participants in their sensorimotor control of a pick-and-lift task while controlling a robotic hand. For this purpose, we provided visual continuous feedback related to grip force and hand closure to the participants. Each variable was mapped to the length of one of the two ellipse axes visualized on the screen of wearable single-eye display AR glasses. We observed changes in behavior when subtle (i.e., not announced to the participants) manipulation of the AR feedback was introduced, which indicated that the participants integrated the artificial feedback within the sensorimotor control of the task. These results demonstrate that it is possible to deliver effective information through AR feedback in a compact and wearable fashion. This feedback modality may be exploited for delivering sensory feedback to amputees in a clinical scenario.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Internal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685 · cited 1×
“For example, handling objects with different compliances could be used to probe if the AR feedback allows learning an internal model of the GF [35].”
BackgroundCoding and use of tactile signals from the fingertips in object manipulation tasks
Johansson, R. S., & Flanagan, J. R. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2621 · Cited by 2,063
Error Correction, Sensory Prediction, and Adaptation in Motor Control
Shadmehr, R., Smith, M. A., & Krakauer, J. W. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-153135 · Cited by 1,869 · cited 1×
“previous studies [13], [19] as well as in the literature on adaptation in motor control [24].”
BackgroundAugmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416 · cited 1×
“on the feedback, which might be detrimental to the development of an internal motor representation of the task [21].”
BackgroundRestoring natural sensory feedback in real-time bidirectional hand prostheses
Raspopovic, S., Capogrosso, M., Petrini, F. M., Bonizzato, M., Rigosa, J., Di Pino, G., Carpaneto, J., Controzzi, M., Boretius, T., Fernandez, E., et al. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3006820 · Cited by 1,001
Self-citationA neural interface provides long-term stable natural touch perception
Tan, D. W., Schiefer, M. A., Keith, M. W., Anderson, J. R., Tyler, J., & Tyler, D. J. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3008669 · Cited by 751 · cited 1×
“, the afferent nerve fibers) [4]–[7] or noninvasively by stimulating body sites normally not involved in the motor task [8]–[13].”
BackgroundDirect neural sensory feedback and control of a prosthetic arm
Dhillon, G. S., & Horch, K. W. (2005) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2005.856072 · Cited by 573
Ortiz-Catalan, M., Håkansson, B., & Brånemark, R. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3008933 · Cited by 484
Clemente, F., D'Alonzo, M., Controzzi, M., Edin, B. B., & Cipriani, C. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2015.2500586 · Cited by 209 · cited 3×
“previous studies [13], [19] as well as in the literature on adaptation in motor control [24].”
BackgroundSelf-citationClosed-loop control in prosthetic systems: Historical perspective
Childress, D. S. (1980) · Annals of Biomedical Engineering · doi:10.1007/bf02363433 · Cited by 158
Cited by
A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback
D’Anna, E., Valle, G., Mazzoni, A., Strauss, I., Iberite, F., Patton, J., Petrini, F. M., Raspopovic, S., Granata, G., Di Iorio, R., et al. (2019) · Science Robotics · doi:10.1126/scirobotics.aau8892 · Cited by 321
“Sensory substitution (remapping) has been used extensively for restoring other sensory modalities (11) and pioneered by Bach-y-Rita and colleagues (24) with tactile substitution of visual stimuli, including recently using brain implants in nonhuman primates (25, 26) and augmented reality in healthy participants (27, 2…”
BackgroundSelf-citationAugmented Reality for Robotics: A Review
Makhataeva, Z., & Varol, H. (2020) · Robotics · doi:10.3390/robotics9020021 · Cited by 266
A Review of Non-Invasive Sensory Feedback Methods for Transradial Prosthetic Hands
Stephens-Fripp, B., Alici, G., & Mutlu, R. (2018) · IEEE Access · doi:10.1109/access.2018.2791583 · Cited by 210
“[76] also examined the use of augmented reality for sensory feedback for prosthetic devices.”
BackgroundShi, C., Yang, D., Zhao, J., & Liu, H. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.3007625 · Cited by 87
“Besides, by combining the global vision and the AR technology, the state of the prosthetic hand, such as grasp patterns, aperture size, and grasping force [40], [41], can be presented to the user as visual clues, which will greatly expand the bandwidth of the feedback information.”
Method
Metadata
- Authors
- Clemente, F., Dosen, S., Lonini, L., Markovic, M., Farina, D., & Cipriani, C.
- Venue
- IEEE Transactions on Human-Machine Systems
- Published
- 2017-08
- Volume
- 47
- Issue
- 4
- Pages
- 583-589
- ISSN
- 2168-2291 (ISSN-L)
- 2168-2305
- OpenAlex
- W2531630518
- Cited by
- 51
- References
- 10
- FWCI
- 5.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Humans Can Integrate Augmented Reality Feedback in Their Sensorimotor Control of a Robotic Hand. https://app.cochat.ai/papers/10.1109/thms.2016.2611998
- The paper
- Clemente, F., Dosen, S., Lonini, L., Markovic, M., Farina, D., & Cipriani, C. (2017). Humans Can Integrate Augmented Reality Feedback in Their Sensorimotor Control of a Robotic Hand. IEEE Transactions on Human-Machine Systems. https://doi.org/10.1109/thms.2016.2611998
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.