Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index; 2 of the 59 sources its claims cite were checked for support.

Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study

Open access
Gonzalez, Jose, Soma, Hirokazu, Sekine, Masashi, Yu, Wenwei · 2012 · Journal of NeuroEngineering and Rehabilitation

Abstract

BACKGROUND: Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user's mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. METHODS: 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject's EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. RESULTS: The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. CONCLUSIONS: The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual "pop-out" or enhance effect. Also, the NASA TLX, the EEG's Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications.

Overview

CoChat Summary

## TL;DR

This preliminary study tested whether psycho-physiological measures can assess mental effort while manipulating a prosthetic-style robot hand with auditory, visual, or audiovisual feedback. The audiovisual condition produced the best performance and the lowest perceived/physiological workload, suggesting auditory cues added to vision reduced attentional demand.

## Key findings

  • Trial duration differed by modality: VF was significantly longer than AVF (p = 0.023), while VF vs AF was not significant (p = 0.22).
  • Error detection/fix time was significantly worse in VF than in AF and AVF (both p < 0.001); AF vs AVF was not significant (p = 0.478).
  • Grasping performance also differed: finger flexion in VF was significantly different from both AF and AVF (both p = 0.001), and AF vs AVF was not significant (p = 0.48); the paper says the task required about 60% flexion for a complete grasp.
  • NASA TLX, EEG alpha suppression, and heart rate all pointed to AVF as least demanding; after excluding Subjects 1 and 8 as outliers, the NASA TLX effect was significant, F(1.8,12.9) = 7.954, p = 0.006, and EEG alpha showed significant modality effects, F(1.27,75.2) = 14.06, p < 0.001.
  • Heart rate decelerated in all modalities, with a significant modality effect, F(1.7,133.6) = 6.944, p = 0.002; respiration increased most in AF and EDA showed no significant effect.

## Methods

  • Preliminary within-subject experiment with 10 male, right-handed subjects aged 22–30, tested over 2 consecutive days; they received 30 minutes of guided training on day 1 and completed 10 trials per modality on day 2.
  • Three feedback conditions were compared: auditory feedback only (AF), visual feedback only (VF), and audiovisual feedback (AVF). Participants performed open-close-open grasping motions on a tendon-driven robot hand; the study sampled thumb, pointer, and middle finger motion at 40 Hz.
  • Outcomes included trial duration, error detection/fix time, grasp flexion, NASA TLX, EEG alpha/beta power, ECG heart rate/HRV, EDA, and respiration. Analysis used repeated-measures ANOVA in SPSS with Greenhouse-Geisser correction.

## Limitations

  • The paper explicitly calls the study “preliminary” and says the task was static; it states results may not generalize to daily-life use, longer-term use, fatigue, or more complex dynamic tasks.
  • Only 9 subjects were analyzed for psycho-physiological signals because of contamination, and only 7 were used for EDA because of a transducer problem.
  • The paper itself notes that the task may have been too simple to elicit strong EDA activity, and that using only 1 EEG channel gives limited resolution; it also says at least 2 to 4 channels would be better.
  • Evident from the text: the sample was small and all-male, and the findings are based on able-bodied participants rather than amputees (the study did not test prosthetic users).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/1743-0003-9-33

Cites

60 of 60 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Experiment setting. a) Subject’s perspective of the robot hand during the experiment. The task was to grasp a bottle with the prosthetic hand. b) View of the whole experiment setting. The subject used a Data Glove to control the robot hand motion and bending sensors in the robot hand fingers were used to produce the auditory feedback cues.
Figure 1 Experiment setting. a) Subject’s perspective of the robot hand during the experiment. The task was to grasp a bottle with the prosthetic hand. b) View of the whole experiment setting. The subject used a Data Glove to control the robot hand motion and bending sensors in the robot hand fingers were used to produce the auditory feedback cues.CC BY · PubMed Central
Figure 2 Experiment setting block diagram. The subjects controlled the robot hand’s motion using a Data Glove. The different profiles of the robot hand movements were mapped to sounds and conveyed back to the subjects. During tests, the experimenter forced one of the robot hand’s fingers to stop moving, which generated an error signal that was conveyed back to the subject as an auditory icon.
Figure 2 Experiment setting block diagram. The subjects controlled the robot hand’s motion using a Data Glove. The different profiles of the robot hand movements were mapped to sounds and conveyed back to the subjects. During tests, the experimenter forced one of the robot hand’s fingers to stop moving, which generated an error signal that was conveyed back to the subject as an auditory icon.CC BY · PubMed Central
Figure 3 Temporal performance results. a) Trial Duration. It can be noted that the trial duration was lower when the auditory and the visual feedback was used simultaneously. b) Duration to detect and fix an error. An error was detected and fixed faster when the auditory display was used.
Figure 3 Temporal performance results. a) Trial Duration. It can be noted that the trial duration was lower when the auditory and the visual feedback was used simultaneously. b) Duration to detect and fix an error. An error was detected and fixed faster when the auditory display was used.CC BY · PubMed Central
Figure 4 Finger flexure results. The finger flexure was measured as a percentage value where 0% indicated a fully open hand pose and 100% indicated a fully closed hand pose (e.g. fist). From the results it can be noted that the Auditory feedback allowed the subject to know more accurately when the bottle was completely grasped.
Figure 4 Finger flexure results. The finger flexure was measured as a percentage value where 0% indicated a fully open hand pose and 100% indicated a fully closed hand pose (e.g. fist). From the results it can be noted that the Auditory feedback allowed the subject to know more accurately when the bottle was completely grasped.CC BY · PubMed Central
Figure 5 NASA TLX scores. The NASA TLX mean scores showed that, in general, the VF modality was ranked with the highest mental workload, followed very closely by the AF modality when manipulating the prosthetic device.
Figure 5 NASA TLX scores. The NASA TLX mean scores showed that, in general, the VF modality was ranked with the highest mental workload, followed very closely by the AF modality when manipulating the prosthetic device.CC BY · PubMed Central
Figure 6 NASA TLX scores without outliers. a) Subject 1 and Subject 8 were the only ones that reported that the mental effort in the VF modality was lower than in the other 2 modalities, which were considered to be similarly difficult. b) Considering Subject 1 and Subject 8 as outliers, the results showed the same tendency, but with a significant effect between modalities.
Figure 6 NASA TLX scores without outliers. a) Subject 1 and Subject 8 were the only ones that reported that the mental effort in the VF modality was lower than in the other 2 modalities, which were considered to be similarly difficult. b) Considering Subject 1 and Subject 8 as outliers, the results showed the same tendency, but with a significant effect between modalities.CC BY · PubMed Central
Figure 7 EEG results. a) The EEG mean power spectra of the Alpha and Beta band of each modality for all subjects. A higher Alpha suppression was found for the VF modality. b) When considering Subject 1 and 8 as outliers, we found a significantly statistical effect between the modalities. These results points out a higher attentional demand in the VF modality.
Figure 7 EEG results. a) The EEG mean power spectra of the Alpha and Beta band of each modality for all subjects. A higher Alpha suppression was found for the VF modality. b) When considering Subject 1 and 8 as outliers, we found a significantly statistical effect between the modalities. These results points out a higher attentional demand in the VF modality.CC BY · PubMed Central
Figure 8 ECG results. The VF modality showed the lowest deceleration of all the groups, followed very closely by the AF modality, while the AVF showed the highest deceleration. Which points out a lower mental effort and more focused attention in the AVF modality.
Figure 8 ECG results. The VF modality showed the lowest deceleration of all the groups, followed very closely by the AF modality, while the AVF showed the highest deceleration. Which points out a lower mental effort and more focused attention in the AVF modality.CC BY · PubMed Central
Figure 9 Attentional model. Sensory information is integrated, enhancing or reducing the attention to a specific task. Then, this information is processed in order to understand the meaning of the sensory input and to decide what actions should be taken. Long term memory wasn’t taken in consideration in this study.
Figure 9 Attentional model. Sensory information is integrated, enhancing or reducing the attention to a specific task. Then, this information is processed in order to understand the meaning of the sensory input and to decide what actions should be taken. Long term memory wasn’t taken in consideration in this study.CC BY · PubMed Central

Verification

Claims the paper makes

0 Valid · 2 Not valid · 27 Not checked · 89 Own results and interpretations

61 more claims

Create a free account to see all 118 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 24
  • It may state two separate claims as one. 34
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • ConsistentF(1.9, 135) = 184.99reported p < .01 · recomputed p < .001

    “F(1.9,135) = 184.99, p < .01”

  • ConsistentF(1.4, 105) = 6.455reported p = .006 · recomputed p = .006

    “F(1.4,105)=6.455, p = .006”

2 of 2

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 60 references

Cited by

See all 87

Metadata

Authors
Gonzalez, J., Soma, H., Sekine, M., & Yu, W.
Affiliations
Chiba University (JP)
Venue
Journal of NeuroEngineering and Rehabilitation
Published
2012
Volume
9
Issue
1
Pages
33
ISSN
1743-0003 (ISSN-L)
OpenAlex
W2146050353
Cited by
87
References
60
Citations by year
2026: 3 · 2025: 4 · 2024: 5 · 2023: 13 · 2022: 5 · 2021: 8 · 2020: 6 · 2019: 5 · 2018: 7 · 2017: 5 · 2016: 8 · 2015: 8 · 2014: 7 · 2013: 3
FWCI
3.28
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of NeuroEngineering and Rehabilitation (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Japan Society for the Promotion of Science (23300206)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Prosthetics and Rehabilitation Robotics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Engineering › Biomedical Engineering › Muscle activation and electromyography studies
Keywords
prosthetic hand, sensory substitution, auditory feedback, robotic hand, multimodal feedback, cognitive effort, cognitive load, NASA-TLX, heart rate, electrodermal activity, respiration rate, grasping performance, temporal performance, visual feedback, attention
MeSH terms
Acoustic Stimulation, Adult, Artificial Limbs, Cognition, Electrocardiography, Electroencephalography, Feasibility Studies, Galvanic Skin Response, Hand, Heart Rate, Humans, Male, Mental Processes, Prosthesis Design, Psychomotor Performance, Psychophysiology, Surveys and Questionnaires, Robotics, Self-Assessment, Hand Strength, Young Adult, Respiratory Rate, Feedback, Sensory

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study. https://app.cochat.ai/papers/10.1186/1743-0003-9-33
The paper
Gonzalez, J., Soma, H., Sekine, M., & Yu, W. (2012). Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study. Journal of NeuroEngineering and Rehabilitation. https://doi.org/10.1186/1743-0003-9-33

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.