CoChat

Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications

Open access

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

Abstract

A haptic-feedback glove with triboelectric sensors and piezoelectric stimulators is developed for interaction in virtual space.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1126/sciadv.aaz8693

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Schematics of glove-based HMI for diversified applications. (i) Three major functional units: triboelectric finger sensor and (ii) the working principle for (iii) detecting bending motions, triboelectric palm sensor, and (iv) the working principle for (v) detecting sliding motions, as well as piezoelectric haptic mechanical stimulator for (vi) haptic stimulation.
Fig. 1 Schematics of glove-based HMI for diversified applications. (i) Three major functional units: triboelectric finger sensor and (ii) the working principle for (iii) detecting bending motions, triboelectric palm sensor, and (iv) the working principle for (v) detecting sliding motions, as well as piezoelectric haptic mechanical stimulator for (vi) haptic stimulation.CC BY-NC · PubMed Central
Fig. 2 Schematics and characterization of triboelectric finger bending sensors. (A) Designs of finger case of each phalanx, the positions of sensors, and the photo of the PP. (B) Comparison of triboelectric outputs of sensor made by PDMS and Eco-flex. (C) Characterized relationship between the changing loading force and the triboelectric output of sensor under 2-Hz frequency. (D) Variations of triboelectric outputs with different sensor sizes (diameter: 3, 3.5, and 4 mm) for a finger size of (i) 60 mm and (ii) 50 mm in perimeter. (E) Measured triboelectric outputs from eight sensors (DU, DD, MU, MD, PU, PD, PR, and PL) under the bending of (i) DP, (ii) MP, (iii) PP, and (iv) all three phalanges (curling). The dashed boxes indicate the functional signals. (F) Measured triboelectric outputs from four sensors (PU, PD, PR, and PL) under the bending of finger in eight directions: (i) up, down, left, and right and (ii) up + left, up + right, down + left, and down + right. Photo credit: Minglu Zhu, National University of Singapore.
Fig. 2 Schematics and characterization of triboelectric finger bending sensors. (A) Designs of finger case of each phalanx, the positions of sensors, and the photo of the PP. (B) Comparison of triboelectric outputs of sensor made by PDMS and Eco-flex. (C) Characterized relationship between the changing loading force and the triboelectric output of sensor under 2-Hz frequency. (D) Variations of triboelectric outputs with different sensor sizes (diameter: 3, 3.5, and 4 mm) for a finger size of (i) 60 mm and (ii) 50 mm in perimeter. (E) Measured triboelectric outputs from eight sensors (DU, DD, MU, MD, PU, PD, PR, and PL) under the bending of (i) DP, (ii) MP, (iii) PP, and (iv) all three phalanges (curling). The dashed boxes indicate the functional signals. (F) Measured triboelectric outputs from four sensors (PU, PD, PR, and PL) under the bending of finger in eight directions: (i) up, down, left, and right and (ii) up + left, up + right, down + left, and down + right. Photo credit: Minglu Zhu, National University of Singapore.CC BY-NC · PubMed Central
Fig. 3 Demonstrations of finger bending sensing as main functions of HMI. (A) (i) Projection of the motions of PP in virtual space (FPS: 60) and the corresponding positive triboelectric outputs from eight sensors (DD, MD, PD, DU, MU, PU, PL, and PR) on index finger with three distinguishable bending angles (30°, 60°, and 90°) and the following returning motion detected by positive signals of PU for each bending, (ii) projection of the motions of index finger with three phalanges under DP bending, DP + MP bending and DP + MP + PP bending, and the following returning motion detected by positive signals of DU, MU, and PU for each bending, as well as left/right deflection of the PP. The dashed lines and boxes indicate the functional signals. (B) Screenshots of the demonstrations of (i) alphabet writing and (ii) online shopping, (iii) schematics of the detailed procedure of alphabet writing, with photos of finger motions and the corresponding triboelectric output signals for (1) activate dragging, (2) upward writing and stop, (3) down + right writing and stop, (4) upward writing and stop, (5) activate moving, (6) right moving and stop, (7) activate dragging, and (8) downward writing and stop. Photo credit: Minglu Zhu, National University of Singapore.
Fig. 3 Demonstrations of finger bending sensing as main functions of HMI. (A) (i) Projection of the motions of PP in virtual space (FPS: 60) and the corresponding positive triboelectric outputs from eight sensors (DD, MD, PD, DU, MU, PU, PL, and PR) on index finger with three distinguishable bending angles (30°, 60°, and 90°) and the following returning motion detected by positive signals of PU for each bending, (ii) projection of the motions of index finger with three phalanges under DP bending, DP + MP bending and DP + MP + PP bending, and the following returning motion detected by positive signals of DU, MU, and PU for each bending, as well as left/right deflection of the PP. The dashed lines and boxes indicate the functional signals. (B) Screenshots of the demonstrations of (i) alphabet writing and (ii) online shopping, (iii) schematics of the detailed procedure of alphabet writing, with photos of finger motions and the corresponding triboelectric output signals for (1) activate dragging, (2) upward writing and stop, (3) down + right writing and stop, (4) upward writing and stop, (5) activate moving, (6) right moving and stop, (7) activate dragging, and (8) downward writing and stop. Photo credit: Minglu Zhu, National University of Singapore.CC BY-NC · PubMed Central
Fig. 4 Triboelectric palm sensor and piezoelectric haptic stimulator. (A) Design and photo of as-fabricated palm sensor. (B) Characterization of the output against the loading force from a single electrode at 2 Hz. (C) Measured triboelectric outputs from four electrodes for sliding in eight directions: (i) up, down, forward, and backward and (ii) down + forward, up + backward, down + backward, and up + forward. The activated signals are in dashed boxes. (D) Control of virtual hand 793 by interacting with external objects in eight directions. (E) Design and photo of PZT haptic stimulator. (F) Measured stimulation using second PZT chip for tunable input AC power (6, 8, and 10 V) at 270 Hz. (G) Demonstration of real-time haptic feedback in response to the interactive event in Unity, with the measured mechanical stimulation. (H to K) Integrated demonstration in baseball gaming program. The illustrations of (H) grabbing bat, (I) light strike, and (J) heavy strike with (i) screenshots of real-time demonstration in Unity, (ii) measured haptic stimulation induced by the piezoelectric stimulator, (iii) measured triboelectric outputs from the palm sensor, and (iv) the intensity of interactive force exerted on each electrode and the shear force direction. (K) Flow chart for the operation of baseball program. Photo credit: Minglu Zhu, National University of Singapore.
Fig. 4 Triboelectric palm sensor and piezoelectric haptic stimulator. (A) Design and photo of as-fabricated palm sensor. (B) Characterization of the output against the loading force from a single electrode at 2 Hz. (C) Measured triboelectric outputs from four electrodes for sliding in eight directions: (i) up, down, forward, and backward and (ii) down + forward, up + backward, down + backward, and up + forward. The activated signals are in dashed boxes. (D) Control of virtual hand 793 by interacting with external objects in eight directions. (E) Design and photo of PZT haptic stimulator. (F) Measured stimulation using second PZT chip for tunable input AC power (6, 8, and 10 V) at 270 Hz. (G) Demonstration of real-time haptic feedback in response to the interactive event in Unity, with the measured mechanical stimulation. (H to K) Integrated demonstration in baseball gaming program. The illustrations of (H) grabbing bat, (I) light strike, and (J) heavy strike with (i) screenshots of real-time demonstration in Unity, (ii) measured haptic stimulation induced by the piezoelectric stimulator, (iii) measured triboelectric outputs from the palm sensor, and (iv) the intensity of interactive force exerted on each electrode and the shear force direction. (K) Flow chart for the operation of baseball program. Photo credit: Minglu Zhu, National University of Singapore.CC BY-NC · PubMed Central
Fig. 5 Triboelectric output–based object recognition using machine learning technique. (A) Schematics of the process and parameters for constructing the CNN. (B) Corresponding triboelectric outputs from 16 sensors: thumb (DD and DU), index finger (DD, MD, PD, and DU), middle finger (DD, MD, and PD), ring finger (DD, MD, and PD), pinky finger (DD, MD, and PD), and palm (single electrode), during the grabbing of six objects, including rod, cube, disk, curved, pyramid, and small cube. The solid boxes indicate the featured pattern for the training of recognition. (C) Confusion maps of object recognition derived from two models made by (i) CNN and (ii) SVM, with 100 tests for each object and 40 tests for the baseline; output class refers to the recognized results, and target class refers to the true objects. Photo credit: Minglu Zhu, National University of Singapore.
Fig. 5 Triboelectric output–based object recognition using machine learning technique. (A) Schematics of the process and parameters for constructing the CNN. (B) Corresponding triboelectric outputs from 16 sensors: thumb (DD and DU), index finger (DD, MD, PD, and DU), middle finger (DD, MD, and PD), ring finger (DD, MD, and PD), pinky finger (DD, MD, and PD), and palm (single electrode), during the grabbing of six objects, including rod, cube, disk, curved, pyramid, and small cube. The solid boxes indicate the featured pattern for the training of recognition. (C) Confusion maps of object recognition derived from two models made by (i) CNN and (ii) SVM, with 100 tests for each object and 40 tests for the baseline; output class refers to the recognized results, and target class refers to the true objects. Photo credit: Minglu Zhu, National University of Singapore.CC BY-NC · PubMed Central
Fig. 6 Integrated demonstration in VR/AR applications. (A) Illustration of functions for the as-fabricated gloves under control mode and recognition mode. (B) Universal applications on diversified scenarios. Augmented interactions for various VR training programs and social activities using the glove-based HMI. (C) Surgical training program: Photos and screenshots of the finger motions for realizing (I) mode switching, (II and III) motions of right hand, (IV) display of left hand, (V) recognition of scissors, (VI) recognition of knife, (VII) recognition of gauze, (VIII) operation of scissors (cutting), (IX) operation of knife (cutting), and (X) operation of gauze (swiping). (D) Measured triboelectric outputs from eight sensors: thumb (DD and DU), index finger (DD and DU), middle finger (DD and DU), and ring finger (DD and DU) under (i) control mode, and triboelectric outputs from 16 sensors: thumb (DD and DU), index finger (DD, MD, PD and DU), middle finger (DD, MD, and PD), ring finger (DD, MD, and PD), pinky finger (DD, MD, and PD), and palm (single electrode), under (ii) recognition mode for the motions of grabbing scissors, knife, and gauze. Photo credit: Minglu Zhu, National University of Singapore.
Fig. 6 Integrated demonstration in VR/AR applications. (A) Illustration of functions for the as-fabricated gloves under control mode and recognition mode. (B) Universal applications on diversified scenarios. Augmented interactions for various VR training programs and social activities using the glove-based HMI. (C) Surgical training program: Photos and screenshots of the finger motions for realizing (I) mode switching, (II and III) motions of right hand, (IV) display of left hand, (V) recognition of scissors, (VI) recognition of knife, (VII) recognition of gauze, (VIII) operation of scissors (cutting), (IX) operation of knife (cutting), and (X) operation of gauze (swiping). (D) Measured triboelectric outputs from eight sensors: thumb (DD and DU), index finger (DD and DU), middle finger (DD and DU), and ring finger (DD and DU) under (i) control mode, and triboelectric outputs from 16 sensors: thumb (DD and DU), index finger (DD, MD, PD and DU), middle finger (DD, MD, and PD), ring finger (DD, MD, and PD), pinky finger (DD, MD, and PD), and palm (single electrode), under (ii) recognition mode for the motions of grabbing scissors, knife, and gauze. Photo credit: Minglu Zhu, National University of Singapore.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 40 references

Cited by

Metadata

Authors
Zhu, M., Sun, Z., Zhang, Z., Shi, Q., He, T., Liu, H., Chen, T., & Lee, C.
Affiliations
  • National University of Singapore (SG)
  • Soochow University (CN)
Corresponding author
  • Chen, Tao
  • Lee, Chengkuo
Venue
Science Advances
Published
2020-05-08
Volume
6
Issue
19
Pages
eaaz8693-eaaz8693
ISSN
2375-2548 (ISSN-L)
OpenAlex
W3022965290
Cited by
784
References
40
Citations by year
2026: 96 · 2025: 132 · 2024: 154 · 2023: 144 · 2022: 136 · 2021: 99 · 2020: 23
FWCI
31.58
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • Science Advances (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • National University of Singapore (submittedVersion)
Funders
  • HIFES Seed Funding (R-263-501-012-133)
  • Agency for Science, Technology and Research (A*STAR), Singapore and Narodowe Centrum Badańi Rozwoju (NCBR), Poland Joint Grant (R-263-000-C91-305)
  • National Research Funding - Competitive Research Programme (R-719-000-001-281)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Advanced Sensor and Energy Harvesting Materials
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
Keywords
haptic feedback, smart glove, human-machine interaction, triboelectric sensors, finger bending detection, piezoelectric actuators, haptic stimulation, object recognition, virtual reality, augmented reality, low-cost wearable sensing, hand gesture recognition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.