Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Glove-Talk II is a system which translates hand gestures to speech through an adaptive interface. Hand gestures are mapped continuously to ten control parameters of a parallel formant speech synthesizer. The mapping allows the hand to act as an artificial vocal tract that produces speech in real time. This gives an unlimited vocabulary in addition to direct control of fundamental frequency and volume. Currently, the best version of Glove-Talk II uses several input devices, a parallel formant speech synthesizer, and three neural networks. The gesture-to-speech task is divided into vowel and consonant production by using a gating network to weight the outputs of a vowel and a consonant neural network. The gating network and the consonant network are trained with examples from the user. The vowel network implements a fixed user-defined relationship between hand position and vowel sound and does not require any training examples from the user. Volume, fundamental frequency, and stop consonants are produced with a fixed mapping from the input devices. With Glove-Talk II, the subject can speak slowly but with far more natural sounding pitch variations than a text-to-speech synthesizer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citation
Cited by
A Survey of Glove-Based Systems and Their Applications
Dipietro, L., Sabatini, A. M., & Dario, P. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.923862 · Cited by 691
Extraction of 2D motion trajectories and its application to hand gesture recognition
Yang, M.-H., Ahuja, N., & Tabb, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1023803 · Cited by 353
A low cost instrumented glove for extended monitoring and functional hand assessment
Simone, L. K., Sundarrajan, N., Luo, X., Jia, Y., & Kamper, D. G. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2006.09.021 · Cited by 154
“…Mehdi and Khan (2002) reported 8% accuracy using a neural network model on inputs from a -sensor glove (1 bend sensor for each finger, plus hand tilt and and rotation), and Fels and Hinton (1997) used eight flexion ngles, thumb abduction and thumb rotation to translate hand estures to speech.”
MethodMapping transparency through metaphor: towards more expressive musical instruments
Fels, S., Gadd, A., & Mulder, A. (2002) · Organised Sound · doi:10.1017/s1355771802002042 · Cited by 124
“most expressive ca pacity of humans in b oth content and form. In Glove-TalkII [ 7 ] we”
BackgroundSelf-citationSonimime: Movement Sonification For Real-Time Timbre Shaping
Fox, J., & Carlile, J. (2005) · Zenodo · doi:10.5281/zenodo.1176740 · Cited by 3
Metadata
- Authors
- Fels, S. S., & Hinton, G. E.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 1998
- Volume
- 9
- Issue
- 1
- Pages
- 205-212
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2158233635
- Cited by
- 138
- References
- 1
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.