A Voice-Input Voice-Output Communication Aid for People With Severe Speech Impairment
The DOI matches its Crossref record; 25 of the 27 references it cites were found in a registry or an index.
Abstract
A new form of augmentative and alternative communication (AAC) device for people with severe speech impairment-the voice-input voice-output communication aid (VIVOCA)-is described. The VIVOCA recognizes the disordered speech of the user and builds messages, which are converted into synthetic speech. System development was carried out employing user-centered design and development methods, which identified and refined key requirements for the device. A novel methodology for building small vocabulary, speaker-dependent automatic speech recognizers with reduced amounts of training data, was applied. Experiments showed that this method is successful in generating good recognition performance (mean accuracy 96%) on highly disordered speech, even when recognition perplexity is increased. The selected message-building technique traded off various factors including speed of message construction and range of available message outputs. The VIVOCA was evaluated in a field trial by individuals with moderate to severe dysarthria and confirmed that they can make use of the device to produce intelligible speech output from disordered speech input. The trial highlighted some issues which limit the performance and usability of the device when applied in real usage situations, with mean recognition accuracy of 67% in these circumstances. These limitations will be addressed in future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For this speaker with severe dysarthria and global aphasia, a speaker-dependent ASR therefore functions as an amplifier of intelligibility, supporting more reliable communication in everyday contexts (17, 18).”
From Case Report: Tailored automatic speech recognition in global aphasia with dysarthria - a single case proof of concept (2026) · cites this paper as [17]
Experimental — accuracy not yet measuredIn the citing paper
“Yet, the accuracy of their methodology for the speech recognition is only 67% for real-life study which comprises nine persons.”
From Applications of Artificial Intelligence and Big Data Analytics in m-Health: A Healthcare System Perspective (2020) · cites this paper as [98]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775 · cited 1×
“This is determined from the log probability of the model generating the word by the most likely path (computed by the Viterbi algorithm) [17], [18].”
MethodGaze and eye contact: a research review
Kleinke, C. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.100.1.78 · Cited by 1,455 · cited 1×
“Consequently, they can be difficult to use and tiring for many users, and they do not readily facilitate natural communication as they are relatively slow and disrupt eye contact [3].”
BackgroundFrenchay Dysarthria Assessment
Enderby, P. (1980) · International Journal of Language & Communication Disorders · doi:10.3109/13682828009112541 · Cited by 588
Self-citationThe handbook of augmentative and alternative communication
Glennen, S. L., & DeCoste, D. C. (1997) · Singular Pub. Group eBooks · Cited by 302
Festival Speech Synthesis System
Black, A. W., Taylor, P., & Caley, R. (2000) · Americanae (AECID Library) · Cited by 204
Flite: a small fast run-time synthesis engine.
Black, A. W., & Lenzo, K. (2001) · Cited by 122
A speech-controlled environmental control system for people with severe dysarthria
Hawley, M. S., Enderby, P., Green, P., Cunningham, S., Brownsell, S., Carmichael, J., Parker, M., Hatzis, A., O’Neill, P., & Palmer, R. (2007) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2006.06.009 · Cited by 103 · cited 7×
“These enhancements resulted in speech recognition being a viable means of controlling assistive technology for small input vocabularies, even for people with severe speech disorders [13].”
BackgroundMethodResultInfluentialSelf-citationMurphy, J. (2004) · Augmentative and Alternative Communication · doi:10.1080/07434610400005663 · Cited by 93 · cited 1×
“Many people with VOCAs often prefer to speak rather than use the aid, even if their speech is largely unintelligible, as it is a more natural form of communication [5].”
BackgroundAutomatic speech recognition with sparse training data for dysarthric speakers
Green, P., Carmichael, J., Hatzis, A., Enderby, P., Hawley, M., & Parker, M. (2003) · 8th European Conference on Speech Communication and Technology (Eurospeech 2003) · doi:10.21437/eurospeech.2003-384 · Cited by 87 · cited 2×
“This is determined from the log probability of the model generating the word by the most likely path (computed by the Viterbi algorithm) [17], [18].”
BackgroundMethodSelf-citationWisenburn, B., & Higginbotham, D. J. (2008) · Augmentative and Alternative Communication · doi:10.1080/07434610701740448 · Cited by 80 · cited 1×
“botham who explored the potential for using speech recognition in a VOCA to recognize the speech of a conversation partner [11], [12].”
BackgroundFerrier, L., Shane, H., Ballard, H., Carpenter, T., & Benoit, A. (1995) · Augmentative and Alternative Communication · doi:10.1080/07434619512331277289 · Cited by 78 · cited 2×
“Moreover, the small-scale laboratory experiments reported in [7], [8] do not represent the range of environmental conditions that are likely to be encountered in realistic usage, which is known to degrade recognition accuracy.”
BackgroundWhole Utterance Approaches in AAC
Todman, J., Alm, N. A., Higginbotham, D. J., & File, P. E. (2008) · Augmentative and Alternative Communication · doi:10.1080/08990220802388271 · Cited by 76 · cited 1×
“[6], found that listeners rated users of a communication aid as more socially competent if they had a more rapid rate of delivery.”
BackgroundRate and quality of conversations using a text-storage AAC system: Single-case training study
Todman, J. (2000) · Augmentative and Alternative Communication · doi:10.1080/07434610012331279024 · Cited by 69 · cited 1×
“One of the key considerations is the speed at which people are able to communicate [23].”
BackgroundO'Keefe, B. M., Kozak, N. B., & Schuller, R. (2007) · Augmentative and Alternative Communication · doi:10.1080/07434610601116517 · Cited by 65 · cited 1×
“[4] report that users need a device which is physically easy to operate in a wide range of positions and environments.”
BackgroundDoes Speech and Language Therapy Work
Emerson, J., & Enderby, P. (1995) · Cited by 61
Self-citationAugmentative and Alternative Communication
Dyczko, M. J. J., & Jones, N. L. (2004) · BRILL eBooks · doi:10.1163/9780080475974_013 · Cited by 55
Parker, M., Cunningham, S., Enderby, P., Hawley, M., & Green, P. (2006) · Clinical Linguistics & Phonetics · doi:10.1080/02699200400026884 · Cited by 52 · cited 1×
“Previous studies have shown that both listening to their previous best attempt, and repeated practice can have a beneficial effect in stabilizing the target utterance [19], and this has the additional benefit of providing additional training examples for retraining recognition models [20].”
BackgroundSelf-citationState-Transition Interpolation and MAP Adaptation for HMM-based Dysarthric Speech Recognition
Sharma, H. V., & Hasegawa‐Johnson, M. (2010) · Cited by 50
Thomas-Stonell, N., Kotler, A.-L., Leeper, H., & Doyle, P. (1998) · Augmentative and Alternative Communication · doi:10.1080/07434619812331278196 · Cited by 46
Wisenburn, B., & Higginbotham, D. J. (2009) · Augmentative and Alternative Communication · doi:10.1080/07434610902739876 · Cited by 29 · cited 1×
“botham who explored the potential for using speech recognition in a VOCA to recognize the speech of a conversation partner [11], [12].”
BackgroundThe Effect of Three Practice Conditions on the Consistency of Chronic Dysarthric Speech
Palmer, R., Enderby, P., & Cunningham, S. P. (2004) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 26
Self-citationSpeech Recognition and Synthesis
(2000) · CRC Press eBooks · doi:10.1201/9781420036879-13 · Cited by 16
A voice input voice output communication aid: what do users and therapists require?
Palmer, R., Enderby, P., & Hawley, M. (2010) · Journal of Assistive Technologies · doi:10.5042/jat.2010.0277 · Cited by 15 · cited 1×
“speech and language therapists/pathologists who provide voiceoutput communication aids [15].”
BackgroundSelf-citationHawley, M., Cunningham, S. P., Cardinaux, F., Coy, A., O'Neill, P., Seghal, S., & Enderby, P. (2007) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 13
Self-citationA system for recognition and translation of the speech of handicapped individuals
Sandler, U., & Sonnenblick, Y. (2002) · IEEE Mediterranean Electrotechnical Conference (MELECON) · doi:10.1109/melcon.1998.692166 · Cited by 9 · cited 1×
“Previous prototypes of voice-input voiceoutput communication aids (VIVOCAs) have been reported, but have not been tested extensively with users or reached the stage of becoming available as commercial products [9], [10].”
Background
Research works printed but not linked: 2
- [16] S. Young et al. , Cambridge University Engineering Department The HTK book, 2006. -
- [9] R. N. Bloor, K. Barrett, and C. Geldard, 'The clinical application of microcomputers in the treatment of patients with severe speech dysfunction,' IEE Colloquium High-Tech Help Handicapped , pp. 9/1-9/2, 1990. -
Cited by
Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature
Triantafyllidis, A. K., & Tsanas, A. (2019) · Journal of Medical Internet Research · doi:10.2196/12286 · Cited by 243
“On the basis of the EPHPP criteria for selection bias, design, confounders, blinding, data collection, and dropouts, we found the methodological quality to be moderate for 2 of the 8 (25%) studies [21,22] and weak for the remaining 6 (75%) studies [23-28] (Table 1).”
BackgroundMethodResultInfluentialA survey on health monitoring systems for health smart homes
Mshali, H., Lemlouma, T., Moloney, M., & Magoni, D. (2018) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2018.02.002 · Cited by 239
“…compensating for any impaired movement of smart wheelchairs [169], developing customizable speech recognition interfaces for speech impairment [170], etc. Basically, AAL systems are designed for monitoring and evaluating subject activity and for maintaining health-care service quality for…”
Backgroundkhan, Z. F., & Alotaibi, S. R. (2020) · Journal of Healthcare Engineering · doi:10.1155/2020/8894694 · Cited by 235
“[98] proposed an application of automated machine in the recognition of speech of persons who are affected with dysarthria.”
Xiong, F., Barker, J., & Christensen, H. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683091 · Cited by 78
“At the same time, since dysarthria is often associated with severe physical disabilities like cerebral palsy, for this group of people, speech-enabled and hands-free interfaces often provide a more attractive and efficient means of access in comparison to hardwired switches, keyboards and remote controls [2, 3, 4, 5,…”
BackgroundInvestigation of Data Augmentation Techniques for Disordered Speech Recognition
Geng, M., Xie, X., Liu, S., Yu, J., Hu, S., Liu, X., & Meng, H. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1161 · Cited by 55
“Meanwhile, as speech disorders always come together with loss of abilities in physical motion, there is a popular demand of hands-free and speech-enabled assistive technologies to help such people [7, 8].”
Background
Metadata
- Authors
- Hawley, M. S., Cunningham, S. P., Green, P. D., Enderby, P., Palmer, R., Sehgal, S., & O'Neill, P.
- Affiliations
- University of Sheffield (GB)
- Barnsley Hospital NHS Foundation Trust (GB)
- Venue
- IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Published
- 2013-01
- Volume
- 21
- Issue
- 1
- Pages
- 23-31
- ISSN
- 1534-4320 (ISSN-L)
- 1558-0210
- OpenAlex
- W2073393345
- Cited by
- 110
- References
- 27
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 11 · 2023: 11 · 2022: 10 · 2021: 9 · 2020: 8 · 2019: 13 · 2018: 7 · 2017: 6 · 2016: 5 · 2015: 10 · 2014: 11 · 2013: 1
- FWCI
- 21.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Neural Systems and Rehabilitation Engineering (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Funders
- National Institute for Health and Care Research (HTD 553)
- Topics
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- augmentative and alternative communication, severe speech impairment, dysarthria, limited training data, speech synthesis, user-centered design, assistive technology
- MeSH terms
- Adult, Aged, Aged, 80 and over, Artificial Intelligence, Communication Devices for People with Disabilities, Equipment Design, Female, Humans, Male, Middle Aged, Sound Spectrography, Speech Disorders, Speech Production Measurement, Treatment Outcome, Vocabulary, Controlled, Equipment Failure Analysis, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.