The DOI matches its Crossref record; 69 of the 70 references it cites were found in a registry or an index.
Speech Interaction with Personal Assistive Robots Supporting Aging at Home for Individuals with Alzheimer’s Disease
Abstract
Increases in the prevalence of dementia and Alzheimer’s disease (AD) are a growing challenge in many nations where healthcare infrastructures are ill-prepared for the upcoming demand for personal caregiving. To help individuals with AD live at home for longer, we are developing a mobile robot, called ED, intended to assist with activities of daily living through visual monitoring and verbal prompts in cases of difficulty. In a series of experiments, we study speech-based interactions between ED and each of 10 older adults with AD as the latter complete daily tasks in a simulated home environment. Traditional automatic speech recognition is evaluated in this environment, along with rates of verbal behaviors that indicate confusion or trouble with the conversation. Analysis reveals that speech recognition remains a challenge in this setup, especially during household tasks with individuals with AD. Across the verbal behaviors that indicate confusion, older adults with AD are very likely to simply ignore the robot, which accounts for over 40% of all such behaviors when interacting with the robot. This work provides a baseline assessment of the types of technical and communicative challenges that will need to be overcome for robots to be used effectively in the home for speech-based assistance with daily living.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, patients with Alzheimer disease experience difficulties interacting with a voice-controlled robot because of the timing imposed by the device [21].”
From Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study (2020) · cites this paper as [21]
In the citing paper
“However, conversations with individuals with dementia are often subject to communication breakdowns and misunderstanding [33], which complicates the task for an artificial system.”
From A Conversational Robot for Older Adults with Alzheimer's Disease (2020) · cites this paper as [33]
In the citing paper
“Prior work also finds that the timeout period for speech input is often inadequate for people with Alzheimer's [34] and intellectual disabilities [3].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [34]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR)
American Psychiatric Association (2000) · doi:10.1176/appi.books.9780890423349 · Cited by 11,069
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
The Preference for Self-Correction in the Organization of Repair in Conversation
Schegloff, E. A., Jefferson, G., & Sacks, H. (1977) · Language · doi:10.2307/413107 · Cited by 5,150
Speech enhancement using a minimum mean-square error log-spectral amplitude estimator
Ephraim, Y., & Malah, D. (1985) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1985.1164550 · Cited by 3,723
Proceedings. 1985 IEEE International Conference on Robotics and Automation
(1985) · doi:10.1109/robot.1985 · Cited by 3,673
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078
Human–Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2008) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000005 · Cited by 1,541
Proceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting
(2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631171 · Cited by 1,432
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Nass, R. (1984) · Annals of Neurology · doi:10.1002/ana.410160524 · Cited by 1,066
Schlosberg, H. (1954) · Psychological Review · doi:10.1037/h0054570 · Cited by 1,057
Proceedings of Interspeech 2013
Lu, L., Ghoshal, A. K., & Renals, S. J. (2013) · Proceedings - International Symposium on Computer Architecture/Proceedings · Cited by 1,003
How bodies matter: five themes for interaction design
Klemmer, S. R., Hartmann, B., & Takayama, L. (2006) · Proceedings of the 6th conference on Designing Interactive systems · doi:10.1145/1142405.1142429 · Cited by 645 · cited 2×
“Receiving assistance from an entity with a physical body (such as a robot) is often psychologically more acceptable than receiving assistance from an entity without a physical body (such as an embedded system) [Klemmer et al. 2006].”
BackgroundMethodYoung, S. J., Evermann, G., Gales, M., Kershaw, D., Moore, G. L., Odell, J. J., Ollason, D., Povey, D., Valtchev, & Woodland, P. (2006) · Cambridge University Engineering Department Publications Database · Cited by 619
HUMAN–ROBOT COLLABORATION: A SURVEY
BAUER, A., WOLLHERR, D., & BUSS, M. (2008) · International Journal of Humanoid Robotics · doi:10.1142/s0219843608001303 · Cited by 493
Spoken Language Derived Measures for Detecting Mild Cognitive Impairment
Roark, B., Mitchell, M., Hosom, J.-P., Hollingshead, K., & Kaye, J. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2112351 · Cited by 355
Bharucha, A. J., Anand, V., Forlizzi, J., Dew, M. A., Reynolds, C. F., Stevens, S., & Wactlar, H. (2009) · The American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e318187dde5 · Cited by 350
Mihailidis, A., Boger, J. N., Craig, T., & Hoey, J. (2008) · BMC Geriatrics · doi:10.1186/1471-2318-8-28 · Cited by 345
Self-citationHuman-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design
Green, S. A., Billinghurst, M., Chen, X., & Chase, J. G. (2008) · International Journal of Advanced Robotic Systems · doi:10.5772/5664 · Cited by 306
Measurement of trust in human-robot collaboration
Freedy, A., DeVisser, E., Weltman, G., & Coeyman, N. (2007) · 2007 International Symposium on Collaborative Technologies and Systems · doi:10.1109/cts.2007.4621745 · Cited by 295
Lee, T., & Mihailidis, A. (2005) · Journal of Telemedicine and Telecare · doi:10.1258/1357633054068946 · Cited by 237
Self-citationAware technologies for aging in place: understanding user needs and attitudes
Mynatt, E. D., Melenhorst, A.-S., Fisk, A.-D., & Rogers, W. A. (2004) · IEEE Pervasive Computing · doi:10.1109/mprv.2004.1316816 · Cited by 234
An overview of human interactive robots for psychological enrichment
Shibata, T. (2004) · Proceedings of the IEEE · doi:10.1109/jproc.2004.835383 · Cited by 215
Small, J. A., GUTMAN, G. M., Makela, S., & Hillhouse, B. (2003) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2003/028 · Cited by 155
Meal-Time with a Socially Assistive Robot and Older Adults at a Long-term Care Facility
McColl, D., & Nejat, G. (2013) · Journal of Human-Robot Interaction · doi:10.5898/jhri.2.1.mccoll · Cited by 134
Olivier, P. L., Xu, G., Monk, A. F., & Hoey, J. (2009) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/1579114.1579161 · Cited by 133
The Rapid Development of User Interfaces: Experience with the Wizard of OZ Method
Green, P., & Wei-Haas, L. (1985) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193128502900515 · Cited by 120
Performance of daily activities by older adults with dementia: The role of an assistive robot
Begum, M., Wang, R. H., Huq, R., & Mihailidis, A. (2013) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2013.6650405 · Cited by 110
Self-citationFinding a balance: The Carolinas Conversation Collection
Pope, C. A., & Davis, B. H. (2011) · Corpus Linguistics and Linguistic Theory · doi:10.1515/cllt.2011.007 · Cited by 108
Delirium, dementia, and amnestic and other cognitive disorders
Tucker, G. J. (1984) · Medical Entomology and Zoology · Cited by 104
Conversational Repair by Individuals With Dementia of the Alzheimer's Type
Orange, J. B., Lubinski, R. B., & Higginbotham, D. J. (1996) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.3904.881 · Cited by 100 · cited 3×
“, misunderstanding of topic, shared knowledge, or cohesion) [Orange et al. 1996].”
BackgroundInfluentialNonlinear, Biophysically-Informed Speech Pathology Detection
Little, M. A., McSharry, P., Moroz, I. M., & Roberts, S. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2006.1660534 · Cited by 97
WATSON, C. M. (1999) · Aphasiology · doi:10.1080/026870399402181 · Cited by 95
Rochon, E. A., Waters, G. S., & Caplan, D. N. (2000) · Journal of Speech Language and Hearing Research · doi:10.1044/jslhr.4302.395 · Cited by 92
Wilson, R., Rochon, E. A., Mihailidis, A., & Léonard, C. (2011) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2011/10-0206 · Cited by 80
Self-citationModeling the progression of Alzheimer’s disease for cognitive assistance in smart homes
Serna, A., Pigot, H., & Rialle, V. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9032-y · Cited by 71
A data-driven approach to optimizing spectral speech enhancement methods for various error criteria
Erkelens, J. S., Jensen, J., & Heusdens, R. R. (2006) · Speech Communication · doi:10.1016/j.specom.2006.06.012 · Cited by 67
Pakhomov, S. V. S., Smith, G. E., Chacon, D., Feliciano, Y., Graff-Radford, N., Caselli, R., & Knopman, D. S. (2010) · Cognitive and Behavioral Neurology · doi:10.1097/wnn.0b013e3181c5dde3 · Cited by 64
Ekman, G. (1955) · Acta Psychologica · doi:10.1016/s0001-6918(55)80091-1 · Cited by 63
Using text and acoustic features to diagnose progressive aphasia and its subtypes
Fraser, K. C., Rudzicz, F., & Rochon, E. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-514 · Cited by 61
Self-citationExamining Pauses in Alzheimer's Discourse
Davis, B. H., & Maclagan, M. (2009) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/1533317508328138 · Cited by 60
Language Processing in Dementia
Reilly, J. J., Troche, J., & Grossman, M. (2011) · Wiley eBooks · doi:10.1002/9781444344110.ch12 · Cited by 56
Speech rate and syntactic complexity effects on the auditory comprehension of alzheimer patients
Tomoeda, C. K., Bayles, K. A., Boone, D. R., Kaszniak, A. W., & Slauson, T. J. (1990) · Journal of Communication Disorders · doi:10.1016/0021-9924(90)90019-u · Cited by 53
A lexically-driven algorithm for disfluency detection
Snover, M., Dorr, B. J., & Schwartz, R. M. (2004) · doi:10.3115/1613984.1614024 · Cited by 49
Automatic detection of expressed emotion in Parkinson's Disease
Zhao, S., Rudzicz, F., Carvalho, L. G., Márquez-Chin, C., & Livingstone, S. R. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854516 · Cited by 45
Self-citationAcoustic models of the elderly for large-vocabulary continuous speech recognition
Baba, A., Yoshizawa, S., Yamada, M., Lee, A., & Shikano, K. (2004) · Electronics and Communications in Japan (Part II Electronics) · doi:10.1002/ecjb.20101 · Cited by 45
Resolution of communication breakdown in dementia of the Alzheimer's type: A longitudinal study
Orange, J. B., Gennep, K. M. V., Miller, L. T., & Johnson, A. M. (1998) · Journal of Applied Communication Research · doi:10.1080/00909889809365495 · Cited by 44
Effects of working memory capacity on understanding rate-altered speech
Small, J. A., Andersen, E. S., & Kempler, D. (1997) · Aging Neuropsychology and Cognition · doi:10.1080/13825589708256641 · Cited by 42
Speech Input from Older Users in Smart Environments: Challenges and Perspectives
Vipperla, R., Wolters, M., Georgila, K., & Renals, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02710-9_14 · Cited by 37
Can I be of assistance? The intelligence behind an assistive robot
Nejat, G., & Ficocelli, M. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543756 · Cited by 36
Alzheimer's disease: current knowledge, management and research.
Gauthier, S. G., Panisset, M., Nalbantoglu, J. N., & Poirier, J. (1997) · Europe PMC (PubMed Central) · Cited by 36
Indirect Interventions to Facilitate Communication in Alzheimer's Disease
Hopper, T. L. (2001) · Seminars in Speech and Language · doi:10.1055/s-2001-17428 · Cited by 35
Impact of Age in ASR for the Elderly: Preliminary Experiments in European Portuguese
Pellegrini, T., Trancoso, I. M., Hämäläinen, A., Calado, A., Dias, M. S., & Braga, D. (2012) · Communications in computer and information science · doi:10.1007/978-3-642-35292-8_15 · Cited by 30
Autominder: A Case Study of Assistive Technology for Elders with Cognitive Impairment
Pollack, M. E. (2006) · Generations · Cited by 30
Proceedings of HLT-NAACL 2004: Short Papers
Hirschberg, J., Dumais, S., Marcu, D., & Roukos, S. (2004) · Cited by 26
Automatically identifying trouble-indicating speech behaviors in alzheimer's disease
Rudzicz, F., Currie, L. C., Danks, A., Mehta, T., & Zhao, S. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661382 · Cited by 25
Self-citationBenefits of Social Intelligence in Home Dialogue Systems
Saini, P. K., de Ruyter, B., Markopoulos, P., & van Breemen, A. (2005) · Lecture notes in computer science · doi:10.1007/11555261_42 · Cited by 23
Recognition Of Voice Commands By Multisource Asr And Noise Cancellation In A Smart Home Environment
Lecouteux, B., Portet, F., & Vacher, M. (2012) · HAL · doi:10.5281/zenodo.52143 · Cited by 21
Automatic Speech Recognition for ageing voices
Vipperla, R. (2011) · ERA · Cited by 15
Goldfarb, R., & Pietro, M. J. S. (2004) · Journal of Ambulatory Care Management · doi:10.1097/00004479-200410000-00008 · Cited by 13
Real-time framework for multimodal human-robot interaction
Gast, J., Bannat, A., Rehrl, T., Wallhoff, F., Rigoll, G., Wendt, C. S., Schmidt, S., Popp, M., & Färber, B. (2009) · Conference on Human System Interactions · doi:10.1109/hsi.2009.5090992 · Cited by 12
Rudzicz, F. (2006) · doi:10.3115/1557856.1557875 · Cited by 9
Self-citationWu, Y.-H., Chétouani, M., Cristancho‐Lacroix, V., Maître, J. L., Jost, C., Pévédic, B. L., Duhaut, D., Granata, C., & Rigaud, A. (2011) · HAL · Cited by 8
Park, K., Lee, S. J., Jung, H., & Lee, Y. (2009) · IEEE RO-MAN · doi:10.1109/roman.2009.5326264 · Cited by 6
Cognitive Assistance and Physical Therapy for Dementia Patients
Tapus, A., Fasola, J., & Matarić, M. J. (2008) · Cited by 5
Communication strategies for a computerized caregiver for individuals with Alzheimer’s disease
Rudzicz, F., Wilson, R., Mihailidis, A., Rochon, E. A., & Léonard, C. (2012) · North American Chapter of the Association for Computational Linguistics · Cited by 4
Self-citationAssistive Robot Multi-modal Interaction with Augmented 3D Vision and Dialogue
Victores, J. G., Cañadillas, F. R., Morante, S., Jardón, A., & Balaguer, C. (2013) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-03413-3_15 · Cited by 3
Multi-agents based system to coordinate mobile teamworking robots
Mouad, M., Adouane, L., Schmitt, P., Khadraoui, D., Gâteau, B., & Martinet, P. (2010) · HAL · Cited by 2
Proceedings of the 2005 international conference on Collaborative technologies and systems
McQuay, W. K., & Smari, W. W. (2005) · Cited by 2
Research works printed but not linked: 16
- Begum M., Proceedings of the IEEE International Conference on Rehabilitation Robotics.
- Gast J., Proceedings of the IEEE International Conference on Human-System Interaction. 276--283
- H. Goodglass and E. Kaplan. 1983. The Assessment of Aphasia and Related Disorders (2nd ed.). Lea and Febiger Philadelphia PA. H. Goodglass and E. Kaplan. 1983. The Assessment of Aphasia and Related Disorders (2nd ed.). Lea and Febiger Philadelphia PA.
- Guinn C., 2012, Technical Report FS-12-01. Association for the Advancement of Artificial Intelligence.
- Jarvis R., 2009, Multimodal robot/human interaction for assisted living, International Journal on Advances in Intelligent Systems, 2
- Little M., 2006, Proceedings of ICASSP
- E. Lucet. 2012. Social Mobiserv Kompai robot to assist people. In euRobotics Workshop on Robots in Healthcare and Welfare. E. Lucet. 2012. Social Mobiserv Kompai robot to assist people. In euRobotics Workshop on Robots in Healthcare and Welfare.
- Mouad M., Proceedings of the 4th Companion Robotics Institute
- Park K., 2009, The 18th IEEE International Symposium on Robot and Human Interactive Communication, 2009
- 10.5555/1557856.1557875 · doi:10.5555/1557856.1557875
- Rudzicz F., Proceedings of the 3rd Workshop on Speech and Language Processing for Assistive Technologies (SLPAT’12)
- 10.1353/lan.1977.0041 · doi:10.1353/lan.1977.0041 · Paper page
- Tapus A., Proceedings of the International Symposium on Quality of Life Technology Intelligent Systems for Better Living
- Tapus A., ICRA Workshop on Social Interaction with Intelligent Indoor Robots.
- Vacher M., Proceedings of the 20th European Signal Processing Conference (EUSIPCO’12)
- Zhao S., 2014, Proceedings of ICASSP
Cited by
Pradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448
“Another issue that arose for users more broadly, beyond those with speech impairments, was the device timing out before the speaker could complete their command (an issue noted for users with Alzheimer’s disease [33]).”
BackgroundUse of Intelligent Voice Assistants by Older Adults with Low Technology Use
Pradhan, A., Lazar, A., & Findlater, L. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3373759 · Cited by 285
“Much of this work has explored using voice interaction for controlling smart homes [60, 79], assistive and social robots [7, 14, 66], and cognitive and other multimodal assistants [21, 58, 88].”
BackgroundYu, C., Sommerlad, A., Sakure, L., & Livingston, G. (2022) · Ageing Research Reviews · doi:10.1016/j.arr.2022.101633 · Cited by 131
“(Begum et al., 2015; Rudzicz et al., 2015; Wang et al., 2017) and one was a qualitative study inter-viewing family caregivers ’ perception towards 3DX robot.”
Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study
Masina, F., Orso, V., Pluchino, P., Dainese, G., Volpato, S., Nelini, C., Mapelli, D., Spagnolli, A., & Gamberini, L. (2020) · Journal of Medical Internet Research · doi:10.2196/18431 · Cited by 105
“Furthermore, patients with Alzheimer disease experience difficulties interacting with a voice-controlled robot because of the timing imposed by the device [21].”
BackgroundSandoval, D. C., Téllez, A. M., Sandoval, E. B., & Favela, J. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3319502.3374840 · Cited by 116
“This includes the use of SAR for companionship [2, 22], exercise coaching [11], assistance of daily living [20], and to facilitate recreational activities [15].”
Background
Metadata
- Authors
- Rudzicz, F., Wang, R., Begum, M., & Mihailidis, A.
- Affiliations
- University of Toronto (CA)
- Toronto Rehabilitation Institute (CA)
- University of Massachusetts Lowell (US)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2015-05-22
- Volume
- 7
- Issue
- 2
- Pages
- 1-22
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W2294978157
- Semantic Scholar
- d609d8e3e783fdb13e1a605b1fb96c6d11264b59
- Cited by
- 83
- References
- 70
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 10 · 2023: 9 · 2022: 4 · 2021: 11 · 2020: 11 · 2019: 9 · 2018: 3 · 2017: 7 · 2016: 3 · 2015: 1
- FWCI
- 7.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Funders
- Alzheimer Society
- Natural Sciences and Engineering Research Council of Canada (RGPIN 435874)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Keywords
- Alzheimer's disease, assistive robots, speech-based interaction, home-based elderly care, activities of daily living, speech recognition, robot-robot interaction, dementia caregiving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.