Toward a memory assistant companion for the individuals with mild memory impairment
The DOI matches its Crossref record; 17 of the 19 references it cites were found in a registry or an index.
Abstract
With the increasing average life expectancy of world population, there are more and more dementia patients, and the needs of assistive technology emerges. According to the literature, the progress of cognitive impairment can be suppressed to be slower if the patients is constantly in calm mood. An effective way is suggested by keeping them in social relationship with others. With the goal of developing a conversational humanoid that can serve as a companion for dementia patients, we propose an autonomous virtual agent that can generate back channel feedback, such as head nods and verbal acknowledgment, on the basis of acoustic information in the user's speech. The system is also capable of speech recognition and language understanding functionalities. In order to compensate the companionship of the agent and the ability to assist the user's memory, we are developing a memory vest which is equipped with portable devices including an Android smartphone, two IC audio recorders, and a digital video recorder to log the daily life of the patient. The gathered activity history database can then be used to enrich the dialogue ability of the agent and for helping the user to recall his / her own memory.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the system proposed by these authors does not seem to include features that are specifically designed for people with cognitive impairment, our work being thus the first to introduce dedicated interaction management mechanisms for this public.”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [7]
In the citing paper
“However, the current literature on the use of ECAs by older adults with cognitive impairment does not provide many guidelines for adapting ECA technology for this public.”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [7]
In the citing paper
“To the best of our knowledge, the only system that explicitly targets verbal and non-verbal interaction between the ECA and older adults with cognitive impairment is presented in [7].”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [7]
In the citing paper
“To do this, several researchers [5, 6, 7, 8, 9] have proposed to use virtual humanoid characters, called Embodied Conversational Agents (ECAs), that are able to interact with a person through verbal and nonverbal communication.”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [7]
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282 · cited 1×
“With the collaboration of a 72-year- old patient with mild cognitive impairment (MMSE measure [16]: 27/30), we have conducted a preliminary test on the memory vest.”
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“The recognition process uses a priorly trained C4.5 decision tree by Weka data mining tool [17] from 30-minute training data of each class.”
Kempermann, G., Gast, D., & Gage, F. H. (2002) · Annals of Neurology · doi:10.1002/ana.10262 · Cited by 889 · cited 1×
“It is also reported in the literature [2], [3] that repetitive stimuli on cognitive functions in the environment is also effective in suppressing the degradation of specific cognitive abilities.”
Environmental Enrichment Reduces Aβ Levels and Amyloid Deposition in Transgenic Mice
Lazarov, O., Robinson, J., Tang, Y.-P., Hairston, I. S., Korade-Mirnics, Z., Lee, V. M.-Y., Hersh, L. B., Sapolsky, R. M., Mirnics, K., & Sisodia, S. S. (2005) · Cell · doi:10.1016/j.cell.2005.01.015 · Cited by 885
Successful Aging and the Role of the Life Review*
BUTLER, R. N. (1974) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1974.tb04823.x · Cited by 339 · cited 1×
“Reminiscence or life review [1] is a well known method to slow the progress of the most prominent symptom of dementia, memory impairment.”
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247 · cited 1×
“The feedback generation rules were created on the basis of previous studies [14], [15].”
Nudge Nudge Wink Wink: Elements of Face-to-Face Conversation for Embodied Conversational Agents
Cassell, J. (2000) · Embodied Conversational Agents · doi:10.7551/mitpress/2697.003.0002 · Cited by 233
Bickmore, T. W., & Picard, R. W. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986097 · Cited by 122 · cited 2×
“Bickmore et al. [5] investigated the effects of verbal and non-verbal empathic behaviors of a 2D graphic agent and found that the subjects did rate the agent more caring if it shows those behaviors.”
(2006) · Cited by 93
Examination of Practicability of Communication Robot-Assisted Activity Program for Elderly People
Kanoh, M., Chukyo University, 1. T., Oida, Y., Nomura, Y., Araki, A., Konagaya, Y., Ihara, K., Shimizu, T., Kimura, K., Obu Dementia Care and Training Center, 3.-2. H.-C., et al. (2011) · Journal of Robotics and Mechatronics · doi:10.20965/jrm.2011.p0003 · Cited by 74 · cited 1×
“Kanoh et al. [8] investigated user acceptance of a robot in recreational use inside health care facilities for elderly people.”
Research works printed but not linked: 1
- pollack, 2005, Intelligent technology for an aging population: The use of ai to assist elders with cognitive impairment, AI Magazine, 26, 9
Cited by
Conversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
“Previous research has explored the use of conversational agents with individuals with MCI and dementia; pause and utterance duration, pitch, frequency of head nods, and overall patient responsiveness in the conversation were used as indicators of cognitive status [118]–[120].”
Dialogue Systems and Conversational Agents for Patients with Dementia: The Human–Robot Interaction
Russo, A., D'Onofrio, G., Gangemi, A., Giuliani, F., Mongiovi, M., Ricciardi, F., Greco, F., Cavallo, F., Dario, P., Sancarlo, D., et al. (2019) · Rejuvenation Research · doi:10.1089/rej.2018.2075 · Cited by 47
A companion robot for daily care of elders based on homeostasis
Yang, C.-Y., Lu, M.-J., Tseng, S.-H., & Fu, L. (2017) · Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE) · doi:10.23919/sice.2017.8105748 · Cited by 39
Wargnier, P., Benveniste, S., Jouvelot, P., & Rigaud, A.-S. (2018) · Technology and Disability · doi:10.3233/tad-180189 · Cited by 32
“To do this, several researchers [5, 6, 7, 8, 9] have proposed to use virtual humanoid characters, called Embodied Conversational Agents (ECAs), that are able to interact with a person through verbal and nonverbal communication.”
Embodied Conversational Agents for Patients With Dementia: Thematic Literature Analysis
Rampioni, M., Stara, V., Felici, E., Rossi, L., & Paolini, S. (2021) · JMIR mhealth and uhealth · doi:10.2196/25381 · Cited by 43
“Recently, several studies [23-27] proposed the use of screen-based entities designed to stimulate human face-to-face conversation skills called as embodied conversational agents (ECAs) or personal virtual assistants [28,29].”
BackgroundWargnier, P., Malaise, A., Jacquemot, J., Benveniste, S., Jouvelot, P., Pino, M., & Rigaud, A.-S. (2015) · 2015 3rd IEEE VR International Workshop on Virtual and Augmented Assistive Technology (VAAT) · doi:10.1109/vaat.2015.7155406 · Cited by 18
“In [10], Huang et al. propose to enrich the interaction with this ECA by using a life-logging system.”
Stara, V., Vera, B., Bolliger, D., Paolini, S., de Jong, M., Felici, E., Koenderink, S., Rossi, L., von Döllen, V., & Rosa, M. D. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910405 · Cited by 16
A Brain-Inspired Self-Organizing Episodic Memory Model for a Memory Assistance Robot
Yang, C.-Y., Gamborino, E., Fu, L., & Chang, Y. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3061659 · Cited by 13
Hocking, J., Maeder, A., Powers, D. M. W., Perimal‐Lewis, L., Dodd, B., & Lange, B. S. (2023) · Clinical Rehabilitation · doi:10.1177/02692155231216615 · Cited by 10
Can a Virtual Listener Replace a Human Listener in Active Listening Conversation?
Huang, H., Konishi, N., Shibusawa, S., & Kawagoe, K. (2015) · doi:10.1145/2829966.2829971 · Cited by 7
“Rapport is a mood which a person feels the connection and the harmony with another person when he/she is engaged in a pleasant relationship with him/her, and it helps to keep long-term relationships [5, 6].”
BackgroundSelf-citationToward RNN Based Micro Non-verbal Behavior Generation for Virtual Listener Agents
Huang, H., Fukuda, M., & Nishida, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21902-4_5 · Cited by 7
Self-citationStara, V., de Jong, M., Felici, E., Bolliger, D., Birrer, E., von Döllen, V., Rossi, L., & Heerink, M. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-20451-8_27 · Cited by 6
Capturing Human Digital Memories for Assisting Memory Recall
Dobbins, C., Merabti, M., Fergus, P., & Llewellyn-Jones, D. (2014) · Human-computer interaction series · doi:10.1007/978-1-4471-6392-3_10 · Cited by 8
“Since the probability of becoming cognitively impaired increases with age (roughly 10 % of over 65 years old), one side-effect of increasing life expectancy is the emerging number of dementia patients (Huang et al. 2012).”
BackgroundEstimating Speaker’s Engagement from Non-verbal Features Based on an Active Listening Corpus
Zhang, L., Huang, H., & Kuwabara, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91485-5_25 · Cited by 4
Self-citationShibusawa, S., Huang, H., Hayashi, Y., & Kawagoe, K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39137-8_17 · Cited by 2
“Rapport is a mood which a person feels the connection and harmony with another person when (s) he is engaged in a pleasant relationship with him / her, and it helps to keep long-term relationships [1, 2].”
BackgroundSelf-citationBasic Study of Wall-Projected Humanitude Agent for Pre-care Multimodal Interaction
Wan, X., & Yonezawa, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49904-4_45 · Cited by 2
Tumari, S. Z. M., & Sudirman, R. (2014) · International Conference on Artificial Intelligence, Modelling and Simulation (AIMS) · doi:10.1109/aims.2014.12 · Cited by 1
“By using visual stimuli, the behavioral and neuronal consequences of reflexive orienting were investigated [2] [3] [4].”
MethodAvatars 4 All – An Avatar Generation Toolchain
Sili, M., Broneder, E., Morandell, M. M., & Mayer, C. C. (2016) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/eai.16-5-2016.2264655 · Cited by 1
Understanding Emotional and Cognitive Dynamics in Older Adults Using Personalized Care Robots
Choi, N., & Park, D.-H. (2024) · International Conference on Machine Learning and Machine Intelligence (MLMI) · doi:10.1145/3696271.3696298
“While previous research has focused on older adults with cognitive impairments (Huang et al., 2012; Non-aka et al., 2012; Asgari, 2017), empirical studies on older adults in natural settings have been relatively scarce.”
Metadata
- Authors
- Huang, H.-H., Matsushita, H., Kawagoe, K., Sakai, Y., Nonaka, Y., Nakano, Y., & Yasuda, K.
- Affiliations
- Ritsumeikan University (JP)
- Seikei University (JP)
- Chiba Rosai Hospital (JP)
- Venue
- 2012 IEEE 11th International Conference on Cognitive Informatics and Cognitive Computing
- Publisher
- IEEE
- Published
- 2012-08
- Pages
- 295-299
- OpenAlex
- W2016678857
- Cited by
- 19
- References
- 19
- Citations by year
- 2024: 1 · 2023: 1 · 2021: 4 · 2020: 1 · 2019: 2 · 2018: 3 · 2017: 1 · 2016: 1 · 2015: 2 · 2014: 2 · 2013: 1
- FWCI
- 1.23
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Cognitive Informatics (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Keywords
- dementia, virtual agents, head nodding, speech recognition, language comprehension, activity logging, memory retrieval, social interaction, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.