Simple and Steady Interactions Win the Healthy Mentality: Designing a Chatbot Service for the Elderly
The DOI matches its Crossref record, with a small difference in title or year; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Although suicide among older adults is increasing in severity in the aging among South Koreans, older adult depression and anxiety, which are two crucial factors affecting suicide in this population, are not adequately addressed by the status quo. Existing products and services emphasize physical needs; however, they still lack a user-oriented approach. Moreover, offers for mental health care are costly and exclude potential users from the development process, thus inhibiting older adults from having better access to such services. To address this problem, we designed and developed a mental health care chatbot, Yeonheebot, to decrease anxiety and depression among older adults. Yeonheebot initiates conversations regarding daily care for the well-being of older adults and provides features related to their interests as initiatives for using the mental health care chatbot. To examine whether a short-term, yet repeating conversation with the agent could help reduce anxiety and depression among older adults, we conducted a 2-week field study with 25 users. The results indicate that the constant use of Yeonheebot decreased the levels of anxiety and depression by 36% and 18%, respectively. Our research implies that simple and repeated interactions could help Korean older adults cope with anxiety and depression.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another study showed a reduction in depression and anxiety by p = 0.053 and 0.029, respectively [32].”
From A systematic review on healthcare artificial intelligent conversational agents for chronic conditions (2022) · cites this paper as [32]
Citations
Cites
Basics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. (1992) · Journal of Marketing Research · doi:10.2307/3172751 · Cited by 17,850
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 1×
“However, unlike the results of the MHCC, conversational agents that delivered cognitive behavior therapy to young people showed reductions in depression, but no such effect for anxiety [14].”
ResultConversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 2×
“Although some regard chatbots as identical beings [51], for this research, we followed the definition of a chatbot under the higher category of conversational agents [38, 59].”
BackgroundMethodHill, J., Randolph Ford, W., & Farreras, I. G. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.026 · Cited by 856 · cited 1×
“Chatbots were proven to be effective in increasing conversation time, albeit the shortness in the length of messages compared to humans [76].”
BackgroundThe Discovery of Grounded Theory: Strategies for Qualitative Research.
Scott, J. C., & Glaser, B. G. (1971) · American Sociological Review · doi:10.2307/2094063 · Cited by 829
Gerontechnology acceptance by elderly Hong Kong Chinese: A senior technology acceptance model (STAM)
Chen, K., & Chan, A. H. S. (2014) · Ergonomics · doi:10.1080/00140139.2014.895855 · Cited by 679
Fifty Years of Classification and Regression Trees
Loh, W. (2014) · International Statistical Review · doi:10.1111/insr.12016 · Cited by 649
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
(2018) · doi:10.1145/3173574 · Cited by 569
Carleton, R. N., Thibodeau, M. A., Teale, M. J. N., Welch, P. G., Abrams, M. P., Robinson, T., & Asmundson, G. J. G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0058067 · Cited by 548
What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461
A k-nearest neighbor based algorithm for multi-label classification
Zhang, M.-L., & Zhou, Z.-H. (2005) · 2005 IEEE International Conference on Granular Computing · doi:10.1109/grc.2005.1547385 · Cited by 449
Hybrid decision tree and naïve Bayes classifiers for multi-class classification tasks
Farid, D. M., Zhang, L., Rahman, C. M., Hossain, M. A., & Strachan, R. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.089 · Cited by 368
Schreurs, K., Quan-Haase, A., & Martin, K. (2017) · Canadian Journal of Communication · doi:10.22230/cjc.2017v42n2a3130 · Cited by 315
Bayesian Naïve Bayes classifiers to text classification
Xu, S. (2018) · Journal of Information Science · doi:10.1177/0165551516677946 · Cited by 314
The Beck Anxiety Inventory: Reexamination of factor structure and psychometric properties
Osman, A., Kopper, B. A., Barrios, F. X., Osman, J. R., & Wade, T. (1997) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(199701)53:1<7::aid-jclp2>3.0.co;2-s · Cited by 294
Effectiveness of an Empathic Chatbot in Combating Adverse Effects of Social Exclusion on Mood
de Gennaro, M., Krumhuber, E. G., & Lucas, G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03061 · Cited by 265
Frailty, depression, and anxiety in later life
Ní Mhaoláin, A. M., Fan, C. W., Romero-Ortuno, R., Cogan, L., Cunningham, C., Kenny, R.-A., & Lawlor, B. (2012) · International Psychogeriatrics · doi:10.1017/s1041610211002110 · Cited by 184
The Beck Anxiety Inventory: Psychometric Properties with Older Adults
Morin, C. M., Landreville, P., Colecchi, C. A., McDonald, K., Stone, J., & Ling, W. D. (1999) · Journal of Clinical Geropsychology · doi:10.1023/a:1022986728576 · Cited by 167
Musa, A. B. (2012) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-012-0068-x · Cited by 152
What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P. R., Garaialde, D., Edwards, J., Spillane, B., Murad, C., Munteanu, C., Wade, V., et al. (2019) · Cork Open Research Archive (University College Cork, Ireland) · doi:10.48550/arxiv.1901.06525 · Cited by 147
King, A. C., Bickmore, T. W., Campero, M. I., Pruitt, L. A., & Yin, J. L. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.798374 · Cited by 114
‘Realness’ in Chatbots: Establishing Quantifiable Criteria
Morrissey, K., & Kirakowski, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39330-3_10 · Cited by 110
Lee, H.-K., Kim, J., SanghwangHong, Lee, E.-H., & Taeg, H. S. (2016) · The Korean Journal of Clinical Psychology · doi:10.15842/kjcp.2016.35.4.010 · Cited by 102
Physical Activity, Depression and Anxiety Among the Elderly
Teixeira, C. M., Vasconcelos-Raposo, J., Fernandes, H. M., & Brustad, R. J. (2012) · Social Indicators Research · doi:10.1007/s11205-012-0094-9 · Cited by 97
A chatbot using LSTM-based multi-layer embedding for elderly care
Su, M.-H., Wu, C., Huang, K.-Y., Hong, Q.-B., & Wang, H. (2017) · International Conference on Orange Technologies · doi:10.1109/icot.2017.8336091 · Cited by 94
Laumer, S., Maier, C., & Gubler, F. T. (2019) · Journal of the Association for Information Systems · Cited by 86
Martínez-Miranda, J., Martínez, A., Ramos, R., Aguilar, H., Jiménez, L., Arias, H., Rosales, G., & Valencia, E. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1387-1 · Cited by 79 · cited 1×
“Mobile-based embodied chatbots are especially helpful in gaining access to currently unavailable clinical services due to high costs, logistical issues, stigma, or inconvenience [46].”
BackgroundSmart conversational agents for reminiscence
Nikitina, S., Callaioli, S., & Báez, M. (2018) · doi:10.1145/3195555.3195567 · Cited by 49
Proceedings of the 2018 Designing Interactive Systems Conference
Koskinen, I., China, D. '. D. I. S. C. 2. 2. H. K., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Computer-Human Interaction, & SIGs, A. (2018) · doi:10.1145/3196709 · Cited by 38
The Design and Implementation of a Chatbot's Character for Elderly Care
Liu, W.-D., Chuang, K.-Y., & Chen, K.-Y. (2018) · International Conference on System Science and Engineering · doi:10.1109/icsse.2018.8520008 · Cited by 21
Deploying service integration agent for personalized smart elderly care
Tokunaga, S., Horiuchi, H., Tamamizu, K., Saiki, S., Nakamura, M., & Yasuda, K. (2016) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icis.2016.7550873 · Cited by 19
Reliability and Validity of Korean Geriatric Anxiety Inventory(K-GAI)
Kim, J., 박명숙, & 오두남 (2014) · Journal of muscle and joint health · doi:10.5953/jmjh.2014.21.1.75 · Cited by 18
Health-related quality of life according to breakfast in elderly
Kim, J. (2015) · Journal of the Korea Academia-Industrial cooperation Society · doi:10.5762/kais.2015.16.7.4668 · Cited by 16
Correlation among Depression, Death Anxiety, and Quality of Life of Aged Women
Park, K.-E., Kwon, M.-H., & Kwon, Y.-E. (2013) · Journal of Korean Public Health Nursing · doi:10.5932/jkphn.2013.27.3.527 · Cited by 15
홍순명, & 최석영 (1996) · Journal of the Korean Society of Food Science and Nutrition · Cited by 15
Lee, J., & Solheim, C. A. (2018) · Journal of Comparative Family Studies · doi:10.3138/jcfs.49.4.409 · Cited by 11
Kang, H.-C. (2014) · Journal of Oriental Neuropsychiatry · doi:10.7231/jon.2014.25.2.123 · Cited by 10
Ryu, H., & Lee, M. (2019) · 조사연구 · doi:10.20997/sr.20.1.1 · Cited by 10
Self-citationReflex epilepsy induced by playing Go-stop or Baduk games
Lee, M. K., Yoo, J., Cho, Y., et al. (2012) · Seizure · doi:10.1016/j.seizure.2012.08.007 · Cited by 7
The Risk Factors of Suicidal Ideation by Age Groups among the Elderly in Korea
Kim, E. K. (2015) · Daehan imsang geon-gang jeungjin hakoeji/Daehan imsang geon'gang jeungjin haghoeji · doi:10.15384/kjhp.2015.15.2.54 · Cited by 7
Jung, S.-H., & Kim, J.-H. (2019) · Health and Social Welfare Review · doi:10.15709/hswr.2019.39.2.580 · Cited by 7
Chang, S.-H., Suh, E. E., & Choi, H. (2017) · The Korean Journal of Rehabilitation Nursing · doi:10.7587/kjrehn.2017.111 · Cited by 7
Sik, J. Y., & Mo, S.-H. (2017) · Cited by 5
Yoon, H., Kim, Y., Choi, K., Lim, Y. O., Nam, I., Kim, W., & 함혜진 (2018) · Daehan imsang geon-gang jeungjin hakoeji/Daehan imsang geon'gang jeungjin haghoeji · doi:10.15384/kjhp.2018.18.1.60 · Cited by 5
Comparison of Depression, Anxiety, and Stress Between Korea Elders and New Zealand Elders
Kim, G.-D., & Kim, K.-H. (2015) · Journal of the Korea Academia-Industrial cooperation Society · doi:10.5762/kais.2015.16.9.6190 · Cited by 2
Son, Y. E., Lee, J. H., & Nam, S. I. (2016) · The Center for Social Welfare Research Yonsei University · doi:10.17997/swry.50.1.2 · Cited by 2
The Effects of Music Therapy on Cognitive Function and Depression in Demented Old Adults
Gwon, J.-Y., & Kim, J. S. (1998) · Research in Community and Public Health Nursing · Cited by 2
Park, J. H., Myung, W., Choi, J., et al. (2015) · Cited by 1
The Effect of Depression, Anxiety, Stress on Suicidal Ideation of the Elderly in Youngdong County
Chang, W.-S. (2016) · The Journal of the Korea Contents Association · doi:10.5392/jkca.2016.16.07.720 · Cited by 1
Serious Mobile Game App Design Planning for Dementia Prevention
시각디자인, 대. 디., & Yoon, Y. K. (2018) · Journal of Cultural Product and Design · doi:10.18555/kicpd.2018.52.5 · Cited by 1
Research works printed but not linked: 29
- Anderson Monica, 2017, Technology use among seniors
- Bakker David, 2016, Mental health smartphone apps: review and evidence-based recommendations for future developments. JMIR mental health 3, 1
- Bergman Bo, 2011, Five main processes in healthcare: a citizen perspective. BMJ quality & safety 20, Suppl, 1, i41
- Charmaz Kathy, 2007, Grounded theory
- Cho Inhye, 2019, AI Robot ElliQ. Retrieved
- An Kee Suk Kyoon, 2018, Kyung Mee Park and Eun Lee
- Fadhil Ahmed, 2019, Designing for Health Chatbots. arXiv preprint arXiv:1902.09022 · arXiv
- Genuer Robin, 2010, Variable selection using random forests. Pattern recognition letters 31, 14
- Gjestsen Martha Therese, 2014, What does it take? Healthcare professional's perspective on incentives and obstacles related to implementing ICTs in home-based elderly care. BMC health services research 14, 2
- Hong Soonmyung, 1996, A Study on Meal Management and Nutrient Intake of the Elderly, Journal of the Korean Society of Food Science and Nutrition, 25, 1055
- Hwang Boyeon, 2016, Retrieved
- Korea Information Society Development Institute. 2017., KISDI STAT REPORT
- Jeong Hijo, 2017, The Gap Between the Ro Ro Care Business. Retrieved
- Kim Dongsuk, 2018, Retrieved
- Kim Jung Wan, 2009, Communicative Ability in Normal Aging, A Review. Korean Journal of Communication Disorders, 14, 495
- Kim Yoo Kyung, 2016, The Family Support and Policy Implications on Support Environment Changes, Health and Social Welfare Forum, 2016, 62
- Lara, 2012 11th International Conference on Machine Learning and Applications, 2
- Zeni Montenegro Joao Luis, 2019, Cristiano André da Costa, and Rodrigo da Rosa Righi
- Ministry of Health and Welfare Korea Suicide Prevention Center, 2017 Suicide Prevention White Paper. Gyemunsa
- Park Jungil, 2018, Retrieved
- Park Yeongseok, 2017, Retrieved
- Radziwill Nicole M, 2017, Evaluating quality of chatbots and intelligent conversational agents. arXiv preprint arXiv:1704.04579 · arXiv
- Razavi S Zahra, 2019, Kimberly Van Orden, and Tianyi Ma.
- Seo Minjun, 2018, Retrieved
- Seong Hangkyeong, 2016, Retrieved
- Shaked Nava A, 2017, Avatars and virtual agents--relationship interfaces for the elderly. Healthcare technology letters 4, 3
- Yeom Jihyun, 2017, Retrieved
- Yoon Jihye, 2007, Korean Psychological Association Annual Conference Program and Abstract 2007
- M., 2019, Selecting the most important self-assessed features for predicting conversion to Mild Cognitive Impairment with Random Forest and Permutation-based methods. bioRxiv, 785519
Cited by
Liu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100495 · Cited by 296
“Researchers have so far endeavored to deploy mobile-based therapy chatbots for college students (Dekker et al., 2020), teenagers (Huang et al., 2015), the elderly (Ryu et al., 2020), patients (Greer et al., 2019), and so on.”
BackgroundJo, E., Epstein, D. A., Jung, H., & Kim, Y.-H. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581503 · Cited by 174
“Relevant to our work, Yeonheebot performs conversations with older adults to mitigate their depression and anxiety [65].”
BackgroundYang, Z., Xu, X., Yao, B., Rogers, E., Zhang, S., Intille, S., Shara, N., Gao, G. G., & Wang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659625 · Cited by 120
Bin Sawad, A., Narayan, B., Alnefaie, A., Maqbool, A., Mckie, I., Smith, J., Yuksel, B., Puthal, D., Prasad, M., & Kocaballi, A. B. (2022) · Sensors · doi:10.3390/s22072625 · Cited by 113
Introduction to large language models (LLMs) for dementia care and research
Treder, M. S., Lee, S., & Tsvetanov, K. A. (2024) · Frontiers in Dementia · doi:10.3389/frdem.2024.1385303 · Cited by 63
Metadata
- Authors
- Ryu, H., Kim, S., Kim, D., Han, S., Lee, K., & Kang, Y.
- Affiliations
- Yonsei University (KR)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2020-10-14
- Volume
- 4
- Issue
- CSCW2
- Pages
- 1-25
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3094018806
- Cited by
- 66
- References
- 52
- Citations by year
- 2026: 11 · 2025: 17 · 2024: 15 · 2023: 8 · 2022: 11 · 2021: 4
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Keywords
- mental health chatbots, older adults, depression, anxiety, suicide prevention, user-centered design, repeated interaction, Korean older adults, well-being, access to mental health care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.