Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults
Open accessThe DOI matches its Crossref record; 135 of the 135 references it cites were found in a registry or an index; 33 of the 64 sources its claims cite were checked for support.
Abstract
Despite the plethora of telehealth applications to assist home-based older adults and healthcare providers, basic messaging and phone calls are still the most common communication methods, which suffer from limited availability, information loss, and process inefficiencies. One promising solution to facilitate patient-provider communication is to leverage large language models (LLMs) with their powerful natural conversation and summarization capability. However, there is a limited understanding of LLMs' role during the communication. We first conducted two interview studies with both older adults (N=10) and healthcare providers (N=9) to understand their needs and opportunities for LLMs in patient-provider asynchronous communication. Based on the insights, we built an LLM-powered communication system, Talk2Care, and designed interactive components for both groups: (1) For older adults, we leveraged the convenience and accessibility of voice assistants (VAs) and built an LLM-powered conversational interface for effective information collection. (2) For health providers, we built an LLM-based dashboard to summarize and present important health information based on older adults' conversations with the VA. We further conducted two user studies with older adults and providers to evaluate the usability of the system. The results showed that Talk2Care could facilitate the communication process, enrich the health information collected from older adults, and considerably save providers' efforts and time. We envision our work as an initial exploration of LLMs' capability in the intersection of healthcare and interpersonal communication.
Overview
CoChat Summary
## TL;DR
Talk2Care is a pilot LLM-powered voice assistant and provider dashboard designed to improve asynchronous communication between older adults at home and healthcare providers. Across interviews and user studies with 10 older adults and 9 providers, the system was reported to improve usability, enrich shared health information, and reduce providers’ effort and time.
## Key findings
- In the need-finding interviews, older adults and providers both described communication breakdowns in existing methods: providers were hard to reach, messages were often unclear or incomplete, and older adults had accessibility and literacy challenges.
- In the older-adult user study, the VA system had an average SUS score of 75.5±17.1 and participants rated it as simple to understand (4.6±0.5), accurate in understanding their words (4.3±0.8), reliable (4.2±1.0), and supportive for home-based healthcare needs (4.2±1.0).
- In the provider user study, the dashboard had an average SUS score of 85.8±9.8; providers also reported low task load on NASA-TLX (mental demand 2.2±1.0, physical demand 1.4±0.5, temporal demand 1.7±0.9, effort 2.0±1.1, frustration 1.1±0.3, performance 6.1±0.6).
- Providers rated the system helpful for communication with older adults (4.6±0.5 out of 5) and for offloading work (4.4±0.9), and 5 out of 9 said the dashboard could assist triage and prioritization.
## Methods
- The paper used a mixed design: two semi-structured interview studies for need-finding, followed by two scenario-based user studies evaluating a pilot system.
- Sample: 10 older adults (65+ years old, living in single-family homes in the northeastern U.S.) and 9 healthcare providers (including physicians, nurse practitioners, and related professionals).
- Analysis and evaluation: interview transcripts were analyzed with thematic analysis; user studies used questionnaires including SUS and NASA-TLX, plus exit interviews and comparison against traditional asynchronous messaging/phone-call workflows.
## Limitations
- The paper states that the user-study sample sizes were limited: 10 older adults and 9 healthcare providers.
- The paper states that participants were recruited from a university pool and may have had higher education, digital literacy, or better understanding of LLMs than other groups, so results may not generalize to other populations.
- The paper states that providers were mainly physicians rather than a wider range of roles; it suggests future work include broader patient and provider populations.
- Evident from the text: the system is a proof-of-concept prototype and the evaluation focused mainly on usability and perceived benefits, not on module-level performance such as question quality, summary quality, or risk-prediction accuracy.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures











Verification
Claims the paper makes
6 Valid · 16 Not valid · 7 Not checked · 163 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“multiple studies have raised concerns about using LLMs for healthcare scenarios, due to their inconsistency, potential errors, and bias in clinical work [17,55,64]”
§ Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults > 2.3 Large Language Models for Healthcare
What the sources say
- Not checked — no full text of the sourcecites [17] 17. Johnna Blair and Saeed Abdullah. 2019. Understanding the Needs and Challenges of Using Conversational Agents for Deaf Older Adults. In Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing (CSCW '19 Companion). Association for Computing Machinery, New York, NY, USA, 161-165. https://doi.org/10.1145/3311957.3359487 source
- Not checked — no full text of the sourcecites [55] 55. Mohit Jain, Pratyush Kumar, Ishita Bhansali, Q. Vera Liao, Khai Truong, and Shwetak Patel. 2018. FarmChat: A Conversational Agent to Answer Farmer Queries. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 4, Article 170 (dec 2018), 22 pages. https://doi.org/10.1145/3287048 source
- Could not verifycites [64] 64. Clemens Kruse, Joanna Fohn, Nakia Wilson, Evangelina Nunez Patlan, Stephanie Zipp, Michael Mileski, et al. 2020. Utilization barriers and medical outcomes commensurate with the use of telehealth among older adults: systematic review. JMIR medical informatics 8, 8 (2020), e20359. sourceExperimental — accuracy not yet measured
The Methods section on risk of bias and the Results section on bias within studies discuss the quality and selection bias of telehealth studies, not LLMs. Searches for LLMs and for clinical AI errors or bias found no passage addressing the cited claim. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“digital messages could be lost due to providers' hasty schedules [69]”
§ Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults > 1 INTRODUCTION
What the sources say
- Could not verifycites [69] 69. Gibbeum Lee, Volker Hartmann, Jongho Park, Dimitris Papailiopoulos, and Kangwook Lee. 2023. Prompted LLMs as Chatbot Modules for Long Open-domain Conversation. In Findings of the Association for Computational Linguistics: ACL 2023. 4536-4554. https://doi.org/10.18653/v1/2023.findings-acl.277 arXiv:2305.04533 [cs] sourceExperimental — accuracy not yet measured
The Modular Prompted Chatbot section (p. 2) discusses how a chatbot processes and retains conversational information, not whether providers miss digital messages. Searches for lost digital messages and providers’ rushed schedules found no passage addressing that claim. (LLM, conf=0.76)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“getting feedback and progress via asynchronous messages is time-consuming”
§ Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults > 1 INTRODUCTION
What the sources say
- Could not verifycites [69] 69. Gibbeum Lee, Volker Hartmann, Jongho Park, Dimitris Papailiopoulos, and Kangwook Lee. 2023. Prompted LLMs as Chatbot Modules for Long Open-domain Conversation. In Findings of the Association for Computational Linguistics: ACL 2023. 4536-4554. https://doi.org/10.18653/v1/2023.findings-acl.277 arXiv:2305.04533 [cs] sourceExperimental — accuracy not yet measured
The cited paper’s C.3 Crowdworker Instruction (p. 11) describes evaluating chatbot responses, and B.1 Full Single Model Evaluation (p. 9) discusses response latency. Neither addresses whether obtaining feedback and progress updates through asynchronous messages is time-consuming. Searches for that phrase and for delayed communication about updates found no supporting passage. (LLM, conf=0.73)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“studies have also pointed out the limited use of these VAs by older adults due to usability barriers, cultural gaps, lack of explainability, and flexibility [18,44,49,108,131]”
§ Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults > 1 INTRODUCTION
What the sources say
- Partly supportedcites [18] 18. Ann Blandford, Janet Wesson, René Amalberti, Raed AlHazme, and Ragad Allwihan. 2020. Opportunities and challenges for telehealth within, and beyond, a pandemic. The Lancet Global Health 8, 11 (2020), e1364-e1365. sourceExperimental — accuracy not yet measured
In the paper’s main text (page not provided), Blandford et al. say telehealth must be easy to use, flexible, and tailored to users’ needs, and they discuss cultural differences relevant to data sharing. The paper does not report limited use of virtual assistants by older adults or identify lack of explainability as a cause. (LLM, conf=0.82)
- Partly supportedcites [44] 44. Kristen R Haase, Theodore Cosco, Lucy Kervin, Indira Riadi, and Megan E O'Connell. 2021. Older adults' experiences with using technology for socialization during the COVID-19 pandemic: Cross-sectional survey study. JMIR aging 4, 2 (2021), e28010. sourceExperimental — accuracy not yet measured
The Results (Facilitators to Web-Based Socialization; page unavailable) link older adults’ willingness to use socialization technology to its user-friendliness and report requests for clearer instructions. The paper concerns technology such as Zoom, not virtual assistants; our copy does not establish limited VA use or identify cultural gaps, lack of explainability, or lack of flexibility as its causes. (LLM, conf=0.86)
- Not matchedcites [49] 49. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139-183.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Could not verifycites [108] 108. Reed V. Tuckson, Margo Edmunds, and Michael L. Hodgkins. 2017. Telehealth. New England Journal of Medicine 377, 16 (Oct. 2017), 1585-1592. https://doi.org/10.1056/NEJMsr1503323 Publisher: Massachusetts Medical Society _eprint: https://doi.org/10.1056/NEJMsr1503323. sourceExperimental — accuracy not yet measured
The Telehealth and Patient Engagement sections discuss telehealth tools and patient-facing apps, but do not address older adults’ use of virtual assistants or the proposed reasons for limited use. Searches for older adults, voice assistants, and the specified barriers found no passage supporting the attributed claim. (LLM, conf=0.75)
- Not checked — no full text of the sourcecites [131] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Given the limited work in multi-stakeholder contexts [58], our work uncovers AI's capability to address challenges in patient-provider communication.”
§ Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older Adults > 6.1 AI-Empowered Healthcare Work
What the sources say
- Could not verifycites [58] 58. Eric L Johnson and Eden Miller. 2022. Remote patient monitoring in diabetes: how to acquire, manage, and use all of the data. Diabetes Spectrum 35, 1 (2022), 43-56. sourceExperimental — accuracy not yet measured
The citation is attached to the assertion that work in multi-stakeholder contexts is limited, not to the citing authors’ finding about AI. The paper discusses roles for patients, clinicians, and clinic staff in remote diabetes monitoring (Abstract, page unavailable), but does not assess how much research exists in multi-stakeholder contexts. Searches for that research-gap claim found no supporting passage. (LLM, conf=0.73)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
72 more claims · 1 with their cited sources checked
Create a free account to see all 192 claims and every source verdict.
- It may state two separate claims as one. 55
- Probably not a substantial claim. 79
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More recent advancements with voice-based conversational agents28 could interact with patients over the phone to overcome barriers with the writing and typing typically required of traditional questionnaires, and also increase access for patients who are of lower socioeconomic status, limited English proficiency, or elderly.29–32”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [32]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Recent efforts to incorporate LLMs into voice-based interactions for older adults have shown improvement in conversational aspects [26, 63]”
From Situated Understanding of Errors in Older Adults' Interactions with Voice Assistants: A Month-Long, In-Home Study (2026) · cites this paper as [63]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Current challenges include cost, time required for clinicians to administer tests, specific training even for the most common assessments (e.g., MMSE, MoCA), and language and cultural biases that complicate interpretation in medically under-served populations.6,32,51”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [32]
Experimental — accuracy not yet measured
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Dorsey, E. R., & Topol, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1601705 · Cited by 1,211
Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023) · Journal of Medical Systems · doi:10.1007/s10916-023-01925-4 · Cited by 1,120
The ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105 · cited 1×
“Talk2Care is intentionally designed to not provide health advice due to the concern about AI reliability in healthcare [24, 55, 82].”
BackgroundTuckson, R. V., Edmunds, M., & Hodgkins, M. L. (2017) · New England Journal of Medicine · doi:10.1056/nejmsr1503323 · Cited by 907
The State of Telehealth Before and After the COVID-19 Pandemic
Shaver, J. (2022) · Primary Care: Clinics in Office Practice · doi:10.1016/j.pop.2022.04.002 · Cited by 863
AudioPaLM: A Large Language Model That Can Speak and ListenPreprint
Rubenstein, P. K., Asawaroengchai, C., Nguyen, D. D., Bapna, A., Borsos, Z., Quitry, F. D. C., Chen, P., Badawy, D. E., Han, W., Kharitonov, E., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.12925 · Cited by 671
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · cited 1×
“For healthcare professionals, researchers have also leveraged LLMs to support public health interventions [58], clinical pre-screening [48, 115], risk prediction [16, 42, 63, 86] and information processing [9, 10, 26, 64, 84, 85].”
BackgroundChaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572 · cited 1×
“In addition, failure of the CA such as voice recognition issues (Section 5.2.3) [27, 83], should also be addressed to ensure the information accuracy.”
BackgroundInfluentialRemote patient monitoring: a comprehensive study
Malasinghe, L. P., Ramzan, N., & Dahal, K. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-017-0598-x · Cited by 534 · cited 1×
“…has focused on various home-based telehealth applications to support asynchronous communication between older adults and their healthcare providers, such as remote health monitoring [15, 34, 47, 59, 77], healthcare plan management [11], and patient-provider collaborative review [30, 31, 98].”
BackgroundThe CONNECT (Clinical Evaluation of Remote Notification to Reduce Time to Clinical Decision) Trial
Crossley, G. H., Boyle, A., Vitense, H., Chang, Y., & Mead, R. H. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2010.12.012 · Cited by 526
Li, Y., Li, Z., Zhang, K., Dan, R., Jiang, S., & Zhang, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.14070 · Cited by 512 · cited 2×
“The latest studies have discussed and explored its application for individual patients’ in health information seeking [119, 128], mental health support [66, 68, 124], personal health coaching and management [81, 117] and health education [67, 81].”
BackgroundCapabilities of GPT-4 on Medical Challenge Problems
Nori, H., King, N., McKinney, S. M., Carignan, D., & Horvitz, E. (2023) · arXiv · doi:10.48550/arxiv.2303.13375 · Cited by 509
Health Literacy and Older Adults: A Systematic Review
Chesser, A. K., Keene Woods, N., Smothers, K., & Rogers, N. (2016) · Gerontology and Geriatric Medicine · doi:10.1177/2333721416630492 · Cited by 398
Using AI-generated suggestions from ChatGPT to optimize clinical decision support
Liu, S., Wright, A. P., Patterson, B. L., Wanderer, J. P., Turer, R. W., Nelson, S. D., McCoy, A. B., Sittig, D. F., & Wright, A. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad072 · Cited by 397
Large language models are few-shot clinical information extractors
Agrawal, M., Hegselmann, S., Lang, H., Kim, Y., & Sontag, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.130 · Cited by 358
Magrabi, F., Ammenwerth, E., McNair, J. B., De Keizer, N. F., Hyppönen, H., Nykänen, P., Rigby, M., Scott, P. J., Vehko, T., Wong, Z. S.-Y., et al. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677903 · Cited by 347
Patient and clinician experiences with telehealth for patient follow-up care.
Donelan, K., Barreto, E. A., Sossong, S., Michael, C., Estrada, J., Cohen, A. B., Wozniak, J. R., & Schwamm, L. H. (2019) · PubMed · Cited by 337
Home-based technologies for stroke rehabilitation: A systematic review
Chen, Y., Abel, K. T., Janecek, J. T., Chen, Y., Zheng, K., & Cramer, S. C. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.12.001 · Cited by 328
For Telehealth To Succeed, Privacy And Security Risks Must Be Identified And Addressed
Hall, J. L., & McGraw, D. (2014) · Health Affairs · doi:10.1377/hlthaff.2013.0997 · Cited by 297 · cited 1×
“…3.1.4 and 5.2.3), future designers and developers should refer to regulations such as HIPPA and existing secured telehealth systems to enable secured access to the database [46, 93], and could potentially utilize natural language processing (NLP) methods to filter critical identifiable information.”
BackgroundInfluentialKruse, C., Fohn, J., Wilson, N., Nunez Patlan, E., Zipp, S., & Mileski, M. (2020) · JMIR Medical Informatics · doi:10.2196/20359 · Cited by 295
Leveraging Large Language Models for Mental Health Prediction via Online Text DataPreprint
Xu, X., Yao, B., Dong, Y.-Z., Yu, H., Hendler, J. A., Dey, A., & Wang, D.-K. (2023) · arXiv.org · doi:10.48550/arxiv.2307.14385 · Cited by 291
Self-citationUse of Intelligent Voice Assistants by Older Adults with Low Technology Use
Pradhan, A., Lazar, A., & Findlater, L. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3373759 · Cited by 285 · cited 2×
“However, lack of digital literacy is a widely known issue [40, 91, 104].”
BackgroundMental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data
Xu, X., Yao, B., Dong, Y., Gabriel, S., Yu, H., Hendler, J., Ghassemi, M., Dey, A. K., & Wang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3643540 · Cited by 278
Self-citationToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection
Hartvigsen, T., Gabriel, S., Palangi, H., Sap, M., Ray, D., & Kamar, E. (2022) · arXiv · doi:10.48550/arxiv.2203.09509 · Cited by 276
Opportunities and challenges for telehealth within, and beyond, a pandemic
Blandford, A., Wesson, J., Amalberti, R., AlHazme, R., & Allwihan, R. (2020) · The Lancet Global Health · doi:10.1016/s2214-109x(20)30362-4 · Cited by 268
Ross, S. I., Martinez, F., Houde, S., Muller, M., & Weisz, J. D. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584037 · Cited by 258
A review of PHR, EMR and EHR integration: A more personalized healthcare and public health policy
Heart, T., Ben-Assuli, O., & Shabtai, I. (2017) · Health Policy and Technology · doi:10.1016/j.hlpt.2016.08.002 · Cited by 251 · cited 1×
“Admittedly, integration with EHR may come across several obstacles, including demand for budget and resources, handling sensitive information, and interoperability issues [33, 52, 118].”
BackgroundEvaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study
Hämäläinen, P., Tavast, M., & Kunnari, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580688 · Cited by 248 · cited 1×
“Recently, the technology boost of Large Language Models (LLM), such as ChatGPT [87], has shown its great potential in engaging in, scaffolding, and processing natural conversations [54, 72, 102, 113, 120, 121].”
BackgroundYang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247
Xiao, Z., Yuan, X., Liao, Q. V., Abdelghani, R., & Oudeyer, P.-Y. (2023) · 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581754.3584136 · Cited by 230
Haase, K. R., Cosco, T., Kervin, L., Riadi, I., & O'Connell, M. E. (2021) · JMIR Aging · doi:10.2196/28010 · Cited by 229 · cited 1×
“Meanwhile, older adults generally have lower technology proficiency compared to younger generations, which is another common obstacle to accessing and using some of these tools [40, 45, 65, 104].”
BackgroundChung, C.-F., Dew, K., Cole, A., Zia, J., Fogarty, J., Kientz, J. A., & Munson, S. A. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819926 · Cited by 222
Murtarelli, G., Gregory, A., & Romenti, S. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.09.018 · Cited by 209 · cited 1×
“In addition, failure of the CA such as voice recognition issues (Section 5.2.3) [27, 83], should also be addressed to ensure the information accuracy.”
BackgroundInfluentialWang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445432 · Cited by 209
Self-citationDelirium Risk Prediction, Healthcare Use and Mortality of Elderly Adults in the Emergency Department
Kennedy, M., Enander, R. A., Tadiri, S. P., Wolfe, R. E., Shapiro, N. I., & Marcantonio, E. R. (2014) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12692 · Cited by 205 · cited 2×
“For healthcare professionals, researchers have also leveraged LLMs to support public health interventions [58], clinical pre-screening [48, 115], risk prediction [16, 42, 63, 86] and information processing [9, 10, 26, 64, 84, 85].”
BackgroundSpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Zhang, D., Li, S., Zhang, X., Zhan, J., Wang, P., Zhou, Y., & Qiu, X. (2023) · arXiv · doi:10.48550/arxiv.2305.11000 · Cited by 189
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Zhang, D., Li, S., Zhang, X., Zhan, J., Wang, P., Zhou, Y., & Qiu, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.1055 · Cited by 187
Xiao, Z., Zhou, M. X., Liao, Q. V., Mark, G., Chi, C., Chen, W., & Yang, H. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3381804 · Cited by 185
We need to talk about deception in social robotics!
Sharkey, A., & Sharkey, N. (2021) · Ethics and Information Technology · doi:10.1007/s10676-020-09573-9 · Cited by 179 · cited 1×
“Similarly, given earlier work on deception and social CAs [100], it is possible that this system could lead to the social isolation of some older adults if they communicate more with the system and less with their family members or providers directly.”
BackgroundJo, E., Epstein, D. A., Jung, H., & Kim, Y.-H. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581503 · Cited by 174
Cifuentes, M., Davis, M., Fernald, D., Gunn, R., Dickinson, P., & Cohen, D. J. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.s1.150133 · Cited by 164 · cited 1×
“Admittedly, integration with EHR may come across several obstacles, including demand for budget and resources, handling sensitive information, and interoperability issues [33, 52, 118].”
BackgroundRed teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicity
Zhuo, T. Y., Huang, Y., Chen, C., & Xing, Z. (2023) · arXiv · doi:10.48550/arxiv.2301.12867 · Cited by 164 · cited 2×
“We found the common ethical concerns for AI systems [130] and privacy concerns of VAs from 3 participants [91].”
BackgroundPark, S. Y., Lee, S. Y., & Chen, Y. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.12.001 · Cited by 162
Xu, X., Chikersal, P., Doryab, A., Villalba, D. K., Dutcher, J. M., Tumminia, M. J., Althoff, T., Cohen, S., Creswell, K. G., Creswell, J. D., et al. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351274 · Cited by 160
Self-citationFacilitators and Barriers to the Adoption of Telehealth in Older Adults: An Integrative Review
Foster, M., & Sethares, K. A. (2014) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000105 · Cited by 158
Enabling Conversational Interaction with Mobile UI using Large Language Models
Wang, B., Li, G., & Li, Y. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580895 · Cited by 156 · cited 2×
“Recently, the technology boost of Large Language Models (LLM), such as ChatGPT [87], has shown its great potential in engaging in, scaffolding, and processing natural conversations [54, 72, 102, 113, 120, 121].”
BackgroundMethod"Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo
Trajkova, M., & Martin-Hammond, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376760 · Cited by 154
Evaluation of ChatGPT for NLP-based Mental Health ApplicationsPreprint
Lamichhane, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.15727 · Cited by 145
Kawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143
Mark, T. L., Treiman, K., Padwa, H., Henretty, K., Tzeng, J., & Gilbert, M. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202100088 · Cited by 130
Schroeder, J., Hoffswell, J., Chung, C.-F., Fogarty, J. A., Munson, S. A., & Zia, J. K. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998276 · Cited by 128 · cited 1×
“…has focused on various home-based telehealth applications to support asynchronous communication between older adults and their healthcare providers, such as remote health monitoring [15, 34, 47, 59, 77], healthcare plan management [11], and patient-provider collaborative review [30, 31, 98].”
BackgroundUsing artificial intelligence to analyse and teach communication in healthcare
Butow, P., & Hoque, E. (2020) · The Breast · doi:10.1016/j.breast.2020.01.008 · Cited by 118 · cited 1×
“Talk2Care is intentionally designed to not provide health advice due to the concern about AI reliability in healthcare [24, 55, 82].”
BackgroundFarmChat: A Conversational Agent to Answer Farmer Queries
Jain, M., Kumar, P., Bhansali, I., Liao, Q. V., Truong, K., & Patel, S. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3287048 · Cited by 117
Kocaballi, A. B., Ijaz, K., Laranjo, L., Quiroz, J. C., Rezazadegan, D., Tong, H. L., Willcock, S., Berkovsky, S., & Coiera, E. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa131 · Cited by 112 · cited 2×
“For healthcare professionals, researchers have also leveraged LLMs to support public health interventions [58], clinical pre-screening [48, 115], risk prediction [16, 42, 63, 86] and information processing [9, 10, 26, 64, 84, 85].”
BackgroundBeyond self-monitoring: understanding non-functional aspects of home-based healthcare technology
Grönvall, E., & Verdezoto, N. (2013) · Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing · doi:10.1145/2493432.2493495 · Cited by 108
Benefits and challenges of EMR implementations in low resource settings: a state-of-the-art review
Jawhari, B., Ludwick, D., Keenan, L., Zakus, D., & Hayward, R. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0354-8 · Cited by 106
Zubatiy, T., Vickers, K. L., Mathur, N., & Mynatt, E. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445124 · Cited by 105
Harrington, C. N., Garg, R., Woodward, A., & Williams, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501995 · Cited by 98
Eack, S. M., Greeno, C. G., & Lee, B.-J. (2006) · Research on Social Work Practice · doi:10.1177/1049731506291582 · Cited by 97
GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling
Xu, X., Liu, X., Zhang, H., Wang, W., Nepal, S., Sefidgar, Y., Seo, W., Kuehn, K. S., Huckins, J. F., Morris, M. E., et al. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3569485 · Cited by 96
Self-citationChung, C.-F., Wang, Q., Schroeder, J., Cole, A., Zia, J., Fogarty, J., & Munson, S. A. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3314394 · Cited by 93
Mieczkowski, H., Hancock, J. T., Naaman, M., Jung, M., & Hohenstein, J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449091 · Cited by 91
Assessing the Value of ChatGPT for Clinical Decision Support Optimization
Liu, S., Wright, A. P., Patterson, B. L., Wanderer, J. P., Turer, R. W., Nelson, S. D., McCoy, A. B., Sittig, D. F., & Wright, A. (2023) · doi:10.1101/2023.02.21.23286254 · Cited by 90
O’Caoimh, R., Cornally, N., Weathers, E., O'Sullivan, R., Fitzgerald, C., Orfila, F., Clarnette, R., Paúl, C., & Molloy, D. W. (2015) · Maturitas · doi:10.1016/j.maturitas.2015.03.009 · Cited by 89 · cited 2×
“For healthcare professionals, researchers have also leveraged LLMs to support public health interventions [58], clinical pre-screening [48, 115], risk prediction [16, 42, 63, 86] and information processing [9, 10, 26, 64, 84, 85].”
BackgroundAn Empirical Study of Older Adult’s Voice Assistant Use for Health Information Seeking
Brewer, R., Pierce, C., Upadhyay, P., & Park, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3484507 · Cited by 89
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
Wei, J., Kim, S., Jung, H., & Kim, Y.-H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637364 · Cited by 84
Using EHRs to integrate research with patient care: promises and challenges: Table 1
Weng, C., Appelbaum, P., Hripcsak, G., Kronish, I., Busacca, L., Davidson, K. W., & Bigger, J. T. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-000878 · Cited by 82
Overview on the Challenges and Benefits of Using Telehealth Tools in a Pediatric Population
Brophy, P. D. (2017) · Advances in Chronic Kidney Disease · doi:10.1053/j.ackd.2016.12.003 · Cited by 81
Opportunities and challenges of artificial intelligence in healthcare
Iliashenko, O. Y., Bikkulova, Z. U., & Dubgorn, A. S. (2019) · E3S Web of Conferences · doi:10.1051/e3sconf/201911002028 · Cited by 81
Yang, Q., Steinfeld, A. M., & Zimmerman, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09612 · Cited by 80
Data Decentralisation of LLM-Based Chatbot Systems in Chronic Disease Self-Management
Montagna, S., Ferretti, S., Klopfenstein, L. C., Florio, A., & Pengo, M. F. (2023) · Proceedings of the 2023 ACM Conference on Information Technology for Social Good · doi:10.1145/3582515.3609536 · Cited by 76 · cited 2×
“The latest studies have discussed and explored its application for individual patients’ in health information seeking [119, 128], mental health support [66, 68, 124], personal health coaching and management [81, 117] and health education [67, 81].”
BackgroundHome visits - central to primary care, tradition or an obligation? A qualitative study
Theile, G., Kruschinski, C., Buck, M., Müller, C. A., & Hummers-Pradier, E. (2011) · BMC Family Practice · doi:10.1186/1471-2296-12-24 · Cited by 75 · cited 1×
“Asking them to visit patients’ homes to check their health is not a scalable solution due to the significant workload [107].”
BackgroundAugmenting Language Models with Long-Term Memory
Wang, W., Dong, L., Cheng, H., Liu, X., Yan, X., Gao, J., & Wei, F. (2023) · arXiv · doi:10.48550/arxiv.2306.07174 · Cited by 72
Gudala, M., Ross, M. E. T., Mogalla, S., Lyons, M., Ramaswamy, P., & Roberts, K. (2022) · JMIR Aging · doi:10.2196/32169 · Cited by 71
Ryu, H., Kim, S., Kim, D., Han, S., Lee, K., & Kang, Y. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415223 · Cited by 66
Laukka, E., Huhtakangas, M., Heponiemi, T., Kujala, S., Kaihlanen, A.-M., Gluschkoff, K., & Kanste, O. (2020) · Journal of Medical Internet Research · doi:10.2196/21623 · Cited by 65 · cited 1×
“Firstly, getting feedback and progress via asynchronous messages is time-consuming, and digital messages could be lost due to providers’ hasty schedules [69].”
BackgroundThe Ethics of AI in Health Care: A Mapping ReviewPreprint
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3830408 · Cited by 65
Powering an AI Chatbot with Expert Sourcing to Support Credible Health Information Access
Xiao, Z., Liao, Q. V., Zhou, M., Grandison, T., & Li, Y. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584031 · Cited by 59
Augmenting Language Models with Long-Term Memory
Wang, W., Dong, L., Cheng, H., Liu, X., Yan, X., Gao, J., & Wei, F. (2023) · neural information processing systems · doi:10.52202/075280-3259 · Cited by 59
Medical text-based consultations on the Internet: A 4-year study
UMEFJORD, G., SANDSTROM, H., MALKER, H., & PETERSSON, G. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.01.009 · Cited by 56
TypeOut: Leveraging Just-in-Time Self-Affirmation for Smartphone Overuse Reduction
Xu, X., Zou, T., Han, X. L., Li, Y., Wang, R., Yuan, T., Wang, Y., Shi, Y., Mankoff, J. C., & Dey, A. K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517476 · Cited by 53
Self-citationExploring the Use of Large Language Models for Improving the Awareness of Mindfulness
Kumar, H., Wang, Y., Shi, J., Musabirov, I., Farb, N. A. S., & Williams, J. J. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585614 · Cited by 50
Large Language Models are Few-Shot Clinical Information ExtractorsPreprint
Agrawal, M., Hegselmann, S., Lang, H., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.12689 · Cited by 49
AI-Supported Messaging: An Investigation of Human-Human Text Conversation with AI Support
Hohenstein, J., & Jung, M. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188487 · Cited by 48
Older Adults' Needs for Home Health Care and the Potential for Human Factors Interventions
Mitzner, T. L., Beer, J. M., McBride, S. E., Rogers, W. A., & Fisk, A. D. (2009) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120905301118 · Cited by 47
Rubin, D. L., Parmer, J., Freimuth, V. S., Kaley, T., & Okundaye, M. (2011) · Journal of Health Communication · doi:10.1080/10810730.2011.604380 · Cited by 47
GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling GeneralizationPreprint
Xu, X., Zhang, H., Sefidgar, Y. S., Ren, Y., Liu, X., Seo, W., Bruning, J., Kuehn, K., Merrill, M. A., Nurius, P. S., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.02733 · Cited by 43
Self-citationShen, H., Huang, C.-Y., Wu, T., & Huang, T.-H. K. (2023) · Computer Supported Cooperative Work and Social Computing · doi:10.1145/3584931.3607492 · Cited by 42 · cited 1×
“Recently, the technology boost of Large Language Models (LLM), such as ChatGPT [87], has shown its great potential in engaging in, scaffolding, and processing natural conversations [54, 72, 102, 113, 120, 121].”
BackgroundPrivacyStreams: Enabling Transparency in Personal Data Processing for Mobile Apps
Li, Y., Chen, F., Li, T. J.-J., Guo, Y., Huang, G., Fredrikson, M., Agarwal, Y., & Hong, J. I. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130941 · Cited by 39
Firefox Voice: An Open and Extensible Voice Assistant Built Upon the Web
Cambre, J., Williams, A. C., Razi, A., Bicking, I., Wallin, A., Tsai, J., Kulkarni, C., & Kaye, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445409 · Cited by 39 · cited 1×
“For example, Natural Language Processing (NLP) methods have been used to build CAs in travel apps and browsers to simplify user interaction [25, 90], and LLMs have been used in CAs to interact with mobile UI and programming tasks [94, 113].”
MethodBoundary Negotiation for Patient-Provider Communication via WeChat in China
Ding, X., Chen, Y., Ding, Z., & Xu, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359259 · Cited by 39
Desai, S., & Chin, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581507 · Cited by 38
Xiao, Z., Zhou, M. X., Liao, Q. V., Mark, G. J., Chi, C., Chen, W., & Yang, H. (2019) · Cambridge University Engineering Department Publications Database · doi:10.48550/arxiv.1905.10700 · Cited by 38
Stara, V., Vera, B., Bolliger, D., Rossi, L., Felici, E., Di Rosa, M., de Jong, M., & Paolini, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/25891 · Cited by 36 · cited 2×
“Our results suggest that our LLM-powered communication tool can facilitate the asynchronous communication process, enrich the health information collected from older adults, and save providers’ efforts and time considerably. support [103, 105, 106].”
BackgroundPlease Call the Specialism: Using WeChat to Support Patient Care in China
Wang, D., Kale, S. D., & O’Neill, J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376274 · Cited by 36
Self-citationImproving Patient Pre-screening for Clinical Trials: Assisting Physicians with Large Language ModelsPreprint
den Hamer, D. M., Schoor, P., Polak, T. B., & Kapitan, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.07396 · Cited by 36
Bartle, V., Lyu, J., El Shabazz-Thompson, F., Oh, Y., Chen, A. A., Chang, Y.-J., Holstein, K., & Dell, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517683 · Cited by 35
Prompted LLMs as Chatbot Modules for Long Open-domain Conversation
Lee, G., Hartmann, V., Park, J., Papailiopoulos, D., & Lee, K. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.277 · Cited by 34 · cited 1×
“As pointed out by existing work in LLMs and natural language processing, there are restrictions to the number of tokens input to the LLMs [6], limiting the length of conversation history texts that could be included in LLM prompting [12, 70, 116].”
BackgroundDaisy: A Friendly Conversational Agent for Older Adults
Simpson, J., Gaiser, F., Macík, M., & Breßgott, T. (2020) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3405755.3406166 · Cited by 34
Prompted LLMs as Chatbot Modules for Long Open-domain Conversation
Lee, G., Hartmann, V., Park, J., Papailiopoulos, D., & Lee, K. (2023) · arXiv · doi:10.48550/arxiv.2305.04533 · Cited by 34
Stroke rehabilitation with a sensing surface
Boulanger, C., Boulanger, A., de Greef, L., et al. (2013) · doi:10.1145/2470654.2466160 · Cited by 29
Remote monitoring of stroke patients' rehabilitation using wearable accelerometers
Halloran, S., Tang, L., Guan, Y., Shi, J. Q., & Eyre, J. A. (2019) · International Symposium on Wearable Computers · doi:10.1145/3341163.3347731 · Cited by 29 · cited 1×
“…has focused on various home-based telehealth applications to support asynchronous communication between older adults and their healthcare providers, such as remote health monitoring [15, 34, 47, 59, 77], healthcare plan management [11], and patient-provider collaborative review [30, 31, 98].”
BackgroundFraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569893 · Cited by 28
Nair, V., Schumacher, E., & Kannan, A. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.26 · Cited by 27
Remote Patient Monitoring in Diabetes: How to Acquire, Manage, and Use All of the Data
Johnson, E. L., & Miller, E. (2022) · Diabetes Spectrum · doi:10.2337/dsi21-0015 · Cited by 25
Understanding the Needs and Challenges of Using Conversational Agents for Deaf Older Adults
Blair, J., & Abdullah, S. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3359487 · Cited by 23 · cited 1×
“Yet studies have also pointed out the limited use of these VAs by older adults due to usability barriers, cultural gaps, lack of explainability, and flexibility [18, 44, 49, 108, 131], and none of them have explored CAs as communication interfaces.”
BackgroundSeo, W., Buyuktur, A. G., Verma, S., Kim, H., Choi, S. W., Sedig, L., & Park, S. Y. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445120 · Cited by 18
"This machine is for the aides": Tailoring Voice Assistant Design to Home Health Care Work
Bartle, V., Albright, L., & Dell, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581118 · Cited by 18
Rao, P., & Joshi, A. (2020) · IndiaHCI '20: Proceedings of the 11th Indian Conference on Human-Computer Interaction · doi:10.1145/3429290.3429294 · Cited by 16
Kayser, J., Wang, X., Wu, Z., Dimoji, A., & Xiang, X. (2023) · JMIR Research Protocols · doi:10.2196/44210 · Cited by 16
How Cultural Norms Influence Persuasive Design: A Study on Chinese Food Journaling Apps
Lu, X., Chen, Y., & A. Epstein, D. (2021) · Designing Interactive Systems Conference 2021 · doi:10.1145/3461778.3462142 · Cited by 15
Bérubé, C., Kovacs, Z. F., Fleisch, E., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/32161 · Cited by 14 · cited 2×
“However, multiple studies have raised concerns about using LLMs for healthcare scenarios, due to their inconsistency, potential errors, and bias in clinical work [17, 55, 64].”
BackgroundKasim, H. F., Salih, A. İ., & Attash, F. M. (2023) · Public Health in Practice · doi:10.1016/j.puhip.2023.100368 · Cited by 14
Vinker, S., Weinfass, M., Kasinetz, L. M., Kitai, E., & Kaiserman, I. (2007) · Medical Informatics and the Internet in Medicine · doi:10.1080/14639230601178653 · Cited by 14
A review of literature on risk prediction tools for hospital readmissions in older adults
Gatt, M. L., Cassar, M., & Buttigieg, S. C. (2022) · Journal of Health Organization and Management · doi:10.1108/jhom-11-2020-0450 · Cited by 13 · cited 2×
“For healthcare professionals, researchers have also leveraged LLMs to support public health interventions [58], clinical pre-screening [48, 115], risk prediction [16, 42, 63, 86] and information processing [9, 10, 26, 64, 84, 85].”
BackgroundSupporting patient-provider communication and engagement with personal informatics data
Chung, C.-F. (2017) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3123024.3123197 · Cited by 12
Pandit, S., Tran, S., Gu, Y., Saraee, E., Jansen, F., Singh, S., Cao, S., Sadeghi, A., Shandelman, E., Ellis, T. D., et al. (2019) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3316782.3321537 · Cited by 8
ARGUELLO, D. J., Rogers, E., Denmark, G. H., Lena, J., Goodro, T., Anderson-Song, Q., Cloutier, G. J., Hillman, C. H., Kramer, A. F., Castaneda‐Sceppa, C., et al. (2023) · Sensors · doi:10.3390/s23042221 · Cited by 6
Self-citationKeep Me Updated! Memory Management in Long-term Conversations
Bae, S., Kwak, D., Kang, S., Lee, M. Y., Kim, S., Jeong, Y., Kim, H., Lee, S.-W., Park, W., & Sung, N. (2022) · arXiv · doi:10.48550/arxiv.2210.08750 · Cited by 5 · cited 1×
“As pointed out by existing work in LLMs and natural language processing, there are restrictions to the number of tokens input to the LLMs [6], limiting the length of conversation history texts that could be included in LLM prompting [12, 70, 116].”
BackgroundWith One Voice: Composing a Travel Voice Assistant from Repurposed Models
Poran, S., Amsalem, G., Beka, A., & Goldenberg, D. (2022) · Companion Proceedings of the Web Conference 2022 · doi:10.1145/3487553.3524228 · Cited by 4
Wireless monitoring of post-operative respiratory complications
Bates, A., Arvind, D. K., & Mann, J. (2011) · doi:10.1145/2077546.2077549 · Cited by 2 · cited 1×
“…has focused on various home-based telehealth applications to support asynchronous communication between older adults and their healthcare providers, such as remote health monitoring [15, 34, 47, 59, 77], healthcare plan management [11], and patient-provider collaborative review [30, 31, 98].”
BackgroundMitzner, T. L., Beer, J. M., McBride, S. E., Rogers, W. A., & Fisk, A. D. (2009) · PsycEXTRA Dataset · doi:10.1037/e578452012-019 · Cited by 2
Nair, V., Schumacher, E., & Kannan, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.05982 · Cited by 2
Chung, C.-F., Dew, K. N., Cole, A., et al. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.30102 · Cited by 2
Clinician Attitudes Towards Telemonitoring for Heart Failure Care: Opportunities for Design Research
Vugs, S., Scholte, N. T. B., Markopoulos, P., & Ronner, E. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585723 · Cited by 2
Shen, H., Huang, C.-Y., Wu, T., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.09770 · Cited by 1
Arbatti, L., Hosamath, A., Ramanarayanan, V., & Shoulson, I. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.04905 · Cited by 1
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI
Liu, H., Das, A., Boltz, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.07213
Laukka, E., Huhtakangas, M., Heponiemi, T., et al. (2020) · doi:10.2196/preprints.21623
Is pre-employment health screening by questionnaire effective?
Madan, I., & Williams, S. (2012) · Occupational Medicine · doi:10.1093/occmed/kqr208
Research works printed but not linked: 2
- Farah Magrabi, Elske Ammenwerth, Jytte Brender McNair, Nicolet F De Keizer, Hannele Hyppönen, Pirkko Nykänen, Michael Rigby, Philip J Scott, Tuulikki Vehko, Zoie Shui-Yee Wong, et al. 2019. Artificial intelligence in clinical decision support: challenges for evaluating AI and practical implications. Yearbook of medical informatics 28, 01 (2019), 128--134.
- Brendan Spillane, Emer Gilmartin, Christian Saam, Benjamin R Cowan, and Vincent Wade. 2018. ADELE: Care and Companionship for Independent Aging.. In ICAHGCA@ AAMAS. 18--24.
Cited by
From language to action: a review of large language models as autonomous agents and tool users
Chowa, S. S., Alvi, R., Rahman, S. S., Rahman, M. A., Raiaan, M. A. K., Islam, M. R., Hussain, M., & Azam, S. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11471-9 · Cited by 50
“Future research should enhance LLM agents’ scalability, adaptability, and real-time operational capacity, for deployment in multimodal and domain-specific environments [72,77,85,102].”
Clinical insights: A comprehensive review of language models in medicine
Neveditsin, N., Lingras, P., & Mago, V. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000800 · Cited by 37
“Among these, the GPT series [19] has advanced text generation capabilities while establishing the foundation for interactive applications.”
Voice Assistants for Health Self-Management: Designing for and with Older Adults
Mahmood, A., Cao, S., Stiber, M., Antony, V. N., & Huang, C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713839 · Cited by 50
Yang, B., Guo, Y., Xu, L., Yan, Z., Chen, H., Xing, G., & Jiang, X. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3712286 · Cited by 72
ASHABot: An LLM-Powered Chatbot to Support the Informational Needs of Community Health Workers
Ramjee, P., Chhokar, M., Sachdeva, B., Meena, M., Abdullah, H., Vashistha, A., Nagar, R., & Jain, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713680 · Cited by 69
Metadata
- Authors
- Yang, Z., Xu, X., Yao, B., Rogers, E., Zhang, S., Intille, S., Shara, N., Gao, G. G., & Wang, D.
- Affiliations
- University of Michigan (US)
- Massachusetts Institute of Technology (US)
- Rensselaer Polytechnic Institute (US)
- Northeastern University (US)
- MedStar Health Research Institute (US)
- Johns Hopkins University (US)
- ORCID
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2024-05-13
- Volume
- 8
- Issue
- 2
- Pages
- 1-35
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4396919238
- Cited by
- 120
- References
- 89
- Citations by year
- 2026: 50 · 2025: 64 · 2024: 6
- FWCI
- 102.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion, cc-by)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- Topics
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Innovation in Digital Healthcare Systems
- Keywords
- large language models, voice assistants, patient-provider communication, older adults, asynchronous communication, telemedicine, conversational interfaces, usability evaluation, user needs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.