A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; 22 of the 52 sources its claims cite were checked for support.
Abstract
BACKGROUND: Hospitalized older adults often experience isolation and disorientation while receiving care, placing them at risk for many inpatient complications, including loneliness, depression, delirium, and falls. Embodied conversational agents (ECAs) are technological entities that can interact with people through spoken conversation. Some ECAs are also relational agents, which build and maintain socioemotional relationships with people across multiple interactions. This study utilized a novel form of relational ECA, provided by Care Coach (care.coach, inc): an animated animal avatar on a tablet device, monitored and controlled by live health advocates. The ECA implemented algorithm-based clinical protocols for hospitalized older adults, such as reorienting patients to mitigate delirium risk, eliciting toileting needs to prevent falls, and engaging patients in social interaction to facilitate social engagement. Previous pilot studies of the Care Coach avatar have demonstrated the ECA's usability and efficacy in home-dwelling older adults. Further study among hospitalized older adults in a larger experimental trial is needed to demonstrate its effectiveness. OBJECTIVE: The aim of the study was to examine the effect of a human-in-the-loop, protocol-driven relational ECA on loneliness, depression, delirium, and falls among diverse hospitalized older adults. METHODS: This was a clinical trial of 95 adults over the age of 65 years, hospitalized at an inner-city community hospital. Intervention participants received an avatar for the duration of their hospital stay; participants on a control unit received a daily 15-min visit from a nursing student. Measures of loneliness (3-item University of California, Los Angeles Loneliness Scale), depression (15-item Geriatric Depression Scale), and delirium (confusion assessment method) were administered upon study enrollment and before discharge. RESULTS: Participants who received the avatar during hospitalization had lower frequency of delirium at discharge (P<.001), reported fewer symptoms of loneliness (P=.01), and experienced fewer falls than control participants. There were no significant differences in self-reported depressive symptoms. CONCLUSIONS: The study findings validate the use of human-in-the-loop, relational ECAs among diverse hospitalized older adults.
Overview
CoChat Summary
## TL;DR
This case-control quasi-experimental pre-post study tested a human-in-the-loop, protocol-driven tablet avatar (Care Coach) in 95 hospitalized adults over 65 and found lower delirium and loneliness at discharge versus a control unit. The intervention did not improve depressive symptoms, and the paper reports fewer falls on the avatar units.
## Key findings
- In the intervention group, delirium presence decreased from enrollment to discharge, with McNemar tests showing P<.001; the control group showed no change (P=.25).
- Participants with avatars had a decrease in loneliness on the UCLA Loneliness Scale compared with controls (P=.01).
- There was no statistically significant difference in depressive symptoms between participants with and without avatars.
- Falls data were reported as unit-level quarterly rates: falls were reduced by 33% on one avatar unit with partial data, reduced by 82% on the avatar unit with complete data, and increased by 86% on the control unit.
## Methods
- Design: Case control quasi-experimental pre-post clinical study in 3 medical-surgical units of a 600+ bed community hospital in New York City; 1 control unit and 2 intervention units.
- Sample/data: 95 adults over age 65 (intervention n=41, control n=54); inclusion required consent or proxy consent, and patients who did not speak English were excluded.
- Analysis: Descriptive tests used Student t tests and chi-square; McNemar tests assessed within-group delirium change; ANCOVA/general linear models compared loneliness and depression between groups; falls were examined descriptively using quarterly unit-level quality improvement data.
## Limitations
- The paper states the study was limited by convenience sampling and possible referral bias by nurse managers.
- The authors note they could not control for differences in unit care model and participant exposure to care across units.
- Only English-speaking patients were enrolled, which excluded many potential participants in a diverse setting.
- Falls data were only available quarterly by unit, and slower recruitment on the second intervention unit led to partial falls data; additionally, individual-level comorbidity data were unavailable, limiting analysis of patient-specific effects.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
15 Valid · 1 Not valid · 16 Not checked · 38 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Previous pilot studies of the Care Coach avatar have demonstrated the ECA’s usability and efficacy in home-dwelling older adults.”
§ A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study > Abstract > Background
What the sources say
- Partly supportedcites [26] sourceExperimental — accuracy not yet measured
The Methods (Design; page not available) describe home use of the Care.Coach digital pet by ten older adults, and the Discussion reports companionship and perceived benefits. But the paper explores acceptance and usability, notes increasing usability challenges, and does not establish broad efficacy in home-dwelling older adults. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [30] Demiris, G, 2016, AMIA Annu Symp Proc
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Delirium significantly increases the risk of falls in the hospital setting [11,13,14].”
§ A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [11] source
- Partly supportedcites [13] sourceExperimental — accuracy not yet measured
The Future Directions and Recommendations section links delirium to falls, and Evaluation and Work-Up recommends preventing falls while caring for patients with delirium. Neither passage establishes that delirium significantly increases fall risk specifically in hospitals; no page numbers are available in our copy. (LLM, conf=0.82)
- Could not verifycites [14] sourceExperimental — accuracy not yet measured
The paper's main text discusses increased morbidity among hospitalized older patients with delirium, but does not identify hospital falls as an outcome. The only passage found on falls compares the economic costs of non-fatal falls with those of delirium; it does not say delirium increases fall risk (searched: hospital falls and falls). (LLM, conf=0.76)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The results of the previous pilot study demonstrated the feasibility of the Care Coach platform to improve clinically meaningful aspects of patient care in the home.”
§ A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study > Introduction > Objectives
What the sources say
- Partly supportedcites [26] sourceExperimental — accuracy not yet measured
The Methods (Design) describe a three-month deployment of the Care.Coach digital pet in ten older adults’ homes, and the Results (Benefits) report perceived benefits, including companionship, reminders, and enhanced social interaction. The paper does not demonstrate improvement in clinically meaningful patient-care outcomes; its conclusions concern companionship and social interaction, while noting usability issues. Page numbers are unavailable in our copy. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [30] Demiris, G, 2016, AMIA Annu Symp Proc
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In the United States, all of these risks are greatest among patients with limited English comprehension, low health literacy, and socioeconomic disadvantage [15].”
§ A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study > Introduction > Background
What the sources say
- Partly supportedcites [15] sourceExperimental — accuracy not yet measured
The Results (Study Population; page unavailable) report that older surgical patients who developed postoperative delirium had lower literacy. But literacy did not significantly predict delirium after adjustment, and the paper measures reading-test literacy rather than health literacy. It does not establish that loneliness, depression, delirium, and falls are greatest among patients with limited English comprehension or socioeconomic disadvantage. (LLM, conf=0.86)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“showed no statistically significant difference in depression between participants with and without avatars”
- Also stated in: § Depression · plain
“A general linear model examining admission and discharge endorsement of depression symptomology on the GDS between groups showed no statistically significant difference in depression between participants with and without avatars (see Table 3).”
§ A Protocol-Driven, Bedside Digital Conversational Agent to Support Nurse Teams and Mitigate Risks of Hospitalization in Older Adults: Case Control Pre-Post Study > Results > Depression
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Depression · plain
22 more claims
Create a free account to see all 70 claims and every source verdict.
- Probably not a substantial claim. 31
- It may state two separate claims as one. 22
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One of the quasi-experimental studies evaluated the medication adherence system of interaction dialogue, finding decreased delirium (p < 0.001) and loneliness (p = 0.01) [45].”
From A systematic review on healthcare artificial intelligent conversational agents for chronic conditions (2022) · cites this paper as [45]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In health-care context, human-in-the-loop concepts for conversational agents supporting hospital nurse teams has proved beneficial [13].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [13]
Citations
Cites
Sheikh (1986) · doi:10.1300/j018v05n01_09 · Cited by 7,236 · cited 1×
“Depression was measured using the Geriatric Depression Scale (GDS) 15-item short form [41].”
MethodA Short Scale for Measuring Loneliness in Large Surveys: Results From Two Population-Based Studies
Hughes, M. E., Waite, L. J., Hawkley, L. C., & Cacioppo, J. T. (2004) · Research on Aging · doi:10.1177/0164027504268574 · Cited by 4,781
Inouye, S. K., Westendorp, R. G., & Saczynski, J. S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)60688-1 · Cited by 3,722 · cited 4×
“One in 3 older adults reports loneliness in the United States [2], and a recent American Association of Retired Persons (AARP) survey found that approximately 42.6 million older adults suffer from chronic loneliness [3]; research demonstrates that loneliness is linked to a variety of negative health outcomes, includin…”
InfluentialCacioppo, J. T., Hughes, M. E., Waite, L. J., Hawkley, L. C., & Thisted, R. A. (2006) · Psychology and Aging · doi:10.1037/0882-7974.21.1.140 · Cited by 2,380 · cited 1×
“6 million older adults suffer from chronic loneliness [3]; research demonstrates that loneliness is linked to a variety of negative health outcomes, including high blood pressure [4], disability [5], functional decline [2], depression [6], and cognitive decline [7].”
BackgroundLoneliness in Older Persons: A Predictor of Functional Decline and Death
Perissinotto, C. M., Stijacic Cenzer, I., & Covinsky, K. E. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2012.1993 · Cited by 1,269
The direct costs of fatal and non-fatal falls among older adults — United States
Burns, E. R., Stevens, J. A., & Lee, R. (2016) · Journal of Safety Research · doi:10.1016/j.jsr.2016.05.001 · Cited by 861 · cited 1×
“The cost of this intervention is significantly less than the cost of a fall (the average hospital cost for a fall injury is over US $30,000) [50] or the potential cost of increased length of stay because of delirium, which is an average increase of 7.”
BackgroundReuben, D. B., Inouye, S. K., Bogardus, S. T., Baker, D. I., Leo‐Summers, L., & Cooney, L. M. (2000) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2000.tb03885.x · Cited by 802
Effectiveness of Multicomponent Nonpharmacological Delirium Interventions: A Meta-analysis
Hshieh, T. T., Yue, J., Oh, E., Puelle, M., Dowal, S., Travison, T., & Inouye, S. K. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.7779 · Cited by 801
The Confusion Assessment Method: A Systematic Review of Current Usage
Wei, L. A., Fearing, M. A., Sternberg, E. J., & Inouye, S. K. (2008) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2008.01674.x · Cited by 796 · cited 2×
“The confusion assessment method (CAM) was utilized to screen for delirium [39].”
BackgroundMethodHawkley, L. C., Thisted, R. A., Masi, C. M., & Cacioppo, J. T. (2010) · Psychology and Aging · doi:10.1037/a0017805 · Cited by 726 · cited 1×
“6 million older adults suffer from chronic loneliness [3]; research demonstrates that loneliness is linked to a variety of negative health outcomes, including high blood pressure [4], disability [5], functional decline [2], depression [6], and cognitive decline [7].”
Background
Research works printed but not linked: 3
- Adams, J, 2013, Nurs Econ, 31, 83
- Demiris, G, 2016, AMIA Annu Symp Proc, 2016, 496
- Singh, I, 2016, Gerontol Geriatr Res, 2, 1015
Cited by
Interventions to reduce falls in hospitals: a systematic review and meta-analysis
Morris, M. E., Webster, K., Jones, C., Hill, A.-M., Haines, T., McPhail, S., Kiegaldie, D., Slade, S., Jazayeri, D., Heng, H., et al. (2022) · Age and Ageing · doi:10.1093/ageing/afac077 · Cited by 272
“[64] reported a reduction in falls with the use of an embodied conversational agent.”
BackgroundFuture directions for chatbot research: An interdisciplinary research agenda
Følstad, A., Araujo, T., Law, E. L.-C., Brandtzaeg, P. B., Papadopoulos, S., Reis, L., Baez, M., Laban, G., McAllister, P., Ischen, C., et al. (2021) · Computing · doi:10.1007/s00607-021-01016-7 · Cited by 247
Machine Learning in Healthcare Communication
Siddique, S., & Chow, J. C. L. (2021) · Encyclopedia · doi:10.3390/encyclopedia1010021 · Cited by 190
Gasteiger, N., Loveys, K., Law, M., & Broadbent, E. (2021) · Clinical Interventions in Aging · doi:10.2147/cia.s282709 · Cited by 153
“Two used Care Coach, 32,47 two used Tanya 31,62 and the final study investigated differences between the AlwaysOn System delivered as both a virtual agent and a robot.”
InfluentialLiu, N., Yin, J., Tan, S. S.-L., Ngiam, K. Y., & Teo, H. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab151 · Cited by 179
“We also analyzed specific game elements from the included articles, such as avatars ( N ¼ 9), 28,38,44,51,54,74,80,96,97 goal-setting ( N ¼ 11), 38,59,64,69,72,75–78,86,97 self-monitoring self-monitoring and tracking ( N ¼ 25 ),”
Method
Metadata
- Authors
- Bott, N., Wexler, S., Drury, L., Pollak, C., Wang, V., Scher, K., & Narducci, S.
- Affiliations
- Stanford Medicine (US)
- Pace University (US)
- Jamaica Hospital (US)
- Corresponding author
- Bott, Nicholas
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-10-17
- Volume
- 21
- Issue
- 10
- Pages
- e13440
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6913375
- OpenAlex
- W2969720013
- Semantic Scholar
- e159012a618310fe0970a8d059ada07f64127230
- Cited by
- 61
- References
- 43
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 15 · 2023: 9 · 2022: 12 · 2021: 9 · 2020: 2
- FWCI
- 7.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- New York City Economic Development Corporation
- National Institute of Nursing Research (R44NR017842)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- embodied conversational agents, relational agents, hospitalized older adults, loneliness, depression, delirium, falls, human-in-the-loop, clinical protocols, nursing team, social isolation, social engagement, human-robot interaction
- MeSH terms
- Aged, Aged, 80 and over, Communication, Female, Hospitalization, Humans, Interpersonal Relations, Male, Nurses, Pilot Projects, Case-Control Studies, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

