A Digital Human for Delivering a Remote Loneliness and Stress Intervention to At-Risk Younger and Older Adults During the COVID-19 Pandemic: Randomized Pilot Trial
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Background: Loneliness is a growing public health issue that has been exacerbated in vulnerable groups during the COVID-19 pandemic. Computer agents are capable of delivering psychological therapies through the internet; however, there is limited research on their acceptability to date. Objective: The objectives of this study were to evaluate (1) the feasibility and acceptability of a remote loneliness and stress intervention with digital human delivery to at-risk adults and (2) the feasibility of the study methods in preparation for a randomized controlled trial. Methods: A parallel randomized pilot trial with a mixed design was conducted. Participants were adults aged 18 to 69 years with an underlying medical condition or aged 70 years or older with a Mini-Mental State Examination score of >24 (ie, at greater risk of developing severe COVID-19). Participants took part from their place of residence (independent living retirement village, 20; community dwelling, 7; nursing home, 3). Participants were randomly allocated to the intervention or waitlist control group that received the intervention 1 week later. The intervention involved completing cognitive behavioral and positive psychology exercises with a digital human facilitator on a website for at least 15 minutes per day over 1 week. The exercises targeted loneliness, stress, and psychological well-being. Feasibility was evaluated using dropout rates and behavioral observation data. Acceptability was evaluated from behavioral engagement data, the Friendship Questionnaire (adapted), self-report items, and qualitative questions. Psychological measures were administered to evaluate the feasibility of the trial methods and included the UCLA Loneliness Scale, the 4-item Perceived Stress Scale, a 1-item COVID-19 distress measure, the Flourishing Scale, and the Scale of Positive and Negative Experiences. Results: The study recruited 30 participants (15 per group). Participants were 22 older adults and 8 younger adults with a health condition. Six participants dropped out of the study. Thus, the data of 24 participants were analyzed (intervention group, 12; waitlist group, 12). The digital human intervention and trial methods were generally found to be feasible and acceptable in younger and older adults living independently, based on intervention completion, and behavioral, qualitative, and some self-report data. The intervention and trial methods were less feasible to nursing home residents who required caregiver assistance. Acceptability could be improved with additional content, tailoring to the population, and changes to the digital human’s design. Conclusions: Digital humans are a promising and novel technological solution for providing at-risk adults with access to remote psychological support during the COVID-19 pandemic. Research should further examine design techniques to improve their acceptability in this application and investigate intervention effectiveness in a randomized controlled trial. Trial Registration: Australia New Zealand Clinical Trials Registry ACTRN12620000786998; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=380113
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Loneliness and Social Isolation as Risk Factors for Mortality: A Meta-Analytic Review
Holt-Lunstad, J., Smith, T. B., Baker, M., Harris, T., & Stephenson, D. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691614568352 · Cited by 6,043
UCLA loneliness scale (version 3): reliability, validity, and factor structure
Russell, D. W. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6601_2 · Cited by 5,800
New well-being measures: Short scales to assess flourishing and positive and negative feelings
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-W., Oishi, S., & Biswas-Diener, R. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9493-y · Cited by 4,980 · cited 5×
“Psychological measures were administered to evaluate the feasibility of the trial methods and included the UCLA Loneliness Scale, the 4-item Perceived Stress Scale, a 1-item COVID-19 distress measure, the Flourishing Scale, and the Scale of Positive and Negative Experiences.”
InfluentialLoneliness matters: a theoretical and empirical review of consequences and mechanisms
Hawkley, L. C., & Cacioppo, J. T. (2010) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9210-8 · Cited by 4,782 · cited 1×
“While brief feelings of loneliness can serve as an adaptive motivator to seek social interaction, chronic loneliness has negative effects on physical and mental health outcomes [11,12].”
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
Sample size of 12 per group rule of thumb for a pilot study
Julious, S. A. (2005) · Pharmaceutical Statistics · doi:10.1002/pst.185 · Cited by 3,068
Review of the Psychometric Evidence of the Perceived Stress Scale
Lee, E.-H. (2012) · Asian Nursing Research · doi:10.1016/j.anr.2012.08.004 · Cited by 2,305 · cited 1×
“Although the psychometric properties of the PSS-10 and PSS-14 have been shown to be superior, the PSS-4 was chosen as it is a shorter measure of perceived stress that reduces participant burden and has adequate internal consistency reliability [56].”
A Meta-Analysis of Interventions to Reduce Loneliness
Masi, C. M., Chen, H.-Y., Hawkley, L. C., & Cacioppo, J. T. (2011) · Personality and Social Psychology Review · doi:10.1177/1088868310377394 · Cited by 1,995 · cited 4×
“Loneliness can be improved through psychological interventions that target the following 4 key areas: changing maladaptive social cognitions, increasing social support, increasing opportunities for social interaction, and improving social skills [16].”
InfluentialValtorta, N. K., Kanaan, M., Gilbody, S., Ronzi, S., & Hanratty, B. (2016) · Heart · doi:10.1136/heartjnl-2015-308790 · Cited by 1,971
Covid-19: risk factors for severe disease and death
Jordan, R. E., Adab, P., & Cheng, K. K. (2020) · BMJ · doi:10.1136/bmj.m1198 · Cited by 1,653 · cited 1×
“This included older adults over the age of 70 years (who are at greater risk of dying from COVID-19) [5] and younger adults with an underlying medical condition who may be immunocompromised [6].”
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 2×
“CAs are artificial agents that include a dialogue system, and may or may not include a digital embodiment or face [28].”
Loneliness: clinical import and interventions
Cacioppo, S., Grippo, A. J., London, S., Goossens, L., & Cacioppo, J. T. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615570616 · Cited by 1,206 · cited 1×
“The intervention content could be expanded with evidence-based techniques, such as cognitive behavioral and mindfulness exercises to reduce maladaptive social cognition, which have been shown to be the most effective techniques for reducing loneliness in a meta-analysis [16,19,75].”
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 2×
“Research has shown that engagement with eHealth interventions is often lower than what is observed in trials [23,24].”
The Prevalence of Loneliness Among Adults: A Case Study of the United Kingdom
Victor, C. R., & Yang, K. (2012) · The Journal of Psychology · doi:10.1080/00223980.2011.613875 · Cited by 746
Bu, F., Steptoe, A., & Fancourt, D. (2020) · Public Health · doi:10.1016/j.puhe.2020.06.036 · Cited by 703
Creswell, J. D., Irwin, M. R., Burklund, L. J., Lieberman, M. D., Arevalo, J. M. G., Ma, J., Breen, E. C., & Cole, S. W. (2012) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2012.07.006 · Cited by 607 · cited 2×
“The intervention content could be expanded with evidence-based techniques, such as cognitive behavioral and mindfulness exercises to reduce maladaptive social cognition, which have been shown to be the most effective techniques for reducing loneliness in a meta-analysis [16,19,75].”
The Psychosocial Effects of a Companion Robot: A Randomized Controlled Trial
Robinson, H., MacDonald, B., Kerse, N., & Broadbent, E. (2013) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2013.02.007 · Cited by 546 · cited 1×
“For example, Paro, a companion robot in the form of a fluffy baby harp seal, alleviated feelings of loneliness in older adults in nursing homes by providing direct companionship in a manner akin to a pet [31].”
Self-citationRathbone, A. L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7740 · Cited by 497 · cited 2×
“Research has shown that engagement with eHealth interventions is often lower than what is observed in trials [23,24].”
Loneliness and pathways to disease
Hawkley, L. C., & Cacioppo, J. T. (2003) · Brain, Behavior, and Immunity · doi:10.1016/s0889-1591(02)00073-9 · Cited by 446 · cited 1×
“The sympathetic nervous system becomes activated, and over a prolonged period, it creates negative downstream effects on the cardiovascular, neuroendocrine, and immune systems [14].”
The benefits of and barriers to using a social robot paro in care settings: a scoping review
Hung, L., Liu, C., Woldum, E., Au-Yeung, A., Berndt, A., Wallsworth, C., Horne, N., Gregorio, M., Mann, J., & Chaudhury, H. (2019) · BMC Geriatrics · doi:10.1186/s12877-019-1244-6 · Cited by 356 · cited 1×
“CAs may be more feasible for providing remote support than robots because they are less expensive and more scalable [29], as they can be accessed through websites or software applications on devices that many patients already own (eg, smartphones and computers).”
The Personalization of Conversational Agents in Health Care: Systematic Review
Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E. (2019) · Journal of Medical Internet Research · doi:10.2196/15360 · Cited by 332 · cited 1×
“Some research suggests that greater personalization of CAs (eg, through feedback, daily health reports, and recommendations) may improve acceptability and user engagement [72].”
Jia, R., Ayling, K., Chalder, T., Massey, A., Broadbent, E., Coupland, C., & Vedhara, K. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040620 · Cited by 329
Self-citationGreer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J., & Haritatos, J. (2019) · JMIR mHealth and uHealth · doi:10.2196/15018 · Cited by 265 · cited 2×
“Vivibot, a Facebook messenger chatbot that delivered positive psychology exercises over 4 weeks, was found to be acceptable and effective for reducing anxiety in young adults with a chronic health condition [39].”
Deckx, L., van den Akker, M., & Buntinx, F. (2014) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2014.05.002 · Cited by 206 · cited 1×
“Older adults and adults with underlying health conditions were already at greater risk of loneliness prepandemic [8,9], and these restrictions have exacerbated this risk.”
Rauschenberg, C., Schick, A., Hirjak, D., Seidler, A., Paetzold, I., Apfelbacher, C., Riedel-Heller, S. G., & Reininghaus, U. (2021) · Journal of Medical Internet Research · doi:10.2196/23365 · Cited by 205 · cited 1×
“Indeed, other studies have found that digital psychological interventions have been effective during the pandemic (eg, mHealth apps) [63,64].”
Design Features of Embodied Conversational Agents in eHealth: a Literature Review
ter Stal, S., Kramer, L. L., Tabak, M., op den Akker, H., & Hermens, H. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102409 · Cited by 188 · cited 2×
“Questions remain around how to optimally design CAs for health care applications [66,71].”
Psychometric Properties of the Flourishing Scale in a New Zealand Sample
Hone, L., Jarden, A., & Schofield, G. (2014) · Social Indicators Research · doi:10.1007/s11205-013-0501-x · Cited by 168
Gasteiger, N., Loveys, K., Law, M., & Broadbent, E. (2021) · Clinical Interventions in Aging · doi:10.2147/cia.s282709 · Cited by 153 · cited 1×
“A recent scoping review on robot-facilitated loneliness interventions found evidence supporting their use with older adults [30].”
Self-citationSun, S., Lin, D., Goldberg, S., Shen, Z., Chen, P., Qiao, S., Brewer, J., Loucks, E., & Operario, D. (2022) · Journal of Counseling Psychology · doi:10.1037/cou0000568 · Cited by 138 · cited 1×
“Indeed, other studies have found that digital psychological interventions have been effective during the pandemic (eg, mHealth apps) [63,64].”
Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review
Kramer, L. L., ter Stal, S., Mulder, B. C., de Vet, E., & van Velsen, L. (2020) · Journal of Medical Internet Research · doi:10.2196/14058 · Cited by 121 · cited 1×
“Indeed, other research has argued the importance of a co-design process with users and stakeholders to increase acceptability and encourage successful implementation, and future research should adopt this process [73,74].”
Social support agents for older adults: longitudinal affective computing in the home
Ring, L., Shi, L., Totzke, K., & Bickmore, T. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-014-0157-0 · Cited by 97
Easton, K., Potter, S., Bec, R., Bennion, M., Christensen, H., Grindell, C., Mirheidari, B., Weich, S., de Witte, L., Wolstenholme, D., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12996 · Cited by 88 · cited 1×
“This study achieved positive results that align with prior CA research showing good acceptability at delivering loneliness interventions to older people [38,68,69], and psychological support for well-being [70] and anxiety in adults with chronic health conditions [39].”
Bott, N., Wexler, S., Drury, L., Pollak, C., Wang, V., Scher, K., & Narducci, S. (2019) · Journal of Medical Internet Research · doi:10.2196/13440 · Cited by 61 · cited 1×
“However, a study found that daily conversations with an animal-like embodied CA over the course of a hospital stay significantly improved loneliness in older adults [37].”
Barrett, E., Burke, M., Whelan, S., Santorelli, A., Oliveira, B. L., Cavallo, F., Dröes, R.-M., Hopper, L., Fawcett-Henesy, A., Meiland, F. J. M., et al. (2019) · Journal of Gerontological Nursing · doi:10.3928/00989134-20190531-01 · Cited by 60 · cited 1×
“Other robots include Giraff (a telepresence robot that connects users and their families over video call [32]), MARIO (which includes a My Memories function where users can show photographs to others as a conversation starter [33]), and SYMPARTNER (which reminds people of their upcoming social engagements [34]).”
Pilot testing a digital pet avatar for older adults
Chi, N.-C., Sparks, O., Lin, S.-Y., Lazar, A., Thompson, H. J., & Demiris, G. (2017) · Geriatric Nursing · doi:10.1016/j.gerinurse.2017.04.002 · Cited by 56
Loveys, K., Fricchione, G., Kolappa, K., Sagar, M., & Broadbent, E. (2019) · Journal of Medical Internet Research · doi:10.2196/13664 · Cited by 54
Self-citationStara, V., Vera, B., Bolliger, D., Rossi, L., Felici, E., Di Rosa, M., de Jong, M., & Paolini, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/25891 · Cited by 36
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Artificial intelligence in surgery
Varghese, C., Harrison, E. M., O’Grady, G., & Topol, E. J. (2024) · Nature Medicine · doi:10.1038/s41591-024-02970-3 · Cited by 287
He, Y., Yang, L., Qian, C., Li, T., Su, Z., Zhang, Q., & Hou, X. (2023) · Journal of Medical Internet Research · doi:10.2196/43862 · Cited by 213
He, Y., Yang, L., Zhu, X., Wu, B., Zhang, S., Qian, C., & Tian, T. (2022) · Journal of Medical Internet Research · doi:10.2196/40719 · Cited by 178
Metadata
- Authors
- Loveys, K., Sagar, M., Pickering, I., & Broadbent, E.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2021-11-08
- Volume
- 8
- Issue
- 11
- Pages
- e31586
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W3204686589
- Cited by
- 86
- References
- 38
- FWCI
- 10.71
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.