Use and Effect of Web-Based Embodied Conversational Agents for Improving Eating Behavior and Decreasing Loneliness Among Community-Dwelling Older Adults: Protocol for a Randomized Controlled Trial
Open accessPublished version of a preprint
Abstract
Background: An unhealthy eating pattern and loneliness negatively influence quality of life in older age. Embodied conversational agents (ECAs) are a promising way to address these health behaviors in an engaging manner. Objective: We aim to (1) identify whether ECAs can persuade community-dwelling older adults to change their dietary behavior and whether ECA use can decrease loneliness, (2) test these pathways to effects, and (3) understand the use of an ECA. Methods: The web-based eHealth app PACO is a fully automated 8-week intervention in which 2 ECAs engage older adults in dialogue to motivate them to change their dietary behavior and decrease their loneliness. PACO was developed via a human-centered and stakeholder-inclusive design approach and incorporates Self-determination Theory and various behavior change techniques. For this study, an unblinded randomized controlled trial will be performed. There will be 2 cohorts, with 30 participants per cohort. Participants in the first cohort will immediately receive the PACO app for 8 weeks, while participants in the second cohort receive the PACO app after a waiting-list condition of 4 weeks. Participants will be recruited via social media, an online panel, flyers, and advertorials. To be eligible, participants must be at least 65 years of age, must not be in paid employment, and must live alone independently at home. Primary outcomes will be self-assessed via online questionnaires at intake, control, after 4 weeks, and after 8 weeks, and will include eating behavior and loneliness. In addition, the primary outcome—use—will be measured via data logs. Secondary outcomes will be measured at the same junctures, via either validated, self-assessed, online questionnaires or an optional interview. Results: As of July 2020, we have begun recruiting participants. Conclusions: By unraveling the mechanisms behind the use of a web-based intervention with ECAs, we hope to gain a fine-grained understanding of both the effectiveness and the use of ECAs in the health context. Trial Registration: ClinicalTrials.gov NCT04510883; https://clinicaltrials.gov/ct2/show/NCT04510883 International Registered Report Identifier (IRRID): PRR1-10.2196/22186
AI snapshot
Written from the paper’s full text.
TL;DR
This paper is the protocol for an unblinded randomized controlled trial evaluating PACO, a fully automated 8-week web-based app in which two embodied conversational agents (ECAs) dialogue with community-dwelling older adults to improve eating behavior and decrease loneliness. No outcome results are reported; recruitment had begun as of July 2020.
Key findings
- No effectiveness results are reported: "As of July 2020, we have begun recruiting participants."
- The trial aims to include 60 participants (30 per cohort), a number based on the 10-times rule for partial least squares structural equation modeling (PLS-SEM), discussed with a statistician.
- Primary outcomes are use (measured via data logs), eating behavior (three open 24-hour recall questions on fruit, vegetables, and drinks), and loneliness (De Jong Gierveld Loneliness Scale, 6 items).
- The paper presents two conceptual models to be tested: one explaining ECA use (CEU) and one explaining health effects (CHE), the latter grounded in Self-determination Theory.
Methods
- Design: unblinded randomized controlled trial with two cohorts of 30. Cohort 1 receives the 8-week PACO app immediately; cohort 2 receives it after a 4-week waiting-list condition and serves as the control group. Questionnaires are administered at control, intake (T0), 4 weeks (T1), and 8 weeks (T2), plus data logs during the intervention and an optional ~30-minute interview.
- Participants: recruited via an existing online panel (Ouderenpanel), flyers, advertorials in local/community newspapers and social media, and participant referrals. Eligibility: aged ≥65 years, not in paid employment, living alone independently at home, Dutch-speaking, able to use a tablet/computer, and with home wireless internet. No exclusion criteria apart from willingness to provide informed consent.
- Analysis: descriptive statistics for demographics, data logs, and willingness-to-pay; within-subject t tests comparing control, T0, T1, and T2; PLS-SEM in two phases (measurement model validation, then causal model testing) for the two conceptual models; thematic analysis (deductive and inductive) of interviews and open-ended user-experience questions. Participants with no PACO interaction for 14 consecutive days are treated as dropouts. Analyses in SPSS v24 and SmartPLS v3.
- Intervention: PACO has five modules applying behavior change techniques — food diary (self-monitoring), goals (action planning), recipes (tailoring and self-efficacy, >280 recipes), stories (social learning), and chat via WhatsApp groups (social facilitation). Two ECAs: Herman (the cook, nutritional advice) and Ellen (the peer, social advice).
Limitations
- Stated: the recruitment strategy is expected to include more women than men, though the authors note this reflects the greater number of single older women in the Netherlands; encouraging participants to invite relatives risks contamination, which will be monitored.
- Stated: use of the ECA intervention may be influenced by the study itself, since participants know they must complete multiple questionnaires and are phoned if they do not use the app for 7 days, potentially increasing use relative to a non-trial setting.
- Evident from the text: as a protocol, no effectiveness or use data are yet available, so all claims about ECA effects remain to be tested; the sample size (60) is small and justified by the 10-times rule and the study's explorative nature rather than a formal power calculation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 45 cited sources checked · 0 supported · 0 flagged
- Premisecitation
Loneliness is a significant predictor of malnutrition.
“and is a significant predictor of malnutrition [6]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [6] Ramic, E, 2011, Med. Arh
Not checked in the free run.
- Premisecitation
Loneliness is associated with a loss of pleasure in eating and cooking.
“As eating is regarded as a social activity, loneliness is associated with a loss of pleasure in eating and cooking [5]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [5] source
Not checked in the free run.
- Premisecitation
The expected increase in single, community-dwelling older adults in the coming years will exacerbate the loneliness problem.
“The expected increase in the coming years [9] in this group of single, community-dwelling older adults will exacerbate this problem.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [9] van Duin, C, 2016, Huishoudensprognose 2015–2060: jongeren en ouderen langer thuis
Not checked in the free run.
- Premisecitation
In the Netherlands, there are more single women than men in older age groups.
“given that there are more single women than men in older age groups in the Netherlands [61]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] CBSBevolking; geslacht, leeftijd en burgerlijke staat,Statline202009072020-12-23Den HaagCBShttps://opendata.cbs.nl/statline/#/CBS/nl/dataset/7461bev/table?ts=1565696300750
Not checked in the free run.
- Premisecitation
Self-monitoring and self-efficacy are associated with increased autonomy.
“Self-monitoring and self-efficacy are associated with increased autonomy [30].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [30] source
Not checked in the free run.
- Premisecitation
Interventions with an ECA are not immune to declining use over time.
“Nonetheless, interventions with an ECA are not immune to declining use over time, meaning that this issue must be addressed in ECA design to prevent limited long-term health effects [12].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
- Premisecitation
Action planning is found to be supportive of increasing competence.
“Action planning is found to be supportive of increasing competence [31].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] source
Not checked in the free run.
- Premisecitation
ECAs can make an intervention for coaching people in a healthy lifestyle more engaging than traditional electronic health interventions.
“ECAs can make an intervention for coaching people in a healthy lifestyle more engaging than traditional electronic health interventions [12].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
- Study design and conductreasoning
Use of the ECA intervention might be influenced by the study itself, with participants possibly using the app more often than if the intervention were applied outside a randomized controlled trial setting.
“Second, use of the ECA intervention might be influenced by the study itself.”
- Also stated in: § Limitations · hedged
“Thus, participants might be inclined to use the app more often than if the intervention were applied outside a randomized controlled trial setting.”
Quote in the paperNot a substantial claim - Also stated in: § Limitations · hedged
- Premisecitation
There is robust evidence that usability has a direct effect on perceived usefulness.
“Furthermore, there is robust evidence that usability has a direct effect on perceived usefulness [28].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] source
Not checked in the free run.
- Premisecitation
At the time of writing, evidence on the effectiveness and underlying working mechanisms of ECA use for health purposes remains inconclusive.
“At the time of writing, evidence on the effectiveness and underlying working mechanisms of ECA use for health purposes remains inconclusive [12].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
- Interpretationcitation
A majority of women in the study sample is a realistic reflection of Dutch society.
“a majority of women is a realistic reflection of society”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] CBSBevolking; geslacht, leeftijd en burgerlijke staat,Statline202009072020-12-23Den HaagCBShttps://opendata.cbs.nl/statline/#/CBS/nl/dataset/7461bev/table?ts=1565696300750
Not checked in the free run.
- Classified as probably not a substantial claim. 27
- May combine two claims. 15
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationIn the Netherlands, over 50% of older adults indicate experiencing loneliness, and this percentage is higher among people without a partner.
“In the Netherlands, over 50% of older adults indicate that they experience loneliness, a percentage that is even higher among people without a partner [8].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [8] GGDCBSRIVMGezondheidsmonitor Volwassenen en Ouderen201807052020-12-23https://www.volksgezondheidenzorg.info/onderwerp/eenzaamheid/cijfers-context/huidige-situatie#node-eenzaamheid-naar-leeftijd
Not checked in the free run.
May combine two claims.
PremisecitationUnhealthy eating and loneliness negatively influence quality of life in older age.
“Unhealthy eating and loneliness negatively influence quality of life (QoL) in older age [1,2].”
Quote in the paperSubstantial claim0 of 2 sources checkedClassified as probably not a substantial claim.
PremisecitationEmbodied conversational agents have been proposed as a promising technological tool to persuasively address health behaviors by changing users' attitudes or behaviors through persuasion and social influence rather than coercion.
“Embodied conversational agents (ECAs) have been proposed as a promising technological tool to persuasively address these health behaviors, with the aim of changing users’ attitudes or behaviors through persuasion and social influence rather than through coercion [10].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [10] source
Not checked in the free run.
May combine two claims.
Study design and conductcitationThe target sample size of 60 participants (30 per cohort) is based on the 10-times rule for PLS-SEM, discussed with a statistician, and considering current practices, the explorative nature of the study, and available staff.
“We aim to include a total of 60 participants: 30 in cohort 1 and 30 in cohort 2.”
- Also stated in: § Participants · plain
“The number of participants is based on the 10-times rule, a widely used minimum-sample-size estimation method for partial least squares structural equation modeling (PLS-SEM) [32]. This method was discussed with a statistician.”
- Also stated in: § Participants · plain
“In addition, we considered the current practices in the field [12], the explorative nature of this study, and the staff available to provide support.”
Quote in the paperSubstantial claim0 of 2 sources checked- Also stated in: § Participants · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study has been registered at ClinicalTrials.gov before the enrolment of participants (identifier NCT04510883).
“The study has been approved by the medical ethical committee of Wageningen University (number NL73121.081.20) and has been registered at ClinicalTrials.gov before the enrolment of participants (identifier NCT04510883).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenIn phase 1, the measurement model will be validated by testing the constructs separately to determine internal validity using SEM-oriented criteria and a traditional Cronbach alpha.
“In phase 1, the measurement model will be validated by testing the constructs separately to determine internal validity [using structural equation modeling (SEM)-oriented criteria and a traditional Cronbach alpha].”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study has been approved by the medical ethical committee of Wageningen University (number NL73121.081.20).
“The study has been approved by the medical ethical committee of Wageningen University (number NL73121.081.20) and has been registered at ClinicalTrials.gov before the enrolment of participants (identifier NCT04510883).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe randomized controlled trial will be unblinded.
“An unblinded randomized controlled trial will be carried out.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe intervention was developed via a human-centered and stakeholder-inclusive design approach, incorporating theory and various BCTs.
“The intervention was developed via a human-centered and stakeholder-inclusive design approach, incorporating theory and various BCTs.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVisual aesthetics, defined as an orderly and clear design, are closely related to many design rules advocated by usability experts.
“Visual aesthetics, defined as an orderly and clear design, are closely related to many of the design rules advocated by usability experts [21].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [21] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPerceiving something as enjoyable is linked to a positive effect on use when the system is perceived to be useful.
“Perceiving something as enjoyable is linked to a positive effect on use when the system is perceived to be useful [23].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Study design and conductnone givenA conservative approach will be adopted whereby the theoretical model will be adjusted only if this results in a large improvement in the model.
“A conservative approach will be adopted whereby the theoretical model will be adjusted only if this results in a large improvement in the model.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationAll usability issues were resolved, leading to the final app.
“All usability issues were resolved, leading to the final app.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [46] Groot, S, 2020, Wageningen University & Research
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationSelf-determination Theory postulates that human beings have three essential psychological needs: autonomy, competence, and relatedness.
“Briefly, SDT postulates that human beings have 3 essential psychological needs: autonomy (the feeling of being the origin of one’s own behaviors), competence (feeling effective), and relatedness (the need to feel belongingness and connectedness with others).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [29] source
Not checked in the free run.
May combine two claims.
PremisecitationIn previous studies by the authors, women were more interested in lifestyle-related studies, resulting in focus group sessions with an overrepresentation of women.
“In previous studies [44], we found women to be more interested in lifestyle-related studies, resulting in focus group sessions with an overrepresentation of women.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [44] Kramer, LL, 2021, Design for Health
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe PACO development process was based on the first three steps of the CeHRes Roadmap: contextual inquiry, value specification, and design phase.
“The PACO development process was based on the first 3 steps of the Center for eHealth Research and Disease Management (CeHRes) Roadmap [43]: the contextual inquiry, the value specification, and the design phase.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationThe design phase of the PACO app was based on the previous two phases and used Self-determination Theory as a foundation.
“The design phase of the PACO app was based on the previous 2 phases. In addition, the SDT [29] was used as a foundation.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationECAs' ability to make interventions more engaging is often ascribed to their capacity to establish and maintain an emphatic relationship.
“This ability is often ascribed to ECAs’ capacity to establish and maintain an emphatic relationship [12,13].”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
PremisecitationECAs are perceived as enjoyable, usable, and acceptable for addressing health behavior change.
“ECAs are perceived as enjoyable, usable, and acceptable for addressing health behavior change [16-18].”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenQualitative coding will be performed independently by two researchers, with differences resolved through discussion to produce a final codebook and coded transcripts.
“An initial list of inductive codes will be generated by LK and supplemented independently by another researcher. Differences will be discussed, leading to a final and agreed upon codebook. Each transcript will be coded by LK and another project member. Differences will be discussed again, leading to a final coded transcript.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationOlder adults from populations in which eHealth literacy is generally lower also form relationships with ECAs and consider them companions.
“including those from populations in which eHealth literacy is generally lower [15]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenEncouraging participants to invite relatives might induce a risk of contamination in the study.
“participants are encouraged to invite relatives, and this might induce a risk of contamination”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationEvidence of ECA effectiveness and underlying working mechanisms is scarce and remains inconclusive.
“Furthermore, and even more importantly, evidence of ECA effectiveness and underlying working mechanisms is scarce and remains inconclusive [12].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenAll collected data will be kept in secure online databases that are password-protected, with access limited to the study team.
“All collected data will be kept in secure online databases that are password-protected, with access limited to the study team.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn the case of patient portals, aesthetics have been found to influence usability in the context of explaining technology acceptance.
“In the case of patient portals, aesthetics have thus been found to influence usability in the context of explaining technology acceptance [22].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationAll secondary study parameters will be measured via validated, self-assessed, online questionnaires.
“All these parameters will be measured via validated, self-assessed, online questionnaires.”
Quote in the paperNot a substantial claim0 of 5 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe study expects to include more women than men.
“We expect to include more women than men.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [44] Kramer, LL, 2021, Design for Health
Not checked in the free run.
- cites [61] CBSBevolking; geslacht, leeftijd en burgerlijke staat,Statline202009072020-12-23Den HaagCBShttps://opendata.cbs.nl/statline/#/CBS/nl/dataset/7461bev/table?ts=1565696300750
Not checked in the free run.
May combine two claims.
Premisecitation94.5% of older Dutch adults aged 65-75 years have internet access at home, with 77% using the internet daily.
“The latter 2 criteria seem feasible, as 94.5% of all older Dutch adults aged 65-75 years have internet access at home, with 77% using the internet daily [34].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [34] CBSInternet; toegang, gebruik en faciliteiten; 2012-2019Statline201910082020-12-23https://opendata.cbs.nl/statline/#/CBS/nl/dataset/83429NED/table?fromstatweb
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWillingness to share personal information and preferences (absence of privacy concerns) is argued to be a prerequisite for convenience and a useful system.
“Willingness to share personal information and preferences (ie, the absence of privacy concerns) is argued to be a prerequisite for convenience and a useful system [24].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningA data safety monitoring board will not be used during the study.
“As participants are not exposed to any risks, a data safety monitoring board will not be used during the study.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants are not exposed to any risks.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn human-computer interaction literature, control has been identified as a crucial factor in the occurrence of perceived usefulness and use.
“Especially in human-computer interaction literature, control has been identified as a crucial factor in the occurrence of perceived usefulness and use [26,27].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe inclusion criteria fit a potential target audience of almost 1 million people.
“These inclusion criteria fit a potential target audience of almost 1 million people [33].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] CBSHuishoudens; personen naar geslachtStatline20201019Den HaagCBShttps://opendata.cbs.nl/#/CBS/nl/dataset/71488ned/table?dl=25C1C
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAudio recordings of the interviews will be transcribed until data saturation is reached.
“Audio recordings of the interviews will be transcribed until data saturation is reached.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenParticipants will be allocated to cohorts by random assignment of a digit (1 or 2) in a list generated by Excel.
“To allocate participants to a cohort, they will be randomly assigned a digit, either 1 or 2, in a list generated by Excel (version 16.0.13426.20274; Microsoft).”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationcitationThe scarcity and inconclusiveness of evidence on ECA effectiveness limits the possibility to learn from others' efforts and prevents knowledge accumulation.
“This limits the possibility to learn from others’ efforts and prevents knowledge accumulation.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationEarly studies show that older adults who interact with an ECA form a relationship with the ECA and consider it a companion.
“Early studies show that older adults who interact with an ECA form a relationship with the ECA and consider it a companion [14]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] source
Not checked in the free run.
The authors state this as an assumption.
An eHealth intervention will not be used if it does not create any benefit (perceived usefulness) or if it has a substantial number of usability problems.
“It is assumed that an eHealth intervention will not be used if it does not create any benefit (perceived usefulness) or if it has a substantial number of usability problems [20].”
The paper relies on this without support.
It is challenging to realize an actual change in eating behavior and deal with loneliness.
“However, it is challenging to realize an actual change in eating behavior and deal with loneliness.”
The paper relies on this without support.
Both unhealthy eating and loneliness are important risk factors for chronic diseases and are clearly associated with unhealthy eating behaviors.
“Both are important risk factors for chronic diseases and are clearly associated with unhealthy eating behaviors.”
The paper relies on this without support.
Participants are not exposed to any risks.
“As participants are not exposed to any risks, a data safety monitoring board will not be used during the study.”
The paper relies on this without support.
ECAs are a promising means of addressing health behavior change in general, including among community-dwelling older adults.
“ECAs seem to be a promising means of addressing health behavior change in general, including among community-dwelling older adults.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ECA use declines over time, limiting long-term health effects.
“Nonetheless, ECA use does decline over time, limiting long-term health effects [1,14-17].”
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · see citing works
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 27,815 · see citing works
Pls-Sem: indeed a silver bullet
Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011) · Journal of Marketing Theory and Practice · doi:10.2753/mtp1069-6679190202 · Cited by 21,631 · see citing works
Extrinsic and Intrinsic Motivation to Use Computers in the Workplace <sup>1</sup>
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1992) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1992.tb00945.x · Cited by 6,231 · cited 1× · see citing works
“Perceiving something as enjoyable is linked to a positive effect on use when the system is perceived to be useful [23].”
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
Moral Identity and Developmental Theory
Lapsley, D. K. (2015) · Human Development · doi:10.1159/000435926 · Cited by 3,836 · see citing works
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · see citing works
Basic psychological need satisfaction, need frustration, and need strength across four cultures
Chen, B., Vansteenkiste, M., Beyers, W., Boone, L., Deci, E. L., Van der Kaap-Deeder, J., Duriez, B., Lens, W., Matos, L., Mouratidis, A., et al. (2015) · Motivation and Emotion · doi:10.1007/s11031-014-9450-1 · Cited by 2,507 · see citing works
Persuasive Systems Design: Key Issues, Process Model, and System Features
Oinas-Kukkonen, H., & Harjumaa, M. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02428 · Cited by 1,663 · see citing works
A 6-Item Scale for Overall, Emotional, and Social Loneliness: Confirmatory Tests on Survey Data
Gierveld, J. D. J., & Tilburg, T. V. (2006) · Research on Aging · doi:10.1177/0164027506289723 · Cited by 1,467 · see citing works
Assessing dimensions of perceived visual aesthetics of web sites
Lavie, T., & Tractinsky, N. (2003) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2003.09.002 · Cited by 1,349 · see citing works
Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model
Heerink, M., Kröse, B., Evers, V., & Wielinga, B. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0068-5 · Cited by 1,229 · see citing works
Factors influencing acceptance of technology for aging in place: A systematic review
Peek, S. T. M., Wouters, E. J. M., van Hoof, J., Luijkx, K. G., Boeije, H. R., & Vrijhoef, H. J. M. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.004 · Cited by 1,206 · see citing works
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · see citing works
Personalization versus Privacy: An Empirical Examination of the Online Consumer’s Dilemma
Chellappa, R. K., & Sin, R. G. (2005) · Information Technology and Management · doi:10.1007/s10799-005-5879-y · Cited by 1,043 · see citing works
(2003) · Choice Reviews Online · doi:10.5860/choice.40-4648 · Cited by 779 · see citing works
Tennant, B., Stellefson, M., Dodd, V. J. N., Chaney, B. H., Chaney, D. J., Paige, S. R., & Alber, J. M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3992 · Cited by 762 · see citing works
Being alone in later life: Loneliness, social isolation and living alone
Victor, C., Scambler, S., Bond, J., & Bowling, A. (2000) · Reviews in Clinical Gerontology · doi:10.1017/s0959259800104101 · Cited by 730 · see citing works
Krantz, S. G. (1999) · doi:10.5948/upo9781614440260.011 · Cited by 714 · see citing works
Developing a scale to measure the interactivity of websites
Liu, Y. (2003) · Journal of Advertising Research · doi:10.2501/jar-43-2-207-216 · Cited by 659 · see citing works
Teixeira, P. J., Marques, M. M., Silva, M. N., Brunet, J., Duda, J. L., Haerens, L., La Guardia, J., Lindwall, M., Lonsdale, C., Markland, D., et al. (2020) · Motivation Science · doi:10.1037/mot0000172 · Cited by 528 · see citing works
Embodied conversational agents in clinical psychology: a scoping review
Provoost, S., Lau, H. M., Ruwaard, J., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6553 · Cited by 433 · see citing works
Motivation, self-determination, and long-term weight control
Teixeira, P. J., Silva, M. N., Mata, J., Palmeira, A. L., & Markland, D. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-22 · Cited by 422 · see citing works
Creating Rapport with Virtual Agents
Gratch, J., Wang, N., Gerten, J., Fast, E., & Duffy, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_12 · Cited by 419 · see citing works
van der Vaart, R., van Deursen, A. J., Drossaert, C. H., Taal, E., van Dijk, J. A., & van de Laar, M. A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1840 · Cited by 404 · see citing works
'It's just like you talk to a friend': relational agents for older adults
Bickmore, T. W., Caruso, L., Clough-Gorr, K., & Heeren, T. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2005.09.002 · Cited by 341 · cited 1× · see citing works
“ECAs are perceived as enjoyable, usable, and acceptable for addressing health behavior change [16-18].”
Prediction of Internet and World Wide Web usage at work: a test of an extended Triandis model
Cheung, W., Chang, M. K., & Lai, V. S. K. (2000) · Decision Support Systems · doi:10.1016/s0167-9236(00)00125-1 · Cited by 322 · see citing works
Dietary patterns and quality of life in older adults: a systematic review
Govindaraju, T., Sahle, B., McCaffrey, T., McNeil, J., & Owen, A. (2018) · Nutrients · doi:10.3390/nu10080971 · Cited by 314 · see citing works
A randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · cited 1× · see citing works
“ECAs are perceived as enjoyable, usable, and acceptable for addressing health behavior change [16-18].”
Bowling, A., Hankins, M. C., Windle, G., Bilotta, C., & Grant, R. (2012) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2012.08.012 · Cited by 251 · see citing works
Baker, T. B., Gustafson, D. H., & Shah, D. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2925 · Cited by 221 · see citing works
Designing Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166 · see citing works
Stephens, C. V., Alpass, F., Towers, A., & Stevenson, B. (2011) · Journal of Aging and Health · doi:10.1177/0898264311400189 · Cited by 161 · see citing works
Cole-Lewis, H., Ezeanochie, N., & Turgiss, J. (2019) · JMIR Formative Research · doi:10.2196/14052 · Cited by 155 · see citing works
Acceptance and usability of a relational agent interface by urban older adults
Bickmore, T. W., Caruso, L., & Clough-Gorr, K. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056879 · Cited by 142 · see citing works
Stewart, M., Craig, D. M., MacPherson, K. M., & Alexander, S. (2001) · Public Health Nursing · doi:10.1046/j.1525-1446.2001.00054.x · Cited by 134 · see citing works
The effect of loneliness on malnutrition in elderly population.
Ramić, E., Pranjić, N., Batić-Mujanović, O., Karic, E., Alibašić, E., & Alić, A. (2011) · PubMed · Cited by 133 · see citing works
Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review
Kramer, L. L., ter Stal, S., Mulder, B. C., de Vet, E., & van Velsen, L. (2020) · Journal of Medical Internet Research · doi:10.2196/14058 · Cited by 121 · cited 8× · see citing works
“This ability is often ascribed to ECAs’ capacity to establish and maintain an emphatic relationship [12,13].”
InfluentialSelf-citationAutonomy-Supportive Parenting and Autonomy-Supportive Sibling Interactions
van der Kaap‐Deeder, J., Vansteenkiste, M., Soenens, B., Loeys, T., Mabbe, E., & Gargurevich, R. (2015) · Personality and Social Psychology Bulletin · doi:10.1177/0146167215602225 · Cited by 115 · see citing works
Factors Influencing Food Choice for Independently Living Older People—A Systematic Literature Review
Host, A., McMahon, A.-T., Walton, K., & Charlton, K. (2016) · Journal of Nutrition in Gerontology and Geriatrics · doi:10.1080/21551197.2016.1168760 · Cited by 115 · see citing works
Ooi, K., Hew, J.-J., & Lee, V. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.01.017 · Cited by 113 · see citing works
Lazard, A. J., Watkins, I., Mackert, M., Xie, B., Stephens, K. K., & Shalev, H. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv174 · Cited by 112 · see citing works
Can Virtual Humans Be More Engaging Than Real Ones?
Gratch, J. S., Wang, N., Okhmatovskaia, A., Lamothe, F., Morales, M., van der Werf, R. J., & Morency, L. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73110-8_30 · Cited by 110 · see citing works
Achieving rapport with turn-by-turn, user-responsive emotional coloring
Acosta, J., & Ward, N. G. (2011) · Speech Communication · doi:10.1016/j.specom.2010.11.006 · Cited by 98 · see citing works
Campbell, R., Vansteenkiste, M., Delesie, L. M., Mariman, A. N., Soenens, B., Tobback, E., Van der Kaap-Deeder, J., & Vogelaers, D. P. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.01.003 · Cited by 94 · see citing works
Embodied Conversational Agents on a Common Ground
Ruttkay, Z., Dormann, C., & Noot, H. (2004) · Human-computer interaction series · doi:10.1007/1-4020-2730-3_2 · Cited by 86 · see citing works
Friederichs, S., Bolman, C., Oenema, A., Guyaux, J., & Lechner, L. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2974 · Cited by 69 · see citing works
Mini Nutritional Assessment (MNA): Research and Practice in the Elderly
Vellas, B. J., Garry, P. J., Guigoz, Y., & Services, N. N. (1999) · doi:10.1159/isbn.978-3-318-00379-6 · Cited by 59 · see citing works
Adaptive Interfaces and Agents
Jameson, A. (2007) · Human factors and ergonomics · doi:10.1201/9781410615862.ch22 · Cited by 57 · see citing works
van Velsen, L., van der Geest, T., van de Wijngaert, L., van den Berg, S., & Steehouder, M. (2015) · Journal of Organizational Computing and Electronic Commerce · doi:10.1080/10919392.2015.990782 · Cited by 32 · see citing works
Borkent, J. W., Naumann, E., Vasse, E., van der Heijden, E., & de van der Schueren, M. A. E. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16091562 · Cited by 28 · see citing works
Apps and Autonomy: Perceived Interactivity and Autonomous Regulation in mHealth Applications
Bellur, S. S., & DeVoss, C. L. (2018) · Communication Research Reports · doi:10.1080/08824096.2018.1501672 · Cited by 27 · see citing works
Kramer, L. L., Blok, M., van Velsen, L., Mulder, B. C., & de Vet, E. (2021) · Design for Health · doi:10.1080/24735132.2021.1885592 · Cited by 26 · see citing works
Self-citationToward a social psychology of solidarity.
Stern, P. C. (1986) · American Psychologist · doi:10.1037/0003-066x.41.2.229 · Cited by 24 · see citing works
Leisure, Relatedness, and Ill-Being among Older Adults in Long-Term Care
Duncan, J. M., Killian, T. S., & Lucier‐Greer, M. (2017) · Activities Adaptation & Aging · doi:10.1080/01924788.2017.1326764 · Cited by 22 · see citing works
Hajek, A., & König, H. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00447 · Cited by 16 · see citing works
Stokes, I. (2017) · Routledge eBooks · doi:10.4324/9781315264783-79 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- Ramic, E, 2011, Med. Arh, 65, 92
- van Duin, C, 2016, Huishoudensprognose 2015–2060: jongeren en ouderen langer thuis, 1
- Ruttkay, Z, 2004, From Brows to Trust, 1
- Kramer, LL, 2021, Design for Health
- Groot, S, 2020, Wageningen University & Research, 1
Cited by
Sorted by citations
Kramer, L. L., van Velsen, L., Clark, J. L., Mulder, B. C., & de Vet, E. (2022) · JMIR Formative Research · doi:10.2196/33974 · Cited by 31 · see citing works
Self-citation
- Authors
- Kramer, L. L., Mulder, B. C., van Velsen, L., & de Vet, E.
- Affiliations
- Wageningen University & Research (NL)
- Corresponding author
- Kramer, Lean L
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2021-01-06
- Volume
- 10
- Issue
- 1
- Pages
- e22186
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC7817356
- OpenAlex
- W3101961110
- Semantic Scholar
- cb8b63573714204d79ccc26b3a7a39ab0567cfd3
- Cited by
- 23
- References
- 58
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 5 · 2023: 4 · 2022: 3 · 2021: 4
- FWCI
- 3.01
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- Socio-Environmental Systems Modeling (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Twente Research Information (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Funders
- ZonMw (40-44300-98-110)
- Wageningen University and Research
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Demography › Technology Use by Older Adults
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- embodied conversational agents, dietary habits, loneliness, older adults, community-dwelling older adults, dietary behavior change, digital health interventions, self-determination theory, behaviour change techniques, persuasive technology, online intervention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review