Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index; 2 of the 39 sources its claims cite were checked for support.
Abstract
BACKGROUND: Embodied conversational agents (ECAs) have great potential for health apps but are rarely investigated as part of such apps. To promote the uptake of health apps, we need to understand how the design of ECAs can influence the preferences, motivation, and behavior of users. OBJECTIVE: This is one of the first studies that investigates how the appearance of an ECA implemented within a health app affects users' likeliness of following agent advice, their perception of agent characteristics, and their feeling of rapport. In addition, we assessed usability and intention to use. METHODS: The ECA was implemented within a frailty assessment app in which three health questionnaires were translated into agent dialogues. In a within-subject experiment, questionnaire dialogues were randomly offered by a young female agent or an older male agent. Participants were asked to think aloud during interaction. Afterward, they rated the likeliness of following the agent's advice, agent characteristics, rapport, usability, and intention to use and participated in a semistructured interview. RESULTS: A total of 20 older adults (72.2 [SD 3.5] years) participated. The older male agent was perceived as more authoritative than the young female agent (P=.03), but no other differences were found. The app scored high on usability (median 6.1) and intention to use (median 6.0). Participants indicated they did not see an added value of the agent to the health app. CONCLUSIONS: Agent age and gender little influence users' impressions after short interaction but remain important at first glance to lower the threshold to interact with the agent. Thus, it is important to take the design of ECAs into account when implementing them into health apps.
Overview
CoChat Summary
## TL;DR
This within-subject lab study of 20 older adults tested whether a frailty-assessment app’s ECA appearance (young female vs older male) changed users’ impressions after short interaction. The older male agent was rated more authoritative, but otherwise agent appearance had little effect; usability and intention to use were high, though participants saw little added value from the agent.
## Key findings
- A total of 20 older adults participated; their mean age was 72.2 years (SD 3.5).
- The older male agent was perceived as more authoritative than the young female agent (P = .03, r = .344); there were no significant differences for likeliness of following advice, other agent characteristics, or rapport items.
- The frailty assessment app scored high on usability (median 6.1, IQR 6.1–7.0) and intention to use (median 6.0, IQR 4.0–6.0) on a 7-point scale.
- Participants generally said they did not see added value in the agent; many felt the app was not personal and that the text-based interaction limited the agent’s usefulness.
## Methods
- Design: Within-subject lab experiment with counterbalanced order; each participant interacted with both agents, Sylvia (young female) and Egbert (older male), in random order.
- Sample/data: Older adults aged 65+, Dutch-speaking, cognitively able to work with an ECA (MMSE ≥ 23); 21 started and 1 was excluded for lack of computer experience, leaving 20 analyzed.
- Analysis: Post-interaction ratings were compared using Wilcoxon signed-rank tests for the crossover design; qualitative think-aloud audio and semistructured interviews were transcribed and thematically analyzed.
## Limitations
- The paper says the app may not have been mature enough because the agent conveyed most information via text, which may have reduced attention to the agent and made it harder to form impressions.
- The interaction time was likely too short to establish impressions of agent characteristics and rapport.
- The study could not disentangle whether the authority difference was due to agent age or gender, because these factors were not independently controlled.
- Evident from the text: the sample was small (n=20) and recruited from a Dutch eHealth panel and a physiotherapy practice, which limits generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
2 Valid · 0 Not valid · 20 Not checked · 31 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Research shows that collecting health data using a digital survey does not affect test reliability with respect to a paper version [3-5]”
§ Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study > Introduction
What the sources say
- Not checked — no full text of the sourcecites [3] source
- Supportedcites [4] source
The Results report similar test-retest reliability for PDA and paper versions of self-reported health measures, with no significant reliability differences across the measures tested. The study was conducted in 30 patients with stable rheumatoid arthritis, so it supports the claim for the digital and paper questionnaires it examined. (LLM, conf=0.92)
- Not checked yetcites [5] source
Checked before — its earlier verdict is held back until a new check runs.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Fanning and McAuley [7] showed that older adults may accept a tablet for health surveys”
§ Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study > Introduction
What the sources say
- Supportedcites [7] source
The Abstract’s Conclusions state that questionnaires delivered to older adults on tablets may be acceptable. The Discussion’s Principal Findings report that a significant majority of participants preferred the tablet questionnaires; the authors describe the evidence as preliminary. (LLM, conf=0.94)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The older male agent was perceived as more authoritative than the young female agent (P=.03), but no other differences were found.”
- Also stated in: § Agent Appearance · plain
“However, Egbert was rated significantly more authoritative than Sylvia (P=.03), resulting in a medium effect size (r=.344).”
- Also stated in: § Principal Findings Our results show that the appearance of an agent, in particular age and gender, affects users’ perceptions of agent authority but does not affect users’ perceptions of other agent characteristics, users’ feelings of rapport, or users’ likeliness of following agent advice. Compared with a young female agent, an older male agent is only seen as more authoritative. These results are not in line with our expectation that agents are perceived differently after a short interaction with a user. To the best of our knowledge, there is no existing research comparing users’ impressions of agents at first glance with those after short interactions. But research shows that in human-human interaction, first impressions, formed within milliseconds [28], are difficult to lose. Therefore, we assumed that the differences in perceptions of characteristics of a static image of a young female agent and an older male agent, as found in a previous study [16], would still be present after a short interaction with these agents. An explanation for this inconsistency could be that impressions in human-agent interaction differ from impressions in human-human interaction. Users’ judgments of agents may modify with ongoing interaction, as research shows that agents do have a second chance to make a first impression [13,29]. Therefore, differences in perceptions of both agents may have been present at first glance but disappeared after interaction. Further research is needed to confirm this finding. Future research could study users’ perceptions of agent characteristics with a larger study population. Eventually agents will be used in a long-term setting; therefore, it is interesting to research not only users’ perceptions at first glance and after short-term interaction, but also after long-term interaction. How do we explain the difference in perceptions of agent authority after a short interaction? Although research on short-term interaction with an agent indicates that an agent’s appearance, including clothing [18], racial concordance with the user [30,31], and similarity with the user [30,32], could affect users’ perceptions of the agent, to the best of our knowledge there is no research on agent authority after short interaction in particular. From a previous study [16], we see that at first glance, static images of male and older agents are indeed seen as more authoritative than female and young agents, respectively. In addition, the study shows that the differences found in authority are often higher compared with differences found for other characteristics tested, which could explain why the difference in authority level is still present after short interaction. However, since we did not control the age and gender of the agents in this study independently, it is difficult to say whether the difference in perception of agent authority is caused by agent age or gender in particular or solely by the combination. Future research could study which factors actually control the difference, researching users’ perceptions of agent authority by independently controlling the age and gender of the agents. In addition, future research could study how an agent’s authority is perceived after long-term interaction. We expect that the effect of the first impression established by agent age and gender on the impression after short interaction is small compared with the effect of other design features, such as the content and language of the messages, (absence of) agent speech, and the amount of embodiment. Our study shows that the majority of participants perceived the agents not as humans but as machines or cartoons and found interaction with the agents impersonal or artificial. They did not have the feeling of being in a conversation. These perceptions may indicate users had a negative adaptation gap [29], which occurs when a user overestimates the competency of an agent, creating a negative gap between expected and actual competency of the agent and resulting in the user being disappointed. This negative adaptation gap may have been caused by the content and language of agent messages, agents lacking speech, or agents having little embodiment, as supported by remarks made by participants during the thinking aloud sessions and interviews. Therefore, we believe it is important to manage users’ expectations of agent characteristics and functionality up front, ensuring users’ expectations match actual agent capabilities by explaining what the users can expect from the agent. Future research could study how an agent’s content, language, speech, and embodiment affect users’ perceptions of the conversation with the agent (eg, how these factors could make the conversation with an agent more human-like). Although our study shows agent age and gender have little effect on users’ impressions of the agent after short interaction, we believe that adapting these features to the user is important because they affect users’ impressions of the agent at first glance [17,19,33], and research shows that people with favorable impressions of someone tend to interact more with that person than they do others who gave unfavorable impressions [34]. Selecting an agent with the right age and gender could thus lower the threshold to interact with the agent and use the app. · plain
“Compared with a young female agent, an older male agent is only seen as more authoritative.”
§ Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study > Abstract > Results
plainn = 20 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Agent Appearance · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For the ratings of the likeliness of following the agent’s advice, no significant difference between Egbert and Sylvia was found.”
- Also stated in: § Principal Findings Our results show that the appearance of an agent, in particular age and gender, affects users’ perceptions of agent authority but does not affect users’ perceptions of other agent characteristics, users’ feelings of rapport, or users’ likeliness of following agent advice. Compared with a young female agent, an older male agent is only seen as more authoritative. These results are not in line with our expectation that agents are perceived differently after a short interaction with a user. To the best of our knowledge, there is no existing research comparing users’ impressions of agents at first glance with those after short interactions. But research shows that in human-human interaction, first impressions, formed within milliseconds [28], are difficult to lose. Therefore, we assumed that the differences in perceptions of characteristics of a static image of a young female agent and an older male agent, as found in a previous study [16], would still be present after a short interaction with these agents. An explanation for this inconsistency could be that impressions in human-agent interaction differ from impressions in human-human interaction. Users’ judgments of agents may modify with ongoing interaction, as research shows that agents do have a second chance to make a first impression [13,29]. Therefore, differences in perceptions of both agents may have been present at first glance but disappeared after interaction. Further research is needed to confirm this finding. Future research could study users’ perceptions of agent characteristics with a larger study population. Eventually agents will be used in a long-term setting; therefore, it is interesting to research not only users’ perceptions at first glance and after short-term interaction, but also after long-term interaction. How do we explain the difference in perceptions of agent authority after a short interaction? Although research on short-term interaction with an agent indicates that an agent’s appearance, including clothing [18], racial concordance with the user [30,31], and similarity with the user [30,32], could affect users’ perceptions of the agent, to the best of our knowledge there is no research on agent authority after short interaction in particular. From a previous study [16], we see that at first glance, static images of male and older agents are indeed seen as more authoritative than female and young agents, respectively. In addition, the study shows that the differences found in authority are often higher compared with differences found for other characteristics tested, which could explain why the difference in authority level is still present after short interaction. However, since we did not control the age and gender of the agents in this study independently, it is difficult to say whether the difference in perception of agent authority is caused by agent age or gender in particular or solely by the combination. Future research could study which factors actually control the difference, researching users’ perceptions of agent authority by independently controlling the age and gender of the agents. In addition, future research could study how an agent’s authority is perceived after long-term interaction. We expect that the effect of the first impression established by agent age and gender on the impression after short interaction is small compared with the effect of other design features, such as the content and language of the messages, (absence of) agent speech, and the amount of embodiment. Our study shows that the majority of participants perceived the agents not as humans but as machines or cartoons and found interaction with the agents impersonal or artificial. They did not have the feeling of being in a conversation. These perceptions may indicate users had a negative adaptation gap [29], which occurs when a user overestimates the competency of an agent, creating a negative gap between expected and actual competency of the agent and resulting in the user being disappointed. This negative adaptation gap may have been caused by the content and language of agent messages, agents lacking speech, or agents having little embodiment, as supported by remarks made by participants during the thinking aloud sessions and interviews. Therefore, we believe it is important to manage users’ expectations of agent characteristics and functionality up front, ensuring users’ expectations match actual agent capabilities by explaining what the users can expect from the agent. Future research could study how an agent’s content, language, speech, and embodiment affect users’ perceptions of the conversation with the agent (eg, how these factors could make the conversation with an agent more human-like). Although our study shows agent age and gender have little effect on users’ impressions of the agent after short interaction, we believe that adapting these features to the user is important because they affect users’ impressions of the agent at first glance [17,19,33], and research shows that people with favorable impressions of someone tend to interact more with that person than they do others who gave unfavorable impressions [34]. Selecting an agent with the right age and gender could thus lower the threshold to interact with the agent and use the app. · plain
“does not affect users’ perceptions of other agent characteristics, users’ feelings of rapport, or users’ likeliness of following agent advice.”
§ Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study > Results > Agent Appearance
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Principal Findings Our results show that the appearance of an agent, in particular age and gender, affects users’ perceptions of agent authority but does not affect users’ perceptions of other agent characteristics, users’ feelings of rapport, or users’ likeliness of following agent advice. Compared with a young female agent, an older male agent is only seen as more authoritative. These results are not in line with our expectation that agents are perceived differently after a short interaction with a user. To the best of our knowledge, there is no existing research comparing users’ impressions of agents at first glance with those after short interactions. But research shows that in human-human interaction, first impressions, formed within milliseconds [28], are difficult to lose. Therefore, we assumed that the differences in perceptions of characteristics of a static image of a young female agent and an older male agent, as found in a previous study [16], would still be present after a short interaction with these agents. An explanation for this inconsistency could be that impressions in human-agent interaction differ from impressions in human-human interaction. Users’ judgments of agents may modify with ongoing interaction, as research shows that agents do have a second chance to make a first impression [13,29]. Therefore, differences in perceptions of both agents may have been present at first glance but disappeared after interaction. Further research is needed to confirm this finding. Future research could study users’ perceptions of agent characteristics with a larger study population. Eventually agents will be used in a long-term setting; therefore, it is interesting to research not only users’ perceptions at first glance and after short-term interaction, but also after long-term interaction. How do we explain the difference in perceptions of agent authority after a short interaction? Although research on short-term interaction with an agent indicates that an agent’s appearance, including clothing [18], racial concordance with the user [30,31], and similarity with the user [30,32], could affect users’ perceptions of the agent, to the best of our knowledge there is no research on agent authority after short interaction in particular. From a previous study [16], we see that at first glance, static images of male and older agents are indeed seen as more authoritative than female and young agents, respectively. In addition, the study shows that the differences found in authority are often higher compared with differences found for other characteristics tested, which could explain why the difference in authority level is still present after short interaction. However, since we did not control the age and gender of the agents in this study independently, it is difficult to say whether the difference in perception of agent authority is caused by agent age or gender in particular or solely by the combination. Future research could study which factors actually control the difference, researching users’ perceptions of agent authority by independently controlling the age and gender of the agents. In addition, future research could study how an agent’s authority is perceived after long-term interaction. We expect that the effect of the first impression established by agent age and gender on the impression after short interaction is small compared with the effect of other design features, such as the content and language of the messages, (absence of) agent speech, and the amount of embodiment. Our study shows that the majority of participants perceived the agents not as humans but as machines or cartoons and found interaction with the agents impersonal or artificial. They did not have the feeling of being in a conversation. These perceptions may indicate users had a negative adaptation gap [29], which occurs when a user overestimates the competency of an agent, creating a negative gap between expected and actual competency of the agent and resulting in the user being disappointed. This negative adaptation gap may have been caused by the content and language of agent messages, agents lacking speech, or agents having little embodiment, as supported by remarks made by participants during the thinking aloud sessions and interviews. Therefore, we believe it is important to manage users’ expectations of agent characteristics and functionality up front, ensuring users’ expectations match actual agent capabilities by explaining what the users can expect from the agent. Future research could study how an agent’s content, language, speech, and embodiment affect users’ perceptions of the conversation with the agent (eg, how these factors could make the conversation with an agent more human-like). Although our study shows agent age and gender have little effect on users’ impressions of the agent after short interaction, we believe that adapting these features to the user is important because they affect users’ impressions of the agent at first glance [17,19,33], and research shows that people with favorable impressions of someone tend to interact more with that person than they do others who gave unfavorable impressions [34]. Selecting an agent with the right age and gender could thus lower the threshold to interact with the agent and use the app. · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the 20 usability ratings displayed a median of 6.1 (interquartile range [IQR] 6.1-7.0)”
- Also stated in: § Results · plain
“The app scored high on usability (median 6.1)”
§ Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study > Results > Usability and Intention to Use Frailty Assessment App
plainn = 20- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Results · plain
24 more claims
Create a free account to see all 53 claims and to verify the 8 references still open.
- It may state two separate claims as one. 17
- Probably not a substantial claim. 14
- The quote only partly states this claim. 1
Citations
Cites
Frailty in Older Adults: Evidence for a Phenotype
Fried, L. P., Tangen, C. M., Walston, J., Newman, A. B., Hirsch, C., Gottdiener, J., Seeman, T., Tracy, R., Kop, W. J., Burke, G., et al. (2001) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/56.3.m146 · Cited by 24,907 · cited 1×
“As people get older, they are likely to experience frailty, a decline in functional and cognitive abilities such as walking speed, balance control, and working memory [1,2].”
BackgroundThe Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782 · cited 1×
“Before interacting with the frailty assessment app, the participant completed the preinteraction questionnaire gathering the participant’s gender, date of birth, education, housing status, technology literacy, health literacy, and state of change for nutrition and physical activity [25].”
MethodRubenstein, L. Z., Harker, J. O., Salva, A., Guigoz, Y., & Vellas, B. (2001) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/56.6.m366 · Cited by 2,751 · cited 1×
“The Mini Nutritional Assessment [23] tests for malnutrition with 6 multiple-choice questions related to nutrition and weight.”
MethodBar, M., Neta, M., & Linz, H. (2006) · Emotion · doi:10.1037/1528-3542.6.2.269 · Cited by 693 · cited 1×
“But research shows that in human-human interaction, first impressions, formed within milliseconds [28], are difficult to lose.”
BackgroundTHE WARM‐COLD VARIABLE IN FIRST IMPRESSIONS OF PERSONS
KELLEY, H. H. (1950) · Journal of Personality · doi:10.1111/j.1467-6494.1950.tb01260.x · Cited by 509 · cited 1×
“Although our study shows agent age and gender have little effect on users’ impressions of the agent after short interaction, we believe that adapting these features to the user is important because they affect users’ impressions of the agent at first glance [17,19,33], and research shows that people with favorable imp…”
BackgroundQualitative Research: Observational methods in health care settings
Mays, N., & Pope, C. (1995) · BMJ · doi:10.1136/bmj.311.6998.182 · Cited by 491 · cited 2×
“ti Scientific Software Development GmbH) based on an empirical method proposed by Pope and Mays [27].”
MethodDoes computer-generated speech manifest personality? an experimental test of similarity-attraction
Nass, C., & Lee, K. M. (2000) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems · doi:10.1145/332040.332452 · Cited by 242 · cited 1×
“In addition, the use of speech is recommended because it could increase the sense of personality of an agent [41] and could be used to describe feelings [42].”
BackgroundGalvin, J. E., Roe, C. M., Coats, M. A., & Morris, J. C. (2007) · Archives of Neurology · doi:10.1001/archneur.64.5.725 · Cited by 236 · cited 1×
“The Alzheimer Disease Detection [22] tests for functional decline in memory using 8 yes or no items.”
MethodFrom Brows to Trust: Evaluating Embodied Conversational Agents
Ruttkay, Z., & Pélachaud, C. (2004) · Human-computer interaction series · doi:10.1007/1-4020-2730-3 · Cited by 192
The Effects of Image and Animation in Enhancing Pedagogical Agent Persona
Baylor, A. L., & Ryu, J. (2003) · Journal of Educational Computing Research · doi:10.2190/v0wq-nwgn-jb54-fat4 · Cited by 188 · cited 1×
“Existing research provides evidence for implementation of animations of the agent’s embodiment, showing that animations positively affect users’ impressions of the agent [38-40] and interaction time [13,39].”
BackgroundDesign Features of Embodied Conversational Agents in eHealth: a Literature Review
ter Stal, S., Kramer, L. L., Tabak, M., op den Akker, H., & Hermens, H. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102409 · Cited by 188 · cited 1×
“Although ECAs have the potential to be used as eHealth apps such as digital frailty assessments, little is known about how these agents should be designed and how the design affects our impressions of the agents, and no design guidelines exist [15].”
BackgroundSelf-citationDesiring to be in touch in a changing communications landscape: attitudes of older adults
Lindley, S. E., Harper, R., & Sellen, A. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518962 · Cited by 180 · cited 1×
“Research indicates that older adults put effort into learning new digital technologies as long as they are believed to be worthy of time and dedication (eg, when technology can be used to keep in touch with others to foster relationships [36]).”
BackgroundDesigning Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166 · cited 1×
“By interacting with the user face to face, ECAs can build trust and rapport—a close and harmonious relationship—leading to companionship and long-term continual use [11].”
BackgroundBliven, B. D., Kaufman, S. E., & Spertus, J. A. (2001) · Quality of Life Research · doi:10.1023/a:1016740312904 · Cited by 146 · cited 1×
“Research shows that collecting health data using a digital survey does not affect test reliability with respect to a paper version [3-5], and several”
BackgroundBergmann, K., Eyssel, F., & Kopp, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_13 · Cited by 136 · cited 3×
“Existing research provides evidence for implementation of animations of the agent’s embodiment, showing that animations positively affect users’ impressions of the agent [38-40] and interaction time [13,39].”
BackgroundNot For Me: Older Adults Choosing Not to Participate in a Social Isolation Intervention
Waycott, J., Vetere, F., Pedell, S., Morgans, A., Ozanne, E., & Kulik, L. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858458 · Cited by 127 · cited 2×
“In addition, intention to use digital technologies in elderly persons is, next to the quality of the technology itself, affected by their personal context (eg, their ability to concentrate) and social context (eg, whether family is around to provide technical support) [37].”
BackgroundFirst Impressions in Human--Agent Virtual Encounters
Cafaro, A., Vilhjálmsson, H. H., & Bickmore, T. (2016) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2940325 · Cited by 120 · cited 1×
“These impressions can be shaped by static [12] and dynamic characteristics [12,13].”
BackgroundHébert, R., Bravo, G., Korner-Bitensky, N., & Voyer, L. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00527-7 · Cited by 114
ter Stal, S., Tabak, M., op den Akker, H., Beinema, T., & Hermens, H. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1699744 · Cited by 102 · cited 5×
“This study builds on previous work [16] by studying users’ impressions of agents at first glance (using the zero acquaintance approach) and after a short interaction with the agents (using the thin-slicing approach).”
BackgroundMethodInfluentialSelf-citationKomatsu, T., Kurosawa, R., & Yamada, S. (2012) · International Journal of Social Robotics · doi:10.1007/s12369-011-0122-y · Cited by 100
Achieving rapport with turn-by-turn, user-responsive emotional coloring
Acosta, J. C., & Ward, N. (2010) · Speech Communication · doi:10.1016/j.specom.2010.11.006 · Cited by 95 · cited 2×
“3 | e19987 | p. 4https://humanfactors.jmir.org/2020/3/e19987 (page number not for citation purposes) XSL•FO RenderX • Likeliness of following the agent’s advice (on a 7-point Likert scale) • Agent characteristics ratings (all on 7-point Likert scales): friendliness, authority, involvement, reliability, intelligence •…”
BackgroundPerformance of health status measures with a pen based personal digital assistant
Kvien, T. K., Mowinckel, P., Heiberg, T., Dammann, K. L., Dale, Ø., Aanerud, G. J., Alme, T. N., & Uhlig, T. (2005) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2004.030437 · Cited by 92 · cited 1×
“Research shows that collecting health data using a digital survey does not affect test reliability with respect to a paper version [3-5], and several”
BackgroundUser Interface Design for Low-literate and Novice Users: Past, Present and Future
Medhi Thies, I. (2015) · Foundations and Trends in Human–Computer Interaction · doi:10.1561/1100000047 · Cited by 83 · cited 1×
“Low-literate users could benefit from multiple output modalities [43].”
BackgroundPatient Difficulty Using Tablet Computers to Screen in Primary Care
Hess, R., Santucci, A., McTigue, K., Fischer, G., & Kapoor, W. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0500-1 · Cited by 79 · cited 1×
“Research shows that collecting health data using a digital survey does not affect test reliability with respect to a paper version [3-5], and several”
BackgroundHow interface agents affect interaction between humans and computers
Forlizzi, J., Zimmerman, J., Mancuso, V., & Kwak, S. (2007) · Proceedings of the 2007 conference on Designing pleasurable products and interfaces · doi:10.1145/1314161.1314180 · Cited by 69 · cited 2×
“Other research focused on users’ perceptions of static agent images at first glance [17-19], showing that the agent’s gender and role affect the user’s perception of the agent.”
BackgroundAgent-User Concordance and Satisfaction with a Virtual Hospital Discharge Nurse
Zhou, S., Bickmore, T., Paasche-Orlow, M., & Jack, B. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-09767-1_63 · Cited by 57 · cited 1×
“How do we explain the difference in perceptions of agent authority after a short interaction? Although research on short-term interaction with an agent indicates that an agent’s appearance, including clothing [18], racial concordance with the user [30,31], and similarity with the user [30,32], could affect users’ perc…”
BackgroundAre the ``myths'' of low back pain alive in the general Norwegian population?
Ihlebæk, C., & Eriksen, H. R. (2003) · Scandinavian Journal of Public Health · doi:10.1080/14034940210165163 · Cited by 55
Enali: A Research and Design Framework for Virtual Characters and Pedagogical Agents
Veletsianos, G., Miller, C., & Doering, A. (2009) · Journal of Educational Computing Research · doi:10.2190/ec.41.2.c · Cited by 52 · cited 1×
“In addition, the use of speech is recommended because it could increase the sense of personality of an agent [41] and could be used to describe feelings [42].”
BackgroundA Comparison of Tablet Computer and Paper-Based Questionnaires in Healthy Aging Research
Fanning, J., & McAuley, E. (2014) · JMIR Research Protocols · doi:10.2196/resprot.3291 · Cited by 50 · cited 2×
“studies showed similar results for a population of older adults [6,7].”
BackgroundResultLooking the Part: The Effect of Attire and Setting on Perceptions of a Virtual Health Counselor
Parmar, D., Olafsson, S., Utami, D., & Bickmore, T. (2018) · Proceedings of the 18th International Conference on Intelligent Virtual Agents · doi:10.1145/3267851.3267915 · Cited by 50 · cited 2×
“Other research focused on users’ perceptions of static agent images at first glance [17-19], showing that the agent’s gender and role affect the user’s perception of the agent.”
BackgroundCowell, A. J., & Stanney, K. M. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39396-2_50 · Cited by 48 · cited 1×
“Existing research provides evidence for implementation of animations of the agent’s embodiment, showing that animations positively affect users’ impressions of the agent [38-40] and interaction time [13,39].”
BackgroundNon-response bias in a postal questionnaire survey on respiratory health in the old and very old
Hardie, J. A., Bakke, P. S., & Mørkve, O. (2003) · Scandinavian Journal of Public Health · doi:10.1177/140349480303100603 · Cited by 41 · cited 1×
“Research shows that the older and more frail adults get, the more they become nonrespondents to questionnaires [8,9], whereas refusal of face-to-face interviewing is less present in this population [8].”
BackgroundAdapting a Persuasive Conversational Agent for the Chinese Culture
Zhou, S., Zhang, Z., & Bickmore, T. (2017) · 2017 International Conference on Culture and Computing (Culture and Computing) · doi:10.1109/culture.and.computing.2017.42 · Cited by 31 · cited 1×
“How do we explain the difference in perceptions of agent authority after a short interaction? Although research on short-term interaction with an agent indicates that an agent’s appearance, including clothing [18], racial concordance with the user [30,31], and similarity with the user [30,32], could affect users’ perc…”
Backgroundvan Wissen, A., Vinkers, C., & van Halteren, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-31510-2_23 · Cited by 30 · cited 1×
“How do we explain the difference in perceptions of agent authority after a short interaction? Although research on short-term interaction with an agent indicates that an agent’s appearance, including clothing [18], racial concordance with the user [30,31], and similarity with the user [30,32], could affect users’ perc…”
BackgroundIs it Me or Is it what I say? Source Image and Persuasion
Nguyen, H., & Masthoff, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77006-0_29 · Cited by 28 · cited 1×
“Although our study shows agent age and gender have little effect on users’ impressions of the agent after short interaction, we believe that adapting these features to the user is important because they affect users’ impressions of the agent at first glance [17,19,33], and research shows that people with favorable imp…”
BackgroundOperational definition of active and healthy ageing: Roadmap from concept to change of management
Malva, J. O., & Bousquet, J. (2016) · Maturitas · doi:10.1016/j.maturitas.2015.11.004 · Cited by 26 · cited 1×
“As people get older, they are likely to experience frailty, a decline in functional and cognitive abilities such as walking speed, balance control, and working memory [1,2].”
BackgroundThe Effect of An Animated Virtual Character on Mobile Chat Interactions
Kang, S.-H., Feng, A. W., Leuski, A., Casas, D., & Shapiro, A. (2015) · Proceedings of the 3rd International Conference on Human-Agent Interaction · doi:10.1145/2814940.2814957 · Cited by 19 · cited 1×
“Existing research provides evidence for implementation of animations of the agent’s embodiment, showing that animations positively affect users’ impressions of the agent [38-40] and interaction time [13,39].”
BackgroundPersonality assessment and behavioral prediction at first impression
Vartanian, O. A., Stewart, K., Mandel, D. R., Pavlovic, N. J., McLellan, L., & Taylor, P. J. (2011) · Personality and Individual Differences · doi:10.1016/j.paid.2011.05.024 · Cited by 15
Beukema, S., van Velsen, L., Jansen-Kosterink, S., & Karreman, J. (2017) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0210 · Cited by 10 · cited 1×
“We suggest tailoring the content and language toward the personal characteristics of the user, as confirmed by existing research [35], and adapting the content to previous answers given by the user.”
MethodThe Reliability of Using Tablet Technology for Screening the Health of Older Adults
Lex, V. V., Frazer, S. W. T., Aurèle, N., Ammour, N., Susanna, D. S., Zia, G., & Hermie, H. (2018) · Studies in health technology and informatics · doi:10.3233/978-1-61499-852-5-651 · Cited by 7 · cited 2×
“studies showed similar results for a population of older adults [6,7].”
BackgroundResultDesigning game-based eHealth applications: strategies for sustainable engagement of older adults
de Vette, F. (2019) · doi:10.3990/1.9789036547994 · Cited by 5
Research works printed but not linked: 1
- van Velsen, L, 2018, Stud Health Technol Inform, 247, 651
Cited by
Liu, N., Yin, J., Tan, S. S.-L., Ngiam, K. Y., & Teo, H. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab151 · Cited by 179
Research Trends in Artificial Intelligence Applications in Human Factors Health Care: Mapping Review
Asan, O., & Choudhury, A. (2021) · JMIR Human Factors · doi:10.2196/28236 · Cited by 114
“One study in our review measured users’perception of an AI-based conversational agent [70], and another study developed an AI algorithm for real-time detection of patient emotional states and behavior adaptation to encourage positive health care experiences [59].”
BackgroundWutz, M., Hermes, M., Winter, V., & Köberlein-Neu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/46548 · Cited by 99
“Therefore, this relationship should also exist between users and the technology [13,15,16,23,26,54,76,78,79,82,84,87,88,94,105,112-114].”
InfluentialHarrington, C., & Egede, L. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580719 · Cited by 108
“In a systematic review of design features of embodied conversational agents [73], Stal et al highlight that there is no conclusive research on age preference of ECAs among older adults and more research is needed [73].”
BackgroundEnam, M. A., Murmu, C., & Dixon, E. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2476710 · Cited by 78
“For example, researchers have examined the effects of onscreen characteristics of embodied conversational agents in health-related contexts (Azevedo et al., 2018; Bickmore et al., 2009; Harrington & Egede, 2023; Miller & Bell, 2012; Stal et al., 2020).”
Metadata
- Authors
- ter Stal, S., Broekhuis, M., van Velsen, L., Hermens, H., & Tabak, M.
- Affiliations
- Roessingh Research and Development (NL)
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2020-09-04
- Volume
- 7
- Issue
- 3
- Pages
- e19987
- ISSN
- 2292-9495 (ISSN-L)
- PMC
- PMC7501582
- OpenAlex
- W3036831094
- Semantic Scholar
- 2ba810d5dbfa4d95cecb87ccc9c316849ed07d8e
- Cited by
- 36
- References
- 40
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 2 · 2023: 9 · 2022: 5 · 2021: 8
- FWCI
- 6.01
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Human Factors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Eurostars (10824)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- embodied conversational agents, agent appearance, health apps, older adults, frailty assessment, perceived authority, rapport, usability, intention to use, user preferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.