The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
MAINTAINING ENGAGEMENT IN LONG-TERM INTERVENTIONS WITH RELATIONAL AGENTS
Open accessAbstract
We discuss issues in designing virtual humans for applications which require long-term voluntary use, and the problem of maintaining engagement with users over time. Concepts and theories related to engagement from a variety of disciplines are reviewed. We describe a platform for conducting studies into long-term interactions between humans and virtual agents, and present the results of two longitudinal randomized controlled experiments in which the effect of manipulations of agent behavior on user engagement was assessed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This interactive style enhances engagement by establishing a working alliance between the users and the CAs [57,58], reflecting the collaborative relationship between shared treatment goals and tasks [59], which is crucial for treatment success in psychotherapy and counseling [60].”
From Development and Evaluation of a Smartphone-Based Chatbot Coach to Facilitate a Balanced Lifestyle in Individuals With Headaches (BalanceUP App): Randomized Controlled Trial (2024) · cites this paper as [58]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Globally, current results [10, 11, 5, 6, 12] lead to the conclusion that the use of ECAs could improve the accessibility and acceptance of computer-based assistive technologies, compared to graphical user interfaces and voice interfaces, especially for older adults with cognitive impairment.”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The aforementioned authors have identified the following advantages of ECAs over other kinds of interfaces: naturalness [11, 5, 6], higher levels of attention [10, 11, 5], easy understanding [11, 5], believability [10, 11], higher motivation [10, 12, 13] and effectiveness [10, 11, 5].”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [12]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In addition, none of these studies involved older adults with cognitive impairment and the study conducted by Vardoulakis et al. was a WoZ study.”
From Usability assessment of interaction management support in LOUISE, an ECA-based user interface for elders with cognitive impairment (2018) · cites this paper as [12]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Health Behavior and Health Education: Theory, Research, and Practice
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-4-350_1 · Cited by 13,232
Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,654
Customer Loyalty: Toward an Integrated Conceptual Framework
Dick, A. S., & Basu, K. (1994) · Journal of the Academy of Marketing Science · doi:10.1177/0092070394222001 · Cited by 7,137
Flow: The Psychology of Optimal Experience
Mirvis, P. H., & Csikszentmihalyi, M. (1991) · Academy of Management Review · doi:10.2307/258925 · Cited by 3,758
Attitudes and Persuasion: Classic and Contemporary Approaches
Petty, R. E., & Cacioppo, J. T. (1981) · Medical Entomology and Zoology · Cited by 3,368
Health behavior and health education
(1990) · Choice Reviews Online · doi:10.5860/choice.28-2173 · Cited by 2,919
Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990.
Csíkszentmihályi, M. (1990) · Cited by 1,864
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333 · cited 4×
“Relational agents are conversational virtual humans designed to build and maintain long-term social-emotional relationships with their users (Bickmore and Picard 2005).”
BackgroundInfluentialSelf-citationConsolvo, S., McDonald, D. W., Toscos, T., Chen, M. Y., Froehlich, J. E., Harrison, B. L., Klasnja, P., LaMarca, A., LeGrand, L., Libby, R., et al. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357335 · Cited by 1,133
Health Behavior and Health Education
Glanz, K., Lewis, F. M., & Rimer, B. K. (1991) · Medicine & Science in Sports & Exercise · doi:10.1249/00005768-199112000-00016 · Cited by 1,127
Jakobson, R. (1981) · Mouton eBooks · doi:10.1515/9783110802122.18 · Cited by 1,082
The nature of rapport and its nonverbal correlates
Tickle-Degnen, L., & Rosenthal, R. (1990) · Psychological Inquiry · doi:10.1207/s15327965pli0104_1 · Cited by 960 · cited 1×
“Although many of these concepts have to do with short-term cognitive engagement in performing a task or in working with another person or thing (eg, Csikszentmihalyi's “flow” Csikszentmihalyi, 1990 , Tickle-Degnen's “rapport” Tickle-Degnen and Rosenthal, 1990 , or Sidner's “engagement” Sidner et al, 2005 ), we are mor…”
BackgroundJefferson, G. (1978) · Elsevier eBooks · doi:10.1016/b978-0-12-623550-0.50016-1 · Cited by 806
Design requirements for technologies that encourage physical activity
Consolvo, S., Everitt, K., Smith, I., & Landay, J. A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124840 · Cited by 801
Communication and Relational Maintenance
Canary, D. J. (1994) · Cited by 582
Explorations in engagement for humans and robots
Sidner, C. L., Lee, C. W., Kidd, C. D., Lesh, N. B., & Rich, C. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.03.005 · Cited by 559
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494
Self-citationMAHI: investigation of social scaffolding for reflective thinking in diabetes management
Mamykina, L., Mynatt, E., Davidson, P., & Greenblatt, D. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357131 · Cited by 355
'It's just like you talk to a friend': relational agents for older adults
Bickmore, T. W., Caruso, L., Clough-Gorr, K., & Heeren, T. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2005.09.002 · Cited by 341 · cited 7×
“interaction, most participants found the conversations repetitive at some point during the intervention, and because of this many lost motivation to follow the agent’s advice (Bickmore et al. 2005; Bickmore and Picard 2005).”
BackgroundMethodInfluentialSelf-citationLarge scale analysis of web revisitation patterns
Adar, E., Teevan, J., & Dumais, S. T. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357241 · Cited by 255
Relational agents : effecting change through human-computer relationships
Bickmore, T. (2003) · Cited by 252
Self-citationHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242
Self-citationRevere, D., & Dunbar, P. J. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080062 · Cited by 208 · cited 2×
“The development of technologies to promote such healthy behavior (“behavioral informatics”) has also become a burgeoning area of research in the behavioral medicine community (Revere and Dunbar, 2001 ; Bickmore and Giorgino, 2006 ).”
BackgroundRusbult, C. E., Drigotas, S. M., & Verette, J. A. (1994) · Cited by 202
Engagement vs. Deceit: Virtual Humans with Human Autobiographies
Bickmore, T., Schulman, D. J., & Yin, L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04380-2_4 · Cited by 85
Self-citationPersuasion, Task Interruption and Health Regimen Adherence
Bickmore, T., Mauer, D., Crespo, F., & Brown, T. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77006-0_1 · Cited by 68
Self-citationDesigning for long-term human-robot interaction and application to weight loss
Breazeal, C., & Kidd, C. D. (2008) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 61
Usability, playability, and long-term engagement in computer games
Febretti, A., & Garzotto, F. (2009) · CHI '09 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1520340.1520618 · Cited by 36
A virtual laboratory for studying long-term relationships between humans and virtual agents
Bickmore, T., & Schulman, D. J. (2009) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/xdra5701 · Cited by 30
Self-citationWhy Fat Interface Characters Are Better e-Health Advisors
Vugt, H. C. V., Konijn, E. A., Hoorn, J. F., & Veldhuis, J. (2006) · Lecture notes in computer science · doi:10.1007/11821830_1 · Cited by 26
Designing for long-term human-robot interaction and application to weight loss
Kidd, C. D. (2008) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 12
Research works printed but not linked: 3
- Bickmore , T. , and L. Pfeifer . 2008 . Relational agents for antipsychotic medication adherence. Proceedings of the Conference on Human Factors in Computer Systems, CHI'08 Workshop on Technology in Mental Health, Florence, Italy, 1–7.
- Jakobson R., 1960, Style in Language
- Reeves B., 1996, The Media Equation
Cited by
Sorted by citations
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
“This embodied bot was built on substantial design work on establishing human-computer relationships [28].”
BackgroundA Socially Assistive Robot Exercise Coach for the Elderly
Fasola, J., & Matarić, M. J. (2013) · Journal of Human-Robot Interaction · doi:10.5898/jhri.2.2.fasola · Cited by 437
Natural language processing in mental health applications using non-clinical texts
Calvo, R. A., Milne, D., Hussain, M. S., & Christensen, H. M. (2017) · Natural Language Engineering · doi:10.1017/s1351324916000383 · Cited by 405
Gaze tutor: A gaze-reactive intelligent tutoring system
D’Mello, S. K., Olney, A. M., Williams, C., & Hays, P. A. (2012) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2012.01.004 · Cited by 375
Doherty, K., & Doherty, G. J. (2018) · ACM Computing Surveys · doi:10.1145/3234149 · Cited by 299
Metadata
- Authors
- Bickmore, T., Schulman, D., & Yin, L.
- Affiliations
- Northeastern University (US)
- Corresponding author
- Bickmore, Timothy
- Venue
- Applied Artificial Intelligence
- Publisher
- Informa UK Limited
- Published
- 2010-07-12
- Volume
- 24
- Issue
- 6
- Pages
- 648-666
- ISSN
- 0883-9514 (ISSN-L)
- 1087-6545
- PMC
- PMC3035950
- OpenAlex
- W1988568632
- Cited by
- 246
- References
- 31
- Citations by year
- 2026: 24 · 2025: 13 · 2024: 16 · 2023: 11 · 2022: 21 · 2021: 29 · 2020: 24 · 2019: 15 · 2018: 18 · 2017: 17 · 2016: 8 · 2015: 15 · 2014: 11 · 2013: 12 · 2012: 6
- FWCI
- 10.44
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Applied Artificial Intelligence (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Science Foundation (CAREER, 0545932)
- National Cancer Institute (R01CA119195)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- user engagement, long-term intervention, virtual humans, relational agents, human-agent interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
