Perceived Usefulness, Satisfaction, Ease of Use and Potential of a Virtual Companion to Support the Care Provision for Older Adults
Open accessThe DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Abstract
This article reports a study aiming to determine the perceptions of older adults needing formal care about the usefulness, satisfaction, and ease of use of CaMeLi, a virtual companion based on an embodied conversational agent, and the perceptions of formal caregivers about the potential of virtual companions to support care provision. An observational study involving older adults needing formal care was conducted to assess CaMeLi using a multi-method approach (i.e., an auto-reported questionnaire—the Usefulness, Satisfaction, and Ease of use questionnaire; a scale for the usability assessment based on the opinion of observers—the International Classification of Functioning Disability and Health-based Usability Scale; and critical incident registration). Moreover, a focus group was conducted to collect data regarding the perceived utility of virtual companions to support care provision. The observational study was conducted with 46 participants with an average age of 63.6 years, and the results were associated with a high level of usefulness, satisfaction, and ease of use of CaMeLi. Furthermore, the focus group composed of four care providers considered virtual companions a promising solution to support care provision and to prevent loneliness and social isolation. The results of both the observational study and the focus group revealed good perceptions regarding the role of virtual companions to support the care provision for older adults.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Ali et al [30] and Jegundo et al [34] used the well-known System Usability Scale [40].”
From Voice-Enabled Intelligent Virtual Agents for People With Amnesia: Systematic Review (2022) · cites this paper as [34]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In 4 studies, the user could only give yes or no or a few other short commands [24,33,34,40].”
From Voice-Enabled Intelligent Virtual Agents for People With Amnesia: Systematic Review (2022) · cites this paper as [34]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Christiane, Druml, Wolzt, & Pleiner (2001) · Acta Scientiarum Naturalium Universitatis Sunyatseni · Cited by 3,419
The Meaning of "Aging in Place" to Older People
Wiles, J. L., Leibing, A., Guberman, N., Reeve, J., & Allen, R. E. S. (2012) · The Gerontologist · doi:10.1093/geront/gnr098 · Cited by 1,965
(2013) · Journal of Usability Studies archive · Cited by 1,357
The UX Book: Process and Guidelines for Ensuring a Quality User Experience
Hartson, R., & Pyla, P. S. (2012) · Cited by 659
Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies
Lewis, J. R. (2002) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2002.9669130 · Cited by 621
Middleton, B., Bloomrosen, M., Dente, M. A., Hashmat, B., Koppel, R., Overhage, J. M., Payne, T. H., Rosenbloom, S. T., Weaver, C., & Zhang, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001458 · Cited by 618
This computer responds to user frustration:
Klein, J., Moon, Y., & Picard, R. W. (2002) · Interacting with Computers · doi:10.1016/s0953-5438(01)00053-4 · Cited by 558
Home care in Europe: a systematic literature review
Genet, N., Boerma, W. G., Kringos, D. S., Bouman, A., Francke, A. L., Fagerström, C., Melchiorre, M. G., Greco, C., & Devillé, W. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-207 · Cited by 506
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494
Embodied conversational interface agents
Cassell, J. (2000) · Communications of the ACM · doi:10.1145/332051.332075 · Cited by 393
A randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · cited 4×
“Embodied conversational agents supporting virtual companions to be used for extended periods of time require special design considerations compared to systems that are either only used for brief interactions or do not intend to engage the user in social interaction [22].”
BackgroundMethodInfluentialNew ISO Standards for Usability, Usability Reports and Usability Measures
Bevan, N., Carter, J., Earthy, J., Geis, T., & Harker, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-39510-4_25 · Cited by 218
Design Features of Embodied Conversational Agents in eHealth: a Literature Review
ter Stal, S., Kramer, L. L., Tabak, M., op den Akker, H., & Hermens, H. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102409 · Cited by 188
Usability in telemedicine systems—A literature survey
Klaassen, B., van Beijnum, B.-J. F., & Hermens, H. J. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.06.004 · Cited by 173
Designing Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
Lewis, J. R. (2006) · Wiley eBooks · doi:10.1002/0470048204.ch49 · Cited by 151
Philip, P., Dupuy, L., Auriacombe, M., Serre, F., de Sevin, É., Sauteraud, A., & Micoulaud‐Franchi, J. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0213-y · Cited by 126
Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review
Kramer, L. L., ter Stal, S., Mulder, B. C., de Vet, E., & van Velsen, L. (2020) · Journal of Medical Internet Research · doi:10.2196/14058 · Cited by 121 · cited 1×
“For instance, two recent reviews of the literature [18,61] identified that the usability assessment was an objective of several primary studies.”
BackgroundTaking mHealth Forward: Examining the Core Characteristics
Davis, T. L., DiClemente, R. J., & Prietula, M. J. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5659 · Cited by 100
Virtual Agents as Daily Assistants for Elderly or Cognitively Impaired People
Yaghoubzadeh, R., Kramer, M., Pitsch, K., & Kopp, S. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40415-3_7 · Cited by 98
Social support agents for older adults: longitudinal affective computing in the home
Ring, L., Shi, L., Totzke, K., & Bickmore, T. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-014-0157-0 · Cited by 97
Martínez-Miranda, J., Martínez, A., Ramos, R., Aguilar, H., Jiménez, L., Arias, H., Rosales, G., & Valencia, E. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1387-1 · Cited by 79
The Right Agent for the Job? The Effects of Agent Visual Appearance on Task Domain
Ring, L., Utami, D., & Bickmore, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-09767-1_49 · Cited by 71
Building long-term relationships with virtual and robotic characters: the role of remembering
Kasap, Z., & Magnenat‐Thalmann, N. (2011) · The Visual Computer · doi:10.1007/s00371-011-0630-7 · Cited by 67
Tielman, M. L., Neerincx, M. A., van Meggelen, M., Franken, I., & Brinkman, W.-P. (2018) · Technology and Health Care · doi:10.3233/thc-170899 · Cited by 63
Systematic guidance on usability methods in user-centered software development
Pérez, L. C., & Macías, J. A. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2018.01.010 · Cited by 61
Agent-User Concordance and Satisfaction with a Virtual Hospital Discharge Nurse
Zhou, S., Bickmore, T., Paasche-Orlow, M., & Jack, B. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-09767-1_63 · Cited by 57
Bedaf, S., Gelderblom, G. J., Syrdal, D. S., Lehmann, H., Michel, H., Hewson, D. J., Amirabdollahian, F., Dautenhahn, K., & de Witte, L. (2013) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483107.2013.840861 · Cited by 56
(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-20609-7 · Cited by 56
Pilot testing a digital pet avatar for older adults
Chi, N.-C., Sparks, O., Lin, S.-Y., Lazar, A., Thompson, H. J., & Demiris, G. (2017) · Geriatric Nursing · doi:10.1016/j.gerinurse.2017.04.002 · Cited by 56
Virtual Assistive Companions for Older Adults: Qualitative Field Study and Design Implications
Tsiourti, C., Joly, E., Wings, C., Ben Moussa, M., & Wac, K. (2014) · Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2014.254943 · Cited by 54 · cited 4×
“Although these solutions cannot and should not replace the human role, they represent an additional support to human caregiving [6].”
BackgroundResultInfluentialLooking the Part: The Effect of Attire and Setting on Perceptions of a Virtual Health Counselor
Parmar, D., Olafsson, S., Utami, D., & Bickmore, T. (2018) · Proceedings of the 18th International Conference on Intelligent Virtual Agents · doi:10.1145/3267851.3267915 · Cited by 50
Perspectives on Human-Computer Interaction Research with Older People
(2019) · Human-computer interaction series · doi:10.1007/978-3-030-06076-3 · Cited by 50
Quintas, J., Menezes, P., & Dias, J. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2016.2634923 · Cited by 49
Self-citationToward a Context-Aware Human–Robot Interaction Framework Based on Cognitive Development
Quintas, J. M., Martins, G. S., Santos, L., Menezes, P. J., & Dias, J. M. M. (2018) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2018.2833384 · Cited by 49
Self-citationSupporting user-perceived usability benchmarking through a developed quantitative metric
Veral, R., & Macías, J. A. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.09.012 · Cited by 49
A Virtual Assistive Companion for Older Adults: Design Implications for a Real-World Application
Tsiourti, C., Ben Moussa, M., Quintas, J., Loke, B., Jochem, I., Lopes, J. A., & Konstantas, D. (2018) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-319-56994-9_69 · Cited by 45
Self-citationThe Impact of an Embodied Agent's Emotional Expressions Over Multiple Interactions
Creed, C., Beale, R., & Cowan, B. R. (2014) · Interacting with Computers · doi:10.1093/iwc/iwt064 · Cited by 43
Tongpeth, J., Du, H., & Clark, R. A. (2018) · Journal of Clinical Nursing · doi:10.1111/jocn.14528 · Cited by 35
Usability Evaluation Methods: A Systematic Review
Martins, A. I., Queirós, A., Silva, A. G., & Rocha, N. P. (2014) · Advances in systems analysis, software engineering, and high performance computing book series · doi:10.4018/978-1-4666-6485-2.ch013 · Cited by 34
Self-citationWargnier, P., Benveniste, S., Jouvelot, P., & Rigaud, A.-S. (2018) · Technology and Disability · doi:10.3233/tad-180189 · Cited by 32 · cited 1×
“In turn, semi-structured, individual interviews [63], observation of task completion [64], group discussions [65], or specific questionnaires [23,63] have been used to identify usability issues.”
Adapting a Persuasive Conversational Agent for the Chinese Culture
Zhou, S., Zhang, Z., & Bickmore, T. (2017) · 2017 International Conference on Culture and Computing (Culture and Computing) · doi:10.1109/culture.and.computing.2017.42 · Cited by 31
van Wissen, A., Vinkers, C., & van Halteren, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-31510-2_23 · Cited by 30
Robertson, S. L., Solomon, R., Riedl, M. O., Gillespie, T. W., Chociemski, T., Master, V. A., & Mohan, A. V. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20609-7_40 · Cited by 28
European Portuguese Validation of Usefulness, Satisfaction and Ease of Use Questionnaire (USE)
Dantas, C., Jegundo, A., Quintas, J. M., Martins, A. I., Queirós, A., & Rocha, N. P. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-56538-5_57 · Cited by 27
Self-citationThe Domiciliary Support Service in Portugal and the change of paradigm in care provision
Santana, S., Dias, A. A. D. C., Souza, E., & Rocha, N. P. (2007) · International Journal of Integrated Care · doi:10.5334/ijic.177 · Cited by 26
Disappearing computers, social actors and embodied agents
Nijholt, A. (2004) · International Conference on Cyberworlds (CW) · doi:10.1109/cyber.2003.1253445 · Cited by 26
The Essence of Enjoyable Experiences: The Human Needs
Kim, J., Park, S. M., Hassenzahl, M., & Eckoldt, K. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21675-6_9 · Cited by 26
Human Factors in Software Development and Design
Saeed, S. (2014) · Advances in systems analysis, software engineering, and high performance computing book series · doi:10.4018/978-1-4666-6485-2 · Cited by 25
Definition and Validation of the ICF – Usability Scale
Martins, A. I., Rosa, A. F., Queirós, A., Silva, A. G., & Rocha, N. P. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.09.257 · Cited by 24
Self-citationUsing Virtual Reality Technology to Improve Reality for Young People with Chronic Health Conditions
Alsharbi, B. M., & Richards, D. (2017) · International Conference on Computer and Automation Engineering · doi:10.1145/3057039.3057080 · Cited by 22
User interactions with an affective nutritional coach
Creed, C., & Beale, R. (2012) · Interacting with Computers · doi:10.1016/j.intcom.2012.05.004 · Cited by 21
Technologies for Ageing in Place to Support Home Monitoring of Patients with Chronic Diseases
Queirós, A., Pereira, L. T., Dias, A. A. D. C., & Rocha, N. P. (2017) · International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC) · doi:10.5220/0006140000660076 · Cited by 21
Wargnier, P., Malaise, A., Jacquemot, J., Benveniste, S., Jouvelot, P., Pino, M., & Rigaud, A.-S. (2015) · 2015 3rd IEEE VR International Workshop on Virtual and Augmented Assistive Technology (VAAT) · doi:10.1109/vaat.2015.7155406 · Cited by 18
Martins, A. I., Queirós, A., Silva, A. G., & Rocha, N. P. (2016) · International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (DSAI) · doi:10.1145/3019943.3019997 · Cited by 16
Self-citationWeb-Based Embodied Conversational Agents and Older People
Llorach, G., Agenjo, J., Blat, J., & Sayago, S. (2019) · Human-computer interaction series · doi:10.1007/978-3-030-06076-3_8 · Cited by 16
Usability evaluation of ambient assisted living systems using a multi-method approach
Martins, A. I., Queirós, A., Silva, A. G., & Rocha, N. P. (2016) · International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (DSAI) · doi:10.1145/3019943.3019981 · Cited by 12
Self-citationDas, K., Beinema, T. C., den Akker, H. O., & Hermens, H. J. (2019) · International Conference on Information and Communication Technologies for Ageing Well and e-Health (ICT4AWE) · doi:10.5220/0007750602970304 · Cited by 10
A study of elderly people's emotional understanding of prompts given by Virtual Humans
Malhotra, A., Hoey, J., König, A., & van Vuuren, S. (2016) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/eai.16-5-2016.2263327 · Cited by 8
That’s a Rap: Increasing Engagement with Rap Music Performance by Virtual Agents
Ólafsson, S., Kimani, E., Asadı, R., & Bickmore, T. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67401-8_41 · Cited by 7
“How am I Doing?” - Personifying Health through Animated Characters
Schmeil, A., & Suggs, L. S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07635-5_10 · Cited by 6
Usability Evaluation of a Virtual Assistive Companion
Jegundo, A., Dantas, C., Quintas, J. M., Dutra, J., Almeida, A. L., Caravau, H., Rosa, A. F., Martins, A. I., Queirós, A., & Rocha, N. P. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-16184-2_67 · Cited by 6
Self-citationFaddoul, G., & Chatterjee, S. (2019) · Journal of the Association for Information Systems · Cited by 4
Research works printed but not linked: 4
- Norman, D.A. (2013). The design of everyday things: Revised and Expanded Edition, Basic Books.
- Dix, A., Dix, A.J., Finlay, J., Abowd, G.D., and Beale, R. (2003). Human-Computer Interaction, Pearson Education.
- Lund, 2001, Measuring Usability with the USE Questionnaire, Usability Interface, 8, 3
- Smith, J.A. (2015). Qualitative Psychology: A practical Guide to Research Methods, SAGE.
Cited by
Service robots with (perceived) theory of mind: An examination of humans’ reactions
Söderlund, M. (2022) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2022.102999 · Cited by 97
Anisha, S. A., Sen, A., & Bain, C. (2024) · Journal of Medical Internet Research · doi:10.2196/56114 · Cited by 102
Rodríguez-Martínez, A., Aguilar, T. A., Moreno, J. C., & Jiménez, J. J. (2023) · Healthcare · doi:10.3390/healthcare12010062 · Cited by 80
Açikgöz, F., Filieri, R., & Yan, M. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2074668 · Cited by 56
Hurmuz, M. Z. M., Jansen-Kosterink, S. M., Beinema, T. C., Fischer, K., den Akker, H. O., & Hermens, H. J. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100501 · Cited by 30
Metadata
- Authors
- Jegundo, A. L., Dantas, C., Quintas, J., Dutra, J., Almeida, A. L., Caravau, H., Rosa, A. F., Martins, A. I., & Pacheco Rocha, N.
- Affiliations
- Instituto Pedro Nunes (PT)
- Caritas Diocesana de Coimbra (PT)
- University of Aveiro (PT)
- IEETA-Institute of Electronics and Informatics Engineering of Aveiro, Department of Medical Sciences, University of Aveiro, Campo Universitário de Santiago, 3810-193 Aveiro, Portugal
- ORCID
- Venue
- Technologies
- Publisher
- MDPI AG
- Published
- 2020-07-25
- Volume
- 8
- Issue
- 3
- Pages
- 42
- ISSN
- 2227-7080 (ISSN-L)
- OpenAlex
- W3045327354
- Cited by
- 45
- References
- 64
- Citations by year
- 2026: 11 · 2025: 12 · 2024: 7 · 2023: 3 · 2022: 7 · 2021: 3 · 2020: 2
- FWCI
- 5.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Technologies (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Fundação para a Ciência e a Tecnologia (AAL/0005/2017)
- H2020 LEIT Information and Communication Technologies (643647)
- Topics
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- virtual companions, embodied conversational agents, older adults, formal care, caregiver support, perceived usefulness, user satisfaction, ease of use, usability, loneliness prevention, social isolation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
