A Process Evaluation Examining the Performance, Adherence, and Acceptability of a Physical Activity and Diet Artificial Intelligence Virtual Health Assistant
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Artificial intelligence virtual health assistants are a promising emerging technology. This study is a process evaluation of a 12-week pilot physical activity and diet program delivered by virtual assistant “Paola”. This single-arm repeated measures study (n = 28, aged 45–75 years) was evaluated on technical performance (accuracy of conversational exchanges), engagement (number of weekly check-ins completed), adherence (percentage of step goal and recommended food servings), and user feedback. Paola correctly asked scripted questions and responded to participants during the check-ins 97% and 96% of the time, respectively, but correctly responded to spontaneous exchanges only 21% of the time. Participants completed 63% of weekly check-ins and conducted a total of 3648 exchanges. Mean dietary adherence was 91% and was lowest for discretionary foods, grains, red meat, and vegetables. Participants met their step goal 59% of the time. Participants enjoyed the program and found Paola useful during check-ins but not for spontaneous exchanges. More in-depth knowledge, personalized advice and spontaneity were identified as important improvements. Virtual health assistants should ensure an adequate knowledge base and ability to recognize intents and entities, include personality and spontaneity, and provide ongoing technical troubleshooting of the virtual assistant to ensure the assistant remains effective.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estruch, R., Ros, E., Salas-Salvadó, J., Covas, M.-I., Corella, D., Arós, F., Gómez-Gracia, E., Ruiz-Gutiérrez, V., Fiol, M., Lapetra, J., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1800389 · Cited by 3,616
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Schröder, H., Fitó, M., Estruch, R., Martínez-González, M. A., Corella, D., Salas-Salvadó, J., Lamuela-Raventós, R., Ros, E., Salaverría, I., Fiol, M., et al. (2011) · The Journal of Nutrition · doi:10.3945/jn.110.135566 · Cited by 1,624
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 4×
“In 2018, a systematic literature review identified 14 studies involving artificial intelligence (AI) virtual health assistants capable of natural language processing [7].”
BackgroundInfluentialNadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363 · cited 2×
“Finally, a review completed in July 2020 focused specifically on virtual assistants designed to improve diet and physical activity, which included the present study and 6 others [18].”
BackgroundA randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · cited 1×
“[14] tested a virtual assistant for improving physical activity and fruit and vegetable intake, as well as physical activity in older adults [15].”
BackgroundConversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275
Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity
Kocielnik, R., Xiao, L., Avrahami, D., & Hsieh, G. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3214273 · Cited by 221
Hauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210 · cited 1×
“In 2020 alone, virtual assistants or chatbots have been tested for pain-self management amongst adults with chronic pain [9], promoting fertility awareness among child-bearing women [10], for life skill promotion amongst adolesents [11], and to promote physical activity amongst office workers [12].”
Background
Cited by
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
Visan, A. I., & Negut, I. (2024) · Life · doi:10.3390/life14020233 · Cited by 279
Perceptions and Needs of Artificial Intelligence in Health Care to Increase Adoption: Scoping Review
Chew, H. S. J., & Achananuparp, P. (2022) · Journal of Medical Internet Research · doi:10.2196/32939 · Cited by 243
The Role of Artificial Intelligence in Nutrition Research: A Scoping Review
Sosa-Holwerda, A., Park, O.-H., Albracht-Schulte, K., Niraula, S., Thompson, L., & Oldewage-Theron, W. (2024) · Nutrients · doi:10.3390/nu16132066 · Cited by 114
“Figure 3 shows the nutrition areas in which the included articles used AI. by lifestyle interventions [26–28], and dietary assessment specifically for people [25,42].”
BackgroundInfluentialREVIEW OF AI APPLICATIONS IN HEALTHCARE: COMPARATIVE INSIGHTS FROM THE USA AND AFRICA
Babarinde, A. O., Ayo-Farai, O., Maduka, C. P., Okongwu, C. C., Ogundairo, O., & Sodamade, O. (2023) · International Medical Science Research Journal · doi:10.51594/imsrj.v3i3.641 · Cited by 42
Metadata
- Authors
- Davis, C. R., Murphy, K. J., Curtis, R. G., & Maher, C. A.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2020-12-07
- Volume
- 17
- Issue
- 23
- Pages
- 9137
- ISSN
- 1660-4601 (ISSN-L)
- OpenAlex
- W3111693918
- Cited by
- 57
- References
- 19
- FWCI
- 5.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Process Evaluation Examining the Performance, Adherence, and Acceptability of a Physical Activity and Diet Artificial Intelligence Virtual Health Assistant. https://app.cochat.ai/papers/10.3390/ijerph17239137
- The paper
- Davis, C. R., Murphy, K. J., Curtis, R. G., & Maher, C. A. (2020). A Process Evaluation Examining the Performance, Adherence, and Acceptability of a Physical Activity and Diet Artificial Intelligence Virtual Health Assistant. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph17239137
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.