The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index; 93 of the 113 sources its claims cite were checked for support.
Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review.
Open accessPublished version of a preprint
Abstract
Artificial intelligence (AI)-based chatbots can offer personalized, engaging, and on-demand health promotion interventions. The aim of this systematic review was to evaluate the feasibility, efficacy, and intervention characteristics of AI chatbots for promoting health behavior change. A comprehensive search was conducted in 7 bibliographic databases (PubMed, IEEE Xplore, ACM Digital Library, PsycINFO, Web of Science, Embase, and JMIR publications) for empirical articles published from 1980 to 2022 that evaluated the feasibility or efficacy of AI chatbots for behavior change. The screening, extraction, and analysis of the identified articles were performed by following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Of the 15 included studies, several demonstrated the high efficacy of AI chatbots in promoting healthy lifestyles (n=6, 40%), smoking cessation (n=4, 27%), treatment or medication adherence (n=2, 13%), and reduction in substance misuse (n=1, 7%). However, there were mixed results regarding feasibility, acceptability, and usability. Selected behavior change theories and expert consultation were used to develop the behavior change strategies of AI chatbots, including goal setting, monitoring, real-time reinforcement or feedback, and on-demand support. Real-time user-chatbot interaction data, such as user preferences and behavioral performance, were collected on the chatbot platform to identify ways of providing personalize…
Overview
CoChat Summary
TL;DR
This systematic review found that AI-based chatbots showed efficacy for several health behavior changes, especially healthy lifestyles, smoking cessation, and medication/treatment adherence, but evidence was mixed for feasibility, acceptability, and usability. The authors caution that most included studies had moderate to high risk of internal validity issues and limited reporting of AI methods, so stronger RCTs are needed.
Key findings
- The review included 15 studies; AI chatbots were reported as efficacious for healthy lifestyles (6/15, 40%), smoking cessation (4/15, 27%), treatment or medication adherence (2/15, 13%), and reduction in substance misuse (1/15, 7%).
- Feasibility evidence was limited: 11/15 (73%) studies reported feasibility, but safety was only reported in 1/15 (7%) study, and engagement often declined over time.
- Acceptability was mixed: 7/15 (47%) studies reported acceptability/engagement, but the overall proportion of satisfied participants was less than 50%.
- Usability was also mixed: 11/15 (73%) studies reported usability, with ease of use generally low to moderate and 1/15 (7%) studies reporting technical issues for 82.3% of participants.
Methods
- Systematic review following PRISMA; searched 7 databases (PubMed, IEEE Xplore, ACM Digital Library, PsycINFO, Web of Science, Embase, JMIR publications) for empirical English-language articles from 1980 to 2022.
- Included studies had to evaluate AI-based chatbots for health behavior change; from 1961 records screened, 15 studies met inclusion criteria.
- The authors extracted study characteristics, intervention features, and outcomes; quality was assessed using the NIH quality assessment tool for controlled intervention studies and CONSORT-AI guidance.
Limitations
- The paper states that no meta-analysis was conducted because of heterogeneity in design, outcomes, and measures.
- The review states it did not cover a comprehensive set of behavioral outcomes because of strict inclusion criteria; the included studies focused on healthy lifestyle, smoking cessation, and treatment/medication adherence.
- The text makes evident that many included studies had pre-post designs without control groups, small samples in some studies, and limited description of AI techniques; the paper explicitly notes moderate to high internal validity risk and limited generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
51 Valid · 5 Not valid · 6 Not checked · 114 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“First, this review did not distinguish between AI-driven chatbots and other chatbots.”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Introduction > Prior Work
What the sources say
- Disputedcites [2] sourceExperimental — accuracy not yet measured
The Methods (Eligibility criteria; page unavailable) limit the review to interventions using AI chatbots, rather than chatbots generally. The Results (Summary of intervention and chatbot characteristics; page unavailable) further distinguish constrained from unconstrained chatbots. The paper therefore does not support the claim that it made no distinction between AI chatbots and other chatbots. (LLM, conf=0.84)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“Second, the selected studies targeted only a limited set of behaviors, including physical activity, diet, and weight management.”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Introduction > Prior Work
What the sources say
- Supportedcites [2] source
The Methods (Eligibility criteria, Table 1; page not available) limit included studies to AI chatbot interventions for physical activity, diet, and/or weight management. The review’s selected studies therefore fall within the limited set of behaviors described in the claim. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The existing digital therapeutic and telehealth interventions with didactic components, which enable health care providers to communicate with patients via digital platforms (eg, email and video call), have encountered several challenges, including relatively low adherence, unsustainability, and inflexibility [3,4].”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [3] source
- Partly supportedcites [4] sourceExperimental — accuracy not yet measured
The Adherence and adverse events section reports low completion of computerised CBT: 10.4% with minimal support and 19.4% with telephone facilitation completed all five sessions. The paper does not establish that these interventions are unsustainable or inflexible; its Implications section instead says telephone-supported CBT could be offered at scale. Its findings also concern CBT for depression, not digital therapeutic and telehealth interventions generally. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The overall conversational flexibility offered by AI chatbots in terms of communicating at anytime from anywhere offers a safe space to facilitate interactions with patients who feel or experience stigmatization while seeking health care services [5].”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Introduction > Background
What the sources say
- Partly supportedcites [5] sourceExperimental — accuracy not yet measured
The Discussion (Principal Findings; page unavailable) reports that participants felt more comfortable discussing issues with a robot because they did not expect it to judge them. The Discussion (Limitations and Directions for Future Research; page unavailable) suggests this could encourage discussion of sensitive issues and earlier help-seeking. The study concerns a social robot, however, and does not establish that AI chatbots offer flexible conversation anytime from anywhere or specifically facilitate interactions for patients experiencing stigmatization while seeking health care. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Second, the AI algorithm uses machine learning (ML) and natural language processing (NLP) techniques to identify clinically meaningful patterns and understand user needs [7].”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Introduction > Background
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Introduction (Background; page unavailable) says conversational agents use machine learning and NLP to analyze user input and respond. It does not say they identify clinically meaningful patterns, and the Discussion (Principal Findings; page unavailable) notes that agents often had difficulty understanding users. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
90 more claims · 28 with their cited sources checked
Create a free account to see all 176 claims and every source verdict.
- It may state two separate claims as one. 66
- Probably not a substantial claim. 27
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is notable that research into the use of AI for the delivery of personalized recommendations is sparse33”
From Impact of digital health interventions on glycemic control and weight management. (2025) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These findings align with those of another meta-analysis [122], showing the effectiveness of CAs in outcomes related to lifestyle changes, smoking cessation, substance misuse, and medication adherence.”
From Development and Evaluation of a Smartphone-Based Chatbot Coach to Facilitate a Balanced Lifestyle in Individuals With Headaches (BalanceUP App): Randomized Controlled Trial (2024) · cites this paper as [122]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, an AI-driven system might suggest lifestyle modifications, such as dietary changes or exercise routines that are optimized for an individual’s metabolism and cardiovascular risk (57).”
From Generative artificial intelligence in predictive analysis of diabetes and its complications: a narrative review (2025) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Chatbots provide real-time personalized health promotion, prevention, and screening (Aggarwal et al., 2023; Laranjo et al., 2018).”
From A chatbot-delivered intervention for optimizing social media use and reducing perceived isolation among rural-living LGBTQ+ youth: Development, acceptability, usability, satisfaction, and utility (2023) · cites this paper as Aggarwal et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Chatbots are convenient artificial intelligence–operated conversational agents; they can be deployed within a social media site, do not require user download, and do not take up space in a user's device.”
From A chatbot-delivered intervention for optimizing social media use and reducing perceived isolation among rural-living LGBTQ+ youth: Development, acceptability, usability, satisfaction, and utility (2023) · cites this paper as Aggarwal et al., 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Results > Characteristics of the Reviewed Studies
“All 13 studies were distributed across low-income countries, with 4 (31%) from the United States, 2 (15%) from Australia, and 1 (8%) from each remaining country (ie, South Korea, Spain, the United Kingdom, Japan, France, Switzerland, and the Netherlands).”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Discussion > Limitations of the Reviewed Studies and Future Research Directions
“Out of the 13 studies that reported the geographical locations, all (100%) were conducted in the high-income countries;”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Results > Characteristics of the Reviewed Studies
“Only 27% (4/15) of studies used randomized control trials (RCTs), and most of the studies (9/15, 60%) adopted a quasiexperimental design (ie, pre- and posttests) with no control group, followed by 7% (1/15) of studies with a cross-sectional design and 7% (1/15) of studies with a postexperimental research method.”
§ Artificial Intelligence–Based Chatbots for Promoting Health Behavioral Changes: Systematic Review > Results > Intervention Study Quality Assessment
“In the case of RCTs (4/15, 27%), this bias was minimized because of the experimental setting of the interventions; however, for non-RCT studies (11/14, 73%), there was a high risk of bias owing to the potential effect of confounding variables.”
Citations
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
How we design feasibility studies
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., Bakken, S., Kaplan, C. P., Squiers, L., Fabrizio, C., et al. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.02.002 · Cited by 4,021 · cited 1×
“Feasibility was defined as the demand of the intervention, that is, the actual use of the intervention and whether the intervention is doable in a certain setting [16].”
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 9×
“Artificial intelligence (AI)–driven chatbots (AI chatbots) are conversational agents that mimic human interaction through written, oral, and visual forms of communication with a user [1,2].”
InfluentialChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 1×
“…findings are consistent with the previous systematic literature reviews that reported that all the chatbot intervention studies were conducted in high-income countries [2,10,11,14], most studies were conducted with adults [2,7], and most studies did not focus on racial or ethnic minorities [2,14].”
Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory
Zhou, H., Huang, M., Zhang, T., Zhu, X., & Liu, B. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11325 · Cited by 763
Liu, X., Rivera, S. C., Moher, D., Calvert, M. J., & Denniston, A. K. (2020) · BMJ · doi:10.1136/bmj.m3164 · Cited by 702
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · cited 8×
“This finding is consistent with the previous systematic literature reviews that reported very few studies discussed participant safety or ethics in terms of adverse events [1,2,7,9] and data security or privacy [2,8].”
InfluentialAbd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503
Embodied conversational agents in clinical psychology: a scoping review
Provoost, S., Lau, H. M., Ruwaard, J., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6553 · Cited by 433 · cited 2×
“Of the extant systematic reviews on AI chatbots, 6 articles targeted at assessing efficacy of AI-chatbots in enhancing mental health outcomes [1,7,9-12], 2 examined the feasibility of AI-chatbots in health care settings [8,13], and 1 described the technical architectures and characteristics of the…”
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363 · cited 1×
“As specified in the AI chatbot design literature, user engagement is dependent on the chatbot’s ability to understand the user’s background, build a relation, be persuasive, and offer quick feedback [34].”
Research works printed but not linked: 1
- Radziwill, NM, 2017, arXiv
Cited by
Large language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944
Revolutionizing healthcare: the role of artificial intelligence in clinical practice
Alowais, S. A., Alghamdi, S. S., Alsuhebany, N., Alqahtani, T., Alshaya, A. I., Almohareb, S. N., Aldairem, A., Alrashed, M., Bin Saleh, K., Badreldin, H. A., et al. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04698-z · Cited by 3,146
“AI has the potential to play a significant role in patient education by providing personalized and interactive information and guidance to patients and their caregivers [100].”
BackgroundRoles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Innovation and challenges of artificial intelligence technology in personalized healthcare
Li, Y.-H., Li, Y.-L., Wei, M.-Y., & Li, G.-Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-70073-7 · Cited by 275
“By utilizing Natural Language Processing (NLP) and machine learning algorithms, chatbots can learn from patient interactions and adjust their responses to match the patient’s language and style, making the user experience more natural and engaging 5,6 .”
Method
Metadata
- Authors
- Aggarwal, A., Tam, C. C., Wu, D., Li, X., & Qiao, S.
- Affiliations
- University of South Carolina (US)
- Corresponding author
- Qiao, Shan
- Venue
- Journal of medical Internet research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-02-24
- Volume
- 25
- Pages
- e40789
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC10007007
- OpenAlex
- W4321748146
- Cited by
- 683
- References
- 36
- Citations by year
- 2026: 239 · 2025: 263 · 2024: 135 · 2023: 46
- FWCI
- 34.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- medRxiv (acceptedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of South Carolina (BDHSC-2021-14)
- National Institutes of Health
- National Institute of Allergy and Infectious Diseases (R01AI127203)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- AI chatbots, health behavior change, health promotion, smoking cessation, medication adherence, substance abuse, behaviour change theory, personalized interventions, feasibility and acceptability, chatbot usability, real-time feedback
- MeSH terms
- Artificial Intelligence, Delivery of Health Care, Health Promotion, Humans, Software, Health Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review. https://app.cochat.ai/papers/10.2196/40789
- The paper
- Aggarwal, A., Tam, C. C., Wu, D., Li, X., & Qiao, S. (2023). Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review. Journal of medical Internet research. https://doi.org/10.2196/40789
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
