Engaging women with an embodied conversational agent to deliver mindfulness and lifestyle recommendations: A feasibility randomized control trial
Open accessAbstract
Objective This randomized controlled trial evaluates the feasibility of using an Embodied Conversational Agent (ECA) to teach lifestyle modifications to urban women. Methods Women were randomized to either 1) an ECA (content included: mindfulness, stress management, physical activity, and healthy eating) or 2) patient education sheets mirroring same content plus a meditation CD/MP3 once a day for one month. General outcome measures included: number of stress management techniques used, physical activity levels, and eating patterns. Results Sixty-one women ages 18 to 50 were enrolled. On average, 51% identified as white, 26% as black, 23% as other races; and 20% as Hispanic. The major stress management techniques reported at baseline were: exercise (69%), listening to music (70%), and social support (66%). After one month, women randomized to the ECA significantly decreased alcohol consumption to reduce stress (p = 0.03) and increased daily fruit consumption by an average of 2 servings compared to the control (p = 0.04). Conclusion It is feasible to use an ECA to promote health behaviors on stress management and healthy eating among diverse urban women. Practice implications Compared to patient information sheets, ECAs provide promise as a way to teach healthy lifestyle behaviors to diverse urban women.
AI snapshot
Written from the paper’s full text.
TL;DR
This feasibility randomized controlled trial enrolled 61 urban women ages 18–50 to compare an embodied conversational agent (ECA), Gabby, with patient education sheets plus a meditation CD/MP3 for one month. The ECA was feasible and was associated with significantly decreased alcohol use for stress and increased daily fruit servings compared with control.
Key findings
- Sixty-one women were enrolled and 57 had outcome data from baseline to follow-up; mean age was 35, 51% identified as white, 26% as black, 2% as Asian/Pacific Islander, 21% as other races, and 20% as Hispanic.
- At 30 days, women randomized to the ECA significantly decreased alcohol consumption to reduce stress compared with control (35% to 14% for intervention, 30% to 31% for control; p = 0.03).
- ECA users significantly increased daily fruit servings compared with control (μ = 2 to 4 for intervention, μ = 2 to 2 for control; p = 0.04).
- ECA users spent a median total of 52 min interacting with Gabby (IQR = 101.4, N = 31) and logged in 5 times (IQR = 7, N = 31); average session time was 12.1 min (σ = 6.1, min = 3.9, max = 25.8). Satisfaction was higher but not statistically significant for using Gabby suggestions for healthy eating (69% vs 66%), physical activity (52% vs 49%), and stress management (70% vs 66%).
Methods
- Two-arm feasibility RCT recruiting women from primary care outpatient clinics at Boston Medical Center; inclusion criteria were self-identified women, ages 18–50, telephone and computer internet access, English-speaking, and not pregnant. Participants were randomized by computer-generated permuted block to ECA or control; the research assistant was not blinded to allocation.
- Intervention participants used the Gabby ECA system, with content on mindfulness, stress management, physical activity, and healthy eating, and were asked to log on once daily for 30 days. Control participants reviewed patient information sheets mirroring the same content plus a meditation CD/MP3 recorded by a live meditation teacher, and were encouraged to listen once daily for 30 days.
- Outcomes included feasibility metrics (recruitment, racial minority proportion, completion, outcome data collection, satisfaction), demographics, SF-12, PHQ-9, NHANES-adapted eating questions, Stanford Exercise Behaviors Questionnaire, Self-Efficacy for Exercise Scale, Perceived Stress Scale, confidence ratings, and qualitative interviews. Analysis used descriptive statistics, Chi-square tests, two-sample t-tests, Wilcoxon Rank Sum tests, and SAS 9.3.
Limitations
- The paper states limitations including small sample size, short intervention duration, specific inclusion criteria, and self-reported information; internet access inclusion may bias toward women with favorable technology use; the Gabby system was developed in English, excluding non-fluent English speakers; and participants could inaccurately report health behaviors due to lack of knowledge or discomfort sharing with a web-based system.
- Evident from the text: the research assistant was not blinded to group allocation, and the feasibility study lacked statistical power to measure differences in adherence or efficacy, so many outcomes were not statistically significant.
- Evident from the text: control group meditations were recorded by a live meditation teacher while Gabby used an electronic voice, which may confound comparisons of the meditation components.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 62 cited sources checked · 0 supported · 0 flagged
- Findingown data
At baseline, women in both groups were identified as being mildly depressed, with an average PHQ-9 score of 7.
“At baseline, women in both groups were identified as being mildly depressed, with an average PHQ-9 score of 7.”
Quote in the paperNot a substantial claim - Findingown data
At 30 days, there was a significant decrease in the number of women who used alcohol for stress management in the intervention compared to the control group (35% to 14% for intervention, 30% to 31% for control; p = 0.03).
“At 30 days, there was a significant decrease in the number of women who used alcohol for stress management in the intervention compared to the control group (35% to 14% for intervention, 30% to 31% for control; p = 0.03).”
Quote in the paperSubstantial claim - Findingown data
At one month, there was no significant difference in the number of adaptive coping techniques between groups.
“At one month, there was no significant difference in the number of adaptive coping techniques between groups.”
Quote in the paperNot a substantial claim - Findingown data
Consumption of whole grains, red meat, and fish did not differ significantly between the two groups from baseline to follow-up.
“Consumption of whole grains, red meat, and fish did not differ significantly between the two groups from baseline to follow-up.”
Quote in the paperNot a substantial claim - Findingown data
PHQ-9 scores decreased by two units in the ECA group compared to a one unit decrease in the control group.
“However, it is worth noting that PHQ-9 scores decreased by two units in the ECA group compared to a one unit decrease in the control group.”
Quote in the paperNot a substantial claim
- Findingown data
There was no significant difference in the perceived stress scale in the intervention compared to the control group.
“There was no significant difference in the perceived stress scale in the intervention compared to the control group.”
Quote in the paperNot a substantial claim - Findingown data
There were trends in the reduction of weekly caffeine and snack consumptions after 30 days for women in the ECA group compared to the control group, although statistically insignificant.
“There were trends in the reduction of weekly caffeine and snack consumptions after 30 days for women in the ECA group compared to the control group, although statistically insignificant.”
Quote in the paperNot a substantial claim - Findingown data
At baseline, 67% of participants reported drinking alcohol at least once a month or more to manage stress.
“At baseline, 67% of participants reported drinking alcohol at least once a month or more to manage their stress.”
Quote in the paperNot a substantial claim - Findingown data
The proportion of women who reported eating as a coping technique decreased, although not significantly (55% to 29% for intervention, 50% to 38% for control).
“The proportion of women who reported eating as a coping technique did decrease, although not significantly (55% to 29% for intervention, 50% to 38% for control).”
Quote in the paperNot a substantial claim - Findingown data
ECA users significantly increased the average amount of fruit servings they ate compared to women using patient information sheets (μ = 2 to 4 for intervention, μ = 2 to 2 for control; p = 0.04).
“Analysis revealed that ECA users significantly increased the average amount of fruit servings they ate compared to women using patient information sheets (μ = 2 to 4 for intervention, μ = 2 to 2 for control; p = 0.04).”
Quote in the paperSubstantial claim - Findingown data
There was no statistically significant difference in perceived stress between women in the Gabby group and the control group.
“There was no statistically significant difference in perceived stress among women in the Gabby group compared to the control group.”
Quote in the paperSubstantial claim - Findingown data
In the qualitative data, participants in both the intervention and control groups reported being more knowledgeable about managing their stress after the intervention.
“In the qualitative data, both groups reported being more knowledgeable about managing their stress post-intervention.”
Quote in the paperNot a substantial claim - Findingown data
A majority of intervention participants perceived Gabby to be a fast, reliable and credible source of information.
“The majority of users perceived Gabby to be a fast, reliable, and credible source of information.”
Quote in the paperNot a substantial claim - Findingown data
A majority of ECA users reported that Gabby was most relevant for stress management.
“Interestingly, a majority of ECA users commented that Gabby was most relevant in regards to stress management.”
Quote in the paperNot a substantial claim - Findingown data
Control group participants generally found the patient information sheets difficult to use because of a reported lack of accountability and follow-up.
“In contrast, control group participants generally found it difficult to use the patient information sheets due to reported lack of accountability and follow-up.”
Quote in the paperNot a substantial claim - Findingown data
A majority of participants who interacted with Gabby described her as empowering and relatable.
“Additionally, the majority of those who interacted with Gabby described her as empowering and relatable.”
Quote in the paperSubstantial claim - Findingown data
It is feasible to use embodied conversational agent technology to deliver multiple healthy lifestyle recommendations covering physical activity, healthy eating, mindfulness and stress management to a sample of diverse urban women.
“In this study, we demonstrated that it is feasible to use ECA technology to deliver multiple healthy lifestyle recommendations on physical activity, healthy eating, mindfulness, and stress management techniques among diverse urban women.”
- Also stated in: § 4.2. Conclusion · plain
“Feasibility data on the Gabby system are encouraging, and show that ECA technology can help improve education on lifestyle information on physical activity, healthy eating, mindfulness and stress management methods for diverse, urban women.”
Quote in the paperSubstantial claim - Also stated in: § 4.2. Conclusion · plain
- Findingown data
Most participants perceived the health information they received to be helpful.
“Findings suggest that most participants perceived the health information they received to be helpful”
Quote in the paperSubstantial claim - Findingown data
In this study sample, interacting with the ECA produced a significant decrease in alcohol use for stress management (63%) among women who used Gabby compared with the control group.
“Among our study sample, interaction with an ECA was shown to be effective in decreasing alcohol consumption for stress and increasing daily fruit consumption.”
- Also stated in: § 4.1. Discussion · plain
“Our results also show a significant decrease in alcohol use for stress management (63%) for women who interacted with Gabby compared to the control group.”
Quote in the paperSubstantial claim - Also stated in: § 4.1. Discussion · plain
- Findingown data
Daily fruit consumption increased significantly among Gabby users relative to women who received patient information sheets.
“Among our study sample, interaction with an ECA was shown to be effective in decreasing alcohol consumption for stress and increasing daily fruit consumption.”
- Also stated in: § 4.1. Discussion · plain
“Specifically, increased fruit consumption was statistically significant for Gabby users.”
- Also stated in: § 4.1. Discussion · plain
“With Gabby, we find that women were actually consuming an increased amount of fruit servings relative to those who were given patient information sheets–results consistent with these two studies mentioned above.”
Quote in the paperSubstantial claim - Also stated in: § 4.1. Discussion · plain
- Findingown data
Healthy eating habits generally improved in both the intervention and the control group.
“Generally, healthy eating habits improved in both the intervention and control groups.”
Quote in the paperNot a substantial claim - Findingown data
Seventy percent of Gabby users reported using Gabby's suggestions to improve their stress.
“and 70% of them responded that they used Gabby’s suggestions to improve their stress”
Quote in the paperNot a substantial claim - Interpretationown data
It is feasible to use an ECA to promote health behaviors on stress management and healthy eating among diverse urban women.
“It is feasible to use an ECA to promote health behaviors on stress management and healthy eating among diverse urban women.”
Quote in the paperSubstantial claim- Rests on an assumption: The ECA's content and dialogue are culturally appropriate and effective for the diverse urban women in the study.
- Rests on an assumption: The patient information sheets plus meditation CD/MP3 are an adequate control that mirrors the ECA content and dose.
- Rests on an assumption: The feasibility outcomes (recruitment, retention, satisfaction) are sufficient to conclude feasibility for a larger RCT.
- Rests on an assumption: The one-month follow-up period is long enough to detect meaningful changes in health behaviors.
- Rests on an assumption: The self-reported measures of diet, physical activity, and stress management are accurate and not subject to significant bias.
- Rests on an assumption: The ECA system's electronic voice is not a barrier compared to a live meditation teacher.
- Rests on an assumption: The sample of 61 women recruited from Boston primary care clinics is representative of diverse urban women.
- Study design and conductown data
There were no significant differences in demographics or clinical characteristics between groups.
“There were no significant differences in demographics or clinical characteristics between groups.”
Quote in the paperSubstantial claim - Interpretationreasoning
Compared to patient information sheets, ECAs provide promise as a way to teach healthy lifestyle behaviors to diverse urban women.
“Compared to patient information sheets, ECAs provide promise as a way to teach healthy lifestyle behaviors to diverse urban women.”
Quote in the paperSubstantial claim- Rests on an assumption: The ECA's content and dialogue are culturally appropriate and effective for the diverse urban women in the study.
- Rests on an assumption: The patient information sheets plus meditation CD/MP3 are an adequate control that mirrors the ECA content and dose.
- Rests on an assumption: The feasibility outcomes (recruitment, retention, satisfaction) are sufficient to conclude feasibility for a larger RCT.
- Rests on an assumption: The one-month follow-up period is long enough to detect meaningful changes in health behaviors.
- Rests on an assumption: The self-reported measures of diet, physical activity, and stress management are accurate and not subject to significant bias.
- Rests on an assumption: The ECA system's electronic voice is not a barrier compared to a live meditation teacher.
- Rests on an assumption: The sample of 61 women recruited from Boston primary care clinics is representative of diverse urban women.
- Premisecitation
Prior pilots have demonstrated acceptability of ECAs in both inpatient and outpatient settings.
“Prior pilots have demonstrated acceptability of ECAs in both inpatient [17–19] and outpatient settings [20, 21].”
Quote in the paperNot a substantial claim0 of 5 sources checked- cites [17] Bickmore TW Pfeifer LM Byron D Forsythe S Henault LE Jack BW Silliman R Paasche-Orlow MK Usability of conversational agents by patients with inadequate health literacy: evidence from two clinical trials J. Health Commun 15 2010 197 210 20845204 source
Not checked in the free run.
- cites [18] Ehrenfeld J Sandberg W Warren L Kwo J Bickmore T Use of a computer agent to explain anesthesia concepts to patients Annual Meeting of the American Society of Anesthesiologists 3 2010
Not checked in the free run.
- cites [19] Bickmore TW Pfeifer LM Jack BW Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2009 ACM 2017 1265 1274
Not checked in the free run.
- cites [20] Ellis T Latham N DeAngelis T Thomas CA Saint-Hilaire M Bickmore TW Feasibility of a virtual exercise coach to promote walking in community-dwelling persons with Parkinson Disease Am. J. Phys. Med. Rehabil 92 2013 472 485 quiz 482-5 23552335 PMC4266140 source
Not checked in the free run.
- cites [21] Bickmore TW Silliman RA Nelson K Cheng DM Winter M Henault L Paasche-Orlow MK A randomized controlled trial of an automated exercise coach for older adults J. Am. Geriatr. Soc 61 2013 1676 1683 24001030 source
Not checked in the free run.
- Premisecitation
Other studies have yielded positive outcomes for ECAs to deliver health education on topics such as exercise, eating fruits and vegetables, and preconception care.
“Other studies have also yielded positive outcomes for ECAs to deliver health education on topics such as: exercise, eating fruits and vegetables, and preconception care [12, 16, 21–24].”
Quote in the paperNot a substantial claim0 of 6 sources checked- cites [12] Bickmore TW Schulman D Sidner C Automated interventions for multiple health behaviors using conversational agents Patient Educ. Couns 92 2013 142 148 23763983 PMC3727973 source
Not checked in the free run.
- cites [16] Gardiner P Hempstead MB Ring L Bickmore T Yinusa-Nyahkoon L Tran H Paasche-Orlow M Damus K Jack B Reaching women through health information technology: the Gabby preconception care system Am. J. Health Promot 27 2013 eS11 20 23286652 PMC3779885 source
Not checked in the free run.
- cites [21] Bickmore TW Silliman RA Nelson K Cheng DM Winter M Henault L Paasche-Orlow MK A randomized controlled trial of an automated exercise coach for older adults J. Am. Geriatr. Soc 61 2013 1676 1683 24001030 source
Not checked in the free run.
- cites [22] Hudlicka E Virtual training and coaching of health behavior: example from mindfulness meditation training Patient Educ. Couns 92 2013 160 166 23809167 PMC3970714 source
Not checked in the free run.
- cites [23] Morie JF Antonisse J Bouchard S Chance E Virtual worlds as a healing modality for returning soldiers and veterans Stud. Health Technol. Inform 144 2009 273 276 19592780
Not checked in the free run.
- cites [24] Jack B Bickmore T Hempstead M Yinusa-Nyahkoon L Sadikova E Mitchell S Gardiner P Adigun F Penti B Schulman D Damus K Reducing preconception risks among African American women with conversational agent technology J. Am. Board Fam. Med 28 2015 441 451 26152434 PMC4739811 source
Not checked in the free run.
- Premisecitation
Little is known about the practicality of using a technology-based intervention to deliver a multi-behavioral change intervention in racially diverse women.
“Little is known about the practicality of using a technology-based intervention to deliver a multi-behavioral change intervention in racially diverse women [10, 11].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [10] Rosal MC Heyden R Mejilla R Capelson R Chalmers KA Rizzo DePaoli M Veerappa C Wiecha JM A virtual world versus face-to-face intervention format to promote diabetes self-management among african american women: a pilot randomized clinical trial JMIR Res. Protoc 24 2014 e54 doi: http://dx.doi.org/10.2196/resprot.3412 PMC4259910 25344620 source
Not checked in the free run.
- cites [11] Valle CG Deal AM Tate DF Preventing weight gain in African American breast cancer survivors using smart scales and activity trackers: a randomized controlled pilot study J. Cancer Surviv 2016 1 16 (Epub ahead of print) PMC5269496 27631874
Not checked in the free run.
- Premisecitation
Most automated health behavior change interventions are designed to address only a single behavior.
“To date, most automated health behavior change interventions are designed to only address a single behavior [8, 9].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [8] Monroe CM Bassett DR Jr Fitzhugh EC Raynor HA Thompson DL Effect of adding online social support tools to an adult walking program: a pilot randomized controlled trial Health Promot. Pract 2016 26895847
Not checked in the free run.
- cites [9] King AC Bickmore TW Campero MI Pruitt LA Yin JL Employing virtual advisors in preventive care for underserved communities: results from the COMPASS study J. Health Commun 18 2013 1449 1464 23941610 PMC7187757 source
Not checked in the free run.
- Premisecitation
The ECA shows particular promise for conveying behavioral change strategies to patients.
“One technology, called the embodied conversational agent (ECA), shows particular promise for conveying behavioral change strategies to patients [9, 12].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [9] King AC Bickmore TW Campero MI Pruitt LA Yin JL Employing virtual advisors in preventive care for underserved communities: results from the COMPASS study J. Health Commun 18 2013 1449 1464 23941610 PMC7187757 source
Not checked in the free run.
- cites [12] Bickmore TW Schulman D Sidner C Automated interventions for multiple health behaviors using conversational agents Patient Educ. Couns 92 2013 142 148 23763983 PMC3727973 source
Not checked in the free run.
- Premisecitation
Based on previous studies, it is feasible for young African American women ages 18 to 34 years to benefit from an ECA delivering health information on dietary supplements and stress management as part of a larger preconception patient education ECA system.
“Based on our previous studies, we have shown it is feasible for young African American women ages 18 to 34 years to benefit from an ECA delivering health information on dietary supplements and stress management as part of a larger preconception patient education ECA system [16, 24].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [16] Gardiner P Hempstead MB Ring L Bickmore T Yinusa-Nyahkoon L Tran H Paasche-Orlow M Damus K Jack B Reaching women through health information technology: the Gabby preconception care system Am. J. Health Promot 27 2013 eS11 20 23286652 PMC3779885 source
Not checked in the free run.
- cites [24] Jack B Bickmore T Hempstead M Yinusa-Nyahkoon L Sadikova E Mitchell S Gardiner P Adigun F Penti B Schulman D Damus K Reducing preconception risks among African American women with conversational agent technology J. Am. Board Fam. Med 28 2015 441 451 26152434 PMC4739811 source
Not checked in the free run.
- Study design and conductreasoning
Restricting enrolment to women with internet access may have biased the sample toward women who use technology favorably.
“By including only women who had access to the internet, we may have biased the sample towards women who have favorable use of technology.”
Quote in the paperNot a substantial claim - Study design and conductnone given
The study's small sample size is a limitation.
“Limitations to this feasibility study include a small sample size, short duration of the intervention, specific inclusion criteria, and self-reported information.”
Quote in the paperNot a substantial claim - Interpretationcitation
Features of Gabby such as personalization and face-to-face engagement may promote healthy decision making about stress management among its users.
“In light of our findings and previous studies, we believe that aspects of Gabby, including personalization and face-to-face engagement [16], may promote healthy decision making on stress management among its users.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Gardiner P Hempstead MB Ring L Bickmore T Yinusa-Nyahkoon L Tran H Paasche-Orlow M Damus K Jack B Reaching women through health information technology: the Gabby preconception care system Am. J. Health Promot 27 2013 eS11 20 23286652 PMC3779885 source
Not checked in the free run.
- Study design and conductnone given
The short duration of the intervention is a limitation of the study.
“Limitations to this feasibility study include a small sample size, short duration of the intervention, specific inclusion criteria, and self-reported information.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
The study's specific inclusion criteria are a limitation.
“Limitations to this feasibility study include a small sample size, short duration of the intervention, specific inclusion criteria, and self-reported information.”
Quote in the paperNot a substantial claim - Study design and conductnone given
This feasibility study lacked the statistical power to measure the difference in adherence to plan between intervention and control patients.
“This feasibility study lacked the statistical power to measure the difference in adherence to plan between intervention and control patients.”
Quote in the paperSubstantial claim - Study design and conductown data
The study was not adequately powered to detect a difference in perceived stress between groups.
“However, our study was not adequately powered to detect such a difference”
Quote in the paperSubstantial claim - Premisecitation
Access to the Internet or ownership of cell phones with data is common among underserved racially diverse populations.
“Use of technology, such as having access to the Internet or owning cell phones with data, is common among underserved racially diverse populations [5].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [5] Gibbons CM Use of health information technology among racial and ethnic underserved communities Perspect. Health Inf. Manag 8 2011 Winter PMC3035830 21307989
Not checked in the free run.
- May combine two claims. 30
- Classified as probably not a substantial claim. 40
- The quote only partly states this claim. 1
May combine two claims.
Findingown dataThe amount of vegetable servings increased for both groups, but not significantly.
“The amount of vegetable servings increased for both groups, but not significantly.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe number of stress management techniques increased in both groups, though there was no significant difference (μ = 1 to 4 for intervention, μ=2 to 3 for control).
“The number of stress management techniques increased in both groups, though there was no significant difference (μ = 1 to 4 for intervention, μ=2 to 3 for control).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAt baseline, 51% identified as white, 26% as black, 2% as Asian/Pacific Islander, and 21% as other races.
“51% identified as white, 26% as black, 2% as Asian/Pacific Islander, and 21% as other races;”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAlthough statistically insignificant, duration of exercise increased in both groups for stretching/strengthening (p = 0.18) and aerobic exercise (p = 0.27).
“Although statistically insignificant, duration of exercise increased in both groups for stretching/ strengthening (p = 0.18) and aerobic exercise (p = 0.27).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown data84% primarily spoke English at home, while 11% primarily spoke Spanish.
“Eighty-four percent of participants primarily spoke English at home, while 11% primarily spoke Spanish.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe average time spent per individual session was 12.1 min (σ = 6.1, min = 3.9, max = 25.8).
“The average time spent per individual session was 12.1 min (σ = 6.1, min = 3.9, max = 25.8).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAt baseline, participants' average age was 35 years.
“On average, participants were 35 years old;”
Quote in the paperNot a substantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataThe study enrolled 61 women between the ages of 18 and 50 during a 12-month recruitment window.
“We recruited 61 participants in a 12-month period; all 61 recruited women were screened eligible and enrolled into the study for one month.”
- Also stated in: § Results · plain
“Sixty-one women ages 18 to 50 were enrolled.”
Quote in the paperNot a substantial claim- Also stated in: § Results · plain
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown data3% reported smoking, and 70% reported drinking alcohol at least once a month or more.
“Three percent of participants reported smoking, and 70% reported drinking alcohol at least once a month or more.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataOutcome data were collected from baseline to follow-up for 57 participants.
“We collected outcome data from baseline to follow-up on 57 participants (Fig. 2).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThere was no significant difference in food knowledge, food insecurity, and breakfast consumption between groups (p = 0.15, p = 0.99, and p = 0.11, respectively).
“There was no significant difference in food knowledge, food insecurity, and breakfast consumption between groups (p = 0.15, p = 0.99, and p = 0.11, respectively).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data20% of participants identified as Hispanic.
“and 20% identified as Hispanic.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAt follow-up, PHQ-9 and SF-12 scores did not differ significantly between the two groups (p = 0.36 and p = 0.28, respectively).
“At follow-up, PHQ-9 and SF-12 scores did not differ significantly between the two groups (p = 0.36 and p = 0.28, respectively).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAll 61 recruited women were screened eligible and enrolled for one month.
“We recruited 61 participants in a 12-month period; all 61 recruited women were screened eligible and enrolled into the study for one month.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataOn average, women had a BMI of 28 kg/m3 and scored 7 on the PHQ-9.
“On average, women in the study had a BMI of 28 kg/m3 and scored a 7 on the PHQ-9 assessment;”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data69% utilized suggestions from Gabby to improve healthy eating, 52% to increase physical activity, and 70% to manage stress: all of which were greater-but not statistically significant-relative frequencies than participants using patient information sheets (66%, 49% and 66%, respectively).
“Sixty-nine percent utilized suggestions from Gabby to improve healthy eating, 52% to increase physical activity, and 70% to manage stress: all of which were greater–but not statistically significant–relative frequencies than participants using patient information sheets (66%, 49% and 66%, respectively).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWomen favored using Gabby to improve stress management and increase physical activity more than women using patient information sheets.
“Women favored using Gabby to improve stress management and increase physical activity more than women using patient information sheets.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThere was no significant difference in self-confidence to manage stress, to engage in physical activity, and to eat healthy between groups.
“There was no significant difference in self-confidence to manage stress, to engage in physical activity, and to eat healthy between groups.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown data44% reported yearly household income less than $49,000, 46% more than $50,000, and 10% refused to disclose.
“In regards to yearly household income, 44% reported making less than $49,000, and another 46% reported making more than $50,000. Ten percent of participants refused to disclose their income status.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAt baseline, the most popular stress management techniques were physical activity (69%), listening to music (70%), and spending time with friends (66%).
“the most popular stress management techniques at baseline among participants included: engaging in physical activity (69%), listening to music (70%),and spending time with friends (66%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataECA users spent a median total of 52 min (IQR = 101.4, N = 31) interacting with Gabby and logged in 5 times (IQR = 7, N = 31).
“For one month, ECA users spent a median total of 52 min (interquartile range [IQR] = 101.4, N = 31) interacting with Gabby and logged in 5 times (IQR = 7, N = 31).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown data30% reported chronic health problems, and 67% regularly took prescribed medication.
“30% reported having chronic health problems, and 67% regularly took prescribed medication.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown data79% had completed at least some college, and 89% worked full-time or part-time.
“Seventy-nine percent of women had completed at least some college, and 89% of them worked full-time or part-time.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThere was a trend increase in the number of stress management techniques used, with Gabby users reporting use of more such techniques than at baseline.
“There was also a trend increase in the number of stress management techniques used.”
- Also stated in: § 4.1. Discussion · plain
“Gabby users reported utilizing more stress management techniques from baseline”
Quote in the paperNot a substantial claim- Also stated in: § 4.1. Discussion · plain
May combine two claims.
Findingown dataParticipants in both groups generally described their assigned intervention as very informative, easy to use, and a good reminder to keep their health status in check through mindfulness, physical activity and healthy eating.
“Users from both groups generally highlighted that their assigned intervention was very informative, easy to use, and served as a good reminder to keep their health status in check through mindfulness, physical activity and healthy eating.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataReported challenges in using the Gabby system were the sound and quality of her voice, the time commitment required, and limitations in program accessibility.
“Challenges using the Gabby system included the sound and quality of her voice, time commitment to use the system, and program accessibility.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationClinicians often address multiple health behaviors simultaneously and supplement office visits with written materials such as patient information sheets or brochures.
“Clinicians often address multiple health behaviors simultaneously and supplement office visits with additional health education through written materials, such as patient information sheets or brochures [1, 2].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [1] Buck ML Providing patients with written medication information Ann. Pharmacother 32 1998 962 969 9762384 source
Not checked in the free run.
- cites [2] Harvey I O'Brien M Addressing health disparities through patient education: the development of culturally-tailored health education materials at Puentes de Salud J. Community Health Nurs 28 2011 181 189 22053763 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTechnology-based interventions are becoming increasingly popular for delivering health-related behavioral changes.
“Today, technology-based interventions are becoming increasingly popular for delivering health-related behavioral changes [5–7].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [5] Gibbons CM Use of health information technology among racial and ethnic underserved communities Perspect. Health Inf. Manag 8 2011 Winter PMC3035830 21307989
Not checked in the free run.
- cites [6] Matthews J Win KT Oinas-Kukkonen H Freeman M Persuasive technology in mobile applications promoting physical activity: a systematic review J. Med. Syst 40 2016 72 26748792 source
Not checked in the free run.
- cites [7] Harris J Felix L Miners A Murray E Michie S Ferguson E Free C Lock K Landon J Edwards P Adaptive e-learning to improve dietary behavior: a systematic review and cost-effectiveness analysis Health Technol. Assess 15 2011 1 8 doi:http://dx.doi.org/10.3310/hta15370 PMC4781244 22030014 source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationMany clinicians endorse lifestyle changes or assist in managing chronic stress related problems (e.g., obesity, alcohol, and tobacco abuse) which require patients to change several behaviors at a time.
“Furthermore, many clinicians endorse lifestyle changes or assist in managing chronic stress related problems (e.g. obesity, alcohol, and tobacco abuse) which require patients to change several behaviors at a time [4].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [4] Khusid MA Vythilingam M The emerging role of mindfulness meditation as effective self-management strategy, part 1: clinical implications for depression, post-traumatic stress disorder, and anxiety Mil. Med 181 2016 961 968 27612338 source
Not checked in the free run.
May combine two claims.
PremisecitationAlthough patient information sheets are standard of care, their content and readability may not benefit patients with cultural or economic differences or lower literacy.
“Although these sheets are considered standard of care, the content and readability may not necessarily benefit patients with cultural or economic differences or lower literacy [3].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] Kutner M Greenburg E Jin Y Paulsen C The Health Literacy of America's Adults: Results from the 2003 National Assessment of Adult Literacy. NCES 2006-483 National Center for Education Statistics 2006
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningBecause the Gabby system was developed in English, participants who are not fluent in English were excluded.
“The Gabby system was also developed in English, excluding participants who are not fluent in English.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationOnly 13% of adults in the United States consume the recommended daily amount of fruits (4 to 5 servings).
“Only 13% of the adults in the United States consume the recommended daily amount of fruits (4 to 5 servings) [56, 57].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [56] American Heart Association, Suggested Servings from Each Food Group Healthy Living 2015 Accessed Feb 15 2017 Retrieved from http://www.heart.org/HEARTORG/HealthyLiving/HealthyEating/HealthyDietGoals/Suggested-Servings-from-Each-Food-Group_UCM_318186_Article.jsp#.WKR36tIrKUl
Not checked in the free run.
- cites [57] Centers for Disease Control and Prevention Overview: BRFSS 2013. Behavioral Risk Factor Surveillance System 2013 Accessed Feb 15 2017 Retrieved from http://www.cdc.gov/brfss/annual_data/2013/pdf/overview_2013.pdf
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe research assistant was not blinded to group allocation.
“The RA was not blinded to group allocation.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductcitationPerceived stress was measured using the Perceived Stress Scale (PSS-4).
“For stress management, we asked participants to report self-perceived stress levels using the Perceived Stress Scale (PSS-4) [45].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [45] Cohen S Williamson G Perceived stress in a probability sample of the United States Soc. Psychol. Health 3 1988 1 67
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study was approved by the BMC Institutional Review Board.
“The study was approved by the BMC Institutional Review Board.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPhysical activity recommendations were based on governmental guidelines.
“Finally, physical activity recommendations were based on governmental guidelines for physical activity [20, 21, 37, 38].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [20] Ellis T Latham N DeAngelis T Thomas CA Saint-Hilaire M Bickmore TW Feasibility of a virtual exercise coach to promote walking in community-dwelling persons with Parkinson Disease Am. J. Phys. Med. Rehabil 92 2013 472 485 quiz 482-5 23552335 PMC4266140 source
Not checked in the free run.
- cites [21] Bickmore TW Silliman RA Nelson K Cheng DM Winter M Henault L Paasche-Orlow MK A randomized controlled trial of an automated exercise coach for older adults J. Am. Geriatr. Soc 61 2013 1676 1683 24001030 source
Not checked in the free run.
- cites [37] US Department of Health and Human Services Physical Activity Guidelines for Americans US Department of Health and Human Services 2008
Not checked in the free run.
- cites [38] Centers for Disease Control and Prevention How Much Physical Activity Do Adults Need? Physical Activity 2015 Accessed Sept 10 2016 Retrieved from http://www.cdc.gov/physicalactivity/basics/adults/index.htm
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationPhysical activity was measured based on the Stanford Patient Education Research Center's Exercise Behaviors Questionnaire.
“Based on the Stanford Patient Education Research Center’s Exercise Behaviors Questionnaire, we compiled the total amount of time, in minutes, participants reported engaging in physical activity during a typical week [43].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] Stanford Patient Education Research Center, Exercise Behaviors Research Instruments Developed, Adapted or Used by the Stanford Patient Education Research Center 2017 Accessed on Sept 10 2016 Retrieved from http://patienteducation.stanford.edu/research/exercise.pdf
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningECAs may help patients adhere to behavioral changes through improved decision making and experiential learning rather than passive reading.
“ECAs may help patients adhere to behavioral changes through improved decision making and experiential learning as opposed to passive reading.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningReliance on self-reported information is a limitation, because participants may have inaccurately reported their health behaviors through lack of knowledge or discomfort sharing information with a web-based system.
“Limitations to this feasibility study include a small sample size, short duration of the intervention, specific inclusion criteria, and self-reported information.”
- Also stated in: § 4.1. Discussion · hedged
“Lastly, participants could have inaccurately reported their health behaviors due to a lack of knowledge or feeling uncomfortable sharing information with a web-based system.”
Quote in the paperNot a substantial claim- Also stated in: § 4.1. Discussion · hedged
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataParticipants were randomized using a computer-generated permuted block method.
“After obtaining baseline information, participants were randomized to either the intervention or control using a computer-generated permuted block method.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationA recent systematic review identified 21 RCTs of MBSR: eleven showed improvement in mental health measures compared to waitlist or standard care controls, and improved pain scores and mental health status for patients with chronic pain.
“A recent systematic review identified 21 RCTs of MBSR: eleven of these studies showed improvement in mental health measures compared to waitlist or standard care controls, and improved pain scores and mental health status for patients with chronic pain [32];”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [32] Fjorback L Arendt M Ørnbøl E Fink P Walach H Mindfulness-based stress reduction and mindfulness-based cognitive therapy – a systematic review of randomized controlled trials Acta Psychiatr. Scand 124 2011 102 119 21534932 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationFood access was measured using the Household Food Insecurity Access Scale (HFIAS).
“and inquired about food access and assistance programs using the Household Food Insecurity Access Scale (HFIAS) [42].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [42] Coates J Swindale A Bilinsky P Household Food Insecurity Access Scale (HFIAS) for Measurement of Food Access: Indicator Guide Food and Nutrition Technical Assistance Project Academy for Educational Development Washington, DC 2007
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationPhysical and mental health statuses were measured by the Short Form Health Survey (SF-12) and depression levels by the Patient Health Questionnaire (PHQ-9).
“physical and mental health statuses by the Short Form Health Survey (SF-12) [39] and depression levels by the Patient Health Questionnaire (PHQ-9) [40].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [39] Ware JE Jr Kosinski M Keller SD A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity Med. Care 34 1996 220 233 8628042 source
Not checked in the free run.
- cites [40] Kroenke K Spitzer RL The PHQ-9: a new depression diagnostic and severity measure Psychiatr. Ann 32 2002 509 515 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationUse of technologies among non-dependent alcoholic drinkers has been found to be promising.
“Research has found the use of technologies among non-dependent alcoholic drinkers to be promising [47, 48].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [47] Sankaranarayanan J Sallach RE Rural patients' access to mobile phones and willingness to receive mobile phone-based pharmacy and other health technology services: a pilot study Telemed. J. E Health 20 2014 182 185 24205837 source
Not checked in the free run.
- cites [48] Fowler LA Holt SL Joshi D Mobile technology-based interventions for adult users of alcohol: a systematic review of the literature Addict. Behav 62 2016 25 34 27310031 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataEffectiveness of randomization was assessed by comparing sociodemographic factors between groups using Chi-square tests and two-sample t-tests.
“Effectiveness of randomization was assessed by comparing sociodemographic factors between the intervention and control using Chi-square tests for dichotomous and categorical variables and two-sample t-tests for continuous variables.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationSelf-efficacy for exercise was measured with the Self-Efficacy for Exercise Scale (SEE).
“We also collected information on participants’ self-efficacy to participate in physical activity with the Self-Efficacy for Exercise Scale (SEE) [44].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [44] Resnick B Jenkins LS Testing the reliability and validity of the self-efficacy for exercise scale Nurs. Res 49 2000 154 159 10882320 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationNutrition questions were adapted from the National Health and Nutrition Examination Survey (NHANES).
“Adapting questions from the National Health and Nutrition Examination Survey (NHANES), participants reported the total number of fruit and vegetable servings they consumed daily;”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [41] National Center for Health Statistics (US) National Health and Nutrition Examination Survey, US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics 2008
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFewer than 10% of adults in the United States, including women, follow a healthy lifestyle pattern that includes stress management.
“Adherence to a healthy lifestyle includes stress management; however, fewer than 10% of adults in the United States follow this pattern, including women [46].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [46] King DE Mainous AG III Carnemolla M Everett CJ Adherence to healthy lifestyle habits in US adults, 1988–2006 Am. J. Med 122 2009 528 534 19486715 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMBSR is a promising mind-body intervention.
“Information on stress management was adapted from principles of Mindfulness Based Stress Reduction (MBSR) [16], a promising mind-body intervention [28–31].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [28] National Institute of Diabetes and Digestive and Kidney Diseases Diabetes Prevention Program. Diabetes Diabetes Prevention Program 2008 Accessed Sept 10 2016 Retrieved from https://www.niddk.nih.gov/about-niddk/research-areas/diabetes/diabetes-prevention-program-dpp/Pages/default.aspx
Not checked in the free run.
- cites [29] Reiner K Tibi L Lipsitz JD Do mindfulness-based interventions reduce pain intensity? A critical review of the literature Pain Med 14 2013 230 242 23240921 source
Not checked in the free run.
- cites [30] Cramer H Haller H Lauche R Dobos G Mindfulness-based stress reduction for low back pain: a systematic review BMC Complement. Altern. Med 12 2012 162 23009599 PMC3520871 source
Not checked in the free run.
- cites [31] Niazi AK Niazi SK Mindfulness-based stress reduction: a non-pharmacological approach for chronic illnesses N. Am. J. Med. Sci 3 2011 20 23 22540058 PMC3336928 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningUsers would have used the ECA system more if it had been available on multiple technology platforms such as mobile devices, since installation on a frequently used device would create more opportunities for engagement.
“Based on our qualitative feedback, we believe that users would have utilized the ECA system more had it been available on multiple technology platforms, such as mobile devices.”
- Also stated in: § 4.1. Discussion · hedged
“With smartphone ownership increasing steadily [60], having the Gabby system installed on a frequently used device would provide more opportunities for patients to engage in learning and practicing meaningful health behaviors.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [60] Poushter J Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies Pew Research Center: Global Attitudes & Trends 2016
Not checked in the free run.
- Also stated in: § 4.1. Discussion · hedged
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe National Standards for Culturally and Linguistically Appropriate Services in Health and Health Care encourage healthcare organizations and providers to use multimedia when communicating health information to culturally diverse patients.
“The National Standards for Culturally and Linguistically Appropriate Services in Health and Health Care encourage healthcare organizations and providers to use multimedia when communicating health information to culturally diverse patients [61].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Office of Minority Health National Standards for Culturally and Linguistically Appropriate Services (CLAS) in Health and Health Care: A Blueprint for Advancing and Sustaining CLAS Policy and Patience US Department of Health and Human Services Washington (DC) 2013
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFemale ethnic minority college students ate more servings of fruit when they received motivational text messages.
“another study revealed that female ethnic minority college students ate more servings of fruit when they received motivational text messages [59].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [59] Rodgers RF Pernal W Matsumoto A Shiyko M Intille S Franko DL Capitalizing on mobile technology to support healthy eating in ethnic minority college students J. Am. Coll. Health 64 2016 125 132 26630479 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSmartphone ownership is increasing steadily.
“With smartphone ownership increasing steadily [60]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [60] Poushter J Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies Pew Research Center: Global Attitudes & Trends 2016
Not checked in the free run.
May combine two claims.
PremisecitationMindfulness training has been shown to reduce stress levels and may as a result partially reduce engagement in alcohol use.
“Furthermore, mindfulness training has been shown to help decrease stress levels and as a result, may partially decrease engagement in alcohol use [52–55].”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [52] Bodenlos JS Noonan M Wells SY Mindfulness and alcohol problems in college students: the mediating effects of stress J. Am. Coll. Health 61 2013 371 378 23930751 source
Not checked in the free run.
- cites [53] Zgierska A Rabago D Chawla N Kushner K Koehler R Marlatt A Mindfulness meditation for substance use disorders: a systematic review Subst. Abus 30 2009 266 294 19904664 PMC2800788 source
Not checked in the free run.
- cites [54] Sinha R The role of stress in addiction relapse Curr. Psychiatry Rep 9 2007 388 395 17915078 source
Not checked in the free run.
- cites [55] Marcus MT Fine PM Moeller FG Khan MM Pitts K Swank PR Liehr P Changes in stress levels following mindfulness based stress reduction in a therapeutic community Addict. Disord. Their Treat 2 2003 63 68 source
Not checked in the free run.
May combine two claims.
PremisecitationIn studies aimed at reducing alcohol use among college students, those who received tailored text messages were more likely to report reduced alcohol consumption and increased awareness of managing drinking behaviors.
“In several studies to reduce alcohol use among college students, participants who received tailored text messages were more likely to report a reduction in alcohol consumption and an increased awareness to manage drinking behaviors [49–51].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [49] Mason M Ola B Zaharakis N Zhang J Text messaging interventions for adolescent and young adult substance use: a meta-analysis Prev. Sci 16 2015 181 188 24930386 source
Not checked in the free run.
- cites [50] Witkiewitz K Desai SA Bowen S Leigh BC Kirouac M Larimer ME Development and evaluation of a mobile intervention for heavy drinking and smoking among college students Psychol. Addict. Behav 28 2014 639 650 25000269 PMC6143292 source
Not checked in the free run.
- cites [51] Weitzel JA Bernhardt JM Usdan S Mays D Glanz K Using wireless handheld computers and tailored text messaging to reduce negative consequences of drinking alcohol J. Stud. Alcohol Drugs 68 2007 534 537 17568957 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn a pilot study of a virtual coach delivering mindfulness training, participants with coach-based training performed the techniques more effectively and regularly than those who taught themselves using paper and audio materials.
“Similarly, one pilot study implemented a virtual coach to provide mindfulness training, and found that participants who had coach-based training performed the techniques more effectively and regularly than participants who had to teach themselves the same techniques using paper and audio materials [22].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [22] Hudlicka E Virtual training and coaching of health behavior: example from mindfulness meditation training Patient Educ. Couns 92 2013 160 166 23809167 PMC3970714 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA web-based nutrition program produced an increase in fruit consumption that was not statistically significant compared with traditional in-person nutrition education among low-income adults.
“one study found that a web-based nutrition program led to increased–but not statistically significant–fruit consumption compared to a traditional in-person nutrition education among low-income adults [58]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Neuenschwander LM Abbott A Mobley AR Comparison of a web-based vs in-person nutrition education program for low-income adults J. Acad. Nutr. Diet 113 2013 120 126 23092741 source
Not checked in the free run.
The paper relies on this without support.
The ECA's content and dialogue are culturally appropriate and effective for the diverse urban women in the study.
“The ECA is an animated African American female character programmed to deliver culturally aware patient strategies and health information (e.g. recommending specific popular recipes or foods, mentioning prayer or spiritual traditions) to increase skills in self-management.”
The paper relies on this without support.
The patient information sheets plus meditation CD/MP3 are an adequate control that mirrors the ECA content and dose.
“If participants were randomized to the control, the RA reviewed patient information sheets in person for 60 min, which mirrored the content from the Gabby system.”
The paper relies on this without support.
The feasibility outcomes (recruitment, retention, satisfaction) are sufficient to conclude feasibility for a larger RCT.
“A primary goal of this study was to gather feasibility data on ECA utilization among multiracial women ages 18 to 50 years within an outpatient setting in order to design a larger fully powered RCT.”
The paper relies on this without support.
The one-month follow-up period is long enough to detect meaningful changes in health behaviors.
“After one month from baseline, the RA conducted post-study interviews in person or by phone.”
The paper relies on this without support.
The self-reported measures of diet, physical activity, and stress management are accurate and not subject to significant bias.
“We asked questions assessing eating patterns, physical activity routines, and stress management levels at baseline and post-intervention.”
The paper relies on this without support.
The ECA system's electronic voice is not a barrier compared to a live meditation teacher.
“Control group meditations were recorded by a live meditation teacher in contrast to Gabby’s electronic voice.”
The paper relies on this without support.
The sample of 61 women recruited from Boston primary care clinics is representative of diverse urban women.
“Participants were recruited from primary care outpatient clinics at Boston Medical Center (BMC).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The findings add to the mixed evidence base on nutritional ECAs.
“Our findings might, on first sight, contradict our hypotheses, and add to the mixed evidence base on nutritional ECAs [5,6,44].”
In these studies, both intervention and control conditions demonstrated reduced distress or increased uptake of stress management techniques.
“Furthermore, 4 controlled studies reported no significant posttreatment differences on measures of psychological distress between the intervention and control groups [24,27,32,33] with both intervention and control conditions demonstrating reduced distress [24,27,33] or increased uptake of stress management techniques [32].”
From Conversational agents in the treatment of mental health problems: mixed-method systematic review (2019) · cites this paper as [32]
Participants reported being satisfied with the conversational agent interventions offered.
“Generally, from studies that reported user experience outcomes (n=11), participants reported being satisfied with the conversational agent interventions offered [22,23,25,26,29,30,32].”
From Conversational agents in the treatment of mental health problems: mixed-method systematic review (2019) · cites this paper as [32]
Four controlled studies reported no significant posttreatment differences on measures of psychological distress between the intervention and control groups.
“Furthermore, 4 controlled studies reported no significant posttreatment differences on measures of psychological distress between the intervention and control groups [24,27,32,33] with both intervention and control conditions demonstrating reduced distress [24,27,33] or increased uptake of stress management techniques [32].”
From Conversational agents in the treatment of mental health problems: mixed-method systematic review (2019) · cites this paper as [32]
Three studies reported that participants found the conversational agent interventions available and accessible.
“In addition, 3 studies reported that participants found the conversational agent interventions available and accessible [26,32,33].”
From Conversational agents in the treatment of mental health problems: mixed-method systematic review (2019) · cites this paper as [32]
Their broader utility in promoting positive well-being in nonclinical populations appears uncertain.
“However, their broader utility in promoting positive well-being in nonclinical populations appears uncertain [32,33].”
From Conversational agents in the treatment of mental health problems: mixed-method systematic review (2019) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Baseline alcohol use for stress is reported as both 67% and about one-third
MajorThe reported baseline rates of alcohol use for stress management are 35% in the intervention group and 30% in the control group. The combined rate must lie between those values, not at 67%.
“At baseline, 67% of participants reported drinking alcohol at least once a month or more to manage their stress.”
“At 30 days, there was a significant decrease in the number of women who used alcohol for stress management in the intervention compared to the control group (35% to 14% for intervention, 30% to 31% for control; p = 0.03).”
Cites
WARE, J. E., KOSINSKI, M., & KELLER, S. D. (1996) · Medical Care · doi:10.1097/00005650-199603000-00003 · Cited by 17,392 · see citing works
The Physical Activity Guidelines for Americans
Piercy, K. L., Troiano, R. P., Ballard, R. M., Carlson, S. A., Fulton, J. E., Galuska, D. A., George, S. M., & Olson, R. D. (2018) · JAMA · doi:10.1001/jama.2018.14854 · Cited by 9,755 · see citing works
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · see citing works
(1988) · Cited by 4,111 · see citing works
Coates, J., Swindale, A., & Bilinsky, P. (2007) · PsycEXTRA Dataset · doi:10.1037/e576842013-001 · Cited by 2,122 · see citing works
National Health and Nutrition Examination Survey
Rothwell, C. J. (2009) · Springer eBooks · doi:10.1007/978-0-387-78665-0_6177 · Cited by 2,087 · see citing works
Kutner, M. A., Greenburg, E., Jin, Y., & Paulsen, C. A. (2006) · National Center for Education Statistics · Cited by 1,545 · see citing works
2008 Physical activity guidelines for Americans
(2008) · PsycEXTRA Dataset · doi:10.1037/e525412010-001 · Cited by 1,472 · see citing works
National Health and Nutrition Examination Survey
(2008) · Encyclopedia of Epidemiology · doi:10.4135/9781412953948.n305 · Cited by 1,341 · see citing works
Testing the reliability and validity of the self-efficacy for exercise scale
Resnick, B., & Jenkins, L. S. (2000) · Nursing Research · doi:10.1097/00006199-200005000-00007 · Cited by 810 · cited 1× · see citing works
“We also collected information on participants’ self-efficacy to participate in physical activity with the Self-Efficacy for Exercise Scale (SEE) [44].”
MethodFjorback, L. O., Arendt, M., Ørnbøl, E., Fink, P., & Walach, H. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01704.x · Cited by 803 · see citing works
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494 · see citing works
Self-citationThe role of stress in addiction relapse
Sinha, R. (2007) · Current Psychiatry Reports · doi:10.1007/s11920-007-0050-6 · Cited by 423 · see citing works
A randomised controlled trial of a brief online mindfulness-based intervention
Cavanagh, K., Strauss, C., Cicconi, F., Griffiths, N., Wyper, A., & Jones, F. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.06.003 · Cited by 350 · see citing works
Mindfulness meditation for substance use disorders: a systematic review
Zgierska, A., Rabago, D., Chawla, N., Kushner, K., Koehler, R., & Marlatt, A. (2009) · Substance Abuse · doi:10.1080/08897070903250019 · Cited by 348 · see citing works
Adherence to healthy lifestyle habits in US adults, 1988–2006
King, D. E., Mainous, A. G., Carnemolla, M., & Everett, C. J. (2009) · The American Journal of Medicine · doi:10.1016/j.amjmed.2008.11.013 · Cited by 336 · cited 1× · see citing works
“Adherence to a healthy lifestyle includes stress management; however, fewer than 10% of adults in the United States follow this pattern, including women [46].”
BackgroundA randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · cited 2× · see citing works
“Finally, physical activity recommendations were based on governmental guidelines for physical activity [20, 21, 37, 38].”
BackgroundSelf-citationTaking the time to care: empowering low health literacy hospital patients with virtual nurse agents
Bickmore, T. W., Pfeifer, L. M., & Jack, B. W. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518891 · Cited by 289 · see citing works
Self-citationBickmore, T. W., Pfeifer, L. M., Byron, D., Forsythe, S., Henault, L. E., Jack, B. W., Silliman, R., & Paasche-Orlow, M. K. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499991 · Cited by 249 · see citing works
Self-citationHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242 · see citing works
Self-citationPersuasive technology in mobile applications promoting physical activity: a systematic review
Matthews, J., Win, K. T., Oinas-Kukkonen, H., & Freeman, M. (2016) · Journal of Medical Systems · doi:10.1007/s10916-015-0425-x · Cited by 239 · see citing works
Maintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213 · see citing works
Self-citationDo mindfulness-based interventions reduce pain intensity? A critical review of the literature
Reiner, K., Tibi, L., & Lipsitz, J. D. (2013) · Pain Medicine · doi:10.1111/pme.12006 · Cited by 208 · see citing works
Automated interventions for multiple health behaviors using conversational agents
Bickmore, T. W., Schulman, D., & Sidner, C. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.011 · Cited by 206 · see citing works
Self-citationMindfulness-based stress reduction for low back pain. A systematic review
Cramer, H., Haller, H., Lauche, R., & Dobos, G. (2012) · BMC Complementary and Alternative Medicine · doi:10.1186/1472-6882-12-162 · Cited by 193 · see citing works
Krusche, A., Cyhlarova, E., & Williams, J. M. G. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-003498 · Cited by 192 · see citing works
Mindfulness-based stress reduction: A non-pharmacological approach for chronic illnesses
Niazi, A., & Niazi, S. (2011) · North American Journal of Medical Sciences · doi:10.4297/najms.2011.320 · Cited by 170 · see citing works
A randomized controlled pilot study of a brief web-based mindfulness training
Glück, T. M., & Maercker, A. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-175 · Cited by 168 · see citing works
Text messaging interventions for adolescent and young adult substance use: a meta-analysis
Mason, M., Ola, B., Zaharakis, N., & Zhang, J. (2015) · Prevention Science · doi:10.1007/s11121-014-0498-7 · Cited by 160 · see citing works
Feasibility of an Online Mindfulness Program for Stress Management—A Randomized, Controlled Trial
Morledge, T. J., Allexandre, D., Fox, E., Fu, A. Z., Higashi, M. K., Kruzikas, D. T., Pham, S. V., & Reese, P. R. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9490-x · Cited by 159 · see citing works
Weitzel, J. A., Bernhardt, J. M., Usdan, S., Mays, D., & Glanz, K. (2007) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2007.68.534 · Cited by 142 · see citing works
Witkiewitz, K., Desai, S. A., Bowen, S., Leigh, B. C., Kirouac, M., & Larimer, M. E. (2014) · Psychology of Addictive Behaviors · doi:10.1037/a0034747 · Cited by 134 · see citing works
The clinical content of preconception care: nutrition and dietary supplements
Gardiner, P. M., Nelson, L., Shellhaas, C., Dunlop, A. L., Long, R., Andrist, S., & Jack, B. W. (2008) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2008.10.049 · Cited by 133 · see citing works
Self-citationFowler, L. A., Holt, S. L., & Joshi, D. (2016) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.06.008 · Cited by 123 · see citing works
King, A. C., Bickmore, T. W., Campero, M. I., Pruitt, L. A., & Yin, J. L. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.798374 · Cited by 114 · see citing works
Harris, J., Felix, L., Miners, A., Murray, E., Michie, S., Ferguson, E., Free, C., Lock, K., Landon, J., & Edwards, P. (2011) · Health Technology Assessment · doi:10.3310/hta15370 · Cited by 109 · see citing works
Change in stress levels following mindfulness-based stress reduction in a therapeutic community
Marcus, M. T., Fine, P. M., Moeller, F. G., Khan, M. M., Pitts, K., Swank, P. R., & Liehr, P. (2003) · Addictive Disorders & Their Treatment · doi:10.1097/00132576-200302030-00001 · Cited by 106 · see citing works
Virtual training and coaching of health behavior: Example from mindfulness meditation training
Hudlicka, E. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.007 · Cited by 104 · see citing works
Reducing preconception risks among African American women with conversational agent technology
Jack, B., Bickmore, T., Hempstead, M., Yinusa-Nyahkoon, L., Sadikova, E., Mitchell, S., Gardiner, P., Adigun, F., Penti, B., Schulman, D., et al. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.04.140327 · Cited by 99 · see citing works
Self-citationEllis, T., Latham, N. K., DeAngelis, T. R., Thomas, C. A., Saint-Hilaire, M., & Bickmore, T. W. (2013) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e31828cd466 · Cited by 91 · see citing works
Self-citationUse of health information technology among racial and ethnic underserved communities.
Gibbons, M. C. (2011) · PubMed Central · Cited by 89 · see citing works
Valle, C. G., Deal, A. M., & Tate, D. F. (2017) · Journal of Cancer Survivorship · doi:10.1007/s11764-016-0571-2 · Cited by 89 · see citing works
Reaching Women through Health Information Technology: The Gabby Preconception Care System
Gardiner, P., Hempstead, M. B., Ring, L., Bickmore, T., Yinusa-Nyahkoon, L., Tran, H., Paasche-Orlow, M., Damus, K., & Jack, B. (2013) · American Journal of Health Promotion · doi:10.4278/ajhp.1200113-quan-18 · Cited by 88 · see citing works
Self-citationComparison of a web-based vs in-person nutrition education program for low-income adults
Neuenschwander, L. M., Abbott, A., & Mobley, A. R. (2013) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2012.07.034 · Cited by 83 · see citing works
Mindfulness and alcohol problems in college students: the mediating effects of stress
Bodenlos, J. S., Noonan, M., & Wells, S. Y. (2013) · Journal of American College Health · doi:10.1080/07448481.2013.805714 · Cited by 81 · see citing works
Khusid, M. A., & Vythilingam, M. (2016) · Military Medicine · doi:10.7205/milmed-d-14-00677 · Cited by 77 · see citing works
Providing patients with written medication information
Buck, M. L. (1998) · Annals of Pharmacotherapy · doi:10.1345/aph.17455 · Cited by 72 · see citing works
Rosal, M. C., Heyden, R., Mejilla, R., Capelson, R., Chalmers, K. A., Rizzo DePaoli, M., Veerappa, C., & Wiecha, J. M. (2014) · JMIR Research Protocols · doi:10.2196/resprot.3412 · Cited by 56 · see citing works
Sankaranarayanan, J., & Sallach, R. E. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0150 · Cited by 39 · see citing works
Virtual Worlds as a Healing Modality for Returning Soldiers and Veterans
Chance, E. (2009) · Frontiers in Neuroengineering · doi:10.3389/conf.neuro.14.2009.06.070 · Cited by 16 · see citing works
Effect of Adding Online Social Support Tools to an Adult Walking Program
Monroe, C. M., Bassett, D. R., Fitzhugh, E. C., Raynor, H. A., & Thompson, D. L. (2016) · Health Promotion Practice · doi:10.1177/1524839915626674 · Cited by 16 · see citing works
Harvey, I., & O'Brien, M. (2011) · Journal of Community Health Nursing · doi:10.1080/07370016.2011.614827 · Cited by 15 · see citing works
Capitalizing on mobile technology to support healthy eating in ethnic minority college students
Rodgers, R. F., Pernal, W., Matsumoto, A., Shiyko, M., Intille, S., & Franko, D. L. (2016) · Journal of American College Health · doi:10.1080/07448481.2015.1085055 · Cited by 14 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Ehrenfeld, 2010, Use of a computer agent to explain anesthesia concepts to patients, Annual Meeting of the American Society of Anesthesiologists, vol. 3
Cited by
Sorted by citations
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · see citing works
Conversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275 · see citing works
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302 · see citing works
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305 · see citing works
Prochaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257 · see citing works
“Finally, although conversational agents can present in different modalities, including text, verbal [18,19], and animation [20-25], preliminary research on modality for psychoeducation delivery specifically found that text-based presentation resulted in higher program adherence than verbal presentation [26].”
BackgroundBeatty, C., Malik, T., Meheli, S., & Sinha, C. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.847991 · Cited by 224 · see citing works
“…mental health space is gaining traction and they have recently been implemented to help track medication and physical activity adherence (26, 27), provide cognitive behavioral therapy (CBT) (28), and deliver healthy lifestyle recommendations (29) across clinical and non-clinical populations.”
BackgroundHauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210 · see citing works
A critical review of state‐of‐the‐art chatbot designs and applications
Luo, B., Lau, R. Y. K., Li, C., & Si, Y. (2021) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1434 · Cited by 244 · see citing works
Bendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H. (2022) · Verhaltenstherapie · doi:10.1159/000501812 · Cited by 214 · see citing works
Systematic review and meta-analysis of the effectiveness of chatbots on lifestyle behaviours
Singh, B., Olds, T., Brinsley, J., Dumuid, D., Virgara, R., Matricciani, L., Watson, A., Szeto, K., Eglitis, E., Miatke, A., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00856-1 · Cited by 215 · see citing works
Digital Commensality: Eating and Drinking in the Company of Technology
Spence, C. J., Mancini, M., & Huisman, G. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02252 · Cited by 157 · see citing works
Technical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150 · see citing works
Chew, H. S. J. (2022) · JMIR Medical Informatics · doi:10.2196/32578 · Cited by 136 · see citing works
Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review
Kramer, L. L., ter Stal, S., Mulder, B. C., de Vet, E., & van Velsen, L. (2020) · Journal of Medical Internet Research · doi:10.2196/14058 · Cited by 121 · see citing works
“Study designs varied from a randomized controlled trial (RCT) [3,4,17,19-23,25-30,32,33] to a pretest-posttest design, either with [31] or without control a control group [5,18,30].”
BackgroundMethodInfluentialInfluence of Rapport and Social Presence with an AI Psychotherapy Chatbot on Users’ Self-Disclosure
Lee, J., Lee, D., & Lee, J.-G. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2146227 · Cited by 130 · see citing works
Chatbots to Support Young Adults’ Mental Health: An Exploratory Study of Acceptability
Koulouri, T., Macredie, R. D., & Olakitan, D. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3485874 · Cited by 127 · see citing works
Loveys, K., Sebaratnam, G., Sagar, M., & Broadbent, E. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00680-7 · Cited by 110 · see citing works
Mitsea, E., Drigas, A. S., & Skianis, C. A. (2023) · Behavioral Sciences · doi:10.3390/bs13121008 · Cited by 102 · see citing works
Hunt, M. G., Miguez, S. M., Dukas, B., Onwude, O., & White, S. J. (2021) · JMIR mhealth and uhealth · doi:10.2196/26152 · Cited by 98 · see citing works
Kim, M., Lee, S., Kim, S., Heo, J.-I., Lee, S., Shin, Y., Cho, C., & Jung, D. (2025) · Journal of Medical Internet Research · doi:10.2196/65589 · Cited by 117 · see citing works
Deploying a robotic positive psychology coach to improve college students’ psychological well-being
Jeong, S., Aymerich-Franch, L., Arias, K., Alghowinem, S., Lapedriza, À., Picard, R. W., Park, H. W., & Breazeal, C. (2022) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-022-09337-8 · Cited by 90 · see citing works
Polite speech strategies and their impact on drivers’ trust in autonomous vehicles
Lee, J.-G., & Lee, K. M. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107015 · Cited by 83 · see citing works
Early detection of depression using a conversational AI bot: A non-clinical trial
Kaywan, P., Ahmed, K. E. U., Ibaida, A., Miao, Y., & Gu, B. (2023) · PLoS ONE · doi:10.1371/journal.pone.0279743 · Cited by 83 · see citing works
Vaidyam, A. N., Linggonegoro, D. W., & Torous, J. B. (2020) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720966429 · Cited by 83 · see citing works
Rehabilitation, the Great Absentee of Virtual Coaching in Medical Care: Scoping Review
Tropea, P., Schlieter, H., Sterpi, I., Judica, E., Gand, K., Caprino, M., Gabilondo, I., Gomez-Esteban, J. C., Busnatu, S., Sinescu, C., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12805 · Cited by 73 · see citing works
Promoting Physical Activity Through Conversational Agents: Mixed Methods Systematic Review
Luo, T. C., Aguilera, A., Lyles, C. R., & Figueroa, C. A. (2021) · Journal of Medical Internet Research · doi:10.2196/25486 · Cited by 68 · see citing works
Computer-Controlled Virtual Humans in Patient-Facing Systems: Systematic Review and Meta-Analysis
Chattopadhyay, D., Ma, T., Sharifi, H., & Martyn-Nemeth, P. A. (2020) · Journal of Medical Internet Research · doi:10.2196/18839 · Cited by 66 · see citing works
Li, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D. T. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104494 · Cited by 74 · see citing works
Celino, I., & Calegari, G. R. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102410 · Cited by 66 · see citing works
Bendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H. (2019) · Verhaltenstherapie · doi:10.1159/000499492 · Cited by 62 · see citing works
Househ, M. S., Grainger, R., Petersen, C. C., Bamidis, P. D., & Merolli, M. (2018) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1641197 · Cited by 55 · see citing works
Gardiner, P., Luo, M., D’Amico, S., Gergen-Barnett, K., White, L. F., Saper, R., Mitchell, S., & Liebschutz, J. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0225540 · Cited by 55 · see citing works
Self-citationNiewiadomski, R., Ceccaldi, E., Huisman, G., Volpe, G., & Mancini, M. (2019) · Frontiers in Robotics and AI · doi:10.3389/frobt.2019.00119 · Cited by 57 · see citing works
Review of artificial intelligence‐based question‐answering systems in healthcare
Cilar, L., Gosak, L., & Štiglic, G. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1487 · Cited by 60 · see citing works
Pickard, M. D., & Roster, C. A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.106197 · Cited by 52 · see citing works
Embodied Conversational Agents for Chronic Diseases: Scoping Review
Jiang, Z., Huang, X., Wang, Z., Liu, Y., Huang, L., & Luo, X. (2023) · Journal of Medical Internet Research · doi:10.2196/47134 · Cited by 51 · see citing works
Ponathil, A., Özkan, N. F., Welch, B. M., Bertrand, J., & Madathil, K. C. (2020) · Journal of Genetic Counseling · doi:10.1002/jgc4.1239 · Cited by 48 · see citing works
What Do We Know About the Use of Chatbots for Public Health?
Gabarrón, E., Larbi, D., Denecke, K., & Årsand, E. (2020) · Studies in health technology and informatics · doi:10.3233/shti200270 · Cited by 49 · see citing works
Martinengo, L., Jabir, A. I., Goh, W. W. T., Lo, N. Y. W., Ho, M. R., Kowatsch, T., Atun, R. A., Michie, S., & Car, L. T. (2022) · Journal of Medical Internet Research · doi:10.2196/39243 · Cited by 48 · see citing works
User Experiences of Well-Being Chatbots
Kettle, L., & Lee, Y.-C. (2024) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208231162453 · Cited by 45 · see citing works
Mobile health interventions: exploring the use of common relationship factors
Grekin, E. R., Beatty, J. R., & Ondersma, S. J. (2019) · JMIR mhealth and uhealth · doi:10.2196/11245 · Cited by 42 · see citing works
21-Day Stress Detox: Open Trial of a Universal Well-Being Chatbot for Young Adults
Williams, R. M., Hopkins, S. A., Frampton, C., Holt‐Quick, C., Merry, S., & Stasiak, K. (2021) · Social Sciences · doi:10.3390/socsci10110416 · Cited by 43 · see citing works
Tailoring coaching strategies to users’ motivation in a multi-agent health coaching application
Beinema, T. C., den Akker, H. O., van Velsen, L., & Hermens, H. J. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106787 · Cited by 38 · see citing works
Ulrich, S., Gantenbein, A. R., Zuber, V., Von Wyl, A., Kowatsch, T., & Künzli, H. (2024) · Journal of Medical Internet Research · doi:10.2196/50132 · Cited by 36 · see citing works
“Conversational agents (CAs), also known as chatbots or digital assistants, are increasingly being applied in both clinical [48-50] and nonclinical [51-53] health care settings to support disease management and behavioral lifestyle interventions.”
Virtual Humans in Health-Related Interventions: A Meta-Analysis
Ma, T., Sharifi, H., & Chattopadhyay, D. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3312853 · Cited by 37 · see citing works
In Helping a Vulnerable Bot, You Help Yourself
Kim, T., Ruensuk, M., & Hong, H. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376743 · Cited by 36 · see citing works
Kramer, L. L., van Velsen, L., Clark, J. L., Mulder, B. C., & de Vet, E. (2022) · JMIR Formative Research · doi:10.2196/33974 · Cited by 31 · see citing works
Bricker, J. B., Sullivan, B. M., Mull, K. E., Santiago‐Torres, M., & Ferres, J. L. (2024) · JMIR mhealth and uhealth · doi:10.2196/57318 · Cited by 32 · see citing works
Schillings, C., Meißner, E., Erb, B., Bendig, E., Schultchen, D., & Pollatos, O. (2024) · JMIR Mental Health · doi:10.2196/50454 · Cited by 44 · see citing works
Gardiner, P. M., Bickmore, T., Yinusa-Nyahkoon, L. S., Reichert, M., Julce, C., Sidduri, N., Martin-Howard, J., Woodhams, E. J., Aryan, J., Zhang, Z., et al. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2020.571705 · Cited by 30 · see citing works
Self-citationSocial robots as eating companions
Niewiadomski, R., Bruijnes, M., Huisman, G., Gallagher, C. P., & Mancini, M. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.909844 · Cited by 28 · see citing works
Militello, L. K., Sezgın, E., Huang, Y., & Lin, S. M. (2021) · JMIR Formative Research · doi:10.2196/18240 · Cited by 26 · see citing works
Mlakar, I., Šafran, V., Hari, D., Rojc, M., Alankuş, G., Luna, R. P., & Ariöz, U. (2021) · Symmetry · doi:10.3390/sym13071187 · Cited by 25 · see citing works
Zhang, Y., & Pan, W. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2468972 · Cited by 22 · see citing works
Chatbots in the Field of Mental Health: Challenges and Opportunities
Viduani, A. C., Cosenza, V., Araújo, R., & Kieling, C. (2023) · Springer eBooks · doi:10.1007/978-3-031-10698-9_8 · Cited by 22 · see citing works
Stock, A., Schlögl, S., & Groth, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35894-4_13 · Cited by 21 · see citing works
Bak, M., & Chin, J. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae057 · Cited by 19 · see citing works
Loveys, K., Antoni, M. H., Donkin, L., Sagar, M. A., & Broadbent, E. (2022) · JMIR Formative Research · doi:10.2196/42390 · Cited by 18 · see citing works
Esposito, A. A., Amorese, T., Cuciniello, M., Esposito, A. M., & Cordasco, G. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1138501 · Cited by 17 · see citing works
Kabir, M. F., Schulman, D. J., & Abdullah, A. S. M. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1360-z · Cited by 17 · see citing works
Bridging the Health Disparity of African Americans Through Conversational Agents
Kim, J., Park, S. Y., & Robert, L. (2020) · Digital Government Research and Practice · doi:10.1145/3428122 · Cited by 17 · see citing works
Interactive Conversational Agents for Perinatal Health: A Mixed Methods Systematic Review
Amil, S., Da, S. M. A. R., Plaisimond, J., Roch, G., Sasseville, M., Bergeron, F., & Gagnon, M. (2025) · Healthcare · doi:10.3390/healthcare13040363 · Cited by 22 · see citing works
Schillings, C., Meißner, E., Erb, B., Schultchen, D., Bendig, E., & Pollatos, O. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1046202 · Cited by 17 · see citing works
Shi, Z., Chen, H., Velentza, A.-M., Liu, S., Dennler, N. S., O'Connell, A., & Matarić, M. J. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568162.3576987 · Cited by 16 · see citing works
Influence of Rapport and Social Presence with an Ai Psychotherapy Chatbot on Users’ Self-Disclosure
Lee, J., Lee, J.-G., & Lee, D. (2022) · doi:10.2139/ssrn.4063508 · Cited by 127 · see citing works
Mancone, S., Diotaiuti, P., Valente, G., Corrado, S., Bellizzi, F., Vilarino, G. T., & Andrade, A. (2023) · Behavioral Sciences · doi:10.3390/bs13070550 · Cited by 14 · see citing works
Wang, Q., Yang, W., Xu, K., & Lam, L. T.-M. (2025) · Digital Health · doi:10.1177/20552076251353731 · Cited by 14 · see citing works
Beinema, T. C., den Akker, H. O., Hurmuz, M. Z. M., Jansen-Kosterink, S. M., & Hermens, H. J. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100502 · Cited by 13 · see citing works
Robinson, N., Connolly, J., Suddrey, G., & Kavanagh, D. J. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01054-5 · Cited by 13 · see citing works
What to Discuss?—A Blueprint Topic Model for Health Coaching Dialogues With Conversational Agents
Beinema, T. C., den Akker, H. O., Hermens, H. J., & van Velsen, L. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2041884 · Cited by 14 · see citing works
Can a virtual human increase mindfulness and reduce stress? A randomised trial
Karhiy, M., Sagar, M. A., Antoni, M. H., Loveys, K., & Broadbent, E. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100069 · Cited by 13 · see citing works
Mobile/VR/Robotics/IoT-Based Chatbots and Intelligent Personal Assistants for Social Inclusion
Karyotaki, M., Drigas, A. S., & Skianis, C. (2024) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v18i08.46473 · Cited by 12 · see citing works
Capturing Teens’ Voice in Designing Supportive Agents
Lopatovska, I., Turpin, O., Davis, J., Connell, E. G., Denney, C., Fournier, H., Ravi, A., Yoon, J. H., & Parasnis, E. (2022) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3543829.3543838 · Cited by 13 · see citing works
DEPRA: An Early Depression Detection Analysis Chatbot
Kaywan, P., Ahmed, K. E. U., Miao, Y., Ibaida, A., & Gu, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90885-0_18 · Cited by 12 · see citing works
Long-Term Interaction with Relational SIAs
Kory-Westlund, J. M., Park, H. W., Grover, I., & Breazeal, C. (2022) · ACM eBooks · doi:10.1145/3563659.3563667 · Cited by 12 · see citing works
Kuhail, M. A., Al-Shamaileh, O., Farooq, S., Shahin, H., Abdelzaher, F., & Thomas, J. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/9942295 · Cited by 11 · see citing works
King, V. L., Siegel, G., Priesmeyer, H. R., Siegel, L. H., & Potter, J. S. (2024) · JMIR Formative Research · doi:10.2196/48068 · Cited by 10 · see citing works
A Survey of Conversational Agents and Their Applications for Self-Management of Chronic Conditions
Park, M. S., Upama, P. B., Anik, A. A., Ahamed, S. I., Luo, J., Tian, S., Rabbani, M., & Oh, H. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00162 · Cited by 12 · see citing works
Influence of a robotic companion on women's food choices: Evidence from an imaginary task
Guo, X., Wang, C., & Wan, X. I. (2024) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12588 · Cited by 10 · see citing works
Strathearn, C., & Ma, M. (2020) · Informatics · doi:10.3390/informatics7030028 · Cited by 10 · see citing works
Reilly, E. D., Kathawalla, U., Robins, H., Heapy, A. A., Hogan, T. P., Waring, M. E., Quigley, K. S., Drebing, C. E., Bickmore, T., Volonte, M., et al. (2023) · JMIR Research Protocols · doi:10.2196/45887 · Cited by 9 · see citing works
Self-citationAmbrosio, M. D. G., Lachman, J. M., Zinzer, P., Sacolo-Gwebu, H., Vyas, S., Vallance, I., Calderón, F., Gardner, F. E. M., Markle, L., Stern, D., et al. (2024) · JMIR Research Protocols · doi:10.2196/52145 · Cited by 11 · see citing works
You, C., Ghosh, R., Vilaro, M. J., Venkatakrishnan, R., Venkatakrishnan, R., Maxim, A., Peng, X., Tamboli, D. N. A., & Lok, B. C. L. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1655860 · Cited by 10 · see citing works
Karhiy, M., Sagar, M. A., Antoni, M., Loveys, K., & Broadbent, E. (2023) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw59127.2023.10388195 · Cited by 11 · see citing works
Can intelligent agents improve data quality in online questiosnnaires? A pilot study
Söderström, A., Shatte, A. B. R., & Fuller‐Tyszkiewicz, M. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01574-w · Cited by 10 · see citing works
Kotov, A., Carcone, A. I., & Towner, E. (2024) · JMIR Research Protocols · doi:10.2196/60361 · Cited by 10 · see citing works
Amil, S., Gagnon, M., Bédard, A., Da, S. M. A. R., Mora, D. Z., Drapeau, V., & Desroches, S. (2025) · Journal of Medical Internet Research · doi:10.2196/78220 · Cited by 8 · see citing works
Loveys, K., Antoni, M. H., Donkin, L., Sagar, M. A., Xu, W., & Broadbent, E. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6110099 · Cited by 8 · see citing works
Users' Expectations and Practices with Agent Memory
Jones, B., Stemmler, K., Su, E., Kim, Y., & Kuzminykh, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720158 · Cited by 8 · see citing works
Development of multimodal sentiment recognition and understanding
Tao, J., Fan, C., Lian, Z., Lyu, Z., Shen, Y., & Liang, S. (2024) · Journal of Image and Graphics · doi:10.11834/jig.240017 · Cited by 8 · see citing works
Chen, T., Shen, Y., Chen, X., & Zhang, L. (2024) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3676962 · Cited by 7 · see citing works
A Review on Trustworthiness of Digital Assistants for Personal Healthcare
Bailoni, T., & Dragoni, M. (2025) · ACM Computing Surveys · doi:10.1145/3714999 · Cited by 9 · see citing works
Talk it Out: Teen Reactions to a Supportive Conversational Agent
Lopatovska, I., Turpin, O., Yoon, J. H., Brown, D., & Vroom, L. (2022) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.615 · Cited by 7 · see citing works
Tailoring coaching conversations with virtual health coaches
Beinema, T. C. (2021) · doi:10.3990/1.9789036552608 · Cited by 6 · see citing works
CuentosIE: can a chatbot about “tales with a message” help to teach emotional intelligence?
Ferrández, A., Lavigne-Cerván, R., Peral, J., Sória, I. N., Lloret, A. T., Gil, D., & Rocamora, C. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1866 · Cited by 10 · see citing works
Designing Supportive Conversational Agents With and For Teens
Lopatovska, I., & Davis, J. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578283 · Cited by 7 · see citing works
Multilingual Chatbots to Collect Patient-Reported Outcomes
Rojc, M., Ariöz, U., Šafran, V., & Mlakar, I. (2023) · IntechOpen eBooks · doi:10.5772/intechopen.111865 · Cited by 7 · see citing works
Digital Human Representations for Health Behavior Change: A Structured Literature Review
Adam, M. T. P., Dreyer, S., Gimpel, H., Olenberger, C., & Fraunhofer, F. I. T. (2022) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00171 · Cited by 5 · see citing works
Assessing Synthetic Voices for Mental Health Chatbots
Amorese, T., McConvey, G., Cuciniello, M., Cordasco, G., Bond, R., Mulvenna, M. D., Ennis, E., Callejas, Z., & Esposito, A. A. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-99-3043-2_6 · Cited by 5 · see citing works
Kim, S. J., Clark, V., Hancock, J. T., Rawassizadeh, R., Liu, H., Taylor, E. A., & Sheppard, V. B. (2025) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaf007 · Cited by 4 · see citing works
- Authors
- Gardiner, P. M., McCue, K. D., Negash, L. M., Cheng, T., White, L. F., Yinusa-Nyahkoon, L., Jack, B. W., & Bickmore, T. W.
- Affiliations
- Boston University (US)
- Northeastern University (US)
- Corresponding author
- Gardiner, Paula M.
- ORCID
- Venue
- Patient Education and Counseling
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 100
- Issue
- 9
- Pages
- 1720-1729
- ISSN
- 0738-3991 (ISSN-L)
- PMC
- PMC5559098
- OpenAlex
- W2608852370
- Semantic Scholar
- 20d862b9b18b68ee28728b34b61de596469c0b10
- Cited by
- 139
- References
- 54
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 14 · 2023: 27 · 2022: 20 · 2021: 20 · 2020: 12 · 2019: 13 · 2018: 2
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Patient Education and Counseling (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- The Journal of the American Medical Association (JAMA) Network (American Medical Association) (submittedVersion)
- Funders
- National Center for Complementary and Integrative Health (K07AT005463)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- embodied conversational agents, mindfulness, stress management, healthy lifestyle intervention, urban women, alcohol consumption, fruit consumption, physical activity, dietary habits, meditation, health behavior change, feasibility
- MeSH terms
- Adolescent, Adult, Behavior Therapy, Communication, Feeding Behavior, Female, Humans, Life Style, Stress, Psychological, Exercise, Outcome Assessment, Health Care, Meditation, Young Adult, Mindfulness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review