Reducing preconception risks among African American women with conversational agent technology
Open accessAbstract
BACKGROUND: Systems and tools are needed to identify and mitigate preconception health (PCH) risks, particularly for African American (AA) women, given persistent health disparities. We developed and tested "Gabby," an online preconception conversational agent system. METHODS: One hundred nongravid AA women 18-34 years of age were screened for over 100 PCH risks and randomized to the Gabby or control group. The Gabby group interacted with the system for up to six months; the control group received a letter indicating their health risks with a recommendation to talk with their clinician. The numbers, proportions, and types of risks were compared between groups. RESULTS: There were 23.7 (SD 5.9) risks identified per participant. Eighty-five percent (77 of 91) provided 6 month follow up data. The Gabby group had greater reductions in the number (8.3 vs. 5.5 risks, P < .05) and the proportion (27.8% vs 20.5%, P < 0.01) of risks compared to controls. The Gabby group averaged 63.7 minutes of interaction time. Seventy-eight percent reported that it "was easy to talk to Gabby" and 64% used information from Gabby to improve their health. CONCLUSION: Gabby was significantly associated with preconception risk reduction. More research is needed to determine if Gabby can benefit higher risk populations and if risk reduction is clinically significant.
AI snapshot
Written from the paper’s full text.
TL;DR
In a 6-month randomized controlled trial of 100 non-gravid African American women, mostly college-attending, the Gabby conversational agent was associated with greater reduction in preconception health risks than a control letter. The authors conclude Gabby holds promise but larger, more socio-demographically diverse trials are needed.
Key findings
- Among 77 women with baseline and 6-month outcome data, the Gabby group resolved 27.8% (297/1,067) of reported risks versus 20.5% (224/1,091) in controls (p<0.01); average risks resolved were 8.3 vs 5.5 (p<0.01). The abstract reports the number of PCH risks as 34% higher (8.3 vs 5.5, p<.05) and proportion resolved as 25% higher (27.8% vs 20.5%, p<0.01).
- At baseline, all participants had at least one PCH risk; mean (SD) was 23.7 (5.9), range 11–45. The most common content areas triggered were “Nutrition and Activity” (27.5%), “Infectious Disease” (16.4%), “Environmental Issues” (10.2%), and “Immunizations and Vaccines” (8.8%).
- Gabby usage: 42 women interacted at least once; 144 interactions totaling 2,676 minutes; average session 18.6 (SD 12.1) minutes; average interaction time 63.7 (SD 70.4, range 2.8–286) minutes per woman; average 2.9 logins. 78% reported it “was easy to talk to Gabby,” 64% used information from Gabby to improve their health, 59% trusted her, 56% said Gabby did a good job answering questions, and 22% planned to use the information in the future.
- Risks most often resolved in the Gabby group included “Bad diet or food choices” (18), “Not using multivitamin with folic acid or folic acid supplement” (16), “At risk for sexually transmitted infection” (15), “Not taking iron supplement” (13), “Use of caffeine” (12), and “At risk for tuberculosis” (12); these six accounted for 29% of risks resolved. Some clinically important risks infrequently or never resolved: “Any current tobacco use” (0/6), “Currently taking any over-the-counter medicines” (1/13), and “No birth control” (3/20).
Methods
- A 6-month RCT (March 2013–February 2014) used a purposeful, convenience sample of 100 self-identified African American/black women, 18–34 years, English-speaking, not pregnant, with telephone and computer internet access. Recruitment sources were the HHS Office of Minority Health’s national Preconception Peer Educator program (n=86), a Healthy Start site in Florida (n=8), a Health Expo in Boston (n=4), and word of mouth (n=2).
- All participants were screened for 107 distinct PCH risk factors across 12 content areas and randomized via sequentially numbered, opaque, sealed envelopes to Gabby or control. Gabby participants received bi-weekly reminder emails and interactions consisting of a greeting, review of identified risks, discussion of selected risks, and review/update of “My Health To-Do List.” Controls received a mailed letter listing their PCH risks with the suggestion to discuss them with a health care provider.
- Baseline measures included demographics, General Self Efficacy Scale, Multidimensional Scale of Perceived Social Support, Everyday Discrimination Scale, and the 66-word Rapid Estimate of Adult Literacy in Health. Six-month outcomes were collected by online survey plus telephone call to determine whether each baseline risk was still active or resolved. Analyses used two-sided t-tests, chi-square/Fisher’s exact tests, Z-tests for proportions, and crude Poisson regressions.
Limitations
- Stated: follow-up was relatively short and behavior change takes time; data were self-reported, with possible misunderstanding, wrong response selection, or intentional misinformation; social desirability bias, recall bias, and self-selection bias were possible; the control group also received a personalized risk letter, which may have led to underestimation of Gabby’s impact; Gabby was desktop/laptop-only, and uptake may have been limited by preference for telephone or tablet; average 2.9 logins over 6 months fell short of the ideal goal of one session per week.
- Stated: the sample was mostly college-educated, computer literate, and reported high self-efficacy, high social support, and low perceived racial discrimination; authors call for a larger, more socio-demographically diverse group and note that whether reducing the number of risks is clinically significant remains unknown.
- Evident from the text: the small sample (100 enrolled; 80 completed the 6-month follow-up phone call; 77 had both baseline and outcome data; 42 interacted with Gabby at least once) limits precision and generalizability, and the study measured risk resolution rather than clinical outcomes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 17 cited sources checked · 0 supported · 0 flagged
- Findingown data
At six months, Gabby-group women resolved an average of 8.3 risks (from an average of 23.2 identified), compared with 5.5 (of 24.2) in the control group (p<0.01).
“At six months, women in the Gabby group resolved 8.3 risks on average (from 23.2 identified on average), compared to 5.5 (of 24.2) in the control group, (p<0.01).”
Quote in the paperSubstantial claim - Findingown data
The nutrition and physical activity content area had the most risks triggered, discussed, and resolved.
“The nutrition and physical activity content area contained the most risks triggered, discussed, and resolved.”
Quote in the paperNot a substantial claim - Findingown data
Among the 77 women with both baseline and six-month outcome data, 27.8% (297/1,067) of reported risks were resolved in the Gabby group versus 20.5% (224/1,091) in the control group (p<0.01).
“Among the 77 women for whom both baseline data and six month outcome data were available, 27.8% (297/1,067) of the reported risks were resolved in the Gabby group, compared to 20.5% (224/1,091) in the control group (Table 2, p<0.01).”
Quote in the paperSubstantial claim - Interpretationcitation
Our trust findings align with other studies showing that patients prefer sharing sensitive information with computerized agents perceived as less judgmental and having more time than traditional providers.
“Our findings regarding participants’ trust in Gabby are consistent with other studies that indicate patients prefer sharing sensitive information with computerized agents who they perceive to be less judgmental and have more time than traditional providers.26”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] Bickmore T Pfeifer L Jack BW Taking the Time to Care: Empowering Low Health Literacy Hospital Patients with Virtual Nurse Agents Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 2009 Boston, MA 2009
Not checked in the free run.
- Premisecitation
Studies using conversational agents have demonstrated significant clinical impacts on outcomes.
“Conversational agents have also been used in studies that have shown significant clinical impact on outcomes.11, 17, 18”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [11] King A Bickmore T Campero M Employing “virtual advisors” in preventive care for underserved communities: results from the COMPASS study J Health Commun 2013 18 12 1449 64 23941610 PMC7187757
Not checked in the free run.
- cites [17] Ellis T Latham N DeAngelis T Thomas C Saint-Hilaire M Bickmore T Feasibility of a virtual exercise coach to promote walking in community-dwelling persons with Parkinson Disease American Journal of Physical Medicine and Rehabilitation 2013 92 6 472 485 23552335 PMC4266140
Not checked in the free run.
- cites [18] Bickmore T Silliman R Nelson K Cheng D Winter M Henaulat L Paasche-Orlow M A randomized controlled trial of an automated exercise coach for older adults Journal of the American Geriatrics Society 2013 61 1676 1683 24001030
Not checked in the free run.
- Premisecitation
A 2006 U.S. Department of Education report found that 58% of African American adults had Below Basic or Basic health literacy, versus 28% of white adults.
“AA women may benefit from conversational agents due to disparities in health literacy levels as according to the 2006 report by the U.S. Department of Education, 58 percent of AA adults possess Below Basic or Basic health literacy, compared to 28 percent of white adults.13”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13] Kutner M Greenberg E Jin Y Paulsen C 2006 The Health Literacy of America’s Adults: Results From the 2003 National Assessment of Adult Literacy (NCES 2006–483) US Department of Education Washington, DC National Center for Education Statistics
Not checked in the free run.
- Premisecitation
Our earlier testing of Gabby showed that the system could potentially help African American women address preconception risks over two months.
“Our earlier testing of “Gabby” demonstrated that the system had potential to help AA women address preconception risks over a two month period.19”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] Gardiner P Hempstead M Ring L Bickmore T Yinusa-Nyahkoon L Tran H Paasche-Orlow M Damus K Jack B Reaching women through health information technology: the gabby preconception care system American Journal of Health Promotion 2013 27 3 Suppl eS11 20 23286652 PMC3779885
Not checked in the free run.
- Interpretationown data
This version of Gabby, with its personalized, relational, and comprehensive approach, is promising for improving access to the primary and preventive care assessments women need before pregnancy.
“This version of the Gabby system, with its personally-tailored, relational and comprehensive approach, holds great promise for improving access to the primary and preventive care assessments women need in order to prepare for pregnancy.”
Quote in the paperSubstantial claim - Study design and conductreasoning
A further limitation that may have underestimated Gabby's impact is that the control group also received an intervention: a personalized letter listing their risks and suggesting they discuss them with a provider.
“Another limitation that may have led to an underestimation of Gabby’s impact is that the control group also received an intervention with the personalized letter listing their identified risks and suggesting that they share this information with their health care provider.”
Quote in the paperNot a substantial claim
- May combine two claims. 29
- Classified as probably not a substantial claim. 19
May combine two claims.
Findingown dataEvery participant had at least one PCH risk; the mean number was 23.7 (SD 5.9), with a range of 11 to 45.
“all had at least one PCH risk with a mean (sd) of 23.7 (5.9), range of 11 to 45 PCH risks.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn the Gabby group, 78% found it easy to talk with Gabby, 59% trusted her, 56% said she answered questions well, almost two thirds had used Gabby information to improve their health, and 22% planned to do so.
“Most women in the Gabby group felt that it was easy to talk with Gabby (78%) and reported that they trusted her (59%). More than half (56%) stated that Gabby did a good job of answering their questions, almost two thirds reported that they had used information from Gabby to improve their health, and another 22% planned to do so in the future.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataGabby-group participants were more likely than controls (64% vs 51%, p=.21) to report at least one primary care appointment within 6 months, but the difference was not significant.
“They were also more likely than those in the control group (64% vs 51%, p=.21) to report at least one primary care appointment within 6 months, an important but non-significant finding potentially due to the relatively short follow-up period.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAbout two thirds of the baseline sample worked at least part-time and had at least some college education, and 41% were students.
“about two thirds were employed at least part-time and completed at least some college, and 41% were students.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataMost of the baseline sample reported high self-efficacy, high social support, and low perceived racial discrimination.
“the majority reported high self-efficacy, high social support, and low perceived racial discrimination.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe average number of risks triggered was 23.7 (SD 5.9): 23.2 in the Gabby group and 24.2 in the control group.
“The average number of risks triggered was 23.7 (S.D. 5.9), per participant, 23.2 (5.95) for the Gabby group and 24.2 (5.84) for the control group.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe 91 participants who completed the risk assessment triggered 2,158 risks in total: 1,067 in the Gabby group and 1,091 in the control group.
“A total of 2,158 risks were triggered by the 91 participants who completed the risk assessment, 1067 by the Gabby group, and 1091 by the control group.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe 99 women who provided baseline data had a mean age of 25.5 years.
“The average age was 25.5 years;”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataUsers averaged 2.9 logins over 6 months, which was below our ideal of one session per week.
“The average 2.9 logins per user over 6 months fell short of our ideal goal of one session per week and underscores the need to plan for the future of Gabby and how women will interact with her outside of the research setting.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe most frequently triggered content area was Nutrition and Activity (27.5%), followed by Infectious Disease (16.4%), Environmental Issues (10.2%), and Immunizations and Vaccines (8.8%).
“The most common content area triggered among all participants was “Nutrition and Activity,” (27.5%), followed by “Infectious Disease” (16.4%), “Environmental Issues” (10.2%), and “Immunizations and Vaccines” (8.8%).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataOf the total Gabby interaction time, 30% was spent on Nutrition and Activity and 10.3% on Reproductive Health.
“Thirty percent of the total time interacting with Gabby was spent discussing “Nutrition and Activity,” and 10.3% was spent discussing “Reproductive Health.””
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe average Gabby session lasted 18.6 (SD 12.1) minutes, and average interaction time per woman over the study was 63.7 (SD 70.4, range 2.8-286) minutes.
“The average session lasted 18.6 (S.D 12.1) minutes and the average interaction time with Gabby during the study was 63.7 (S.D 70.4, range 2.8–286) minutes per woman.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSome clinically important risks rarely or never resolved: current tobacco use (0 of 6 Gabby participants), taking over-the-counter medicines (1 of 13), and no birth control (3 of 20).
“On the other hand, there were clinically-important risks that infrequently or never resolved, such as: “Any current tobacco use” (0 Gabby group participants resolved it out of 6 identified at baseline); “Currently taking any over-the-counter medicines” (1 resolved out of 13); and “No birth control” (3 resolved out of 20).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMore than 90% of the baseline sample had used computers to access online health information.
“Over 90% had used computers to access online health information.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataOver the 6-month intervention, 42 women interacted with Gabby at least once, producing 144 interactions and 2,676 total minutes.
“During the 6-month intervention period, 42 women interacted with Gabby at least once. There were a total of 144 interactions totaling 2,676 minutes.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOver half of the baseline sample had home computer access, and all used a computer regularly or considered themselves expert.
“More than half had computer access at home and all used a computer regularly or considered themselves expert.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMore than 90% of the baseline sample read at a high school level or higher.
“Over 90% read at the high school level or better,”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationConversational agent systems can help overcome clinicians' time constraints and support delivery of recommended preventive care.
“and that these systems can overcome clinician time constraints15 and assist in delivering recommended preventive care.16”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [15] Yarnell KS Pollak KI Østbye T Krause KM Michener JL Primary care: is there enough time for prevention? American Journal of Public Health 2003 93 635 641 12660210 PMC1447803
Not checked in the free run.
- cites [16] Shires DA Stange KC Divine G Ratliff S Vashi R Tai-Seale M Lafata JE Prioritization of evidence-based preventive health services during periodic health examinations American Journal of Preventive Medicine 2012 42 164 173 22261213 PMC3262983
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
PremisecitationHealth information technology offers opportunities to create innovative tools that help clinicians deliver PCC and that engage and empower women to improve their PCH.
“Health information technology presents opportunities to develop innovative tools that assist clinicians in delivering PCC7, and to engage and empower women to improve their PCH.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [7] Henderson JT Weisman CS Grason H Are two doctors better than one? Women’s physician use and appropriate care Women’s Health Issues 2002 12 138 149 12015186
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataRandomization to the Gabby and control groups used sequentially numbered, opaque, sealed envelopes containing the group assignment.
“Participants were randomized into the Gabby and control groups using sequentially numbered, opaque, sealed envelopes containing the random group assignment.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataComplete baseline and six-month outcome data were available for 36 Gabby-group women and 41 control-group women, and response rates did not differ significantly between groups (p=0.34).
“Complete baseline and six-month outcome data were obtained from 36 women in the Gabby group and 41 in the control group (Figure 3). There was no significant difference in response rates between groups (p=0.34).”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe findings show that in a group of mostly college-educated, computer-literate African American women, Gabby can identify preconception risks and prompt actions that reduce the number of such risks.
“The study findings demonstrate that among a group of mostly college-educated, computer literate African American women, the Gabby system can identify preconception risks and initiate actions to reduce the number of preconception risks.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningCurrently Gabby is designed for desktop or laptop computers, and its uptake may have been limited because the target population prefers phones or tablets over traditional computers.
“In its current state, the Gabby system is designed for use on a desktop or laptop computer; uptake of the system may have been limited due to the preference of our target population to use a telephone or tablet instead of traditional computer.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe 2013 National Action Plan for Promoting PCH in the U.S. set goals to improve knowledge, attitudes, and behaviors about PCC, eliminate disparities in adverse maternal, fetal, and infant outcomes, and ensure all U.S. women of childbearing age receive PCC services.
“In 2013 the National Action Plan for Promoting PCH in the U.S. identified the goals of: improving the knowledge, attitudes and behaviors of men and women related to PCC; eliminating disparities in adverse maternal, fetal and infant outcomes; and assuring that all U.S. women of childbearing age receive PCC services.6”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [6] Floyd RL Kay A Johnson KA Owens JR Verbiest S Moore CA Boyle C A National action plan for promoting preconception health and health care in the United States (2012–2014) J Women’s Health 2013 2210 797 802 PMC4480361 23944970
Not checked in the free run.
Classified as probably not a substantial claim.
Interpretationnone givenAchieving the Healthy People 2020 goal of eliminating disparities requires that adverse health outcome rates decline faster among African American women.
“Progress towards the Healthy People 2020 goal to eliminate disparities requires that rates of adverse health outcomes fall more rapidly for AA women, which is why the Gabby system was designed for this group.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThe Gabby and control groups did not differ significantly in demographics, clinical characteristics, or information technology literacy and availability.
“There were no significant differences in the demographics, clinical characteristics, or information technology literacy and availability between groups.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationConversational agents are a logical way to deliver PCH information because they can reach many people while being highly acceptable through culturally appropriate content and information suitable for low health literacy.
“Conversational agents are a logical option to deliver PCH information as they can reach a large audience while providing high user acceptability through culturally-appropriate content and information appropriate to those with low health literacy.11, 12”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [11] King A Bickmore T Campero M Employing “virtual advisors” in preventive care for underserved communities: results from the COMPASS study J Health Commun 2013 18 12 1449 64 23941610 PMC7187757
Not checked in the free run.
- cites [12] Bickmore TW Pfeifer LM Byron D Usability of conversational agents by patients with inadequate health literacy: evidence from two clinical trials J Health Commun 2010 15 suppl 2 197 210 20845204
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe CDC Select Expert Preconception Panel's PCC Clinical Workgroup in 2008 listed content areas that should be identified and addressed to improve maternal and infant outcomes, and it made implementation strategies a top priority.
“In 2008, the CDC Select Expert Preconception Panel’s PCC Clinical Workgroup outlined those content areas important to identify and address to improve maternal and infant outcomes4 and identified implementation strategies as a top priority.5”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [4] Jack BW Atrash H Coonrod DV Moos MK O’Donnell J Johnson K The clinical content of preconception care: an overview and preparation of this supplement Am J Obstet Gynecol 2008 199 suppl S266 279 19081421
Not checked in the free run.
- cites [5] Atrash H Jack BW Johnson K Coonrod DV Moos M-K Stubblefield P Cefalo R Damus K Reddy U Where is the “W”oman in MCH? Am J Obstet Gynecol 2008 199 Suppl S259 265 19081420
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationOur earlier qualitative research supports giving women autonomy and using a shared decision-making approach that is more empowering.
“However, our previous qualitative work supports providing autonomy and supporting a shared decision making approach that is more empowering.20”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [20] Office of Minority Health 2013 9 24 Retrieved August 13, 2014, from http://minorityhealth.hhs.gov/omh/browse.aspx?lvl=3&lvlid=9
Not checked in the free run.
May combine two claims.
PremisecitationClinicians tend to be more verbally dominant and less patient-centered when interacting with African American patients.
“There is also evidence that clinicians are more verbally-dominant and less patient-centered with AA patients,14”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] Johnson RL Roter D Powe NR Cooper LA Patient race/ethnicity and patient-physician communication during medical visits Am J Public Health 2004 12 94 12 2084 2090 15569958 PMC1448596
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe data are self-reported, and participants could have misunderstood questions, selected wrong responses, or given intentional misinformation.
“In addition, data are self-reported and participants potentially could have misunderstood a question, accidentally selected the wrong response, or provided intentional misinformation.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationGabby could potentially address issues of message fidelity and cultural sensitivity, scale, ease of delivery, and clinician time constraints, and it can be used in various settings to address barriers to translating PCC best practices into clinical care.
“Gabby can potentially address problems regarding fidelity and cultural sensitivity of message, scale, ease of delivery, and clinician time constraints and can be used across a range of settings, addressing problems identified as barriers to translating PCC best practices to clinical care27.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Jack B Atrash A Bickmore T Johnson K The future of preconception care Women’s HealthIssues 2008 18 suppl S19 S25 19059546
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningPossible biases include social desirability when reporting risk status to staff, recall bias in baseline and follow-up data, and self-selection bias in study participation.
“There could also be social desirability bias when reporting risk status to staff, recall bias affecting baseline and follow-up data, and self-selection bias for study participation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenA study limitation is that the follow-up period was relatively short, and behavior change takes time.
“A limitation of this research is that the follow-up period was relatively short and behavior change takes time.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
About half of pregnancies are unplanned.
“In addition, about half of pregnancies are unplanned, making it important to promote preconception health (PCH) and deliver preconception care (PCC) to all women of reproductive age, regardless of pregnancy intention.1”
The paper relies on this without support.
Enhancing a woman's health before pregnancy improves perinatal outcomes for women and infants.
“Despite mounting scientific evidence that enhancing a woman’s health before pregnancy improves perinatal outcomes for women and their infants, many women enter pregnancy in poor health and at risk for preventable adverse pregnancy outcomes.”
The paper relies on this without support.
Additional tools are needed for providers and the public to screen for and address preconception health risks.
“Additional tools are needed for providers and the public to screen for and address preconception health (PCH) risks, particularly for African American (AA) women given the national persistent health outcome and healthcare disparities.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Other studies have yielded positive outcomes for ECAs to deliver health education on topics such as exercise, eating fruits and vegetables, and preconception care.
“Other studies have also yielded positive outcomes for ECAs to deliver health education on topics such as: exercise, eating fruits and vegetables, and preconception care [12, 16, 21–24].”
From Engaging women with an embodied conversational agent to deliver mindfulness and lifestyle recommendations: A feasibility randomized control trial (2017) · cites this paper as [24]
Based on previous studies, it is feasible for young African American women ages 18 to 34 years to benefit from an ECA delivering health information on dietary supplements and stress management as part of a larger preconception patient education ECA system.
“Based on our previous studies, we have shown it is feasible for young African American women ages 18 to 34 years to benefit from an ECA delivering health information on dietary supplements and stress management as part of a larger preconception patient education ECA system [16, 24].”
From Engaging women with an embodied conversational agent to deliver mindfulness and lifestyle recommendations: A feasibility randomized control trial (2017) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Risk-resolution denominators include participants outside the stated follow-up group
MajorThe resolution comparison is described as being among 77 women with baseline and outcome data, but its denominators of 1,067 and 1,091 are identified elsewhere as all risks triggered by the groups among 91 women who completed the baseline risk assessment.
“Among the 77 women for whom both baseline data and six month outcome data were available, 27.8% (297/1,067) of the reported risks were resolved in the Gabby group, compared to 20.5% (224/1,091) in the control group”
“A total of 2,158 risks were triggered by the 91 participants who completed the risk assessment, 1067 by the Gabby group, and 1091 by the control group.”
Cites
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807 · see citing works
The Patient Health Questionnaire-2: Validity of a Two-Item Depression Screener
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000093487.78664.3c · Cited by 6,359 · see citing works
Primary Care: Is There Enough Time for Prevention?
Yarnall, K. S. H., Pollak, K. I., Østbye, T., Krause, K. M., & Michener, J. L. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.4.635 · Cited by 1,641 · see citing works
Kutner, M. A., Greenburg, E., Jin, Y., & Paulsen, C. A. (2006) · National Center for Education Statistics · Cited by 1,545 · see citing works
Measures in Health Psychology: A User's Portfolio
Johnston, M., Wright, S., & Weinman, J. A. (1995) · Cited by 1,300 · see citing works
Tailored and Targeted Health Communication: Strategies for Enhancing Information Relevance
Kreuter, M. W., & Wray, R. J. (2003) · American Journal of Health Behavior · doi:10.5993/ajhb.27.1.s3.6 · Cited by 1,095 · see citing works
Health Literacy of America's Adults: Results from the 2003 National Assessment of Adult Literacy
White, S., Bennett, I. M., Cordell, T., & Baxter, S. L. (2007) · PsycEXTRA Dataset · doi:10.1037/e530912012-001 · Cited by 1,060 · see citing works
Patient Race/Ethnicity and Quality of Patient–Physician Communication During Medical Visits
Johnson, R. L., Roter, D., Powe, N. R., & Cooper, L. A. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.12.2084 · Cited by 955 · see citing works
Johnson, K., Posner, S. F., Biermann, J., Cordero, J. F., Atrash, H. K., Parker, C. S., Boulet, S. L., & Curtis, M. (2006) · PsycEXTRA Dataset · doi:10.1037/e506902006-001 · Cited by 835 · see citing works
Rapid assessment of literacy levels of adult primary care patients.
Tc, D., Crouch, M. A., Sw, L., Rh, J., Bates, P. T., Rb, G., & Bairnsfather, L. E. (1991) · PubMed · Cited by 580 · see citing works
Pearson, M. L., Bridges, C. B., & Harper, S. A. (2006) · PsycEXTRA Dataset · doi:10.1037/e506932006-001 · Cited by 529 · see citing works
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494 · see citing works
Self-citationPsychometric properties of the Multidimensional Scale of Perceived Social Support in youth
Bruwer, B. R., Emsley, R. A., Kidd, M., Löchner, C., & Seedat, S. (2007) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2007.09.002 · Cited by 357 · see citing works
A randomized controlled trial of an automated exercise coach for older adults
Bickmore, T. W., Silliman, R. A., Nelson, K., Cheng, D. M., Winter, M., Henault, L., & Paasche‐Orlow, M. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12449 · Cited by 305 · see citing works
Self-citationTaking the time to care: empowering low health literacy hospital patients with virtual nurse agents
Bickmore, T. W., Pfeifer, L. M., & Jack, B. W. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518891 · Cited by 289 · see citing works
Self-citationThe Office of Minority Health <http://www.minorityhealth.hhs.gov>
Sawyer, T. (2013) · Journal of Consumer Health on the Internet · doi:10.1080/15398285.2013.756350 · Cited by 258 · see citing works
Bickmore, T. W., Pfeifer, L. M., Byron, D., Forsythe, S., Henault, L. E., Jack, B. W., Silliman, R., & Paasche-Orlow, M. K. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499991 · Cited by 249 · see citing works
Self-citationHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242 · see citing works
Self-citationMaintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213 · see citing works
Self-citationThe clinical content of preconception care: an overview and preparation of this supplement
Jack, B. W., Atrash, H., Coonrod, D. V., Moos, M.-K., O'Donnell, J., & Johnson, K. (2008) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2008.07.067 · Cited by 205 · see citing works
Self-citationLewis, T. T., Yang, F. M., Jacobs, E. A., & Fitchett, G. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kwr287 · Cited by 203 · see citing works
King, A. C., Bickmore, T. W., Campero, M. I., Pruitt, L. A., & Yin, J. L. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.798374 · Cited by 114 · see citing works
Are two doctors better than one? Women’s physician use and appropriate care
Henderson, J. T., Weisman, C. S., & Grason, H. (2002) · Women's Health Issues · doi:10.1016/s1049-3867(02)00134-2 · Cited by 93 · see citing works
Ellis, T., Latham, N. K., DeAngelis, T. R., Thomas, C. A., Saint-Hilaire, M., & Bickmore, T. W. (2013) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e31828cd466 · Cited by 91 · see citing works
Self-citationReaching Women through Health Information Technology: The Gabby Preconception Care System
Gardiner, P., Hempstead, M. B., Ring, L., Bickmore, T., Yinusa-Nyahkoon, L., Tran, H., Paasche-Orlow, M., Damus, K., & Jack, B. (2013) · American Journal of Health Promotion · doi:10.4278/ajhp.1200113-quan-18 · Cited by 88 · see citing works
Self-citationPreconception care. Risk reduction and health promotion in preparation for pregnancy
Jack, B. W. (1990) · JAMA · doi:10.1001/jama.264.9.1147 · Cited by 74 · see citing works
Self-citationPrioritization of Evidence-Based Preventive Health Services During Periodic Health Examinations
Shires, D. A., Stange, K. C., Divine, G., Ratliff, S. M., Patel, R. V., Tai‐Seale, M., & Lafata, J. E. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.10.008 · Cited by 61 · see citing works
Preconception care: a 2008 update
Atrash, H., Jack, B. W., & Johnson, K. (2008) · Current Opinion in Obstetrics & Gynecology · doi:10.1097/gco.0b013e328317a27c · Cited by 58 · see citing works
Self-citationAtrash, H., Jack, B. W., Johnson, K., Coonrod, D. V., Moos, M.-K., Stubblefield, P. G., Cefalo, R., Damus, K., & Reddy, U. M. (2008) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2008.08.059 · Cited by 56 · see citing works
Self-citationFloyd, R. L., Johnson, K., Owens, J. R., Verbiest, S., Moore, C. A., & Boyle, C. A. (2013) · Journal of Women s Health · doi:10.1089/jwh.2013.4505 · Cited by 54 · see citing works
The future of preconception care
Jack, B. W., Atrash, H., Bickmore, T., & Johnson, K. (2008) · Women's Health Issues · doi:10.1016/j.whi.2008.09.004 · Cited by 25 · see citing works
Self-citation
Flagged first, then by citations
1 of the 32 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Impactful Digital Twin in the Healthcare Revolution
Hassani, H., Huang, X., & MacFeely, S. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6030083 · Cited by 200 · see citing works
Kruse, C. S., & Beane, A. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8793 · Cited by 188 · see citing works
Gardiner, P. M., McCue, K. D., Negash, L. M., Cheng, T., White, L. F., Yinusa-Nyahkoon, L., Jack, B. W., & Bickmore, T. W. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.04.015 · Cited by 139 · see citing works
Self-citationKhan, S. S., Brewer, L. C., Canobbio, M. M., Cipolla, M. J., Grobman, W. A., Lewey, J., Michos, E. D., Miller, E. C., Perak, A. M., Wei, G. S., et al. (2023) · Circulation · doi:10.1161/cir.0000000000001124 · Cited by 156 · see citing works
Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review
Kramer, L. L., ter Stal, S., Mulder, B. C., de Vet, E., & van Velsen, L. (2020) · Journal of Medical Internet Research · doi:10.2196/14058 · Cited by 121 · see citing works
“Study designs varied from a randomized controlled trial (RCT) [3,4,17,19-23,25-30,32,33] to a pretest-posttest design, either with [31] or without control a control group [5,18,30].”
BackgroundMethodInfluentialThe Development and Use of Chatbots in Public Health: Scoping Review
Wilson, L., & Mărăşoiu, M. (2022) · JMIR Human Factors · doi:10.2196/35882 · Cited by 135 · see citing works
Health-focused conversational agents in person-centered care: a review of apps
Parmar, P., Ryu, J., Pandya, S., Sedoc, J., & Agarwal, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00560-6 · Cited by 113 · see citing works
Preconception health behaviours: A scoping review
Toivonen, K., Oinonen, K. A., & Duchene, K. M. (2016) · Preventive Medicine · doi:10.1016/j.ypmed.2016.11.022 · Cited by 108 · see citing works
Preconception health care interventions: A scoping review.
Hemsing, N., Greaves, L., & Poole, N. (2017) · Sexual & Reproductive HealthCare · doi:10.1016/j.srhc.2017.08.004 · Cited by 104 · see citing works
Harrington, C. N., Garg, R., Woodward, A., & Williams, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501995 · Cited by 98 · see citing works
“risk in young and educated Black women [48].”
BackgroundSecurity, privacy, and healthcare-related conversational agents: a scoping review
May, R., & Denecke, K. (2021) · Informatics for Health and Social Care · doi:10.1080/17538157.2021.1983578 · Cited by 91 · see citing works
Hall, J., Chawla, M., Watson, D., Jacob, C. M., Schoenaker, D. A. J. M., Connolly, A., Barrett, G., & Stephenson, J. (2023) · The Lancet Public Health · doi:10.1016/s2468-2667(22)00254-7 · Cited by 76 · see citing works
Maeda, E., Miyata, A., Boivin, J., Nomura, K., Kumazawa, Y., Shirasawa, H., Saito, H., & Terada, Y. (2020) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2020.09.006 · Cited by 76 · see citing works
Jack, B. W., Bickmore, T., Yinusa-Nyahkoon, L. S., Reichert, M., Julce, C., Sidduri, N., Martin-Howard, J., Zhang, Z., Woodhams, E. J., Fernandez, J., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30189-8 · Cited by 66 · see citing works
Self-citationLi, Y., Liang, S., Zhu, B., Liu, X., Li, J., Chen, D., Qin, J., & Bressington, D. T. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104494 · Cited by 74 · see citing works
Hill, B., Skouteris, H., Teede, H. J., Bailey, C., Baxter, J.-A. B., Bergmeier, H. J., Borges, A. L. V., Harrison, C. L., Jack, B., Jorgensen, L., et al. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8122119 · Cited by 65 · see citing works
Self-citationChatbots to Improve Sexual and Reproductive Health: Realist Synthesis
Mills, R., Mangone, E., Lesh, N. B., Mohan, D., & Baraitser, P. (2023) · Journal of Medical Internet Research · doi:10.2196/46761 · Cited by 71 · see citing works
Embodied Conversational Agents for Chronic Diseases: Scoping Review
Jiang, Z., Huang, X., Wang, Z., Liu, Y., Huang, L., & Luo, X. (2023) · Journal of Medical Internet Research · doi:10.2196/47134 · Cited by 51 · see citing works
Lang, A. Y., Harrison, C. L., Barrett, G., Hall, J., Moran, L., & Boyle, J. A. (2020) · Women and Birth · doi:10.1016/j.wombi.2020.02.022 · Cited by 51 · see citing works
What Do We Know About the Use of Chatbots for Public Health?
Gabarrón, E., Larbi, D., Denecke, K., & Årsand, E. (2020) · Studies in health technology and informatics · doi:10.3233/shti200270 · Cited by 49 · see citing works
Martinengo, L., Jabir, A. I., Goh, W. W. T., Lo, N. Y. W., Ho, M. R., Kowatsch, T., Atun, R. A., Michie, S., & Car, L. T. (2022) · Journal of Medical Internet Research · doi:10.2196/39243 · Cited by 48 · see citing works
Community-Based Cultural Tailoring of Virtual Agents
O’Leary, T. K., Stowell, E., Kimani, E., Parmar, D., Ólafsson, S., Hoffman, J. A., Parker, A. G., Paasche‐Orlow, M. K., & Bickmore, T. (2020) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3383652.3423875 · Cited by 44 · see citing works
Self-citationAddressing Obesity in Preconception, Pregnancy, and Postpartum: A Review of the Literature
Lim, S. S., Harrison, C. L., Callander, E. J., Walker, R., Teede, H. J., & Moran, L. (2022) · Current Obesity Reports · doi:10.1007/s13679-022-00485-x · Cited by 42 · see citing works
Mercado, J., Espinosa‐Curiel, I. E., & Martı́nez-Miranda, J. (2023) · Journal of Medical Internet Research · doi:10.2196/52097 · Cited by 41 · see citing works
University students’ fertility awareness and its influencing factors: a systematic review
Ren, Y., Xie, Y., Xu, Q., Long, M., Zheng, Y., Li, L., & Niu, C. (2023) · Reproductive Health · doi:10.1186/s12978-023-01628-6 · Cited by 38 · see citing works
Chua, J. Y. X., Choolani, M. A., Chee, C. Y. I., Chan, Y. H., Lalor, J., Chong, Y. S., & Shorey, S. (2023) · Journal of Midwifery & Women s Health · doi:10.1111/jmwh.13472 · Cited by 33 · see citing works
Kramer, L. L., van Velsen, L., Clark, J. L., Mulder, B. C., & de Vet, E. (2022) · JMIR Formative Research · doi:10.2196/33974 · Cited by 31 · see citing works
The effect of a preconception care outreach strategy: the Healthy Pregnancy 4 All study
Sijpkens, M. K., van Voorst, S. F., de Jong-Potjer, L. C., Denktaş, S., Verhoeff, A. P., Bertens, L. C. M., Rosman, A. N., & Steegers, E. A. P. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-3882-y · Cited by 32 · see citing works
Salamanca-Sanabria, A., Jabir, A. I., Lin, X., Alattas, A., Kocaballi, A. B., Lee, J., Kowatsch, T., & Car, L. T. (2023) · Journal of Medical Internet Research · doi:10.2196/44542 · Cited by 32 · see citing works
Health-Related Applications of Socially Interactive Agents
Bickmore, T. (2022) · ACM eBooks · doi:10.1145/3563659.3563672 · Cited by 30 · see citing works
Self-citationGardiner, P. M., Bickmore, T., Yinusa-Nyahkoon, L. S., Reichert, M., Julce, C., Sidduri, N., Martin-Howard, J., Woodhams, E. J., Aryan, J., Zhang, Z., et al. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2020.571705 · Cited by 30 · see citing works
Self-citationHai, A. H., Hammock, K., & Velasquez, M. M. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14203 · Cited by 24 · see citing works
Preconception, Interconception, and reproductive health screening tools: A systematic review
Ren, M., Shireman, H., VanGompel, E. W., Bello, J. K., Carlock, F., McHugh, A., & Stulberg, D. B. (2022) · Health Services Research · doi:10.1111/1475-6773.14123 · Cited by 24 · see citing works
Ingemann, C., & Larsen, C. V. L. (2018) · Nordic Council of Ministers eBooks · doi:10.6027/anp2018-720 · Cited by 33 · see citing works
Design recommendations for chatbots to support people with depression
de Souza, P. M., Pires, I. D. C., Motti, V. G., Caseli, H. D. M., Neto, J. B. B., Martini, L. C., & Néris, V. P. D. A. (2022) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3554364.3559119 · Cited by 19 · see citing works
Strategies for Patient, Family, and Caregiver Engagement
Bennett, W. L., Pitts, S. I., Aboumatar, H. J., Sharma, R., Smith, B. M., Das, A., Day, J., Holzhauer, K., & Bass, E. B. (2020) · doi:10.23970/ahrqepctb36 · Cited by 19 · see citing works
Preconception women’s views of promoting preconception women’s health in Australia
Walker, R., Drakeley, S. C., & Boyle, J. A. (2020) · Health Promotion Journal of Australia · doi:10.1002/hpja.402 · Cited by 18 · see citing works
Skouteris, H., Teede, H. J., Thangaratinam, S., Bailey, C., Baxter, J. B., Bergmeier, H. J., Harrison, C. L., Hill, B., Jack, B. W., Jorgensen, L., et al. (2019) · Frontiers in Endocrinology · doi:10.3389/fendo.2019.00163 · Cited by 18 · see citing works
Self-citationBridging the Health Disparity of African Americans Through Conversational Agents
Kim, J., Park, S. Y., & Robert, L. (2020) · Digital Government Research and Practice · doi:10.1145/3428122 · Cited by 17 · see citing works
Interactive Conversational Agents for Perinatal Health: A Mixed Methods Systematic Review
Amil, S., Da, S. M. A. R., Plaisimond, J., Roch, G., Sasseville, M., Bergeron, F., & Gagnon, M. (2025) · Healthcare · doi:10.3390/healthcare13040363 · Cited by 22 · see citing works
Nkabane-Nkholongo, E. L., Mokgatle, M. M., Bickmore, T., Julce, C., & Jack, B. W. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1224429 · Cited by 19 · see citing works
Self-citationChen, P., Li, Y., Zhang, X., Feng, X. L., & Sun, X. (2024) · BMC Public Health · doi:10.1186/s12889-024-19667-4 · Cited by 15 · see citing works
Fleur, M. S., Damus, K. H., & Jack, B. W. (2016) · Upsala Journal of Medical Sciences · doi:10.1080/03009734.2016.1206152 · Cited by 13 · see citing works
Self-citationMontanaro, C., Lacey, L., Robson, L., Estill, A., & Vuković, S. (2019) · Maternal and Child Health Journal · doi:10.1007/s10995-019-02806-4 · Cited by 13 · see citing works
Long-Term Interaction with Relational SIAs
Kory-Westlund, J. M., Park, H. W., Grover, I., & Breazeal, C. (2022) · ACM eBooks · doi:10.1145/3563659.3563667 · Cited by 12 · see citing works
Behavior changes to promote preconception health: a systematic review
Suto, M., Inaoka, K., Suzuki, D., Nitamizu, A., Arata, N., & Ota, E. (2025) · BMC Women s Health · doi:10.1186/s12905-024-03544-8 · Cited by 11 · see citing works
Walker, R., Drakeley, S. C., Julce, C., Sidduri, N., Bickmore, T., Skouteris, H., Jack, B. W., & Boyle, J. A. (2020) · Journal of Developmental Origins of Health and Disease · doi:10.1017/s2040174420000264 · Cited by 10 · see citing works
Self-citationMontenegro, J. L. Z., & da Costa, C. A. (2022) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-022-00115-0 · Cited by 9 · see citing works
Brammall, B. R., Garad, R. M., Teede, H. J., & Harrison, C. L. (2024) · Nutrients · doi:10.3390/nu16010155 · Cited by 8 · see citing works
Kotov, A., Carcone, A. I., & Towner, E. (2024) · JMIR Research Protocols · doi:10.2196/60361 · Cited by 10 · see citing works
Kramer, J., Yinusa-Nyahkoon, L. S., Ólafsson, S., Penti, B., Woodhams, E. J., Bickmore, T., & Jack, B. W. (2021) · Qualitative Health Research · doi:10.1177/10497323211013323 · Cited by 7 · see citing works
Self-citationNkabane-Nkholongo, E. L., Mokgatle, M. M., Jack, B. W., Julce, C., & Bickmore, T. (2023) · JMIR Human Factors · doi:10.2196/52048 · Cited by 7 · see citing works
Self-citationForging Alliances in Interdisciplinary Rehabilitation Research (FAIRR)
Gill, S. V., Khetani, M. A., Yinusa-Nyahkoon, L. S., McManus, B. M., Gardiner, P. M., & Tickle‐Degnen, L. (2017) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000000654 · Cited by 7 · see citing works
Self-citationLiu, S., Augustin, G., Ning, N., & Ota, E. (2025) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2025.105134 · Cited by 9 · see citing works
Walter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., Martin-Howard, J., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05726-0 · Cited by 6 · see citing works
Self-citationMontanaro, C., Robson, L., Binnington, L., Winters, N., & Brown, H. K. (2022) · Canadian Journal of Nursing Research · doi:10.1177/08445621221112668 · Cited by 6 · see citing works
User interactivity in eHealth applications: A novel taxonomy
Hashim, M. J. (2016) · International Conference on Innovations in Information Technology · doi:10.1109/innovations.2016.7880023 · Cited by 6 · see citing works
Hazhir, S., Langarizadeh, M., Bahariniya, S., Laktarashi, H. V., Hami, A., & Aghda, S. A. F. (2025) · BMC Public Health · doi:10.1186/s12889-025-25814-2 · Cited by 5 · see citing works
Villegas, V. C., Bosak, D. L., Salgado, Z., Phoenix, M. P., Parde, N., Teplicky, R., Khetani, M. A., Kuznicki, L., Pedrow, A., & Howell, A. W. (2023) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-023-00627-2 · Cited by 5 · see citing works
Health Counseling by Robots: Modalities for Breastfeeding Promotion
Murali, P., O’Leary, T. K., Shamekhi, A., & Bickmore, T. (2019) · IEEE RO-MAN · doi:10.1109/ro-man46459.2019.8956342 · Cited by 5 · see citing works
Self-citationChinkam, S., Steer‐Massaro, C., Herbey, I. I., Zhe, Z., Bickmore, T., & Shorten, A. (2021) · The Journal of Perinatal Education · doi:10.1891/j-pe-d-20-00027 · Cited by 5 · see citing works
Self-citationThe use of artificial intelligence in sexual and reproductive health: a comprehensive scoping review
Mengistu, S., Tamrat, T., Betrán, A. P., Pirsch, S., Ferretti, A., Mburu, G., Alemu, M. B., Malpani, R., Barreix, M., Massonneau, C., et al. (2025) · npj Women s Health · doi:10.1038/s44294-025-00118-3 · Cited by 15 · see citing works
Cancer Genetic Counseling by Humanoid Robot
Zhou, S., Murali, P., Underhill-Blazey, M. L., & Bickmore, T. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3371382.3378303 · Cited by 4 · see citing works
Self-citationProfessional representation of conversational agents for health care: a scoping review protocol
MacNeill, A. L., MacNeill, L., Doucet, S., & Luke, A. (2021) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00589 · Cited by 4 · see citing works
Development and Validation of Conversational Agent to Pregnancy Safe-education
Montenegro, J. L. Z., da Costa, C. A., Righi, R. D. R., Farias, E. R., & Matté, L. B. (2023) · Journal of Medical Systems · doi:10.1007/s10916-022-01903-2 · Cited by 4 · see citing works
Backonja, U., Robledo, C. A., Wallace, M. E., Flores, K. F., & Kiely, M. (2016) · Women s Health Issues · doi:10.1016/j.whi.2016.03.005 · Cited by 4 · see citing works
The professional representation of conversational agents for health care: A scoping review protocolPreprint
MacNeill, A. L., MacNeill, L., Luke, A., & Doucet, S. A. (2021) · doi:10.17605/osf.io/d8v2q · Cited by 4 · see citing works
Nkabane-Nkholongo, E. L., Mokgatle, M. M., Bickmore, T., Julce, C., Thompson, D. M., & Jack, B. W. (2024) · BMC Global and Public Health · doi:10.1186/s44263-024-00091-0 · Cited by 3 · see citing works
Self-citationA scoping review on health behavior changes in women toward preconception care
Suzuki, H., Shoki, R., Arata, N., & Ota, E. (2022) · Journal of Japan Academy of Midwifery · doi:10.3418/jjam.jjam-2021-0041 · Cited by 3 · see citing works
McNeill, I. M., Borland, R., & Abraham, C. (2025) · Journal of Medical Internet Research · doi:10.2196/68112 · Cited by 2 · see citing works
Uma revisão integrativa sobre o uso de chatbot para subsidiar o ensino na área da saúde
Cursino, J. R. V., Filho, A. S. D. C., Calista, A. A., & Nascimento, J. E. D. M. (2020) · Revista de Saúde Digital e Tecnologias Educacionais · doi:10.36517/resdite.v5.n1.2020.a8 · Cited by 3 · see citing works
Yang, Y., Tavares, J., & Oliveira, T. (2026) · International Journal of Telemedicine and Applications · doi:10.1155/ijta/9055091 · Cited by 2 · see citing works
Evolving Applications of Conversational Agents in Healthcare: A Literature Review
Carchiolo, V., & Malgeri, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78090-5_12 · Cited by 2 · see citing works
Delbaere, I., & Stern, J. (2020) · Springer eBooks · doi:10.1007/978-3-030-31753-9_5 · Cited by 2 · see citing works
Recognition Method of Sports Training Based on Intelligent Information Platform
Bu, J., Yao, D., & Wang, C. (2023) · International Journal of e-Collaboration · doi:10.4018/ijec.316872 · Cited by 1 · see citing works
Chingara, O., Sümegi, A., Logan, S. J. S., Bhattacharya, S., & Woolner, A. (2026) · Human Reproduction Update · doi:10.1093/humupd/dmag005 · Cited by 2 · see citing works
Assistente Virtual na Educação em Saúde dos Homens
Filho, A. S. D. C., Cursino, J. R. V., Júnior, T. D. P. B., & Lima, É. C. M. P. (2023) · Journal of Health Informatics · doi:10.59681/2175-4411.v15.iespecial.2023.1087 · Cited by 1 · see citing works
Kim, S. H., Jung, S. Y., Park, J., & Gagne, J. C. D. (2025) · Journal of Medical Internet Research · doi:10.2196/60690 · Cited by 1 · see citing works
Timely and/or Controversial Information for Family Physicians
Bowman, M. A., Neale, A. V., & Seehusen, D. A. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.04.150147 · Cited by 1 · see citing works
Penti, B. (2016) · OpenBU (Boston University)
Self-citationPreconception health and care : perspectives from the reproductive-aged population in Flanders
Goossens, J. (2018) · Ghent University Academic Bibliography (Ghent University)
Preconception health and wellbeing interventions in the workplace: A systematic reviewPreprint
Bailey, C., Walker, R., Hill, B., Hills, A. P., Venn, A., & Skouteris, H. (2019) · doi:10.21203/rs.2.12690/v1
Li, Y., Zhu, B., Liu, X., Li, J., Chen, D., Liang, S., & Bressington, D. T. (2022) · doi:10.2196/preprints.36116
Martinengo, L., Jabir, A. I., Goh, W. W. T., Lo, N. Y. W., Ho, M. R., Kowatsch, T., Atun, R. A., Michie, S., & Car, L. T. (2022) · doi:10.2196/preprints.39243
Puspitaningrum, D., Mustika, D. N., Setyawati, D., Latifah, H., & Rahmayani, A. A. (2023) · Advances in health sciences research/Advances in Health Sciences Research · doi:10.2991/978-94-6463-132-6_5
Penny, S. C. (2023) · American Public Health Association eBooks · doi:10.2105/9780875533414ch03
Walter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986308
Self-citationWalter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986320
Self-citationWalter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986314
Self-citationWalter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986311
Self-citationWalter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986323
Self-citationWalter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986317
Self-citationRen, Y., Xie, Y., Xu, Q., Long, M., Zheng, Y., Li, L., & Niu, C. (2023) · Figshare · doi:10.6084/m9.figshare.23304836
Villegas, V. C., Bosak, D. L., Salgado, Z., Phoenix, M., Parde, N., Teplicky, R., & Khetani, M. A. (2024) · Figshare · doi:10.6084/m9.figshare.26613293
Walter, A. W., Julce, C., Sidduri, N., Yinusa-Nyahkoon, L. S., HOWARD, J. M., Reichert, M., Bickmore, T., & Jack, B. W. (2020) · Figshare · doi:10.6084/m9.figshare.12986305
Self-citationGao, Y., & Broadbent, E. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-33151-0.00001-0
Markanti, R., Wu, D., & Fede, A. L. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00153
- Authors
- Jack, B., Bickmore, T., Hempstead, M., Yinusa-Nyahkoon, L., Sadikova, E., Mitchell, S., Gardiner, P., Adigun, F., Penti, B., Schulman, D., & Damus, K.
- Affiliations
- Boston University (US)
- ORCID
- Venue
- The Journal of the American Board of Family Medicine
- Published
- 2015-07-01
- Volume
- 28
- Issue
- 4
- Pages
- 441-451
- ISSN
- 1557-2625 (ISSN-L)
- 1558-7118
- PMC
- PMC4739811
- OpenAlex
- W2117614818
- Semantic Scholar
- 7b2e72f1029dbf890abb59060a95fa71f77d9bc2
- Cited by
- 99
- References
- 32
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 6 · 2023: 18 · 2022: 16 · 2021: 7 · 2020: 20 · 2019: 8 · 2018: 3 · 2017: 3 · 2016: 5 · 2015: 2
- FWCI
- 7.90
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Journal of the American Board of Family Medicine (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- The Journal of the American Medical Association (JAMA) Network (American Medical Association) (submittedVersion)
- Funders
- U.S. Department of Health and Human Services
- North Carolina Department of Health and Human Services
- Charles R. Drew University of Medicine and Science
- W.K. Kellogg Foundation (P3024018)
- Health Resources and Services Administration
- Agency for Healthcare Research and Quality
- U.S. Public Health Service (HHSA290200600012I, R40 MC21510)
- California State University, Northridge
- National Institute on Minority Health and Health Disparities (R01MD006213)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Reproductive Health and Contraception
- Keywords
- preconception health, African American women, chatbots, health disparities, risk screening, digital health interventions, pregnancy planning
- MeSH terms
- Adolescent, Adult, Black or African American, Female, Follow-Up Studies, Health Promotion, Humans, Medical Informatics Applications, Outcome and Process Assessment, Health Care, Patient Participation, Professional-Patient Relations, United States, Preconception Care, Risk Assessment, Internet, Risk Reduction Behavior, Health Status Disparities, Young Adult, Motivational Interviewing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review