Development and usability testing of a chatbot to promote mental health services use among individuals with eating disorders following screening
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Objective: A significant gap exists between those who need and those who receive care for eating disorders (EDs). Novel solutions are needed to encourage service use and address treatment barriers. This study developed and evaluated the usability of a chatbot designed for pairing with online ED screening. The tool aimed to promote mental health service utilization by improving motivation for treatment and self‐efficacy among individuals with EDs. Methods: A chatbot prototype, Alex, was designed using decision trees and theoretically‐informed components: psychoeducation, motivational interviewing, personalized recommendations, and repeated administration. Usability testing was conducted over four iterative cycles, with user feedback informing refinements to the next iteration. Post‐testing, participants (N= 21) completed the System Usability Scale (SUS), the Usefulness, Satisfaction, and Ease of Use Questionnaire (USE), and a semi‐structured interview. Results: Interview feedback detailed chatbot aspects participants enjoyed and aspects necessitating improvement. Feedback converged on four themes: user experience, chatbot qualities, chatbot content, and ease of use. Following refinements, users described Alex as humanlike, supportive, and encouraging. Content was perceived as novel and personally relevant. USE scores across domains were generally above average (~5 out of 7), and SUS scores indicated “good” to “excellent” usability across cycles, with the final iteration receiving the highest average score. Discussion: Overall, participants generally reflected positively on interactions with Alex, including the initial version. Refinements between cycles further improved user experiences. This study provides preliminary evidence of the feasibility and acceptance of a chatbot designed to promote motivation for and use of services among individuals with EDs. Public Significance: Low rates of service utilization and treatment have been observed among individuals following online eating disorder screening. Tools are needed, including scalable, digital options, that can be easily paired with screening, to improve motivation for addressing eating disorders and promote service utilization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Code Saturation Versus Meaning Saturation: How Many Interviews Are Enough?
Hennink, M. M., Kaiser, B. N., & Marconi, V. C. (2017) · Qualitative Health Research · doi:10.1177/1049732316665344 · Cited by 4,597
Self-perception: An alternative interpretation of cognitive dissonance phenomena.
Bem, D. J. (1967) · Psychological Review · doi:10.1037/h0024835 · Cited by 2,959
Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Mobile Telephone Text Messaging for Medication Adherence in Chronic Disease: A Meta-analysis
Thakkar, J., Kurup, R., Laba, T.-L., Santo, K., Thiagalingam, A., Rodgers, A., Woodward, M., Redfern, J., & Chow, C. K. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.7667 · Cited by 685
Eisenberg, D., Nicklett, E. J., Roeder, K., & Kirz, N. E. (2011) · Journal of American College Health · doi:10.1080/07448481.2010.546461 · Cited by 634
Lundahl, B., & Burke, B. L. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20638 · Cited by 573
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
The think aloud method: a guide to user interface design
JASPERS, M., STEEN, T., BOS, C., & GEENEN, M. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.08.003 · Cited by 544
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
Addressing critical gaps in the treatment of eating disorders
Kazdin, A. E., Fitzsimmons‐Craft, E. E., & Wilfley, D. E. (2017) · International Journal of Eating Disorders · doi:10.1002/eat.22670 · Cited by 389
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363
Prevention of Eating Disorders in At-Risk College-Age Women
Taylor, C. B., Bryson, S., Luce, K. H., Cunning, D., Doyle, A. C., Abascal, L. B., Rockwell, R., Dev, P., Winzelberg, A. J., & Wilfley, D. E. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.8.881 · Cited by 354
Self-citationSurvey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301
Counting in Qualitative Research: Why to Conduct it, When to Avoid it, and When to Closet it
Hannah, D. R., & Lautsch, B. A. (2011) · Journal of Management Inquiry · doi:10.1177/1056492610375988 · Cited by 282
Darcy, A., Daniels, J., Salinger, D., Wicks, P., & Robinson, A. (2021) · JMIR Formative Research · doi:10.2196/27868 · Cited by 260
Xu, Z., Huang, F., Kösters, M., Staiger, T., Becker, T., Thornicroft, G., & Rüsch, N. (2018) · Psychological Medicine · doi:10.1017/s0033291718001265 · Cited by 252
Using Health Chatbots for Behavior Change: A Mapping Study
Pereira, J., & Díaz, Ó. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1237-1 · Cited by 199
Lyon, A. R., & Bruns, E. J. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3060 · Cited by 178
Stephens, T. N., Joerin, A., Rauws, M., & Werk, L. N. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz043 · Cited by 150
Beintner, I., Jacobi, C., & Taylor, C. B. (2012) · European Eating Disorders Review · doi:10.1002/erv.1130 · Cited by 139
Self-citationUnderstanding treatment delay: perceived barriers preventing treatment-seeking for eating disorders
Hamilton, A., Mitchison, D., Basten, C., Byrne, S., Goldstein, M., Hay, P., Heruc, G., Thornton, C., & Touyz, S. (2022) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674211020102 · Cited by 133
Oh, J., Jang, S., Kim, H., & Kim, J.-J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104171 · Cited by 124
Taylor, C. B., Kass, A. E., Trockel, M., Cunning, D., Weisman, H., Bailey, J., Sinton, M., Aspen, V., Schecthman, K., Jacobi, C., et al. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000077 · Cited by 70
Self-citationConceptual Introduction to the Multiphase Optimization Strategy (MOST)
Collins, L. M. (2018) · Statistics for Social and Behavioral Sciences · doi:10.1007/978-3-319-72206-1_1 · Cited by 51
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Grammer, A. C., Shah, J., Laboe, A. A., McGinnis, C. G., Balantekin, K. N., Graham, A. K., Smolar, L., Taylor, C. B., Wilfley, D. E., & Fitzsimmons‐Craft, E. E. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23760 · Cited by 26
Self-citationPrivate Yet Social: How LLM Chatbots Support and Challenge Eating Disorder Recovery
Choi, R., Kim, T., Park, S., Kim, J. G., & Lee, S.-J. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713485 · Cited by 19
Metadata
- Authors
- Shah, J., DePietro, B., D'Adamo, L., Firebaugh, M., Laing, O., Fowler, L. A., Smolar, L., Sadeh‐Sharvit, S., Taylor, C. B., Wilfley, D. E., & Fitzsimmons‐Craft, E. E.
- Venue
- International Journal of Eating Disorders
- Publisher
- Wiley
- Published
- 2022-08-18
- Volume
- 55
- Issue
- 9
- Pages
- 1229-1244
- ISSN
- 0276-3478 (ISSN-L)
- 1098-108X
- OpenAlex
- W4292230838
- Cited by
- 69
- References
- 29
- FWCI
- 11.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.