An Exploration Into the Use of a Chatbot for Patients With Inflammatory Bowel Diseases: Retrospective Cohort Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Background: The emergence of chatbots in health care is fast approaching. Data on the feasibility of chatbots for chronic disease management are scarce. Objective: This study aimed to explore the feasibility of utilizing natural language processing (NLP) for the categorization of electronic dialog data of patients with inflammatory bowel diseases (IBD) for use in the development of a chatbot. Methods: Electronic dialog data collected between 2013 and 2018 from a care management platform (UCLA eIBD) at a tertiary referral center for IBD at the University of California, Los Angeles, were used. Part of the data was manually reviewed, and an algorithm for categorization was created. The algorithm categorized all relevant dialogs into a set number of categories using NLP. In addition, 3 independent physicians evaluated the appropriateness of the categorization. Results: A total of 16,453 lines of dialog were collected and analyzed. We categorized 8324 messages from 424 patients into seven categories. As there was an overlap in these categories, their frequencies were measured independently as symptoms (2033/6193, 32.83%), medications (2397/6193, 38.70%), appointments (1518/6193, 24.51%), laboratory investigations (2106/6193, 34.01%), finance or insurance (447/6193, 7.22%), communications (2161/6193, 34.89%), procedures (617/6193, 9.96%), and miscellaneous (624/6193, 10.08%). Furthermore, in 95.0% (285/300) of cases, there were minor or no differences in categorization between the algorithm and the three independent physicians. Conclusions: With increased adaptation of electronic health technologies, chatbots could have great potential in interacting with patients, collecting data, and increasing efficiency. Our categorization showcases the feasibility of using NLP in large amounts of electronic dialog for the development of a chatbot algorithm. Chatbots could allow for the monitoring of patients beyond consultations and potentially empower and educate patients and improve clinical outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Zand et al 68 used natural language processing to develop a chatbot knowledge base by categorizing electronic messages between patients and providers.”
From A chatbot for hypertension self-management support: user-centered design, development, and usability testing (2023) · cites this paper as [68]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Savova, G. K., Masanz, J. J., Ogren, P. V., Zheng, J., Sohn, S., Kipper-Schuler, K. C., & Chute, C. G. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001560 · Cited by 1,967 · cited 3×
“The literature shows that it is common to perform exploratory analysis on natural language data to understand the topics and vocabulary of a specific domain in health care [9-14].”
BackgroundMethodThe design and implementation of Xiaoice, an empathetic social chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2018) · arXiv · doi:10.48550/arxiv.1812.08989 · Cited by 777
From Eliza to XiaoIce: Challenges and opportunities with social chatbots
Shum, H.-Y., He, X.-D., & Li, D. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700826 · Cited by 749 · cited 1×
“For instance, Artificial Linguistic Internet Computer Entity and ELIZA, two classic chatbots, utilize hand-constructed databases to generate a response that matches a given human input [20].”
BackgroundAnanthakrishnan, A. N., Cai, T., Savova, G., Cheng, S.-C., Chen, P., Perez, R. G., Gainer, V. S., Murphy, S. N., Szolovits, P., Xia, Z., et al. (2013) · Inflammatory Bowel Diseases · doi:10.1097/mib.0b013e31828133fd · Cited by 168
A Systematic Review of Natural Language Processing in Healthcare
Iroju, O. G., & Janet, O. (2015) · International Journal of Information Technology and Computer Science · doi:10.5815/ijitcs.2015.08.07 · Cited by 161
Pharmabot: A Pediatric Generic Medicine Consultant Chatbot
Comendador, B. E. V., Francisco, B. M. B., Medenilla, J. S., Nacion, S. M. T., & Serac, T. B. E. (2015) · Journal of Automation and Control Engineering · doi:10.12720/joace.3.2.137-140 · Cited by 150
van Deen, W. K., Jong, A. E. V. D. M., Parekh, N. K., Kane, E., Zand, A., DiNicola, C. A., Hall, L., Inserra, E. K., Choi, J. M., Ha, C. Y., et al. (2015) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2015.10.035 · Cited by 74
Self-citationModeling public health interventions for improved access to the gray literature.
Turner, A. M., Liddy, E. D., Bradley, J., & Wheatley, J. A. (2005) · Europe PMC (PubMed Central) · Cited by 59
Text mining in healthcare. Applications and opportunities.
Raja, U., Mitchell, T., Day, T., & Hardin, J. M. (2008) · PubMed · Cited by 57
Costs in inflammatory bowel diseases
Petryszyn, P. W., & Witczak, I. (2016) · Gastroenterology Review · doi:10.5114/pg.2016.57883 · Cited by 28
A network model of activities in primary care consultations
Kocaballi, A. B., Coiera, E., Tong, H. L., White, S. J., Quiroz, J. C., Rezazadegan, F., Willcock, S., & Laranjo, L. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz046 · Cited by 23
Research works printed but not linked: 4
- KowatschTNißenMShihCHRüeggerDVollandDFillerAKünzlerFBarataFHaugSBüchterDBrogleBHeldtKGindratGFarpour-LambertNl'AllemandDText-Based Healthcare Chatbots Supporting Patient and Health Professional Teams: Preliminary Results of a Randomized Controlled Trial on Childhood Obesity17th International Conference on Intelligent Virtual Agents2017IVA'17August 27-30, 2017Stockholm, Sweden
- Turner, AM, 2005, J Med Libr Assoc, 93, 487
- Raja, U, 2008, J Healthc Inf Manag, 22, 52
- 10.5555/1625275.1625342 · doi:10.5555/1625275.1625342
Cited by
Stidham, R. W., & Takenaka, K. (2022) · Gastroenterology · doi:10.1053/j.gastro.2021.12.238 · Cited by 123
Quantum Computing and Machine Learning in Medical Decision-Making: A Comprehensive Review
Chow, J. C. L. (2025) · Algorithms · doi:10.3390/a18030156 · Cited by 141
Comparative Performance of ChatGPT and Bard in a Text-Based Radiology Knowledge Assessment
Patil, N. S., Huang, R. S., van der Pol, C. B., & Larocque, N. (2024) · Canadian Association of Radiologists Journal · doi:10.1177/08465371231193716 · Cited by 94
Inflammation, Autoinflammation and Autoimmunity in Inflammatory Bowel Diseases
Padoan, A., Musso, G., Contran, N., & Basso, D. (2023) · Current Issues in Molecular Biology · doi:10.3390/cimb45070350 · Cited by 80
Kocaballi, A. B., Sezgın, E., Clark, L., Carroll, J. M., Huang, Y., Huh, J., Kim, J., Kocielnik, R., Lee, Y., Mamykina, L., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/38525 · Cited by 77
Metadata
- Authors
- Zand, A., Sharma, A., Stokes, Z., Reynolds, C., Montilla, A., Sauk, J., & Hommes, D.
- Affiliations
- University of California, Los Angeles (US)
- Cisco Systems (United States) (US)
- Corresponding author
- Zand, Aria
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-05-26
- Volume
- 22
- Issue
- 5
- Pages
- e15589
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7284401
- OpenAlex
- W3022060579
- Semantic Scholar
- aa72df551dcffccaea567398144c19fe01fb84bc
- Cited by
- 48
- References
- 10
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 10 · 2023: 10 · 2022: 7 · 2021: 5 · 2020: 3
- FWCI
- 1.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- chatbots, inflammatory bowel disease, natural language processing, electronic health records, patient-generated health data, chronic disease management, patient monitoring
- MeSH terms
- Adult, Communication, Female, Humans, Male, Retrospective Studies, Inflammatory Bowel Diseases, Cohort Studies, Social Media, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.