An Exploration Into the Use of a Chatbot for Patients With Inflammatory Bowel Diseases: Retrospective Cohort Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Background: The emergence of chatbots in health care is fast approaching. Data on the feasibility of chatbots for chronic disease management are scarce. Objective: This study aimed to explore the feasibility of utilizing natural language processing (NLP) for the categorization of electronic dialog data of patients with inflammatory bowel diseases (IBD) for use in the development of a chatbot. Methods: Electronic dialog data collected between 2013 and 2018 from a care management platform (UCLA eIBD) at a tertiary referral center for IBD at the University of California, Los Angeles, were used. Part of the data was manually reviewed, and an algorithm for categorization was created. The algorithm categorized all relevant dialogs into a set number of categories using NLP. In addition, 3 independent physicians evaluated the appropriateness of the categorization. Results: A total of 16,453 lines of dialog were collected and analyzed. We categorized 8324 messages from 424 patients into seven categories. As there was an overlap in these categories, their frequencies were measured independently as symptoms (2033/6193, 32.83%), medications (2397/6193, 38.70%), appointments (1518/6193, 24.51%), laboratory investigations (2106/6193, 34.01%), finance or insurance (447/6193, 7.22%), communications (2161/6193, 34.89%), procedures (617/6193, 9.96%), and miscellaneous (624/6193, 10.08%). Furthermore, in 95.0% (285/300) of cases, there were minor or no differences in categorization between the algorithm and the three independent physicians. Conclusions: With increased adaptation of electronic health technologies, chatbots could have great potential in interacting with patients, collecting data, and increasing efficiency. Our categorization showcases the feasibility of using NLP in large amounts of electronic dialog for the development of a chatbot algorithm. Chatbots could allow for the monitoring of patients beyond consultations and potentially empower and educate patients and improve clinical outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Zand et al 68 used natural language processing to develop a chatbot knowledge base by categorizing electronic messages between patients and providers.”
From A chatbot for hypertension self-management support: user-centered design, development, and usability testing (2023) · cites this paper as [68]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Savova, G. K., Masanz, J. J., Ogren, P. V., Zheng, J., Sohn, S., Kipper-Schuler, K. C., & Chute, C. G. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001560 · Cited by 1,967 · cited 3×
“The literature shows that it is common to perform exploratory analysis on natural language data to understand the topics and vocabulary of a specific domain in health care [9-14].”
BackgroundMethodThe design and implementation of Xiaoice, an empathetic social chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2018) · arXiv · doi:10.48550/arxiv.1812.08989 · Cited by 777
From Eliza to XiaoIce: Challenges and opportunities with social chatbots
Shum, H.-Y., He, X.-D., & Li, D. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700826 · Cited by 749 · cited 1×
“For instance, Artificial Linguistic Internet Computer Entity and ELIZA, two classic chatbots, utilize hand-constructed databases to generate a response that matches a given human input [20].”
BackgroundAnanthakrishnan, A. N., Cai, T., Savova, G., Cheng, S.-C., Chen, P., Perez, R. G., Gainer, V. S., Murphy, S. N., Szolovits, P., Xia, Z., et al. (2013) · Inflammatory Bowel Diseases · doi:10.1097/mib.0b013e31828133fd · Cited by 168
Pharmabot: A Pediatric Generic Medicine Consultant Chatbot
Comendador, B. E. V., Francisco, B. M. B., Medenilla, J. S., Nacion, S. M. T., & Serac, T. B. E. (2015) · Journal of Automation and Control Engineering · doi:10.12720/joace.3.2.137-140 · Cited by 150
A Systematic Review of Natural Language Processing in Healthcare
Department of Computer Science, A. C. O. E., Iroju, O. G., & Olaleke, J. O. (2015) · International Journal of Information Technology and Computer Science · doi:10.5815/ijitcs.2015.08.07 · Cited by 111
van Deen, W. K., Jong, A. E. V. D. M., Parekh, N. K., Kane, E., Zand, A., DiNicola, C. A., Hall, L., Inserra, E. K., Choi, J. M., Ha, C. Y., et al. (2015) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2015.10.035 · Cited by 78
Self-citationModeling public health interventions for improved access to the gray literature.
Turner, A. M., Liddy, E. D., Bradley, J., & Wheatley, J. A. (2005) · Europe PMC (PubMed Central) · Cited by 59
Text mining in healthcare. Applications and opportunities.
Raja, U., Mitchell, T., Day, T., & Hardin, J. M. (2008) · PubMed · Cited by 57
Research works printed but not linked: 4
- KowatschTNißenMShihCHRüeggerDVollandDFillerAKünzlerFBarataFHaugSBüchterDBrogleBHeldtKGindratGFarpour-LambertNl'AllemandDText-Based Healthcare Chatbots Supporting Patient and Health Professional Teams: Preliminary Results of a Randomized Controlled Trial on Childhood Obesity17th International Conference on Intelligent Virtual Agents2017IVA'17August 27-30, 2017Stockholm, Sweden
- Turner, AM, 2005, J Med Libr Assoc, 93, 487
- Raja, U, 2008, J Healthc Inf Manag, 22, 52
- 10.5555/1625275.1625342 · doi:10.5555/1625275.1625342
Cited by
Stidham, R. W., & Takenaka, K. (2022) · Gastroenterology · doi:10.1053/j.gastro.2021.12.238 · Cited by 123
Quantum Computing and Machine Learning in Medical Decision-Making: A Comprehensive Review
Chow, J. C. L. (2025) · Algorithms · doi:10.3390/a18030156 · Cited by 141
Comparative Performance of ChatGPT and Bard in a Text-Based Radiology Knowledge Assessment
Patil, N. S., Huang, R. S., van der Pol, C. B., & Larocque, N. (2024) · Canadian Association of Radiologists Journal · doi:10.1177/08465371231193716 · Cited by 94
Inflammation, Autoinflammation and Autoimmunity in Inflammatory Bowel Diseases
Padoan, A., Musso, G., Contran, N., & Basso, D. (2023) · Current Issues in Molecular Biology · doi:10.3390/cimb45070350 · Cited by 80
Kocaballi, A. B., Sezgin, E., Clark, L., Carroll, J. M., Huang, Y., Huh-Yoo, J., Kim, J., Kocielnik, R., Lee, Y.-C., Mamykina, L., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/38525 · Cited by 62
Validity of Chatbot Use for Mental Health Assessment: Experimental Study
Schick, A., Feine, J., Morana, S., Maedche, A., & Reininghaus, U. (2022) · JMIR mHealth and uHealth · doi:10.2196/28082 · Cited by 58
Natural Language Processing in medicine and ophthalmology: A review for the 21st-century clinician
Rojas-Carabali, W. A., Agrawal, R., Gutiérrez-Sinisterra, L., Baxter, S. L., Cifuentes‐González, C., Wei, Y. C., Abisheganaden, J. A., Kannapiran, P., Wong, S., Lee, B. T. K., et al. (2024) · Asia-Pacific Journal of Ophthalmology · doi:10.1016/j.apjo.2024.100084 · Cited by 82
Natural Language Processing: from Bedside to Everywhere
Aramaki, E., Wakamiya, S., Yada, S., & Nakamura, Y. (2022) · Yearbook of Medical Informatics · doi:10.1055/s-0042-1742510 · Cited by 67
Lee, H., Kang, J., & Yeo, J. (2021) · Journal of Medical Internet Research · doi:10.2196/27460 · Cited by 47
Griffin, A. C., Khairat, S., Bailey, S. C., & Chung, A. E. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad073 · Cited by 46
Chatbot as Islamic Finance Expert (CaIFE)
Khan, S., & Rabbani, M. R. (2020) · International Symposium on Computer Science and Intelligent Control (ISCSIC) · doi:10.1145/3440084.3441213 · Cited by 44
Pinton, P. (2023) · Annals of Medicine · doi:10.1080/07853890.2023.2300670 · Cited by 48
Egli, A., Schrenzel, J., & Greub, G. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.06.023 · Cited by 65
Applications of natural language processing in ophthalmology: present and future
Chen, J., & Baxter, S. L. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.906554 · Cited by 50
Desideri, L. F., Roth, J., Zinkernagel, M. S., & Anguita, R. (2023) · International Journal of Retina and Vitreous · doi:10.1186/s40942-023-00511-7 · Cited by 49
Leveraging conversational technology to answer common COVID-19 questions
McKillop, M. M., South, B. R., Preininger, A. M., Mason, M., & Jackson, G. P. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa316 · Cited by 38
Chua, J. Y. X., Choolani, M. A., Chee, C. Y. I., Chan, Y. H., Lalor, J., Chong, Y. S., & Shorey, S. (2023) · Journal of Midwifery & Women s Health · doi:10.1111/jmwh.13472 · Cited by 43
Clinical applications of large language models in medicine and surgery: A scoping review
Liang, E. N., Pei, S., Staibano, P., & van der Woerd, B. D. (2025) · Journal of International Medical Research · doi:10.1177/03000605251347556 · Cited by 29
Cohen‐Mekelburg, S., Berry, S. K., Stidham, R. W., Zhu, J., & Waljee, A. K. (2021) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.15405 · Cited by 26
Kuhail, M. A., Bahja, M., Al-Shamaileh, O., Thomas, J., Alkazemi, A., & Negreiros, J. G. M. (2024) · IEEE Access · doi:10.1109/access.2024.3402977 · Cited by 36
Patel, P. V., Davis, C., Ralbovsky, A., Tinoco, D., Williams, C. Y. K., Slatter, S., Naderalvojoud, B., Rosen, M. J., Hernandez‐Boussard, T., & Rudrapatna, V. A. (2024) · Gastro Hep Advances · doi:10.1016/j.gastha.2024.10.003 · Cited by 24
How Far Can Conversational Agents Contribute to IBD Patient Health Care—A Review of the Literature
Pernencar, C. A. D. C., Saboia, I., & Dias, J. C. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.862432 · Cited by 17
The evolution of creativity: how generative AI is reshaping the hospitality landscape
Chung, K. C. (2024) · Enterprise Information Systems · doi:10.1080/17517575.2024.2427024 · Cited by 16
Stammers, M., Ramgopal, B., Nimako, A. O., Vyas, A., Nouraei, S. A. R., Metcalf, C., Batchelor, J., Shepherd, J., & Gwiggner, M. (2025) · BMC Gastroenterology · doi:10.1186/s12876-025-03608-5 · Cited by 21
Artificial intelligence and inflammatory bowel disease: practicalities and future prospects
Brooks-Warburton, J., Ashton, J. J., Dhar, A., Tham, T., Allen, P. B., Hoque, S., Lovat, L. B., & Sebastian, S. (2021) · Frontline Gastroenterology · doi:10.1136/flgastro-2021-102003 · Cited by 18
Artificial Intelligence (AI) Generated Health Counseling For Mental Illness Patients
Shankar Ganesh, M., & Venkateswaramurthy, N. (2024) · Current Psychiatry Research and Reviews · doi:10.2174/0126660822277500240109050359 · Cited by 25
Omar, M., Nassar, S., Sharif, Κ., Glicksberg, B. S., Nadkarni, G. N., & Klang, E. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2024.1512824 · Cited by 25
Artificial Intelligence in Advancing Inflammatory Bowel Disease Management: Setting New Standards
Labarile, N., Vitello, A., Sinagra, E., Nardone, O. M., Calabrese, G., Bonomo, F., Maida, M. F., & Iacucci, M. (2025) · Cancers · doi:10.3390/cancers17142337 · Cited by 17
AI-Enabled Conversational Journaling for Advancing Parkinson's Disease Symptom Tracking
Rashik, M., Sweth, S., Agrawal, N. A., Kochar, S., Smith, K. M., Rajabiyazdi, F., Setlur, V., Mahyar, N., & Sarvghad, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714280 · Cited by 20
Rani, S., & Jain, A. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15539-y · Cited by 14
Computer Science meets Vascular Surgery: Keeping a pulse on artificial intelligence
Thaxton, C. T., & Dardik, A. (2023) · Seminars in Vascular Surgery · doi:10.1053/j.semvascsurg.2023.05.003 · Cited by 10
Artificial Intelligence in Healthcare and Biotechnology: A Reviewof the Saudi Experience
Dabdoub, F., Colangelo, M., Kibbi, O. E., Shami, S., Aljumah, M., Boudjela, M., & Aljumah, M. (2022) · Journal of Artificial Intelligence & Cloud Computing · doi:10.47363/jaicc/2022(1)107 · Cited by 9
Ramesh, S. H., Jull, D., Fournier, H., & Rajabiyazdi, F. (2025) · Interactive Journal of Medical Research · doi:10.2196/66164 · Cited by 7
Aminuddin, R., Noor, M. H. M., Ilias, N. F., & Wahab, N. I. F. A. (2021) · IEEE Symposium on Industrial Electronics & Applications (ISIEA) · doi:10.1109/isiea51897.2021.9509978 · Cited by 3
Feldman, K., & Nehme, F. (2023) · Gastroenterology · doi:10.1053/j.gastro.2023.06.006 · Cited by 3
Natural Language Processing in Gastroenterology
Parasa, S., & Sridhar, A. R. M. (2025) · Gastrointestinal Endoscopy Clinics of North America · doi:10.1016/j.giec.2024.09.005 · Cited by 4
Neogi, S., Mukherjee, S., & Verma, A. (2024) · Advances in logistics, operations, and management science book series · doi:10.4018/979-8-3693-5503-9.ch017 · Cited by 1
Sharma, N., Wrede, C., Bastoni, S., Braakman‐Jansen, A., & van Gemert‐Pijnen, J. E. W. C. (2024) · JMIR Formative Research · doi:10.2196/54734 · Cited by 2
Xiao, L., & Han, X. (2025) · Social Science & Medicine · doi:10.1016/j.socscimed.2025.118822 · Cited by 2
Lucchini, A., Bozzon, A., & Colombo, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790698 · Cited by 2
Assessing the Sentiment of Book Characteristics Using Machine Learning NLP Models
Drozda, P., & Sopyła, K. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-23480-4_18 · Cited by 1
rAVA: A Robot for Virtual Support of Learning
de Oliveira, E. S., Spalenza, M. A., & Pirovani, J. P. C. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-71187-0_115 · Cited by 1
Stammers, M., Ramgopal, B., Obeng, A., Vyas, A., Nouraei, S. A. R., Metcalf, C., Batchelor, J., Shepherd, J., & Gwiggner, M. (2024) · Research Square · doi:10.21203/rs.3.rs-4249448/v1 · Cited by 1
Generation Y Health Care Professionals and Their Acceptance of Chatbots
Zwicky, A., Stallone, V., & Haarmann, J. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-45642-8_23
Examining the Readability of AtlasGPT, the Premiere Resource for Neurosurgical Education
Lavadi, R. S., Carnovale, B. J., Tirmizi, Z., Gajjar, A. A., Kumar, R. P., Shah, M. J., Hamilton, D. K., & Agarwal, N. (2024) · World Neurosurgery · doi:10.1016/j.wneu.2024.11.052
Understanding machine learning for patient education
Shams, W., Tantray, J., Parveen, H., Nikumbh, P., & Prajapati, B. G. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-43823-3.00013-3
Artificial intelligence in the management of inflammatory bowel disease: What’s next?
Bilotta, A. J., Trebilcock, J., Hebda, N., Sasan, C., Cooper, K. M., & Rupawala, A. (2026) · World Journal of Gastrointestinal Pharmacology and Therapeutics · doi:10.4292/wjgpt.v17.i1.112640
Abbas, K. F., Malvankar‐Mehta, M. S., Juncal, V., Hooper, P. L., & Sheidow, T. G. (2026) · Journal of VitreoRetinal Diseases · doi:10.1177/24741264261460669
Metadata
- Authors
- Zand, A., Sharma, A., Stokes, Z., Reynolds, C., Montilla, A., Sauk, J., & Hommes, D.
- Affiliations
- University of California, Los Angeles (US)
- Cisco Systems (United States) (US)
- Corresponding author
- Zand, Aria
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-05-26
- Volume
- 22
- Issue
- 5
- Pages
- e15589
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7284401
- OpenAlex
- W3022060579
- Semantic Scholar
- aa72df551dcffccaea567398144c19fe01fb84bc
- Cited by
- 48
- References
- 10
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 10 · 2023: 10 · 2022: 7 · 2021: 5 · 2020: 3
- FWCI
- 1.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- chatbots, inflammatory bowel disease, natural language processing, electronic health records, patient-generated health data, chronic disease management, patient monitoring
- MeSH terms
- Adult, Communication, Female, Humans, Male, Retrospective Studies, Inflammatory Bowel Diseases, Cohort Studies, Social Media, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.