CoChat

An Exploration Into the Use of a Chatbot for Patients With Inflammatory Bowel Diseases: Retrospective Cohort Study

Open access
Zand, Aria, Sharma, Arjun, Stokes, Zack, Reynolds, Courtney, Montilla, Alberto, Sauk, Jenny, Hommes, Daniel · 2020 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Abstract

Background: The emergence of chatbots in health care is fast approaching. Data on the feasibility of chatbots for chronic disease management are scarce. Objective: This study aimed to explore the feasibility of utilizing natural language processing (NLP) for the categorization of electronic dialog data of patients with inflammatory bowel diseases (IBD) for use in the development of a chatbot. Methods: Electronic dialog data collected between 2013 and 2018 from a care management platform (UCLA eIBD) at a tertiary referral center for IBD at the University of California, Los Angeles, were used. Part of the data was manually reviewed, and an algorithm for categorization was created. The algorithm categorized all relevant dialogs into a set number of categories using NLP. In addition, 3 independent physicians evaluated the appropriateness of the categorization. Results: A total of 16,453 lines of dialog were collected and analyzed. We categorized 8324 messages from 424 patients into seven categories. As there was an overlap in these categories, their frequencies were measured independently as symptoms (2033/6193, 32.83%), medications (2397/6193, 38.70%), appointments (1518/6193, 24.51%), laboratory investigations (2106/6193, 34.01%), finance or insurance (447/6193, 7.22%), communications (2161/6193, 34.89%), procedures (617/6193, 9.96%), and miscellaneous (624/6193, 10.08%). Furthermore, in 95.0% (285/300) of cases, there were minor or no differences in categorization between the algorithm and the three independent physicians. Conclusions: With increased adaptation of electronic health technologies, chatbots could have great potential in interacting with patients, collecting data, and increasing efficiency. Our categorization showcases the feasibility of using NLP in large amounts of electronic dialog for the development of a chatbot algorithm. Chatbots could allow for the monitoring of patients beyond consultations and potentially empower and educate patients and improve clinical outcomes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/15589

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Overview of UCLA eIBD platform. AI: artificial intelligence; API: application programming interface.
Figure 1 Overview of UCLA eIBD platform. AI: artificial intelligence; API: application programming interface.CC BY · PubMed Central
Figure 2 Flowchart of inclusion and categorization. N/A: not applicable.
Figure 2 Flowchart of inclusion and categorization. N/A: not applicable.CC BY · PubMed Central
Figure 3 Heat map of category overlaps in dialog. This map shows the frequency of category overlap in pairs and how often the categories occurred by themselves out of the 6193 dialogs. Note: across the diagonal, the map is a mirror of itself.
Figure 3 Heat map of category overlaps in dialog. This map shows the frequency of category overlap in pairs and how often the categories occurred by themselves out of the 6193 dialogs. Note: across the diagonal, the map is a mirror of itself.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 4

  1. KowatschTNißenMShihCHRüeggerDVollandDFillerAKünzlerFBarataFHaugSBüchterDBrogleBHeldtKGindratGFarpour-LambertNl'AllemandDText-Based Healthcare Chatbots Supporting Patient and Health Professional Teams: Preliminary Results of a Randomized Controlled Trial on Childhood Obesity17th International Conference on Intelligent Virtual Agents2017IVA'17August 27-30, 2017Stockholm, Sweden
  2. Turner, AM, 2005, J Med Libr Assoc, 93, 487
  3. Raja, U, 2008, J Healthc Inf Manag, 22, 52
  4. 10.5555/1625275.1625342 · doi:10.5555/1625275.1625342

Cited by

See all 48

Metadata

Authors
Zand, A., Sharma, A., Stokes, Z., Reynolds, C., Montilla, A., Sauk, J., & Hommes, D.
Affiliations
  • University of California, Los Angeles (US)
  • Cisco Systems (United States) (US)
Corresponding author
Zand, Aria
Venue
Journal of Medical Internet Research
Published
2020-05-26
Volume
22
Issue
5
Pages
e15589
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3022060579
Cited by
48
References
10
Citations by year
2026: 3 · 2025: 10 · 2024: 10 · 2023: 10 · 2022: 7 · 2021: 5 · 2020: 3
FWCI
1.84
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
chatbots, inflammatory bowel disease, natural language processing, electronic health records, patient-generated health data, chronic disease management, patient monitoring
MeSH terms
Adult, Communication, Female, Humans, Male, Retrospective Studies, Inflammatory Bowel Diseases, Cohort Studies, Social Media, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.