Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening

Open access

Abstract

Recent studies showed that large language models (LLMs) could enhance understanding of colorectal cancer (CRC) screening, potentially increasing participation rates. However, a limitation of these studies is that questions posed to LLMs are generated by experts. This study aimed to investigate ChatGPT-4o effectiveness in answering CRC screening queries directly generated by patients. Ten consecutive subjects aged 50 to 69 years who were eligible for the Italian national CRC screening program but not actively involved were enrolled. Four possible scenarios for CRC screening were presented to each participant and they were asked to formulate one question per scenario to gather additional information. These questions were then posed to ChatGPT in two separate sessions. The responses were evaluated by five senior experts, who rated each answer based on three criteria: accuracy, completeness, and comprehensibility, using a 5-point Likert scale. In addition, the same 10 patients who created the questions assessed the answers, rating each response as complete, understandable, and trustworthy on a dichotomous scale (yes/no). Experts rated the responses with mean scores of 4.1 ± 1.0 for accuracy, 4.2 ± 1.0 for completeness, and 4.3 ± 1.0 for comprehensibility. Patients rated responses as complete in 97.5%, understandable in 95%, and trustworthy in 100% of cases. Consistency over time was confirmed by an 86.8% similarity between session responses. Despite variability in questions and answers, ChatGPT confirmed good performances in answering CRC screening queries, even when used directly by patients.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1055/a-2568-9416

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 a Box plot and b frequency histogram showing the rating of ChatGPT answers by experts overall, and c in each scenario. (Full list of Q&A for each scenario available in Supplementary Table 1 and scales for assessment of accuracy, completeness and comprehensibility are available in Supplementary Table 2).
Fig. 1 a Box plot and b frequency histogram showing the rating of ChatGPT answers by experts overall, and c in each scenario. (Full list of Q&A for each scenario available in Supplementary Table 1 and scales for assessment of accuracy, completeness and comprehensibility are available in Supplementary Table 2).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Cited by

See all 8

Metadata

Authors
Maida, M., Mori, Y., Fuccio, L., Sferrazza, S., Vitello, A., Facciorusso, A., & Hassan, C.
Affiliations
  • Università degli Studi di Enna Kore (IT)
  • University of Oslo (NO)
  • IRCCS Azienda Ospedliero-Universitaria di Bologna Policlinico di Sant'Orsola (IT)
  • Gastroenterology Unit, Ospedale Civico Palermo, Palermo, Italy
  • University of Foggia (IT)
  • Humanitas University (IT)
Corresponding author
Maida, Marcello
Venue
Endoscopy International Open
Published
2025-03-28
Volume
13
Issue
CP
Pages
a25689416-a25689416
ISSN
  • 2196-9736 (ISSN-L)
  • 2364-3722
OpenAlex
W4408935628
Cited by
7
References
10
Citations by year
2026: 4 · 2025: 3
FWCI
1.68
Type
journal article
Language
en
Open access
Locations
  • Endoscopy International Open (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • AIRUS (submittedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Oncology › Colorectal Cancer Screening and Detection
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
ChatGPT, large language models, colorectal cancer screening, patient-provider communication, screening uptake, AI-generated health information, expert evaluation of AI responses

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening. https://app.cochat.ai/papers/10.1055/a-2568-9416
The paper
Maida, M., Mori, Y., Fuccio, L., Sferrazza, S., Vitello, A., Facciorusso, A., & Hassan, C. (2025). Exploring ChatGPT effectiveness in addressing direct patient queries on colorectal cancer screening. Endoscopy International Open. https://doi.org/10.1055/a-2568-9416

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.