Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index; 18 of the 38 sources its claims cite were checked for support.

Is there any room for ChatGPT AI bot in speech-language pathology?

Open access
Birol, Namık Yücel, Çiftci, Hilal Berber, Yılmaz, Ayşegül, Çağlayan, Ayhan, Alkan, Ferhat · 2025 · European Archives of Oto-Rhino-Laryngology

Abstract

Purpose: This study investigates the potential of the ChatGPT-4.0 artificial intelligence bot to assist speech-language pathologists (SLPs) by assessing its accuracy, comprehensiveness, and relevance in various tasks related to speech, language, and swallowing disorders. Method: In this cross-sectional descriptive study, 15 practicing SLPs evaluated ChatGPT-4.0’s responses to task-specific queries across six core areas: report writing, assessment material generation, clinical decision support, therapy stimulus generation, therapy planning, and client/family training material generation. English prompts were created in seven areas: speech sound disorders, motor speech disorders, aphasia, stuttering, childhood language disorders, voice disorders, and swallowing disorders. These prompts were entered into ChatGPT-4.0, and its responses were evaluated. Using a three-point Likert-type scale, participants rated each response for accuracy, relevance, and comprehensiveness based on clinical expectations and their professional judgment. Results: The study revealed that ChatGPT-4.0 performed with predominantly high accuracy, comprehensiveness, and relevance in tasks related to speech and language disorders. High accuracy, comprehensiveness, and relevance levels were observed in report writing, clinical decision support, and creating education material. However, tasks such as creating therapy stimuli and therapy planning showed more variation with medium and high accuracy levels. Conclusions: ChatGPT-4.0 shows promise in assisting SLPs with various professional tasks, particularly report writing, clinical decision support, and education material creation. However, further research is needed to address its limitations in therapy stimulus generation and therapy planning to improve its usability in clinical practice. Integrating AI technologies such as ChatGPT could improve the efficiency and effectiveness of therapeutic processes in speech-language pathology.

Overview

CoChat Summary

## TL;DR

This cross-sectional descriptive study asked 15 practicing speech-language pathologists to rate ChatGPT-4.0’s responses to SLP tasks across speech, language, and swallowing disorders. Overall, ChatGPT-4.0 was rated highly for accuracy, comprehensiveness, and relevance, especially for report writing and clinical decision support, but it was weaker for therapy stimulus generation and some Turkish-specific assessment tasks.

## Key findings

  • Across tasks and disorder categories, ChatGPT-4.0 showed predominantly high performance: mean accuracy scores ranged from 1.60 to 2.93 on a 1–3 scale.
  • In Speech Sound Disorders, accuracy differed significantly across tasks (p < 0.001): report writing (M = 2.80) and clinical decision support (M = 2.93) were highest, while therapy stimuli was lowest (M = 1.60).
  • For comprehensiveness, means ranged from 2.07 to 2.93; in Speech Sound Disorders, therapy planning was highest (M = 2.73) and assessment material creation was lowest (M = 2.07) with significant differences (p < 0.001).
  • Relevance was generally high, with scores ranging from 2.40 to 2.93; the paper notes lower relevance for assessment/stimuli generation in speech sound disorders.
  • Inter-rater reliability for the ratings was good: ICC = 0.755, 95% CI [0.677, 0.818].

## Methods

  • Design: Cross-sectional descriptive study evaluating ChatGPT-4.0’s responses to SLP-related prompts.
  • Sample/data: 15 participants (4 master’s students, 11 doctoral students), all practicing clinicians; prompts covered 6 tasks across 7 disorder areas. The prompts and hypothetical cases were created by five PhD-student SLP authors through three online consensus panels.
  • Main analysis: Participants rated responses on a 3-point Likert scale for accuracy, comprehensiveness, and relevance; analyses used descriptives, Friedman tests, and Bonferroni-corrected Wilcoxon tests. Inter-rater reliability was assessed with a two-way mixed-effects ICC.

## Limitations

  • The paper explicitly states the sample size was relatively small, which may limit generalizability.
  • It also states the sample was predominantly academic (practicing SLPs who were also graduate students), which may not represent broader clinical practice.
  • The survey took about 150 minutes, and the paper says this length was a barrier to participation.
  • Evident from the text: the study used only ChatGPT-4.0, only text responses, and evaluation was based on participants’ judgments rather than a specific gold-standard reference; the paper itself notes that no comparison with other AI models was conducted and that the version used had data only up to September 2021.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s00405-025-09295-y

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

16 Valid · 5 Not valid · 20 Not checked · 94 Own results and interpretations

54 more claims · 1 with their cited sources checked

Create a free account to see all 135 claims and to verify the 2 references still open.

See all claims — free account
  • Probably not a substantial claim. 55
  • It may state two separate claims as one. 38

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

6 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 28 references

Research works printed but not linked: 1

  1. Weismer G, Brown DK (2021) Introduction to communication sciences and disorders: the scientific basis of clinical practice. Plural Publishing, San Diego, CA

Cited by

See all 12

Metadata

Authors
Birol, N. Y., Çiftci, H. B., Yılmaz, A., Çağlayan, A., & Alkan, F.
Affiliations
  • Tarsus University (TR)
  • Istanbul Medipol University (TR)
  • Istinye University (TR)
Corresponding author
Birol, Namık Yücel
Venue
European Archives of Oto-Rhino-Laryngology
Published
2025-03-01
Volume
282
Issue
6
Pages
3267-3280
ISSN
  • 0937-4477 (ISSN-L)
  • 1434-4726
OpenAlex
W4408077353
Cited by
12
References
28
Citations by year
2026: 6 · 2025: 6
FWCI
2.86
Type
journal article
Language
en
Open access
Licence
Locations
  • European Archives of Oto-Rhino-Laryngology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
Tarsus University
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
Keywords
ChatGPT, large language models, speech-language pathology, clinical decision support, speech sound disorders, motor speech disorders, aphasia, stuttering, language disorders in children, voice disorders, dysphagia, treatment planning, clinical report writing
MeSH terms
Generative Artificial Intelligence, Adult, Artificial Intelligence, Cross-Sectional Studies, Female, Humans, Male, Speech Disorders, Speech-Language Pathology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Is there any room for ChatGPT AI bot in speech-language pathology? https://app.cochat.ai/papers/10.1007/s00405-025-09295-y
The paper
Birol, N. Y., Çiftci, H. B., Yılmaz, A., Çağlayan, A., & Alkan, F. (2025). Is there any room for ChatGPT AI bot in speech-language pathology? European Archives of Oto-Rhino-Laryngology. https://doi.org/10.1007/s00405-025-09295-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.