Clinical Application of Large Language Models for Intervention Plan Development in Speech-Language Pathology
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Purpose: This study investigates the speech and language intervention plan outputs generated by six different artificial intelligence (AI) tools powered by large language models (LLMs), currently available for clinical writing in the field of speech-language pathology. This study aims to evaluate the potential applications and limitations of these AI tools, as well as their ability to provide relevant and reliable information for developing intervention plans. Method: Using a mixed design including both quantitative and qualitative analyses, this study compared the performance outputs of the six AI tools across three fictional clinical cases, each involving different types of speech and language disorders in 5-year-old children. Two types of command prompts, each with three levels of input specificity, were used to generate AI outputs. Results: Results revealed that the intervention plans generated by these AI tools were rated between Needs Improvement and Meets Expectations in terms of clinical knowledge and competency. Detailed and structured command prompts than general prompts yielded outputs with higher ratings, while the specificity of case information did not consistently influence the outputs. Each AI tool demonstrated unique strengths and limitations in supporting the development of intervention plans. Conclusion: The results of this study may serve as foundational data to provide insights into how clinicians, educators, and students in the field of speech-language pathology can appropriately and responsibly utilize existing AI resources when implementing these technologies into the development of intervention plans.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study
Armstrong, D., Gosling, A., Weinman, J., & Marteau, T. (1997) · Sociology · doi:10.1177/0038038597031003015 · Cited by 1,008
What ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828
Generative artificial intelligence: a systematic review and applications
Sengar, S. S., Hasan, A. B., Kumar, S., & Carroll, F. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20016-1 · Cited by 467
Homolak, J. (2023) · Croatian Medical Journal · doi:10.3325/cmj.2023.64.1 · Cited by 208
Hallucination is Inevitable: An Innate Limitation of Large Language Models
Xu, Z., Jain, S., & Kankanhalli, M. (2024) · arXiv · doi:10.48550/arxiv.2401.11817 · Cited by 180
Differentiate ChatGPT-generated and Human-written Medical Texts
Liao, W., Liu, Z., Dai, H., Xu, S., Wu, Z., Zhang, Y., Huang, X., Zhu, D., Cai, H., Liu, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.11567 · Cited by 119
Research works printed but not linked: 1
- Budiu, R., Liu, F., Zhang, A., & Cionca, E. (2023, November 24). Prompt structure in conversations with generative AI. Nielsen Norman Group. https://www.nngroup.com/articles/ai-prompt-structure/
Cited by
Applying artificial intelligence in neurodevelopmental disorders management and research
Mohamed, S., Ben-Jaafar, A., Frimpong, M., Roy, S., Sanker, V., Nkrumah-Boateng, P. A., Imran, S., Mumeen, A. A., Mohamed, S., & Awuah, W. A. (2026) · European journal of medical research · doi:10.1186/s40001-025-03740-8 · Cited by 9
“From a translational standpoint, a clear gap persists between experimental validation and real-world clinical use, since only a handful of studies have implemented these tools in live healthcare or community settings [142, 157].”
InfluentialBailey, D. J., Anjum, J., Park, H., Carpenter, E., Mamlekar, C. R., & Kurland, J. (2026) · American Journal of Speech-Language Pathology · doi:10.1044/2025_ajslp-25-00262 · Cited by 7
Bai, T., Jiang, K., Yu, Y., Qie, S., Wang, C., Wang, B., & Zhang, W. (2026) · Future Internet · doi:10.3390/fi18020095 · Cited by 2
“Overall, LLMs demonstrate significant potential in rehabilitation, with future developments expected to yield more specialized models for specific sub-domains (e.g., speech therapy, orthopedic rehabilitation) [96].”
Shankar, R., Goh, Z., & Qian, X. (2025) · medRxiv · doi:10.1101/2025.10.11.25337799
Meng, Y., Wang, Q., Liu, B., & Lu, H. (2026) · doi:10.2196/preprints.110160
Metadata
- Authors
- Kim, N., Homer, M., & Jang, H.
- Affiliations
- California Baptist University (US)
- Indiana University Indianapolis (US)
- Venue
- American Journal of Speech-Language Pathology
- Published
- 2025-07-10
- Volume
- 34
- Issue
- 4
- Pages
- 2098-2114
- ISSN
- 1058-0360 (ISSN-L)
- 1558-9110
- OpenAlex
- W4410611248
- Cited by
- 9
- References
- 22
- Citations by year
- 2026: 8 · 2025: 1
- FWCI
- 2.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Speech-Language Pathology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- large language models, medical writing, AI tool comparison, prompt specificity, children with speech and language disorders, clinical decision support
- MeSH terms
- Large Language Models, Artificial Intelligence, Child Language, Child, Preschool, Female, Humans, Language Disorders, Male, Speech Disorders, Speech-Language Pathology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Clinical Application of Large Language Models for Intervention Plan Development in Speech-Language Pathology. https://app.cochat.ai/papers/10.1044/2025_ajslp-24-00464
- The paper
- Kim, N., Homer, M., & Jang, H. (2025). Clinical Application of Large Language Models for Intervention Plan Development in Speech-Language Pathology. American Journal of Speech-Language Pathology. https://doi.org/10.1044/2025_ajslp-24-00464
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.