The Use of Large Language Models to Generate Education Materials about Uveitis
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To assess large language models in generating readable uveitis information and in improving the readability of online health information. DESIGN: Evaluation of technology. SUBJECTS: Not applicable. METHODS: ChatGPT and Bard were asked the following prompts: (prompt A) "considering that the average American reads at a 6th grade level, using the Flesch-Kincaid Grade Level (FKGL) formula, can you write patient-targeted health information on uveitis of around 6th grade level?" and (prompt B) "can you write patient-targeted health information on uveitis that is easy to understand by an average American?" Additionally, ChatGPT and Bard were asked the following prompt from the first-page results of Google when the term "uveitis" was searched: "Considering that the average American reads at a 6th grade level, using the FKGL formula, can you rewrite the following text to 6th grade level: [insert text]." The readability of each response was analyzed and compared using several metrics described below. MAIN OUTCOME MEASURES: The FKGL is a highly validated readability assessment tool that assigns a grade level to a given text, the total number of words, sentences, syllables, and complex words. Complex words were defined as those with > 2 syllables. RESULTS: ChatGPT and Bard generated responses with lower FKGL scores (i.e., easier to understand) in response to prompt A compared with prompt B. This was only significant for ChatGPT (P < 0.0001). The mean FKGL of responses to ChatGPT (6.3 ± 1.2) was significantly lower (P < 0.0001) than Bard 10.5 ± 0.8. ChatGPT responses also contained less complex words than Bard (P < 0.0001). Online health information on uveitis had a mean grade level of 11.0 ± 1.4. ChatGPT lowered the FKGL to 8.0 ± 1.0 (P < 0.0001) when asked to rewrite the content. Bard was not able to do so (mean FKGL of 11.1 ± 1.6). CONCLUSIONS: ChatGPT can aid clinicians in producing easier-to-understand health information on uveitis for patients compared with already-existing content. It can also help with reducing the difficulty of the language used for uveitis health information targeted for patients. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Health literacy in Europe: Comparative results of the european health literacy survey (HLS-EU)
Sørensen, K., Pelikan, J. M., Röthlin, F., Ganahl, K., Slonska, Z., Doyle, G., Fullam, J., Kondilis, B., Agrafiotis, D., Uiters, E., et al. (2015) · The European Journal of Public Health · doi:10.1093/eurpub/ckv043 · Cited by 2,651
Literacy and health outcomes: A systematic review of the literature
DeWalt, D. A., Berkman, N. D., Sheridan, S., Lohr, K. N., & Pignone, M. P. (2004) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2004.40153.x · Cited by 2,309
Health literacy and adherence to medical treatment in chronic and acute illness: A meta-analysis
Miller, T. A. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2016.01.020 · Cited by 662
Nakayama, K., Osaka, W., Togari, T., Ishikawa, H., Yonekura, Y., Sekido, A., & Matsumoto, M. (2015) · BMC Public Health · doi:10.1186/s12889-015-1835-x · Cited by 338
Johnson, S. B., King, A. J., Warner, E. L., Aneja, S., Kann, B. H., & Bylund, C. L. (2023) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkad015 · Cited by 289
Ghosh, A., & Bir, A. (2023) · Cureus · doi:10.7759/cureus.37023 · Cited by 67
Cited by
Current applications and challenges in large language models for patient care: a systematic review
Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-024-00717-2 · Cited by 358
Large language models for structured reporting in radiology: past, present, and future
Busch, F., Hoffmann, L., dos Santos, D. P., Makowski, M. R., Saba, L., Prucker, P., Hadamitzky, M., Navab, N., Kather, J. N., Truhn, D., et al. (2024) · European Radiology · doi:10.1007/s00330-024-11107-6 · Cited by 134
“5 ’ s responses on uveitis being signi fi cantly above the recommended 6th-grade level for patient education materials [49].”
A large language model digital patient system enhances ophthalmology history taking skills
Luo, M.-J., Bi, S., Pang, J., Liu, L., Tsui, C.-K., Lai, Y., Chen, W., Yang, Y., Xu, K., Zhao, L., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01841-6 · Cited by 39
“…a literature search, we found that LLM applications in medicine such as answering medical examination questions 25,26 , providing diagnostic and treatment recommendations 27,28 , summarizing clinical research articles 29 , and generating patient education materials 30 are beingincreasinglyexplored.”
A closer look at ChatGPT's role in concept map generation for education
Schicchi, D., Limongelli, C., Monteleone, V., & Taibi, D. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2025.2497110 · Cited by 11
“LLMs can generate educational material such as summaries, quizzes, and assignments, which can significantly reduce the involvement of teachers in creating such content (Kianian et al., 2023).”
Metadata
- Authors
- Kianian, R., Sun, D., Crowell, E. L., & Tsui, E.
- Venue
- Ophthalmology Retina
- Publisher
- Elsevier BV
- Published
- 2024-02
- Volume
- 8
- Issue
- 2
- Pages
- 195-201
- ISSN
- 2468-6530 (ISSN-L)
- OpenAlex
- W4386776401
- Cited by
- 83
- References
- 7
- FWCI
- 2.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.