CoChat

Generative Artificial Intelligence Through ChatGPT and Other Large Language Models in Ophthalmology

Open access
Tan, Ting Fang, Thirunavukarasu, Arun James, Campbell, J. Peter, Keane, Pearse A., Pasquale, Louis R., Abramoff, Michael D., Kalpathy-Cramer, Jayashree, Lum, Flora, Kim, Judy E., Baxter, Sally L., Ting, Daniel Shu Wei · 2023 · Ophthalmology Science
Cited by 116

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Abstract

The rapid progress of large language models (LLMs) driving generative artificial intelligence applications heralds the potential of opportunities in health care. We conducted a review up to April 2023 on Google Scholar, Embase, MEDLINE, and Scopus using the following terms: "large language models," "generative artificial intelligence," "ophthalmology," "ChatGPT," and "eye," based on relevance to this review. From a clinical viewpoint specific to ophthalmologists, we explore from the different stakeholders' perspectives-including patients, physicians, and policymakers-the potential LLM applications in education, research, and clinical domains specific to ophthalmology. We also highlight the foreseeable challenges of LLM implementation into clinical practice, including the concerns of accuracy, interpretability, perpetuating bias, and data security. As LLMs continue to mature, it is essential for stakeholders to jointly establish standards for best practices to safeguard patient safety. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.xops.2023.100394

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 43 references

Research works printed but not linked: 17

  1. Radford, 2018, Improving language understanding by generative pre-training, Comput Sci
  2. Radford, 2019, Language models are unsupervised multitask learners, Comput Sci, 1, 9
  3. Raimondi, 2023, Comparative analysis of large language models in the Royal College of Ophthalmologists fellowship exams, Eye, 10.1038/s41433-023-02563-3 · DOI · Paper page
  4. Lin, 2023, Comparison of GPT-3.5, GPT-4, and human user performance on a practice ophthalmology written examination, Eye, 10.1038/s41433-023-02564-2 · DOI
  5. Papanikolaou, 2020, DARE: data augmented relation extraction with GPT-2, arXiv preprint arXiv:2004.13845 · arXiv
  6. Chen, 2022, Applications of natural language processing in ophthalmology: present and future, Front Med (Lausanne), 9
  7. Thirunavukarasu, 2021, Evaluating the mainstream impact of ophthalmological research with Google Trends, Eye, 35, 3165, 10.1038/s41433-020-01257-4 · DOI
  8. Pitt, 2022, Providing a second opinion to Dr. Google with the WWW framework, J Gen Intern Med, 37, 222, 10.1007/s11606-021-06895-2 · DOI
  9. Kuehn, 2013, More than one-third of US individuals use the Internet to self-diagnose, JAMA, 309, 756, 10.1001/jama.2013.629 · DOI
  10. Korot, 2020, Will AI replace ophthalmologists?, Transl Vis Sci Technol, 9, 2, 10.1167/tvst.9.2.2 · DOI
  11. Yakar, 2022, Do people favor artificial intelligence over physicians? A survey among the general population and their view on artificial intelligence in medicine, Value Health, 25, 374, 10.1016/j.jval.2021.09.004 · DOI
  12. Chow, 2022, Patient-centred care in ophthalmology: current practices, effectiveness and challenges, Graefes Arch Clin Exp Ophthalmol, 260, 3149, 10.1007/s00417-022-05666-x · DOI
  13. Wang, 2022, Leveraging weak supervision to perform named entity recognition in electronic health records progress notes to identify the ophthalmology exam, Int J Med Inform, 167, 10.1016/j.ijmedinf.2022.104864 · DOI
  14. Mai, 2022, TSSNote-CyaPromBERT: development of an integrated platform for highly accurate promoter prediction and visualization of Synechococcus sp. and Synechocystis sp. through a state-of-the-art natural language processing model BERT, Front Genet, 13, 10.3389/fgene.2022.1067562 · DOI
  15. Shashikumar, 2021, Artificial intelligence sepsis prediction algorithm learns to say “I don't know”, NPJ Digit Med, 4, 134, 10.1038/s41746-021-00504-6 · DOI · Paper page
  16. Youssef, 2023, Is the algorithm good in a bad world, or has it learned to be bad? The ethical challenges of “locked” versus “continuously learning” artificial intelligence systems, and "Autonomous" Versus "Assistive" AI Tools in Healthcare, Am J Bioeth, 23, 43, 10.1080/15265161.2023.2191052 · DOI · Paper page
  17. Korot, 2021, Predicting sex from retinal fundus photographs using automated deep learning, Sci Rep, 11, 10.1038/s41598-021-89743-x · DOI

Cited by

See all 116

Metadata

Authors
Tan, T. F., Thirunavukarasu, A. J., Campbell, J. P., Keane, P. A., Pasquale, L. R., Abramoff, M. D., Kalpathy-Cramer, J., Lum, F., Kim, J. E., Baxter, S. L., & Ting, D. S. W.
Venue
Ophthalmology Science
Publisher
Elsevier BV
Published
2023-12
Volume
3
Issue
4
Pages
100394
ISSN
2666-9145 (ISSN-L)
OpenAlex
W4386572315
Cited by
116
References
43
FWCI
4.01
Type
journal article
Language
en
Open access
gold
Licence
Funders
  • National Medical Research Council (MOH-000655-00, MOH-001014-00, NMRC/HSRG/0087/2018)
  • Moorfields Eye Charity (R190028A)
  • Research to Prevent Blindness
  • Glaucoma Foundation
  • Genentech
  • National Institutes of Health
  • National Eye Institute

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Generative Artificial Intelligence Through ChatGPT and Other Large Language Models in Ophthalmology. https://app.cochat.ai/papers/10.1016/j.xops.2023.100394
The paper
Tan, T. F., Thirunavukarasu, A. J., Campbell, J. P., Keane, P. A., Pasquale, L. R., Abramoff, M. D., Kalpathy-Cramer, J., Lum, F., Kim, J. E., Baxter, S. L., & Ting, D. S. W. (2023). Generative Artificial Intelligence Through ChatGPT and Other Large Language Models in Ophthalmology. Ophthalmology Science. https://doi.org/10.1016/j.xops.2023.100394

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.