Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index; 1 of the 6 sources its claims cite were checked for support.
Abstract
Data about the quality of cancer information that chatbots and other artificial intelligence systems provide are limited. Here, we evaluate the accuracy of cancer information on ChatGPT compared with the National Cancer Institute’s (NCI’s) answers by using the questions on the “Common Cancer Myths and Misconceptions” web page. The NCI’s answers and ChatGPT answers to each question were blinded, and then evaluated for accuracy (accurate: yes vs no). Ratings were evaluated independently for each question, and then compared between the blinded NCI and ChatGPT answers. Additionally, word count and Flesch-Kincaid readability grade level for each individual response were evaluated. Following expert review, the percentage of overall agreement for accuracy was 100% for NCI answers and 96.9% for ChatGPT outputs for questions 1 through 13 (ĸ = ‒0.03, standard error = 0.08). There were few noticeable differences in the number of words or the readability of the answers from NCI or ChatGPT. Overall, the results suggest that ChatGPT provides accurate information about common cancer myths and misconceptions.
Overview
CoChat Summary
TL;DR
This brief report evaluated whether ChatGPT provides accurate answers to 13 common cancer myths and misconceptions compared with National Cancer Institute (NCI) answers. Expert reviewers found ChatGPT outputs largely accurate and similar to NCI answers, though with some hedging/uncertainty noted.
Key findings
- NCI answers were rated accurate by 5 of 5 reviewers for 13 of 13 questions, giving 100% interrater agreement.
- ChatGPT outputs were rated accurate by 5 of 5 reviewers for 11 of 13 questions, with 96.9% overall agreement; the remaining 2 questions were rated accurate by 4 of 5 reviewers (Fleiss ĸ = ‒0.03, SE = 0.08, P = .6).
- There were few noticeable differences in word count or Flesch-Kincaid readability between NCI and ChatGPT answers, though both were written at a less readable level than health literacy advocates would likely recommend.
- Five repeated runs for each of the 13 questions showed subtle sentence-structure changes but consistent answers, suggesting accuracy remained stable with repetitive questioning.
Methods
- On December 20, 2022, the authors asked ChatGPT (December 15, 2022, version) the 13 questions from the NCI “Common Cancer Myths and Misconceptions” web page.
- NCI and ChatGPT answers were blinded and independently rated for accuracy (yes vs no) by 5 scientific reviewers with expertise in cancer treatment and cancer misinformation between December 20, 2022, and January 3, 2023.
- Interrater agreement was assessed with Fleiss ĸ; word count and Flesch-Kincaid grade level were evaluated for each response, and analyses used Stata version 17.
Limitations
- The paper states that it evaluated only common cancer misinformation in English, so more obscure myths may have incomplete or English-only information and may not be answered accurately.
- The paper states that ChatGPT outputs may be trained on models that could be scientifically outdated, and ChatGPT was limited to data collected before 2021, so accuracy may be delayed as new scientific information emerges.
- Evident from the text: this was a small-scale study of 13 questions using one ChatGPT version at one time point; the authors did not code for specific message features, though multiple observers perceived hedging and uncertainty in ChatGPT messages.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 0 Not valid · 5 Not checked · 17 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were few noticeable differences in the number of words or the readability of the answers from NCI or ChatGPT.”
- Also stated in: § Abstract · plain
“There were few noticeable differences in the number of words or the readability of the answers from NCI or ChatGPT.”
§ Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Abstract · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The remaining 2 questions (question 5, “Does my attitude—positive or negative—determine my risk of getting or surviving cancer?” and question 9, “Do power lines cause cancer?”) were rated as accurate by 4 of 5 reviewers, with a single unique reviewer rating each question as inaccurate (ĸ = ‒0.03, SE = 0.08, P = .6).”
§ Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we completed 5 runs repeatedly from the same input for each of the 13 questions (Supplementary Table 1, available online). On review, although subtle sentence structure changes were noted, the answers remained consistent”
§ Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Answers from both sources were written at a less readable rate than would likely be recommended by health literacy advocates, for example.”
§ Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information > Abstract
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“suggesting that answers remain accurate with repetitive questioning.”
§ Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information > Abstract
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
3 more claims
Create a free account to see all 23 claims and to verify the 5 references still open.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 5
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“it was observed that ChatGPT responses were relevant and had a high level of accuracy, similar to the responses of the National Cancer Institute [32].”
From Is there any room for ChatGPT AI bot in speech-language pathology? (2025) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“ChatGPT was shown to exhibit good performance at answering questions about cancer myths and misconceptions (159).”
From Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions (2024) · cites this paper as [159]
Citations
Cites
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · cited 1×
“Interrater agreement was evaluated by Fleiss Œ (5).”
MethodDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“There is concern that algorithms reinforce current health disparities and inequities (9), although the extent to which this is true about health information specifically is currently unknown.”
BackgroundChatbots in the fight against the COVID-19 pandemic
Miner, A. S., Laranjo, L., & Kocaballi, A. B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0280-0 · Cited by 322 · cited 1×
“spaces (3); recently, 1 such AI system receiving a lot of public and”
BackgroundAn Initial Model of Trust in Chatbots for Customer Service—Findings from a Questionnaire Study
Nordheim, C. B., Følstad, A., & Bjørkli, C. A. (2019) · Interacting with Computers · doi:10.1093/iwc/iwz022 · Cited by 233 · cited 1×
“Other practical considerations about how people will interpret AI-generated chat responses in terms of trust and credibility (10) exist, particularly as they relate to medical and health information, behaviors, and services compared with consumer products, behaviors, and services.”
BackgroundCancer misinformation and harmful information on Facebook and other social media: a brief report
Johnson, S. B., Parsons, M., Dorff, T., Moran, M. S., Ward, J. H., Cohen, S. A., Akerley, W., Bauman, J., Hubbard, J., Spratt, D. E., et al. (2022) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djab141 · Cited by 210 · cited 1×
“JNCI Cancer Spectrum, 2023, 7(2), pkad015”
Self-citationCalixte, R., Rivera, A., Oridota, O., Beauchamp, W., & Camacho-Rivera, M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17186856 · Cited by 112 · cited 1×
“Patients are increasingly turning to the internet for information about cancer, with 80% of US adults reportedly using the internet to seek health information (1).”
Background
Research works printed but not linked: 1
- Hundt A, Agnew W, Zeng V, Kacianka S, Gombolay M. Robots enact malignant stereotypes. FACCT’22: 2022 ACM Conference on Fairness, Accountability, and Transparency. 2022; 743- 756.
Cited by
Items 101–200 of 289
Jo, M. H., Kim, M.-J., Oh, H.-K., Choi, M. J., Shin, H.-R., Lee, T.-G., Ahn, H.-M., Kim, D.-W., & Kang, S.-B. (2024) · International Journal of Colorectal Disease · doi:10.1007/s00384-024-04670-3 · Cited by 17
Varady, N. H., Lu, A. Z., Mazzucco, M. R., Dines, J. S., Altchek, D. W., Williams, R. J., & Kunze, K. N. (2024) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671241257516 · Cited by 20
Sawamura, S., Bito, T., Ando, T., Masuda, K., Kameyama, S., & Ishida, H. (2024) · Journal of Physical Therapy Science · doi:10.1589/jpts.36.234 · Cited by 23
“Further, Johnson et al. 16) reported that ChatGPT can provide accurate information on common cancer myths and misconceptions; similarly, the system can generate correct answers to questions requiring higher-order thinking in medical biochemistry 34) and can provide factually accurate, contextually…”
BackgroundChatbot Performance in Defining and Differentiating Palliative Care, Supportive Care, Hospice Care
Kim, M. J., Admane, S., Chang, Y. K., Shih, K. K., Reddy, A. S., Tang, M. J., de la Cruz, M., Taylor, T. P., Bruera, E. D., & Hui, D. (2024) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2024.01.008 · Cited by 19
ChatGPT in Oncology Diagnosis and Treatment: Applications, Legal and Ethical Challenges
Zhou, Z., Qin, P., Cheng, X., Shao, M., Ren, Z., Zhao, Y., Li, Q., & Liu, L. (2025) · Current Oncology Reports · doi:10.1007/s11912-025-01649-3 · Cited by 18
“ChatGPT surpasses competing AI technologies in accuracy, readability, and the emulation of human-like care, showing great potential in assisting doctors with diagnoses and treatments [3, 4].”
ChatGPT in Dermatology: A Comprehensive Systematic ReviewPreprint
Gabashvili, I. S. (2023) · medRxiv · doi:10.1101/2023.06.11.23291252 · Cited by 17
“The performance of large language models (LLMs) varied depending on the medical question being asked, with the best results observed in skin cancer-related topics [19], while specialized dermatology topics like eczema posed challenges, especially when”
BackgroundGroße Sprachmodelle wie ChatGPT und GPT-4 für eine patientenzentrierte Radiologie
Fink, M. A. (2023) · Die Radiologie · doi:10.1007/s00117-023-01187-8 · Cited by 19
Xiaoqing: A Q&A model for glaucoma based on LLMs
Xue, X., Zhang, D., Sun, C., Shi, Y., Wang, R., Tan, T., Gao, P., Fan, S., Zhai, G., Hu, M., et al. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108399 · Cited by 27
Park, K. U., Lipsitz, S. R., Dominici, L. S., Lynce, F. C., Minami, C. A., Nakhlis, F., Waks, A. G., Warren, L. E., Eidman, N., Frazier, J., et al. (2024) · Cancer · doi:10.1002/cncr.35521 · Cited by 20
“19 Although prompts to ChatGPT can be modified to explicitly request responses at a specific reading level, our study indicated that the prompt of “I am a patient.”
Quantitative evaluation of ChatGPT versus Bard responses to anaesthesia-related queries
Patnaik, S. S., & Hoffmann, U. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.09.030 · Cited by 26
Haupt, M. R., Chiu, M., Chang, J., Li, Z., Cuomo, R. E., & Mackey, T. K. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295414 · Cited by 20
AI-Generated Content in Cancer Symptom Management: A Comparative Analysis Between ChatGPT and NCCN
Lazris, D., Schenker, Y., & Thomas, T. H. (2024) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2024.06.019 · Cited by 17
Ishida, K., & Hanada, E. (2024) · Cureus · doi:10.7759/cureus.66324 · Cited by 18
Cohen, N. D., Ho, M., McIntire, D., Smith, K., & Kho, K. A. (2024) · AJOG Global Reports · doi:10.1016/j.xagr.2024.100405 · Cited by 18
Zeng, J., Zou, X., Li, S., Tang, Y., Teng, S., Li, H., Wang, C., Wu, Y., Zhang, L., Zhong, Y., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/51095 · Cited by 17
Role of chatbots on gastroenterology: Let's chat about the future
Li, L. (2023) · Gastroenterology & Endoscopy · doi:10.1016/j.gande.2023.06.002 · Cited by 17
Chen, R., Zhang, S., Zheng, Y., Yu, Q., & Wang, C. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1599241 · Cited by 16
The accuracy of AI-assisted chatbots on the annual assessment test for emergency medicine residents
Arslan, B., Eyüpoğlu, G., Korkut, S., Türkdoğan, K. A., & Altınbilek, E. (2024) · Journal of Medicine Surgery and Public Health · doi:10.1016/j.glmedi.2024.100070 · Cited by 18
Liao, C.-Y., Chu, C.-N., Lien, M.-Y., Wu, Y., & Wang, T. (2024) · Current Oncology · doi:10.3390/curroncol32010007 · Cited by 16
“…ChatGPT-4 can assist in patient education for cancer patients, analysis of next-generation genetic data in cancer (NGS) [2], care recommendations for patients with hepatitis and cirrhosis [11], clarifying common cancer myths [12,13], and answering health-related questions on social media [3].”
The Impact of Generative Artificial Intelligence on Socioeconomic Inequalities and Policy MakingPreprint
Capraro, V., Lentsch, A., Acemoğlu, D., Akgün, S., Akhmedova, A., Bilancini, E., Bonnefon, J., Brañas‐Garza, P., Butera, L., Douglas, K. M., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4666103 · Cited by 18
Self-citationIs there any room for ChatGPT AI bot in speech-language pathology?
Birol, N. Y., Çiftci, H. B., Yılmaz, A., Çağlayan, A., & Alkan, F. (2025) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-025-09295-y · Cited by 12
“…examining Chat-GPT responses to cancer myths, which can be considered similar to the task of creating relevant educational material in our study, it was observed that ChatGPT responses were relevant and had a high level of accuracy, similar to the responses of the National Cancer Institute [32].”
Haupt, M. R., Yang, L., Purnat, T. D., & Mackey, T. K. (2024) · JMIR Infodemiology · doi:10.2196/60678 · Cited by 24
“Recent studies show that LLMs are effective at providing factual responses to clinical questions [14] and can correctly identify health-related misperceptions and misinformation [4,5,15].”
BackgroundInfluentialÇoban, E., & Altay, B. (2024) · Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.joms.2024.03.001 · Cited by 13
Manian, F. A., Garland, K., & Ding, J. (2024) · Southern Medical Journal · doi:10.14423/smj.0000000000001715 · Cited by 12
Artificial intelligence methods available for cancer research
Murmu, A., & Győrffy, B. (2024) · Frontiers of Medicine · doi:10.1007/s11684-024-1085-3 · Cited by 18
Analysis of Responses of GPT-4 V to the Japanese National Clinical Engineer Licensing Examination
Ishida, K., Arisaka, N., & Fujii, K. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02103-w · Cited by 13
Large language models for improving cancer diagnosis and management in primary health care settings
Andrew, A., & Tizzard, E. (2024) · Journal of Medicine Surgery and Public Health · doi:10.1016/j.glmedi.2024.100157 · Cited by 13
ChatGPT in Head and Neck Oncology-Opportunities and Challenges
Sarma, G., Kashyap, H., & Medhi, P. P. (2023) · Indian Journal of Otolaryngology and Head & Neck Surgery · doi:10.1007/s12070-023-04201-6 · Cited by 15
“…the potential of artificial intelligence chatbots to access cancer patients’ information [18], generate accurate information about cancer myths and misconceptions [19], identify guideline-based treatments for advanced solid tumours indicating a level of concordance with the NCCN guidelines [20].”
Alessi, M. R., Gomes, H. A., de Castro, M. L., & Okamoto, C. T. (2024) · Cureus · doi:10.7759/cureus.64924 · Cited by 20
“The accuracy in answering medical questions in the study was high and superior to the students, reinforcing how powerful this tool is, given that it is not connected to the internet to obtain information, as its last data source update was in 2021 [7-10].”
BackgroundOliveira, A. L., Coelho, M. M., Guedes, L. C., Cattoni, M. B., Carvalho, H., & Duarte-Batista, P. (2024) · Neurological Sciences · doi:10.1007/s10072-024-07732-0 · Cited by 11
Adaptive Treatment of Metastatic Prostate Cancer Using Generative Artificial Intelligence
Derbal, Y. (2025) · Clinical Medicine Insights Oncology · doi:10.1177/11795549241311408 · Cited by 12
Owens, O. L., & Leonard, M. (2025) · American Journal of Health Promotion · doi:10.1177/08901171251316371 · Cited by 9
Yucel, K. B., Sütçüoğlu, O., Yazıcı, O., Özet, A., & Özdemir, N. (2024) · memo - Magazine of European Medical Oncology · doi:10.1007/s12254-023-00954-6 · Cited by 16
“Although it is believed that newly developed artificial intelligence (AI) systems can produce content of a higher quality than social media, data on these systems, particularly about cancer support treatments, are extremely limited [11, 15].”
ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls
Maniyar, N., Sarode, G. S., Sarode, S. C., & Thakkar, S. (2024) · Oral Oncology Reports · doi:10.1016/j.oor.2024.100280 · Cited by 10
Comparison of ChatGPT vs. Bard to Anesthesia-related QueriesPreprint
Patnaik, S. S., & Hoffmann, U. (2023) · medRxiv · doi:10.1101/2023.06.29.23292057 · Cited by 10
“We have compared readability [16, 19-22], linguistic [23-26], and text-based analytical [13] differences between the two popular generative AI interfaces – ChatGPT and Bard.”
MethodResultInfluentialMeasuring the Effectiveness of AI Tools in Clinical Research and Writing: A Case Study in Healthcare
Salisu, S., Alyasiri, O. M., Younis, H. A., Sahib, T. M., Ali, A. H., Noor, A. A., & Hayder, I. M. (2024) · Mesopotamian Journal of Artificial Intelligence in Healthcare · doi:10.58496/mjaih/2024/002 · Cited by 15
“While the utilization of Natural Language Processing (NLP) in healthcare research is not new [36–39], the recent introduction of ChatGPT has generated substantial interest in the AI community.”
BackgroundChatGPT as an Information Source for Patients with Migraines: A Qualitative Case Study
Schütz, P., Lob, S., Chahed, H., Dathe, L., Löwer, M., Reiß, H., Weigel, A., Albrecht, J., Tokgöz, P., & Dockweiler, C. (2024) · Healthcare · doi:10.3390/healthcare12161594 · Cited by 11
Matsuoka, M., Onodera, T., Fukuda, R., Iwasaki, K., Hamasaki, M., Ebata, T., Hosokawa, Y., Kondo, E., & Iwasaki, N. (2024) · Journal of Surgical Oncology · doi:10.1002/jso.27874 · Cited by 8
Faiyazuddin, M., Gholap, A. D., Maqsood, S., Abbas, S., Chaudhari, Y. S., Sharmila, S., & Webster, T. J. (2024) · Journal of Biomedical Nanotechnology · doi:10.1166/jbn.2024.3925 · Cited by 15
Zhou, X., Chen, Y., Abdulghani, E. A., Zhang, X., Zheng, W., & Li, Y. (2025) · Journal of the World Federation of Orthodontists · doi:10.1016/j.ejwf.2025.02.001 · Cited by 17
Esmaeilzadeh, P. (2025) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzaf134 · Cited by 11
Yıldız, M. S., & Alper, A. (2023) · Journal of Consumer Health on the Internet · doi:10.1080/15398285.2023.2240652 · Cited by 9
The Use of Chatbots in Head and Neck Mucosal Malignancy Treatment Recommendations
Washington, C. J., Abouyared, M., Karanth, S. D., Braithwaite, D., Birkeland, A. C., Silverman, D. A., & Chen, S. (2024) · Otolaryngology · doi:10.1002/ohn.818 · Cited by 10
Fact Check: Assessing the Response of ChatGPT to Alzheimer's Disease Myths
Huang, S. S., Song, Q., Beiting, K. J., Duggan, M. C., Hines, K., Murff, H., Leung, V., Powers, J., Harvey, T. S., Malin, B., et al. (2024) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2024.105178 · Cited by 9
Huang, S. S., Song, Q., Beiting, K. J., Duggan, M. C., Hines, K., Murff, H. J., Leung, V., Powers, J. S., Harvey, T. S., Malin, B., et al. (2023) · medRxiv · doi:10.1101/2023.09.04.23294917 · Cited by 9
Gökbulut, P., Kuşkonmaz, Ş. M., Önder, Ç. E., Taşkaldıran, I., & Koç, G. (2024) · SiSli Etfal Hastanesi Tip Bulteni / The Medical Bulletin of Sisli Hospital · doi:10.14744/semb.2024.23697 · Cited by 13
“[29] It may also tend to repeat expressions from previous interactions.”
How good does ChatGPT answer frequently asked questions about haemophilia?
de Wyngaert, C. V., Iarossi, M., & Hermans, C. R. J. R. (2023) · Haemophilia · doi:10.1111/hae.14858 · Cited by 13
Performance of ChatGPT in providing patient information about upper tract urothelial carcinoma
Łaszkiewicz, J., Krajewski, W. R., Tomczak, W. A., Chorbińska, J., Nowak, Ł., Chełmoński, A., Krajewski, P. K., Sójka, A., Małkiewicz, B., & Szydełko, T. (2024) · Współczesna Onkologia · doi:10.5114/wo.2024.141567 · Cited by 7
“Moreover, AI was accurate in 96.9% of the inquiries about common cancer myths and misconceptions [16].”
BackgroundInfluentialChatGPT in medical literature – a concise review and SWOT analysisPreprint
Gödde, D., Nöhl, S., Wolf, C., Rupert, Y., Rimkus, L., Ehlers, J. P., Breuckmann, F., & Sellmann, T. (2023) · medRxiv · doi:10.1101/2023.05.06.23289608 · Cited by 8
“Interestingly, however, a publication speed, if ascertainable, of 16 days (4-83) was significantly faster than described in other studies on biomedical journals.”
ResultGoogle Trends Analysis of Peripheral Nerve Disease and Surgery
Orlando, N., Qiu, C. S., ElNemer, W. G., & TUFFAHA, S. H. (2023) · World Neurosurgery · doi:10.1016/j.wneu.2023.09.006 · Cited by 7
Beyoğlu, M. M., Kaya, E., & Karabulut, E. (2024) · Universal Access in the Information Society · doi:10.1007/s10209-024-01155-6 · Cited by 11
“However, they found both Chat GPT and NCI answers were less readable than would likely be recommended by health literacy advocates [32].”
Karami, A., Qiao, Z., Zhang, X., Kharrazi, H. H. K., Bozorgi, P., & Bozorgi, A. (2024) · Big Data and Cognitive Computing · doi:10.3390/bdcc8100130 · Cited by 10
Observed Correction: How We Can All Respond to Misinformation on Social Media
Bode, L., & Vraga, E. K. (2025) · doi:10.1093/oso/9780197565896.001.0001 · Cited by 10
Health Misinformation Detection: Approaches, Challenges and Opportunities
Feng, X., Luo, J., Yang, Y., Baz, D. E., & Shi, L. (2025) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/00469580251384784 · Cited by 22
“185,186 However, the rise of publicly accessible AI chatbots, capable of generating large volumes of persuasive human-like text, may accelerate misinformation spread, leading to an “AI-driven infodemic.””
Torun, C., Sarmış, A., & Oğuz, A. (2024) · Medeniyet Medical Journal · doi:10.4274/mmj.galenos.2024.03154 · Cited by 17
“In Johnson et al. 20 , ChatGPT provided 96.9% correct answers to frequently asked questions about cancer myths and misconceptions.”
BackgroundInfluentialSilva, R. R., de Lima, B. E., José, G., Cordeiro, D. F., Viana, R. B., Andrade, M. S., Vancini, R. L., Rosemann, T. J., Weiss, K., Knechtle, B., et al. (2024) · Epilepsy & Behavior Reports · doi:10.1016/j.ebr.2024.100692 · Cited by 9
“This includes their adoption by medical students [5], the provision of information on ambulatory practices [6], and addressing myths and misconceptions about cancer [7], cancer in specific regions such as the neck [8], and spinal surgery [6].”
BackgroundAdvancements of AI in healthcare: a comprehensive review of ChatGPT’s applications and challenges
Ali, S., Aslam, A., Tahir, Z., Ashraf, B., & Tanweer, A. (2024) · Journal of the Pakistan Medical Association · doi:10.47391/jpma.11173 · Cited by 9
The future of oral cancer care: Integrating ChatGPT into clinical practice
Ahmed, S. K. (2024) · Oral Oncology Reports · doi:10.1016/j.oor.2024.100317 · Cited by 7
Guirguis, P. G., Youssef, M. P., Punreddy, A., Botros, M., Raiford, M. E., & McDowell, S. (2024) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000003263 · Cited by 10
Lone, M. R., Sohail, S. S., Rahman, A., & Najar, A. A. (2024) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-024-09062-5 · Cited by 7
Patel, V. R., Liu, M., Snyder, R. A., Loehrer, A. P., & Haynes, A. B. (2024) · Annals of Surgery · doi:10.1097/sla.0000000000006516 · Cited by 8
“42,43 These misbeliefs have recently been targeted by culturally sensitive physician training and outreach programs that aim to promote trust in the health care system and bridge divides stemming from historical disenfranchisement.”
Are artificial intelligence based chatbots reliable sources for patients regarding orthodontics?
Özkan, T. H., Acar, A. H., Özkan, E., Düzyol, M., & Öztürk, E. A. (2025) · APOS Trends in Orthodontics · doi:10.25259/apos_203_2024 · Cited by 8
Chuang, W.-K., Kao, Y., Liu, Y., & Lee, C.-Y. (2025) · Practical Radiation Oncology · doi:10.1016/j.prro.2025.04.009 · Cited by 6
Liu, H., Peng, J., Li, L., Deng, A., Huang, X., Yin, G., & Luo, H. (2025) · JMIR Medical Informatics · doi:10.2196/66429 · Cited by 8
“Studies have shown that ChatGPT has greater potential for patient education in breast reconstruction and diabetes self-management, while also being able to accurately answer some cancer-related questions [11,13,14].”
Salem, M., Karasan, D., Revilla‐León, M., Barmak, A. B., & Sailer, I. (2025) · Journal of Esthetic and Restorative Dentistry · doi:10.1111/jerd.13496 · Cited by 6
FAMILY CAREGIVERS IN CANCER: EXPERIENCES, CAPACITIES, AND SOLUTIONS
Eghtedar, S., Almasi, L., Jasemi, M., Aparnak, F.-S., & Habibzadeh, H. (2023) · Nursing and Midwifery Journal · doi:10.61186/unmf.21.3.195 · Cited by 8
Trials and Tribulations: Responses of ChatGPT to Patient Questions About Kidney Transplantation
Xu, J., Mankowski, M. A., Vanterpool, K. B., Strauss, A. T., Lonze, B. E., Orandi, B. J., Stewart, D. E., Bae, S., Ali, N. M., Stern, J. M., et al. (2024) · Transplantation · doi:10.1097/tp.0000000000005261 · Cited by 5
Provoking critical thinking: Using counter-arguments in online discussion summarisation
Li, S., Han, L., & Demartini, G. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104258 · Cited by 9
Alotaibi, S. S., Rehman, A., & Hasnain, M. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1338215 · Cited by 8
“ChatGPT shows limitations to answer the queries on the updated information (57).”
BackgroundArtificial intelligence generates proficient Spanish obstetrics and gynecology counseling templates
Solmonovich, R. L., Kouba, I., Quezada, O., Rodríguez-Ayala, G., Rojas, V., Bonilla, K., Espino, K., & Bracero, L. A. (2024) · AJOG Global Reports · doi:10.1016/j.xagr.2024.100400 · Cited by 6
Lukac, S., Griewing, S., Leinert, E., Dayan, D., Heitmeir, B., Wallwiener, M., Janni, W., Fink, V., & Ebner, F. K. (2024) · Clinics and Practice · doi:10.3390/clinpract15010008 · Cited by 7
“Other studies confirmed that ChatGPT provides the correct basic information on the requested drug and also correctly clarifies common cancer myths [32,33].”
Utilization of ChatGPT for Rhinology Patient Education: Limitations in a Surgical Sub‐Specialty
Huang, A. E., Chang, M. T., Khanwalkar, A. R., Yan, C. H., Phillips, K. M., Yong, M., Nayak, J. V., Hwang, P. H., & Patel, Z. M. (2025) · OTO Open · doi:10.1002/oto2.70065 · Cited by 5
“9 Anecdotally, common calls to on ‐ call otolaryngology residents or providers often center around postoperative symptoms in the form of binary questions (eg, “ Is this symptom expected?”
Moya‐Salazar, J., Salazar, C. R., Delzo, S. S., Goicochea‐Palomino, E. A., & Rojas-Zumarán, V. (2024) · Electronic Journal of General Medicine · doi:10.29333/ejgm/14354 · Cited by 7
Safrai, M., & Azaria, A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302217 · Cited by 9
“5 was able to provide general medical information on common retinal disease [15], in almost every subject in genecology [16] and in cancer subjects [17].”
Mullis, M. D., Fisher, C. L., Johnson, S. B., Liu, T., Amin, T. B., Rogers, S. C., DeGruccio, K., & Bylund, C. L. (2024) · PEC Innovation · doi:10.1016/j.pecinn.2024.100319 · Cited by 5
“The script contained three questions about cancer treatment that were informed by common myths and misperceptions about cancer [25,26].”
BackgroundSelf-citationCan ChatGPT provide quality information about fever in children?
Özdemir, E., & İpekten, F. (2024) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.16710 · Cited by 9
Alharbi, F., & Asiri, S. N. (2024) · Applied Sciences · doi:10.3390/app142210323 · Cited by 5
Letter to the Editor: ChatGPT's contribution to cancer study
Faraji, N., Aali, S., Motiei, M., & Mansouri, S. S. (2023) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-023-05183-2 · Cited by 5
“Overall, ChatGPT stands poised to play a significant role in the future of medical oncology, working synergistically with healthcare professionals and deepening our understanding of cancer (Johnson et al. 2023).”
Student perceptions of artificial intelligence in Doctor of Physical Therapy Education
Reoli, R., Marchese, V. G., Duggal, A., & Kaplan, K. B. (2025) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2025.2496978 · Cited by 4
“These technologies now enable rapid, precise identification of complex medical conditions like cancer and neurological disorders (Cascella, Montomoli, Bellini, and Bignami, 2023; Johnson et al, 2023; Kafai, 2005).”
Automated standardization of bridge inspection data using generative AI
Omar, A., & Moselhi, O. (2025) · Engineering Structures · doi:10.1016/j.engstruct.2025.121904 · Cited by 5
Müller, Y., Lemberg, H., Gellert, P. R., & Zoellick, J. C. (2026) · JMIR Medical Education · doi:10.2196/88092 · Cited by 6
“AI chatbots potentially reduce conspiracy beliefs [16] and climate change skepticism [17], provide correct medical information with high accuracy [18-20], and increase efficiency in administrative processes, such as discharging patients [21], writing medical reports [22,23], or analyzing medical…”
A Conversation with ChatGPT on Contentious Issues in Senescence and Cancer Research
Elshazly, A. M., Shahin, U., Shboul, S. A., Gewirtz, D. A., & Saleh, T. (2024) · Molecular Pharmacology · doi:10.1124/molpharm.124.000871 · Cited by 4
ChatGPT vs. Gemini: Which Provides Better Information on Bladder Cancer?
Alasker, A., Alshathri, N. N., Alsalamah, S., Almansour, N., Alsalamah, F., Alghafees, M. A., Alkhamees, M. A., & Alsaikhan, B. H. (2025) · Société Internationale d’Urologie Journal · doi:10.3390/siuj6020034 · Cited by 6
“This new era has raised both hopes for the future applications of these tools in health-care as well as concerns about their current quality and accuracy of responses that deliver critical medical information, especially when it comes to cancer [9,14].”
The Genie Is Out of the Bottle: What ChatGPT Can and Cannot Do for Medical Professionals
Morales-Ramirez, P., Mishek, H., & Dasgupta, A. (2023) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000005446 · Cited by 4
Alanzi, T. M., Alzahrani, W., Albalawi, N. S., Allahyani, T., Alghamdi, A., Al-Zahrani, ., Almutairi, ., Alzahrani, H., Almulhem, L., Alanzi, N., et al. (2023) · Cureus · doi:10.7759/cureus.50781 · Cited by 4
Han, J. Y. (2024) · Obstetrics & Gynecology Science · doi:10.5468/ogs.24231 · Cited by 7
BiasAlert: Supporting Bias Identification in Search Queries
Mellatdoust, P., Fede, G. D., Alrabie, L., Cappiello, C., & Andolina, S. (2025) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3750069.3755952 · Cited by 4
“The myths were taken from official sources that we deemed reliable [1–4, 7, 14, 16, 19, 26, 28].”
Etli, D. (2024) · Journal of Quality in Health Care & Economics · doi:10.23880/jqhe-16000361 · Cited by 6
Yan, S., Liu, Y., Ma, L., Xiao, L., Hu, X., Guo, R. Z., You, C., & Tian, R. (2024) · Ibrain · doi:10.1002/ibra.12149 · Cited by 5
Evaluating the fidelity of AI-generated information on long-acting reversible contraceptive methods
Riley, G. F., Wang, E. Y., Flynn, C., Lopez, A., & Sridhar, A. (2025) · The European Journal of Contraception & Reproductive Health Care · doi:10.1080/13625187.2025.2450011 · Cited by 3
“…investigators have found that ChatGpt usually provides accurate answers to frequently-asked medical questions, with variable quality, comprehensiveness, and readability [4, 5]. to our knowledge, the accuracy and reliability of contra-ception information provided by ChatGpt has not been examined.”
Admane, S., Kim, M. J., Reddy, A. S., Tang, M., Chang, Y. K., Shih, K. K., de la Cruz, M., Cepeda, S. J., Bruera, E. D., & Hui, D. (2025) · Journal of Palliative Medicine · doi:10.1089/jpm.2024.0526 · Cited by 7
“18,22,23 The credibility of references was poor, consistent with recently published literature on chatbots.”
Bernstein, E., Ramsamooj, A., Millar, K. L., & Lum, Z. C. (2025) · JMIR AI · doi:10.2196/68603 · Cited by 4
“Potential weaknesses preventing current widespread adoption included lack of nuanced information that an experienced physician would understand and potential inaccuracies due to biased or outdated training data [12,13].”
Liao, L., Lai, I., & Chang, L. (2025) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.70108 · Cited by 3
Large Language model (LLM) in temporomandibular disorder education: a comparative study
Zincir, Ö. Ö., Hatipoğlu, Ş., & Özkan, E. Ç. (2025) · BMC Oral Health · doi:10.1186/s12903-025-07468-z · Cited by 5
“While some researchers have expressed skepticism regarding the reliability and clarity of AI-generated health content [31], others argue that these tools can deliver content of satisfactory quality and acceptable readability when applied judiciously [28, 30, 32, 33].”
Kaplan, S. T. (2025) · Oncology Research and Treatment · doi:10.1159/000545231 · Cited by 3
“Although some studies tried to analyze the potential of AI models, the present study stands apart from earlier research in its sheer scope and wide ingredients [1, 9, 13].”
InfluentialUnleashing the Power of OpenAI in Shaping the Future of Cancer Research
Abdullah, R. M., Masseh, H. D. I., Salihi, A. B., & Faraj, B. M. (2023) · BioMed Target Journal · doi:10.59786/bmtj.112 · Cited by 3
Casà, C., Corvari, B., Cellini, F., Cornacchione, P., D’Aviero, A., Reina, S., Franco, S. D., Salvati, A., Colloca, G. F., Cesario, A., et al. (2023) · Healthcare · doi:10.3390/healthcare11131950 · Cited by 3
“pathway and is also beginning to be used not only as an accessory capable of performing dedicated functions, but also as a potential substitute for processes currently the prerogative of human intelligence: for example, ChatGPT (Open AI, San Francisco, CA, USA) is considered fairly accurate in providing information re…”
BackgroundCan ChatGPT Provide Quality Information on Integrative Oncology? A Brief Report
Lam, C. S., Hua, R., Koon, H. K., Zhou, K. R., Lam, T. N., Lee, C. P., Lin, W. L., Wong, C. L., Lau, Y. M., Loong, H. H.-F., et al. (2023) · Journal of Integrative and Complementary Medicine · doi:10.1089/jicm.2023.0290 · Cited by 3
ChatGPT (GPT-4V) Performance on the Healthcare Information Technologist Examination in Japan
Ishida, K., & Hanada, E. (2025) · Cureus · doi:10.7759/cureus.76775 · Cited by 6
İnan, S. A., İnan, M., & Türkmen, O. (2025) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2025.102930 · Cited by 7
Metadata
- Authors
- Johnson, S. B., King, A. J., Warner, E. L., Aneja, S., Kann, B. H., & Bylund, C. L.
- Affiliations
- University of Utah (US)
- Yale University (US)
- Brigham and Women's Hospital (US)
- University of Florida Health (US)
- Corresponding author
- Johnson, Skyler B
- Venue
- JNCI Cancer Spectrum
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-03-01
- Volume
- 7
- Issue
- 2
- ISSN
- 2515-5091 (ISSN-L)
- PMC
- PMC10020140
- OpenAlex
- W4327681325
- Cited by
- 289
- References
- 6
- Citations by year
- 2026: 21 · 2025: 77 · 2024: 116 · 2023: 75
- FWCI
- 11.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- JNCI Cancer Spectrum (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Huntsman Cancer Institute
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Health › Social Media in Health Education
- Keywords
- ChatGPT, cancer myths, cancer misconceptions, artificial intelligence, chatbots, health information accuracy, National Cancer Institute, information quality, readability
- MeSH terms
- Artificial Intelligence, Humans, Neoplasms, United States, National Cancer Institute (U.S.)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.