Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Introduction: Artificial intelligence (AI) is revolutionizing medical workflows, with self-learning systems like ChatGPT showing promise in therapy recommendations. Our study evaluated ChatGPT’s performance in suggesting treatments for 30 breast cancer cases. AI’s role in healthcare is expanding, particularly with tools like ChatGPT becoming accessible. However, understanding its limitations is vital for safe implementation. Material and Methods: We used 30 breast cancer cases from our medical board, assessing ChatGPT’s suggestions. The input was standardized, incorporating relevant patient details and treatment options. ChatGPT’s output was evaluated by oncologists based on a given questionnaire. Results: Treatment recommendations by ChatGPT were overall rated sufficient with minor limitations by the oncologists. The HER2 treatment category was the best-rated therapy option, with the most accurate recommendations. Primary cases received more accurate recommendations, especially regarding chemotherapy. Conclusions: While ChatGPT demonstrated potential, difficulties were shown in intricate cases and postoperative scenarios. Challenges arose in offering chronological treatment sequences and partially lacked precision. Refining inputs, addressing ethical intricacies, and ensuring chronological treatment suggestions are essential. Ongoing research is vital to improving AI’s accuracy, balancing AI-driven suggestions with expert insights and ensuring safe and reliable AI integration into patient care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540 · cited 1×
“When working with LLMs, the production of output that cannot be explained by the training data, known as hallucinations, can occur and generate incorrect statements [21].”
BackgroundPrompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial
Meskó, B. (2023) · Journal of Medical Internet Research · doi:10.2196/50638 · Cited by 709
Teaching AI Ethics in Medical Education: A Scoping Review of Current Literature and Practices
Weidener, L., & Fischer, M. (2023) · Perspectives on Medical Education · doi:10.5334/pme.954 · Cited by 133 · cited 1×
“The increasing use of AI systems in medicine and the ethical challenges they pose are of utmost relevance today [19].”
BackgroundLukac, S., Dayan, D., Fink, V., Leinert, E., Hartkopf, A., Veselinovic, K., Janni, W., Rack, B., Pfister, K., Heitmeir, B., et al. (2023) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-023-07130-5 · Cited by 130 · cited 1×
“In contrast to the results of Lukac et al., 2023, who used primary breast cancer cases and compared it with their multidisciplinary tumor board recommendation, we found the HER-2 treatment recommendation to be the most reliable one [11].”
ResultHirosawa, T., Kawamura, R., Harada, Y., Mizuta, K., Tokumasu, K., Kaji, Y., Suzuki, T., & Shimizu, T. (2023) · JMIR Medical Informatics · doi:10.2196/48808 · Cited by 130 · cited 1×
“Similar to a recent study [18], our findings highlight a decrease in reliability for complex medical decisions, emphasizing the need for further development.”
ResultJost, E., Kosian, P., Jimenez Cruz, J., Albarqouni, S., Gembruch, U., Strizek, B., & Recker, F. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12216833 · Cited by 44 · cited 2×
“Since this research is often lacking clinical applicability [2], these systems are not implemented in daily medical treatment routines, therapy recommendations or patient care in Germany.”
BackgroundMethod
Cited by
Froicu, E.-M., Creangă-Murariu, I., Afrăsânie, V.-A., Gafton, B., Alexa-Stratulat, T., Miron, L., Pușcașu, D. M., Poroch, V., Bacoanu, G., Radu, I., et al. (2025) · Current Oncology Reports · doi:10.1007/s11912-025-01698-8 · Cited by 38
“According to Stalp et al., 2024, ChatGPT’s treatment recommendations were generally sufficient, with high accuracy observed in HER2-positive breast cancer cases and better performance in primary, non-complicated scenarios, particularly for chemotherapy [18].”
Meyer, B., Kfuri‐Rubens, R., Schmidt, G., Tariq, M., Riedel, C., Recker, F., Riedel, F., Kiechle, M., & Riedel, M. (2025) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70251 · Cited by 10
Büyükceran, E. U., Seyfettin, A., Babatürk, A., Özkan, M. B., Çolak, D., Ünal, İ., Kaymaz, E., Ergün, E., Emer, M. Ö., & Mersin, H. H. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02314-9 · Cited by 6
Dehdab, R., Afat, S., Mankertz, F., Brendel, J. M., Maalouf, N., Werner, S., Brendlin, A., Herrmann, J., Nikolaou, K., Kloker, L. D., et al. (2026) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-026-06432-w · Cited by 5
Reimagining cancer treatments in the era of generative AI
Derbal, Y. (2025) · DIGITAL HEALTH · doi:10.1177/20552076251394631 · Cited by 4
Metadata
- Authors
- Stalp, J. L., Denecke, A., Jentschke, M., Hillemanns, P., & Klapdor, R.
- Venue
- Current Oncology
- Publisher
- MDPI AG
- Published
- 2024-07-01
- Volume
- 31
- Issue
- 7
- Pages
- 3845-3854
- ISSN
- 1198-0052 (ISSN-L)
- 1718-7729
- OpenAlex
- W4400284100
- Cited by
- 27
- References
- 6
- FWCI
- 2.16
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology. https://app.cochat.ai/papers/10.3390/curroncol31070284
- The paper
- Stalp, J. L., Denecke, A., Jentschke, M., Hillemanns, P., & Klapdor, R. (2024). Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology. Current Oncology. https://doi.org/10.3390/curroncol31070284
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.