Exploring the potential of AI ‐powered applications for clinical decision‐making in gynecologic oncology
Open accessAbstract
Objective: The rise of artificial intelligence (AI) and large language models like Llama, Gemini, or Generative Pretraining Transformer (GPT) signals a promising new era in natural language processing and has significant potential for application in medical care. This study seeks to investigate the potential of GPT‐4 for automated therapy recommendations by examining individual patient health record data with a focus on gynecologic malignancies and breast cancer. Methods: We tasked GPT‐4 with generating independent treatment proposals for 60 randomly selected patient cases presented at gynecologic and senologic multidisciplinary tumor boards (MDTs). The treatment recommendations by GPT‐4 were compared with those of the MDTs using a novel clinical concordance score and were reviewed both qualitatively and quantitatively by experienced gynecologic oncologists. Results: GPT‐4 generated coherent therapeutic recommendations for all clinical cases. Overall, these recommendations were assessed by clinical experts as moderately sufficient for real‐word clinical application. Deficiencies in both accuracy and completeness were especially noted. Using a quantitative clinical concordance score, GPT‐4 consistently demonstrated superior performance in managing the senologic cases compared with the gynecologic cases. Iterative prompting substantially enhanced treatment recommendations in both categories, increasing concordance with MDT decisions to up to 84% in senologic cases. Conclusion: GPT‐4 is capable of processing complex patient cases and generates detailed treatment recommendations; however, differences persist in surgical approaches and the use of systemic therapies, and there is a tendency toward recommending excessive genetic testing. As AI‐powered solutions continue to be integrated into medicine, we envision the potential for automated therapy recommendations to play a supportive role in human clinical decision‐making in the future.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Meyer et al. evaluated GPT-4 in 60 gynecologic and senologic cases.
“Meyer et al. evaluated GPT-4 in 60 gynecologic and senologic cases [12]”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672 · see citing works
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · see citing works
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169 · see citing works
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078 · see citing works
Dave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204 · see citing works
Human-computer collaboration for skin cancer recognition
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0942-0 · Cited by 1,024 · see citing works
Transformer-XL: Attentive Language Models Beyond a Fixed-Length ContextPreprint
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q. V., & Salakhutdinov, R. (2019) · arXiv (Cornell University) · doi:10.4230/lipics.ecrts.2023.7 · Cited by 860 · see citing works
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT
White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., & Schmidt, D. C. (2023) · arXiv · doi:10.48550/arxiv.2302.11382 · Cited by 838 · see citing works
Prompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial
Meskó, B. (2023) · Journal of Medical Internet Research · doi:10.2196/50638 · Cited by 709 · see citing works
Human–machine partnership with artificial intelligence for chest radiograph diagnosis
Patel, B. N., Rosenberg, L., Willcox, G., Baltaxe, D., Lyons, M., Irvin, J., Rajpurkar, P., Amrhein, T., Gupta, R., Halabi, S., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0189-7 · Cited by 254 · see citing works
Huh, S. (2023) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2023.20.01 · Cited by 199 · see citing works
Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models
Tamkin, A., Brundage, M., Clark, J., & Ganguli, D. (2021) · arXiv · doi:10.48550/arxiv.2102.02503 · Cited by 135 · see citing works
Lukac, S., Dayan, D., Fink, V., Leinert, E., Hartkopf, A., Veselinovic, K., Janni, W., Rack, B., Pfister, K., Heitmeir, B., et al. (2023) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-023-07130-5 · Cited by 130 · see citing works
Leveraging large language models for generating responses to patient messages—a subjective analysis
Liu, S., McCoy, A. B., Wright, A. P., Carew, B., Genkins, J. Z., Huang, S. S., Peterson, J. F., Steitz, B. D., & Wright, A. T. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae052 · Cited by 124 · see citing works
Ayre, J., Mac, O., McCaffery, K., McKay, B. R., Liu, M., Shi, Y., Rezwan, A., & Dunn, A. G. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08469-w · Cited by 124 · see citing works
Meyer, A., Riese, J., & Streichert, T. (2024) · JMIR Medical Education · doi:10.2196/50965 · Cited by 110 · see citing works
Artificial intelligence-based text generators in hepatology: ChatGPT is just the beginning
Ge, J., & Lai, J. C. (2023) · Hepatology Communications · doi:10.1097/hc9.0000000000000097 · Cited by 83 · see citing works
Abreu, A. A., Murimwa, G. Z., Farah, E., Stewart, J. W., Zhang, L., Rodrı́guez, J., Sweetenham, J. W., Zeh, H. J., Wang, S. C., & Polanco, P. M. (2024) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2023.7334 · Cited by 70 · see citing works
Farhat, F., Chaudry, B., Nadeem, M., Sohail, S. S., & Madsen, D. Ø. (2023) · JMIR Medical Education · doi:10.2196/51523 · Cited by 62 · see citing works
Watari, T., Takagi, S., Sakaguchi, K., Nishizaki, Y., Shimizu, T., Yamamoto, Y., & Tokuda, Y. (2023) · JMIR Medical Education · doi:10.2196/52202 · Cited by 54 · see citing works
Russe, M. F., Reisert, M., Bamberg, F., & Rau, A. (2024) · RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren · doi:10.1055/a-2264-5631 · Cited by 52 · see citing works
Riedel, M., Kaefinger, K., Stuehrenberg, A., Ritter, V., Amann, N., Graf, A., Recker, F., Klein, E., Kiechle, M., Riedel, F., et al. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1296615 · Cited by 49 · see citing works
Self-citationGriewing, S., Knitza, J., Boekhoff, J., Hillen, C., Lechner, F., Wagner, U., Wallwiener, M., & Kuhn, S. (2024) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-024-07565-4 · Cited by 38 · see citing works
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT
(2024) · Proceedings of the 30th Conference on Pattern Languages of Programs · doi:10.64346/plop2023p05 · Cited by 32 · see citing works
Beattie, J., Neufeld, S., Yang, D., Chukwuma, C., Gul, A., Desai, N., Jiang, S., & Dohopolski, M. (2024) · Cureus · doi:10.7759/cureus.60044 · Cited by 30 · see citing works
Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology
Stalp, J. L., Denecke, A., Jentschke, M., Hillemanns, P., & Klapdor, R. (2024) · Current Oncology · doi:10.3390/curroncol31070284 · Cited by 26 · see citing works
Braun, E.-M., Juhasz‐Böss, I., Solomayer, E., Truhn, D., Keller, C., Heinrich, V., & Braun, B. J. (2023) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-023-07272-6 · Cited by 13 · see citing works
ChatGPT in a gynaecologic oncology multidisciplinary team tumour board: A feasibility study
Levin, G., Gotlieb, W. H., Ramirez, P. T., Meyer, R., & Brezinov, Y. (2024) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17929 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Artificial Intelligence agents for biological research: a survey
Qi, C., Wang, W., Jiang, S., Liu, Q., Song, X., Fang, H., & Wei, Z. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag075 · Cited by 11 · see citing works
Pergialiotis, V., Thomakos, N., Lygizos, V., Fanaki, M., Varthaliti, A., Vlachos, D. E., & Haidopoulos, D. (2026) · Cancers · doi:10.3390/cancers18030452 · Cited by 5 · see citing works
Prabhakaran, S., Bell, S. W., Lee, J. C., & Kong, J. C. H. (2026) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2026.111741 · Cited by 4 · see citing works
The role of artificial intelligence in precision medicine for breast cancer
Hu, J.-J., Ding, Z.-L., & Yang, Z. (2026) · Discover Oncology · doi:10.1007/s12672-026-05550-8 · Cited by 3 · see citing works
Asoglu, H., Kose, S., Kayim, O., Abaci, A., Khatib, G., Vardar, M. A., Kilic Bagir, E., Gumurdulu, D., Kidi, M. M., Bayram, E., et al. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15124451 · Cited by 1 · see citing works
“…have predominantly utilized earlier model versions and limited sample sizes: Meyer et al. evaluated GPT-4 in 60 gynecologic and senologic cases [12], Psilopatis et al. demonstrated feasibility but noted discrepancies in complex cases [13], and Gumilar et al. found variable accuracy across…”
Chen, D., Lamiman, K., Jesus, A. D. D., Silver, M., Tsatsas, M., Palileo, A., Hanusek, R., Schachter, A., Gorelick, C., Kanis, M. J., et al. (2026) · Gynecologic Oncology Reports · doi:10.1016/j.gore.2026.102187
Yalçin, I., Taşkın, S., Sahin, G., Köse, F., Ortaç, F., & Bilir, E. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09192-w
Penagos–Collazos, P. L., Torres–Meneses, M. J., & Serna–Trejos, J. S. (2026) · Revista Experiencia en Medicina del Hospital Regional Lambayeque · doi:10.37065/rem.2026.a898
Liu, Z., Li, Y., Wang, J., Liu, Q., Feife, C., Zhu, L., Ren, Y., Xing, L., & Wang, X. (2026) · Journal of Medical Internet Research · doi:10.2196/87254
Alzoubi, Y. I., & Mishra, A. (2026) · Journal of Responsible Technology · doi:10.1016/j.jrt.2026.100187
Borella, F., Fucina, S., Denti, P., Gallio, N., Bertero, L., Ditto, A., Ray-Coquard, I. L., Chopin, N., Ferraioli, D., & Cosma, S. (2026) · International Journal of Gynecological Cancer · doi:10.1016/j.ijgc.2026.105598
- Authors
- Meyer, B., Kfuri‐Rubens, R., Schmidt, G., Tariq, M., Riedel, C., Recker, F., Riedel, F., Kiechle, M., & Riedel, M.
- Affiliations
- TUM Klinikum (DE)
- University Hospital Heidelberg (DE)
- University Hospital Bonn (DE)
- Heidelberg University (DE)
- Corresponding author
- Riedel, Maximilian
- ORCID
- Venue
- International Journal of Gynecology & Obstetrics
- Publisher
- Wiley
- Published
- 2025-06-13
- Volume
- 171
- Issue
- 2
- Pages
- 698-704
- ISSN
- 0020-6695 (ISSN-L)
- 0020-7292
- 1879-3479
- PMC
- PMC12553098
- OpenAlex
- W4411277954
- Cited by
- 10
- References
- 25
- Citations by year
- 2026: 10
- FWCI
- 2.39
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- International Journal of Gynecology & Obstetrics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- GPT-4, large language models, clinical decision support, gynecologic oncology, breast cancer, multidisciplinary tumor board, clinical concordance, iterative prompting, biomedical natural language processing, genetic testing recommendations
- MeSH terms
- Clinical Decision-Making, Artificial Intelligence, Breast Neoplasms, Female, Genital Neoplasms, Female, Gynecology, Humans, Medical Oncology, Middle Aged, Natural Language Processing, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
