ChatGPT’s Efficacy in Queries Regarding Polycystic Ovary Syndrome and Treatment Strategies for Women Experiencing Infertility
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
This study assesses the efficacy of ChatGPT-4, an advanced artificial intelligence (AI) language model, in delivering precise and comprehensive answers to inquiries regarding managing polycystic ovary syndrome (PCOS)-related infertility. The research team, comprising experienced gynecologists, formulated 460 structured queries encompassing a wide range of common and intricate PCOS scenarios. The queries were: true/false (170), open-ended (165), and multiple-choice (125) and further classified as ‘easy’, ‘moderate’, and ‘hard’. For true/false questions, ChatGPT-4 achieved a flawless accuracy rate of 100% initially and upon reassessment after 30 days. In the open-ended category, there was a noteworthy enhancement in accuracy, with scores increasing from 5.53 ± 0.89 initially to 5.88 ± 0.43 at the 30-day mark (p < 0.001). Completeness scores for open-ended queries also experienced a significant improvement, rising from 2.35 ± 0.58 to 2.92 ± 0.29 (p < 0.001). In the multiple-choice category, although the accuracy score exhibited a minor decline from 5.96 ± 0.44 to 5.92 ± 0.63 after 30 days (p > 0.05). Completeness scores for multiple-choice questions remained consistent, with initial and 30-day means of 2.98 ± 0.18 and 2.97 ± 0.25, respectively (p > 0.05). ChatGPT-4 demonstrated exceptional performance in true/false queries and significantly improved handling of open-ended questions during the 30 days. These findings emphasize the potential of AI, particularly ChatGPT-4, in enhancing decision-making support for healthcare professionals managing PCOS-related infertility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In both articles, the accuracy of the information was rated high; however, the readability was a challenge for the average user”
From Availability and Use of Digital Technology Among Women With Polycystic Ovary Syndrome: Scoping Review (2025) · cites this paper as [51]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Furthermore, 6% (2/34) of articles were about the use of ChatGPT to provide PCOS information; 1 about fertility treatments [51] and 1 about nutrition [52]”
From Availability and Use of Digital Technology Among Women With Polycystic Ovary Syndrome: Scoping Review (2025) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Appropriateness of breast cancer prevention and screening recommendations provided by ChatGPT
Haver, H. L., Ambinder, E. B., Bahl, M., Oluyemi, E. T., Jeudy, J., & Yi, P. H. (2023) · Radiology · doi:10.1148/radiol.230424 · Cited by 247 · cited 1×
“These networks are adept at discerning patterns and associations amongst words and phrases, enabling the model to respond intelligently to various inquiries and commands [11].”
BackgroundThe exciting potential for ChatGPT in obstetrics and gynecology
Grünebaum, A., Chervenak, J., Pollet, S. L., Katz, A., & Chervenak, F. A. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.03.009 · Cited by 234 · cited 2×
“Grünebaum et al. highlight ChatGPT’s potential to provide preliminary information across a broad spectrum of clinical queries, though they caution about its limitations, including data currency and the lack of source citation capabilities, which might mislead users [16].”
BackgroundRole of Metformin in Polycystic Ovary Syndrome (PCOS): Related Infertility
Attia, G. M., Almouteri, M. M., & Alnakhli, F. T. (2023) · Cureus · doi:10.7759/cureus.44493 · Cited by 133 · cited 1×
“Given its multifaceted nature, the management of infertility in women with PCOS requires a comprehensive approach, of which ovulation induction is a cornerstone [5–7].”
BackgroundChatGPT in Medical Imaging Higher Education
Currie, G., Singh, C., Nelson, T., Nabasenja, C., Al-Hayek, Y., & Spuur, K. (2023) · Radiography · doi:10.1016/j.radi.2023.05.011 · Cited by 128 · cited 1×
“The development of artificial intelligence (AI) technology has witnessed substantial advancements across numerous sectors, with a particularly notable exemplar being the sophisticated language models such as ChatGPT 4 (by OpenAI) [9,10].”
BackgroundThe prospect of artificial intelligence to personalize assisted reproductive technology
Hanassab, S., Abbara, A., Yeung, A. C., Voliotis, M., Tsaneva-Atanasova, K. T., Kelsey, T., Trew, G. H., Nelson, S. M., Heinis, T., & Dhillo, W. S. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01006-x · Cited by 125 · cited 1×
“Specifically, in the context of ovulation induction, it can play a pivotal role in investigating treatment protocols for individual patient profiles, thus maximizing the chances of successful pregnancy while minimizing the risks of treatment-related complications [12,13].”
BackgroundLi, S. W., Kemp, M. W., Logan, S. J. S., Dimri, P. S., Singh, N., Mattar, C. N. Z., Dashraath, P., Ramlal, H., Mahyuddin, A. P., Kanayan, S., et al. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.04.020 · Cited by 116 · cited 1×
“The technology’s potential extends to competitive scenarios, as evidenced by a study by Li et al., wherein ChatGPT outperformed human candidates in a virtual objective structured clinical examination [18].”
BackgroundEvaluating ChatGPT Responses on Thyroid Nodules for Patient Education
Campbell, D. J., Estephan, L. E., Sina, E. M., Mastrolonardo, E. V., Alapati, R., Amin, D. R., & Cottrill, E. E. (2024) · Thyroid® · doi:10.1089/thy.2023.0491 · Cited by 81 · cited 1×
“These insights are vital for integrating AI tools like ChatGPT 4 into medical education and patient interaction settings, though they must be deployed judiciously alongside human expertise.”
BackgroundBeyond chatting: The opportunities and challenges of ChatGPT in medicine and radiology
Ferres, J. L., Weeks, W. B., Chu, L. C. H., Rowe, S. P., & Fishman, E. K. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.006 · Cited by 51 · cited 1×
“The development of artificial intelligence (AI) technology has witnessed substantial advancements across numerous sectors, with a particularly notable exemplar being the sophisticated language models such as ChatGPT 4 (by OpenAI) [9,10].”
BackgroundBan, M., Sun, Y., Chen, X., Zhou, X., Zhang, Y., & Cui, L. (2024) · Journal of Ovarian Research · doi:10.1186/s13048-023-01331-x · Cited by 49 · cited 1×
“Advancements in assisted reproductive technology and pharmacological interventions have significantly improved these patients’ prognoses, yet the quest for optimal treatment strategies remains ongoing [8].”
BackgroundDiagnostic and Management Performance of ChatGPT in Obstetrics and Gynecology
Allahqoli, L., Ghiasvand, M. M., Mazidimoradi, A., Salehiniya, H., & Alkatout, I. (2023) · Gynecologic and Obstetric Investigation · doi:10.1159/000533177 · Cited by 40 · cited 3×
“Similarly, Allahqoli et al. demonstrated ChatGPT’s robust diagnostic and management capabilities in obstetrics and gynecology, albeit with an acknowledgment of inherent biases and the need for careful consideration of ethical issues surrounding its use [17].”
Background
Cited by
Artificial intelligence in polycystic ovarian syndrome management: past, present, and future
Wang, J., Chen, R., Long, H., He, J., Tang, M., Su, M., Deng, R., Chen, Y., Ni, R., Zhao, S., et al. (2025) · La radiologia medica · doi:10.1007/s11547-025-02032-9 · Cited by 39
“…quality, Acc, and readability, however, general advice from AI applications was still inferior to personalized medical guidance from healthcare professionals, which were given a slightly lower average score based on subjective scales (such as DISCERN, global quality scale, and Likert) [151, 152].”
Güneşli, I., Aksun, S., Fathelbab, J., & Yıldız, B. O. (2024) · Endocrine · doi:10.1007/s12020-024-04121-7 · Cited by 21
“Results showed ChatGPT-4 generated accurate and reliable responses, but evaluations were subjective, and dynamic learning was lacking [17].”
The Role of Artificial Intelligence in Female Infertility Diagnosis: An Update
Fındıklı, N., Houba, C., Pening, D., & Delbaere, A. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14093127 · Cited by 17
Comparative analysis of ChatGPT 3.5 and ChatGPT 4 obstetric and gynecological knowledge
Ługowski, F., Babińska, J., Ludwin, A., & Stanirowski, P. J. (2025) · Scientific Reports · doi:10.1038/s41598-025-08424-1 · Cited by 17
Ulug, E., Gunesli, I., Acıkgoz Pinar, A., & Yildiz, B. O. (2025) · Nutrition Research · doi:10.1016/j.nutres.2024.11.005 · Cited by 12
Metadata
- Authors
- Devranoglu, B., Gurbuz, T., & Gokmen, O.
- Affiliations
- Department of Obstetrics and Gynecology, Zeynep Kamil Maternity/Children, Education and Training Hospital, Istanbul 34480, Turkey
- Department of Gynecology and Obstetrics Clinic, Medistate Hospital, Istanbul 34820, Turkey
- Department of Gynecology, Obstetrics and In Vitro Fertilization Clinic, Medistate Hospital, Istanbul 34820, Turkey
- Venue
- Diagnostics
- Publisher
- MDPI AG
- Published
- 2024-05-22
- Volume
- 14
- Issue
- 11
- Pages
- 1082
- ISSN
- 2075-4418 (ISSN-L)
- PMC
- PMC11172366
- OpenAlex
- W4398202230
- Cited by
- 15
- References
- 26
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 3
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Diagnostics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Reproductive Medicine › Ovarian function and disorders
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- ChatGPT-4, polycystic ovary syndrome, AI-generated medical information, answer accuracy, open-ended questions, multiple-choice questions, true/false questions, clinical decision support, gynecology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ChatGPT’s Efficacy in Queries Regarding Polycystic Ovary Syndrome and Treatment Strategies for Women Experiencing Infertility. https://app.cochat.ai/papers/10.3390/diagnostics14111082
- The paper
- Devranoglu, B., Gurbuz, T., & Gokmen, O. (2024). ChatGPT’s Efficacy in Queries Regarding Polycystic Ovary Syndrome and Treatment Strategies for Women Experiencing Infertility. Diagnostics. https://doi.org/10.3390/diagnostics14111082
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
