ChatGPT’s Efficacy in Queries Regarding Polycystic Ovary Syndrome and Treatment Strategies for Women Experiencing Infertility
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
This study assesses the efficacy of ChatGPT-4, an advanced artificial intelligence (AI) language model, in delivering precise and comprehensive answers to inquiries regarding managing polycystic ovary syndrome (PCOS)-related infertility. The research team, comprising experienced gynecologists, formulated 460 structured queries encompassing a wide range of common and intricate PCOS scenarios. The queries were: true/false (170), open-ended (165), and multiple-choice (125) and further classified as ‘easy’, ‘moderate’, and ‘hard’. For true/false questions, ChatGPT-4 achieved a flawless accuracy rate of 100% initially and upon reassessment after 30 days. In the open-ended category, there was a noteworthy enhancement in accuracy, with scores increasing from 5.53 ± 0.89 initially to 5.88 ± 0.43 at the 30-day mark (p < 0.001). Completeness scores for open-ended queries also experienced a significant improvement, rising from 2.35 ± 0.58 to 2.92 ± 0.29 (p < 0.001). In the multiple-choice category, although the accuracy score exhibited a minor decline from 5.96 ± 0.44 to 5.92 ± 0.63 after 30 days (p > 0.05). Completeness scores for multiple-choice questions remained consistent, with initial and 30-day means of 2.98 ± 0.18 and 2.97 ± 0.25, respectively (p > 0.05). ChatGPT-4 demonstrated exceptional performance in true/false queries and significantly improved handling of open-ended questions during the 30 days. These findings emphasize the potential of AI, particularly ChatGPT-4, in enhancing decision-making support for healthcare professionals managing PCOS-related infertility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In both articles, the accuracy of the information was rated high; however, the readability was a challenge for the average user”
From Availability and Use of Digital Technology Among Women With Polycystic Ovary Syndrome: Scoping Review (2025) · cites this paper as [51]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Furthermore, 6% (2/34) of articles were about the use of ChatGPT to provide PCOS information; 1 about fertility treatments [51] and 1 about nutrition [52]”
From Availability and Use of Digital Technology Among Women With Polycystic Ovary Syndrome: Scoping Review (2025) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Appropriateness of breast cancer prevention and screening recommendations provided by ChatGPT
Haver, H. L., Ambinder, E. B., Bahl, M., Oluyemi, E. T., Jeudy, J., & Yi, P. H. (2023) · Radiology · doi:10.1148/radiol.230424 · Cited by 247 · cited 1×
“These networks are adept at discerning patterns and associations amongst words and phrases, enabling the model to respond intelligently to various inquiries and commands [11].”
BackgroundThe exciting potential for ChatGPT in obstetrics and gynecology
Grünebaum, A., Chervenak, J., Pollet, S. L., Katz, A., & Chervenak, F. A. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.03.009 · Cited by 234 · cited 2×
“Grünebaum et al. highlight ChatGPT’s potential to provide preliminary information across a broad spectrum of clinical queries, though they caution about its limitations, including data currency and the lack of source citation capabilities, which might mislead users [16].”
BackgroundRole of Metformin in Polycystic Ovary Syndrome (PCOS): Related Infertility
Attia, G. M., Almouteri, M. M., & Alnakhli, F. T. (2023) · Cureus · doi:10.7759/cureus.44493 · Cited by 133 · cited 1×
“Given its multifaceted nature, the management of infertility in women with PCOS requires a comprehensive approach, of which ovulation induction is a cornerstone [5–7].”
BackgroundChatGPT in Medical Imaging Higher Education
Currie, G., Singh, C., Nelson, T., Nabasenja, C., Al-Hayek, Y., & Spuur, K. (2023) · Radiography · doi:10.1016/j.radi.2023.05.011 · Cited by 128 · cited 1×
“The development of artificial intelligence (AI) technology has witnessed substantial advancements across numerous sectors, with a particularly notable exemplar being the sophisticated language models such as ChatGPT 4 (by OpenAI) [9,10].”
BackgroundThe prospect of artificial intelligence to personalize assisted reproductive technology
Hanassab, S., Abbara, A., Yeung, A. C., Voliotis, M., Tsaneva-Atanasova, K. T., Kelsey, T., Trew, G. H., Nelson, S. M., Heinis, T., & Dhillo, W. S. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01006-x · Cited by 125 · cited 1×
“Specifically, in the context of ovulation induction, it can play a pivotal role in investigating treatment protocols for individual patient profiles, thus maximizing the chances of successful pregnancy while minimizing the risks of treatment-related complications [12,13].”
BackgroundLi, S. W., Kemp, M. W., Logan, S. J. S., Dimri, P. S., Singh, N., Mattar, C. N. Z., Dashraath, P., Ramlal, H., Mahyuddin, A. P., Kanayan, S., et al. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.04.020 · Cited by 116 · cited 1×
“The technology’s potential extends to competitive scenarios, as evidenced by a study by Li et al., wherein ChatGPT outperformed human candidates in a virtual objective structured clinical examination [18].”
BackgroundEvaluating ChatGPT Responses on Thyroid Nodules for Patient Education
Campbell, D. J., Estephan, L. E., Sina, E. M., Mastrolonardo, E. V., Alapati, R., Amin, D. R., & Cottrill, E. E. (2024) · Thyroid® · doi:10.1089/thy.2023.0491 · Cited by 81 · cited 1×
“These insights are vital for integrating AI tools like ChatGPT 4 into medical education and patient interaction settings, though they must be deployed judiciously alongside human expertise.”
BackgroundBeyond chatting: The opportunities and challenges of ChatGPT in medicine and radiology
Ferres, J. L., Weeks, W. B., Chu, L. C. H., Rowe, S. P., & Fishman, E. K. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.006 · Cited by 51 · cited 1×
“The development of artificial intelligence (AI) technology has witnessed substantial advancements across numerous sectors, with a particularly notable exemplar being the sophisticated language models such as ChatGPT 4 (by OpenAI) [9,10].”
BackgroundBan, M., Sun, Y., Chen, X., Zhou, X., Zhang, Y., & Cui, L. (2024) · Journal of Ovarian Research · doi:10.1186/s13048-023-01331-x · Cited by 49 · cited 1×
“Advancements in assisted reproductive technology and pharmacological interventions have significantly improved these patients’ prognoses, yet the quest for optimal treatment strategies remains ongoing [8].”
BackgroundDiagnostic and Management Performance of ChatGPT in Obstetrics and Gynecology
Allahqoli, L., Ghiasvand, M. M., Mazidimoradi, A., Salehiniya, H., & Alkatout, I. (2023) · Gynecologic and Obstetric Investigation · doi:10.1159/000533177 · Cited by 40 · cited 3×
“Similarly, Allahqoli et al. demonstrated ChatGPT’s robust diagnostic and management capabilities in obstetrics and gynecology, albeit with an acknowledgment of inherent biases and the need for careful consideration of ethical issues surrounding its use [17].”
BackgroundCurrent Updates on Involvement of Artificial Intelligence and Machine Learning in Semen Analysis
Selvam, M. K. P., Moharana, A. K., Baskaran, S., Finelli, R., Hudnall, M. C., & Sikka, S. C. (2024) · Medicina · doi:10.3390/medicina60020279 · Cited by 38 · cited 1×
“Specifically, in the context of ovulation induction, it can play a pivotal role in investigating treatment protocols for individual patient profiles, thus maximizing the chances of successful pregnancy while minimizing the risks of treatment-related complications [12,13].”
BackgroundRisk stratification of thyroid nodules: Assessing the suitability of ChatGPT for text-based analysis
Sievert, M., Conrad, O., Mueller, S. K., Rupp, R., Balk, M., Richter, D., Mantsopoulos, K., Iro, H., & Koch, M. (2023) · American Journal of Otolaryngology · doi:10.1016/j.amjoto.2023.104144 · Cited by 35
Berberine—A Promising Therapeutic Approach to Polycystic Ovary Syndrome in Infertile/Pregnant Women
Ionescu, O.-M., Frîncu, F., Mehedintu, A. M., Plotogea, M., Cîrstoiu, M. M., Petca, A. T., Varlas, V. N., & Mehedințu, C. (2023) · Life · doi:10.3390/life13010125 · Cited by 34 · cited 1×
“It is characterized by a spectrum of some symptoms, including but not limited to oligomenorrhea, hyperandrogenism, and polycystic ovaries [2–4].”
BackgroundBahreiny, S. S., Ahangarpour, A., Saki, N., Dabbagh, M. R., Ebrahimi, R., Mahdizade, A. H., Ghorbani, H., & Aghaei, M. (2024) · Reproductive Sciences · doi:10.1007/s43032-023-01447-x · Cited by 33 · cited 1×
“It is characterized by a spectrum of some symptoms, including but not limited to oligomenorrhea, hyperandrogenism, and polycystic ovaries [2–4].”
BackgroundPolycystic Ovarian Syndrome in Adolescents
Adone, A., & Fulmali, D. G. (2023) · Cureus · doi:10.7759/cureus.34183 · Cited by 32
Endocrine factors associated with infertility in women: an updated review
Concepción‐Zavaleta, M. J., Arroyo, J., Aldave, J. E. Q., Durand‐Vásquez, M. D. C., Ildefonso-Najarro, S. P., Rafael-Robles, L. D. P., Urteaga, L. A. C., Osorio, E. R. G., Suárez-Rojas, J., & Paz‐Ibarra, J. (2023) · Expert Review of Endocrinology & Metabolism · doi:10.1080/17446651.2023.2256405 · Cited by 32
Application of generative language models to orthopaedic practice
Caterson, J., Ambler, O., Cereceda‐Monteoliva, N., Horner, M., Jones, A., & Poacher, A. T. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-076484 · Cited by 30 · cited 1×
“These insights are vital for integrating AI tools like ChatGPT 4 into medical education and patient interaction settings, though they must be deployed judiciously alongside human expertise.”
BackgroundUpdates in diagnosing polycystic ovary syndrome-related infertility
Haddad-Filho, H., Tosatti, J. A. G., Magalhães, F. M. V., Gomes, K. B., & dos Reis, F. M. (2023) · Expert Review of Molecular Diagnostics · doi:10.1080/14737159.2023.2177536 · Cited by 29
Potential applications of ChatGPT in obstetrics and gynecology in Korea: a review article
Lee, Y., & Kim, S. Y. (2024) · Obstetrics & Gynecology Science · doi:10.5468/ogs.23231 · Cited by 29 · cited 1×
“While these findings are promising, Lee and Kim note that the ongoing challenge remains the verification of information and the ethical implications associated with AI in medical settings [19].”
BackgroundStevenson, E., Walsh, C., & Hibberd, L. (2024) · Annals of Clinical Biochemistry: International Journal of Laboratory Medicine · doi:10.1177/00045632231203473 · Cited by 26 · cited 1×
“These should encompass diverse patients and reflect the unique aspects of practices globally [15].”
BackgroundÇil, G., & Doğan, K. (2024) · World Journal of Urology · doi:10.1007/s00345-024-04847-z · Cited by 25
Deniz, M. S., & Güler, B. Y. (2024) · Endocrine · doi:10.1007/s12020-024-03750-2 · Cited by 25 · cited 1×
“These insights are vital for integrating AI tools like ChatGPT 4 into medical education and patient interaction settings, though they must be deployed judiciously alongside human expertise.”
BackgroundChatGPT: a pioneering approach to complex prenatal differential diagnosis
Suhag, A., Kidd, J., McGath, M., Rajesh, R., Gelfinbein, J., Cacace, N., Monteleone, B., & Chavez, M. R. (2023) · American Journal of Obstetrics & Gynecology MFM · doi:10.1016/j.ajogmf.2023.101029 · Cited by 23 · cited 2×
“Notably, AI’s performance in true/false queries maintained a remarkable 100% accuracy rate both initially and after a 30-day interval, underscoring its reliability.”
BackgroundExploring the use of ChatGPT for guidance during unexpected labour
Santo, D. S. E., & Joviano‐Santos, J. V. (2023) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2023.04.001 · Cited by 14 · cited 1×
“These insights are vital for integrating AI tools like ChatGPT 4 into medical education and patient interaction settings, though they must be deployed judiciously alongside human expertise.”
BackgroundCurrent pharmacotherapy and future directions for neuroendocrine causes of female infertility
Koysombat, K., Abbara, A., & Dhillo, W. S. (2022) · Expert Opinion on Pharmacotherapy · doi:10.1080/14656566.2022.2064217 · Cited by 10 · cited 1×
“Given its multifaceted nature, the management of infertility in women with PCOS requires a comprehensive approach, of which ovulation induction is a cornerstone [5–7].”
BackgroundProceedings of the first world conference on AI in fertility
Curchoe, C. L. (2023) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-022-02704-9 · Cited by 7
Cited by
Artificial intelligence in polycystic ovarian syndrome management: past, present, and future
Wang, J., Chen, R., Long, H., He, J., Tang, M., Su, M., Deng, R., Chen, Y., Ni, R., Zhao, S., et al. (2025) · La radiologia medica · doi:10.1007/s11547-025-02032-9 · Cited by 39
“…quality, Acc, and readability, however, general advice from AI applications was still inferior to personalized medical guidance from healthcare professionals, which were given a slightly lower average score based on subjective scales (such as DISCERN, global quality scale, and Likert) [151, 152].”
Güneşli, I., Aksun, S., Fathelbab, J., & Yıldız, B. O. (2024) · Endocrine · doi:10.1007/s12020-024-04121-7 · Cited by 21
“Results showed ChatGPT-4 generated accurate and reliable responses, but evaluations were subjective, and dynamic learning was lacking [17].”
The Role of Artificial Intelligence in Female Infertility Diagnosis: An Update
Fındıklı, N., Houba, C., Pening, D., & Delbaere, A. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14093127 · Cited by 17
Comparative analysis of ChatGPT 3.5 and ChatGPT 4 obstetric and gynecological knowledge
Ługowski, F., Babińska, J., Ludwin, A., & Stanirowski, P. J. (2025) · Scientific Reports · doi:10.1038/s41598-025-08424-1 · Cited by 17
Ulug, E., Gunesli, I., Acıkgoz Pinar, A., & Yildiz, B. O. (2025) · Nutrition Research · doi:10.1016/j.nutres.2024.11.005 · Cited by 12
Metadata
- Authors
- Devranoglu, B., Gurbuz, T., & Gokmen, O.
- Affiliations
- Department of Obstetrics and Gynecology, Zeynep Kamil Maternity/Children, Education and Training Hospital, Istanbul 34480, Turkey
- Department of Gynecology and Obstetrics Clinic, Medistate Hospital, Istanbul 34820, Turkey
- Department of Gynecology, Obstetrics and In Vitro Fertilization Clinic, Medistate Hospital, Istanbul 34820, Turkey
- Venue
- Diagnostics
- Publisher
- MDPI AG
- Published
- 2024-05-22
- Volume
- 14
- Issue
- 11
- Pages
- 1082
- ISSN
- 2075-4418 (ISSN-L)
- PMC
- PMC11172366
- OpenAlex
- W4398202230
- Cited by
- 15
- References
- 26
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 3
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Diagnostics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Reproductive Medicine › Ovarian function and disorders
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- ChatGPT-4, polycystic ovary syndrome, AI-generated medical information, answer accuracy, open-ended questions, multiple-choice questions, true/false questions, clinical decision support, gynecology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
