The promise and peril of using a large language model to obtain clinical information: ChatGPT performs strongly as a fertility counseling tool with limitations
Open accessAbstract
OBJECTIVE: To compare the responses of the large language model-based "ChatGPT" to reputable sources when given fertility-related clinical prompts. DESIGN: The "Feb 13" version of ChatGPT by OpenAI was tested against established sources relating to patient-oriented clinical information: 17 "frequently asked questions (FAQs)" about infertility on the Centers for Disease Control (CDC) Website, 2 validated fertility knowledge surveys, the Cardiff Fertility Knowledge Scale and the Fertility and Infertility Treatment Knowledge Score, as well as the American Society for Reproductive Medicine committee opinion "optimizing natural fertility." SETTING: Academic medical center. PATIENT(S): Online AI Chatbot. INTERVENTION(S): Frequently asked questions, survey questions and rephrased summary statements were entered as prompts in the chatbot over a 1-week period in February 2023. MAIN OUTCOME MEASURE(S): For FAQs from CDC: words/response, sentiment analysis polarity and objectivity, total factual statements, rate of statements that were incorrect, referenced a source, or noted the value of consulting providers. FOR FERTILITY KNOWLEDGE SURVEYS: Percentile according to published population data. FOR COMMITTEE OPINION: Whether response to conclusions rephrased as questions identified missing facts. RESULT(S): When administered the CDC's 17 infertility FAQ's, ChatGPT produced responses of similar length (207.8 ChatGPT vs. 181.0 CDC words/response), factual content (8.65 factual statements/response vs. 10.41), sentiment polarity (mean 0.11 vs. 0.11 on a scale of -1 (negative) to 1 (positive)), and subjectivity (mean 0.42 vs. 0.35 on a scale of 0 (objective) to 1 (subjective)). In total, 9 (6.12%) of 147 ChatGPT factual statements were categorized as incorrect, and only 1 (0.68%) statement cited a reference. ChatGPT would have been at the 87th percentile of Bunting's 2013 international cohort for the Cardiff Fertility Knowledge Scale and at the 95th percentile on the basis of Kudesia's 2017 cohort for the Fertility and Infertility Treatment Knowledge Score. ChatGPT reproduced the missing facts for all 7 summary statements from "optimizing natural fertility." CONCLUSION(S): A February 2023 version of "ChatGPT" demonstrates the ability of generative artificial intelligence to produce relevant, meaningful responses to fertility-related clinical queries comparable to established sources. Although performance may improve with medical domain-specific training, limitations such as the inability to reliably cite sources and the unpredictable possibility of fabricated information may limit its clinical use.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ChatGPT can generate responses similar to existing sources in fertility-related clinical prompts.
“Chervenak et al. [21] highlighted that while ChatGPT can generate responses similar to existing sources in fertility-related clinical prompts, its limitations in reliably citing sources and potential for fabricating information restrict its clinical utility.”
From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [21]
ChatGPT's limitations in reliably citing sources and potential for fabricating information restrict its clinical utility.
“Chervenak et al. [21] highlighted that while ChatGPT can generate responses similar to existing sources in fertility-related clinical prompts, its limitations in reliably citing sources and potential for fabricating information restrict its clinical utility.”
From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,182 · see citing works
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087 · see citing works
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025 · see citing works
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · see citing works
ChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842 · see citing works
Internet Health Information Seeking and the Patient-Physician Relationship: A Systematic Review
Tan, S. S.-L., & Goonawardene, N. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5729 · Cited by 1,101 · see citing works
ChatGPT and other large language models are double-edged swords
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023) · Radiology · doi:10.1148/radiol.230163 · Cited by 1,008 · see citing works
Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., Chung, W., et al. (2023) · Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.ijcnlp-main.45 · Cited by 682 · see citing works
ChatGPT and the future of medical writing
Biswas, S. (2023) · Radiology · doi:10.1148/radiol.223312 · Cited by 571 · see citing works
AI bot ChatGPT writes smart essays — should professors worry?
Stokel-Walker, C. (2022) · Nature · doi:10.1038/d41586-022-04397-7 · Cited by 543 · see citing works
Dale, R. (2020) · Natural Language Engineering · doi:10.1017/s1351324920000601 · Cited by 461 · see citing works
Sarraju, A., Bruemmer, D., Iterson, E. H. V., Cho, L., Rodríguez, F., & Laffin, L. J. (2023) · JAMA · doi:10.1001/jama.2023.1044 · Cited by 455 · see citing works
Medical Marketing in the United States, 1997-2016
Schwartz, L. M., & Woloshin, S. (2019) · JAMA · doi:10.1001/jama.2018.19320 · Cited by 380 · see citing works
Kong, W., Song, S., Zhao, Y. C., Zhu, Q., & Sha, L. (2021) · Journal of Medical Internet Research · doi:10.2196/30409 · Cited by 357 · see citing works
Sun, Y., Zhang, Y., Gwizdka, J., & Trace, C. B. (2019) · Journal of Medical Internet Research · doi:10.2196/12522 · Cited by 333 · see citing works
Bunting, L., Tsibulsky, I., & Boivin, J. (2013) · Human Reproduction · doi:10.1093/humrep/des402 · Cited by 292 · see citing works
Babel, A., Taneja, R., Mondello Malvestiti, F., Monaco, A., & Donde, S. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.669869 · Cited by 199 · see citing works
Could an artificial-intelligence agent pass an introductory physics course?
Kortemeyer, G. (2023) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.19.010132 · Cited by 199 · see citing works
Artificial intelligence in human in vitro fertilization and embryology
Zaninović, N., & Rosenwaks, Z. (2020) · Fertility and Sterility · doi:10.1016/j.fertnstert.2020.09.157 · Cited by 196 · see citing works
Geller, T. (2008) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2008.79 · Cited by 179 · see citing works
Analysis of large-language model versus human performance for genetics questions
Duong, D., & Solomon, B. D. (2023) · doi:10.1101/2023.01.27.23285115 · Cited by 159 · see citing works
Analysis of large-language model versus human performance for genetics questions
Duong, D., & Solomon, B. D. (2024) · European Journal of Human Genetics · doi:10.1038/s41431-023-01396-8 · Cited by 159 · see citing works
A Computer Wrote this Paper: What ChatGPT Means for Education, Research, and WritingPreprint
Shaver, L. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4338981 · Cited by 141 · see citing works
Kudesia, R., Chernyak, E., & McAvey, B. (2017) · Fertility and Sterility · doi:10.1016/j.fertnstert.2017.07.1158 · Cited by 92 · see citing works
Breckons, M., Jones, R. B., Morris, J., & Richardson, J. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.961 · Cited by 88 · see citing works
Sentiment analysis of clinical narratives: A scoping review
Denecke, K., & Reichenpfader, D. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104336 · Cited by 83 · see citing works
Optimizing natural fertility: a committee opinion
Penzias, A., Azziz, R., Bendikson, K. A., Falcone, T., Hansen, K., Hill, M., Jindal, S., Kalra, S., Mersereau, J., Reindollar, R., et al. (2021) · Fertility and Sterility · doi:10.1016/j.fertnstert.2021.10.007 · Cited by 69 · see citing works
Self-citationSentiment in nursing notes as an indicator of out-of-hospital mortality in intensive care patients
Waudby-Smith, I., Tran, N., Dubin, J. A., & Lee, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198687 · Cited by 67 · see citing works
Guide to the Internet: Introducing the Internet
Pallen, M. J. (1995) · BMJ · doi:10.1136/bmj.311.7017.1422 · Cited by 59 · see citing works
Quality of fertility clinic websites
Huang, J. Y. J., Discepola, F., Al-Fozan, H. M., & Tulandi, T. (2005) · Fertility and Sterility · doi:10.1016/j.fertnstert.2004.08.036 · Cited by 53 · see citing works
AI in the treatment of fertility: key considerations
Swain, J. E., VerMilyea, M. T., Meseguer, M., Ezcurra, D., Fertility AI Forum Group, Ezcurra, D., Letterie, G. S., Sánchez, P., Trew, G. H., Swain, J., et al. (2020) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-020-01950-z · Cited by 53 · see citing works
Gao, Q., Wang, D., Sun, P., Luan, X., & Wang, W. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/3440778 · Cited by 21 · see citing works
Liu, Z., Yang, Y., Song, H., & Luo, J. (2022) · Annals of Translational Medicine · doi:10.21037/atm-22-1613 · Cited by 17 · see citing works
The Artificial Creatives: The Rise of Combinatorial Creativity from Dall-E to ChatGPTPreprint
Frosio, G. F. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4350802 · Cited by 12 · see citing works
Clinical Notes Mining for Post Discharge Mortality Prediction
Kumar, V., Bajpai, R., & Roy, R. B. (2021) · IETE Technical Review · doi:10.1080/02564602.2021.1936224 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Pallen M. Introducing the Internet. BMJ 1995;311:1422-4.
- Patel SB, Lam K, Liebrenz M. ChatGPT: friend or foe. Lancet Digit Health 2023;5:e102.
- Loria S, Keen P, Honnibal M, Yankovsky R, Karesh D, Dempsey E, et al. Text- blob: simplified text processing, Second. TextBlob Simpl. Text Process 2014; 3:2014.
- Agrawal A, Gans J, Goldfarb A. Power and prediction: the disruptive eco- nomics of artificial intelligence. Boston: Harvard Business Review Press; 2022.
Cited by
Sorted by citations
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 2,842 · see citing works
“Chervenak et al. [19] highlighted that while ChatGPT can generate responses similar to existing sources in fertility-related clinical prompts, its limitations in reliably citing sources and potential for fabricating information restrict its clinical utility.”
BackgroundCurrent applications and challenges in large language models for patient care: a systematic review
Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-024-00717-2 · Cited by 358 · see citing works
Large Language Models for Chatbot Health Advice Studies: A Systematic Review
Huo, B., Boyle, A., Marfo, N., Tangamornsuksan, W., Steen, J. P., McKechnie, T., Lee, Y., Mayol, J., Antoniou, S. A., Thirunavukarasu, A. J., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.57879 · Cited by 283 · see citing works
Large language models in medical and healthcare fields: applications, advances, and challenges
Wang, D., & Zhang, S. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10921-0 · Cited by 246 · see citing works
Garg, R. K., Urs, V. L., Agrawal, A. A., Chaudhary, S. K., Paliwal, V. K., & Kar, S. K. (2023) · Health Promotion Perspectives · doi:10.34172/hpp.2023.22 · Cited by 233 · see citing works
Evaluation of ChatGPT-generated medical responses: A systematic review and meta-analysis
Wei, Q., Yao, Z., Cui, Y., Wei, B., Jin, Z., & Xu, X. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104620 · Cited by 215 · see citing works
Wang, L., Wan, Z., Ni, C., Song, Q., Li, Y., Clayton, E. W., Malin, B., & Yin, Z. (2024) · Journal of Medical Internet Research · doi:10.2196/22769 · Cited by 226 · see citing works
Evaluating Large Language Models in Class-Level Code Generation
Du, X.-Y., Liu, M.-W., Wang, K.-X., Wang, H.-L., Liu, J.-W., Chen, Y.-X., Feng, J.-Y., Sha, C.-F., Peng, X., & Lou, Y. (2024) · International Conference on Software Engineering · doi:10.1145/3597503.3639219 · Cited by 377 · see citing works
He, K., Mao, R., Lin, Q., Ruan, Y., Lan, X., Feng, M., & Cambria, E. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102963 · Cited by 147 · see citing works
Nasra, M., Jaffri, R., Pavlin‐Premrl, D., Kok, H. K., Khabaza, A., Barras, C. D., Slater, L., Yazdabadi, A., Moore, J. M., Russell, J. H., et al. (2024) · Internal Medicine Journal · doi:10.1111/imj.16607 · Cited by 83 · see citing works
Evaluating large language models and agents in healthcare: key challenges in clinical applications
Chen, X., Xiang, J., Lu, S., Liu, Y., He, M., & Shi, D. (2025) · Intelligent Medicine · doi:10.1016/j.imed.2025.03.002 · Cited by 86 · see citing works
He, K., Mao, R., Lin, Q., Ruan, Y., Lan, X., Feng, M., & Cambria, E. (2024) · doi:10.2139/ssrn.4809363 · Cited by 69 · see citing works
Gianola, S., Bargeri, S., Castellini, G., Cook, C., Palese, A., Pillastrini, P., Salvalaggio, S., Turolla, A., & Rossettini, G. (2024) · Journal of Orthopaedic & Sports Physical Therapy · doi:10.2519/jospt.2024.12151 · Cited by 62 · see citing works
Analyzing evaluation methods for large language models in the medical field: a scoping review
Lee, J., Park, S., Shin, J., & Cho, B. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02709-7 · Cited by 52 · see citing works
The Impact of Artificial Intelligence on Human Sexuality: A Five-Year Literature Review 2020–2024
Döring, N., Le, T. D., Vowels, L. M., Vowels, M. J., & Marcantonio, T. L. (2024) · Current Sexual Health Reports · doi:10.1007/s11930-024-00397-y · Cited by 65 · see citing works
A Systematic Review of ChatGPT and Other Conversational Large Language Models in HealthcarePreprint
Wang, L., Wan, Z., Ni, C., Song, Q., Li, Y., Clayton, E. W., Malin, B., & Yin, Z. (2024) · medRxiv · doi:10.1101/2024.04.26.24306390 · Cited by 41 · see citing works
Li, W., Chen, J., Chen, F., Liang, J., & Yu, H. (2023) · Aesthetic Plastic Surgery · doi:10.1007/s00266-023-03660-0 · Cited by 36 · see citing works
Garg, R. K., Urs, V. L., Agrawal, A. A., Chaudhary, S. K., Paliwal, V. K., & Kar, S. K. (2023) · medRxiv · doi:10.1101/2023.06.13.23291311 · Cited by 36 · see citing works
Evaluating search engines and large language models for answering health questions
Fernández-Pichel, M., Pichel, J. C., & Losada, D. E. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01546-w · Cited by 33 · see citing works
Reynolds, K. A., Nadelman, D. A., Durgin, J. S., Ansah-Addo, S., Cole, D. W., Fayne, R. A., Harrell, J., Ratycz, M., Runge, M., Shepard-Hayes, A., et al. (2024) · Clinical and Experimental Dermatology · doi:10.1093/ced/llad456 · Cited by 29 · see citing works
Large language models in physical therapy: time to adapt and adept
Naqvi, W. M., Shaikh, S. Z., & Mishra, G. V. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1364660 · Cited by 24 · see citing works
Evaluation of ChatGPT's performance in providing treatment recommendations for pediatric diseases
Wei, Q., Wang, Y., Yao, Z., Cui, Y., Wei, B., Li, T., & Xu, X. (2023) · Pediatric Discovery · doi:10.1002/pdi3.42 · Cited by 23 · see citing works
Safrai, M., & Orwig, K. E. (2024) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-024-03089-7 · Cited by 27 · see citing works
Artificial Intelligence for Clinical Management of Male Infertility, a Scoping Review
Naik, N. C., Roth, B. J., & Lundy, S. D. (2024) · Current Urology Reports · doi:10.1007/s11934-024-01239-z · Cited by 22 · see citing works
Toward sustainable smart cities: applications, challenges, and future directions
Ullah, A., Khan, S. H., Ullah, I., Mahmood, T., Nawazish, S., Ali, Z., & Rehman, A. U. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00856-2 · Cited by 18 · see citing works
Cerchione, R., Liccardo, G., & Passaro, R. (2026) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2025.100866 · Cited by 24 · see citing works
Croen, B. J., Abdullah, M. S., Berns, E. M., Rapaport, S. F., Hahn, A. K., Barrett, C. C., & Sobel, A. D. (2024) · Hand · doi:10.1177/15589447241247332 · Cited by 16 · see citing works
Large language models and the future of rheumatology: assessing impact and emerging opportunities
Mannstadt, I., & Mehta, B. Y. (2023) · Current Opinion in Rheumatology · doi:10.1097/bor.0000000000000981 · Cited by 16 · see citing works
Quantitative evaluation of ChatGPT versus Bard responses to anaesthesia-related queries
Patnaik, S. S., & Hoffmann, U. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.09.030 · Cited by 14 · see citing works
Liu, Y., Li, H., Ouyang, J., Xue, Z., Wang, M., He, H., Song, B., Zheng, X., & Gan, W. (2025) · JMIR Perioperative Medicine · doi:10.2196/70047 · Cited by 14 · see citing works
Hlavinka, W. J., Sontam, T. R., Gupta, A., Croen, B. J., Abdullah, M. S., & Humbyrd, C. J. (2024) · Foot and Ankle Surgery · doi:10.1016/j.fas.2024.08.002 · Cited by 12 · see citing works
ChatGPT: a reliable fertility decision-making tool?
Beilby, K., & Hammarberg, K. (2024) · Human Reproduction · doi:10.1093/humrep/dead272 · Cited by 14 · see citing works
Guo, Y., Wang, H., Ren, X., Wang, T., Chen, W., Xu, Z., & Ge, H. (2025) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70004 · Cited by 11 · see citing works
The Role of Artificial Intelligence in Female Infertility Diagnosis: An Update
Fındıklı, N., Houba, C., Pening, D., & Delbaere, A. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14093127 · Cited by 11 · see citing works
Muthmainnah, M., Asad, M. M., Yakin, A. M. A., & Almusharraf, N. (2025) · Asian Education and Development Studies · doi:10.1108/aeds-01-2025-0038 · Cited by 14 · see citing works
Su, B., Jones, R., Chen, K. S., Kostenko, E., Schmid, M., DeMaria, A. L., Villa, A., Swarup, M., Weida, J., & Tuuli, M. G. (2024) · Patient Education and Counseling · doi:10.1016/j.pec.2024.108557 · Cited by 10 · see citing works
Owens, O. L., & Leonard, M. (2025) · American Journal of Health Promotion · doi:10.1177/08901171251316371 · Cited by 10 · see citing works
Casals-Farre, O., Baskaran, R., Singh, A. P., Kaur, H., Hoque, T. U., de Almeida, A., Coffey, M. J., & Hassoulas, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-97327-2 · Cited by 11 · see citing works
Comparison of ChatGPT vs. Bard to Anesthesia-related QueriesPreprint
Patnaik, S. S., & Hoffmann, U. (2023) · medRxiv · doi:10.1101/2023.06.29.23292057 · Cited by 10 · see citing works
Demirkol, M., & Malkoç, N. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.124.3 · Cited by 10 · see citing works
Ni, Y., & Cao, Y. (2025) · Mental Health and Digital Technologies · doi:10.1108/mhdt-02-2025-0013 · Cited by 6 · see citing works
Liu, S., Su, L., He, Q., Qiu, M., & Liang, R.-S. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106164 · Cited by 8 · see citing works
Large language models to facilitate pregnancy prediction after in vitro fertilization
Cao, P., Acharya, G., Salumets, A., & Esteki, M. Z. (2024) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.14989 · Cited by 8 · see citing works
Understanding Misunderstandings: Evaluating LLMs on Networking Questions
Anwar, M., & Caesar, M. (2024) · ACM SIGCOMM Computer Communication Review · doi:10.1145/3717512.3717515 · Cited by 8 · see citing works
Zhong, W., Sun, M.-Y., Yao, S., Liu, Y., Peng, D., Liu, Y., Yang, K., Gao, H., Yan, H., Hao, W., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/73233 · Cited by 7 · see citing works
Hahne, J., & Carpenter, B. D. (2026) · Patient Education and Counseling · doi:10.1016/j.pec.2026.109492 · Cited by 12 · see citing works
Survey of Large Language Models for Answering Questions Across Various Fields
Shailendra, P., Ghosh, R. C., Kumar, R., & Sharma, N. (2024) · International Conference on Advanced Computing and Communication Systems (ICACCS) · doi:10.1109/icaccs60874.2024.10717078 · Cited by 9 · see citing works
Meter, A. V., Wheaton, M. G., Cosgrove, V. E., Andreadis, K., & Robertson, R. E. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000711 · Cited by 7 · see citing works
ChatGPT utilization within the building blocks of the healthcare services: A mixed-methods study
Shojaei, P., Khosravi, M., Jafari, Y., Mahmoudi, A. H., & Hassanipourmahani, H. (2024) · Digital Health · doi:10.1177/20552076241297059 · Cited by 6 · see citing works
Bahçeci, T., Elmaağaç, B., & Ceyhan, E. (2025) · International Journal of Impotence Research · doi:10.1038/s41443-025-01056-z · Cited by 6 · see citing works
A Survey of Large-Scale Deep Learning Models in Medicine and Healthcare
Chen, Z., Liu, R., Huang, S., Guo, Y., & Ren, Y. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.067809 · Cited by 6 · see citing works
Artificial intelligence generates proficient Spanish obstetrics and gynecology counseling templates
Solmonovich, R. L., Kouba, I., Quezada, O., Rodríguez-Ayala, G., Rojas, V., Bonilla, K., Espino, K., & Bracero, L. A. (2024) · AJOG Global Reports · doi:10.1016/j.xagr.2024.100400 · Cited by 6 · see citing works
БІБЛІОМЕТРИЧНИЙ АНАЛІЗ ДОСЛІДЖЕНЬ З НАВЧАННЯ ЧАТ-БОТІВ: КЛЮЧОВІ ПОНЯТТЯ ТА ТЕНДЕНЦІЇ
Liashenko, R. O., & Semerikov, S. O. (2024) · Information Technologies and Learning Tools · doi:10.33407/itlt.v101i3.5622 · Cited by 5 · see citing works
Zhang, Y., Lu, X., Luo, Y. F., Zhu, Y., & Ling, W. (2024) · JMIR Medical Informatics · doi:10.2196/63924 · Cited by 5 · see citing works
Mardikaningsih, A., Asmaroini, A. P., Lani, A., & Padillah, R. (2023) · Journal of Public Health · doi:10.1093/pubmed/fdad107 · Cited by 5 · see citing works
Vitale, J. A., McCall, A., Cina, A., Athlete Travel, S. I. G. (., Alonso, J.-M., Bender, A., Biggins, M., Charest, J., Dohi, M., Filip-Stachnik, A., et al. (2025) · Sports Medicine · doi:10.1007/s40279-025-02303-5 · Cited by 4 · see citing works
Nana, V. K., & Marshall, M. T. (2025) · AI · doi:10.3390/ai6110278 · Cited by 6 · see citing works
The use of artificial intelligence in sexual and reproductive health: a comprehensive scoping review
Mengistu, S., Tamrat, T., Betrán, A. P., Pirsch, S., Ferretti, A., Mburu, G., Alemu, M. B., Malpani, R., Barreix, M., Massonneau, C., et al. (2025) · npj Women s Health · doi:10.1038/s44294-025-00118-3 · Cited by 15 · see citing works
Etli, D. (2024) · Journal of Quality in Health Care & Economics · doi:10.23880/jqhe-16000361 · Cited by 4 · see citing works
Samaan, J. S., Yeo, Y. H., Rajeev, N. D., Ng, W. H., Srinivasan, N., & Samakar, K. (2023) · Obesity Surgery · doi:10.1007/s11695-023-06666-4 · Cited by 4 · see citing works
Can artificial intelligence models provide reliable medical counselling to fertility patients?
Alcalay, I., Weissman, A., Herman, H. G., Tsafrir, A., Friedman, M., Weiner, E., Orvieto, R., Polyzos, N. P., Dahan, M. H., Polyakov, A., et al. (2025) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2025.105237 · Cited by 3 · see citing works
Grace, B., Zhu, J., Dudakia, H., Ajao-Rotimi, F., & Colton, N. A. (2025) · Human Fertility · doi:10.1080/14647273.2025.2584673 · Cited by 5 · see citing works
Évaluation des modèles d’intelligence artificielle dans la gestion clinique de la lombalgie commune
André, F., Armengaud, P., & Couquet, G. (2025) · Kinésithérapie la Revue · doi:10.1016/j.kine.2025.02.021 · Cited by 2 · see citing works
Xue, D., & Liao, S. (2025) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s531777 · Cited by 2 · see citing works
Unlocking medical students’ adoption of AIGC tools: a multi-theory perspective
Zhou, Z., Li, Z., Li, Z., Wang, C., Qi, H., & Guo, L. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-06078-y · Cited by 2 · see citing works
Solving Situation Puzzles with Large Language Model and External Reformulation
Li, K., Chen, X., Song, T., Zhou, C., Liu, Z., Zhang, Z., Guo, J., & Shan, Q. (2025) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit65432.2025.11035296 · Cited by 2 · see citing works
Dale, R., Cheng, M., Pines, K., & Currie, M. (2025) · medRxiv · doi:10.1101/2025.05.20.25328009 · Cited by 1 · see citing works
Sood, A., Moyer, A., Jahangiri, P., Mar, D. A., Nitichaikulvatana, P., Ramreddy, N., Stolyar, L., & Lin, J. (2025) · JCR Journal of Clinical Rheumatology · doi:10.1097/rhu.0000000000002198 · Cited by 1 · see citing works
The potential of large language models in the field of infertility: a systematic review
Li, W., Ur-Rehman, A., Ge, M., Shen, L.-T., Peng, X.-Y., Zhong, K., Feng, R., Gao, S., Hu, F., Jia, Y., et al. (2025) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-025-03679-z · Cited by 1 · see citing works
Liao, Z., Huang, J., Liu, Y., Li, F., Tang, L., Cong, L., Wang, H., & Luo, S. (2025) · Aesthetic Plastic Surgery · doi:10.1007/s00266-025-05314-9 · Cited by 1 · see citing works
Taşkum, İ., Sınacı, S., Sucu, S., & Yetişkin, F. D. Y. (2025) · Scientific Reports · doi:10.1038/s41598-025-25224-9 · Cited by 1 · see citing works
Şahap, M., Özaslan, N. G., & Veizi, E. (2026) · Kastamonu Medical Journal · doi:10.66235/kumj.1906313 · Cited by 1 · see citing works
Large Language Models for Binary Health-Related Question Answering: A Zero- and Few-Shot Evaluation
Fernández-Pichel, M., Losada, D. E., & Pichel, J. C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-63772-8_29 · Cited by 1 · see citing works
ARTIFICIAL INTELLIGENCE IN MARKETING: IMPLICATIONS AND FUTURE RESEARCH DIRECTIONS
Badawy, A. M., Elhamd, E. A., Shamma, H. M., & Kolaly, H. E. (2025) · International Journal of Business & Economics (IJBE) · doi:10.58885/ijbe.v10i1.66.ab · Cited by 2 · see citing works
Taking AIm at medical misinformation
Hamilton, A. K., Goldstein, M. J., & Combs, J. C. (2023) · Fertility and Sterility · doi:10.1016/j.fertnstert.2023.06.014 · Cited by 1 · see citing works
Ray, P. P. (2023) · Fertility and Sterility · doi:10.1016/j.fertnstert.2023.07.016 · Cited by 1 · see citing works
Niszczota, P., & Rybicka, I. (2023) · Nutrition · doi:10.1016/j.nut.2023.112296 · Cited by 1 · see citing works
Reply of the authors: looking beyond “promise and peril”
Chervenak, J., Lieman, H., Blanco-Breindel, M., & Jindal, S. (2023) · Fertility and Sterility · doi:10.1016/j.fertnstert.2023.08.021
Self-citationMachine learning's impact on medical education and research: beneficial or detrimental?
Subramaniam, S. K., Gounder, P. K., Mahmood, A. A. R., Anandaram, H., Polevoy, G. G., & Pichandy, M. P. (2024) · International Journal of Public Health Science (IJPHS) · doi:10.11591/ijphs.v13i3.24330
Zhang, Y., Lu, X., Luo, Y. F., Zhu, Y., & Ling, W. (2024) · doi:10.2196/preprints.63924
Campolo, J. A., Kwon, D. Y., & Henderson, P. W. (2024) · PubMed Central
CHATGPT DALAM PRAKTIK KEPERAWATAN: REVIEW LITERATUR LENGKAP
Simbolon, I., & Limbong, A. (2024) · JURNAL KEPERAWATAN TROPIS PAPUA · doi:10.47539/jktp.v7i2.382 · Cited by 1 · see citing works
Çeker, G., Ulus, İ., & Hacıbey, İ. (2025) · Yeni Üroloji Dergisi · doi:10.33719/nju1730282
KGLMQA: enhancing medical visual question answering with knowledge graphs and LLMs
Wang, W., Liu, H., & Wei, C. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3679
Zhou, T., Peng, X., Zhang, J., Sha, C., Zhang, C., Yuan, Z., & Xie, S. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792164
Yüksel, B., Uçar, S. B., Özdemir, E., Ayık, G., Kaymakoğlu, M., & Huri, G. (2026) · Foot and Ankle Surgery · doi:10.1016/j.fas.2026.06.006
The Role of Large Language Models in Hormonal Contraception Consultation
Psilopatis, I., Emons, J., & Zwimpfer, T. A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15145543
- Authors
- Chervenak, J., Lieman, H., Blanco-Breindel, M., & Jindal, S.
- Affiliations
- Albert Einstein College of Medicine (US)
- Corresponding author
- Chervenak, Joseph
- Venue
- Fertility and Sterility
- Publisher
- Elsevier BV
- Published
- 2023-09
- Volume
- 120
- Issue
- 3
- Pages
- 575-583
- ISSN
- 0015-0282 (ISSN-L)
- OpenAlex
- W4377157938
- Cited by
- 87
- References
- 34
- Citations by year
- 2026: 6 · 2025: 35 · 2024: 32 · 2023: 14
- FWCI
- 3.52
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Fertility and Sterility (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Medicine › Reproductive Medicine › Reproductive Health and Technologies
- Keywords
- ChatGPT, large language models, fertility counseling, infertility, natural fertility, AI chatbots, factual accuracy, sentiment analysis, referencing, patient-provider communication
- MeSH terms
- Artificial Intelligence, Counseling, Fertility, Humans, Infertility, Language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review