The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Awareness and Use of ChatGPT and Large Language Models: A Prospective Cross-sectional Global Survey in Urology
Abstract
Background Since its release in November 2022, ChatGPT has captivated society and shown potential for various aspects of health care.Objective To investigate potential use of ChatGPT, a large language model (LLM), in urology by gathering opinions from urologists worldwide.Design, setting, and participants An open web-based survey was distributed via social media and e-mail chains to urologists between April 20, 2023 and May 5, 2023. Participants were asked to answer questions related to their knowledge and experience with artificial intelligence, as well as their opinions of potential use of ChatGPT/LLMs in research and clinical practice.Outcome measurements and statistical analysis Data are reported as the mean and standard deviation for continuous variables, and the frequency and percentage for categorical variables. Charts and tables are used as appropriate, with descriptions of the chart types and the measures used. The data are reported in accordance with the Checklist for Reporting Results of Internet E-Surveys (CHERRIES).Results and limitations A total of 456 individuals completed the survey (64% completion rate). Nearly half (47.7%) reported that they use ChatGPT/LLMs in their academic practice, with fewer using the technology in clinical practice (19.8%). More than half (62.2%) believe there are potential ethical concerns when using ChatGPT for scientific or academic writing, and 53% reported that they have experienced limitations when using ChatGPT in academic practice.Conclusions Urologists recognise the potential of ChatGPT/LLMs in research but have concerns regarding ethics and patient acceptance. There is a desire for regulations and guidelines to ensure appropriate use. In addition, measures should be taken to establish rules and guidelines to maximise safety and efficiency when using this novel technology.Patient summary A survey asked 456 urologists from around the world about using an artificial intelligence tool called ChatGPT in their work. Almost half of them use ChatGPT for research, but not many use it for patients care. The resonders think ChatGPT could be helpful, but they worry about problems like ethics and want rules to make sure it's used safely.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent international surveys indicate that more than 80% of university students have used generative AI tools for academic purposes”
From From adoption to interaction: examining human-GenAI engagement patterns, ethical tensions, and educational trade-offs in nursing education (2026) · cites this paper as [20]
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
ChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
Social media and health care professionals: benefits, risks, and best practices.
(2014) · PubMed Central · Cited by 1,011
ChatGPT and other large language models are double-edged swords
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023) · Radiology · doi:10.1148/radiol.230163 · Cited by 1,008
What ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828
Social Media: A Review and Tutorial of Applications in Medicine and Health Care
Grajales III, F. J., Sheps, S., Ho, K., Novak-Lauscher, H., & Eysenbach, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2912 · Cited by 737
Generating scholarly content with ChatGPT: Ethical challenges for medical publishing
Liebrenz, M., Schleifer, R., Buadze, A., Bhugra, D., & Smith, A. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00019-5 · Cited by 594
Welcome to the Era of ChatGPT et al.: The Prospects of Large Language Models
Teubner, T., Flath, C. M., Weinhardt, C., van der Aalst, W., & Hinz, O. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00795-x · Cited by 384
Using ChatGPT to write patient clinic letters
Ali, S. R., Dobbs, T. D., Hutchings, H. A., & Whitaker, I. S. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00048-1 · Cited by 375
Hirosawa, T., Harada, Y., Yokose, M., Sakamoto, T., Kawamura, R., & Shimizu, T. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043378 · Cited by 351
ChatGPT: Is this version good for healthcare and research?
Vaishya, R., Misra, A., & Vaish, A. (2023) · Diabetes & Metabolic Syndrome: Clinical Research & Reviews · doi:10.1016/j.dsx.2023.102744 · Cited by 293
Hopkins, A. M., Logan, J. M., Kichenadasse, G., & Sorich, M. J. (2023) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkad010 · Cited by 259
Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making
Rao, A., Kim, J., Kamineni, M., Pang, M., Lie, W., & Succi, M. D. (2023) · doi:10.1101/2023.02.02.23285399 · Cited by 257
Eysenbach, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2042 · Cited by 246
A Global Survey on the Impact of COVID-19 on Urological Services
Teoh, J. Y., Keat, W. O. L., González‐Padilla, D. A., Castellani, D., Dubin, J. M., Esperto, F., Campi, R., Gudaru, K., Talwar, R., Okhunov, Z., et al. (2020) · European Urology · doi:10.1016/j.eururo.2020.05.025 · Cited by 174
Self-citationArtificial intelligence and neural networks in urology: current clinical applications
Checcucci, E., Riccardo Autorino, B., Cacciamani, G. E., Amparore, D., CILLIS, S. D., Piana, A., Piazzolla, P., Vezzetti, E., Fiori, C., Veneziano, D., et al. (2020) · Minerva Urologica e Nefrologica · doi:10.23736/s0393-2249.19.03613-0 · Cited by 150
Self-citationWen, J., & Wang, W. (2023) · Clinical and Translational Medicine · doi:10.1002/ctm2.1207 · Cited by 115
Exploring ChatGPT for information of cardiopulmonary resuscitation
Ahn, C. (2023) · Resuscitation · doi:10.1016/j.resuscitation.2023.109729 · Cited by 112
Evaluating the use of large language model in identifying top research questions in gastroenterology
Lahat, A., Shachar, E., Avidan, B., Shatz, Z., Glicksberg, B. S., & Klang, E. (2023) · Scientific Reports · doi:10.1038/s41598-023-31412-2 · Cited by 111
How Nature readers are using ChatGPT
Owens, B. (2023) · Nature · doi:10.1038/d41586-023-00500-8 · Cited by 109
Application of ChatGPT in Cosmetic Plastic Surgery: Ally or Antagonist?
Gupta, R., Pande, P., Herzog, I., Weisberger, J. S., Chao, J. A. K., Chaiyasate, K., & Lee, E. S. (2023) · Aesthetic Surgery Journal · doi:10.1093/asj/sjad042 · Cited by 86
Artificial intelligence-based text generators in hepatology: ChatGPT is just the beginning
Ge, J., & Lai, J. C. (2023) · Hepatology Communications · doi:10.1097/hc9.0000000000000097 · Cited by 83
Gabrielson, A. T., Odisho, A. Y., & Canes, D. (2023) · Journal of Urology · doi:10.1097/ju.0000000000003383 · Cited by 76
Self-citationChatGPT: temptations of progress
Doshi, R. H., Bajaj, S. S., & Krumholz, H. M. (2023) · The American Journal of Bioethics · doi:10.1080/15265161.2023.2180110 · Cited by 58
The use of ChatGPT and other large language models in surgical science
Janssen, B. V., Kazemier, G., & Besselink, M. G. (2023) · BJS Open · doi:10.1093/bjsopen/zrad032 · Cited by 53
Consulting ChatGPT: Ethical dilemmas in language model artificial intelligence
Beltrami, E. J., & Grant-Kels, J. M. (2024) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2023.02.052 · Cited by 51
Cacciamani, G. E., Bassi, S., Sebben, M. A., Marcer, A., Russo, G. I., Cocci, A., Dell’Oglio, P., Medina, L. G., Nassiri, N., Tafuri, A., et al. (2019) · European Urology Oncology · doi:10.1016/j.euo.2019.07.002 · Cited by 46
Self-citationThe Importance of Proper Use of ChatGPT in Medical Writing
Koo, M. (2023) · Radiology · doi:10.1148/radiol.230312 · Cited by 46
Checcucci, E., Verri, P., Amparore, D., Cacciamani, G. E., Fiori, C., Breda, A., & Porpiglia, F. (2023) · Minerva Urology and Nephrology · doi:10.23736/s2724-6051.23.05326-0 · Cited by 32
Self-citationNuclear Medicine from a Novel Perspective: Buvat and Weber Talk with OpenAI’s ChatGPT
Buvat, I., & Weber, W. (2023) · Journal of Nuclear Medicine · doi:10.2967/jnumed.123.265636 · Cited by 27
Can knowledge management enhance technology adoption in healthcare? A review of the literature
Williams, I., & Dickinson, H. (2010) · Evidence & Policy · doi:10.1332/174426410x524811 · Cited by 17
Cacciamani, G. E., Sebben, M. A., Tafuri, A., Nassiri, N., Cocci, A., Russo, G. I., Hung, A. J., Abreu, A. L., Gill, I. S., & Artibani, W. (2021) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.2250 · Cited by 14
Self-citationDullea, A. D., Gonzalez, D. C., Reddy, R., Diaz, P., Zucker, I. J., Delgado, J., Nackeeran, S., Blachmann-Braun, R., Jones, L., Sathe, A. A., et al. (2022) · Cureus · doi:10.7759/cureus.22502 · Cited by 14
Research works printed but not linked: 2
- Cacciamani, 2021, Asking “Dr. Google” for a second opinion: the devil is in the details. Eur Urol, Focus, 7, 479
- Cacciamani GE, Eppler MB, Ganjavi C, et al. Development of the ChatGPT, Generative Artificial Intelligence and Natural Large Language Models for Accountable Reporting and Use (CANGARU) guidelines. arXiv preprint. https://arxiv.org/abs/2307.08974. · arXiv
Cited by
Sorted by citations
ChatGPT awareness, acceptance, and adoption in higher education: The role of trust as a cornerstone
Shahzad, M. F., Xu, S., & Javed, I. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00478-x · Cited by 274
“In the context of ChatGPT, awareness encompasses understanding its capabilities, applications, and limitations (Eppler et al., 2023).”
BackgroundKıyak, Y. S., & Emekli, E. (2024) · Postgraduate Medical Journal · doi:10.1093/postmj/qgae065 · Cited by 169
Miao, J., Thongprayoon, C., Suppadungsuk, S., Garcia Valencia, O. A., Qureshi, F., & Cheungpasitporn, W. (2023) · Clinics and Practice · doi:10.3390/clinpract14010008 · Cited by 111
“%) thinking there are potential ethical concerns when using ChatGPT for scientific or academic writing [38].”
BackgroundHershenhouse, J. S., Mokhtar, D., Eppler, M., Rodler, S., Ramacciotti, L. S., Ganjavi, C., Hom, B. M., Davis, R. J., Tran, J., Russo, G. I., et al. (2024) · Prostate Cancer and Prostatic Diseases · doi:10.1038/s41391-024-00826-y · Cited by 102
“…attendings and residents through social media channels and to those who had previously given their consent to be contacted for future research after participating in a survey on the use of GPT in urology, fi ndings of which were published in European Urology [16] available Sep 8-Oct 22, 2023.”
Self-citationLarge language model use in clinical oncology
Carl, N., Schramm, F., Haggenmüller, S., Kather, J. N., Hetz, M. J., Wies, C., Michel, M. S., Wessels, F., & Brinker, T. J. (2024) · npj Precision Oncology · doi:10.1038/s41698-024-00733-4 · Cited by 85
“TrustintheaccuracyofLLM-generatedinformationissplit,with 29.6%ofparticipantsexpressingbothtrustandscepticism 65 .”
Influential
Metadata
- Authors
- Eppler, M., Ganjavi, C., Ramacciotti, L. S., Piazza, P., Rodler, S., Checcucci, E., Gomez Rivas, J., Kowalewski, K. F., Belenchón, I. R., Puliatti, S., Taratkin, M., Veccia, A., Baekelandt, L., Teoh, J. Y.-C., Somani, B. K., Wroclawski, M., Abreu, A., Porpiglia, F., Gill, I. S., Murphy, D. G., Canes, D., & Cacciamani, G. E.
- Affiliations
- University of Southern California (US)
- IRCCS Azienda Ospedliero-Universitaria di Bologna Policlinico di Sant'Orsola (IT)
- LMU Klinikum (DE)
- Candiolo Cancer Institute (IT)
- Heidelberg University (DE)
- University of Modena and Reggio Emilia (IT)
- Sechenov University (RU)
- Azienda Ospedaliera Universitaria Integrata Verona (IT)
- Universitair Ziekenhuis Leuven (BE)
- Chinese University of Hong Kong (HK)
- University Hospital Southampton NHS Foundation Trust (GB)
- Hospital Israelita Albert Einstein (BR)
- The University of Melbourne (AU)
- Lahey Hospital and Medical Center (US)
- Corresponding author
- Cacciamani, Giovanni E.
- ORCID
- Eppler, Michael
- Ganjavi, Conner
- Ramacciotti, Lorenzo Storino
- Piazza, Pietro
- Rodler, Severin
- Checcucci, Enrico
- Kowalewski, Karl F.
- Puliatti, Stefano
- Taratkin, Mark
- Veccia, Alessandro
- Baekelandt, Loïc
- Teoh, Jeremy Y.-C.
- Somani, Bhaskar K.
- Wroclawski, Marcelo
- Abreu, Andre
- Porpiglia, Francesco
- Gill, Inderbir S.
- Murphy, Declan G.
- Canes, David
- Cacciamani, Giovanni E.
- Venue
- European Urology
- Publisher
- Elsevier BV
- Published
- 2024-02
- Volume
- 85
- Issue
- 2
- Pages
- 146-153
- ISSN
- 0302-2838 (ISSN-L)
- OpenAlex
- W4388347957
- Cited by
- 117
- References
- 35
- Citations by year
- 2026: 27 · 2025: 35 · 2024: 50
- FWCI
- 4.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- European Urology (publishedVersion)
- PubMed (publishedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion)
- Institutional Research Information System University of Turin (University of Turin) (submittedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- ChatGPT, large language models, urologists, artificial intelligence in healthcare, AI use in research, ethical considerations, scientific writing, patient acceptance, urology
- MeSH terms
- Artificial Intelligence, Cross-Sectional Studies, Humans, Language, Prospective Studies, Urology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review