Cited by 117Artificial Intelligence in Healthcare and EducationArtificial Intelligence ApplicationsEthics and Social Impacts of AI

Awareness and Use of ChatGPT and Large Language Models: A Prospective Cross-sectional Global Survey in Urology

Eppler, Michael, Ganjavi, Conner, Ramacciotti, Lorenzo Storino, Piazza, Pietro, Rodler, Severin, Checcucci, Enrico, Gomez Rivas, Juan, Kowalewski, Karl F. +14 more·2024·European Urology

Abstract

Background Since its release in November 2022, ChatGPT has captivated society and shown potential for various aspects of health care.Objective To investigate potential use of ChatGPT, a large language model (LLM), in urology by gathering opinions from urologists worldwide.Design, setting, and participants An open web-based survey was distributed via social media and e-mail chains to urologists between April 20, 2023 and May 5, 2023. Participants were asked to answer questions related to their knowledge and experience with artificial intelligence, as well as their opinions of potential use of ChatGPT/LLMs in research and clinical practice.Outcome measurements and statistical analysis Data are reported as the mean and standard deviation for continuous variables, and the frequency and percentage for categorical variables. Charts and tables are used as appropriate, with descriptions of the chart types and the measures used. The data are reported in accordance with the Checklist for Reporting Results of Internet E-Surveys (CHERRIES).Results and limitations A total of 456 individuals completed the survey (64% completion rate). Nearly half (47.7%) reported that they use ChatGPT/LLMs in their academic practice, with fewer using the technology in clinical practice (19.8%). More than half (62.2%) believe there are potential ethical concerns when using ChatGPT for scientific or academic writing, and 53% reported that they have experienced limitations when using ChatGPT in academic practice.Conclusions Urologists recognise the potential of ChatGPT/LLMs in research but have concerns regarding ethics and patient acceptance. There is a desire for regulations and guidelines to ensure appropriate use. In addition, measures should be taken to establish rules and guidelines to maximise safety and efficiency when using this novel technology.Patient summary A survey asked 456 urologists from around the world about using an artificial intelligence tool called ChatGPT in their work. Almost half of them use ChatGPT for research, but not many use it for patients care. The resonders think ChatGPT could be helpful, but they worry about problems like ethics and want rules to make sure it's used safely.

Integrity signals

Registry

Crossref · 10.1016/j.eururo.2023.10.014

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Eppler, M., Ganjavi, C., Ramacciotti, L. S., Piazza, P., Rodler, S., Checcucci, E., Gomez Rivas, J., Kowalewski, K. F., Belenchón, I. R., Puliatti, S., Taratkin, M., Veccia, A., Baekelandt, L., Teoh, J. Y.-C., Somani, B. K., Wroclawski, M., Abreu, A., Porpiglia, F., Gill, I. S., Murphy, D. G., Canes, D., & Cacciamani, G. E.
Affiliations
  • University of Southern California (US)
  • IRCCS Azienda Ospedliero-Universitaria di Bologna Policlinico di Sant'Orsola (IT)
  • LMU Klinikum (DE)
  • Candiolo Cancer Institute (IT)
  • Heidelberg University (DE)
  • University of Modena and Reggio Emilia (IT)
  • Sechenov University (RU)
  • Azienda Ospedaliera Universitaria Integrata Verona (IT)
  • Universitair Ziekenhuis Leuven (BE)
  • Chinese University of Hong Kong (HK)
  • University Hospital Southampton NHS Foundation Trust (GB)
  • Hospital Israelita Albert Einstein (BR)
  • The University of Melbourne (AU)
  • Lahey Hospital and Medical Center (US)
Corresponding author
Cacciamani, Giovanni E.
Venue
European Urology
Publisher
Elsevier BV
Published
2024-02
Volume
85
Issue
2
Pages
146-153
ISSN
0302-2838 (ISSN-L)
OpenAlex
W4388347957
Cited by
117
References
35
Citations by year
2026: 27 · 2025: 35 · 2024: 50 · 2023: 4
FWCI
4.62
Type
journal article
Language
en
Open access
closed
Locations
  • European Urology (publishedVersion)
  • PubMed (publishedVersion)
  • Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion)
  • IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion)
  • Institutional Research Information System University of Turin (University of Turin) (submittedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
ChatGPT, large language models, urologists, artificial intelligence in healthcare, AI use in research, ethical considerations, scientific writing, patient acceptance, urology
MeSH terms
Artificial Intelligence, Cross-Sectional Studies, Humans, Language, Prospective Studies, Urology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review