Not the Last Word: ChatGPT Can’t Perform Orthopaedic Surgery
Open accessAbstract
1Department of Orthopaedic Surgery, University of Pennsylvania, Philadelphia, PA, USA J. Bernstein, University of Pennsylvania, 424 Stemmler Hall, Philadelphia, PA 19104, USA, Email: [email protected] A note from the Editor-in-Chief: We are pleased to present to readers of Clinical Orthopaedics and Related Research® the next “Not the Last Word”. The goal of this section is to explore timely and controversial issues that affect how orthopaedic surgery is taught, learned, and practiced. We welcome reader feedback on all of our columns and articles; please send your comments to[email protected]. The author certifies that there are no funding or commercial associations (consultancies, stock ownership, equity interest, patent/licensing arrangements, etc.) that might pose a conflict of interest in connection with the submitted article related to the author or any immediate family members. All ICMJE Conflict of Interest Forms for authors and Clinical Orthopaedics and Related Research® editors and board members are on file with the publication and can be viewed on request. The opinions expressed are those of the writer, and do not reflect the opinion or policy of CORR® or The Association of Bone and Joint Surgeons®.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
During surgery, ChatGPT functions as a virtual assistant, providing real-time surgical navigation information and facilitating data recording for convenient postoperative use.
“During surgery, ChatGPT functions as a virtual assistant, providing real-time surgical navigation information and facilitating data recording for convenient postoperative use.2125)”
From Application of ChatGPT for Orthopedic Surgeries and Patient Care (2024) · cites this paper as [25]
ChatGPT can help in personalized preoperative planning and precise implementation.
“ChatGPT can help in personalized preoperative planning and precise implementation.”
From Application of ChatGPT for Orthopedic Surgeries and Patient Care (2024) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Parvizi, J., Tan, T. L., Goswami, K., Higuera, C. A., Valle, C. J. D., Chen, A. F., & Shohat, N. (2018) · The Journal of Arthroplasty · doi:10.1016/j.arth.2018.02.078 · Cited by 2,180 · see citing works
Bernstein, J. M., Kupperman, E., Kandel, L. A., & Ahn, J. (2016) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-15-00750 · Cited by 36 · see citing works
Self-citationThe Sciences in Enlightened Europe
Clark, W. G., Golinski, J., & Schaffer, S. (1999) · Cited by 13 · see citing works
Medicine and the Doctor in Word and Epigram
Jordan, S. M. (1953) · New England Journal of Medicine · doi:10.1056/nejm195305212482101 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- McLuhan M. The Medium is the Message: An Inventory of Effects. Gingko Press; 2001.
Cited by
Sorted by citations
Lisacek-Kiosoglous, A. B., Powling, A. S., Fontalis, A., Gabr, A., Mazomenos, E., & Haddad, F. S. (2023) · Bone & Joint Research · doi:10.1302/2046-3758.127.bjr-2023-0111.r1 · Cited by 184 · see citing works
Will ChatGPT/GPT-4 be a Lighthouse to Guide Spinal Surgeons?
He, Y., Tang, H., Wang, D., Gu, S., Ni, G., & Wu, H. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03206-0 · Cited by 62 · see citing works
Watters, C., & Lemański, M. K. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1224976 · Cited by 57 · see citing works
Abi‐Rafeh, J., Xu, H. H., Kazan, R., Tevlin, R., & Furnas, H. J. (2023) · Aesthetic Surgery Journal · doi:10.1093/asj/sjad260 · Cited by 52 · see citing works
Cheng, K., Li, Z., Li, C., Xie, R., Guo, Q., He, Y., & Wu, H. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03207-z · Cited by 50 · see citing works
ChatGPT encounters multiple opportunities and challenges in neurosurgery
Kuang, Y.-R., Zou, M., Niu, H.-Q., Zheng, B., Zhang, T., & Zheng, B. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000571 · Cited by 49 · see citing works
Johns, W. L., Kellish, A. S., Farronato, D. M., Ciccotti, M. G., & Hammoud, S. (2024) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2024.100893 · Cited by 45 · see citing works
Application of ChatGPT for Orthopedic Surgeries and Patient Care
Morya, V. K., Lee, H.-W., Shahid, H., Magar, A. G., Lee, J.-H., Kim, J.-H., Jun, L., & Noh, K.-C. (2024) · Clinics in Orthopedic Surgery · doi:10.4055/cios23181 · Cited by 44 · see citing works
A descriptive study based on the comparison of ChatGPT and evidence-based neurosurgeons
Liu, J., Zheng, J., Cai, X., Wu, D., & Yin, C. (2023) · iScience · doi:10.1016/j.isci.2023.107590 · Cited by 44 · see citing works
Draschl, A., Hauer, G., Fischerauer, S., Kogler, A., Leitner, L., Andreou, D., Leithner, A., & Sadoghi, P. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12206655 · Cited by 30 · see citing works
Ghanem, D., Covarrubias, O., Raad, M., LaPorte, D. M., & Shafiq, B. (2023) · JBJS Open Access · doi:10.2106/jbjs.oa.23.00103 · Cited by 30 · see citing works
Can generative artificial intelligence pass the orthopaedic board examination?
Isleem, U. N., Zaidat, B., Ren, R., Geng, E. A., Burapachaisri, A., Tang, J. E., Kim, J. S., & Cho, S. K. (2024) · Journal of Orthopaedics · doi:10.1016/j.jor.2023.10.026 · Cited by 19 · see citing works
Large Language Models in Orthopaedic Trauma
Merrell, L. A., Fisher, N. D., & Egol, K. A. (2023) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.23.00395 · Cited by 12 · see citing works
Xu, A. Y., Singh, M., Balmaceno-Criss, M., Oh, A., Leigh, D., Daher, M., Alsoof, D., McDonald, C. L., Diebo, B. G., & Daniels, A. H. (2025) · Journal of orthopaedic surgery · doi:10.1177/10225536241268789 · Cited by 11 · see citing works
Analyzing the Surgical Knowledge of ChatGPT in Undergraduate Written Medical Examination
Reddy, J. S., Usha, A. P., Appavu, R., & Surapaneni, K. M. (2023) · Indian Journal of Surgery · doi:10.1007/s12262-023-03776-2 · Cited by 8 · see citing works
GPT-based chatbot tools are still unreliable in the management of prosthetic joint infections
Bortoli, M., Fiore, M., Tedeschi, S., Oliveira, V. C. C., de Sousa, R. J. G., Bruschi, A., Campanacci, D. A., Viale, P., PAOLIS, M. D., & Sambri, A. (2024) · MUSCULOSKELETAL SURGERY · doi:10.1007/s12306-024-00846-w · Cited by 7 · see citing works
ChatGPT and Bard in Plastic Surgery: Hype or Hope?
Labouchère, A., & Raffoul, W. (2024) · Surgeries · doi:10.3390/surgeries5010006 · Cited by 8 · see citing works
Covarrubias, O., Ghanem, D., Murdock, C. J., Domes, C. M., & Shafiq, B. (2025) · OTA International The Open Access Journal of Orthopaedic Trauma · doi:10.1097/oi9.0000000000000417 · Cited by 6 · see citing works
Karnuta, J. M. (2023) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000002741 · Cited by 6 · see citing works
Evaluation of ChatGPT’s Performance in the Turkish Board of Orthopaedic Surgery Examination
Yiğitbay, A. (2024) · Medical Bulletin of Haseki · doi:10.4274/haseki.galenos.2024.10038 · Cited by 6 · see citing works
CORR Insights®: Can Artificial Intelligence Improve the Readability of Patient Education Materials?
Bernstein, J. M. (2023) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000002702 · Cited by 3 · see citing works
Self-citationA critical analysis of use of ChatGPT in orthopaedics
Ray, P. P. (2023) · International Orthopaedics · doi:10.1007/s00264-023-05916-5 · Cited by 2 · see citing works
The American Board of Orthopaedic Surgery: The Past, Present, and Future
Garvin, K. L., Porter, S. E., & Kang, J. D. (2025) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.24.00633 · Cited by 1 · see citing works
The Impact of ChatGPT on Surgical Practice and Research: Embracing AI’s Transformative Potential
Ray, P. P., & Majumder, P. (2023) · Indian Journal of Surgery · doi:10.1007/s12262-023-03861-6 · Cited by 1 · see citing works
Análisis bibliométrico de ChatGPT como herramienta emergente en la salud
Ascencio-Medina, A., Solano, C., Prieto-Angarita, G., Jaramillo-Sierra, M., & Melo-Pedroza, V. (2024) · Revista Urología Colombiana / Colombian Urology Journal · doi:10.24875/ruc.23000099 · Cited by 1 · see citing works
Assessing ChatGPT's Potential: A Critical Analysis and Future Directions in Total Joint Arthroplasty
Ray, P. P., & Majumder, P. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.05.057 · Cited by 1 · see citing works
SONNET #29888: ChatGPT Finds Poetry in Anterior Cruciate Ligament Reconstruction and Return to Sport
Liu, J. W., & McCulloch, P. C. (2024) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2023.09.012
Not the Last Word: I Was Wrong—AI May Be Coming for Orthopaedic Jobs, Too
Bernstein, J. M. (2026) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000003791
Self-citationBernstein, J. M., & Carey, J. L. (2026) · Journal of Cartilage & Joint Preservation · doi:10.1016/j.jcjp.2026.100317
Self-citation
- Authors
- Bernstein, J.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Bernstein, Joseph
- ORCID
- Bernstein, Joseph
- Venue
- Clinical Orthopaedics & Related Research
- Published
- 2023-03-03
- Volume
- 481
- Issue
- 4
- Pages
- 651-655
- ISSN
- 0009-921X (ISSN-L)
- 1528-1132
- PMC
- PMC10013616
- OpenAlex
- W4323295362
- Cited by
- 29
- References
- 4
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 7 · 2023: 17
- FWCI
- 1.16
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Clinical Orthopaedics and Related Research (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Physical Sciences › Engineering › Biomedical Engineering › Anatomy and Medical Technology
- Keywords
- ChatGPT, large language models, orthopedic surgery, artificial intelligence in surgery, surgical training
- MeSH terms
- Humans, Orthopedics, Orthopedic Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review