Cited by 5Artificial Intelligence in Healthcare and EducationTechnology and Human Factors in Education and HealthArtificial Intelligence in Healthcare

Large Language Models in Spine Surgery: A Promising Technology

Open access
Shah, Romil, Schwab, Joseph H.·2025·HSS Journal®: The Musculoskeletal Journal of Hospital for Special Surgery

Abstract

Large language models (LLMs) offer potential applications across medical specialties; in spine surgery, opportunities exist to enhance patient care, streamline research, and improve clinical practice. This review explores the current and potential applications of LLMs in spine surgery, assessing their possibilities and limitations across patient education, research, clinical practice, and perioperative assistance.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/15563316251340696

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Fabricated or hallucinated citations can create a false evidence base that is difficult for a busy clinician or a member of the lay public to verify.

    “Fabricated or hallucinated citations can create a false evidence base that is difficult for a busy clinician, much less a member of the lay public, to verify.8”

    From Large Language Model Hallucinations in Spine Surgery: A Comparative Analysis of Clinician vs Patient-Level Prompts (2026) · cites this paper as [8]

    The Clinical Practice section (page unavailable) reports that GPT-4 generated incorrect citations in half of its responses to neurosurgical questions, and the Discussion warns that hallucinations can produce misleading information. The paper does not say that these citations create a false evidence base or that busy clinicians or members of the public have difficulty verifying them. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • LLMs are being explored for utility in spine surgery research and patient education.

    “LLMs are being explored for their utility in spine surgery research and patient education, offering to simplify complex medical concepts for patients trying to understand their own conditions, improving healthcare literacy.7,8”
  • The utility of LLMs is limited by a significant and well-documented flaw: hallucinations.

    “The utility of these models is limited by a significant and well-documented flaw: hallucinations.8”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 31

  1. [1]1. Agaronnik ND, Kwok A, Schoenfeld AJ, Lindvall C. Natural language processing for automated surveillance of intraoperative neuromonitoring in spine surgery. J Clin Neurosci . 2022;97:121-126.
  2. [2]2. Ahmed W, Saturno M, Rajjoub R, et al. ChatGPT versus NASS clinical guidelines for degenerative spondylolisthesis: a comparative analysis. Eur Spine J . 2024;33(11):4182-4203.
  3. [3]3. Al Rawi ZM, Kirby BJ, Albrecht PA, Nuelle JAV, London DA. Experimenting with the new frontier: artificial intelligence-powered chat bots in hand surgery. Hand . 2024;2024:15589447241238372.
  4. [5]5. Biswas S, McMenemy L, Sarkar V, et al. Natural language processing for the automated detection of intra-operative elements in lumbar spine surgery. Front Surg . 2023;10: 1271775.
  5. [6]6. Blease C. Open AI meets open notes: surveillance capitalism, patient privacy and online record access. J Med Ethics . 2024;50(2):84-89.
  6. [7]7. Brameier DT, Alnasser AA, Carnino JM, Bhashyam AR, von Keudell AG, Weaver M. Artificial intelligence in orthopaedic surgery: can a large language model 'write' a believable orthopaedic journal article?. J Bone Joint Surg Am . 2023;105(17):1388-1392.
  7. [8]8. Butler JJ, Harrington MC, Tong Y, et al. From jargon to clarity: improving the readability of foot and ankle radiology reports with an artificial intelligence large language model. Foot Ankle Surg . 2024;30(4):331-337.
  8. [12]12. Dwyer T, Hoit G, Burns D, et al. Use of an artificial intelligence conversational agent (chatbot) for hip arthroscopy patients following surgery. Arthrosc Sports Med Rehabil . 2023;5(2):e495-e505.
  9. [13]13. Fabbri D. Using large language models like ChatGPT in healthcare: make sure you understand the risks (press release). 2023. Available at: https://www.imprivata.com/company/ press/using-large-language-models-chatgpt-healthcare-makesure-you-understand-risks. Accessed January 5, 2025.
  10. [14]14. Huang KT, Mehta NH, Gupta S, See AP, Arnaout O. Evaluation of the safety, accuracy, and helpfulness of the GPT-4.0 large language model in neurosurgery. J Clin Neurosci . 2024;123:151-156.
  11. [16]16. questions regarding spine surgery. J Bone Joint Surg Am . 2024;106(12):1136-1142.
  12. [17]17. Kuckelman IJ, Yi PH, Bui M, Onuh I, Anderson JA, Ross AB. Assessing AI-powered patient education: a case study in radiology. Acad Radiol . 2024;31(1):338-342.
  13. [19]19. Lawrence KW, Habibi AA, Ward SA, Lajam CM, Schwarzkopf R, Rozell JC. Human versus artificial intelligence-generated arthroplasty literature: a single-blinded analysis of perceived communication, quality, and authorship source. Int J Med Robot . 2024;20(1):e2621.
  14. [21]21. Maroteau G, An JS, Murgier J, Hulet C, Ollivier M, Ferreira A. Evaluation of the impact of large language learning models on articles submitted to Orthopaedics & Traumatology: Surgery & Research (OTSR): a significant increase in the use of artificial intelligence in 2023. Orthop Traumatol Surg Res . 2023;109(8):103720.
  15. [22]22. Mejia MR, Arroyave JS, Saturno M, et al. Use of ChatGPT for determining clinical and surgical treatment of lumbar disc herniation with radiculopathy: a North American Spine Society guideline comparison. Neurospine . 2024;21(1):149-158.
  16. [24]24. Meskó B, Topol EJ. The imperative for regulatory oversight of large language models (or generative AI) in healthcare. NPJ Digit Med . 2023;6(1):120.
  17. [27]27. Rajjoub R, Arroyave JS, Zaidat B, et al. ChatGPT and its role in the decision-making for the diagnosis and treatment of lumbar spinal stenosis: a comparative analysis and narrative review. Global Spine J . 2024;14(3):998-1017.
  18. [29]29. Sánchez-Rosenberg G, Magnéli M, Barle N, et al. ChatGPT-4 generates orthopedic discharge documents faster than humans maintaining comparable quality: a pilot study of 6 cases. Acta Orthop . 2024;95:152-156.
  19. [30]30. Sastry RA, Setty A, Liu DD, et al. Natural language processing augments comorbidity documentation in neurosurgical inpatient admissions. PLoS One . 2024;19(5):e0303519.
  20. [31]31. Shah R, Jayakumar P, Trutner Z, Bini S. Practical artificial intelligence: realistic ways it can help orthopaedic surgeons and the challenges it will face. Instr Course Lect . 2023;72:101-110.
  21. [32]32. Shah RF, Bini S, Vail T. Data for registry and quality review can be retrospectively collected using natural language processing from unstructured charts of arthroplasty patients. Bone Joint J . 2020;102-B(7 suppl B):99-104.
  22. [33]33. Singhal K, Azizi S, Tu T, et al. Large language models encode clinical knowledge. Nature . 2023;620(7972):172-180.
  23. [35]35. Chatterjee S, Bhattacharya M, Pal S, Lee SS, Chakraborty C. ChatGPT and large language models in orthopedics: from education and surgery to research. J Exp Orthop . 2023;10(1):128. https://doi.org/10.1186/s40634-023-00700-1. · DOI
  24. [36]36. Sosa BR, Cung M, Suhardi VJ, et al. Capacity for large language model chatbots to aid in orthopedic management, research, and patient queries. J Orthop Res . 2024;42(6):1276-1282.
  25. [37]37. Stroop A, Stroop T, Zawy Alsofy S, et al. Large language models: are artificial intelligence-based chatbots a reliable source of patient information for spinal surgery? Eur Spine J . 2023;33(11):4135-4143.
  26. [39]39. van Buchem MM, Boosman H, Bauer MP, Kant IMJ, Cammel SA, Steyerberg EW. The digital scribe in clinical practice: a scoping review and research agenda. NPJ Digit Med . 2021;4(1):57.
  27. [42]42. Vaswani A, Shazeer N, Parmar N, Uszkoreit N, Jones L, Gomez AN. Attention is all you need. 2017. https://doi. org/10.48550/arXiv.1706.03762. · DOI · Paper page
  28. [43]43. Zaidat B, Lahoti YS, Yu A, Mohamed KS, Cho SK, Kim JS. Artificially intelligent billing in spine surgery: an analysis of a large language model. Global Spine J . 2023;15:1113-1120.
  29. [44]44. Zaidat B, Shrestha N, Rosenberg AM, et al. Performance of a large language model in the generation of clinical guidelines for antibiotic prophylaxis in spine surgery. Neurospine . 2024;21(1):128-146.
  30. [45]45. Zaki M, O'Sullivan L, Devane D, Segurado R, McAuliffe E. Factors influencing the statistical planning, design, conduct, analysis and reporting of trials in health care: a systematic review. Contemp Clin Trials Commun . 2022;26:100897.
  31. [46]46. Zhang S, Liau ZQG, Tan KLM, Chua WL. Evaluating the accuracy and relevance of ChatGPT responses to frequently asked questions regarding total knee replacement. Knee Surg Relat Res . 2024;36(1):15.

Cited by

Sorted by citations

Authors
Shah, R., & Schwab, J. H.
Affiliations
Cedars-Sinai Medical Center (US)
Corresponding author
Shah, Romil
Venue
HSS Journal®: The Musculoskeletal Journal of Hospital for Special Surgery
Published
2025-05-29
Volume
21
Issue
3
Pages
325-330
ISSN
  • 1556-3316 (ISSN-L)
  • 1556-3324
OpenAlex
W4410874125
Cited by
5
References
9
Citations by year
2026: 5
FWCI
0.26
Type
journal article
Language
en
Open access
Locations
  • HSS Journal® The Musculoskeletal Journal of Hospital for Special Surgery (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
large language models, spinal surgery, patient education, clinical practice, medical research, artificial intelligence in healthcare

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review