Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

A pre-trained language model approach for triaging surgical patients for preoperative anesthesia clinics

Open access

Abstract

Purpose: Preoperative anesthesia evaluation is a crucial step in ensuring patient safety and optimizing perioperative care. A heterogenous patient population requiring varying levels of assessment often leads to inefficiencies and additional resource allocation. This study proposes using pre-trained language models to assist in triaging the appropriate degree of preoperative anesthesia evaluation for surgical patients. Methods: Retrospective institutional data were obtained from surgical patients evaluated at a single center preoperative anesthesia care clinic. The performance of four pre-trained language models (RoBERTa, BERT, ClinicalBERT, and PubMedBERT) in the classification of which patients would be appropriate for a nursing preoperative phone call versus in-person clinician evaluation was assessed using F1-score, area under the receiver operating characteristics curve (AUC), specificity, sensitivity, and average precision. For each pre-trained language model, three different data input combinations were assessed: (1) diagnosis codes (D); (2) clinical text data (N); and (3) diagnosis codes and clinical text (D + N). The data were split into training (75%) and test set (25%). Results: There were 1,761 unique patients, with an average of 12 notes per patient and a total of 46,922 clinical documents, included in the analysis. The AUC range between the four language models was highest in the D + N analyses (0.70 – 0.74), lower in the N analyses (0.58 – 0.73) and lowest in the D analyses (0.57 – 0.62). RoBERTa had the highest score compared to the other language models for all data types. Conclusions: Automating integrated analysis using pre-trained language models to aid in preoperative triaging could enhance accuracy and efficiency at scale, reducing manual review and provider burden.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10877-025-01401-z

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Study design. the study population consisted of surgical patients who were evaluated at the preoperative anesthesia care clinic. clinical notes and diagnosis codes that occurred prior to surgery were extracted for each patient. various language models were used to classify which patients would be appropriate for a nursing preoperative phone screen (rather than in-person/telehealth appointment with an advanced practice provider or anesthesiologist). three combinations of inputs to the models were compared: (1) diagnosis codes only; (2) clinical notes only; versus (3) diagnosis and clinical notes. abbreviations: AUC, area under the receiver operating characteristics curve; BART, bidirectional and autoregressive transformer; BERT, bidirectional encoder representations from transformers; RoBERTa, a robustly optimized BERT pretraining approach
Fig. 1 Study design. the study population consisted of surgical patients who were evaluated at the preoperative anesthesia care clinic. clinical notes and diagnosis codes that occurred prior to surgery were extracted for each patient. various language models were used to classify which patients would be appropriate for a nursing preoperative phone screen (rather than in-person/telehealth appointment with an advanced practice provider or anesthesiologist). three combinations of inputs to the models were compared: (1) diagnosis codes only; (2) clinical notes only; versus (3) diagnosis and clinical notes. abbreviations: AUC, area under the receiver operating characteristics curve; BART, bidirectional and autoregressive transformer; BERT, bidirectional encoder representations from transformers; RoBERTa, a robustly optimized BERT pretraining approachCC BY · PubMed Central
Fig. 2 Performance of various language models on the test set in classification of patients using three combinations of inputs: (1) diagnosis codes only; (2) clinical notes only; versus (3) diagnosis and clinical notes. the left column represents area under the receiver operating characteristics curve. the right column represents precision-recall curves. abbreviations: AP, average precision; AUC, area under the receiver operating characteristics curve; BERT, bidirectional encoder representations from transformers; RoBERTa, a robustly optimized BERT pretraining approach
Fig. 2 Performance of various language models on the test set in classification of patients using three combinations of inputs: (1) diagnosis codes only; (2) clinical notes only; versus (3) diagnosis and clinical notes. the left column represents area under the receiver operating characteristics curve. the right column represents precision-recall curves. abbreviations: AP, average precision; AUC, area under the receiver operating characteristics curve; BERT, bidirectional encoder representations from transformers; RoBERTa, a robustly optimized BERT pretraining approachCC BY · PubMed Central
Fig. 3 Performance of various language models on the test set in classification of patients using three combinations of inputs: (1) diagnosis codes only; (2) clinical notes only; versus (3) diagnosis and clinical notes. the metrics include F1-score, sensitivity, and specificity
Fig. 3 Performance of various language models on the test set in classification of patients using three combinations of inputs: (1) diagnosis codes only; (2) clinical notes only; versus (3) diagnosis and clinical notes. the metrics include F1-score, sensitivity, and specificityCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 20 references

Research works printed but not linked: 2

  1. Devlin JC, M-W, Lee K, Tutanova K. BERT; Pre-training of Deep Bidirectional Transformers for Langauge Understanding. arXiv (cscl). 2018.
  2. Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V. RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv (cscl) V1. 2019.

Cited by

See all 2

Metadata

Authors
Xu, N. Y., Litake, O., Tully, J. L., Meineke, M. N., Sinha, A., Meyer, M., & Gabriel, R. A.
Affiliations
  • University of California San Diego (US)
  • UC San Diego Health System (US)
Corresponding author
Gabriel, Rodney A.
Venue
Journal of Clinical Monitoring and Computing
Published
2025-12-24
Volume
40
Issue
2
Pages
517-524
ISSN
  • 1387-1307 (ISSN-L)
  • 1573-2614
OpenAlex
W7117142939
Cited by
2
References
20
Citations by year
2026: 1 · 2025: 1
FWCI
0.80
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of Clinical Monitoring and Computing (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
U.S. National Library of Medicine (T15LM011271)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
triage, pre-trained language models, clinical text classification, RoBERTa, BERT, ClinicalBERT, PubMedBERT, diagnosis codes, automated clinical decision support, surgical patients
MeSH terms
Adult, Aged, Algorithms, Anesthesia, Female, Humans, Language, Male, Middle Aged, Preoperative Care, Retrospective Studies, ROC Curve, Sensitivity and Specificity, Triage, Area Under Curve, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A pre-trained language model approach for triaging surgical patients for preoperative anesthesia clinics. https://app.cochat.ai/papers/10.1007/s10877-025-01401-z
The paper
Xu, N. Y., Litake, O., Tully, J. L., Meineke, M. N., Sinha, A., Meyer, M., & Gabriel, R. A. (2025). A pre-trained language model approach for triaging surgical patients for preoperative anesthesia clinics. Journal of Clinical Monitoring and Computing. https://doi.org/10.1007/s10877-025-01401-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.