Prediction of Lupus Classification Criteria via Generative AI Medical Record Profiling

Abstract

Systemic lupus erythematosus (SLE) is a complex autoimmune disease that poses serious long-term patient burdens. (1) Background: SLE patient classification and care are often complicated by case heterogeneity (diverse variations in symptoms and severity). Large language models (LLMs) and generative artificial intelligence (genAI) may mitigate this challenge by profiling medical records to assess key medical criteria. (2) Methods: To demonstrate genAI-based profiling, ACR (American College of Rheumatology) 1997 SLE classification criteria were used to define medically relevant LLM prompts. Records from 78 previously studied patients (45 classified as having SLE; 33 indeterminate or negative) were computationally profiled, via five genAI replicate runs. (3) Results: GenAI determinations of the “Discoid Rash” and “Pleuritis or Pericarditis” classification criteria yielded perfect concurrence with clinical classification, while some factors such as “Immunologic Disorder” (56% accuracy) were statistically unreliable. Compared to clinical classification, our genAI approach achieved a 72% predictive success rate. (4) Conclusions: GenAI classifications may prove sufficiently predictive to aid medical professionals in evaluating SLE patients and structuring care strategies. For individual criteria, accuracy seems to correlate inversely with complexities in clinical determination, implying that improvements in AI patient profiling tools may emerge from continued advances in clinical classification efficacy.