Feasibility of using an automated analysis of formulation effort in patients’ spoken seizure descriptions in the differential diagnosis of epileptic and nonepileptic seizures
Open accessAbstract
Objective There are three common causes of Transient Loss of Consciousness (TLOC), syncope, epileptic and psychogenic nonepileptic seizures (PNES). Many individuals who have experienced TLOC initially receive an incorrect diagnosis and inappropriate treatment. Whereas syncope can be distinguished relatively easily with a small number of "yes"/"no" questions, the differentiation of the other two causes of TLOC is more challenging. Previous qualitative research based on the methodology of Conversation Analysis has demonstrated that the descriptions of epileptic seizures contain more formulation effort than accounts of PNES. This research investigates whether features likely to reflect the level of formulation effort can be automatically elicited from audio recordings and transcripts of speech and used to differentiate between epileptic and nonepileptic seizures. Method Verbatim transcripts of conversations between patients and neurologists were manually produced from video and audio recordings of 45 interactions (21 epilepsy and 24 PNES). The subsection of each transcript containing the person's account of their first seizure was manually extracted for the analysis. Seven automatically detectable features were designed as markers of formulation effort. These features were used to train a Random Forest machine learning classifier. Result There were significantly more hesitations and repetitions in descriptions of epileptic than nonepileptic seizures. Using a nested leave-one-out cross validation approach, 71% of seizures were correctly classified by the Random Forest classifier. Discussion This pilot study provides proof of principle that linguistic features that have been automatically extracted from audio recordings and transcripts could be used to distinguish between epileptic seizures and PNES and thereby contribute to the differential diagnosis of TLOC. Future research should explore whether additional observations can be incorporated into a diagnostic stratification tool and compare the performance of these features when they are combined with additional information provided by patients and witnesses about seizure manifestations and medical history.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Pevy et al. [168]'s algorithm distinguished epileptic seizures from PNES based on verbal expression patterns.
“The algorithm then trained machine learning classifiers with these features, enabling it to distinguish patients based on their verbal expression patterns.”
From A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis (2024) · cites this paper as [168]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 33 · Cited by 23
Research works printed but not linked: 1
- Loper, E. and Bird, S. (2002) 'NLTK: the Natural Language Toolkit', arXiv preprint cs/0205028. doi: 10.3115/1225403.1225421. · DOI · Paper page
- Authors
- Pevy, N., Christensen, H., Walker, T., & Reuber, M.
- Affiliations
- University of Sheffield (GB)
- Royal Hallamshire Hospital (GB)
- Corresponding author
- Pevy, Nathan
- Venue
- Seizure
- Publisher
- Elsevier BV
- Published
- 2021-10
- Volume
- 91
- Pages
- 141-145
- ISSN
- 1059-1311 (ISSN-L)
- OpenAlex
- W3171004580
- Cited by
- 23
- References
- 33
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 8 · 2023: 4 · 2022: 4
- FWCI
- 15.80
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Seizure (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Funders
- Epilepsy Research UK
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Health Sciences › Medicine › Psychiatry and Mental health › Epilepsy research and treatment
- Health Sciences › Medicine › Psychiatry and Mental health › Psychosomatic Disorders and Their Treatments
- Keywords
- psychogenic non-epileptic seizures, epileptic seizures, transient loss of consciousness, differential diagnosis, linguistic features, automated speech analysis, patient-clinician interaction, conversation analysis
- MeSH terms
- Diagnosis, Differential, Electroencephalography, Epilepsy, Feasibility Studies, Humans, Pilot Projects, Seizures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review