Could a Virtual Human Be Used to Explore Excessive Daytime Sleepiness in Patients?
The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
Excessive daytime somnolence (EDS) is defined as the inability to stay awake in daily life activities. Several scales have been used to diagnose excessive daytime sleepiness, the most widely used being the Epworth Sleepiness Scale (ESS). Sleep disorders and EDS are very common in the general population. It is therefore important to be able to screen patients for this symptom in order to obtain an accurate diagnosis of sleep disorders. Embodied Conversational Agents (ECA) have been used in the field of affective computing and human interactions but up to now no software has been specifically designed to investigate sleep disorders. We created an ECA able to conduct an interview based on the ESS and compared it to an interview conducted by a sleep specialist. We recruited 32 consecutive patients and a group of 30 healthy volunteers free of any sleep complaints. The ESS is a self-administered questionnaire that asks the subject to rate (with a pen and paper paradigm) his or her probability of falling asleep. For the purpose of our study, the ECA or real-doctor questionnaire was modified as follows: Instead of the “I” formulate, questions were asked as “Do you.” Our software is based on a common 3D game engine and several commercial software libraries. It can run on standard and affordable hardware products. The sensitivity and specificity of the interview conducted by the ECA were measured. The best results (sensibility and specificity >98%) were obtained to discriminate the sleepiest patients (ESS ≥16) but very good scores (sensibility and specificity >80%) were also obtained for alert subjects (ESS<8). ESS scores obtained in the interview conducted by the physician were significantly correlated with ESS scores obtained in the interview the ECA conducted. Most of the subjects had a positive perception of the virtual physician and considered the interview with the ECA as a good experience. Sixty-five percent of the participants felt that the virtual doctor could significantly help real physicians. Our results show that a virtual physician can conduct a very simple interview to evaluate EDS with very similar results to those obtained by a questionnaire administered by a real physician. The expected massive increase in sleep complaints in the near future likely means that more and more physicians will be looking for computerized systems to help them to diagnose their patients.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One of the quasi-experimental studies (non-randomized) evaluated the diagnostic performance of an embodied conversational agent for excessive daytime sleepiness, in comparison to a sleep specialist, finding sensitivity and specificity values above 80%.”
From Conversational agents in healthcare: a systematic review (2018) · cites this paper as [23]
In the citing paper
“Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
From Conversational agents in healthcare: a systematic review (2018) · cites this paper as [23]
In the citing paper
“In a study of an ECA for sleep disorder screening, 65% of users reported thinking that the agent could provide significant assistance to physicians [51].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [51]
Citations
Cites
A New Method for Measuring Daytime Sleepiness: The Epworth Sleepiness Scale
Johns, M. W. (1991) · Sleep · doi:10.1093/sleep/14.6.540 · Cited by 17,364 · cited 5×
“Sensitivity and specificity were calculated for Virtual Human ESS and Physician ESS for different ESS scores according to the author’s recommendations (Johns, 1991) with cut-off values equal to or greater than 8, 11, and 16.”
MethodInfluential(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Subjective and objective sleepiness in the active individual
Åkerstedt, T., & Gillberg, M. (1990) · International Journal of Neuroscience · doi:10.3109/00207459008994241 · Cited by 3,088 · cited 1×
“Several scales have been used to diagnose (Akerstedt & Gillberg, 1990; Hoddes, Zarcone, Smythe, Phillips, & Dement, 1973) excessive or chronic daytime sleepiness, the most widely used being the Epworth Sleepiness Scale (ESS; Johns, 1991).”
MethodQuantification of Sleepiness: A New Approach
Hoddes, E., Zarcone, V., Smythe, H., Phillips, R., & Dement, W. C. (1973) · Psychophysiology · doi:10.1111/j.1469-8986.1973.tb00801.x · Cited by 2,538
Littner, M. R., Kushida, C., Wise, M., G. Davila, D., Morgenthaler, T., Lee-Chiong, T., Hirshkowitz, M., Loube, D. L., Bailey, D., Berry, R. B., et al. (2005) · Sleep · doi:10.1093/sleep/28.1.113 · Cited by 1,142 · cited 2×
“Excessive daytime sleepiness (EDS) is defined as sleepiness that occurs in a situation when an individual would usually be expected to be awake and alert (Littner et al., 2005).”
BackgroundFrom wakefulness to excessive sleepiness: What we know and still need to know
Ohayon, M. M. (2008) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2008.01.001 · Cited by 264 · cited 1×
“Philip et al. 369 many traffic accidents (Philip, 2010), affects up to 19.5% of the general population in Western countries when subjective assessment is used (Ohayon, 2008, 2012).”
BackgroundInfluentialThe Responses of People to Virtual Humans in an Immersive Virtual Environment
Garau, M., Slater, M., Pertaub, D.-P., & Razzaque, S. (2005) · Presence: Teleoperators and Virtual Environments · doi:10.1162/1054746053890242 · Cited by 212
Hardinge, F. M., Pitson, D., & Stradling, J. R. (1995) · Respiratory Medicine · doi:10.1016/0954-6111(95)90230-9 · Cited by 150
Interactive Pedagogical Drama for Health Interventions
Marsella, S., Johnson, W. L., & LaBore, C. (2003) · Cited by 141
Benzodiazepine-Like Hypnotics and the Associated Risk of Road Traffic Accidents
Orriols, L., Philip, P., Moore, N., Castot, A., Gadegbeku, B., Delorme, B., Mallaret, M., & Lagarde, E. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.3 · Cited by 118 · cited 2×
“…many patients suffering from sleep disorders are diagnosed as psychiatric patients (mood or anxiety disorders) and therefore receive central nervous system drugs, which increase their level of sleepiness and driving risk (Blazejewski, Girodet, Orriols, Capelli, & Moore, 2012; Orriols et al., 2011).”
BackgroundSelf-citation
Research works printed but not linked: 2
- Marsella S., 2003, Australia, 341
- Rizzo A. A., 2009, Studies in Health Technology and Informatics, 142, 277
Cited by
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
“In 3 studies, sources of funding were not reported.(21,23,26)”
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626
Technical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150
Philip, P., Micoulaud-Franchi, J.-A., Sagaspe, P., Sevin, E. D., Olive, J., Bioulac, S., & Sauteraud, A. (2017) · Scientific Reports · doi:10.1038/srep42656 · Cited by 128
Self-citationPhilip, P., Dupuy, L., Auriacombe, M., Serre, F., de Sevin, E., Sauteraud, A., & Micoulaud-Franchi, J.-A. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0213-y · Cited by 103
Self-citationMartínez-Miranda, J., Martínez, A., Ramos, R., Aguilar, H., Jiménez, L., Arias, H., Rosales, G., & Valencia, E. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1387-1 · Cited by 79
Philip, P., Dupuy, L., Morin, C. M., de Sevin, E., Bioulac, S., Taillard, J., Serre, F., Auriacombe, M., & Micoulaud-Franchi, J.-A. (2020) · Journal of Medical Internet Research · doi:10.2196/24268 · Cited by 61
“KANOPEE was implemented using the same architecture as our previous ECAs [15-19], with C# programming language in Unity 3D software (Unity Technologies).”
Self-citationDing, H., Simmich, J., Vaezipour, A., Andrews, N. E., & Russell, T. G. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad222 · Cited by 72
Development and validation of a virtual agent to screen tobacco and alcohol use disorders
Auriacombe, M., Moriceau, S., Serre, F., Denis, C., Micoulaud-Franchi, J.-A., de Sevin, E., Bonhomme, E., Bioulac, S., Fatseas, M., & Philip, P. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.08.025 · Cited by 55
Self-citationNoble, J. M., Zamani, A., Gharaat, M., Merrick, D., Maeda, N., Lambe Foster, A., Nikolaidis, I., Goud, R., Stroulia, E., Agyapong, V. I. O., et al. (2022) · JMIR Research Protocols · doi:10.2196/33717 · Cited by 53
Embodied Conversational Agents for Chronic Diseases: Scoping Review
Jiang, Z., Huang, X., Wang, Z., Liu, Y., Huang, L., & Luo, X. (2023) · Journal of Medical Internet Research · doi:10.2196/47134 · Cited by 63
Medical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions
Rehman, U. U., Chang, D. J., Jung, Y., Akhtar, U., Razzaq, M. A., & Lee, S. (2020) · Applied Sciences · doi:10.3390/app10072216 · Cited by 37
“designed an Embodied Conversational Agent (ECA) for sleep disorder patients that ask questions using the Epworth Sleepiness Scale and identify the somnolence patients [26].”
MethodValidation of the French version of the Acceptability E-scale (AES) for mental E-health systems
Micoulaud‐Franchi, J., Sauteraud, A., Olive, J., Sagaspe, P., Bioulac, S., & Philip, P. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.01.043 · Cited by 29
Self-citationAcceptability of Embodied Conversational Agent in a Health Care Context
Micoulaud‐Franchi, J., Sagaspe, P., de Sevin, É., Bioulac, S., Sauteraud, A., & Philip, P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-47665-0_45 · Cited by 28
“The ECA was adapted from previously developed software designed to self-conduct interactive face-to-face clinical interviews [2].”
BackgroundMethodSelf-citationDupuy, L., Morin, C. M., de Sevin, É., Taillard, J., Salles, N., Bioulac, S., Auriacombe, M., Micoulaud‐Franchi, J., & Philip, P. (2021) · Journal of Sleep Research · doi:10.1111/jsr.13489 · Cited by 28
“KANOPEE was implemented using the same architecture as our previous virtual agents (Auriacombe et al., 2018; Dupuy et al., 2020; Philip et al., 2014, 2017), with C# programming language in Unity 3D software (Unity Technologies).”
MethodSelf-citationBridging the Health Disparity of African Americans Through Conversational Agents
Kim, J., Park, S. Y., & Robert, L. (2020) · Digital Government Research and Practice · doi:10.1145/3428122 · Cited by 24
Dupuy, L., Micoulaud‐Franchi, J., & Philip, P. (2020) · Journal of Sleep Research · doi:10.1111/jsr.13094 · Cited by 17
“Some of the above-mentioned studies (Auriacombe et al., 2018; Lisetti et al., 2013; Philip et al., 2014, 2017; Shamekhi et al., 2017) found that virtual agents were perceived positively by their users, but these studies suffered from some methodological flaws.”
BackgroundSelf-citationEmploying Conversational Agents in Palliative Care: A Feasibility Study and Preliminary Assessment
Chatzimina, M., Koumakis, L., Marias, K., & Tsiknakis, M. (2019) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2019.00095 · Cited by 18
“From these fourteen systems, seven conversational agents focus on patients [2],[21],[22],[23],[24],[25],[26], four conversational agents focus on clinicians [27],[28],[29],[30] and three conversational agents focus on both patients and clinicians [31],[32], [33],[34],[35],[36]”
BackgroundSong, T., Pabst, F., Eck, U., & Navab, N. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3549181 · Cited by 29
“The system incorporated a speech synthe-sizer for the ECA and a speech recognizer for the patient’s answers but lacks the ability to freely generate the virtual human’s responses [61].”
Guidelines for the design of a virtual patient for psychiatric interview training
Dupuy, L., de Sevin, É., Cassoudesalle, H., Ballot, O., Dehail, P., Aouizerate, B., Cuny, E., Micoulaud‐Franchi, J., & Philip, P. (2020) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-020-00338-8 · Cited by 18
“sleepiness [7], addiction for tobacco and alcohol consumption [8] and major depressive disorder [9].”
BackgroundSelf-citationPhilip, P., Bioulac, S., de Sevin, É., & Micoulaud‐Franchi, J. (2017) · La Revue de l Infirmière · doi:10.1016/j.revinf.2017.09.008
Self-citationDialogue management based on forcing a user through a discourse tree of a text
Galitsky, B. A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-824521-7.00004-1
A Narrative Review of Virtual Human Twins (VHTs) of Healthcare Professionals
Gargiulo, L., Saritas, S. N., Arar, F. E., Saitta, L., de Luca, M., Vallefuoco, E., Arlati, S., Mondellini, M., Moccaldi, N., d'Errico, G., et al. (2025) · IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) · doi:10.1109/metroxraine66377.2025.11340559
Saisie de prescriptions médicales en langage naturel sur terminaux mobiles
Kocabiyikoglu, A. C. (2022) · theses.fr (ABES) · doi:10.70675/998d4b74z9eb1z49bcz9763zfa1e8ebcbd43
Modelling a humanoid virtual leader assistant for a remote and isolated caregivers
Jackson, A. C. (2022) · theses.fr (ABES) · doi:10.70675/8634e096z6e3dz48c4z9cddzab3489fa64e0
Metadata
- Authors
- Philip, P., Bioulac, S., Sauteraud, A., Chaufton, C., & Olive, J.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Venue
- Presence: Teleoperators and Virtual Environments
- Publisher
- MIT Press - Journals
- Published
- 2014-11-01
- Volume
- 23
- Issue
- 4
- Pages
- 369-376
- ISSN
- 1054-7460 (ISSN-L)
- OpenAlex
- W1995661738
- Cited by
- 25
- References
- 25
- Citations by year
- 2025: 2 · 2023: 2 · 2022: 4 · 2021: 1 · 2020: 8 · 2019: 2 · 2018: 2 · 2017: 2 · 2016: 2
- FWCI
- 1.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PRESENCE Virtual and Augmented Reality (publishedVersion)
- HAL (submittedVersion)
- Funders
- Agence Nationale de la Recherche (ANR-10-EQPX-0012)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Health Sciences › Medicine › Physiology (medical) › Obstructive Sleep Apnea Research
- Keywords
- excessive daytime sleepiness, Epworth Sleepiness Scale, embodied conversational agents, sleep disorder screening, computer-aided diagnosis, diagnostic accuracy, patient perspectives, affective computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.