Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders
Open accessThe DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
Embodied Conversational Agents (ECAs) are promising software to communicate with patients but no study has tested them in the diagnostic field of mental disorders. The aim of this study was 1) to test the performance of a diagnostic system for major depressive disorders (MDD), based on the identification by an ECA of specific symptoms (the MDD DSM 5 criteria) in outpatients; 2) to evaluate the acceptability of such an ECA. Patients completed two clinical interviews in a randomized order (ECA versus psychiatrist) and filled in the Acceptability E-scale (AES) to quantify the acceptability of the ECA. 179 outpatients were included in this study (mean age 46.5 ± 12.9 years, 57.5% females). Among the 35 patients diagnosed with MDD by the psychiatrist, 14 (40%) patients exhibited mild, 12 (34.3%) moderate and 9 (25.7%) severe depressive symptoms. Sensitivity increased across the severity level of depressive symptoms and reached 73% for patients with severe depressive symptoms, while specificity remained above 95% for all three severity levels. The acceptability of the ECA evaluated by the AES was very good (25.4). We demonstrate here the validity and acceptability of an ECA to diagnose major depressive disorders. ECAs are promising tools to conduct standardized and well-accepted clinical interviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Two studies comparing diagnostic performance of conversational agents and clinicians found acceptable sensitivity and specificity.”
From Conversational agents in healthcare: a systematic review (2018) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The investigated uses for these systems include triage, diagnostics, counseling, health promotion, and training of health care professionals [1,4,11-16].”
From Effectiveness of Conversational Agents (Virtual Assistants) in Health Care: Protocol for a Systematic Review (2020) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“A crossover RCT evaluated the diagnostic performance for depression of an embodied conversational agent compared to a psychiatrist, finding a sensitivity of 49% and specificity of 93%.”
From Conversational agents in healthcare: a systematic review (2018) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“The spoken system for a major depressive disorder used embodied CAs, and showed sensitivity (49%) and specificity (93%) [46].”
From A systematic review on healthcare artificial intelligent conversational agents for chronic conditions (2022) · cites this paper as [46]
The cited source says what the claim attributes to it.
In the citing paper
“The largest proportion of them (12/31, 39%) addressed mental health issues [13,32-42]”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [38]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
(1998) · PubMed · Cited by 10,216
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine
Zweig, M. H., & Campbell, G. (1993) · Clinical Chemistry · doi:10.1093/clinchem/39.4.561 · Cited by 6,569
Basic principles of ROC analysis
Metz, C. E. (1978) · Seminars in Nuclear Medicine · doi:10.1016/s0001-2998(78)80014-2 · Cited by 6,026
Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients
Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. F. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6703_13 · Cited by 5,965
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Cross-national epidemiology of DSM-IV major depressive episode
Bromet, E., Andrade, L. H., Hwang, I., Sampson, N. A., Alonso, J., de Girolamo, G., de Graaf, R., Demyttenaere, K., Hu, C., Iwata, N., et al. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-90 · Cited by 2,221
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Selection and interpretation of diagnostic tests and procedures. Principles and applications.
Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981) · PubMed · Cited by 765
Cited by
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
“All the studies evaluating satisfaction with the system reported high overall satisfaction 24,28,30 but only one of these studies used a validated questionnaire (Acceptability e-Scale).(22) Some of the most frequent user experience issues were related to spoken language understanding or dialogue Table 1.”
InfluentialChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626
“9 (82) 1 1 0 1 0 1 1 1 1 1 1 Philip (2017) [38]”
InfluentialLaestadius, L., Bishop, A., Gonzalez, M., Illenčík, D., & Campos-Castillo, C. (2024) · New Media & Society · doi:10.1177/14614448221142007 · Cited by 420
“Furthermore, embodied chatbots like Replika are preferred to text-only chatbots and may be seen as more trustworthy (Lisetti et al., 2015; Philip et al., 2017).”
BackgroundZhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363
“Most previous chatbot research relied on either finite-state (ie, dialog consisting of a sequence of predetermined steps or states) or frame-based systems (ie, dialog is not predetermined but dependent on the content of the user’s input and the information that the system has to elicit) [34-36].”
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301
“According to Morris et al [67], participants preferred the chatbot’s responses drawn from an existing pool of web-based peer support data rather than those generated by the chatbot itself.”
Prochaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257
“Finally, although conversational agents can present in different modalities, including text, verbal [18,19], and animation [20-25], preliminary research on modality for psychoeducation delivery specifically found that text-based presentation resulted in higher program adherence than verbal presentation [26].”
BackgroundTechnical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150
“Comprehensibility of responses was evaluated using a single question in a s e l f - a d m i n i s t r a t e d q u e s t i o n n a i r e [20,23,31,36,39,42,44,52,59,60,63,69] and interviews [34,51].”
MethodInfluentialChatbot usage intention analysis: Veterinary consultation
Huang, D.-H., & Chueh, H.-E. (2021) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2020.09.002 · Cited by 134
Chatbots to Support Young Adults’ Mental Health: An Exploratory Study of Acceptability
Koulouri, T., Macredie, R. D., & Olakitan, D. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3485874 · Cited by 127
e-Addictology: An Overview of New Technologies for Assessing and Intervening in Addictive Behaviors
Ferreri, F., Bourla, A., Mouchabac, S., & Karila, L. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00051 · Cited by 122
“Some related tests are now being developed using virtual avatars of psychiatrists who can converse directly with patients, known as embodied conversational agents (46).”
Bin Sawad, A., Narayan, B., Alnefaie, A., Maqbool, A., Mckie, I., Smith, J., Yuksel, B., Puthal, D., Prasad, M., & Kocaballi, A. B. (2022) · Sensors · doi:10.3390/s22072625 · Cited by 113
“The spoken system for a major depressive disorder used embodied CAs, and showed sensi‐ tivity (49%) and specificity (93%) [46].”
BackgroundHealth-focused conversational agents in person-centered care: a review of apps
Parmar, P., Ryu, J., Pandya, S., Sedoc, J., & Agarwal, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00560-6 · Cited by 113
Philip, P., Dupuy, L., Auriacombe, M., Serre, F., de Sevin, E., Sauteraud, A., & Micoulaud-Franchi, J.-A. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0213-y · Cited by 103
Self-citationTrends, Technologies, and Key Challenges in Smart and Connected Healthcare
Navaz, A. N., Serhani, M. A., El Kassabi, H. T., Al-Qirim, N., & Ismail, H. (2021) · IEEE Access · doi:10.1109/access.2021.3079217 · Cited by 99
“Virtual humans [20], i.”
Huq, S. M., Maskeliūnas, R., & Damaševičius, R. (2024) · Disability and Rehabilitation: Assistive Technology · doi:10.1080/17483107.2022.2146768 · Cited by 82
Early detection of depression using a conversational AI bot: A non-clinical trial
Kaywan, P., Ahmed, K., Ibaida, A., Miao, Y., & Gu, B. (2023) · PLOS ONE · doi:10.1371/journal.pone.0279743 · Cited by 82
Vaidyam, A. N., Linggonegoro, D., & Torous, J. (2021) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720966429 · Cited by 81
“Objections were either refusals (user says: “I don’t want to do this” to a bot’s understanding of what was said) or complaints (“That’s not what I said” to a bot’s response) Type of Severe Mental Illness Since 2018 Review 2018 Review Major depressive disorder Fulmer et al.,19 Inkster et al.,20 Philip et al.,23 Suganum…”
BackgroundInfluentialVoice-Controlled Intelligent Personal Assistants in Health Care: International Delphi Study
(2021) · doi:10.2196/25312 · Cited by 78
“…advances in machine learning, particularly in neural networks, have enabled voice-based technologies to assist health professionals during medical consultation [5], provide diagnostic support [6], assist elderly people in their daily routines [7,8], and promote an overall healthier lifestyle [9].”
Nashwan, A. J., Gharib, S., Alhadidi, M., El-Ashry, A. M., Alamgir, A., Al-Hassan, M., Khedr, M. A., Dawood, S., & Abufarsakh, B. (2023) · Issues in Mental Health Nursing · doi:10.1080/01612840.2023.2263579 · Cited by 77
“Such technologies also provide an anonymous, stigma and judgment-free platform for individuals who are hesitant to seek in-person assistance (Lee et al., 2023; Lucas et al., 2017; Philip et al., 2017).”
BackgroundInfluentialSoftware-Based Dialogue Systems: Survey, Taxonomy, and Challenges
Motger, Q., Franch, X., & Marco, J. (2023) · ACM Computing Surveys · doi:10.1145/3527450 · Cited by 68
“Conversational agents for information request include Q&A chatbots [37] and utility experts for complex domains like autonomous diagnosis or access to health-related information [128].”
BackgroundBourla, A., Mouchabac, S., El Hage, W., & Ferreri, F. (2018) · European Journal of Psychotraumatology · doi:10.1080/20008198.2018.1424448 · Cited by 68
“Patients are relatively compliant with the use of this type of method (63.1 – 86% response rate) (Possemato et al., 2012; Price et al., 2014).”
MethodInfluentialPhilip, P., Dupuy, L., Morin, C. M., de Sevin, E., Bioulac, S., Taillard, J., Serre, F., Auriacombe, M., & Micoulaud-Franchi, J.-A. (2020) · Journal of Medical Internet Research · doi:10.2196/24268 · Cited by 61
“Named KANOPEE, the program is based on our previous research on embodied conversational agents (ECAs), also called virtual agents, which may be defined as animated characters that can engage in face-to-face dialogue through verbal and nonverbal behaviors.”
Self-citationDialogue System for Early Mental Illness Detection: Toward a Digital Twin Solution
Abilkaiyrkyzy, A., Laamarti, F., Hamdi, M., & Saddik, A. E. (2024) · IEEE Access · doi:10.1109/access.2023.3348783 · Cited by 86
“Philip et al. [16] performed a stratified analysis of ECA to diagnose Major Depressive Disorder (MDD) among 35 participants compared to the diagnosis of the therapist.”
BackgroundMethodde Cock, C., Milne-Ives, M., van Velthoven, M. H., Alturkistani, A., Lam, C., & Meinert, E. (2020) · JMIR Research Protocols · doi:10.2196/16934 · Cited by 62
“The investigated uses for these systems include triage, diagnostics, counseling, health promotion, and training of health care professionals [1,4,11-16].”
BackgroundVilaza, G. N., & McCashin, D. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.689736 · Cited by 60
“However, at the present stage, it is unclear if chatbots can navigate CBT’s theoretical and conceptual assumptions to support the development of human autonomy necessary for a therapeutical alliance, such as mutual trust, respect, and empathy (41).”
BackgroundArnold, A., Kolody, S., Comeau, A., & Miguel Cruz, A. (2024) · Disability and Rehabilitation: Assistive Technology · doi:10.1080/17483107.2022.2065369 · Cited by 59
“…assistants have the potential to alleviate challenges, such as social isolation and loneliness for older adults [22], perform clinical assessments [23], assist with detecting and diagnosing conditions [24–26], monitor behaviour and deliver interventions [27,28], and promote healthy behaviour [29].”
BackgroundDing, H., Simmich, J., Vaezipour, A., Andrews, N. E., & Russell, T. G. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad222 · Cited by 72
Creating an mHealth App for Colorectal Cancer Screening: User-Centered Design Approach
Griffin, L., Lee, D., Jaisle, A., Carek, P., George, T., Laber, E., Lok, B., Modave, F., Paskett, E., & Krieger, J. (2019) · JMIR Human Factors · doi:10.2196/12700 · Cited by 57
“The technology has been used in studies on mental health care [32,33], assessing pain treatment [34-36], and patient and provider communication [37].”
MethodDevelopment and validation of a virtual agent to screen tobacco and alcohol use disorders
Auriacombe, M., Moriceau, S., Serre, F., Denis, C., Micoulaud-Franchi, J.-A., de Sevin, E., Bonhomme, E., Bioulac, S., Fatseas, M., & Philip, P. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.08.025 · Cited by 55
Self-citationNoble, J. M., Zamani, A., Gharaat, M., Merrick, D., Maeda, N., Lambe Foster, A., Nikolaidis, I., Goud, R., Stroulia, E., Agyapong, V. I. O., et al. (2022) · JMIR Research Protocols · doi:10.2196/33717 · Cited by 53
“In reflection of the findings of these studies, where applicable for the purposes of our study, we chose items from validated tools or items used to evaluate other chatbots (eg, CORE-10, ETQ, AES, and classifier performance measures such as accuracy and precision) to permit cross-comparability where possible between t…”
MethodReview of artificial intelligence‐based question‐answering systems in healthcare
Budler, L. C., Gosak, L., & Stiglic, G. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1487 · Cited by 52
“Conversational agents were useful also for patients (Chaix et al., 2019; Denecke et al., 2020; Inkster et al., 2018; Kowatsch et al., 2017; Philip et al., 2017) and helped them to track treatment effectively (Chaix et al., 2019; Dworkin et al., 2019; Wang et al., 2018).”
BackgroundEmbodied Conversational Agents for Chronic Diseases: Scoping Review
Jiang, Z., Huang, X., Wang, Z., Liu, Y., Huang, L., & Luo, X. (2023) · Journal of Medical Internet Research · doi:10.2196/47134 · Cited by 63
Xygkou, A., Siriaraya, P., She, W. J., Covaci, A., & Ang, C. S. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2292880 · Cited by 61
“There is emerging evidence in machine learning research (Gratch et al., 2014) demonstrating that by analyzing the chatlogs, it is possible to automatically detect depression (Philip et al., 2017), post-traumatic stress and suicidal ideation (Carpenter et al., 2012).”
Numata, T., Sato, H. R., Asa, Y., Koike, T., Miyata, K., Nakagawa, E., Sumiya, M., & Sadato, N. (2020) · Scientific Reports · doi:10.1038/s41598-020-62870-7 · Cited by 54
Smart conversational agents for the detection of neuropsychiatric disorders: A systematic review
Pacheco-Lorenzo, M. R., Valladares-Rodríguez, S. M., Anido-Rifón, L. E., & Fernández-Iglesias, M. J. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103632 · Cited by 40
Understanding Conversational and Expressive Style in a Multimodal Embodied Conversational Agent
Aneja, D., Hoegen, R., McDuff, D., & Czerwinski, M. P. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445708 · Cited by 62
“Finally, agents have also been used to help with diagnosing depressive disorders [29].”
BackgroundMedical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions
Rehman, U. U., Chang, D. J., Jung, Y., Akhtar, U., Razzaq, M. A., & Lee, S. (2020) · Applied Sciences · doi:10.3390/app10072216 · Cited by 37
“Similarly, the mental disorder diagnostic system conducts an interview based on DSM-5 criteria and identifies patients with major depressive disorders [27].”
MethodMariamo, A., Temcheff, C. E., Léger, P.-M., Senecal, S., & Lau, M. A. (2021) · JMIR Human Factors · doi:10.2196/24343 · Cited by 35
“Chatbots geared toward mental health are not only capable of identifying individuals who experience psychological distress but can also help reduce this distress [15].”
BackgroundChaby, L., Benamara, A., Pino, M., Prigent, E., Ravenet, B., Martin, J., Vanderstichel, H., Becerril-Ortega, R., Rigaud, A., & Chétouani, M. (2022) · Frontiers in Virtual Reality · doi:10.3389/frvir.2022.827312 · Cited by 49
“…Grossard et al., 2020), virtual coaches motivating the user (Torres et al., 2018; Ali et al., 2021), or even for virtual clinical interviews with real patients suffering from depression, post-traumatic stress disorder or dementia (Stratou et al., 2015; Philip et al., 2017; Mirheidari et al., 2019).”
Zahedi, F. M., Zhao, H., Sanvanson, P. P., Walia, N., Jain, H. K., & Shaker, R. (2022) · Information & Management · doi:10.1016/j.im.2022.103706 · Cited by 37
“[89] Mental health, depression Use virtual human for diagnosing depressive disorders Diagnosis by psychiatrist vs.”
BackgroundBoczar, D., Sisti, A., Oliver, J. D., Helmi, H., Restrepo, D. J., Huayllani, M. T., Spaulding, A., Carter, R. E., Rinker, B. D., & Forte, A. J. (2020) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000002252 · Cited by 33
Maharjan, R., Doherty, K., Rohani, D. A., Bækgaard, P., & Bardram, J. E. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3484508 · Cited by 29
“Finally, Philip et al. contrasted the diagnostic performance of an embodied CA and a psychiatrist in relation to major depressive disorder among 179 outpatient participants [63].”
BackgroundD4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat
Yao, B., Shi, C. J., Zou, L., Dai, L., Wu, M., Chen, L., Wang, Z., & Yu, K. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.156 · Cited by 43
Dupuy, L., Morin, C. M., de Sevin, É., Taillard, J., Salles, N., Bioulac, S., Auriacombe, M., Micoulaud‐Franchi, J., & Philip, P. (2021) · Journal of Sleep Research · doi:10.1111/jsr.13489 · Cited by 28
“KANOPEE was implemented using the same architecture as our previous virtual agents (Auriacombe et al., 2018; Dupuy et al., 2020; Philip et al., 2014, 2017), with C# programming language in Unity 3D software (Unity Technologies).”
BackgroundMethodSelf-citationPhilip, P., Dupuy, L., Sagaspe, P., de Sevin, É., Auriacombe, M., Taillard, J., Micoulaud‐Franchi, J., & Morin, C. M. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11154387 · Cited by 27
“Thanks to repeated interaction with a virtual companion, the app helps screen insomnia complaints, provides a follow-up tool (sleep diary) and gives users personalized recommendations regarding sleep hygiene, stimulus control, the optimization of sleep schedules and physical activity [17].”
BackgroundSelf-citationConversational agents for depression screening: A systematic review
Otero-González, I., Pacheco-Lorenzo, M. R., Iglesias, M. J. F., & Anido, L. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105272 · Cited by 34
Kruse, L., Hertel, J., Mostajeran, F., Schmidt, S., & Steinicke, F. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00082 · Cited by 28
Conversational Agents for Mental Health and Wellbeing
Callejas, Z., & Griol, D. (2021) · Logic, argumentation & reasoning · doi:10.1007/978-3-030-61438-6_11 · Cited by 29
Chatbots in the Field of Mental Health: Challenges and Opportunities
Viduani, A. C., Cosenza, V., Araújo, R., & Kieling, C. (2022) · Springer eBooks · doi:10.1007/978-3-031-10698-9_8 · Cited by 27
Design recommendations for chatbots to support people with depression
de Souza, P. M., Pires, I. D. C., Motti, V. G., Caseli, H. D. M., Neto, J. B. B., Martini, L. C., & Néris, V. P. D. A. (2022) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3554364.3559119 · Cited by 24
“For patient usage, chatbots can be serve to support health literacy (e.g. [3]), nutrition and physical activity (e.g. [4, 8]), sexual health and substance use (e.g. [6]), maternal health (e.g. [12, 15, 28]) and mental health (e.g. [9, 14, 26, 31, 33]).”
BackgroundPregnancy in the time of COVID-19: towards Fetal monitoring 4.0
Kahankova, R. V., Barnova, K., Jaroš, R., Pavlíček, J., Snåšel, V., & Martínek, R. (2023) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-023-05349-3 · Cited by 26
Conversational Interfaces for Health: Bibliometric Analysis of Grants, Publications, and Patents
Xing, Z., Yu, F., Du, J., Walker, J. S., Paulson, C. B., Mani, N. S., & Song, L. (2019) · Journal of Medical Internet Research · doi:10.2196/14672 · Cited by 24
“CNRS, a prominent French research institute, has applied CIs to tackle health issues such as substance use disorder [66] and depression [67].”
On the Generation of Medical Dialogs for COVID-19
Zhou, M., Li, Z., Tan, B., Zeng, G., Yang, W., He, X., Ju, Z., Chakravorty, S., Chen, S., Yang, X., et al. (2021) · doi:10.18653/v1/2021.acl-short.112 · Cited by 34
“Some meth-ods (Lucas et al., 2017; Philip et al., 2017; Tanaka et al., 2017) predefine a sequence of steps or states which are used to guide the conversation.”
BackgroundEagle, T., Blau, C., Bales, S., Desai, N., Li, V., & Whittaker, S. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3488057 · Cited by 21
“Few Randomized Clinical Trials (RCTs) have been conducted [17, 28, 35], in part because this is a time-intensive undertaking complicated by rapid changes in technology.”
BackgroundBridging the Health Disparity of African Americans Through Conversational Agents
Kim, J., Park, S. Y., & Robert, L. (2020) · Digital Government Research and Practice · doi:10.1145/3428122 · Cited by 24
From Combat to COVID-19 – Managing the Impact of Trauma Using Virtual Reality
Rizzo, A., Hartholt, A., & Mozgai, S. (2021) · Journal of Technology in Human Services · doi:10.1080/15228835.2021.1915931 · Cited by 21
“, 2015), as clinical interviewers (Philip et al., 2017), sometimes with automated sensing of facial, gestural, and vocal behaviors useful for inferring the state of the user interacting with these VH entities (Rizzo et al.”
BackgroundLangevin, R., Berry, A. B. L., Zhang, J., Fockele, C. E., Anderson, L., Hsieh, D. T., Hartzler, A. L., Duber, H. C., & Hsieh, G. (2023) · Applied Clinical Informatics · doi:10.1055/a-2035-5342 · Cited by 18
Dupuy, L., Micoulaud‐Franchi, J., & Philip, P. (2020) · Journal of Sleep Research · doi:10.1111/jsr.13094 · Cited by 17
“For example, Philip and colleagues (Auriacombe et al., 2018; Philip, Bioulac, Sauteraud, Chaufton, & Olive, 2014; Philip et al., 2017) designed virtual agents for the diagnosis of major depressive disorders, alcohol and tobacco addiction and EDS, respectively, and found in more than 100 interviews…”
BackgroundSelf-citationCormons, L., Poulet, C., Pellier, D., Pesty, S., & Fiorino, H. (2020) · 2020 6th International Conference on Mechatronics and Robotics Engineering (ICMRE) · doi:10.1109/icmre49073.2020.9065021 · Cited by 16
“Patients found the face-to-face interview with the ECA very acceptable, suggesting that ECA “can communicate empathy, elicit patient trust, reduce the feeling of being judged by a human and reduce emotional barriers to disclose an affective state” (p.5).”
BackgroundInfluentialEmploying Conversational Agents in Palliative Care: A Feasibility Study and Preliminary Assessment
Chatzimina, M., Koumakis, L., Marias, K., & Tsiknakis, M. (2019) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2019.00095 · Cited by 18
“From these fourteen systems, seven conversational agents focus on patients [2],[21],[22],[23],[24],[25],[26], four conversational agents focus on clinicians [27],[28],[29],[30] and three conversational agents focus on both patients and clinicians [31],[32], [33],[34],[35],[36]”
BackgroundConversational Error Analysis in Human-Agent Interaction
Aneja, D., McDuff, D., & Czerwinski, M. (2020) · Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3383652.3423901 · Cited by 15
On the Generation of Medical Dialogues for COVID-19Preprint
Yang, W., Zeng, G., Tan, B., Ju, Z., Chakravorty, S., He, X., Chen, S., Yang, X., Wu, Q., Yu, Z., et al. (2020) · medRxiv · doi:10.1101/2020.05.08.20095810 · Cited by 15
Mancone, S., Diotaiuti, P., Valente, G., Corrado, S., Bellizzi, F., Vilarino, G. T., & Andrade, A. (2023) · Behavioral Sciences · doi:10.3390/bs13070550 · Cited by 14
Ricci, F., Giallanella, D., Gaggiano, C., Torales, J. C., Castaldelli-Maia, J. M., Liebrenz, M., Bener, A., & Ventriglio, A. (2024) · International Review of Psychiatry · doi:10.1080/09540261.2024.2384727 · Cited by 19
“Chatbots and conversational agents may significantly address therapeutic messages targeting depressive symptoms (Fitzpatrick, Darcy and Vierhile, 2017) and, where detected, suicide risk (Bresó et al., 2016; Philip et al., 2017).”
Song, T., Pabst, F., Eck, U., & Navab, N. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3549181 · Cited by 29
“Philip et al. [62] studied the acceptability of an ECA in a face-to-face clinical interview done to diagnose major depressive disorders.”
Guidelines for the design of a virtual patient for psychiatric interview training
Dupuy, L., de Sevin, É., Cassoudesalle, H., Ballot, O., Dehail, P., Aouizerate, B., Cuny, E., Micoulaud‐Franchi, J., & Philip, P. (2020) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-020-00338-8 · Cited by 18
“sleepiness [7], addiction for tobacco and alcohol consumption [8] and major depressive disorder [9].”
BackgroundSelf-citationDigital Conversational Agents for the Mental Health of Treatment-Seeking Youth: Scoping Review
Hawke, L. D., Hou, J., Nguyen, A. T. P., Phi, T., Gibson, J., Ritchie, B., Strudwick, G., Rodak, T., & Gallagher, L. (2025) · JMIR Mental Health · doi:10.2196/77098 · Cited by 12
“Others have been designed to promote service utilization [6], develop mindfulness and emotion regulation [7], determine diagnoses [8], or promote medication adherence [9].”
Capturing Teens’ Voice in Designing Supportive Agents
Lopatovska, I., Turpin, O., Davis, J., Connell, E. G., Denney, C., Fournier, H., Ravi, A., Yoon, J. H., & Parasnis, E. (2022) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3543829.3543838 · Cited by 18
“[75] showed how an embodied CA designed to diagnose a major depressive disorder (MDD) was perceived by participants as able to “communicate empathy, elicit patient trust, reduce the feeling of being judged by a human, and reduce the emotional barriers to disclose an affective state,” [75].”
BackgroundNatural Language Processing for Covid-19 Consulting System
Tripathy, S., Singh, R., & Ray, M. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.01.112 · Cited by 13
“In this section we present the dataset used in this experiment and the different types of methods used for the implementation of the dialogue system.”
MethodDEPRA: An Early Depression Detection Analysis Chatbot
Kaywan, P., Ahmed, K. E. U., Miao, Y., Ibaida, A., & Gu, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90885-0_18 · Cited by 12
Kuhail, M. A., Al-Shamaileh, O., Farooq, S., Shahin, H., Abdelzaher, F., & Thomas, J. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/9942295 · Cited by 11
Close encounters with the virtual kind: Defining a human-virtual agent coexistence framework
Arsenyan, J., Mirowska, A., & Piepenbrink, A. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122644 · Cited by 13
Visvanathan, K., Petry, D., McCullough, M. S., May, B., Tenkasi, R., Sharma, N., Klein, C. A., Johnson, A., Killian, G., Camp, M., et al. (2025) · Journal of Cancer Survivorship · doi:10.1007/s11764-023-01495-x · Cited by 11
“Clinical advancements from precision oncology have led the US National Comprehensive Cancer Network (NCCN) to recommend germline testing in every patient diagnosed with pancreas, ovarian, and colon cancer and in some patients with breast or prostate cancer [1–3].”
InfluentialSemantic similarity to improve question understanding in a virtual patient
Laleye, F. A. A., Blanié, A., Brouquet, A., Behnamou, D., & de Chalendar, G. (2020) · ACM Symposium on Applied Computing · doi:10.1145/3341105.3373936 · Cited by 12
“• the type of technology (platform hosting the conversational agent) namely smartphones [13], [14], laptops or desktops [15], [16] and multimodal platforms [17]; • the dialogue management strategy namely the finite state strategy where the dialogue is a sequence of predefined steps [15]–[17]; the content-based strateg…”
BackgroundIntelligent Conversational Agents in Global Health
Luxton, D. D., & Sirotin, A. P. (2020) · Springer eBooks · doi:10.1007/978-3-319-70134-9_11-1 · Cited by 13
A Survey of Conversational Agents and Their Applications for Self-Management of Chronic Conditions
Park, M. S., Upama, P. B., Anik, A. A., Ahamed, S. I., Luo, J., Tian, S., Rabbani, M., & Oh, H. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00162 · Cited by 18
“al [134] assessed the specificity of their agents that were developed for depressive disorder.”
BackgroundEthical approval and informed consent in mental health research: a scoping review
Cilar, L., & Štiglic, G. (2025) · AI & Society · doi:10.1007/s00146-025-02364-0 · Cited by 23
“Furthermore, clinical trials, such as the one by Philip et al. (2017), are subject to stringent regulatory requirements that differ significantly from those governing observational studies or other types of research.”
How to Design a Relevant Corpus for Sleepiness Detection Through Voice?
Martin, V., Rouas, J.-L., Micoulaud‐Franchi, J., Philip, P., & Krajewski, J. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.686068 · Cited by 17
“Given this situation, a virtual physician has been designed to follow-up patients at home (11, 12), allowing a regular collection of data and the measure of the variation of symptoms in response to the treatment.”
BackgroundSelf-citationCan intelligent agents improve data quality in online questiosnnaires? A pilot study
Söderström, A., Shatte, A. B. R., & Fuller‐Tyszkiewicz, M. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01574-w · Cited by 12
On the Generation of Medical Dialogues for COVID-19Preprint
Yang, W., Zeng, G., Tan, B., Ju, Z., Chakravorty, S., He, X., Chen, S., Yang, X., Wu, Q., Yu, Z., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05442 · Cited by 22
Loizou, M., Arnab, S., Lameras, P., Hartley, T. P., Loizides, F., Kumar, P., & Šumilo, D. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1307817 · Cited by 8
Yang, C., Nolte, I. M., Ma, Y., An, X., Bosker, F. J., & Li, J. (2021) · Molecular Genetics & Genomic Medicine · doi:10.1002/mgg3.1752 · Cited by 8
“Current diagnostic tools in psychiatry are based on the clusters of symptoms and characteristics of clinical course rather than defining it by pathophysiological processes underlying the disease (Philip et al., 2017; WHO, 2018).”
BackgroundA Review on Trustworthiness of Digital Assistants for Personal Healthcare
Bailoni, T., & Dragoni, M. (2025) · ACM Computing Surveys · doi:10.1145/3714999 · Cited by 11
Principles for Designing an mHealth App for Participatory Research and Management of Chronic Pain
Holowka, E. M., Woods, S., Pahayahay, A., Roy, M., & Khalili‐Mahani, N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77820-0_5 · Cited by 8
Miles, O., Pinckard, S., Gungor, M., Ridge, D., & Nadarzynski, T. (2025) · AI & Society · doi:10.1007/s00146-025-02332-8 · Cited by 6
“DHs and VAs have been implemented in healthcare areas such as mental health support (Pauw et al. 2022; Philip et al. 2017), health advice (J. Kim et al. 2023; Nallam et al. 2020), and long-term health self-management (Baptista et al. 2020; Sezgin et al. 2020).”
Cao, J., Pai, Y. S., Li, C., Hoermann, S., & Billinghurst, M. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720086 · Cited by 8
Using reading mistakes as features for sleepiness detection in speech
Martin, V. P., Chapouthier, G., Rieant, M., Rouas, J.-L., & Philip, P. (2020) · Proceedings of the International Conference on Speech Prosody · doi:10.21437/speechprosody.2020-201 · Cited by 8
Self-citationAn Analysis of Use Intention of Pet Disease Consultation Chatbot
Huang, D.-H., & Chueh, H.-E. (2020) · International Conference on E-Society, E-Education and E-Technology (ICSET) · doi:10.1145/3421682.3421693 · Cited by 6
“Many chatbots have been used in health-related practices, such as sports activities [19], psychological health [15], drug compliance [8], and depression and anxiety [3, 10, 11, 25], as well as in expressing sympathy and compassion [22].”
BackgroundOn the Generation of Medical Dialogues for COVID19Preprint
Yang, W., Zeng, G., Tan, B., Ju, Z., Chakravorty, S., He, X., Chen, S., Yang, X., Wu, Q., Zhou, Y., et al. (2020) · doi:10.36227/techrxiv.12290345 · Cited by 5
Herbener, A. B., Klincewicz, M., Frank, L. E., & Damholdt, M. F. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100182 · Cited by 6
“Thus, CAs have for instance been used for the initial screening and identification of mental health issues such as attention deficit hyperactivity disorder (Håvik et al., 2019) and the diagnoses of depression via machine learning-based virtual humans (Philip et al., 2017).”
Digital Humans for Depression Assessment and Intervention Support: Scoping Review
Cao, J., Gao, W., Wen, R., Li, C., Hoermann, S., Baghaei, N., & Billinghurst, M. (2025) · JMIR Mental Health · doi:10.2196/79954 · Cited by 3
“The second category is assessments through interviews, accounting for 5 of the studies [26,28,29,31,39].”
InfluentialKnowing is Trusting! The Influence of Familiarity on the Perception of Intelligent Virtual Agents
Poletaykina, A., Kruse, L., & Steinicke, F. (2025) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3717511.3747072 · Cited by 6
“Here, employing IVAs has many advantages over real doctors, e.g., their availability and accessibility [30], as well as their potential to be non-judgmental [42].”
Marcoux, A., Tessier, M.-H., Grondin, F., Reduron, L. R., & Jackson, P. L. (2021) · Santé mentale au Québec · doi:10.7202/1081509ar · Cited by 6
Telehealth for the geriatric population: uses, opportunities, and challenges
Alhuwail, D., Abd-Alrazaq, A. A., Al-Jafar, E., & Househ, M. S. (2021) · Elsevier eBooks · doi:10.1016/b978-0-323-85173-2.00008-4 · Cited by 6
On the Generation of Medical Dialogues for COVID19Preprint
Yang, W., Zeng, G., Tan, B., Ju, Z., Chakravorty, S., He, X., Chen, S., Yang, X., Wu, Q., Zhou, Y., et al. (2020) · doi:10.36227/techrxiv.12290345.v1 · Cited by 3
Detecting depression through speech and text from casual talks with fully automated virtual humans
Gómez-Zaragozá, L., Altozano, A., Llanes-Jurado, J., Minissi, M. E., Alcañíz, M., & Marín‐Morales, J. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103305 · Cited by 6
Intelligent Conversational Agents in Global Health
Luxton, D. D., & Sirotin, A. P. (2021) · Springer eBooks · doi:10.1007/978-3-030-57296-9_11 · Cited by 3
Physiological and Biological Testing and Assessment of Post-Traumatic Stress Disorder
Bulut, S., Salmanova, K., Crescenzo, P., & Bulut, N. (2023) · Avances en Psicología Latinoamericana · doi:10.12804/revistas.urosario.edu.co/apl/a.8258 · Cited by 2
“, 2008), and two, the Embodied Conversational Agent (eca) (Philip et al., 2017) methods.”
BackgroundMethodAcoustic Characterization of Huntington's Disease Emotional Expression: An Explainable AI Approach
Chenain, L., Bachoud‐Lévi, A., & Clavel, C. (2024) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw63320.2024.00052 · Cited by 3
“Collecting data on their emotional well-being can help clinicians address patients’ needs and provide a personalized healthcare approach [4], [5].”
Metadata
- Authors
- Philip, P., Micoulaud-Franchi, J.-A., Sagaspe, P., Sevin, E. D., Olive, J., Bioulac, S., & Sauteraud, A.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Corresponding author
- Philip, Pierre
- Venue
- Scientific Reports
- Published
- 2017-02-16
- Volume
- 7
- Issue
- 1
- Pages
- 42656-42656
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC5311989
- OpenAlex
- W2588443021
- Cited by
- 128
- References
- 39
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 6 · 2023: 20 · 2022: 19 · 2021: 19 · 2020: 27 · 2019: 5 · 2018: 5 · 2017: 1
- FWCI
- 11.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Oskar-Bordeaux (Universite de Bordeaux) (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- Funders
- Equipex
- Agence Nationale de la Recherche (ANR‐10‐EQPX‐12‐01, ANR-10-EQPX-0012, ANR-10, ANR-10-EQPX)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- embodied conversational agents, major depressive disorder, automated diagnosis, DSM-5 diagnostic criteria, diagnostic accuracy, acceptability, clinical interview, virtual humans, outpatients, depression severity, psychiatric diagnosis
- MeSH terms
- Proof of Concept Study, Adult, Major Depressive Disorder, Female, Humans, Interview, Psychological, Male, Middle Aged, Patient Acceptance of Health Care, ROC Curve, Severity of Illness Index, Software, User-Computer Interface, Reproducibility of Results, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.