Perceptions and Opinions of Patients About Mental Health Chatbots: Scoping Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 86 of the 87 references it cites were found in a registry or an index.
Abstract
Background: Chatbots have been used in the last decade to improve access to mental health care services. Perceptions and opinions of patients influence the adoption of chatbots for health care. Many studies have been conducted to assess the perceptions and opinions of patients about mental health chatbots. To the best of our knowledge, there has been no review of the evidence surrounding perceptions and opinions of patients about mental health chatbots. Objective: This study aims to conduct a scoping review of the perceptions and opinions of patients about chatbots for mental health. Methods: The scoping review was carried out in line with the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) extension for scoping reviews guidelines. Studies were identified by searching 8 electronic databases (eg, MEDLINE and Embase) in addition to conducting backward and forward reference list checking of the included studies and relevant reviews. In total, 2 reviewers independently selected studies and extracted data from the included studies. Data were synthesized using thematic analysis. Results: Of 1072 citations retrieved, 37 unique studies were included in the review. The thematic analysis generated 10 themes from the findings of the studies: usefulness, ease of use, responsiveness, understandability, acceptability, attractiveness, trustworthiness, enjoyability, content, and comparisons. Conclusions: The results demonstrated overall positive perceptions and opinions of patients about chatbots for mental health. Important issues to be addressed in the future are the linguistic capabilities of the chatbots: they have to be able to deal adequately with unexpected user input, provide high-quality responses, and have to show high variability in responses. To be useful for clinical practice, we have to find ways to harmonize chatbot content with individual treatment recommendations, that is, a personalization of chatbot conversations is required.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“During the initial development phase of a chatbot, it can produce crude responses that users may perceive as invalidating, robotic, or disconnected from their response [26].”
From A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study (2022) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Traditional applications designed for cognitive behavioral therapy (CBT) have primarily relied on rule-based logic and responses, which has led to interactions that can feel impersonal and static [3].”
From AI-Facilitated Cognitive Reappraisal via Socrates 2.0: Mixed Methods Feasibility Study. (2025) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is plausible that the human-like responses that LLMs produce lead to a greater sense of being understood compared to rule-based algorithms where responses often did not feel tailored to the individual [3].”
From AI-Facilitated Cognitive Reappraisal via Socrates 2.0: Mixed Methods Feasibility Study. (2025) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With the widespread, everyday use of smartphones, these emerging digital tools could function as efficient, widely available mental health resources for orthopedic clinicians to offer their patients [16,20-22].”
From A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study (2022) · cites this paper as [21]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While previous research has tested usefulness, acceptability, and perception [46], clinical effectiveness and reduction in the symptomology of depression, distress, and stress need to be tested more rigorously.”
From Providing Self-Led Mental Health Support Through an Artificial Intelligence–Powered Chat Bot (Leora) to Meet the Demand of Mental Health Care (2023) · cites this paper as [46]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 2×
“This review was developed, executed, and reported according to the PRISMA Extension for Scoping Reviews [20].”
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 4×
“A scoping review was conducted as the aim was to map the body of literature on this topic [18].”
Influential(1998) · Cited by 13,501
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817 · cited 2×
“The range of study designs currently used in the field makes equitable risk of bias assessment difficult; it is acknowledged that the risk of bias assessments is not required in scoping reviews [18,19].”
Murray, C. J. L., Vos, T., Lozano, R., Naghavi, M., Flaxman, A. D., Michaud, C., Ezzati, M., Shibuya, K., Salomon, J. A., Abdalla, S., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61689-4 · Cited by 8,888
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292 · cited 1×
“For many, accessing mental health care services is challenging because of the shortage of mental health care providers [4-7], lack of health care insurance coverage [8], and perceived stigma [9-11].”
The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846 · cited 1×
“Approximately 29% of individuals may experience such disorders in their lifetime [1].”
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 5×
“However, the content of chatbots was criticized by users because of its superficiality [33,38], irrelevancy [38], having too long videos [37], and having overwhelming information [57].”
InfluentialHawton, K., & van Heeringen, K. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60372-x · Cited by 1,671
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 3×
“Currently, systems are rather restricted in the number of responses, which might be because of the early development stage of many chatbots, as has already been reported by Laranjo et al [71].”
InfluentialWhiteford, H. A., Ferrari, A. J., Degenhardt, L., Feigin, V., & Vos, T. (2015) · PLOS ONE · doi:10.1371/journal.pone.0116820 · Cited by 1,175 · cited 1×
“Mental disorders have a negative effect on the quality of life and are one of the most common causes of disability [2].”
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 2×
“A total of 7 studies demonstrated that chatbot responses were repetitive [35-38, 40, 42, 61].”
Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048 · cited 5×
“For many, accessing mental health care services is challenging because of the shortage of mental health care providers [4-7], lack of health care insurance coverage [8], and perceived stigma [9-11].”
InfluentialFulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715 · cited 7×
“However, the content of chatbots was criticized by users because of its superficiality [33,38], irrelevancy [38], having too long videos [37], and having overwhelming information [57].”
InfluentialMetrics and Models in Software Quality Engineering
Finkbine, R. B. (1996) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/381790.565681 · Cited by 609 · cited 1×
“Software quality can be measured by reliability, security, maintainability, and efficiency using software engineering metrics [86].”
Mohr, D. C., Schueller, S. M., Montague, E., Burns, M. N., & Rashidi, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3077 · Cited by 510 · cited 1×
“Depending on the facet under consideration, different metrics can be used: system performance and effectiveness can be evaluated using different computational metrics (eg, usability, ease of use, usefulness) [85].”
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503 · cited 2×
“Given that Google Scholar usually finds several thousands of references, which are ordered by their relevance to the search topic, we screened only the first 100 references [14,15,21]; these references are the most relevant.”
Self-citationSelecting Studies and Collecting Data
Higgins, J. P., & Deeks, J. J. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch7 · Cited by 467 · cited 1×
“Cohen kappa was calculated to assess the intercoder agreement [22], which was 0.86 and 0.90 for screening titles and abstracts and for reading full texts, respectively, indicating excellent agreement [23].”
InfluentialEmbodied conversational agents in clinical psychology: a scoping review
Provoost, S., Lau, H. M., Ruwaard, J., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6553 · Cited by 433 · cited 3×
“To derive search terms, we checked previous literature reviews [4,14-17] and opinions of informatics experts interested in mental health (which were collected in informal meetings).”
Virtual Reality Job Interview Training in Adults with Autism Spectrum Disorder
Smith, M. J., Ginger, E. J., Wright, K., Wright, M. A., Taylor, J. L., Humm, L. B., Olsen, D. E., Bell, M. D., & Fleming, M. F. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2113-y · Cited by 401
Physicians’ perceptions of chatbots in health Care: cross-sectional web-based survey
Palanica, A., Flaschner, P., Thommandram, A., Li, M., & Fossat, Y. (2019) · Journal of Medical Internet Research · doi:10.2196/12887 · Cited by 384 · cited 2×
“Palanica et al [72] assessed physicians’ perceptions of health chatbots.”
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Mental health: there’s an app for that
Anthes, E. (2016) · Nature · doi:10.1038/532020a · Cited by 333 · cited 2×
“The lack of access to mental health care services increases the risk of self-harm and suicide [12,13].”
The Personalization of Conversational Agents in Health Care: Systematic Review
Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E. (2019) · Journal of Medical Internet Research · doi:10.2196/15360 · Cited by 332 · cited 1×
“This topic is still in its infancy [81].”
Reporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers
Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00051 · Cited by 308
Morris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10148 · Cited by 273
Effectiveness of an Empathic Chatbot in Combating Adverse Effects of Social Exclusion on Mood
de Gennaro, M., Krumhuber, E. G., & Lucas, G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03061 · Cited by 265 · cited 1×
“A study by de Gennaro [76] supports this by demonstrating that empathic chatbots have the potential to provide emotional support to victims of social exclusion.”
Caton, S., & Chapman, M. (2016) · Journal of Intellectual and Developmental Disability · doi:10.3109/13668250.2016.1153052 · Cited by 257 · cited 1×
“This data synthesis approach (ie, thematic analysis) has been applied in numerous systematic and scoping reviews [24-28].”
State of the Field of Mental Health Apps
Neary, M., & Schueller, S. M. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2018.01.002 · Cited by 247
I Can Help You Change! An Empathic Virtual Agent Delivers Behavior Change Health Interventions
Lisetti, C., Amini, R., Yasavur, U., & Rishe, N. (2013) · ACM Transactions on Management Information Systems · doi:10.1145/2544103 · Cited by 242 · cited 5×
“The study also found that participants were more willing to use empathic chatbots than nonempathic chatbots and text-based chatbots [58].”
InfluentialA Mental Health Chatbot for Regulating Emotions (SERMO) - Concept and Usability Test
Denecke, K., Vaaheesan, S., & Arulnathan, A. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2020.2974478 · Cited by 237 · cited 1×
“A recent paper on a chatbot for regulating emotions shows that perceptions of patients and psychologists differ regarding attractiveness, efficiency, and stimulations of health chatbots [73].”
Self-citationResponse to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218 · cited 3×
“Furthermore, 6 studies demonstrated that people would like to use chatbots in the future [35,43,45,46,50,53,54,61,65], whereas participants in 2 studies were ambivalent about the future use of chatbots [33,39].”
Bendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H. (2022) · Verhaltenstherapie · doi:10.1159/000501812 · Cited by 214 · cited 1×
“In addition, the results of Bendig et al [16] suggest the practicability, feasibility, and acceptance of using chatbots to promote mental health.”
Maintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213
Sentiment Analysis of Suicide Notes: A Shared Task
Pestian, J. P., Matykiewicz, P., Linn-Gust, M., South, B., Uzuner, O., Wiebe, J., Cohen, K. B., Hurdle, J., & Brew, C. (2012) · Biomedical Informatics Insights · doi:10.4137/bii.s9042 · Cited by 210 · cited 1×
“Sentiment analysis methods have proven to be successful in analyzing social media messages with respect to suicide and self-harm [80].”
Many Mobile Health Apps Target High-Need, High-Cost Populations, But Gaps Remain
Singh, K., Drouin, K., Newmark, L. P., Lee, J., Faxvaag, A., Rozenblum, R., Pabo, E. A., Landman, A., Klinger, E., & Bates, D. W. (2016) · Health Affairs · doi:10.1377/hlthaff.2016.0578 · Cited by 201 · cited 1×
“In addition, Singh et al [75] showed that only 23% of mHealth apps responded adequately to dangerous user input (eg, suicidal ideations).”
Pocket Skills: A Conversational Mobile Web App To Support Dialectical Behavioral Therapy
Schroeder, J., Wilkes, C., Rowan, K., Toledo, A., Paradiso, A., Czerwinski, M., Mark, G., & Linehan, M. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173972 · Cited by 175 · cited 6×
“The ease of use and usability of chatbots were assessed in 20 studies [33,34,36,39,43,46-51 ,53-61].”
InfluentialEffect of pH on ionic exchange and function in rat and rabbit myocardium
Poole-Wilson, P., & Langer, G. (1975) · American Journal of Physiology-Legacy Content · doi:10.1152/ajplegacy.1975.229.3.570 · Cited by 174
How Adolescents Search for and Appraise Online Health Information: A Systematic Review
Freeman, J. L., Caldwell, P. H. Y., Bennett, P. A., & Scott, K. M. (2018) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.11.031 · Cited by 171
Design of a virtual reality based adaptive response technology for children with autism
Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., & Sarkar, N. (2013) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2012.2218618 · Cited by 162 · cited 2×
“Furthermore, 6 studies demonstrated that people would like to use chatbots in the future [35,43,45,46,50,53,54,61,65], whereas participants in 2 studies were ambivalent about the future use of chatbots [33,39].”
A systematic review and thematic analysis of cinema in medical education
Darbyshire, D., & Baker, P. (2012) · Medical Humanities · doi:10.1136/medhum-2011-010026 · Cited by 162
Computers in the clinical encounter: a scoping review and thematic analysis
Crampton, N. H., Reis, S. P., & Shachak, A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv178 · Cited by 156
Technical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150 · cited 1×
“The first attempts toward evaluation frameworks for digital health interventions [82] and health chatbots [83,84] have been recently published.”
Self-citationBlankers, M., Koeter, M. W. J., & Schippers, G. M. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0023498 · Cited by 146 · cited 1×
“For many, accessing mental health care services is challenging because of the shortage of mental health care providers [4-7], lack of health care insurance coverage [8], and perceived stigma [9-11].”
Philip, P., Micoulaud-Franchi, J.-A., Sagaspe, P., Sevin, E. D., Olive, J., Bioulac, S., & Sauteraud, A. (2017) · Scientific Reports · doi:10.1038/srep42656 · Cited by 128 · cited 1×
“According to Morris et al [67], participants preferred the chatbot’s responses drawn from an existing pool of web-based peer support data rather than those generated by the chatbot itself.”
Burton, C., Szentagotai Tatar, A., McKinstry, B., Matheson, C., Matu, S., Moldovan, R., Macnab, M., Farrow, E., David, D., Pagliari, C., et al. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15609793 · Cited by 125 · cited 10×
“Participants in 3 studies appreciated the personalization feature in chatbots that allowed them to customize the session length and the gender and appearance of the virtual agent [35,57,60].”
InfluentialA design and evaluation framework for digital health interventions
Kowatsch, T., Otto, L., Harperink, S., Cotti, A., & Schlieter, H. (2019) · it - Information Technology · doi:10.1515/itit-2019-0019 · Cited by 116 · cited 1×
“The first attempts toward evaluation frameworks for digital health interventions [82] and health chatbots [83,84] have been recently published.”
Abd-alrazaq, A. A., Bewick, B. M., Farragher, T., & Gardner, P. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.03.014 · Cited by 109 · cited 9×
“To derive search terms, we checked previous literature reviews [4,14-17] and opinions of informatics experts interested in mental health (which were collected in informal meetings).”
InfluentialSelf-citationEthical implications of conversational agents in global public health
Luxton, D. D. (2020) · Bulletin of the World Health Organization · doi:10.2471/blt.19.237636 · Cited by 108 · cited 1×
“In mental health, it is crucial to react appropriately for people who are at risk of suicide or self-harm [79].”
Introduction to Qualitative Research Methods in Psychology
Howitt, D. (2016) · Cited by 108
Ali, M. R., Razavi, S. Z., Langevin, R., Al Mamun, A., Kane, B., Rawassizadeh, R., Schubert, L. K., & Hoque, E. (2020) · Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3383652.3423900 · Cited by 97
Sebastian, J., & Richards, D. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.071 · Cited by 96 · cited 1×
“For many, accessing mental health care services is challenging because of the shortage of mental health care providers [4-7], lack of health care insurance coverage [8], and perceived stigma [9-11].”
Tielman, M. L., Neerincx, M. A., Bidarra, R., Kybartas, B., & Brinkman, W.-P. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0771-y · Cited by 94 · cited 2×
“In 3 studies [41,47-49, 51], the overall usefulness of chatbots Users considered the following components of chatbots useful: real-time feedback [33,45,50], diary [52], weekly summary [42], presenting the helpline during the conversation [36], and psychoeducation [52].”
Assessing the Usability of a Chatbot for Mental Health Care
Cameron, G., Cameron, D., Megaw, G., Bond, R., Mulvenna, M. D., O’Neill, S. M., Armour, C., & McTear, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-17705-8_11 · Cited by 92 · cited 5×
“The ease of use and usability of chatbots were assessed in 20 studies [33,34,36,39,43,46-51 ,53-61].”
InfluentialLack of access to mental health services contributing to the high suicide rates among veterans
Hester, R. D. (2017) · International Journal of Mental Health Systems · doi:10.1186/s13033-017-0154-2 · Cited by 81 · cited 1×
“For many, accessing mental health care services is challenging because of the shortage of mental health care providers [4-7], lack of health care insurance coverage [8], and perceived stigma [9-11].”
Brain drain: a challenge to global mental health
Oladeji, B. D., & Gureje, O. (2016) · BJPsych. International · doi:10.1192/s2056474000001240 · Cited by 79
Grolleman, J., van Dijk, B., Nijholt, A., & van Emst, A. J. (2006) · Lecture notes in computer science · doi:10.1007/11755494_19 · Cited by 75 · cited 2×
“Furthermore, 6 studies demonstrated that people would like to use chatbots in the future [35,43,45,46,50,53,54,61,65], whereas participants in 2 studies were ambivalent about the future use of chatbots [33,39].”
VR-Based Conversation Training Program for Patients with Schizophrenia: A Preliminary Clinical Trial
Ku, J., Han, K., Lee, H. R., Jang, H. J., Kim, K. U., Park, S. H., Kim, J. J., Kim, C. H., Kim, I. Y., & Kim, S. I. (2007) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.9989 · Cited by 71 · cited 1×
“In 3 studies [41,47-49, 51], the overall usefulness of chatbots Users considered the following components of chatbots useful: real-time feedback [33,45,50], diary [52], weekly summary [42], presenting the helpline during the conversation [36], and psychoeducation [52].”
Virtual Reality Job Interview Training for Individuals With Psychiatric Disabilities
Smith, M. J., Ginger, E. J., Wright, M., Wright, K., Boteler Humm, L., Olsen, D., Bell, M. D., & Fleming, M. F. (2014) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000187 · Cited by 71
A Conversational Agent for an Online Mental Health Intervention
Elmasri, D., & Maeder, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-47103-7_24 · Cited by 68 · cited 7×
“However, the content of chatbots was criticized by users because of its superficiality [33,38], irrelevancy [38], having too long videos [37], and having overwhelming information [57].”
InfluentialProfessionals’ views of fetal monitoring during labour: a systematic review and thematic analysis
Smith, V. A., Begley, C., Clarke, M. J., & Devane, D. (2012) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-12-166 · Cited by 66 · cited 1×
“This data synthesis approach (ie, thematic analysis) has been applied in numerous systematic and scoping reviews [24-28].”
Virtual reality job interview training for veterans with posttraumatic stress disorder
Smith, M. J., Boteler Humm, L., Fleming, M. F., Jordan, N., Wright, M. A., Ginger, E. J., Wright, K., Olsen, D., & Bell, M. D. (2015) · Journal of Vocational Rehabilitation · doi:10.3233/jvr-150748 · Cited by 63 · cited 1×
“In 3 studies [41,47-49, 51], the overall usefulness of chatbots Users considered the following components of chatbots useful: real-time feedback [33,45,50], diary [52], weekly summary [42], presenting the helpline during the conversation [36], and psychoeducation [52].”
Tielman, M. L., Neerincx, M. A., van Meggelen, M., Franken, I., & Brinkman, W.-P. (2018) · Technology and Health Care · doi:10.3233/thc-170899 · Cited by 63 · cited 7×
“However, other studies demonstrated that participants had neutral perceptions and opinions about the added value of embodied virtual agents with speech [52] or without speech [44].”
InfluentialSwartout, W., Artstein, R., Forbell, E., Foutz, S., Lane, H. C., Lange, B., Morie, J., Noren, D., Rizzo, S., & Traum, D. (2013) · AI Magazine · doi:10.1609/aimag.v34i4.2487 · Cited by 61 · cited 5×
“One study concluded that participants were satisfied with the anonymity, confidentiality, and objectivity of chatbots [63].”
InfluentialHow Google’s ‘ten things we know to be true’could guide the development of mental health mobile apps
Jones, S. P., Patel, V., Saxena, S., Radcliffe, N., Ali Al-Marri, S., & Darzi, A. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0380 · Cited by 58 · cited 2×
“Technological advancements have improved access to mental health care services [3].”
Siervo, M., Faber, P., Gibney, E. R., Lobley, G. E., Elia, M., Stubbs, R. J., & Johnstone, A. M. (2010) · International Journal of Obesity · doi:10.1038/ijo.2010.9 · Cited by 56
Development of a virtual agent based social tutor for children with autism spectrum disorders
Milne, M., Luerssen, M. H., Lewis, T. W., Leibbrandt, R. E., & Powers, D. M. W. (2010) · The 2010 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596584 · Cited by 55 · cited 1×
“Most participants in several studies stated that chatbots were able to show friendly [34,52,59,60,63] and emotional [35,37,38] responsiveness.”
Development and validation of a virtual agent to screen tobacco and alcohol use disorders
Auriacombe, M., Moriceau, S., Serre, F., Denis, C., Micoulaud-Franchi, J.-A., de Sevin, E., Bonhomme, E., Bioulac, S., Fatseas, M., & Philip, P. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.08.025 · Cited by 55 · cited 1×
“The acceptability of chatbots was rated high by users in 12 studies [34,37,38,43,45,46,53,54,57,61,66,68].”
Yokotani, K., Takagi, G., & Wakashima, K. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.03.045 · Cited by 51 · cited 3×
“Participants also indicated that the rule-based chatbot is less able to understand their responses and feelings than a real expert [69].”
InfluentialAutomated Social Skills Trainer
Tanaka, H., Sakti, S., Neubig, G., Toda, T., Negoro, H., Iwasaka, H., & Nakamura, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701368 · Cited by 49 · cited 3×
“Furthermore, 6 studies demonstrated that people would like to use chatbots in the future [35,43,45,46,50,53,54,61,65], whereas participants in 2 studies were ambivalent about the future use of chatbots [33,39].”
Pinto, M. D., Greenblatt, A. M., Hickman, R. L., Rice, H. M., Thomas, T. L., & Clochesy, J. M. (2016) · Perspectives in Psychiatric Care · doi:10.1111/ppc.12112 · Cited by 46 · cited 6×
“The ease of use and usability of chatbots were assessed in 20 studies [33,34,36,39,43,46-51 ,53-61].”
InfluentialFitzpatrick, M., Nedeljkovic, M., Abbott, J.-A., Kyrios, M., & Moulding, R. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.02.006 · Cited by 42 · cited 1×
“Another approach is blended therapy [77], a combination of face-to-face and web-based or digital therapy, which shows the potential of a cost-effective and accessible format in cognitive behavioral therapy.”
Usability and acceptability assessment of an empathic virtual agent to prevent major depression
Bresó, A., Martínez‐Miranda, J., Botella, C., Baños, R. M., & García‐Gómez, J. M. (2016) · Expert Systems · doi:10.1111/exsy.12151 · Cited by 36 · cited 8×
“The ease of use and usability of chatbots were assessed in 20 studies [33,34,36,39,43,46-51 ,53-61].”
InfluentialThe LISSA Virtual Human and ASD Teens: An Overview of Initial Experiments
Razavi, S. Z., Ali, M. R., Smith, T. H., Schubert, L. K., & Hoque, M. E. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-47665-0_55 · Cited by 34 · cited 9×
“Although most participants in one study preferred interacting with a chatbot rather than a human for their health care [53], participants in another 2 studies had mixed preferences about that [33,45].”
InfluentialLet’s talk! speaking virtual counselor offers you a brief intervention
Yasavur, U., Lisetti, C., & Rishe, N. (2014) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-014-0169-9 · Cited by 32 · cited 6×
“The ease of use and usability of chatbots were assessed in 20 studies [33,34,36,39,43,46-51 ,53-61].”
InfluentialWargnier, P., Benveniste, S., Jouvelot, P., & Rigaud, A.-S. (2018) · Technology and Disability · doi:10.3233/tad-180189 · Cited by 32 · cited 7×
“Participants in 3 studies appreciated the personalization feature in chatbots that allowed them to customize the session length and the gender and appearance of the virtual agent [35,57,60].”
InfluentialVirtual Agents as a Service: Applications in Healthcare
Luerssen, M. H., & Hawke, T. (2018) · Proceedings of the 18th International Conference on Intelligent Virtual Agents · doi:10.1145/3267851.3267858 · Cited by 28 · cited 3×
“Participants in 15 studies rated the In 3 studies, participants faced difficulty in using the chatbot because they did not know when [60] and how [61] to reply to it, and they did not have enough options to reply to it [62].”
A Virtual Therapist That Responds Empathically to Your Answers
Pontier, M. A., & Siddiqui, G. F. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8_42 · Cited by 28 · cited 10×
“However, other studies demonstrated that participants had neutral perceptions and opinions about the added value of embodied virtual agents with speech [52] or without speech [44].”
InfluentialStratou, G., Morency, L., DeVault, D., Hartholt, A., Fast, E., Lhommet, M., Lucas, G., Morbini, F., Georgila, K., Scherer, S. J., et al. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344661 · Cited by 26
Look on the Bright Side: A Model of Cognitive Change in Virtual Agents
Martínez-Miranda, J., Bresó, A., & García-Gómez, J. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-09767-1_37 · Cited by 18 · cited 1×
“However, participants in other studies had mixed perceptions and opinions about the ability of chatbots to generate friendly [35,44,64] and emotional [64] responses.”
How to Evaluate Health Applications with Conversational User Interface?
Kerstin, D., & Jim, W. (2020) · Studies in Health Technology and Informatics · doi:10.3233/shti200307 · Cited by 18 · cited 1×
“The first attempts toward evaluation frameworks for digital health interventions [82] and health chatbots [83,84] have been recently published.”
Self-citationA.Schwandt, T. (2007) · The SAGE Dictionary of Qualitative Inquiry · doi:10.4135/97814129862681.n339 · Cited by 15
Carbonell, J. G., Siekmann, J., Prendinger, H., Lester, J. C., & Ishizuka, M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8 · Cited by 11
DEMİRCİ, H. M. (2018) · OpenMETU (Middle East Technical University) · Cited by 8
Palanica, A. (2019) · Definitions · doi:10.32388/154010 · Cited by 1
Research works printed but not linked: 10
- 10.1055/s-0031-1284519 · DOI · Paper page
- Search TipGoogle Scholars20202020-12-21https://scholar.google.com/intl/en/scholar/help.html
- Orwin, R, 2009, The Handbook of Research Synthesis and Meta-analysis. Second Edition, 177
- Wilson, S, 2011, Research Methods and Data Analysis for Psychology
- 10.2196/mental.9782 · doi:10.2196/mental.9782 · Paper page
- 10.2196/12106 · doi:10.2196/12106 · Paper page
- 10.1016/j.intcom.2009.12.001 · DOI · Paper page
- DeVaultDArtsteinRBennGDeyTFastEGainerASimsensei Kiosk: a Virtual Human Interviewer for Healthcare Decision SupportProceedings of the 2014 international conference on Autonomous agents and multi-agent systems2014AAMS'143-5 May 2014Paris, France
- Fadhil, A, 2019, ArXiv, 1
- YuZXuZBlackAWRudnickyAChatbot Evaluation and Database Expansion via CrowdsourcingProceedings of the chatbot workshop of LREC2016LREC'162016UK
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
“…use by demographic and family-centric groups and their accessibility to underserved populations underline the inclusive capacity of chatbots and their role in enhancing health care access and equity, especially for groups considered marginalized, in line with existing research [12,67,255,263-265].”
Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data
Xu, X., Yao, B., Dong, Y., Gabriel, S., Yu, H., Hendler, J., Ghassemi, M., Dey, A. K., & Wang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3643540 · Cited by 278
“…of opportunities for UbiComp, Human-Computer Interaction (HCI), and mental health communities, such as online public health monitoring systems [41, 78], intelligent assistants for mental health therapists, counselors, and supporters [94, 95], mental-health-aware personal chatbots [5, 34], etc.”
BackgroundLoneliness and suicide mitigation for students using GPT3-enabled chatbots
Maples, B., Cerit, M., Vishwanath, A., & Pea, R. (2024) · npj Mental Health Research · doi:10.1038/s44184-023-00047-6 · Cited by 250
Metadata
- Authors
- Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M.
- Affiliations
- Hamad bin Khalifa University (QA)
- University of Warwick (GB)
- Bern University of Applied Sciences (CH)
- University of Leeds (GB)
- Corresponding author
- Househ, Mowafa
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-01-13
- Volume
- 23
- Issue
- 1
- Pages
- e17828
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7840290
- OpenAlex
- W3036236864
- Cited by
- 301
- References
- 87
- Citations by year
- 2026: 47 · 2025: 70 · 2024: 72 · 2023: 56 · 2022: 41 · 2021: 14
- FWCI
- 4.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Warwick Research Archive Portal (University of Warwick) (submittedVersion)
- Funders
- Fonds National de la Recherche Luxembourg
- Qatar National Research Fund (NPRP12S-0303-190204, NPRP12S-)
- Qatar National Library
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- mental health chatbots, patient perspectives, chatbot acceptance, chatbot usability, digital mental health
- MeSH terms
- Attitude, Humans, Mental Health, Perception, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
