The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
The Next Generation: Chatbots in Clinical Psychology and Psychotherapy to Foster Mental Health – A Scoping Review
Abstract
Background and Purpose: The present age of digitalization brings with it progress and new possibilities for health care in general and clinical psychology/psychotherapy in particular. Internet- and mobile-based interventions (IMIs) have often been evaluated. A fully automated version of IMIs are chatbots. Chatbots are automated computer programs that are able to hold, e.g., a script-based conversation with a human being. Chatbots could contribute to the extension of health care services. The aim of this review is to conceptualize the scope and to work out the current state of the art of chatbots fostering mental health. Methods: The present article is a scoping review on chatbots in clinical psychology and psychotherapy. Studies that utilized chatbots to foster mental health were included. Results: The technology of chatbots is still experimental in nature. Studies are most often pilot studies by nature. The field lacks high-quality evidence derived from randomized controlled studies. Results with regard to practicability, feasibility, and acceptance of chatbots to foster mental health are promising but not yet directly transferable to psychotherapeutic contexts. Discussion: The rapidly increasing research on chatbots in the field of clinical psychology and psychotherapy requires corrective measures. Issues like effectiveness, sustainability, and especially safety and subsequent tests of technology are elements that should be instituted as a corrective for future funding programs of chatbots in clinical psychology and psychotherapy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This finding is in accordance with some of the previous reviews conducted on evaluation of CAs in adult healthcare14,53.”
From Use of automated conversational agents in improving young population mental health: a scoping review (2024) · cites this paper as [53]
In the citing paper
“The meta-analysis by Bendig et al [17] supports the view that state-of-the-art mental health chatbots are still experimental and that little evidence for transferring results to real psychotherapy contexts is available.”
From A conversational artificial intelligence agent for a mental health care app: Evaluation study of its participatory design (2021) · cites this paper as [17]
Citations
Cites
The satisfaction with life scale
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4901_13 · Cited by 31,768
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
The necessary and sufficient conditions of therapeutic personality change.
Rogers, C. R. (1957) · Journal of Consulting Psychology · doi:10.1037/h0045357 · Cited by 5,599 · cited 1×
“ELIZA [Weizenbaum, 1966], the first chatbot, simulated a psychotherapeutic conversation using a trivial script, resulting in a dialogue with users by means of set queries based on the user's inputs [Gesprächspsychotherapie nach Rogers, 1957].”
The PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121
New well-being measures: Short scales to assess flourishing and positive and negative feelings
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-W., Oishi, S., & Biswas-Diener, R. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9493-y · Cited by 4,980
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 10×
“…et al., 2018 Mylo UK 2-arm RCT ITT Nonclinical 171 21.28 ±6.19 90.3 Active CG (ELIZA) ≥20 min MOL [Carey, 2006] Depression, anxiety, stress, DASS-21 Fitzpatrick et al., 2017 Woebot USA 2-arm RCT PP Nonclinical 70 22.2 ±2.33 (18–28) 67.0 Active CG (infomaterial) 2 weeks CBT Anxiety (GAD-7),…”
BackgroundMethodResultInfluentialBarriers to mental health treatment: results from the WHO World Mental Health surveys
Andrade, L. H., Alonso, J., Mneimneh, Z., Wells, J. E., Al-Hamzawi, A., Borges, G., Bromet, E., Bruffaerts, R., de Girolamo, G., de Graaf, R., et al. (2014) · Psychological Medicine · doi:10.1017/s0033291713001943 · Cited by 1,289
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232
Bower, P., & Gilbody, S. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.186.1.11 · Cited by 1,084 · cited 1×
“Another area of research is stepped-care approaches, in which online services represent a low-threshold first step in a tiered supply model [Bower and Gilbody, 2005; Domhardt and Baumeister, 2018].”
BackgroundAndersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 2×
“Psychological problems such as anxiety and depression are already being effectively addressed in this way [Andersson et al., 2014, 2016; Carlbring et al., 2018].”
BackgroundChowdhury, G. G. (2003) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440370103 · Cited by 863
Stigma about depression and its impact on help-seeking intentions
Barney, L. J., Griffiths, K. M., Jorm, A. F., & Christensen, H. (2006) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2006.01741.x · Cited by 844
Brandtzaeg, P. B., & Følstad, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70284-1_30 · Cited by 788
Jacobi, F., Höfler, M., Strehle, J., Mack, S., Gerschler, A., Scholl, L., Busch, M. A., Maske, U., Hapke, U., Gaebel, W., et al. (2014) · Der Nervenarzt · doi:10.1007/s00115-013-3961-y · Cited by 750
Defining Internet-Supported Therapeutic Interventions
Barak, A., Klein, B., & Proudfoot, J. G. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9130-7 · Cited by 731 · cited 1×
“Barak et al. [2009] define a webbased intervention as “a primarily self-guided intervention program that is executed by means of a prescriptive online program operated through a website and used by consumers seeking health- and mental-health-related assistance” [Barak et al., 2009; p. 5].”
MethodDiscovering Shifts to Suicidal Ideation from Mental Health Content in Social Media
Choudhury, M. D., Kıcıman, E., Dredze, M. H., Coppersmith, G., & Kumar, M. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858207 · Cited by 706
Karyotaki, E., Riper, H., Twisk, J., Hoogendoorn, A., Kleiboer, A., Mira, A., Mackinnon, A., Meyer, B., Botella, C., Littlewood, E., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0044 · Cited by 691
Ho, A., Hancock, J., & Miner, A. S. (2018) · Journal of Communication · doi:10.1093/joc/jqy026 · Cited by 629 · cited 1×
“An example of a paradigm that is currently receiving much attention in this research context is therapeutic writing [Tielman et al., 2017; Bendig et al., 2018; Ho et al., 2018].”
Dale, R. (2016) · Natural Language Engineering · doi:10.1017/s1351324916000243 · Cited by 554
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
Self-citationEmbodied conversational agents in clinical psychology: a scoping review
Provoost, S., Lau, H. M., Ruwaard, J., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6553 · Cited by 433
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
'It's just like you talk to a friend': relational agents for older adults
Bickmore, T. W., Caruso, L., Clough-Gorr, K., & Heeren, T. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2005.09.002 · Cited by 341 · cited 2×
“More powerful chatbots can analyze user input and communication patterns more comprehensively, thus responding in a more precise way and deriving contextual information, such as users' emotions [Bickmore et al., 2005a,b].”
BackgroundJosephine, K., Josefine, L., Philipp, D., David, E., & Harald, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.021 · Cited by 341
All in the Family: systematic reviews, rapid reviews, scoping reviews, realist reviews, and more
Moher, D., Stewart, L., & Shekelle, P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0163-7 · Cited by 288
Morris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10148 · Cited by 273
Klopfenstein, L. C., Delpriori, S., Malatini, S., & Bogliolo, A. (2017) · Designing Interactive Systems Conference · doi:10.1145/3064663.3064672 · Cited by 257
Response to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218
Maintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213
Automated interventions for multiple health behaviors using conversational agents
Bickmore, T. W., Schulman, D., & Sidner, C. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.011 · Cited by 206
Artificial Intelligence-Assisted Online Social Therapy for Youth Mental Health
D'Alfonso, S., Santesteban-Echarri, O., Rice, S., Wadley, G., Lederman, R., Miles, C., Gleeson, J., & Alvarez-Jimenez, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00796 · Cited by 192 · cited 3×
“therapeutic context could be support for the prevention, treatment, and follow-up/relapse prevention of psychological problems and mental disorders [Huang et al., 2015; D'Alfonso et al., 2017; Bird et al., 2018].”
BackgroundInfluentialDowling, M. J., & Rickwood, D. (2013) · Journal of Technology in Human Services · doi:10.1080/15228835.2012.728508 · Cited by 190
Gardiner, P. M., McCue, K. D., Negash, L. M., Cheng, T., White, L. F., Yinusa-Nyahkoon, L., Jack, B. W., & Bickmore, T. W. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.04.015 · Cited by 139
Feijt, M. A., de Kort, Y. A., Bongers, I. M., & IJsselsteijn, W. A. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9485 · Cited by 134 · cited 3×
“It is conceivable that by adopting microinterventions that require little therapist contact (such as anamnesis or psychoeducation), the therapists will have time to see more patients or to give more intensive care [Feijt et al., 2018].”
BackgroundInfluentialGaffney, H., Mansell, W., Edwards, R., & Wright, J. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246581300060x · Cited by 122
Teaching Negotiation Skills through Practice and Reflection with Virtual Humans
Core, M. G., Traum, D. R., Lane, H. C., Swartout, W., Gratch, J. S., van Lent, M., & Marsella, S. (2006) · SIMULATION · doi:10.1177/0037549706075542 · Cited by 120
Can a virtual cat persuade you?
Zanbaka, C., Goolkasian, P. A., & Hodges, L. F. (2006) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124945 · Cited by 118
Internet-supported versus face-to-face cognitive behavior therapy for depression
Andersson, G., Topooco, N., Havik, O., & Nordgreen, T. (2016) · Expert Review of Neurotherapeutics · doi:10.1586/14737175.2015.1125783 · Cited by 117
Kanter, J. W., Rusch, L. C., Busch, A. M., & Sedivy, S. K. (2008) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-008-9088-y · Cited by 114
Suganuma, S., Sakamoto, D., & Shimoyama, H. (2018) · JMIR Mental Health · doi:10.2196/10454 · Cited by 112
Bird, T., Mansell, W., Wright, J., Gaffney, H., & Tai, S. (2018) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465817000820 · Cited by 109
Virtual training and coaching of health behavior: Example from mindfulness meditation training
Hudlicka, E. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.007 · Cited by 104
Baumeister, H. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.05.025 · Cited by 97
Self-citationSebastian, J., & Richards, D. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.071 · Cited by 96
Reaching Women through Health Information Technology: The Gabby Preconception Care System
Gardiner, P., Hempstead, M. B., Ring, L., Bickmore, T., Yinusa-Nyahkoon, L., Tran, H., Paasche-Orlow, M., Damus, K., & Jack, B. (2013) · American Journal of Health Promotion · doi:10.4278/ajhp.1200113-quan-18 · Cited by 88
Stieger, M., Nißen, M., Rüegger, D., Kowatsch, T., Flückiger, C., & Allemand, M. (2018) · BMC Psychology · doi:10.1186/s40359-018-0257-9 · Cited by 78
Embodied Conversational Agents: Effects on Memory Performance and Anthropomorphisation
Beun, R., de Vos, E., & Witteman, C. L. M. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39396-2_52 · Cited by 71
Tielman, M. L., Neerincx, M. A., van Meggelen, M., Franken, I., & Brinkman, W.-P. (2018) · Technology and Health Care · doi:10.3233/thc-170899 · Cited by 63 · cited 1×
“An example of a paradigm that is currently receiving much attention in this research context is therapeutic writing [Tielman et al., 2017; Bendig et al., 2018; Ho et al., 2018].”
Blended Psychotherapy – verzahnte Psychotherapie: Das Beste aus zwei Welten?
Baumeister, H., Grässle, C., Ebert, D. D., & Krämer, L. V. (2018) · PiD - Psychotherapie im Dialog · doi:10.1055/a-0592-0264 · Cited by 63
Self-citationPsychotherapy of adjustment disorders: Current state and future directions
Domhardt, M., & Baumeister, H. (2018) · The World Journal of Biological Psychiatry · doi:10.1080/15622975.2018.1467041 · Cited by 61
Self-citationMartínez-Miranda, J. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0784-6 · Cited by 51
TeenChat: A Chatterbot System for Sensing and Releasing Adolescents’ Stress
Huang, J., Li, Q., Xue, Y., Cheng, T., Xu, S., Jia, J., & Feng, L. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-19156-0_14 · Cited by 49
Judgment of the Humanness of an Interlocutor Is in the Eye of the Beholder
Lortie, C. L., & Guitton, M. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025085 · Cited by 46
IDEAS4Games: Building Expressive Virtual Characters for Computer Games
Gebhard, P., Schröder, M., Charfuelàn, M., Endres, C., Kipp, M., Pammi, S., Rumpler, M., & Türk, O. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8_43 · Cited by 39
Baldauf, M., Bösch, R., Frei, C., Hautle, F., & Jenny, M. (2018) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/3236112.3236128 · Cited by 32
Relational Agents for Chronic Disease Self-Management
Bickmore, T. (2010) · The MIT Press eBooks · doi:10.7551/mitpress/9780262014328.003.0007 · Cited by 23
Grünzig, S.-D., Baumeister, H., Bengel, J., Ebert, D. D., & Krämer, L. V. (2018) · Trials · doi:10.1186/s13063-018-2657-9 · Cited by 23
Self-citation'The Chatbot Will See You Now': Mental Health Confidentiality Concerns in Software TherapyPreprint
Stiefel, S. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3166640 · Cited by 18
Internet- und mobilebasierte Intervention bei psychischen Störungen
Paganini, S., Lin, J., Ebert, D. D., & Baumeister, H. (2016) · NeuroTransmitter · doi:10.1007/s15016-016-5393-y · Cited by 15
Self-citationBuilding Rapport with Extraverted and Introverted Agents
Brixey, J., & Novick, D. (2018) · Lecture notes in electrical engineering · doi:10.1007/978-3-319-92108-2_1 · Cited by 9
Zobel, A., & Meyer, A. (2018) · Springer Reference Medizin · doi:10.1007/978-3-662-54250-7_4 · Cited by 6
Cited by
Sorted by citations
Enhancing mental health with Artificial Intelligence: Current trends and future prospects
Olawade, D. B., Wada, O. Z., Odetayo, A., David-Olawade, A. C., Asaolu, F. T., & Eberhardt, J. (2024) · Journal of Medicine Surgery and Public Health · doi:10.1016/j.glmedi.2024.100099 · Cited by 598
Artificially intelligent chatbots in digital mental health interventions: a review
Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.2013200 · Cited by 440
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Self-citationHaque, M. D. R., & Rubya, S. (2023) · JMIR mHealth and uHealth · doi:10.2196/44838 · Cited by 404
Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023) · Sustainability · doi:10.3390/su151712921 · Cited by 370
“…in learning management systems [25], chatbots have been used as a tool for many purposes and have a wide range of industrial applications, such as medical education [26,27], counseling consultations [28], marketing education [29], and telecommunications support and in financial industries [30,31].”
Method
Metadata
- Authors
- Bendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H.
- Affiliations
- Universität Ulm (DE)
- Venue
- Verhaltenstherapie
- Publisher
- S. Karger AG
- Published
- 2019-08-20
- Volume
- 32
- Issue
- Suppl. 1
- Pages
- 64-76
- ISSN
- 1016-6262 (ISSN-L)
- 1423-0402
- OpenAlex
- W4233023712
- Cited by
- 214
- References
- 63
- Citations by year
- 2026: 25 · 2025: 48 · 2024: 39 · 2023: 29 · 2022: 31 · 2021: 32 · 2020: 10
- FWCI
- 20.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Verhaltenstherapie (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- chatbots, clinical psychology, psychotherapy, mental health, digital healthcare, feasibility and acceptability, chatbot safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
