Cited by 14Digital Mental Health InterventionsEthics and Social Impacts of AISocial Robot Interaction and HRI

Does a lack of emotions make chatbots unfit to be psychotherapists?

Open access
Rahsepar Meadi, Mehrdad, Bernstein, Justin S., Batelaan, Neeltje, van Balkom, Anton J. L. M., Metselaar, Suzanne·2024·Bioethics

Abstract

Mental health chatbots (MHCBs) designed to support individuals in coping with mental health issues are rapidly advancing. Currently, these MHCBs are predominantly used in commercial rather than clinical contexts, but this might change soon. The question is whether this use is ethically desirable. This paper addresses a critical yet understudied concern: assuming that MHCBs cannot have genuine emotions, how this assumption may affect psychotherapy, and consequently the quality of treatment outcomes. We argue that if MHCBs lack emotions, they cannot have genuine (affective) empathy or utilise countertransference. Consequently, this gives reason to worry that MHCBs are (a) more liable to harm and (b) less likely to benefit patients than human therapists. We discuss some responses to this worry and conclude that further empirical research is necessary to determine whether these worries are valid. We conclude that, even if these worries are valid, it does not mean that we should never use MHCBs. By discussing the broader ethical debate on the clinical use of chatbots, we point towards how further research can help us establish ethical boundaries for how we should use mental health chatbots.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/bioe.13299

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • A lack of empathy in LLM-CBs may render certain psychotherapeutic features such as countertransference ineffective.

    “A lack of empathy may also render certain psychotherapeutic features such as countertransference ineffective52.”

    From A scoping review on the mental health harms of LLM-based chatbots (2026) · cites this paper as [52]

    Section 5 says that if mental health chatbots lack emotions, they cannot experience countertransference and patients may lose its potential benefits. It also distinguishes countertransference from empathy; the paper attributes the loss of countertransference to a lack of emotions, not specifically to a lack of empathy. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 43

  1. Norcross, J. C. (2010). The therapeutic relationship. In The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 113-141). American Psychological Association. https://doi.org/10.1037/12075-004 · DOI
  2. Wampold, B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry, 14(3), 270-277. https://doi.org/10.1002/wps.20238 · DOI · Paper page
  3. Keijsers, G. P., Schaap, C. P., & Hoogduin, C. A. (2000). The impact of interpersonal patient and therapist behavior on outcome in cognitive-behavior therapy. A review of empirical studies. Behavior Modification, 24(2), 264-297. https://doi.org/10.1177/ 0145445500242006; · DOI
  4. Thwaites, R., & Bennett-Levy, J. (2007). Conceptualizing empathy in cognitive behaviour therapy: Making the implicit explicit. Behavioural and Cognitive Psychotherapy, 35(5), 591-612. https://doi.org/10.1017/S1352465807003785 · DOI
  5. Elliott, R., Bohart, A. C., Watson, J. C., & Murphy, D. (2018). Therapist empathy and client outcome: An updated meta-analysis. Psychotherapy, 55(4), 399-410. https://doi.org/10. 1037/pst0000175 20 Wampold, op. cit. note 17, pp. 270-277. · DOI · Paper page
  6. Elliott et al., op. cit. note 19, pp. 399-410.
  7. Cuff, B. M. P., Brown, S. J., Taylor, L., & Howat, D. J. (2014). Empathy: A review of the concept. Emotion Review, 8, 144-153. https://doi.org/10.1177/1754073914558466 23 Norcross, op. cit. note 16, pp. 113-141. · DOI
  8. Rogers, C. R. (1957). The necessary and sufficient conditions of therapeutic personality change. Journal of Consulting Psychology, 21(2), 95-103. https://doi.org/10.1037/h0045357 25 · DOI · Paper page
  9. Cuff et al., op. cit. note 22. 26 Ibid. 27 Elliott et al., op. cit. note 19, pp. 399-410.
  10. Salamanca-Sanabria, A., Jabir, A. I., Lin, X., Alattas, A., Kocaballi, A. B., Lee, J., Kowatsch T., & Car, L. T. (2023). Exploring the perceptions of mHealth interventions for the prevention of common mental disorders in university students in Singapore: Qualitative study. Journal of Medical Internet Research, 25(1), e44542. https://doi.org/10.2196/44542 · DOI
  11. Inkster, B., Sarda, S., & Subramanian, V. (2018). An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: Real-world data evaluation mixed-methods study. JMIR Mhealth Uhealth, 6(11), e12106. https://doi.org/10.2196/ 12106; · DOI · Paper page
  12. Morris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018). Towards an artificially empathic conversational agent for mental health applications: system design and user perceptions. Journal of Medical Internet Research, 20(6), e10148. https://doi.org/10. 2196/10148 · DOI · Paper page
  13. Ayers, J.W., Poliak, A., Dredze, M., Leas, E.C., Zhu, Z., Kelley, J.B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., & Smith, D. M. (2023). Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Internal Medicine, 183(6), 589-596. https://doi.org/10.1001/jamainternmed. 2023.1838 · DOI · Paper page
  14. Racker, H. (2018). Transference and countertransference. Routledge.
  15. Gabbard, G. O. (2014). Psychodynamic psychiatry in clinical practice (5th ed.). American Psychiatric Publishing.
  16. Holohan, M., & Fiske, A. (2021). 'Like I'm talking to a real person': Exploring the meaning of transference for the use and design of ai-based applications in psychotherapy. Frontiers of Psychology, 12, 720476. https://doi.org/10.3389/fpsyg.2021.720476 · DOI
  17. Hayes, J. A., Gelso, C. J., Goldberg, S., & Kivlighan, D. M. (2018). Countertransference management and effective psychotherapy: Meta-analytic findings. Psychotherapy, 55(4), 496-507. https://doi.org/10.1037/pst0000189; · DOI
  18. Hayes, J. A., Nelson, D. L. B., & Fauth, J. (2015). Countertransference in successful and unsuccessful cases of psychotherapy. Psychotherapy, 52(1), 127-133. https://doi.org/10.1037/a0038827 35 · DOI
  19. Rossberg, J. I., Karterud, S., Pedersen, G., & Friis, S. (2010). Psychiatric symptoms and countertransference feelings: An empirical investigation. Psychiatry Research, 178(1), 191-195. https://doi.org/10.1016/j.psychres.2009.09.019; · DOI
  20. Sandler, J., Holder, A., & Dare, C. (1970). Basic psychoanalytic concepts. IV. Counter-transference. The British Journal of Psychiatry: The Journal of Mental Science, 117(536), 83-88.
  21. Löffler-Stastka, H., Sell, C., Zimmermann, J., Huber, D., & Klug, G. (2019). Is countertransference a valid source of clinical information? Investigating emotional responses to audiotaped psychotherapy sessions. Bulletin of the Menninger Clinic, 83(4), 353-375. https://doi.org/10.1521/bumc_2019_83_02 · DOI
  22. Gabbard, G. O. (2020). The role of countertransference in contemporary psychiatric treatment. World Psychiatry, 19(2), 243-244. https://doi.org/10.1002/wps.20746; · DOI
  23. Colli, A., & Ferri, M. (2015). Patient personality and therapist countertransference. Current Opinion in Psychiatry, 28(1), 46-56. https://doi.org/10.1097/YCO.0000000000000119 39 · DOI
  24. Colli & Ferri, op. cit. note 38, pp. 46-56.
  25. Stefana, A., Bulgari, V., Youngstrom, E. A., Dakanalis, A., Bordin, C., & Hopwood, C.J. (2020). Patient personality and psychotherapist reactions in individual psychotherapy setting: A systematic review. Clinical Psychology & Psychotherapy, 27(5), 697-713. https:// doi.org/10.1002/cpp.2455 · DOI
  26. Rossberg et al., op. cit. note 36, pp. 191-195;
  27. Machado, D. de B., Coelho, F. M. da C., Giacomelli, A. D., Donassolo, M. A. L., Abitante, M. S., Dall'Agnol, T., & Eizirik, C. L. (2014). Systematic review of studies about countertransference in adult psychotherapy. Trends in Psychiatry and Psychotherapy, 36, 173-185. https://doi.org/10.1590/2237-6089-2014- 1004; · DOI
  28. Gazzillo, F., Lingiardi, V., Del Corno, F., Genova, F., Bornstein, R. F., Gordon, R. M., & McWilliams, N. (2015). Clinicians' emotional responses and Psychodynamic Diagnostic Manual adult personality disorders: A clinically relevant empirical investigation. Psycho- therapy, 52(2), 238-246. https://doi.org/10.1037/a0038799; · DOI
  29. Gluhoski, V. L. (1994). Misconceptions of cognitive therapy. Psychotherapy: Theory, Research, Practice, Training, 31(4), 594-600. https://doi.org/10.1037/0033-3204.31.4.594; · DOI
  30. Prasko, J., Ociskova, M., Vanek, J., Burkauskas, J., Slepecky, M., Bite, I., Krone, I., Sollar, T., & Juskiene, A. (2022). Managing transference and countertransference in cognitive behavioral supervision: Theoretical framework and clinical application. Psychology Research and Behavior Management, 15, 2129-2155. https://doi.org/10.2147/PRBM.S369294 · DOI
  31. Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017). Reporting mental health symptoms: Breaking down barriers to care with virtual human interviewers. Frontiers in Robotics and AI, 4, 0. https://www.frontiersin.org/articles/ 10.3389/frobt.2017.00051 · DOI · Paper page
  32. Norris, D. M., Gutheil, T. G., & Strasburger, L. H. (2003). This couldn't happen to me: Boundary problems and sexual misconduct in the psychotherapy relationship. Psychiatric Services, 54(4), 517-522. https://doi.org/10.1176/appi.ps.54.4.517 · DOI
  33. Parth, K., Datz, F., Seidman, C., & Löffler-Stastka, H. (2017). Transference and countertransference: A review. Bulletin of the Menninger Clinic, 81(2), 167-211. https://doi. org/10.1521/bumc.2017.81.2.167 49 Ibid. 50 Hayes et al., op. cit. note 34, pp. 496-507. · DOI
  34. Luxton, op. cit. note 8, pp. 1-10;
  35. Luxton et al., op. cit. note 8, pp. 255-276;
  36. Fiske et al., op. cit. note 4, p. e13216; Miller & Polson, op. cit. note 8, pp. 208-214;
  37. Fiske, A., Henningsen, P., & Buyx, A. (2020). The implications of embodied artificial intelligence in mental healthcare for digital wellbeing. Philosophi- cal studies series (Vol. 140). Springer Nature. https://doi.org/10.1007/978-3-030-50585-1_ 10; · DOI
  38. Brown, C., Story, G. W., Mourão-Miranda, J., & Baker, J. T. (2021). Will artificial intelligence eventually replace psychiatrists? The British Journal of Psychiatry, 218(3), 131-134. https://doi.org/10.1192/bjp.2019.245; · DOI
  39. Omarov, B., Narynov, S., & Zhumanov, Z. (2022). Artificial intelligence-enabled chatbots in mental health: A systematic review. Computers, Materials & Continua, 74(3), 5105-5122. https://doi.org/10.32604/cmc.2023.034655; Sedlakova &Trachsel, op. cit. note 8, pp. 1-10; · DOI
  40. Al-Ameery-Brosche, I., & Resch, F. (2022). Emotional robotics: Curse or blessing in psychiatric care? In R. M. Holm-Hadulla, J. Funke, & M. Wink (Eds.), Intelligence- Theories and applications (pp. 261-271). Springer International Publishing. https://doi.org/ 10.1007/978-3-031-04198-3_15 · DOI
  41. Whitby, B. (2014). The ethical implications of non-human agency in health care. In AISB 2014-50th Annual Convention of the AISB. Society for the Study of Artificial Intelligence and the Simulation of Behaviour; Sedlakova & Trachsel, op. cit. note 8, pp. 1-10.
  42. Persad, G. C., & Emanuel, E. J. (2017). The case for resource sensitivity: Why it is ethical to provide cheaper, less effective treatments in global health. Hastings Center Report, 47(5), 17-24. https://doi.org/10.1002/hast.764 54 Ibid: 17-18. · DOI
  43. RAHSEPAR MEADI ET AL. | 509 14678519, 2024, 6, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/bioe.13299 by Mount Vernon Nazarene University, Wiley Online Library on [25/01/2026]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License · DOI

Cited by

Sorted by citations

Authors
Rahsepar Meadi, M., Bernstein, J. S., Batelaan, N., van Balkom, A. J. L. M., & Metselaar, S.
Affiliations
  • Department of Psychiatry, Amsterdam Public Health, Mental Health program Amsterdam UMC location Vrije Universiteit Amsterdam Amsterdam The Netherlands
  • Vrije Universiteit Amsterdam (NL)
  • Amsterdam Public Health (NL)
  • Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
Venue
Bioethics
Publisher
Wiley
Published
2024-05-12
Volume
38
Issue
6
Pages
503-510
ISSN
  • 0269-9702 (ISSN-L)
  • 1467-8519
OpenAlex
W4396845061
Cited by
14
References
0
Citations by year
2026: 4 · 2025: 8 · 2024: 2
FWCI
5.58
Type
journal article
Language
en
Open access
Locations
  • Bioethics (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Pure Amsterdam UMC (publishedVersion)
  • VU Research Portal (submittedVersion, other-oa)
Funders
Technische Universiteit Delft
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
mental health chatbots, affective empathy, countertransference, chatbot ethics, patient harm, treatment outcomes
MeSH terms
Psychotherapists, Adaptation, Psychological, Mental Disorders, Countertransference, Emotions, Empathy, Humans, Mental Health, Psychotherapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review