Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy
Open accessPublished version of a preprint
The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Research in embodied artificial intelligence (AI) has increasing clinical relevance for therapeutic applications in mental health services. With innovations ranging from 'virtual psychotherapists' to social robots in dementia care and autism disorder, to robots for sexual disorders, artificially intelligent virtual and robotic agents are increasingly taking on high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health professionals. In order to enable responsible clinical implementation, ethical and social implications of the increasing use of embodied AI in mental health need to be identified and addressed. OBJECTIVE: This paper assesses the ethical and social implications of translating embodied AI applications into mental health care across the fields of Psychiatry, Psychology and Psychotherapy. Building on this analysis, it develops a set of preliminary recommendations on how to address ethical and social challenges in current and future applications of embodied AI. METHODS: Based on a thematic literature search and established principles of medical ethics, an analysis of the ethical and social aspects of currently embodied AI applications was conducted across the fields of Psychiatry, Psychology, and Psychotherapy. To enable a comprehensive evaluation, the analysis was structured around the following three steps: assessment of potential benefits; analysis of overarching ethical issues and concerns; discussion of specific ethical and social issues of the interventions. RESULTS: From an ethical perspective, important benefits of embodied AI applications in mental health include new modes of treatment, opportunities to engage hard-to-reach populations, better patient response, and freeing up time for physicians. Overarching ethical issues and concerns include: harm prevention and various questions of data ethics; a lack of guidance on development of AI applications, their clinical integration and training of health professionals; 'gaps' in ethical and regulatory frameworks; the potential for misuse including using the technologies to replace established services, thereby potentially exacerbating existing health inequalities. Specific challenges identified and discussed in the application of embodied AI include: matters of risk-assessment, referrals, and supervision; the need to respect and protect patient autonomy; the role of non-human therapy; transparency in the use of algorithms; and specific concerns regarding long-term effects of these applications on understandings of illness and the human condition. CONCLUSIONS: We argue that embodied AI is a promising approach across the field of mental health; however, further research is needed to address the broader ethical and societal concerns of these technologies to negotiate best research and medical practices in innovative mental health care. We conclude by indicating areas of future research and developing recommendations for high-priority areas in need of concrete ethical guidance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI may also lack interpersonal or cultural competency, which could hinder therapeutic relationships and cause unintended psychological distress [29].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Technical failures, such as AI chatbots that cease to function properly [29], or AI initiatives that fail during a network failure [30], may result in unintended harm.”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
In the citing paper
“although AI can provide some form of healthcare in resource-poor areas, this could be used as a justification to not further develop physical (as opposed to virtual) mental health services in these areas of need [29].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Principles of Biomedical Ethics
(2012) · Thieves of Virtue · doi:10.7551/mitpress/9079.003.0009 · Cited by 13,453
Baio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., Kurzius-Spencer, M., Zahorodny, W., Robinson, C., Rosenberg, et al. (2018) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6706a1 · Cited by 6,078
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“Initiatives for establishing guidelines are emerging, including the online collaboratively generated document “Moral Responsibility for Computing Artifacts: The Rules,” or the recent “An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations” [70].”
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 1×
“Initial studies found that depression symptoms decreased with the use of Woebot more than groups who relied on electronic book resources [21], and another study found that Tess helped to reduce depression and anxiety among users [20].”
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 1×
“Increasingly, artificially intelligent virtual and robotic agents are not only available for relatively low-level elements of mental health support, such as comfort or social interaction, but also perform high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health profess…”
Robots for Use in Autism Research
Scassellati, B., Admoni, H., & Matarić, M. (2012) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071811-150036 · Cited by 942 · cited 1×
“to react positively to robots, even in cases where they have trouble interacting with others [35].”
Assistive social robots in elderly care: a review
Broekens, J., Heerink, M., & Rosendal, H. (2024) · Gerontechnology · doi:10.4017/gt.2009.08.02.002.00 · Cited by 940 · cited 1×
“As with any medical innovation, the effects, impacts, and clinical utility of the applications can only be fully assessed once evidence has improved [50,51].”
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673 · cited 2×
“We have also excluded applications that may have a virtual or robotic interface but do not employ AI, such as telemedicine therapy (for further scholarship on this topic, please see [12-19]).”
The clinical use of robots for individuals with Autism Spectrum Disorders: A critical review
Diehl, J. J., Schmitt, L. M., Villano, M., & Crowell, C. R. (2012) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2011.05.006 · Cited by 626 · cited 1×
“As with any medical innovation, the effects, impacts, and clinical utility of the applications can only be fully assessed once evidence has improved [50,51].”
Socially Assistive Robots in Elderly Care: A Systematic Review into Effects and Effectiveness
Bemelmans, R., Gelderblom, G. J., Jonker, P., & de Witte, L. (2012) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2010.10.002 · Cited by 585 · cited 1×
“Thus far, the outcomes are promising [32,33].”
Research works printed but not linked: 3
- 10.2196/12106 · doi:10.2196/12106 · Paper page
- Riek, L, 2015, Artificial Intelligence in Behavioral Health and Mental Health Care, 185
- Latour, B, 1986, Laboratory Life
Cited by
Items 801–855 of 855
Chelouche-Dwek, G., & Fonagy, P. (2026) · AI · doi:10.3390/ai7080309
“Critics frequently argue that AI cannot substitute for the human relationship, which remains central to psychological change and learning [36,51].”
Zhang, W., & Xie, G. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107628
Liu, B., Zhang, X., Li, J., & Wang, J. (2026) · International Conference on Computer Communication and Artificial Intelligence (CCAI) · doi:10.1109/ccai69603.2026.11642063
“…"Artificial intelligence in medicine" has been cited 1,366 times and has become an important literature in the field of medical AI; Fiske, Amelia [15] explored the application ethics of embodied AI in psychiatry; Milne-Ives, Madison [16] focused on medical dialogue agents; Yu, Jinran [17] and…”
Methodologies for Perioperative Stress Assessment in Surgeons: A Systematic Review
Huang, X., Mitchell, M., Molnar, A., Bhowmik, J., Dixon, B. J., McGovern, A. S., & Asairinachan, A. (2026) · Journal of Surgical Research · doi:10.1016/j.jss.2026.07.047
Kaur, A., & Siddharth, R. V. (2026) · Indian journal of clinical psychology · doi:10.4103/ijcp.ijcp_21_26
Precision medicine for mood disorders in the big data era
Joshi, A. A., Franklin, C., Bray, M. J. C., Adams, R. J., Li, K., Taylor, J., Goes, F. S., Zandi, P., & Potash, J. B. (2026) · International Review of Psychiatry · doi:10.1080/09540261.2026.2717216
Parri, L. A., Lau, R., & Addy, K. B. E. (2026) · JMIR Formative Research · doi:10.2196/95939
Haynes, M. D. L., & Almatarneh, A. (2026) · Corporate Law & Governance Review · doi:10.22495/clgrv8i3sip6
Hanson, R. W., Ahmed, S., Hell, F., Walters, J., Griffith, L., & Agarwal, K. (2026) · Health informatics · doi:10.1007/978-3-032-24537-3_2
Ethical evaluation of AI-supported mental health applications
Deveci, E., & Ekmekçi, P. E. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1870948
Haberlin, S., Evans, A., Grainger, E., & Gacharna, A. B. D. (2026) · AI & Society · doi:10.1007/s00146-026-03341-x
Artificial Intelligence (AI) and Youth Mental Health
Nguyen, T. C. (2026) · Child & Youth Services · doi:10.1080/0145935x.2026.2725208
A strategic pathway for the ethical development of AI tools in dementia care
Deaner, N., Daven, M., Naik, A. D., Sabbagh, M., Breithaupt, A., Possin, K. L., Alford, S., Alexander, A., Daniels, A., Dezzutti, L., et al. (2026) · Alzheimer s & Dementia · doi:10.1002/alz.71805
“We then drew on general healthcare AI guidelines 7–10 and the dementia AI ethics literature, 13–19 incorporated input from a PLWD and a caregiver, and discussed disagreements until the group reached consensus.”
Fabricius, A., Yen, J., O’Doherty, K. C., & Goldenberg, M. J. (2026) · Perspectives on Psychological Science · doi:10.1177/17456916261471511
Piterman, D., Dery, H., Bar, K., Meinlschmidt, G., Geller, A., Hadar‐Shoval, D., Elyoseph, Z., & Refoua, E. (2026) · Scientific Reports · doi:10.1038/s41598-026-58013-z · Cited by 2
“On one hand, a GenAI proficient in vocal analysis could offer unprecedented tools for clinical training and practice 8,58 .”
Hoàng, H. T., Tran, H. T., Nguyen, T. N., Vu, N. H., & Le, T. T. (2026) · Multidisciplinary Reviews · doi:10.31893/multirev.2027283
“…of ethical governance mechanisms is informed by the growing literature on responsible AI, transparency, explainability, fairness, accountability, and human oversight in mental health and educational applications (Feng & Carolus, 2026; Fiske et al., 2019; Tabassum et al., 2025; Thieme et al., 2020).”
Sharma, M., & Chauhan, R. (2026) · Mental Health and Social Inclusion · doi:10.1108/mhsi-08-2026-0299
Reconfigurative care and clinical responsibility in AI-mediated psychological care ecosystems
Minami, U. (2026) · SSM - Mental Health · doi:10.1016/j.ssmmh.2026.100703
Panicker, S. G., & Majumdar, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9109-0.ch006
Human-AI Collaboration in Psychological Practice: A Relational Framework for Responsible AI
Ala, S. M. F., Galvão, A. M., & Lourenço, D. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9109-0.ch007
Saha, S., Singh, M. K., & Choudhary, P. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9109-0.ch005
Saha, S., Choudhary, P. K., Dubey, S., & Khati, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9109-0.ch004
Marin, M., Montañez, M., & Vaillancourt, K. T. (2026) · Journal of Marital and Family Therapy · doi:10.1111/jmft.70172
Wong, A. H. K., & Lee, C. K. H. (2026) · Asian Journal of Business Ethics · doi:10.1007/s13520-026-00271-1
Kuşci, İ., & Bakır, V. (2026) · Current Psychology · doi:10.1007/s12144-026-10070-3
“Specifically, studies such as Fiske et al. (2019), Vaidyam et al. (2019), Li et al. (2023), and Abd-Alrazaq et al. (2020), which are among the most frequently cited works in the field, were manually checked and confirmed to be present in the final data - set.”
Iqbal, M. Z. (2026) · Intelligent Hospital · doi:10.1016/j.inhs.2026.100120
The paradox of pleasing: therapeutic recognition and the limits of conversational AI
Haber, Y., Refoua, E., Elyoseph, Z., & Yinon, D. (2026) · AI & Society · doi:10.1007/s00146-026-03348-4
Doren, N. V., Hall, C., Iturralde, E., Sterling, S., & Satre, D. D. (2026) · doi:10.2196/preprints.112230
Silva, L., Pais, S., & Jamil, M. L. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.117102
Bearden, D. J. (2026) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2026.111295
Talk to Me Kindly: Designing AI Companions to Foster Positive Self-Talk in Young Adults
Gedeus, A.-K., Wagener, N., Li, Y., Bai, Y., Felver, J. C., Difede, J., Yoon, S., & Taylor, A. M. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829873
Miller, E., Sanderson, L., Brien, J. O., Bradford, N., Holland‐Batt, S., Bartlett, S. E., Scharoun, L., Caldwell, G. A., & Guihot, M. (2026) · Journal of Responsible Technology · doi:10.1016/j.jrt.2026.100193 · Cited by 1
Ethische Aspekte zur KI-Anwendung in der Psychotherapie
Schürmann, J. M., Sedláková, J., & Trachsel, M. (2026) · Psychotherapie-Wissenschaft · doi:10.30820/1664-9583-2026-2-17
“…und psychotherapeutische KI-Systeme operieren in einem spezifischen klinischen und ethischen Kontext, der durch die Vulnerabilität der Patient:innen, die zentrale Bedeutung der therapeutischen Beziehung und die Komplexität psychischer Phänomene geprägt ist (Fiske et al., 2019; Stade et al., 2024).”
Negotiating Acceptable Boundaries: Psychologists’ Perceptions of AI-Supported Mental Healthcare
Faria, C. S., Peres, B. J., & Campos, P. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3821402.3830143
Banoo, R., Sharma, S., Nathiya, K., Solomon, S. G., Mazumdar, P. S., Aruna, T., Singh, M. S., Umar, M., Simon Samuvel, S., & Raju, P. E. (2026) · International Journal of Research in Medical Sciences · doi:10.18203/2320-6012.ijrms20263570
Xiao, L. (2026) · Journal of Education and Educational Research · doi:10.54097/2hcyvp15
“Third, emotional AI systems operate outside the framework of accountability and intervention during a mental health emergency [3, 4, 7].”
InfluentialValiao, A. (2026) · Journal of interdisciplinary perspectives · doi:10.69569/jip.2026.317
Friedrich, P., Polifke, L., Obremski, D., Latoschik, M. E., & Wienrich, C. (2026) · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion) · doi:10.1145/3776591.3832491
“…regular therapy and is a more scalable and flexible approach compared to ECAs that are not controlled by AI (e.g., [36, 40, 41]), the use of AI in a sensitive area such as psychotherapy requires adherence to different ethical guidelines to ensure users’ safety and avoid potential harm [11, 20, 42].”
Friedrich, P., Obremski, D., Latoschik, M. E., & Wienrich, C. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831112
“This includes the importance of social factors and the emotions of patients [117], and designing personalized treatment approaches based on patients’ needs [41].”
InfluentialXiaotian, R., Li, X., Gao, L., Wei, Q., Liu, H., & Yu, X. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10217-5
“…may offer them as an initial source of low-intensity support while maintaining clear referral pathways when distress persists or intensifies and preserving access to professional care, peer interaction, and meaningful interpersonal relationships (Fiske et al., 2019; Torous et al., 2021 ).”
Liability and Standard of Care in AI-Driven Psychiatric Practice: European Viewpoint
Madeira, L., Pereira, C. A., Schouler‐Ocak, M., Samochowiec, J., Galderisi, S., & da Costa, M. P. (2026) · Journal of Medical Internet Research · doi:10.2196/99894
“When systems approximate therapeutic dialogue, crisis response, or management of vulnerable users, some duty of care becomes harder to deny [10,13,19,34].”
Dopierała, A. (2026) · Problemy Opiekuńczo-Wychowawcze · doi:10.71358/pow.3319
“Zauważa się, że takie interakcje mogą przy-nosić krótkoterminowe korzyści adaptacyjne, ułatwiając regulację afektu i obniżając poziom stresu w sytuacjach kryzysowych (Fiske i in., 2019).”
AI-Powered Conversations: The Diagnostic Potential of Chatbots in Mental Health Care
Andibanbang, F., Odunuga, K. V., Osuji, C. I., Adeniran, K. O., Akinyemi, K., & Tyem, N. F. (2025) · Scholar J Computational Science · doi:10.67378/z2bzvg67
Xu, M., Liu, J., Yang, Q., Sun, K., Li, R., & Gao, C. (2026) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3785651.3831485
Confounded, Not Generalizable: Evaluation Hygiene for Mobile Multimodal Depression Pre-Screening
Zhou, X., Chen, L., Yong, X. R., Chen, Z., & Wen, X. (2026) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3821581.3833102
“Selective prediction and out-of-distribution detection let a model decline rather than guess outside its competence [7, 8], and embodied mental-health AI raises specific ethical and non-diagnostic constraints [6].”
Sato, W., Kawamura, N., Shimokawa, K., Kubota, Y., & Minato, T. (2026) · Telematics and Informatics Reports · doi:10.1016/j.teler.2026.100379
Sharma, S., Kumari, A., & Lohmore, H. (2026) · Mental Health and Social Inclusion · doi:10.1108/mhsi-09-2026-0360
Yan, Z., Benes, S. S., & Peacock, J. C. (2026) · American Journal of Health Education · doi:10.1080/19325037.2026.2743610
Lis, M., Liasota, M., Kabat, E. Z., Kozłowska, M. J., Konopka, K., Majchrzak, M. K., Kołodziej, F. M., Kwiatkowska, A., Juskowiak, J., & Komin, Z. J. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.4(52).2026.6583
“Such "digital invisibility" results in the postponement of necessary intervention until after catastrophic events, such as suicidal attempts or severe depression breakdowns (Fiske et al., 2019).”
Cheng, S., Xiong, Y., Huang, R., Mao, Y., & Fang, M. (2026) · Ethics & Behavior · doi:10.1080/10508422.2026.2751047
Balancing Innovation and Humanity: Advanced Practice Nurses Harnessing AI in Mental Health Care
Henry-Okafor, Q., Schroer, M. E., & Russell, R. G. (2026) · Journal of the American Psychiatric Nurses Association · doi:10.1177/10783903261499687
Relational Obligations at 2 A.M.: Crisis Use of AI Chatbots and the Limits of Professional Refusal
Mangal, J. P. (2026) · AJOB Neuroscience · doi:10.1080/21507740.2026.2736004
“Fiske et al. (2019) argued that unsupervised use of AI in therapeutic contexts generates duties for the professions and not only for developers.”
Shahra, E. Q., Nassr, R. M., & Jabbar, W. A. (2026) · Algorithms · doi:10.3390/a19110913
Das, D. C., Rony, M. K. K., Bhattacharjee, T., Uddin, A., Zujbe, M. S. A. Z., Dutta, S., Maruf, S. A., Rahman, F., Mortuza, C. G., & JAHAN, N. (2026) · Health & Social Care in the Community · doi:10.1155/hsc/9431386
Metadata
- Authors
- Fiske, A., Henningsen, P., & Buyx, A.
- Affiliations
- Technical University of Munich (DE)
- TUM Klinikum (DE)
- Corresponding author
- Fiske, Amelia
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-05-09
- Volume
- 21
- Issue
- 5
- Pages
- e13216
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6532335
- OpenAlex
- W2916945592
- Cited by
- 857
- References
- 73
- Citations by year
- 2026: 190 · 2025: 205 · 2024: 179 · 2023: 98 · 2022: 88 · 2021: 56 · 2020: 28 · 2019: 13
- FWCI
- 12.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- mediaTUM (Technical University of Munich) (submittedVersion, other-oa)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- embodied AI, social robots, mental health services, patient autonomy, algorithmic transparency, data ethics, health disparities, clinical implementation of AI, harm prevention, psychotherapy
- MeSH terms
- Artificial Intelligence, Humans, Psychiatry, Psychology, Psychotherapy, Robotics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.