Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy
Open accessPublished version of a preprint
The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Research in embodied artificial intelligence (AI) has increasing clinical relevance for therapeutic applications in mental health services. With innovations ranging from 'virtual psychotherapists' to social robots in dementia care and autism disorder, to robots for sexual disorders, artificially intelligent virtual and robotic agents are increasingly taking on high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health professionals. In order to enable responsible clinical implementation, ethical and social implications of the increasing use of embodied AI in mental health need to be identified and addressed. OBJECTIVE: This paper assesses the ethical and social implications of translating embodied AI applications into mental health care across the fields of Psychiatry, Psychology and Psychotherapy. Building on this analysis, it develops a set of preliminary recommendations on how to address ethical and social challenges in current and future applications of embodied AI. METHODS: Based on a thematic literature search and established principles of medical ethics, an analysis of the ethical and social aspects of currently embodied AI applications was conducted across the fields of Psychiatry, Psychology, and Psychotherapy. To enable a comprehensive evaluation, the analysis was structured around the following three steps: assessment of potential benefits; analysis of overarching ethical issues and concerns; discussion of specific ethical and social issues of the interventions. RESULTS: From an ethical perspective, important benefits of embodied AI applications in mental health include new modes of treatment, opportunities to engage hard-to-reach populations, better patient response, and freeing up time for physicians. Overarching ethical issues and concerns include: harm prevention and various questions of data ethics; a lack of guidance on development of AI applications, their clinical integration and training of health professionals; 'gaps' in ethical and regulatory frameworks; the potential for misuse including using the technologies to replace established services, thereby potentially exacerbating existing health inequalities. Specific challenges identified and discussed in the application of embodied AI include: matters of risk-assessment, referrals, and supervision; the need to respect and protect patient autonomy; the role of non-human therapy; transparency in the use of algorithms; and specific concerns regarding long-term effects of these applications on understandings of illness and the human condition. CONCLUSIONS: We argue that embodied AI is a promising approach across the field of mental health; however, further research is needed to address the broader ethical and societal concerns of these technologies to negotiate best research and medical practices in innovative mental health care. We conclude by indicating areas of future research and developing recommendations for high-priority areas in need of concrete ethical guidance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI may also lack interpersonal or cultural competency, which could hinder therapeutic relationships and cause unintended psychological distress [29].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Technical failures, such as AI chatbots that cease to function properly [29], or AI initiatives that fail during a network failure [30], may result in unintended harm.”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
In the citing paper
“although AI can provide some form of healthcare in resource-poor areas, this could be used as a justification to not further develop physical (as opposed to virtual) mental health services in these areas of need [29].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Principles of Biomedical Ethics
(2012) · Thieves of Virtue · doi:10.7551/mitpress/9079.003.0009 · Cited by 13,453
Baio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., Kurzius-Spencer, M., Zahorodny, W., Robinson, C., Rosenberg, et al. (2018) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6706a1 · Cited by 6,078
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“Initiatives for establishing guidelines are emerging, including the online collaboratively generated document “Moral Responsibility for Computing Artifacts: The Rules,” or the recent “An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations” [70].”
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 1×
“Initial studies found that depression symptoms decreased with the use of Woebot more than groups who relied on electronic book resources [21], and another study found that Tess helped to reduce depression and anxiety among users [20].”
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 1×
“Increasingly, artificially intelligent virtual and robotic agents are not only available for relatively low-level elements of mental health support, such as comfort or social interaction, but also perform high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health profess…”
Robots for Use in Autism Research
Scassellati, B., Admoni, H., & Matarić, M. (2012) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071811-150036 · Cited by 942 · cited 1×
“to react positively to robots, even in cases where they have trouble interacting with others [35].”
Assistive social robots in elderly care: a review
Broekens, J., Heerink, M., & Rosendal, H. (2024) · Gerontechnology · doi:10.4017/gt.2009.08.02.002.00 · Cited by 940 · cited 1×
“As with any medical innovation, the effects, impacts, and clinical utility of the applications can only be fully assessed once evidence has improved [50,51].”
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673 · cited 2×
“We have also excluded applications that may have a virtual or robotic interface but do not employ AI, such as telemedicine therapy (for further scholarship on this topic, please see [12-19]).”
The clinical use of robots for individuals with Autism Spectrum Disorders: A critical review
Diehl, J. J., Schmitt, L. M., Villano, M., & Crowell, C. R. (2012) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2011.05.006 · Cited by 626 · cited 1×
“As with any medical innovation, the effects, impacts, and clinical utility of the applications can only be fully assessed once evidence has improved [50,51].”
Socially Assistive Robots in Elderly Care: A Systematic Review into Effects and Effectiveness
Bemelmans, R., Gelderblom, G. J., Jonker, P., & de Witte, L. (2012) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2010.10.002 · Cited by 585 · cited 1×
“Thus far, the outcomes are promising [32,33].”
Research works printed but not linked: 3
- 10.2196/12106 · doi:10.2196/12106 · Paper page
- Riek, L, 2015, Artificial Intelligence in Behavioral Health and Mental Health Care, 185
- Latour, B, 1986, Laboratory Life
Cited by
Items 301–400 of 855
Learning Through Simulation: Counselor Trainees’ Interactions with ChatGPT as a Client
Akkurt, M. N., Maurya, R. K., & Brown, T. (2025) · Behavioral Sciences · doi:10.3390/bs15121660 · Cited by 13
“In contrast, the use of AI to simulate the role of the counselor is met with greater skepticism and ethical concerns (Fiske et al., 2019).”
Winslow, B. D., Garibay, Ö. Ö., Goyal, T., Koon, S., Margetis, G., Salvendy, G., Shneiderman, B., Tayebi, A., & Vardoulakis, L. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2641703 · Cited by 16
Application of artificial intelligence tools in diagnosis and treatmentof mental disorders
Kister, K., Laskowski, J., Makarewicz, A., & Tarkowski, J. (2023) · Current Problems of Psychiatry · doi:10.12923/2353-8627/2023-0001 · Cited by 13
“Istnieją dowody na to, że ludzie mogą rozwijać relacje terapeutyczne za pomocą technologii cyfrowych (określanych jako „cyfrowy sojusz terapeutyczny) [68].”
BackgroundLin, G. S. S., Tan, W. W., & Hashim, H. (2024) · BDJ · doi:10.1038/s41415-024-7184-3 · Cited by 12
Proteger: A Social Robotics System to Support Child Psychological Evaluation
Godoi, D. H., Romero, R. A. F., Azevêdo, H., Ramos, J. J. G., Filho, G. B., & Garcia, M. A. T. (2020) · Latin American Robotics Symposium, Brazilian Symposium on Robotics and Workshop on Robotics in Education (LARS/SBR/WRE) · doi:10.1109/lars/sbr/wre51543.2020.9306975 · Cited by 8
“Fiske et al. [12] presented an interesting work in line with the Ethic group where they emphasize that to enable responsible clinical implementation, the ethical and social implications of the artificial intelligence use in psychoanalysis need to be identified and analyzed.”
BackgroundLuxton, D. D., & Hudlická, E. (2021) · Advances in neuroethics · doi:10.1007/978-3-030-74188-4_4 · Cited by 23
The Case for Integrated Advanced Technology in Applied Behavior Analysis
Neely, L. C., Carnett, A., Quarles, J. P., MacNaul, H. L., Park, S., Oyama, S., Chen, G., Desai, K., & Najafirad, P. (2022) · Advances in Neurodevelopmental Disorders · doi:10.1007/s41252-022-00309-y · Cited by 10
“Some of this discussion is already happening in the related fields of psychology and autism (e.g., Fiske et al., 2019; Keskinbora, 2019; Keyes, 2020).”
BackgroundArtificial Intelligence in Violence Risk Assessment: Addressing Racial Bias and Inequity
Ratajczak, R., & Cockerill, R. G. (2023) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000713 · Cited by 9
Über das Zusammenwirken von menschlicher und künstlicher Intelligenz aus ethischer Sicht
Kruse, A. (2021) · Springer eBooks · doi:10.1007/978-3-658-30882-7_14 · Cited by 8
“Zu nennen sind schließlich Roboter, die der sozialen Begleitung dienen (Sharkey und Sharkey 2012); diese robot companions werden zudem in ihren Potenzialen zur Unterstützung therapeutischer Maßnahmen in Psychiatrie, Psychologie und Psychotherapie diskutiert (Fiske et al. 2019).”
BackgroundRobot Therapy Program for Patients with Dementia: Its Framework and Effectiveness
Osaka, K., Tanioka, R., Betriana, F., Tanioka, T., Yoshihiro, K. A. I., & Locsin, R. C. (2021) · IntechOpen eBooks · doi:10.5772/intechopen.96410 · Cited by 8
Research Advances in ADHD and Technology
Cibrian, F. L., Hayes, G. R., & Lakes, K. D. (2020) · Synthesis lectures on assistive, rehabilitative, and health-preserving technologies · doi:10.2200/s01061ed1v01y202011arh015 · Cited by 12
Call for Papers on Artificial Intelligence Applied to Pediatric Care
Carroll, A. E., & Christakis, D. (2023) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2023.2367 · Cited by 9
Haber, Y., Levkovich, I., Hadar‐Shoval, D., & Elyoseph, Z. (2023) · doi:10.2196/preprints.54781 · Cited by 8
Constructing What Counts as Human at Work: Enigma, Emotion, and Error in Connective Labor
Pugh, A. J. (2022) · American Behavioral Scientist · doi:10.1177/00027642221127240 · Cited by 16
“We can hear the echoes of this historical trend in the commonly deployed phrase that apps or agents would “free up” people to spend time on more useful, sustaining or fulfilling work (Lloyd & Payne, 2019; cf. Fiske et al., 2019).”
BackgroundThe Future of Cystic Fibrosis Care: Exploring AI's Impact on Detection and Therapy
Basu, B., Dutta, S., Rahaman, M., Bose, A., Das, S., Prajapati, J. B., & Prajapati, B. (2024) · Current Respiratory Medicine Reviews · doi:10.2174/011573398x283365240208195944 · Cited by 9
Silveira, P. V. D. R., & Paravidini, J. L. L. (2024) · Revista Pesquisa Qualitativa · doi:10.33361/rpq.2024.v.12.n.30.717 · Cited by 7
Machine learning, healthcare resource allocation, and patient consent
Webb, J. (2024) · The New Bioethics · doi:10.1080/20502877.2024.2416858 · Cited by 8
Isop, W. A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1377938 · Cited by 17
Olia, J. B. H., Raman, A., Hsu, C., Alkhayyat, A., & Nourazarian, A. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109984 · Cited by 10
Yilma, B. A., Kim, C. M., Ludden, G., van Rompay, T. J. L., & Leiva, L. A. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2487859 · Cited by 13
“However, the use of AI in healthcare also raises various ethical concerns and risks, including data ethics such as data bias and privacy concerns, potential errors, the potential for misuse of technologies, and the exacerbation of existing health inequalities (Fiske et al., 2019).”
The Practice of Online Peer Counseling and the Potential for AI-Powered Support Tools
Wang, T., Bruckman, A. S., & Yang, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711089 · Cited by 22
“…to explore the potential of AI in personalizing conversational interaction in digital mental health interventions [28], questions about the appropriateness of using AI as replacements for human interaction [25, 33, 44, 57, 64] make their full deployment on OMHPs unlikely in the near future.”
Keung, W. M., & So, T. Y. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1538387 · Cited by 13
Tan, K. S., Cervin, M., Leman, P. J., Nielsen, K., Kumar, P. V., & Medvedev, O. N. (2025) · Journal of Psychology and AI · doi:10.1080/29974100.2025.2545258 · Cited by 9
Jung, H. W., Park, J. Y., Holoubek, T., Kim, W. J., & Park, J. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01323-5 · Cited by 15
Yeasmin, S., Saha, S., Rony, M. K. K., Semi, M. M. A., Das, S., Rahman, R., Khan, R., Tasnim, A. F., & Hosen, A. S. M. S. (2025) · Digital Health · doi:10.1177/20552076251386662 · Cited by 14
Evaluation of Health Personnel's Thoughts on Artificial Intelligence
ORHAN, M., & Bülez, A. (2022) · Kesit Akademi · doi:10.29228/kesit.66404 · Cited by 11
The future of psychiatry with artificial intelligence: can the man-machine duo redefine the tenets?
Sahoo, J. P., Narayan, B. N., & Santi, N. S. (2023) · Consortium Psychiatricum · doi:10.17816/cp13626 · Cited by 9
Haider, Z., Zummer, A., Waheed, A., & Abuzar, M. (2024) · Bulletin of Business and Economics (BBE) · doi:10.61506/01.00485 · Cited by 15
“These findings are in line with (Fiske et al., 2019) study, which pointed out that although AI tools could boost cognition and lower anxiety, they could have side effects on creativity and working morale, thus the need to approach AI implementation cautiously.”
ResultSingh, S., Gambill, J. L., Attalla, M., Fatima, R., Gill, A. R., & Siddiqui, H. F. (2024) · Cureus · doi:10.7759/cureus.71651 · Cited by 13
Developing a Measure of Social, Ethical, and Legal Content for Intelligent Cognitive Assistants
Hamilton, C., Swart, W., & Stokes, G. M. (2021) · Journal of Strategic Innovation and Sustainability · doi:10.33423/jsis.v16i3.4438 · Cited by 8
Simpson, R., Posa, S., Bruno, T. R., Simpson, S., Wasilewski, M. B., Robinson, L. R., Munce, S., Bayley, M. T., & Feinstein, A. (2022) · Journal of Neurology · doi:10.1007/s00415-022-11497-x · Cited by 14
Digital Healthcare and Expertise: Mental Health and New Knowledge Practices
Egher, C. (2022) · Health, technology and society · doi:10.1007/978-981-16-9178-2 · Cited by 19
AI and Employability: Challenges and Solutions from this Technology Transfer
Pagani, R., de Sá, C. P., Corsi, A., & de Souza, F. F. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80455-994-920231012 · Cited by 15
Staying Curious With Conversational AI in Psychotherapy
Holohan, M., Buyx, A., & Fiske, A. (2023) · The American Journal of Bioethics · doi:10.1080/15265161.2023.2191059 · Cited by 7
“…is to keep the multiplicity of CAI uses and potential within the frame of analysis — across multiple psychothera-peutic modalities and agencies — with the knowledge that the capabilities of these technologies are rapidly changing (Fiske, Henningsen, and Buyx 2019; Holohan and Fiske 2021).”
BackgroundSelf-citationTherapy as an NLP Task: Comparing LLMs and Human Peers Behaviors in CBT Sessions
Iftikhar, Z., Ransom, S., Xiao, A., Nugent, N., & Huang, J. (2024) · arXiv · doi:10.48550/arxiv.2409.02244 · Cited by 6
“However, conversational agentsarerule-based,meaningtheyfollowpredefinedscripts,which limitstheirabilitytoadapttodynamichumanbehaviorandtailorre-sponsestoindividualneeds[1,19,24,31].”
Digital Technology in Healthcare—An Ethical Overview
Hansson, S. O., & Fröding, B. E. E. (2024) · Digital Society · doi:10.1007/s44206-024-00121-2 · Cited by 13
“Direct-to-consumer services give rise to ethical problems concerning safety, effectiveness, accountability and protection of user data (Martinez-Martin & Kreitmair, 2018; Fiske et al., 2019).”
The conductor model of consciousness, our neuromorphic twins, and the human-AI deal
Benitez, F., Pennartz, C. M. A., & Senn, W. (2024) · AI and Ethics · doi:10.1007/s43681-024-00580-w · Cited by 7
“The benefit is observed even in cases where patients are aware that the bots do not truly feel emotions [49].”
Concerns and Values in Human-Robot Interactions: A Focus on Social Robotics
Abbo, G. A., Belpaeme, T., & Spitale, M. (2026) · International Journal of Social Robotics · doi:10.1007/s12369-025-01351-1 · Cited by 24
Sherrill, A. M., Wiese, C. W., Abdullah, S., & Arriaga, R. I. (2025) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-025-00484-4 · Cited by 7
“Ultimately, the ethical use of AI in mental health work may be enhanced by placing responsibility back on the psychotherapist to correct errors that might harm both the patient and the psychotherapist (Fiske et al., 2019).”
Luz, K. P., & Lima, D. L. F. (2025) · Journal of Medical Imaging and Interventional Radiology · doi:10.1007/s44326-025-00061-2 · Cited by 7
Wislocki, K. E., Sami, S., Liberzon, G., & Zalta, A. K. (2025) · JMIR Mental Health · doi:10.2196/80801 · Cited by 9
Galland, L., Pélachaud, C., & Pécune, F. (2025) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3717511.3747062 · Cited by 10
“These systems are not intended to replace human therapists but rather to serve as complementary tools that reinforce existing therapeutic interventions, by interacting with patients in between sessions, particularly in structured approaches requiring multiple sessions [10].”
Torales, J. C. (2026) · Journal of Religion and Health · doi:10.1007/s10943-026-02729-9 · Cited by 7
“Ethical analyses of AI in psychotherapy and psychiatry have therefore warned that such tools may alter expectations of care, responsibility, privacy, and relationality if implemented without careful professional oversight (Fiske et al., 2019).”
Therapy as an NLP Task: Comparing LLMs and Human Peers Behaviors in CBT Sessions
Iftikhar, Z., Ransom, S., Xiao, A. W., Nugent, N. R., & Huang, J. J. S. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3817112 · Cited by 42
“Recentresearchinbioethicshasparticularlyhighlightedtheharmfulethical implicationsofconversationalagents[1,27,47,58,75,95].”
Deng, Z., Tian, Z., Xue, J., & Gupta, S. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2272191 · Cited by 8
“Several studies (Fiske et al. 2019) in the fi eld of mental health counselling con fi rm the same.”
Implementation of an Artificially Empathetic Robot Swarm
Siwek, J., Żywica, P., Siwek, P., Wójcik, A., Woch, W., Pierzyński, K., & Dyczkowski, K. (2023) · Sensors · doi:10.3390/s24010242 · Cited by 8
Human Resources Aspects in Tourism and Its Technology Application: Kenyan Perspective
Nyongesa, W. J., & Westhuizen, J. V. D. (2024) · Springer eBooks · doi:10.1007/978-3-031-63077-4_9 · Cited by 12
The Algorithmic Unconscious: How Psychoanalysis Helps in Understanding AI
Possati, L. M. (2021) · Cited by 6
Riyanti, R. (2022) · International Journal of Health Sciences · doi:10.53730/ijhs.v6n2.10600 · Cited by 9
“This way of individual thinking is viewed as a moderate regulation determinant and direction point (Fiske et al., 2019).”
BackgroundIntegrating artificial intelligence and telehealth services in psychodermatology
Hashmi, N., Noorani, M., Ventriglio, A., Berardis, D. D., Ullah, I., Askari, S., & Goldust, M. (2022) · Journal of Cosmetic Dermatology · doi:10.1111/jocd.15435 · Cited by 6
Role-playing recovery in social virtual worlds: Adult use of child avatars as PTSD therapy
Davis, D., & Alexanian, S. (2023) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2023.100129 · Cited by 9
Palmier, C., Rigaud, A., Ogawa, T., Wieching, R., Dacunha, S., Barbarossa, F., Stara, V., Bevilacqua, R., & Pino, M. (2024) · Journal of Medical Internet Research · doi:10.2196/48126 · Cited by 14
“There are also concerns about the use of these technological tools to reduce health care costs by decreasing the number of available health care resources and services, thereby exacerbating social inequalities [44].”
BackgroundInfluentialThe 100 most influential papers in medical artificial intelligence; a bibliometric analysis
Zahoor, F., Abdullah, M., Tahir, M. W., & Islam, A. M. (2024) · Journal of the Pakistan Medical Association · doi:10.47391/jpma.10064 · Cited by 8
Falkai, P., Koutsouleris, N., Bertsch, K., Bialas, M., Binder, E. B., Bühner, M., Buyx, A., Cai, N., Cappello, S., Ehring, T. W., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.815718 · Cited by 6
Self-citationPsychiatrists’ Views on Robot-Assisted Diagnostics of Peripartum Depression
Zhong, M., Bilal, A.-M., Papadopoulos, F. C., & Castellano, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90525-5_40 · Cited by 7
Khan, A. S., Galea, S., & Mendez, I. M. (2025) · Digital Health · doi:10.1177/20552076251334422 · Cited by 11
“22 This risk is particularly concerning for elders, individuals with low digital literacy, and patients with chronic conditions who require human oversight and culturally sensitive care.”
Integrating Sentiment Analysis to Enhance Mental Health Support Chatbots
Murase, S., & Andritsch, J. (2024) · International Conference on Computing and Data Analytics (ICCDA) · doi:10.1109/iccda64887.2024.10867341 · Cited by 5
Integrating Emotional AI into Mobile Apps with Smart Home Systems for Personalized Mental Wellness
Cern, Y. S. (2025) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-025-00508-z · Cited by 8
“…early detection of mental health issues, offer novel insights into the underlying patterns of mental illnesses, and enable the prediction of treatment outcomes, thereby paving the way for a more proactive and tailored approach to mental healthcare (Fiske & Henningsen, 2019; Graham et al., 2019).”
Focal points and blind spots of human-centered AI: AI risks in written online media
Sebestyen, M. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04814-y · Cited by 12
“(Fiske et al. 2019, p. 6 – 7).”
Garcia, G. (2025) · Nursing Outlook · doi:10.1016/j.outlook.2025.102461 · Cited by 10
Abiodun, O. A., Ajiboye, P., Salihu, M. O., Sulyman, D., Akinsulore, A., Obayi, O., & Salihu, H. B. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-07135-1 · Cited by 11
“Data security concerns are common worldwide whenever AI in health care delivery is considered [29, 30].”
InfluentialYin, M., Yu, Z., & Zhu, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2531279 · Cited by 6
“…2024; Salcedo et al., 2023), therapeutic interventions for children with Autism Spectrum Disorder (Ali et al., 2020; Puglisi et al., 2022), and alleviating loneliness among elderly individuals through embodied AI companions that simulate empathy and rapport (Fiske et al., 2019; Lee & Nagae, 2021).”
Chen, Y., Xiong, Y., Ding, X. X., Yang, F., Deng, Y., Ma, N., & Li, Y. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2527868 · Cited by 5
“Current models face challenges in explain-ability, ethical compliance, and professional oversight, making them difficult to integrate into real-world caregiving environments (Fiske et al., 2019).”
The dangers of AI friendship: Adolescent mental health and ethical oversight
Katoch, H., & Sandhu, D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-41660-6.00016-8 · Cited by 5
AI as mediator of adolescent sexual knowledge: a comparative analysis of ChatGPT and claude
Ricon, T. (2025) · SN Social Sciences · doi:10.1007/s43545-025-01284-6 · Cited by 6
“The finding that neither model provided concrete examples of how privacy is protected or how consent is verified echoes concerns raised by Fiske et al. ( 2019 ) about the “ethics washing” phenom - enon in AI development.”
The Use of Artificial Intelligence for Personalized Treatment in Psychiatry
Jalali, S., You, Q., Xu, V., Chen, L., Zini, J., Zamorano, T., Luo, Y., Friesen, T., Fontana, G. J., & Benrimoh, D. A. (2025) · Current Psychiatry Reports · doi:10.1007/s11920-025-01656-y · Cited by 9
“Furthermore, they may free human clinicians to focus on more complex cases [ 66].”
Joy, G. V., Joy, F. E., & Nashwan, A. J. (2025) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2025.104816 · Cited by 7
AI affective computing and behavioral health
Farsadaki, V., & Griffy‐Brown, C. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1692728 · Cited by 10
Al-Smadi, F., Al-Smadi, S., Xie, X., Abudourusuli, X., Ouyang, L., Zeng, R., Du, L., Liao, Y., Mi, B., & Liu, G. (2026) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2026.1765936 · Cited by 7
Siddiqui, M. F., Mouna, A., Villela, R., Калматович, К. Р., Boueri, M. G., Bay, S., Babu, P. S., Etry, H., Nurmamatovna, M. A., Baig, M. M. I., et al. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-27574-6.00003-5 · Cited by 8
From the Rise of AI to Future Shock – State of the Art
Al-Akhras, L. M., & Tick, A. (2025) · IEEE World Symposium on Applied Machine Intelligence and Informatics (SAMI) · doi:10.1109/sami63904.2025.10883625 · Cited by 5
“In mental health extend beyond individual applications to broader implications for the field [39].”
Toward emotional mediation: generative AI in art therapy for psychosocial health support
Shi, Z., & Yin, D. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1690119 · Cited by 6
Schleidgen, S., Friedrich, O., & Wolkenstein, A. (2021) · Review of Social Economy · doi:10.1080/00346764.2021.1979241 · Cited by 6
“in the military and consumer area, the workplace or in private health applications (Fiske et al., 2019; Ienca et al., 2018; Kotchetkov et al., 2010; Munyon, 2018).”
BackgroundHan, Y. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/5673248 · Cited by 5
“Humans can judge each other’s emotions from similar words, and if features related to emotions can be extracted from audio signals, the psychological information in speech can be recognized [21].”
BackgroundRole of Socially Assistive Robots in Reducing Anxiety and Preserving Autonomy in Children
Fang, N., Zhang, C., Sankaran, S., & Ren, S. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889561 · Cited by 6
“In mental health services, robotic applications might be preferred for some patients due to the less feeling of shame when asking specific private questions [25].”
BackgroundMendes, D. C. G., Costa, R., Agrela, J. G., Badia, S. B. I., & Cameirão, M. S. (2024) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah61285.2024.10639572 · Cited by 9
“…in VR include chatbots (devices that act as virtual communicative agents and mimic human interaction through natural language processing systems [2]) and embodied agents (enabled to respond to clients or patients without the need for any human guidance through a virtually embodied presence [3]).”
BackgroundUbiquitous and Powerful Artificial Intelligence (AI)
Sargsyan, A., Hovsepyan, S., & Muradyan, A. A. (2024) · Sustainable development goals series · doi:10.1007/978-3-031-62332-5_26 · Cited by 6
What patients and caregivers want to know when consenting to the use of digital behavioral markers
Sonig, A., Deeney, C., Hurley, M. E., Storch, E. A., Herrington, J. D., Lázaro‐Muñoz, G., Zampella, C., Tunç, B., Parish‐Morris, J., Blumenthal-Barby, J. S. S., et al. (2024) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-024-00022-9 · Cited by 10
“As we argue elsewhere [22, 23], these understandings can support participatory approaches to co-designing treatment plans that enhance patient engagement, autonomy and empowerment [24, 25].”
Vocal Synchrony of Robots Boosts Positive Affective Empathy
Nishimura, S., Nakamura, T., Sato, W., Kanbara, M., Fujimoto, Y., Kato, H., & Hagita, N. (2021) · Applied Sciences · doi:10.3390/app11062502 · Cited by 7
“This issue is particularly important because robots can be used in psychotherapy if they can downregulate human negative emotions [63].”
BackgroundKim, D. K., Kreps, G. L., & Ahmed, R. (2021) · Human-Machine Communication · doi:10.30658/hmc.3.5 · Cited by 6
“Related to these issues, prior to approving embodied AI devices for clinical use, it will be critically important to perform a rigorous risk assessment and regulatory oversight to mitigate possible harm resulting from therapeutic encounters as well as malfunctioning robots (Fiske et al., 2019).”
BackgroundHechinger, M., & Fringer, A. (2021) · JMIR Formative Research · doi:10.2196/27676 · Cited by 8
“The use of artificial intelligence for mental health care provides a multifaceted opportunity, although unanswered ethical questions remain [47].”
BackgroundInnovative Technologies: Applications in the Present and Considerations for the Future
Issa, T., & Isaias, P. T. (2022) · Springer eBooks · doi:10.1007/978-1-4471-7513-1_8 · Cited by 6
Perspectives on Social Health Robots: How Experts’ Views Improved from 2017 to 2021
Korn, O., & Zallio, M. (2022) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3529190.3531223 · Cited by 5
Are Experts Needed? On Human Evaluation of Counselling Reflection Generation
Wu, Z., Balloccu, S., Reiter, E., Helaoui, R., Recupero, D. R., & Riboni, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.382 · Cited by 22
“We acknowledge that past work inspected similar options (Fiske et al., 2019; D’Alfonso, 2020; Saha et al., 2022), but we take distance from it.”
MethodInteligencia Artificial y su Impacto en la Psicología Humana: Mini Revisión
Salazar-Garcés, L. F., & Hernández, D. C. V. (2024) · Mediciencias UTA (Impresa)/Mediciencias UTA (En línea) · doi:10.31243/mdc.uta.v8i1.2306.2024 · Cited by 18
Detecting Autism Spectrum Disorders with Machine Learning Models Using Speech TranscriptsPreprint
Ramesh, V., & Assaf, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03281 · Cited by 16
“Future systems for detection could possibly be an interaction of children with chatbots [39] or robotic assistants [40] enabled with conversational AI for automated screening and prediction and recommending appropriate treatment plans.”
How the Risk of Exploitation in Human-Ai Relationships Depends on Relationship TypePreprint
Earp, B. D., Feroz, F., Mann, S. P., Voinea, C., Chalson, S., Jurčys, P., Reinecke, M. G., Savulescu, J., Singh, I., & Clark, M. S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5288102 · Cited by 7
Prospects of machine learning applications in affective disorders
Mosolova, E., Alfimov, A. Е., Kostyukova, E. G., & Mosolov, S. N. (2025) · Digital Diagnostics · doi:10.17816/dd634885 · Cited by 6
Artificial Intelligence and Psychotherapy
Bal, F. (2025) · Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry · doi:10.18863/pgy.1538432 · Cited by 7
Avatar Appearance Beyond Pixels - User Ratings and Avatar Preferences Within Health Applications
Ashrafi, N., Graf, P., Marquardt, M., Vona, F., Schorlemmer, J., & Voigt‐Antons, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93508-4_11 · Cited by 3
“Namely, the patient’s willingness to share personal information, and also thoughts, feelings, and uncomfortable experiences, with the goal of delivering a proper diagnosis [1, 6].”
Applications of Artificial Intelligence in Dermatology
Arza, A., Lebhar, J., & Lipoff, J. B. (2025) · Dermatologic Clinics · doi:10.1016/j.det.2025.05.003 · Cited by 7
Emotionally Adaptive Virtual Health Assistants for Enhanced Social Presence and Trust
Ashrafi, N., Schorlemmer, J., Vona, F., Kojić, T., Hillmann, S., Braytee, A., Wang, Y., Kocaballi, A. B., Moreira, C., Möller, S., et al. (2025) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3742886.3756698 · Cited by 5
“Self-disclosure, the willingness to share personal thoughts, experiences, and sensitive information, is a critical factor for the effectiveness of virtual avatars in healthcare settings, particularly for enabling accurate diagnosis [1, 9].”
Beyond the black box: why algorithms cannot replace the unconscious or the psychodynamic therapist
Govrin, A. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1614125 · Cited by 7
Demir, M., AYDOĞDU, F., ALABAY, M. B., Yaşar, H. K., & Bozkurt, A. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-025-01297-1 · Cited by 7
“…between a digitally native client who is highly proficient with AI and a therapist with lim - ited AI literacy could become a potential source of tension [ 26, 61, 68 ] The participants’ expressed concern about the burden of having to learn new things already points to this emerging issue.”
InfluentialArtificial Intelligence to Support Human-Provided Mental Health Treatment
Soma, C. S., Kuo, P. B., Mehta, M., Srikumar, V., Imel, Z. E., & Atkins, D. C. (2026) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-061724-075336 · Cited by 9
Mutluer, T., Fıçıcıoğlu, İ. E. G., Uysal, M., Ekinci, S., Coskun, C. N., Mete, H. K., Çaltıner, Ş. N. İ., Bugay, B. Z., Sever, E., & Başdoğan, Ç. (2026) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-025-02867-7 · Cited by 12
“Key issues include ensuring informed consent for data collection, maintaining trans - parency in AI-driven decision-making, and addressing the unintended consequences of automated interventions [5, 15].”
Management of Refractory Functional Gastrointestinal Disorders: What Role Should Psychiatrists Have?
Khosravi, M., Alzahrani, A. A., Muhammed, T. M., Hjazi, A. M., Abbas, H. H., AbdRabou, M. A., Mohmmed, K. H., Ghildiyal, P., Yumashev, A., Elawady, A., et al. (2024) · Pharmacopsychiatry · doi:10.1055/a-2331-7684 · Cited by 4
Lee, G. C., Platow, M. J., & Cruwys, T. (2024) · British Journal of Clinical Psychology · doi:10.1111/bjc.12489 · Cited by 8
“Our findings join a growing body of scholarship to consider the practical, ethical, and social implications of embodied AI in mental healthcare (e.g., Fiske et al., 2019).”
Agnati, L. F., Anderlini, D., Guidolin, D., Marcoli, M., & Maura, G. (2021) · Foundations of Science · doi:10.1007/s10699-021-09796-z · Cited by 4
Bethel, C. L., Henkel, Z., Henkel, K. B., Thompson, J. F., & Smith, K. (2023) · World Symposium on Digital Intelligence for Systems and Machines (DISA) · doi:10.1109/disa59116.2023.10308910 · Cited by 4
“Achieving success in this area requires extensive collaboration between developers and clinicians [12], [13].”
BackgroundMethod
Metadata
- Authors
- Fiske, A., Henningsen, P., & Buyx, A.
- Affiliations
- Technical University of Munich (DE)
- TUM Klinikum (DE)
- Corresponding author
- Fiske, Amelia
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-05-09
- Volume
- 21
- Issue
- 5
- Pages
- e13216
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6532335
- OpenAlex
- W2916945592
- Cited by
- 857
- References
- 73
- Citations by year
- 2026: 190 · 2025: 205 · 2024: 179 · 2023: 98 · 2022: 88 · 2021: 56 · 2020: 28 · 2019: 13
- FWCI
- 12.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- mediaTUM (Technical University of Munich) (submittedVersion, other-oa)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- embodied AI, social robots, mental health services, patient autonomy, algorithmic transparency, data ethics, health disparities, clinical implementation of AI, harm prevention, psychotherapy
- MeSH terms
- Artificial Intelligence, Humans, Psychiatry, Psychology, Psychotherapy, Robotics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.