The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy
Open accessPublished version of a preprint
Abstract
BACKGROUND: Research in embodied artificial intelligence (AI) has increasing clinical relevance for therapeutic applications in mental health services. With innovations ranging from 'virtual psychotherapists' to social robots in dementia care and autism disorder, to robots for sexual disorders, artificially intelligent virtual and robotic agents are increasingly taking on high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health professionals. In order to enable responsible clinical implementation, ethical and social implications of the increasing use of embodied AI in mental health need to be identified and addressed. OBJECTIVE: This paper assesses the ethical and social implications of translating embodied AI applications into mental health care across the fields of Psychiatry, Psychology and Psychotherapy. Building on this analysis, it develops a set of preliminary recommendations on how to address ethical and social challenges in current and future applications of embodied AI. METHODS: Based on a thematic literature search and established principles of medical ethics, an analysis of the ethical and social aspects of currently embodied AI applications was conducted across the fields of Psychiatry, Psychology, and Psychotherapy. To enable a comprehensive evaluation, the analysis was structured around the following three steps: assessment of potential benefits; analysis of overarching ethical issues and concerns; discussion of specific ethical and social issues of the interventions. RESULTS: From an ethical perspective, important benefits of embodied AI applications in mental health include new modes of treatment, opportunities to engage hard-to-reach populations, better patient response, and freeing up time for physicians. Overarching ethical issues and concerns include: harm prevention and various questions of data ethics; a lack of guidance on development of AI applications, their clinical integration and training of health professionals; 'gaps' in ethical and regulatory frameworks; the potential for misuse including using the technologies to replace established services, thereby potentially exacerbating existing health inequalities. Specific challenges identified and discussed in the application of embodied AI include: matters of risk-assessment, referrals, and supervision; the need to respect and protect patient autonomy; the role of non-human therapy; transparency in the use of algorithms; and specific concerns regarding long-term effects of these applications on understandings of illness and the human condition. CONCLUSIONS: We argue that embodied AI is a promising approach across the field of mental health; however, further research is needed to address the broader ethical and societal concerns of these technologies to negotiate best research and medical practices in innovative mental health care. We conclude by indicating areas of future research and developing recommendations for high-priority areas in need of concrete ethical guidance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI may also lack interpersonal or cultural competency, which could hinder therapeutic relationships and cause unintended psychological distress [29].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Technical failures, such as AI chatbots that cease to function properly [29], or AI initiatives that fail during a network failure [30], may result in unintended harm.”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
In the citing paper
“although AI can provide some form of healthcare in resource-poor areas, this could be used as a justification to not further develop physical (as opposed to virtual) mental health services in these areas of need [29].”
From Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers (2023) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Principles of Biomedical Ethics
(2012) · Thieves of Virtue · doi:10.7551/mitpress/9079.003.0009 · Cited by 13,453
Baio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., Kurzius-Spencer, M., Zahorodny, W., Robinson, C., Rosenberg, et al. (2018) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6706a1 · Cited by 6,078
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“Initiatives for establishing guidelines are emerging, including the online collaboratively generated document “Moral Responsibility for Computing Artifacts: The Rules,” or the recent “An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations” [70].”
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 1×
“Initial studies found that depression symptoms decreased with the use of Woebot more than groups who relied on electronic book resources [21], and another study found that Tess helped to reduce depression and anxiety among users [20].”
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 1×
“Increasingly, artificially intelligent virtual and robotic agents are not only available for relatively low-level elements of mental health support, such as comfort or social interaction, but also perform high-level therapeutic interventions that used to be offered exclusively by highly trained, skilled health profess…”
Robots for Use in Autism Research
Scassellati, B., Admoni, H., & Matarić, M. (2012) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071811-150036 · Cited by 942 · cited 1×
“to react positively to robots, even in cases where they have trouble interacting with others [35].”
Assistive social robots in elderly care: a review
Broekens, J., Heerink, M., & Rosendal, H. (2024) · Gerontechnology · doi:10.4017/gt.2009.08.02.002.00 · Cited by 940 · cited 1×
“As with any medical innovation, the effects, impacts, and clinical utility of the applications can only be fully assessed once evidence has improved [50,51].”
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673 · cited 2×
“We have also excluded applications that may have a virtual or robotic interface but do not employ AI, such as telemedicine therapy (for further scholarship on this topic, please see [12-19]).”
The clinical use of robots for individuals with Autism Spectrum Disorders: A critical review
Diehl, J. J., Schmitt, L. M., Villano, M., & Crowell, C. R. (2012) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2011.05.006 · Cited by 626 · cited 1×
“As with any medical innovation, the effects, impacts, and clinical utility of the applications can only be fully assessed once evidence has improved [50,51].”
Socially Assistive Robots in Elderly Care: A Systematic Review into Effects and Effectiveness
Bemelmans, R., Gelderblom, G. J., Jonker, P., & de Witte, L. (2012) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2010.10.002 · Cited by 585 · cited 1×
“Thus far, the outcomes are promising [32,33].”
Research works printed but not linked: 3
- 10.2196/12106 · doi:10.2196/12106 · Paper page
- Riek, L, 2015, Artificial Intelligence in Behavioral Health and Mental Health Care, 185
- Latour, B, 1986, Laboratory Life
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives
Esmaeilzadeh, P. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01191-1 · Cited by 507
“There is a growing interest in research about AI-centric technologies, yet individuals have not integrated AI devices into many aspects of their lives [76].”
BackgroundApplication of Artificial Intelligence in Dentistry
Shan, T., Tay, F. R., & Gu, L. (2021) · Journal of Dental Research · doi:10.1177/0022034520969115 · Cited by 511
“By learning a set of bases that is representative of the entire set of voice and target dictionary, this technique adapted well to a limited amount of training data and acquired satisfactory short-time objective intelligibility scores (Fu et al. 2017).”
Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review
Yin, J., Ngiam, K. Y., & Teo, H. H. (2021) · Journal of Medical Internet Research · doi:10.2196/25759 · Cited by 419
Identifying Ethical Considerations for Machine Learning Healthcare Applications
Char, D. S., Abràmoff, M. D., & Feudtner, C. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1819469 · Cited by 415
“…any ML-HCA built on such a classification would likely result in an even higher likelihood of de-escalation or withholding, thereby reducing the opportunity to improve outcomes for such conditions (Begoli et al. 2019; Fiske et al. 2019; Nabi 2018; Cohen et al. 2014; Ho 2019; Taljaard et al. 2014).”
BackgroundIqbal, M. J., Javed, Z., Sadia, H., Qureshi, I. A., Irshad, A., Ahmed, R., Malik, K., Raza, S., Abbas, A., Pezzani, R., et al. (2021) · Cancer Cell International · doi:10.1186/s12935-021-01981-1 · Cited by 369
“Moreover, the integrations of AI devices in everyday life and medical care are changing moral judgment and social expectancies as there is a far difference between communication between human and machine [66].”
BackgroundChatGPT outperforms humans in emotional awareness evaluations
Elyoseph, Z., Hadar-Shoval, D., Asraf, K., & Lvovsky, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1199058 · Cited by 324
“Ultimately, the successful integration of AI in mental health care will require a thoughtful and ethical approach that balances the potential benefits and concerns about data ethics, lack of guidance on development and integration of AI applications, potential misuse leading to health inequalities, respecting patient…”
BackgroundRoles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
“However, the digital divide [292-294], algorithmic ethical concerns [295], and the potential misuse of chatbots in replacing established health services [296] present risks.”
Karimian, G., Petelos, E., & Evers, S. M. A. A. (2022) · AI and Ethics · doi:10.1007/s43681-021-00131-7 · Cited by 279
“The principle of patient privacy was another frequent topic of research in the literature [25, 39–41, 43–46, 48].”
BackgroundInfluential(2021) · doi:10.2196/25856 · Cited by 268
“There is growing interest in research about AI-centric technologies; however, individuals have not yet integrated AI applications into many aspects of their lives [96].”
BackgroundTimmons, A. C., Duong, J. B., Simo Fiallo, N., Lee, T., Vo, H. P. Q., Ahle, M. W., Comer, J. S., Brewer, L. C., Frazier, S. L., & Chaspari, T. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221134490 · Cited by 263
Unraveling the Ethical Enigma: Artificial Intelligence in Healthcare
Jeyaraman, M., Balaji, S., Jeyaraman, N., & Yadav, S. (2023) · Cureus · doi:10.7759/cureus.43262 · Cited by 254
“AI applications in the field of mental healthcare have the potential to offer advantages, including new treatment modalities, chances to connect with underserved communities, and improved patient response [13].”
Artificial intelligence and the future of psychiatry: Insights from a global physician survey
Doraiswamy, P. M., Blease, C., & Bodner, K. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101753 · Cited by 253
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251
Digital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges
Wies, B., Landers, C., & Ienca, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.697072 · Cited by 242
“The use of digital mental health tools gives youngsters, on the one hand, the chance to play a more active role in their own treatment as they can actively seek support or control difficult situations (18, 20, 25, 26, 29, 31, 32), as well as the pace of answering/responding (26).”
BackgroundInfluentialArtificial intelligence and chatbots in psychiatry
Pham, K. T., Nabizadeh, A., & Selek, S. (2022) · Psychiatric Quarterly · doi:10.1007/s11126-022-09973-8 · Cited by 241
“Robots such as Kaspar and Nao are able to teach children social skills and help them with facial recognition and appropriate gaze response, with initial studies reporting that children with ASDs performed better with robotic intervention compared to human therapists [8].”
BackgroundMethodLi, F., Ruijs, N., & Lu, Y. (2022) · AI · doi:10.3390/ai4010003 · Cited by 239
To chat or bot to chat: Ethical issues with using chatbots in mental health
Coghlan, S., Leins, K., Sheldrick, S., Cheong, M., Gooding, P., & D'Alfonso, S. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231183542 · Cited by 215
Khawaja, Z., & Bélisle-Pipon, J.-C. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1278186 · Cited by 214
Exploring the Ethical Challenges of Conversational AI in Mental Health Care: Scoping Review
Rahsepar Meadi, M., Sillekens, T., Metselaar, S., van Balkom, A., Bernstein, J., & Batelaan, N. (2025) · JMIR Mental Health · doi:10.2196/60432 · Cited by 211
“Multimedia Appendix 3 [7,8,10,15,16,18-20, 22-24 22-24, Most articles (46/101, 45.5”
InfluentialDigital transformation of mental health services
Bond, R. R., Mulvenna, M. D., Potts, C., O’Neill, S., Ennis, E., & Torous, J. (2023) · npj Mental Health Research · doi:10.1038/s44184-023-00033-y · Cited by 199
“Fiske et al. 39 present studies and instances where clients prefer to ‘ chat ’ to a digital agent to avoid judgement or embarrassment.”
Embedded ethics: a proposal for integrating ethics into the development of medical AI
McLennan, S., Fiske, A., Tigard, D., Müller, R., Haddadin, S., & Buyx, A. (2022) · BMC Medical Ethics · doi:10.1186/s12910-022-00746-3 · Cited by 195
Self-citationRevolutionizing clinical trials: the role of AI in accelerating medical breakthroughs
Chopra, H., Annu, Shin, D. K., Munjal, K., Priyanka, Dhama, K., & Emran, T. B. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000705 · Cited by 177
A Scoping Review of Machine Learning in Psychotherapy Research
Aafjes-van Doorn, K., Kamsteeg, C., Bate, J., & Aafjes, M. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1808729 · Cited by 179
Artificial Intelligence for Chatbots in Mental Health: Opportunities and Challenges
Denecke, K., Abd-Alrazaq, A., & Househ, M. (2021) · Lecture Notes in Bioengineering · doi:10.1007/978-3-030-67303-1_10 · Cited by 177
Service Robots: Trends and Technology
Gonzalez-Aguirre, J. A., Osorio-Oliveros, R., Rodríguez-Hernández, K. L., Lizárraga-Iturralde, J., Morales Menendez, R., Ramírez-Mendoza, R. A., Ramírez-Moreno, M. A., & Lozoya-Santos, J. D. J. (2021) · Applied Sciences · doi:10.3390/app112210702 · Cited by 167
“Some of them are the lack of generalization and formalism in classifications and taxonomy [10], the current perceived utilitarian value [61], battery and autonomy modelling and estimation [119], ethics [36], and even design problems related to gender biases based on the occupation of the robot [120].”
BackgroundOperationalising ethics in artificial intelligence for healthcare: a framework for AI developers
Solanki, P., Grundy, J., & Hussain, W. (2023) · AI and Ethics · doi:10.1007/s43681-022-00195-z · Cited by 157
“Data may be collected by multiple sources (e.g. smartphone geolocation and online forum activity) [31], by AI robots [29], or by passive means (e.g. screen taps or voice inflection) [35].”
BackgroundInfluentialConcepts and applications of digital twins in healthcare and medicine
Zhang, K., Zhou, H.-Y., Baptista‐Hon, D. T., Gao, Y., Liu, X., Oermann, E. K., Xu, S. H., Jin, S., Zhang, J., Sun, Z., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.101028 · Cited by 220
“In medicine, embodied AI has been playing important roles in mental healthcare 50 and medical robotics.”
BackgroundThe ethical issues of social assistive robotics: A critical literature review
Boada, J. P., Maestre, B. R., & Carme Torras, A. (2021) · Technology in Society · doi:10.1016/j.techsoc.2021.101726 · Cited by 180
Artificial intelligence in psychiatry research, diagnosis, and therapy
Sun, J., Dong, Q., Wang, S.-W., Zheng, Y., Liu, X., Lu, T., Yuan, K., Shi, J., Hu, B., Hu, B., et al. (2023) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2023.103705 · Cited by 198
Comparing artificial intelligence and human coaching goal attainment efficacy
Terblanche, N. H. D., Molyn, J., de Haan, E., & Nilsson, V. O. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270255 · Cited by 192
“In the related field of psychology AI offers new modes of treatment, the ability to reach currently excluded populations, improve patient response and free up limited resources such as highly trained psychologists [51].”
BackgroundImage-Based Artificial Intelligence in Wound Assessment: A Systematic Review
Anisuzzaman, D., Wang, C., Rostami, B., Gopalakrishnan, S., Niezgoda, J., & Yu, Z. (2021) · Advances in Wound Care · doi:10.1089/wound.2021.0091 · Cited by 170
“9 With increasing uses of AI technologies in health assessment ( e.g. , in psychiatry, psychology, and psychotherapy, 10 in early coronavirus detection, 11 etc. ), and portable devices such as smartphones, 12,13 it is now timely to develop remote and intelligent diagnosis and prognosis systems for…”
The Modern and Digital Transformation of Oral Health Care: A Mini Review
Alauddin, M. S., Baharuddin, A. S., & Ghazali, M. I. M. (2021) · Healthcare · doi:10.3390/healthcare9020118 · Cited by 145
“Hence, there will be issues in a fair, post-labor economy with division of an income-based society in the future [68].”
BackgroundIs AI the Future of Mental Healthcare?
Minerva, F., & Giubilini, A. (2023) · Topoi · doi:10.1007/s11245-023-09932-3 · Cited by 159
Saheb, T., Saheb, T., & Carpenter, D. O. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104660 · Cited by 162
Obrenovic, B., Gu, X., Wang, G., Godinić, D., & Jakhongirov, I. (2024) · AI & Society · doi:10.1007/s00146-024-01889-0 · Cited by 199
“…consider is how the blur-ring of the boundary between humans and robots in generative AI by erasing the barrier between digital information space and people impacts societal perceptions of robots and the ethics surrounding their use (Bankins and Formosa 2021; Fiske et al. 2019; Felten et al. 2023).”
Artificial intelligence and Psychiatry: An overview
Ray, A., Bhardwaj, A., Malik, Y. K., Singh, S., & Gupta, R. (2022) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2022.103021 · Cited by 150
“Worries around security may be magnified as the amount of data collected continues to expand (Fiske et al., 2019).”
BackgroundDesigning Personality-Adaptive Conversational Agents for Mental Health Care
Ahmad, R., Siemon, D., Gnewuch, U., & Robra-Bissantz, S. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10254-9 · Cited by 159
“Though AI-based CAs are increasingly capable of handling highly complex tasks, such as social support and therapeutic decision-making in a human-like way, currently available CAs, however, do not live up to their full potential yet (Fiske et al., 2019; Graham et al., 2019).”
Backgroundd’Elia, A., Gabbay, M., Rodgers, S., Kierans, C., Jones, E., Durrani, I., Thomas, A., & Frith, L. (2022) · Family Medicine and Community Health · doi:10.1136/fmch-2022-001670 · Cited by 149
“Veinot et al argued that ethnic minorities are more sceptical to digital health interventions than the majority population, 4 a conclusion shared with Marcus et al , who in their review, stated that privacy and security issues are major causes for distrust in AI among minority ethnicities.”
BackgroundDawoodbhoy, F. M., Delaney, J., Cecula, P., Yu, J., Peacock, I., Tan, J. S., & Cox, B. M. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e06993 · Cited by 142
(2023) · doi:10.2196/54369 · Cited by 127
“Equally critical is the concern regarding the exposure of user data to corporations and the urgent need to adequately address both accessibility and infrastructure for end users [39].”
Human-Computer Interaction in Digital Mental Health
Balcombe, L., & Leo, D. D. (2022) · Informatics · doi:10.3390/informatics9010014 · Cited by 185
“, the need for empathetic and inclusive care) which makes the digital therapeutic relationship important to delivering effective, efficient, and patient-centered care [151] in a blended [84] hybrid [152,153] or stepped model of care [36,50,53].”
BackgroundMaassen, O., Fritsch, S., Palm, J., Deffge, S., Kunze, J., Marx, G., Riedel, M., Schuppert, A., & Bickenbach, J. (2021) · Journal of Medical Internet Research · doi:10.2196/26646 · Cited by 125
“The low rating of AI’s potential for psychiatric diseases is remarkable as there are several AI applications for this medical field as described for ML in recent publications [52,53].”
BackgroundContemporary Role and Applications of Artificial Intelligence in Dentistry
Bonny, T., Nassan, W. A., Obaideen, K., Mallahi, M. N. A., Mohammad, Y., & El-Damanhoury, H. M. (2023) · F1000Research · doi:10.12688/f1000research.140204.1 · Cited by 178
Application of Artificial Intelligence on Psychological Interventions and Diagnosis: An Overview
Zhou, S., Zhao, J., & Zhang, L. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.811665 · Cited by 150
“(16) offer evidence that DL algorithms such as Tess, specifically designed for practical and accessible use of internet psychotherapy.”
You Can’t Have AI Both Ways: Balancing Health Data Privacy and Access Fairly
Bak, M., Madai, V. I., Fritzsche, M.-C., Mayrhofer, M. T., & McLennan, S. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.929453 · Cited by 145
Artificial Intelligence for Automatic Pain Assessment: Research Methods and Perspectives
Cascella, M., Schiavo, D., Cuomo, A., Ottaiano, A., Perri, F., Patrone, R., Migliarelli, S., Bignami, E. G., Vittori, A., & Cutugno, F. (2023) · Pain Research and Management · doi:10.1155/2023/6018736 · Cited by 124
A Systematic Review of Robotic Rehabilitation for Cognitive Training
Yuan, F., Klavon, E., Liu, Z., Lopez, R. P., & Zhao, X. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.605715 · Cited by 121
Grodniewicz, J. P., & Hohol, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1190084 · Cited by 100
Equity within AI systems: What can health leaders expect?
Gurevich, E., Hassan, B. E., & Morr, C. E. (2022) · Healthcare Management Forum · doi:10.1177/08404704221125368 · Cited by 110
Attitudes and perspectives towards the preferences for artificial intelligence in psychotherapy
Aktan, M. E., Turhan, Z., & Dolu, İ. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107273 · Cited by 114
Kim, M., Lee, S., Kim, S., Heo, J.-I., Lee, S., Shin, Y.-B., Cho, C.-H., & Jung, D. (2025) · Journal of Medical Internet Research · doi:10.2196/65589 · Cited by 90
Guemghar, I., Padilha, P. P. D. O., Abdel‐Baki, A., Jutras‐Aswad, D., Paquette, J., & Pomey, M. (2022) · JMIR Mental Health · doi:10.2196/36094 · Cited by 125
“Most of the robots cannot assess a patient’s emotional state with great accuracy, and the absence of a human professional can have a negative impact on a patient’s adherence to a program [18,63,80].”
BackgroundInfluentialAbd-Alrazaq, A. A., Alhuwail, D., Schneider, J., Toro, C. T., Ahmed, A., Alzubaidi, M. S., Alajlani, M., & Househ, M. S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00631-8 · Cited by 125
“Advances in the use of AI for diagnostic and therapeutic mental health interventions are on the rise with multiple examples including social bots to support dementia care, sexual disorders, and even virtual psychothera-pists 8 – 11 .”
BackgroundiHealth: The ethics of artificial intelligence and big data in mental healthcare
Rubeis, G. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100518 · Cited by 114
“…aspects have been addressed in general research on the ethics of AI and e-mental health, e.g. threats to autonomy (Fiske et al., 2019; Morley et al., 2020), privacy issues (Martinez-Martin and Kreitmair, 2018; Wykes et al., 2019), and bias (Fiske et al., 2019; Martinez-Martin and Kreitmair, 2018).”
BackgroundThe Role Of Technology In Era 5.0 In The Development Of Arabic Language In The World Of Education
Keshav, M., Julien, L., & Miezel, J. (2022) · Journal International of Lingua and Technology · doi:10.55849/jiltech.v1i2.85 · Cited by 121
Algorithms for Ethical Decision-Making in the Clinic: A Proof of Concept
Meier, L. J., Hein, A., Diepold, K. J., & Buyx, A. (2022) · The American Journal of Bioethics · doi:10.1080/15265161.2022.2040647 · Cited by 108
Self-citationApplications of large language models in psychiatry: a systematic review
Omar, M., Soffer, S., Charney, A. W., Landi, I., Nadkarni, G. N., & Klang, E. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1422807 · Cited by 124
“ChatGPT ’ s ability to provide preliminary mental health assessments and psychotherapeutic support is a notable advancement (15, 16).”
BackgroundHaber, Y., Levkovich, I., Hadar‐Shoval, D., & Elyoseph, Z. (2024) · JMIR Mental Health · doi:10.2196/54781 · Cited by 106
“As GAI is being embedded in the mental health arena, we are witnessing the emergence of a distinctive triangular dynamic: therapist, patient, and the GAI “third” entity [26].”
BackgroundResponsible AI in Africa: Challenges and Opportunities
(2023) · Social and Cultural Studies of Robots and AI · doi:10.1007/978-3-031-08215-3 · Cited by 82
Digital Psychiatry: Risks and Opportunities for Public Health and Wellbeing
Burr, C., Morley, J., Taddeo, M., & Floridi, L. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2977059 · Cited by 86
“2Similar concerns have been raised in relation to embodied robotics used in assisted living and geriatrics [27], [28].”
BackgroundLukkien, D., Nap, H. H., Buimer, H. P., Peine, A., Boon, W., Ket, J. C. F., Minkman, M. M. N., & Moors, E. H. M. (2021) · The Gerontologist · doi:10.1093/geront/gnab180 · Cited by 101
“Third, some papers discuss specific RI issues that require nuanced contextualization (Chaaraoui et al., 2014; Ferreira et al., 2019; Fiske et al., 2019; Körtner, 2016; Nguyen-Truong & Fritz, 2018; Yang et al., 2018).”
BackgroundWu, C., Xu, H., Bai, D., Chen, X., Gao, J., & Jiang, X. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066322 · Cited by 101
“62 Moreover, members of the public believe that both they and medical staff are overdependent on AI, and there is a risk that their skills and knowledge may be deprived by AI.”
BackgroundNashwan, A. J., Gharib, S., Alhadidi, M. M. B., El‐Ashry, A. M., Alamgir, A., Al-Hassan, M., Khedr, M. A., Dawood, S. S., & Abufarsakh, B. (2023) · Issues in Mental Health Nursing · doi:10.1080/01612840.2023.2263579 · Cited by 88
“…health professionals should focus on developing relationships with their patients and observing their behaviors directly, which depends on applying communication skills when it comes to providing treatment for the patient with mental health problems (Fiske et al., 2019; Seibert et al., 2023).”
BackgroundTerra, M., Baklola, M. I., Ali, S. A. A., & El-Bastawisy, K. (2023) · The Egyptian Journal of Neurology Psychiatry and Neurosurgery · doi:10.1186/s41983-023-00681-z · Cited by 111
“However, there are also concerns about the potential ethical and societal implications of AI in psychiatry, such as issues related to data privacy and bias in algorithm decision-making [10–12].”
BackgroundGalderisi, S., Appelbaum, P. S., Gill, N., Gooding, P., Herrman, H., Melillo, A., Myrick, K., Pathare, S., Savage, M., Szmukler, G., et al. (2024) · World Psychiatry · doi:10.1002/wps.21230 · Cited by 76
“Efforts have been made to identify ethical principles, themes and issues that cut across diverse practices 87,95-98 .”
Robotics Applications in COVID-19: A Review
Javaid, M., Haleem, A., Vaish, A., Vaishya, R., & Iyengar, K. (2020) · Journal of Industrial Integration and Management · doi:10.1142/s2424862220300033 · Cited by 44
Laacke, S., Mueller, R., Schomerus, G., & Salloch, S. (2021) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1863515 · Cited by 91
“…in mental healthcare cover a wide range of technologies: Health screening systems, therapeutic and diagnostic chatbots or self-help apps (Fitzpatrick, Darcy, and Vierhile 2017; Inkster, Sarda, and Subramanian 2018; Mehrotra et al. 2017), virtual human avatars (Abbott and Shaw 2016;…”
BackgroundEthical Dilemmas, Mental Health, Artificial Intelligence, and LLM-Based Chatbots
Cabrera-Medina, J., Loyola, M. S., Magaña, I., & Rojas, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34960-7_22 · Cited by 74
Badawy, W., Zinhom, H., & Shaban, M. (2025) · International Nursing Review · doi:10.1111/inr.13059 · Cited by 80
Scholich, T., Barr, M., Wiltsey Stirman, S., & Raj, S. (2025) · JMIR Mental Health · doi:10.2196/69709 · Cited by 72
“Previous research raised ethical concerns regarding the ability of AI-driven mental health tools to handle high-risk situations such as suicidal ideation [14,17,32].”
What Makes a Social Robot Good at Interacting with Humans?
Onyeulo, E. B., & Gandhi, V. (2020) · Information · doi:10.3390/info11010043 · Cited by 88
A Review on Artificial Intelligence with Deep Human Reasoning
Harika, J., Baleeshwar, P., Navya, K., & Hariharan, S. (2022) · International Conference on Applied Artificial Intelligence and Computing (ICAAIC) · doi:10.1109/icaaic53929.2022.9793310 · Cited by 71
Ma, Z., Mei, Y., Long, Y., Su, Z., & Gajos, K. Z. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642482 · Cited by 127
“Designers should also seek to ensure the balance between user autonomy within the chatbot interface and facilitating timely access to safety resources [35, 42].”
BackgroundHolohan, M., & Fiske, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.720476 · Cited by 85
“In the area of mental health, embodied AI is increasingly being integrated into psychotherapeutic practice (Fiske et al., 2019).”
BackgroundSelf-citationFelber, N. A., Tian, Y. J., Pageau, F., Elger, B. S., & Wangmo, T. (2023) · BMC Medical Ethics · doi:10.1186/s12910-023-00898-w · Cited by 78
“In the realm of assistive technology in healthcare, these negotiations focus on high-risk cases and emergencies [127].”
BackgroundZusammenwirken von natürlicher und künstlicher Intelligenz
Haux, R., Gahl, K., Jipp, M., Kruse, R., & Richter, O. (2021) · Springer eBooks · doi:10.1007/978-3-658-30882-7 · Cited by 69
Rasa, A. R. (2024) · BioMed Research International · doi:10.1155/bmri/9554590 · Cited by 115
Zhang, M., Scandiffio, J., Younus, S., Jeyakumar, T., Karsan, I., Charow, R., Salhia, M., & Wiljer, D. (2023) · JMIR Formative Research · doi:10.2196/47847 · Cited by 67
“However, despite the potential for AI to enable more efficient and reliable and higher-quality care, there is a persistent knowledge gap among mental health professionals in the adoption of AI [22].”
BackgroundResultInfluentialZafar, F., Alam, L. F., Vivas, R. R., Wang, J., Whei, S. J., Mehmood, S., Sadeghzadegan, A., Lakkimsetti, M., & Nazir, Z. (2024) · Cureus · doi:10.7759/cureus.56472 · Cited by 110
“One of their essential usages is their assistance in therapy for mental disorders, with depression being the most common [61].”
BackgroundThe Debate on the Ethics of AI in Health Care: a Reconstruction and Critical Review
Morley, J., Machado, C., Burr, C., Cowls, J., Taddeo, M., & Floridi, L. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3486518 · Cited by 66
The double-edged sword of digital self-care: Physician perspectives from Northern Germany
Fiske, A., Buyx, A., & Prainsack, B. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113174 · Cited by 73
Self-citationWhat makes you attached to social companion AI? A two-stage exploratory mixed-method study
Hu, D., Lan, Y., Yan, H., & Chen, C. W. (2025) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2025.102890 · Cited by 114
Jebreen, K., Radwan, E., Kammoun-Rebai, W., Alattar, E., Radwan, A., Safi, W., Radwan, W., & Alajez, M. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05465-4 · Cited by 63
“AI applications in medicine have the potential to support a variety of tasks such as clinical research [5], therapy [6], administrative procedures [7], and drug development [8] due to their capacity to learn from large sets of clinical data.”
BackgroundArtificial intelligence-assisted psychosis risk screening in adolescents: Practices and challenges
Cao, X., & Liu, X. (2022) · World Journal of Psychiatry · doi:10.5498/wjp.v12.i10.1287 · Cited by 67
Human–Robot Interaction and Sexbots: A Systematic Literature Review
González, C. S. G., Gil, R., & Paderewski, P. (2020) · Sensors · doi:10.3390/s21010216 · Cited by 59
“Regarding data related to pedophiles and child-robots, there is currently no evidence of a relationship between the two [44].”
BackgroundMöllmann, N. R. J., Mirbabaie, M., & Stieglitz, S. (2021) · Health Informatics Journal · doi:10.1177/14604582211052391 · Cited by 75
Rogan, J., Bucci, S., & Firth, J. (2024) · JMIR Mental Health · doi:10.2196/49577 · Cited by 74
“Despite the potential benefits, there remains a persistent gap between the rapid developments in digitally supported mental health care and the successful adoption of these tools in clinical practice [13].”
The plasticity of ChatGPT’s mentalizing abilities: personalization for personality structures
Hadar‐Shoval, D., Elyoseph, Z., & Lvovsky, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1234397 · Cited by 60
The Impact of Artificial Intelligence on Human Sexuality: A Five-Year Literature Review 2020–2024
Döring, N., Le, T. D., Vowels, L. M., Vowels, M. J., & Marcantonio, T. L. (2024) · Current Sexual Health Reports · doi:10.1007/s11930-024-00397-y · Cited by 65
“…[69]) therapy bots and the availability of embodied therapy bots (i.e., implemented in a haptic device such as a human-like physical robot; e.g. [70],) will allow stronger bonds between clients and their therapeutic AI devices, which could ideally enhance therapeutic effects for some client…”
Leadership for AI Transformation in Health Care Organization: Scoping Review
Sriharan, A., Sekercioglu, N., Mitchell, C., Senkaiahliyan, S., Hertelendy, A. J., Porter, T. H., & Banaszak‐Holl, J. (2024) · Journal of Medical Internet Research · doi:10.2196/54556 · Cited by 95
Ali, M., Ali, S., Abbas, Q., Abbas, Z., & Lee, S. (2025) · Digital Health · doi:10.1177/20552076251395548 · Cited by 87
“85 However, their responses are limited by programmed algorithms and cannot fully replicate the nuanced understanding, empathy, and clinical judgment of human therapists.”
Lee, H. S., Wright, C., Ferranto, J., Buttimer, J., Palmer, C. E., Welchman, A., Mazor, K. M., Fisher, K. A., Smelson, D., O’Connor, L., et al. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1505024 · Cited by 55
Chan, C. K. Y. (2025) · Behavioral Sciences · doi:10.3390/bs15030287 · Cited by 77
“The most frequently employed frameworks in current research are ethical-based, such as those demonstrated in Fiske et al.’s (2019), Vilaza and McCashin’s (2021), and Khawaja and Bélisle-Pipon’s (2023) studies.”
An Ethical Perspective on the Democratization of Mental Health With Generative AI
Elyoseph, Z., Gur, T., Haber, Y., Simon, T., Angert, T., Navon, Y., Tal, A., & Asman, O. (2024) · JMIR Mental Health · doi:10.2196/58011 · Cited by 79
“By harnessing vast arrays of data and insights, such models may facilitate interventions crafted to meet the varied needs of different populations, including those historically underserved or marginalized [27,28].”
Background“Oh, Dignity too?” Said the Robot: Human Dignity as the Basis for the Governance of Robotics
Zardiashvili, L., & Fosch‐Villaronga, E. (2020) · Minds and Machines · doi:10.1007/s11023-019-09514-6 · Cited by 58
Prescott, J., & Hanley, T. (2023) · Mental Health and Social Inclusion · doi:10.1108/mhsi-02-2023-0020 · Cited by 49
McLennan, S., Meyer, A., Schreyer, K., & Buyx, A. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000114 · Cited by 50
“However, there are currently limited training programs or modules in place [7,27].”
BackgroundSelf-citationBalcombe, L., & Leo, D. D. (2020) · JMIR Formative Research · doi:10.2196/22755 · Cited by 64
“Large-scale and rigorous studies with artificial intelligence–delivered mental health care are still in a preliminary stage [64].”
Background
Metadata
- Authors
- Fiske, A., Henningsen, P., & Buyx, A.
- Affiliations
- Technical University of Munich (DE)
- TUM Klinikum (DE)
- Corresponding author
- Fiske, Amelia
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-05-09
- Volume
- 21
- Issue
- 5
- Pages
- e13216
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6532335
- OpenAlex
- W2916945592
- Cited by
- 857
- References
- 73
- Citations by year
- 2026: 190 · 2025: 205 · 2024: 179 · 2023: 98 · 2022: 88 · 2021: 56 · 2020: 28 · 2019: 13
- FWCI
- 12.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- mediaTUM (Technical University of Munich) (submittedVersion, other-oa)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- embodied AI, social robots, mental health services, patient autonomy, algorithmic transparency, data ethics, health disparities, clinical implementation of AI, harm prevention, psychotherapy
- MeSH terms
- Artificial Intelligence, Humans, Psychiatry, Psychology, Psychotherapy, Robotics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.