Trust me, i'm a chatbot: how artificial intelligence in health care fails the Turing Test
Open accessPublished version of a preprint
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Over the next decade, one issue which will dominate sociotechnical studies in health informatics is the extent to which the promise of artificial intelligence in health care will be realized, along with the social and ethical issues which accompany it. A useful thought experiment is the application of the Turing test to user-facing artificial intelligence systems in health care (such as chatbots or conversational agents). In this paper I argue that many medical decisions require value judgements and the doctor-patient relationship requires empathy and understanding to arrive at a shared decision, often handling large areas of uncertainty and balancing competing risks. Arguably, medicine requires wisdom more than intelligence, artificial or otherwise. Artificial intelligence therefore needs to supplement rather than replace medical professionals, and identifying the complementary positioning of artificial intelligence in medical consultation is a key challenge for the future. In health care, artificial intelligence needs to pass the implementation game, not the imitation game.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“AI misuse such as using smart technology to supplant established health services has been flagged up as an ethical concern (Carter et al., 2020;Powell, 2019) that can potentially exacerbate existing health inequalities (Abràmoff et al., 2020).”
From SHIFTing artificial intelligence to be responsible in healthcare: a systematic review (2022) · cites this paper as Powell, 2019
The cited source says what the claim attributes to it.
In the citing paper
“AI misuse such as using smart technology to supplant established health services has been flagged up as an ethical concern (Carter et al., 2020;Powell, 2019) that can potentially exacerbate existing health inequalities (Abràmoff et al., 2020).”
From SHIFTing artificial intelligence to be responsible in healthcare: a systematic review (2022) · cites this paper as Powell, 2019
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Studies on AI are still scarce and based on observational studies and secondary datasets.”
From 2021 ISHNE/HRS/EHRA/APHRS Expert Collaborative Statement on mHealth in Arrhythmia Management: Digital Medical Tools for Heart Rhythm Professionals: From the International Society for Holter and Noninvasive Electrocardiology/Heart Rhythm Society/European Heart Rhythm Association/Asia-Pacific Heart Rhythm Society (2021) · cites this paper as Powell 2019
Experimental — accuracy not yet measuredIn the citing paper
“Biased AI algorithms trained with unrepresentative and inequitable datasets could lead to inaccurate medical diagnosis and decisions, or worse, discriminatory profiling of citizens in low resource settings”
From SHIFTing artificial intelligence to be responsible in healthcare: a systematic review (2022) · cites this paper as Powell, 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769 · cited 1×
“management of individual patients [19].”
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 1×
“Factors which will influence the implementation of AI tools include those related to people, such as professional and public attitudes, trust, existing work practices, training needs, and the risks of deskilling and disempowerment; those related to the health system, such as leadership and management, the positioning…”
BackgroundWhy Are There Still So Many Jobs? The History and Future of Workplace Automation
Autor, D. H. (2015) · Journal of Economic Perspectives · doi:10.1257/jep.29.3.3 · Cited by 3,917 · cited 1×
“As various studies into the future of work have shown, automation in the workplace will not eliminate all human tasks [20].”
BackgroundYeh, M.-L. (2014) · Journal of Nursing Research · doi:10.1097/jnr.0000000000000065 · Cited by 3,829
Shared decision making — The pinnacle of patient-centered care
Barry, M. J., & Edgman-Levitan, S. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1109283 · Cited by 3,433 · cited 1×
“However, we know that medical consultations are complex [17], that many medical decisions require value judgements, and that the doctor-patient relationship requires empathy and understanding to arrive at a shared decision [18].”
BackgroundGreenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 3×
“We need to understand how to integrate the tools and practices of AI within the work and culture of professionals and organizations, to investigate factors related to adoption, nonadoption, and abandonment [10,12], and investigate the work required to sustain innovation [22].”
BackgroundEysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871 · cited 1×
“From a sociotechnical perspective, there were initial preoccupations with the impact of a new, uncontrolled form of mass communication, alongside concerns with the quality of unregulated online information and threats to professions, with medical professionals in particular fearing a loss of authority [1-3].”
BackgroundSelf-citationEysenbach, G., Powell, J., Englesakis, M., Rizo, C., & Stern, A. (2004) · BMJ · doi:10.1136/bmj.328.7449.1166 · Cited by 1,268
Self-citationMachine learning in medicine: Addressing ethical challenges
Vayena, E., Blasimme, A., & Cohen, I. G. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002689 · Cited by 912 · cited 1×
“For those of us studying the social science of digital technology in health and health care, one area of research is likely to dominate the next decade: the extent to which the promise of artificial intelligence (AI) in health care will be realized, and the social and ethical issues which accompany it [11-13].”
Background
Research works printed but not linked: 1
- Innes, AD, 2005, Br J Gen Pract, 55, 47
Cited by
Artificial intelligence for good health: a scoping review of the ethics literature.
Murphy, K., Di Ruggiero, E., Upshur, R., Willison, D. J., Malhotra, N., Cai, J. C., Malhotra, N., Lui, V., & Gibson, J. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00577-8 · Cited by 435
SHIFTing artificial intelligence to be responsible in healthcare: a systematic review
Siala, H., & Wang, Y. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114782 · Cited by 358
Artificial intelligence technologies and compassion in healthcare: A systematic scoping review
Morrow, E., Zidaru, T., Ross, F., Mason, C., Patel, K. D., Ream, M., & Stockley, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.971044 · Cited by 250
“There is a strong anticipation perspective relating to concerns about role replacement (Johnston, 2018; Blease et al., 2019; Bridge and Bridge, 2019; Powell, 2019; Blease et al., 2020; Doraiswamy et al., 2020; Alrassi et al., 2021) and which parts of healthcare practice, can and should be entrusted…”
BackgroundFriðgeirsson, Þ. V., Ingason, H. Þ., Jónasson, H. I., & Jónsdóttir, H. (2021) · Sustainability · doi:10.3390/su13042345 · Cited by 210
“The famous Turing Test method of inquiry for determining whether or not a computer is capable of thinking like a human being is rarely passed by a computer [2].”
MethodResponsible AI for Digital Health: a Synthesis and a Research Agenda
Trocin, C., Mikalef, P., Papamitsiou, Z., & Conboy, K. (2023) · Information Systems Frontiers · doi:10.1007/s10796-021-10146-4 · Cited by 205
“Due to the ‘black-boxed’ nature of many algorithms, it is challenging to understand the processes followed, the data used, the rules applied, and the people involved (Guan, 2019; Powell, 2019).”
BackgroundMethodd’Elia, A., Gabbay, M., Rodgers, S., Kierans, C., Jones, E., Durrani, I., Thomas, A., & Frith, L. (2022) · Family Medicine and Community Health · doi:10.1136/fmch-2022-001670 · Cited by 166
“20 40 Involvement of the target community throughout the whole implementation chain, from idea and problem formulation via data collection, datasets and regulatory environment all the way through implementation and end-users was key for equitable AI in general healthcare and primary care.”
BackgroundParviainen, J., & Rantala, J. (2022) · Medicine, Health Care and Philosophy · doi:10.1007/s11019-021-10049-w · Cited by 146
“Powell (2019) used the example of an early study of an algorithm-based triage tool in primary care.”
BackgroundMethodSeitz, L., Bekmeier‐Feuerhahn, S., & Gohil, K. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102848 · Cited by 142
Amann, J., Vayena, E., Ormond, K. E., Frey, D., Madai, V. I., & Blasimme, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0279088 · Cited by 120
Recent Advances of Artificial Intelligence in Healthcare: A Systematic Literature Review
Kitsios, F., Kamariotou, M. I., Syngelakis, A. I., & Talias, Μ. A. (2023) · Applied Sciences · doi:10.3390/app13137479 · Cited by 129
“For instance, the unethical use of AI, such as substituting established health services with smart technology, has been called out as a problem that needs to be addressed [137].”
BackgroundPark, G., Chung, J., & Lee, S. (2024) · Current Psychology · doi:10.1007/s12144-023-04653-7 · Cited by 84
“People now require more than an imitation of humanness or social interaction and active implementation of real-life social interaction (Powell, 2019 ).”
Lahat, A., Shachar, E., Avidan, B., Glicksberg, B., & Klang, E. (2023) · Diagnostics · doi:10.3390/diagnostics13111950 · Cited by 92
“Our results are in line with previous data assessing other artificial intelligence conversational agents in healthcare [6,7,11].”
ResultSiglen, E., Vetti, H. H., Lunde, A. B. F., Hatlebrekke, T. A., Strømsvik, N., Hamang, A., Hovland, S. T., Rettberg, J. W., Steen, V. M., & Bjorvatn, C. (2022) · Patient Education and Counseling · doi:10.1016/j.pec.2021.09.027 · Cited by 91
Hereditary Cancer Risk Using a Genetic Chatbot Before Routine Care Visits
Nazareth, S. B., Hayward, L. E., Simmons, E., Snir, M., Hatchell, K. E., Rojahn, S., Slotnick, R. N., & Nussbaum, R. L. (2021) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000004596 · Cited by 92
Huq, S. M., Maskeliūnas, R., & Damaševičius, R. (2022) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2022.2146768 · Cited by 107
“Chatbots programmed with the intention of being indistinguishable from a human when the classic Turing experiments were performed were some of the first cases of conversational agents [5].”
BackgroundRiedl, R., Hogeterp, S. A., & Reuter, M. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1422177 · Cited by 90
“Similarly, Powell (2019) argued that “many medical decisions require value judgments and the doctor-patient relationship requires empathy and understanding to arrive at a shared decision, often handling large areas of uncertainty and balancing competing risks.”
BackgroundVarma, N., Cygankiewicz, I., Turakhia, M. P., Heidbuchel, H., Hu, Y.-F., Chen, L. Y., Couderc, J.-P., Cronin, E. M., Estep, J. D., Grieten, L., et al. (2021) · Circulation: Arrhythmia and Electrophysiology · doi:10.1161/circep.120.009204 · Cited by 74
“…limitations should be considered and roadblocks removed before AI-based mHealth strategies become routinely incorporated in clinical practice (Kagiyama 2019, Powell 2019, Ribeiro 2019, Steinhubl 2015).2,25–27 Studies on AI are still scarce and based on observational studies and secondary datasets.”
BackgroundChatGPT’s Response Consistency: A Study on Repeated Queries of Medical Examination Questions
Funk, P. F., Hoch, C. C., Knoedler, S., Knoedler, L., Cotofana, S., Sofo, G., Bashiri Dezfouli, A., Wollenberg, B., Guntinas-Lichius, O., & Alfertshofer, M. (2024) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe14030043 · Cited by 69
“As AI technologies evolve, their potential to transform healthcare is undeniable, but their integration into the medical field must be approached with careful consideration of their and limitations [33–35].”
BackgroundYou, Y., & Gui, X. (2021) · PubMed · doi:10.48550/arxiv.2101.04796 · Cited by 120
“Other studies have explored the conversational design of healthcare chatbots, illustrating the importance of considering users’ design preferences 10 .”
BackgroundStarke, G., Gille, F., Termine, A., Aquino, Y. S. J., Chavarriaga, R., Ferrario, A., Hastings, J., Jongsma, K. R., Kellmeyer, P., Kulynych, B., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/56306 · Cited by 67
“For instance, there is some empirical evidence that being transparent about the functioning of a triage system makes clinicians more likely to trust it [118].”
Vilaza, G. N., & McCashin, D. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.689736 · Cited by 60
“Before expecting that AI systems replace conventional therapy (28), it is essential to consider how advances could eventually lead to adverse effects.”
BackgroundUniqueness neglect on consumer resistance to AI
Mou, Y., Xu, T., & Hu, Y. (2023) · Marketing Intelligence & Planning · doi:10.1108/mip-11-2022-0505 · Cited by 61
Ćirković, A. (2020) · Journal of Medical Internet Research · doi:10.2196/18097 · Cited by 60
Influences on User Trust in Healthcare Artificial Intelligence: A Systematic Review
Jermutus, E., Kneale, D., Thomas, J., & Michie, S. (2022) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17550.1 · Cited by 63
“Similar to previous healthcare technologies, however, realising AI’s potential is not just about establishing the effectiveness of its applications but also about resolving issues such as trust 15 .”
ResultVarma, N., Cygankiewicz, I., Turakhia, M. P., Heidbüchel, H., Hu, Y., Chen, L. Y., Couderc, J., Cronin, E. M., Estep, J. D., Grieten, L., et al. (2021) · Annals of Noninvasive Electrocardiology · doi:10.1111/anec.12795 · Cited by 54
Chao, M.-H., Trappey, A. J. C., & Wu, C.-T. (2021) · Complexity · doi:10.1155/2021/5511866 · Cited by 50
“An article on the application of chatbot in health care also mentioned that “AI needs to pass the implementation game, not the imitation game” [80].”
BackgroundLee, H., Kang, J., & Yeo, J. (2021) · Journal of Medical Internet Research · doi:10.2196/27460 · Cited by 47
Delayed diagnosis of a transient ischemic attack caused by ChatGPT
Saenger, J. A., Hunger, J., Boss, A., & Richter, J. (2024) · Wiener klinische Wochenschrift · doi:10.1007/s00508-024-02329-1 · Cited by 40
Devaram, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09130 · Cited by 46
“[23] • Limited Adoption –”
AI-enabled chatbots healthcare systems: an ethical perspective on trust and reliability
Basharat, I., & Shahid, S. (2024) · Journal of Health Organization and Management · doi:10.1108/jhom-10-2023-0302 · Cited by 48
Trust Me, I’m a Doctor – User Perceptions of AI-Driven Apps for Mobile Health Diagnosis
Baldauf, M., Fröehlich, P., & Endl, R. (2020) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3428361.3428362 · Cited by 52
“This is in line with prior expectations that medical AI systems will not replace human experts, but will act as a complement [29, 32, 36].”
ResultA New Research Model for Artificial Intelligence–Based Well-Being Chatbot Engagement: Survey Study
Yang, Y., Tavares, J., & Oliveira, T. (2024) · JMIR Human Factors · doi:10.2196/59908 · Cited by 50
“The interactive behavior of users with chatbots for health purposes is analogous to that of patients with their doctors; the establishment of collaborative and cooperative relationships based on trust is conducive to the achievement of health objectives [70,71].”
BackgroundNtinga, X., Musiello, F., Keter, A., Barnabas, R. V., & van Heerden, A. C. (2022) · Journal of Medical Internet Research · doi:10.2196/39816 · Cited by 42
“Despite the apparent advantages of the HIVST chatbot in comparison with a human counselor, it is necessary to be cognizant that artificial intelligence is limited in its ability to weigh competing personal values and to be conscientious [45].”
Sarkar, S., Gaur, M., Chen, L. K., Garg, M., & Srivastava, B. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1229805 · Cited by 38
“Moreover, researchers have made significant contributions in assessing the trustworthiness of WoeBot and Wysa through ethical research protocols, which is crucial given the sensitive nature of virtual mental health agents (VMHAs) (Powell, 2019).”
BackgroundArtificial Intelligence for Dermatopathology: Current Trends and the Road Ahead
Chen, S. B., & Novoa, R. A. (2022) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2022.01.003 · Cited by 37
Varma, N., Cygankiewicz, I., Turakhia, M. P., Heidbüchel, H., Hu, Y., Chen, L. Y., Couderc, J., Cronin, E. M., Estep, J. D., Grieten, L., et al. (2021) · Journal of Arrhythmia · doi:10.1002/joa3.12461 · Cited by 39
“…limitations should be considered and roadblocks removed before AI-based mHealth strategies become routinely incorporated in clinical practice (Kagiyama 2019, Powell 2019, Ribeiro 2019, Steinhubl 2015).2,25–27 Studies on AI are still scarce and based on observational studies and secondary datasets.”
BackgroundDamij, N., & Bhattacharya, S. (2022) · 2022 IEEE Technology and Engineering Management Conference (TEMSCON EUROPE) · doi:10.1109/temsconeurope54743.2022.9801962 · Cited by 22
“positioning of AI-mediated chatbots within mental health services has been recommended [88].”
BackgroundCelebrating 20 Years of Open Access and Innovation at JMIR Publications
Eysenbach, G. (2019) · Journal of Medical Internet Research · doi:10.2196/17578 · Cited by 36
Sagstad, M. H., Morken, N., Lund, A., Dingsør, L. J., Nilsen, A. B. V., & Sørbye, L. M. (2022) · JMIR Formative Research · doi:10.2196/28091 · Cited by 40
“There are several challenges when it comes to integrating this type of new technology into the established health care [39].”
BackgroundTraylor, D., Kern, K. V., Anderson, E. E., & Henderson, R. (2025) · Cureus · doi:10.7759/cureus.76825 · Cited by 48
Cantemir, E., & Kandemir, O. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09395-y · Cited by 34
“If a user cannot distinguish whether the machine they interact with is a human or a machine, the machine encountered as intelligent [2].”
Artificial Empathy: User Experiences with Emotionally Intelligent Chatbots
Rostami, M., & Navabinejad, S. (2023) · AI and Tech in Behavioral and Social Sciences · doi:10.61838/kman.aitech.1.3.4 · Cited by 34
Depresión perinatal en tiempos del COVID-19: rol de las redes sociales en Internet
Bermejo-Sánchez, F. R., Ayudante, W. R. P., & Espinoza-Portilla, E. (2020) · ACTA MEDICA PERUANA · doi:10.35663/amp.2020.371.913 · Cited by 46
Medical Chatbot Techniques: A Review
Tjiptomongsoguno, A. R. W., Chen, A., Sanyoto, H. M., Irwansyah, E., & Kanigoro, B. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-63322-6_28 · Cited by 34
Chatbot-Assisted Care Management
Schario, M. E., Bahner, C. A., Widenhofer, T. V., Rajaballey, J. I., & Thatcher, E. J. (2021) · Professional Case Management · doi:10.1097/ncm.0000000000000504 · Cited by 35
Aljamaan, F., Malki, K. H., Alhasan, K. A., Jamal, A. A., Altamimi, I., Khayat, A., Alhaboob, A. A. N., Abdulmajeed, N., Alshahrani, F. S., Saad, K., et al. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e28962 · Cited by 34
“Therefore, the future challenge lies in determining the appropriate role of AI in medical practice, perhaps to serve as a supplementary tool, rather than replacing human mind [54 – 58].”
BackgroundA critical look into artificial intelligence and healthcare disparities
Li, D. M., Parikh, S., & Costa, A. B. N. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1545869 · Cited by 38
“Similarly, what AI lacks that physicians have is not intelligence, but rather wisdom—the sense of intuition that a human being can accumulate only over time (Powell, 2019).”
Enhancing Artificial Intelligence with Indigenous Wisdom
Williams, D. H., & Shipley, G. P. (2021) · Open Journal of Philosophy · doi:10.4236/ojpp.2021.111005 · Cited by 30
Henkel, T., Linn, A. J., & van der Goot, M. J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25581-6_6 · Cited by 24
(Why) Do We Trust AI?: A Case of AI-based Health Chatbots
Prakash, A. V., & Das, S. (2024) · AJIS. Australasian journal of information systems/AJIS. Australian journal of information systems/Australian journal of information systems · doi:10.3127/ajis.v28.4235 · Cited by 30
The Medical Authority of AI: A Study of AI-enabled Consumer-Facing Health Technology
You, Y., Kou, Y., Ding, X., & Gui, X. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445657 · Cited by 25
“Recent research has also reviewed the development process of healthcare applications, such as the applications’ developers [72], regulation, consent and ownership [100], the role of health applications in healthcare [71].”
BackgroundOuyang, H., Meng, F., Liu, J., Song, X., Li, Y., Yuan, Y., Wang, C., Lang, N., Tian, S., Yao, M., et al. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.814667 · Cited by 21
Apprehensions about Excessive Belief in Digital Therapeutics: Points of Concern Excluding Merits
Kim, H. (2020) · Journal of Korean Medical Science · doi:10.3346/jkms.2020.35.e373 · Cited by 21
Abonizio, H., Barbon, A. P. A. D. C., Rodrigues, R., Santos, M. C. D. S., Martínez‐Vizcaíno, V., Mesas, A. E., & Barbon, S. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105134 · Cited by 22
Ren, X., Spina, G., Vries, S. D., Bijkerk, A., Faber, B., & Geraedts, A. S. (2020) · IEEE Access · doi:10.1109/access.2020.3005733 · Cited by 23
“During the last few years, it has been seen an increased interest in using conversational user interfaces to promote collaborative decision-making practices between clinicians and AI [11], [15], [16], emphasizing supporting medical reasoning [16], collecting patient intake [17], and facilitating clinical training [18].”
BackgroundTennant, R., Allana, S., Mercer, K., & Burns, C. M. (2022) · JMIR Human Factors · doi:10.2196/37688 · Cited by 20
“Intelligent VAs may be better integrated as complementary caregiving tools [59].”
BackgroundArtificial intelligence in medicine: advantages and disadvantages for today and the future
Salomon, I., & Sibomana, O. (2024) · International Journal of Surgery Open · doi:10.1097/io9.0000000000000133 · Cited by 18
Waaler, P. N., Hussain, M., Molchanov, I., Bongo, L. A., & Elvevåg, B. (2025) · JMIR AI · doi:10.2196/69820 · Cited by 19
“Another consequence of their “lack of self-awareness” is that they may drift into roles that require abilities that artificial intelligence (AI) lacks, such as empathy and being able to weigh a multitude of competing personal values and interests when considering complex personal decisions [9].”
Varma, N., Cygankiewicz, I., Turakhia, M. P., Heidbüchel, H., Hu, Y., Chen, L. Y., Couderc, J., Cronin, E. M., Estep, J. D., Grieten, L., et al. (2021) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztab001 · Cited by 21
Ahmad, A., Premanandan, S., Langegård, U., Cajander, Å., Johansson, B., Carlsson, M., & Ehrsson, Y. T. (2023) · JMIR Cancer · doi:10.2196/45748 · Cited by 18
“The trust issues on chatbots are also evident in previous research on chatbots for cancer caregiving [41-43].”
BackgroundVarma, N., Cygankiewicz, I., Turakhia, M. P., Heidbuchel, H., Hu, Y., Chen, L. Y., Couderc, J.-P., Cronin, E. M., Estep, J. D., Grieten, L., et al. (2021) · Cardiovascular Digital Health Journal · doi:10.1016/j.cvdhj.2020.11.004 · Cited by 19
“Several limitations should be considered and roadblocks removed before AI-based mHealth strategies become routinely incorporated in clinical practice (Kagiyama 2019, Powell 2019, Ribeiro 2019, Steinhubl 2015).”
BackgroundDesign and Development of Conversational Chatbot for Covid-19 using NLP: an AI application
Singh, S., Kaur, M., Tanwar, P., & Sharma, S. G. (2022) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc53470.2022.9753893 · Cited by 15
An Empathy Imitation Game: Empathy Turing Test for Care- and Chat-bots
Howick, J., Morley, J., & Floridi, L. (2021) · Minds and Machines · doi:10.1007/s11023-021-09555-w · Cited by 18
“Their use affects a number of dimensions, ranging from disruptions to the workforce to the inability to make value-based ethical decisions (although the latter could also be subject to a related Turing-type test) (Powell 2019).”
BackgroundDigital Political Communication in Russia: Values of Humanism vs. Technocratic Approach
Bykov, I. A., & Kurushkin, S. V. (2022) · RUDN Journal of Political Science · doi:10.22363/2313-1438-2022-24-3-419-432 · Cited by 14
“Некоторые авторы указывают на проблемы практического внедрения технологий искусственного интеллекта и чат-ботов [Powell 2019].”
Vijayarani, M., & Balamurugan, G. (2019) · Indian Journal of Psychiatric Nursing · doi:10.4103/iopn.iopn_34_19 · Cited by 15
“[23] Many doctors in the US said that chatbots could not efficaciously take care of all the needs of patients, show human emotions, and be responsible for comprehensive diagnosis and management.”
BackgroundRole of Artificial Intelligence in Transforming Diagnosis, Treatment, and Patient Care: A Review
Ali, S. A., Ali, S., & Khan, S. (2025) · Current pharmacogenomics and personalized medicine (Online)/Current pharmacogenomics and personalized medicine · doi:10.2174/0118756921404728251019182202 · Cited by 15
Special Section on Ethics in Health Informatics
Petersen, C. C., Subbian, V., & Section Editors Special Section on Ethics in Health Informatics of the International Medical Informatics Association Yearbook (2020) · Yearbook of Medical Informatics · doi:10.1055/s-0040-1702014 · Cited by 13
“Four papers addressed various aspects of ethics in AI, including the appropriate development, validation, and implementation of AI in patient care [19]; a proposed governance model for AI [20]; support for citizen trust when AI is in use [21]; and ethical issues related to the use of AI in psychiatry [22].”
BackgroundOyebode, O., Alqahtani, F., & Orji, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98438-0_12 · Cited by 12
Plikas, J. H., Trakadas, P. T., & Kenourgios, D. F. (2024) · Frontiers of artificial intelligence, ethics and multidisciplinary applications. · doi:10.1007/978-981-99-9836-4_24 · Cited by 12
Pears, M., & Konstantinidis, S. T. (2022) · Studies in health technology and informatics · doi:10.3233/shti220125 · Cited by 11
Turing Test and the Practice of Law: The Role of Autonomous Levels of AI Legal ReasoningPreprint
Eliot, L. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07743 · Cited by 9
“For example, in the medical field, there are AI systems that purportedly exhibit human intelligence capacities when analyzing an X-ray or MRI, and thus a type of Turing Test can be set up to try and determine the veracity of such medically specialized claims [42] [57].”
BackgroundVyas, P., & Gephart, S. M. (2025) · Advances in Nursing Science · doi:10.1097/ans.0000000000000585 · Cited by 8
User Experience of Symptom Checkers: A Systematic Review
You, Y., Ma, R., & Gui, X. (2022) · PubMed Central · doi:10.48550/arxiv.2208.09100 · Cited by 19
“Two papers emphasized the significance of data security 35,44 , calling for more information about how SCs encrypt 35 , anonymize 35 , and store data 44 .”
BackgroundInfluentialChatbots: An Overview of Current Issues and Challenges
Fritsch, T. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-53960-2_7 · Cited by 8
Lee, J., Oh, S. E., Schwendicke, F., Chaurasia, A., & Kim, Y. (2025) · Journal of Periodontal & Implant Science · doi:10.5051/jpis.2402220111 · Cited by 8
“In contrast, while AI-powered chatbots generated long, detailed, and professionally phrased replies, they lack inherent empathic qualities and thus cannot capture the nuanced understanding of human emotions that healthcare professionals provide [31].”
Varma, N., Cygankiewicz, I., & Turakhia, M. P. (2021) · Russian Journal of Cardiology · doi:10.15829/1560-4071-2021-4420 · Cited by 7
Rubinstein, B., & Matos, S. (2025) · Neural Processing Letters · doi:10.1007/s11063-025-11725-1 · Cited by 9
“Rather than intelligence, physicians often seek wisdom [14].”
InfluentialGkinko, L., & Elbanna, A. R. (2022) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-17968-6_7 · Cited by 7
Ahn, H. Y. (2025) · Systems · doi:10.3390/systems13100915 · Cited by 6
“Past studies predominantly centered on the integration of AI-chatbots in diverse sectors, like customer support [39,71,151] and healthcare [152–154], leaving the academic domain relatively untouched.”
Swist, T., Collin, P. J., Lewis, J., Medlow, S., Williams, I., Davies, C., & Steinbeck, K. S. (2023) · Digital Health · doi:10.1177/20552076231212286 · Cited by 6
Triangle of Trust in Cancer Care? The physician, the patient, and artificial intelligence chatbot
Turner, J. H. (2023) · Cancer Biotherapy and Radiopharmaceuticals · doi:10.1089/cbr.2023.0112 · Cited by 5
“19 Physicians can now focus on the fundamental problems of human existence that arise from the experience of illness, uncertainty, vulnerability, loss of autonomy and power, and needing recourse to trust.”
Ahmad, A., Premanandan, S., Cajander, Å., Langegård, U., Üreten, E., & Ehrsson, Y. T. (2024) · Studies in health technology and informatics · doi:10.3233/shti240522 · Cited by 5
Sonar, A., & Weber, K. (2022) · Franz Steiner Verlag eBooks · doi:10.25162/9783515129770 · Cited by 6
Kendir, M. S., & Zuhurlu, M. (2025) · Aesthetic Plastic Surgery · doi:10.1007/s00266-025-05308-7 · Cited by 4
“On the other hand, the performance of LLM systems often varies depending on their algorithmic design, the complexity of the clinical scenarios, and their ability to adopt a holistic approach to patient care [6–8].”
Oscar, M. M., Boland, M., & Cadogan, C. A. (2025) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2025.06.107 · Cited by 4
AI-Enabled Conversational Agents in Service of Mild Cognitive Impairment Patients
Kostis, I.-A., Karamitsios, K., Kotrotsios, K., Tsolaki, M., & Tsolaki, A. (2022) · International Conference on Electrical and Information Technology (IEIT) · doi:10.1109/ieit56384.2022.9967865 · Cited by 5
“…harness important information through conversation, healthcare oriented chatbots are traditionally confronted with the issue of “inhuman behavior”, i.e. not being able to imitate human reaction[16] or empathy[17] in a conversation; or, as it is commonly known, they cannot pass the Turing test[18].”
BackgroundMarquardt, M., Graf, P., Jansen, E. M., Hillmann, S., & Voigt‐Antons, J. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.41 · Cited by 3
Clinical Psychology in the Age of in the new technology : focusing on the recent studies trends
Song, H. (2019) · 한국심리학회지: 일반 · doi:10.22257/kjp.2019.12.38.4.549 · Cited by 3
‘In the Future, as Robots Become More Widespread’
Parviainen, J., & Koski, A. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192865755.013.15 · Cited by 3
Schneider, D., & Weber, K. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.08 · Cited by 6
Kumar, R., Sood, P., Nirala, R. K., Ade, R. P., & Sonaji, A. V. (2023) · Journal for Research in Applied Sciences and Biotechnology · doi:10.55544/jrasb.2.5.9 · Cited by 3
Mental Health Counseling & Therapy via Artificial Intelligence-Enabled ApproachesPreprint
Gyaneshwar, A., Punugoti, H., Chaubey, D., Raj, A., Gupta, L., Goel, M., Kulkarni, K., Adithya, A., GUPTA, M., & Chadha, U. (2024) · doi:10.36227/techrxiv.172597878.81384808/v1 · Cited by 7
Sasseville, M., Barony, R., Yameogo, A. R., Bergeron-Drolet, L.-A., Bergeron, F., & Gagnon, M. (2022) · JMIR Research Protocols · doi:10.2196/40265 · Cited by 3
Aligning Assessment Goals with the Current and Future Technologies Needed to Achieve Them
Cooper, M. M., & Klymkowsky, M. W. (2022) · Methods in physiology · doi:10.1007/978-3-030-95633-2_8 · Cited by 2
Searching for Criteria for a Thinking Machine
Аmbrozy, М. (2023) · Integrated science · doi:10.1007/978-3-031-15959-6_24 · Cited by 1
Delacruz, N. W.-T. W., & Sánchez, M. S. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-58956-0_5 · Cited by 1
Spinal Metastasis—Imaging Using XAI and RAI Techniques
Bagada, A. A., & Patel, P. V. (2025) · Wiley eBooks · doi:10.1002/9781394302444.ch5 · Cited by 1
ChatGPT and trustworthiness of artificial intelligence in medical education
Prashanth, G. P. (2025) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_334_24 · Cited by 1
“[5,6] Hence, ChatGPT integration in AETCOM sounds premature in the absence of framework‑based safeguards.”
Perception of Patient Safety and Error Reduction Through a Clinical Decision Support System (AI)
Alegre-Ortiz, V. M., Tuanama, L. C. T., & Espinoza, A. N. P. (2026) · Aquichan · doi:10.5294/aqui.2026.26.2.1 · Cited by 1
Blame the Bot: Extending Attribution Dynamics in Chatbot-Consumer-Brand Interactions
Chen, C., Hu, X., & Xu, X. (2026) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2026.2657272 · Cited by 2
Metadata
- Authors
- Powell, J.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Powell, John
- ORCID
- Powell, John
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-10-28
- Volume
- 21
- Issue
- 10
- Pages
- e16222
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6914236
- OpenAlex
- W2980109286
- Cited by
- 115
- References
- 26
- Citations by year
- 2026: 4 · 2025: 13 · 2024: 18 · 2023: 17 · 2022: 24 · 2021: 27 · 2020: 9 · 2019: 3
- FWCI
- 4.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- other-oa
- Locations
- Journal of Medical Internet Research (publishedVersion, other-oa)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- MQ: Transforming Mental Health (MQ14PE25)
- National Institute for Health and Care Research
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Keywords
- artificial intelligence in healthcare, Turing test, chatbots, physician-patient relationship, shared decision-making, clinical uncertainty, human-AI collaboration, AI ethics
- MeSH terms
- Machine Learning, Artificial Intelligence, Humans, Medical Informatics, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.