How Should Clinicians Communicate with Patients about the Roles of Artificially Intelligent Team Members?
Open accessAbstract
This commentary responds to a hypothetical case involving an assistive artificial intelligence (AI) surgical device and focuses on potential harms emerging from interactions between humans and AI systems. Informed consent and responsibility-specifically, how responsibility should be distributed among professionals, technology companies, and other stakeholders-for uses of AI in health care are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Robust data management practices include continuous monitoring for anomalies to uphold the integrity of health data.
“These practices include continuous monitoring for anomalies to uphold the integrity of health data.”
From Balancing Privacy and Progress: A Review of Privacy Challenges, Systemic Oversight, and Patient Perceptions in AI-Driven Healthcare (2024) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652 · see citing works
Implementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857 · see citing works
Assessment of Patients' Competence to Consent to Treatment
Appelbaum, P. S. (2007) · New England Journal of Medicine · doi:10.1056/nejmcp074045 · Cited by 1,427 · see citing works
Unintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066 · see citing works
Future Progress in Artificial Intelligence: A Survey of Expert Opinion
Müller, V. C., & Bostrom, N. (2016) · Synthese Library · doi:10.1007/978-3-319-26485-1_33 · Cited by 655 · see citing works
Moral Responsibility of Public Officials: The Problem of Many Hands
Thompson, D. F. (1980) · American Political Science Review · doi:10.2307/1954312 · Cited by 651 · see citing works
Engineering Ethics: Concepts and Cases
Harris, C. E., Pritchard, M. S., & Rabins, M. J. (1994) · Cited by 540 · see citing works
Current applications of robotics in spine surgery: a systematic review of the literature
Joseph, J. R., Smith, B. W., Liu, X., & Park, P. (2017) · Neurosurgical FOCUS · doi:10.3171/2017.2.focus16544 · Cited by 211 · see citing works
Patient safety and the problem of many hands
Dixon‐Woods, M., & Pronovost, P. J. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2016-005232 · Cited by 129 · see citing works
Flagged first, then by citations
1 of the 10 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Garrity M. Who is Mazor Robotics' biggest competitor in the spine market? Becker's Spine Review. November 27, 2017. https://www.beckersspine.com/orthopedic-a-spine-device-a-implant- news/item/39026-who-is-mazor-robotics-biggest-competitor-in-the-spine- market.html. Accessed June 6, 2018.
- Castelvecchi D. Can we open the black box of AI? Nature. 2016;538(7623):20-23.
Cited by
Sorted by citations
A governance model for the application of AI in health care
Reddy, S., Allan, S., Coghlan, S., & Cooper, P. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz192 · Cited by 979 · see citing works
Williamson, S. M., & Prybutok, V. (2024) · Applied Sciences · doi:10.3390/app14020675 · Cited by 567 · see citing works
Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives
Esmaeilzadeh, P. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01191-1 · Cited by 507 · see citing works
Laï, M.-C., Brian, M., & Mamzer, M.-F. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-019-02204-y · Cited by 294 · see citing works
Defining the undefinable: the black box problem in healthcare artificial intelligence
Wadden, J. J. (2022) · Journal of Medical Ethics · doi:10.1136/medethics-2021-107529 · Cited by 224 · see citing works
Artificial Intelligence and Ethics in Dentistry: A Scoping Review
Mörch, C., Atsü, S., Cai, W., Li, X., Madathil, S. A., Liu, X., Mai, V., Tamimi, F., Dilhac, M.-A., & Ducret, M. (2021) · Journal of Dental Research · doi:10.1177/00220345211013808 · Cited by 178 · see citing works
Rajesh, A. E., Davidson, O. Q., Lee, C. S., & Lee, A. (2023) · Diabetes Care · doi:10.2337/dci23-0032 · Cited by 166 · see citing works
Ethics of Artificial Intelligence in Medicine and Ophthalmology
Abdullah, Y. I., Schuman, J. S., Shabsigh, R., Caplan, A. L., & Al‐Aswad, L. A. (2021) · Asia-Pacific Journal of Ophthalmology · doi:10.1097/apo.0000000000000397 · Cited by 159 · see citing works
Aggarwal, R., Farag, S., Martin, G., Ashrafian, H., & Darzi, A. W. (2021) · Journal of Medical Internet Research · doi:10.2196/26162 · Cited by 135 · see citing works
Arnold, M. H. (2021) · Journal of Bioethical Inquiry · doi:10.1007/s11673-020-10080-1 · Cited by 105 · see citing works
What Should ChatGPT Mean for Bioethics?
Cohen, I. G. (2023) · The American Journal of Bioethics · doi:10.1080/15265161.2023.2233357 · Cited by 95 · see citing works
Ng, J. Y., Cramer, H., Lee, M. S., & Moher, D. (2024) · Integrative Medicine Research · doi:10.1016/j.imr.2024.101024 · Cited by 109 · see citing works
Patient perspectives on informed consent for medical AI: A web-based experiment
Park, H. J. (2024) · DIGITAL HEALTH · doi:10.1177/20552076241247938 · Cited by 95 · see citing works
Choudhury, A., & Asan, O. (2022) · Human Factors in Healthcare · doi:10.1016/j.hfh.2022.100021 · Cited by 93 · see citing works
Astromskė, K., Peičius, E., & Astromskis, P. (2020) · AI & Society · doi:10.1007/s00146-020-01008-9 · Cited by 89 · see citing works
The Ethics of Artificial Intelligence in Pathology and Laboratory Medicine: Principles and Practice
Jackson, B. R., Ye, Y., Crawford, J. M., Becich, M. J., Roy, S., Botkin, J. R., de Baca, M. E., & Pantanowitz, L. (2021) · Academic Pathology · doi:10.1177/2374289521990784 · Cited by 83 · see citing works
Machine Learning in Oncology: What Should Clinicians Know?
Nagy, M. R., Radakovich, N., & Nazha, A. (2020) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00049 · Cited by 73 · see citing works
The Evolving Regulatory Paradigm of AI in MedTech: A Review of Perspectives and Where We Are Today
Zhou, K., & Gattinger, G. (2024) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-024-00628-3 · Cited by 75 · see citing works
AI and professional liability assessment in healthcare. a revolution in legal medicine?
Terranova, C., Cestonaro, C., Fava, L., & Cinquetti, A. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2023.1337335 · Cited by 73 · see citing works
Hill, E. R., Mitchell, C., Brigden, T., & Hall, A. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1139210 · Cited by 56 · see citing works
Rose, S. L., & Shapiro, D. (2024) · CHEST Journal · doi:10.1016/j.chest.2024.04.014 · Cited by 47 · see citing works
AI-Enhanced Healthcare: Not a new Paradigm for Informed Consent
Pruski, M. (2024) · Journal of Bioethical Inquiry · doi:10.1007/s11673-023-10320-0 · Cited by 43 · see citing works
Canales, C., Lee, C., & Cannesson, M. P. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004728 · Cited by 41 · see citing works
Hindocha, S., & Badea, C. (2021) · AI and Ethics · doi:10.1007/s43681-021-00089-6 · Cited by 40 · see citing works
EU Regulation of Artificial Intelligence: Challenges for Patients’ Rights
van Kolfschooten, H. (2022) · Common Market Law Review · doi:10.2139/ssrn.3997366 · Cited by 39 · see citing works
Ethical issues in computational pathology
Sorell, T., Rajpoot, N., & Verrill, C. L. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2020-107024 · Cited by 34 · see citing works
Protecting patient safety and privacy in the era of artificial intelligence
Alonso, A. G., & Siracuse, J. J. (2023) · Seminars in Vascular Surgery · doi:10.1053/j.semvascsurg.2023.06.002 · Cited by 34 · see citing works
Ursin, F., Timmermann, C., Orzechowski, M., & Steger, F. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.695217 · Cited by 32 · see citing works
Deep learning in optical coherence tomography: Where are the gaps?
Li, D., Ran, A. R., Cheung, C. Y.-L., & Prince, J. L. (2023) · Clinical and Experimental Ophthalmology · doi:10.1111/ceo.14258 · Cited by 31 · see citing works
Clinical applications of AI in MSK imaging: a liability perspective
Harvey, H. B., & Gowda, V. (2022) · Skeletal Radiology · doi:10.1007/s00256-021-03782-z · Cited by 28 · see citing works
Gould, D. J., Dowsey, M. M., Glanville-Hearst, M., Spelman, T. D., Bailey, J., Choong, P., & Bunzli, S. (2023) · Journal of Medical Internet Research · doi:10.2196/43632 · Cited by 27 · see citing works
Against explainability requirements for ethical artificial intelligence in health care
Kawamleh, S. (2022) · AI and Ethics · doi:10.1007/s43681-022-00212-1 · Cited by 27 · see citing works
Ethical forethoughts on the use of artificial intelligence in medicine
Elhassan, B. T., & Arabi, A. A. (2024) · International Journal of Ethics and Systems · doi:10.1108/ijoes-08-2023-0190 · Cited by 24 · see citing works
Dagli, M. M., Rajesh, A., Asaad, M., & Butler, C. E. (2021) · The American Surgeon · doi:10.1177/00031348211065101 · Cited by 22 · see citing works
Artificial Intelligence: Singularity Approaches
TerKonda, S. P., TerKonda, A. A., Sacks, J. M., Kinney, B. M., Gurtner, G. C., Nachbar, J. M., Reddy, S., & Jeffers, L. L. C. (2023) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000010572 · Cited by 24 · see citing works
Mohammadnabi, S., Moslemy, N., Taghvaei, H., Zia, A. W., Askarinejad, S., & Shalchy, F. (2025) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2025.106949 · Cited by 20 · see citing works
“Does Black Box AI In Medicine Compromise Informed Consent?”
Director, S. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00860-1 · Cited by 21 · see citing works
Patient Perspectives on the Use of Artificial Intelligence
Kovarik, C. (2020) · JAMA Dermatology · doi:10.1001/jamadermatol.2019.5013 · Cited by 19 · see citing works
Artificial intelligence in human reproduction: charting the ethical debate over AI in IVF
Tamir, S. (2022) · AI and Ethics · doi:10.1007/s43681-022-00216-x · Cited by 18 · see citing works
Dentistry in the Era of Artificial Intelligence: Medical Behavior and Clinical Responsibility
Sciarra, F. M., Caivano, G., Cacioppo, A., Messina, P., Cumbo, E. M. G., Vita, E. D., & Scardina, G. A. (2025) · Prosthesis · doi:10.3390/prosthesis7040095 · Cited by 19 · see citing works
Winter, P., & Carusi, A. (2022) · Journal of Responsible Technology · doi:10.1016/j.jrt.2022.100052 · Cited by 17 · see citing works
Potential Benefits of Artificial Intelligence in Healthcare
Hoppe, N., Härting, R.-C., & Rahmel, A. (2022) · Intelligent systems reference library · doi:10.1007/978-3-031-11170-9_9 · Cited by 16 · see citing works
Artificial Intelligence in Pediatric Nephrology—A Call for Action
Filler, G., Gipson, D. S., Iyamuremye, D., & Ferris, M. (2022) · Advances in Kidney Disease and Health · doi:10.1053/j.akdh.2022.11.001 · Cited by 13 · see citing works
AI in Medical Questionnaires: Scoping Review
Luo, X., Li, Y. L., Xu, J., Zheng, Z., Ying, F., & Huang, G. (2025) · Journal of Medical Internet Research · doi:10.2196/72398 · Cited by 14 · see citing works
Chang, J., & Hatfield, B. S. (2024) · Advances in cancer research · doi:10.1016/bs.acr.2024.05.006 · Cited by 11 · see citing works
Wadden, J. J. (2021) · Canadian Journal of Bioethics · doi:10.7202/1077636ar · Cited by 11 · see citing works
Ethical responsibility and computational design: bespoke surgical tools as an instructive case study
Douglas, D., Lacey, J., & Howard, D. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09641-2 · Cited by 11 · see citing works
Hatherley, J. J. (2024) · Journal of Medical Ethics · doi:10.1136/jme-2024-109905 · Cited by 10 · see citing works
Risk and liability in the deployment of AI systems for surgery: a SAGES white paper
Hashimoto, D. A., Marwaha, J. S., Lee, S. A., Schwaitzberg, S. D., & Duffourc, M. (2026) · Surgical Endoscopy · doi:10.1007/s00464-026-12881-8 · Cited by 8 · see citing works
The value of AI in the Diagnosis, Treatment, and Prognosis of Malignant Lung Cancer
Wang, Y., Cai, H., Pu, Y., Li, J., Yang, F., Yang, C., Chen, L., & Hu, Z. (2022) · Frontiers in Radiology · doi:10.3389/fradi.2022.810731 · Cited by 9 · see citing works
Machine learning, healthcare resource allocation, and patient consent
Webb, J. (2024) · The New Bioethics · doi:10.1080/20502877.2024.2416858 · Cited by 7 · see citing works
Hassan, A. M., Coert, J. H., Clemens, M. W., Hassanein, A. H., Waljee, J. F., Nelson, J. A., Mehrara, B. J., & Selber, J. C. (2026) · Journal of the American College of Surgeons · doi:10.1097/xcs.0000000000001834 · Cited by 8 · see citing works
Informed Consent for the Use of AI in the Process of Providing Medical Services
Wałdoch, K. (2024) · Review of European and Comparative Law · doi:10.31743/recl.17239 · Cited by 7 · see citing works
Aldossari, M. (2023) · Asian Journal of Science and Applied Technology · doi:10.51983/ajsat-2023.12.2.3973 · Cited by 6 · see citing works
Glaucoma Screening: Is AI the Answer?
Bhartiya, S. (2022) · JOURNAL OF CURRENT GLAUCOMA PRACTICE · doi:10.5005/jp-journals-10078-1380 · Cited by 6 · see citing works
Becker, J., Gerke, S., & Cohen, I. G. (2023) · Collaborative bioethics · doi:10.1007/978-3-031-29451-8_24 · Cited by 6 · see citing works
Ciesla, R. (2024) · Springer eBooks · doi:10.1007/978-3-031-51004-5_5 · Cited by 6 · see citing works
Ethical insights into AI-driven caries detection: a scoping review
Yousuf, T., Khan, M., & Ghafoor, R. (2025) · BDJ Open · doi:10.1038/s41405-025-00366-0 · Cited by 5 · see citing works
Akinpelu, D. A., & Akintola, S. (2023) · Journal of intellectual property and information technology law · doi:10.52907/jipit.v3i1.261 · Cited by 7 · see citing works
Enhancing Explainable AI Land Valuations Reporting for Consistency, Objectivity, and Transparency
Yiu, C. Y., & Cheung, K. S. (2025) · Land · doi:10.3390/land14050927 · Cited by 3 · see citing works
National Security: Theories, Actors, Issues
Clarke, M., Henschke, A., Legrand, T., & Sussex, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-53494-3_1 · Cited by 3 · see citing works
Ensuring Halal Compliance in AI-Driven Healthcare Solutions
Rahman, M. M. (2023) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-1082-3.ch015 · Cited by 3 · see citing works
Kara, M. A. (2024) · Medicine Health Care and Philosophy · doi:10.1007/s11019-024-10241-8 · Cited by 3 · see citing works
Chourasia, P. K., Coffel, M., Conklin, J., Wood, W. A., & Khairat, S. (2025) · Journal of Patient Experience · doi:10.1177/23743735251380949 · Cited by 2 · see citing works
Joshi, A., Shubham, S., Ahmed, S. M., Mishra, D., Joshi, R., Puri, N., & Gupta, G. (2025) · Cureus · doi:10.7759/cureus.94374 · Cited by 2 · see citing works
Informed consent and ethical considerations in AI for dentistry and medicine: a scoping review
Allende, A. B., Ehsani, S., Eber, P., Ullah, A. I., Kosan, E., Saif, N., Alimohammadi, M., Onyeloili, M., Kientega, F. D., Galrao, T., et al. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106576 · Cited by 2 · see citing works
Naming and Diffusing the Understanding Objection in Healthcare Artificial Intelligence
Wadden, J. J. (2024) · Canadian Journal of Bioethics · doi:10.7202/1114958ar · Cited by 2 · see citing works
Adapting Clinical Ethics Consultations to Address Ethical Issues of Artificial Intelligence
Collins, B. X., Bhatia, S., & Fanning, J. B. (2025) · The Journal of Clinical Ethics · doi:10.1086/734773 · Cited by 2 · see citing works
Rainey, S., Erden, Y. J., & Rességuier, A. (2022) · Springer eBooks · doi:10.1007/978-3-030-64573-1_243 · Cited by 2 · see citing works
Ethical Insights into AI-Driven Caries Detection: A Scoping Review (Preprint)
Yousuf, T., Khan, M., & Ghafoor, R. (2024) · Journal of Medical Internet Research · doi:10.2196/69486 · Cited by 1 · see citing works
Rainey, S., Erden, Y. J., & Rességuier, A. (2021) · Springer eBooks · doi:10.1007/978-3-030-58080-3_243-1 · Cited by 1 · see citing works
Eerste stappen in Europese regulering van artificiële intelligentie: algoritmes en patiëntenrechten
van Kolfschooten, H. (2021) · Tijdschrift voor Gezondheidsrecht · doi:10.5553/tvgr/016508742021045004008
Srinivasan, E. S., & Than, K. D. (2022) · Neurosurgery · doi:10.1227/neu.0000000000001901
Community-Based Consent Model, Patient Rights, and AI Explainability in Medicine
Bao, A., & Zeng, Y. (2025) · The American Journal of Bioethics · doi:10.1080/15265161.2025.2457701
Bias, Machine Learning and Liability—Can EU Policy Improve the Development of AI Systems?
Zorkóczy, M. (2025) · Data science, machine intelligence, and law · doi:10.1007/978-3-031-86813-9_15
Ethical Hazards of Large Language Models in Primary Care: A Clinician-Focused Update
Lu, M. M., Gillette, J. J., & Heston, T. F. (2025) · IntechOpen eBooks · doi:10.5772/intechopen.1012864
Bitzanakis, N., & Vrahatis, A. G. (2026) · Advances in experimental medicine and biology · doi:10.1007/978-3-032-03402-1_30
Decision Ownership and Deference to Healthcare AI
Slome, E. (2026) · Journal of Bioethical Inquiry · doi:10.1007/s11673-025-10518-4
Prós e contras da inteligência artificial na decisão clínica
Diniz, G. L. S., Lourenço, S. S., Lima, G. D. O. M. F., & Leal, M. C. B. D. M. (2026) · Revista Bioética · doi:10.1590/1983-803420263957pt
Pros and cons of artificial intelligence in clinical decision-making
Diniz, G. L. S., Lourenço, S. S., Lima, G. D. O. M. F., & Leal, M. C. B. D. M. (2026) · Revista Bioética · doi:10.1590/1983-803420263957en
Pros y contras de la inteligencia artificial en la decisión clínica
Diniz, G. L. S., Lourenço, S. S., Lima, G. D. O. M. F., & Leal, M. C. B. D. M. (2026) · Revista Bioética · doi:10.1590/1983-803420263957es
Who writes the note: The training data behind artificial intelligence scribes in dermatology
Parikh, A. K., & Lipner, S. R. (2026) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2026.07.012
General Data Protection Principles and Its Implementation in a Tech-Environment
Gupta, I. (2026) · Springer eBooks · doi:10.1007/978-981-99-7371-2_2
The legal and ethical dimensions of artificial intelligence in managing medical records in Oman
Mkadmi, A., Hamad, F. F., & Saleem, N. B. B. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01884-y
Ong, M., Schanberg, L. E., Kohlheim, M., Leal, J., Luo, A., Natter, M. D., & Kimura, Y. (2026) · ACR Open Rheumatology · doi:10.1002/acr2.90105
- Authors
- Schiff, D. S., & Borenstein, J.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- AMA Journal of Ethics
- Publisher
- American Medical Association (AMA)
- Published
- 2019-02-01
- Volume
- 21
- Issue
- 2
- Pages
- E138-145
- ISSN
- 1937-7010 (ISSN-L)
- 2376-6980
- OpenAlex
- W2913777302
- Cited by
- 89
- References
- 10
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 16 · 2023: 12 · 2022: 14 · 2021: 16 · 2020: 6 · 2019: 1
- FWCI
- 2.99
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- The AMA Journal of Ethic (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics and bioethics in healthcare
- Keywords
- artificial intelligence in healthcare, human-AI interaction, patient communication, informed consent, clinical responsibility, AI harms, professional liability
- MeSH terms
- Artificial Intelligence, Attitude to Computers, Communication, Decision Making, Computer-Assisted, Diagnosis, Computer-Assisted, Health Personnel, Humans, Intervertebral Disc Displacement, Male, Middle Aged, Patient Education as Topic, Patients, United States, Robotic Surgical Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
