The DOI matches its Crossref record; 57 of the 58 references it cites were found in a registry or an index.
Legal, regulatory, and ethical frameworks for development of standards in artificial intelligence (AI) and autonomous robotic surgery
Abstract
Background: This paper aims to move the debate forward regarding the potential for artificial intelligence (AI) and autonomous robotic surgery with a particular focus on ethics, regulation and legal aspects (such as civil law, international law, tort law, liability, medical malpractice, privacy and product/device legislation, among other aspects). Methods: We conducted an intensive literature search on current or emerging AI and autonomous technologies (eg, vehicles), military and medical technologies (eg, surgical robots), relevant frameworks and standards, cyber security/safety‐ and legal‐systems worldwide. We provide a discussion on unique challenges for robotic surgery faced by proposals made for AI more generally (eg, Explainable AI) and machine learning more specifically (eg, black box), as well as recommendations for developing and improving relevant frameworks or standards. Conclusion: We classify responsibility into the following: (1) Accountability; (2) Liability; and (3) Culpability. All three aspects were addressed when discussing responsibility for AI and autonomous surgical robots, be these civil or military patients (however, these aspects may require revision in cases where robots become citizens). The component which produces the least clarity is Culpability, since it is unthinkable in the current state of technology. We envision that in the near future a surgical robot can learn and perform routine operative tasks that can then be supervised by a human surgeon. This represents a surgical parallel to autonomously driven vehicles. Here a human remains in the ‘driving seat’ as a ‘doctor‐in‐the‐loop’ thereby safeguarding patients undergoing operations that are supported by surgical machines with autonomous capabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“many AIs are forms of intelligence expressed by some artifact (Bryson & Theodorou, 2019) that interacts with humans at various levels, such as robots and self-driving cars (Manoharan, 2019; O’Sullivan et al., 2019).”
From Ethical principles for artificial intelligence in education (2023) · cites this paper as O’Sullivan et al., 2019
In the citing paper
“The safety issues of medical AI are the risks and harms that occur in its practices, such as program errors, being affected by cybersecurity, the need for adequate testing, difficult software certification, etc., covering various legal and ethical issues”
From Ethics and governance of trustworthy medical artificial intelligence (2023) · cites this paper as [47]
In the citing paper
“The rapid evolution of AI technologies has outpaced the formulation of comprehensive ethical guidelines, raising concerns about the potential misuse and unintended consequences of these powerful tools [32], [33].”
From Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond (2024) · cites this paper as [32]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Medical error—the third leading cause of death in the US
Makary, M. A., & Daniel, M. (2016) · BMJ · doi:10.1136/bmj.i2139 · Cited by 3,264
Lanfranco, A. R., Castellanos, A. E., Desai, J. P., & Meyers, W. C. (2003) · Annals of Surgery · doi:10.1097/01.sla.0000103020.19595.7d · Cited by 1,309
Large Scale Multiple Kernel Learning
Sonnenburg, S., Rätsch, G., Schäfer, C., & Schölkopf, B. (2006) · MPG.PuRe (Max Planck Society) · doi:10.5555/1248547.1248604 · Cited by 1,201
The responsibility gap: Ascribing responsibility for the actions of learning automata
Matthias, A. (2004) · Ethics and Information Technology · doi:10.1007/s10676-004-3422-1 · Cited by 1,101 · cited 2×
“ForMatthias(2004), 42 the traditional rules of liability law would then be unsuitable for unpredictable machines because the human would no longer really have control of the actions of the robot.”
BackgroundInteractive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906
Self-citationYe, Q.-H., Qin, L., Forgues, M., He, P., Kim, J.-W., Peng, A. C., Simon, R., Li, Y., Robles, A. I., Chen, Y., et al. (2003) · Nature Medicine · doi:10.1038/nm843 · Cited by 849
Robot ethics: the ethical and social implications of robotics
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0844 · Cited by 790
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711 · cited 1×
“Such decisions could be informed by what Wallach and Allen (2009) 55 call “ top ‐ down, ” ie, theory ‐ driven, approaches to ethical decision making, or they could be shaped by “ bottom ‐ up, ” or data ‐ driven processes that have been trained to emulate human decision makers.”
BackgroundSelf-citation
Flagged first, then by citations
1 of the 58 references couldn’t be matched to a known paper.
Research works printed but not linked: 13
- Garcia P, 2009, Trauma Pod: a semi‐automated telerobotics surgical system, Int J Med Robot, 5
- BonaciT YanJ HerronJ et al. "Experimental analysis of cyber security attacks on teleoperated surgical robotics".in preparation to the ACM Transaction on Cyber‐Physical Systems2017.
- Holzinger K, 2018, Can we trust machine learning results?, Artificial Intelligence in Safety Critical News, 112, 42
- Decker M, 2014, Rethinking Responsibility in Science and Technology, Pisa, 65
- World Commission on the Ethics of Scientific Knowledge and Technology, 2017, Report of COMEST on robotics ethics
- Palmerini E, 2014, D6.2 Guidelines on Regulating Robotics
- MichaelK BowmanD JonesML et al.Special issue on social implications of robotics and AI. IEEE Technology and Societyy Magazine.2018.
- Veruggio G, 2005, ICRA, 1
- Nevejans N, 2017, Traité de droit et d'éthique de la robotique civile (Treatise of Law and Ethics of Civil Robotics), LEH Edition (in French), 646
- Graaf MMA, 2017, How People Explain Action (and AIS should too)
- Sharif E, 2014, Medical liability in humanitarian missions, The Journal of Humanitarian Assistance
- International Federation of Red Cross and Red Crescent Societies, 2011, The Legal Framework for Volunteering in Emergencies
- Pugliano J, 2017, The Robots are Coming: A Human's Survival Guide to Profiting in the Age of Automation
Cited by
Sorted by citations
Items 401–435 of 435
Against AI ethics: challenging the conventional narratives
Afroogh, S., Pouresmaeil, Y., & Dhurandhar, A. (2026) · AI and Ethics · doi:10.1007/s43681-025-00978-0
Jones, N. J., & Bramstedt, K. A. (2026) · Journal of Ethics and Emerging Technologies · doi:10.55613/jeet.v36i1.207
Agrawal, A., Akshara, & Agrawal, V. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-2680-2_49 · Cited by 1
When the action is “hybrid”–ethical challenges of the emerging technologies in the operating room
Valera, L., Irarrázaval, M. J., & Gabrielli, M. E. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-06455-7
Ethical Design in Medical AI Robotics: Between Innovation and Responsibility
Nechita, R.-M., & Nechita, M.-I. (2025) · Robotica & Management · doi:10.24193/rm.2025.2.5
Emerging Technologies in Surgery
Bandy, V. L., Habermann, A. C., Punjala, A., & McGuire, K. P. (2026) · Springer eBooks · doi:10.1007/978-3-032-10971-2_17
Marwala, T. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-36322-1.00009-2
Green by Design AI in Fashion Retail and the Rise of the Conscious Consumer
Malhi, A. S., Yadav, P. S., Bisht, D., Sharma, A. P. G. K., Sharma, A., & Rashmi, B. H. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5525-2.ch001
Nidhilangelo, M. M., Ghosh, B., & Kumavath, R. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-44121-9.00004-4
Refinetti, M. (2022) · theses.fr (ABES) · doi:10.70675/ef3df09az461fz4ec8z9e8czf805c34ed92f
Robotic Systems in Precision Drug Delivery and Surgical Automation
Walia, J. K., Kaura, K., Rani, S., & Kaur, G. (2026) · Studies in big data · doi:10.1007/978-3-032-18871-7_9
Agha, F. G., Al-Taai, N., & Ibrahim, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01306-z
YAPAY ZEKALI ROBOTLARDA ETİK: AVRUPA BİRLİĞİ’NDE GÜNCEL DURUM DEĞERLENDİRMESİ
Bulut, I. ̇. K. (2026) · Çukurova Üniversitesi Sosyal Bilimler Enstitüsü Dergisi · doi:10.35379/cusosbil.1687584
Optimizing arthroplasty outcomes: the impact of artificial intelligence and robotic assistance
Baghbani, S., Mehrabi, Y., Boroumandfar, F., Salimi, A., Nejad, E. B., Joshaghanian, M. A., Amiri, S., Movahedinia, M., & Shahrezaee, M. (2026) · Annals of Medicine and Surgery · doi:10.1097/ms9.0000000000004816
Hanbing, L. (2026) · International Conference on Intelligent Computing (ICONIC) · doi:10.1109/iconic67661.2026.11517695
Zwischen klinischer Realität und Zukunftsmusik
Pichler, L., Straub, J., Simon, S., & Watrinet, J. M. (2026) · Arthroskopie · doi:10.1007/s00142-026-00850-1
Artificial Intelligence and Robotics in General Surgery: Opportunities and Challenges
Seifi, S., Sahrai, H., Dehnavi, N. S., Amiri, F., Dashti, S. M. A., Noruzi, A., Taheri, N., Mosaddeghi-Heris, R., & Seifi, A. (2026) · Cureus · doi:10.7759/cureus.109378
Zaman, K. (2026) · Innovation journal of social sciences and economic review. · doi:10.36923/ijsser.v8i2.369
Mensah, I. K., & Khan, M. K. (2026) · Administration & Society · doi:10.1177/00953997261459994
Sharma, A. (2026) · European Journal of Plastic Surgery · doi:10.1007/s00238-026-02506-7
A survey on explainable reinforcement learning: state of the art, challenges and opportunities
Melloni, D., & Zingoni, A. (2026) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-026-01246-3
Khan, A., Bhat, S. A., Wolff, A., & Islam, A. K. M. N. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115824
Marzec, J., Kopacki, F., Jaskot, D., Szczeblewska, W., Swiech, J., Kamrowska, M., Apanasewicz, K., Kita, N., Sztenc, N., & Broniszewska, P. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.2(50).2026.5510
Lteif, D., & Mohlaroy, G. (2026) · INTERNATIONAL JOURNAL OF HEALTH SYSTEMS AND MEDICAL SCIENCES · doi:10.51699/ijhsms.v5i3.1580
Applications of Reinforcement Learning for Autonomous Surgical Robotics: A Systematic Review
Shahid, M., Abdullah, A., Fatima, Z., Feroze, W., Torres-Ruiz, M. J., Saldaña-Pérez, M., Sanchéz-Mejorada, C. G., & Quintero, R. (2026) · Biomimetics · doi:10.3390/biomimetics11080577 · Cited by 1
Maitah, M. A. (2026) · Journal of Lifestyle and SDGs Review · doi:10.47172/2965-730x.sdgsreview.v6.n07.pe08275
Hu, Z., Yang, L., Bai, H., Guo, L., & Yin, L. (2026) · Journal of Robotic Surgery · doi:10.1007/s11701-026-03780-0
Chapala, S., Gibson, J. G., Chinniah, P. K., Chandrashekhara, S. H., Kiyawat, V., Parmar, Y., & Botchu, R. (2026) · Journal of Ultrasound in Medicine · doi:10.1002/jum.70417
Fareed, M. M., & Shityakov, S. (2026) · Quantum Machine Intelligence · doi:10.1007/s42484-026-00435-z
AI in orthopedics: Saudi surgeons’ familiarity and perspectives
Bukhary, H. A., Alkhalaf, R., Alfuhigi, Y. M., Alghamdi, R. A., Alhomayani, K. M., Qadi, S. G., Altowairqi, A. D. M., Alyahiwi, L. S., & Alanazi, G. B. (2026) · The Annals of Clinical and Analytical Medicine · doi:10.4328/acam.22891
Santoyo, J., Figueroa, C. V., Nabizada, H., Argüello-Lacayo, L., Arias, G., & Abdelgawad, M. M. (2026) · Journal of Dental Health and Oral Research · doi:10.46889/jdhor.2026.7302
Artificial Intelligence and the Transformation of Academic Knowledge Production and Access
Mamabolo, M. J., & Durodolu, O. O. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-4780-4.ch013
Jiang, C., Bortnovskii, B., Gul, I., Özkan, M., Zhang, L., Yu, D., Pandey, V., Wang, R., Wu, J., & Qin, P. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1966224
Consumer Medical Robots for Personalized, Connected, and Collaborative Care
Sathyanarayana, N., Fathima, Y., Prabhu, U., Muralidhar, L. B., & Nirmala, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1483-7.ch017
Metadata
- Authors
- O'Sullivan, S., Nevejans, N., Allen, C., Blyth, A., Leonard, S., Pagallo, U., Holzinger, K., Holzinger, A., Sajid, M. I., & Ashrafian, H.
- Affiliations
- Department of Pathology, Faculdade de Medicina Universidade de São Paulo São Paulo Brazil
- Université d'Artois (FR)
- University of Pittsburgh (US)
- University of South Wales (GB)
- Department of Computer Science Johns Hopkins University Baltimore Maryland
- University of Turin (IT)
- SBA Research (AT)
- Medical University of Graz (AT)
- Wirral University Teaching Hospital NHS Foundation Trust (GB)
- Imperial College London (GB)
- ORCID
- Venue
- The International Journal of Medical Robotics and Computer Assisted Surgery
- Publisher
- Wiley
- Published
- 2019-01-09
- Volume
- 15
- Issue
- 1
- Pages
- e1968-e1968
- ISSN
- 1478-5951 (ISSN-L)
- 1478-596X
- OpenAlex
- W2899881299
- Cited by
- 437
- References
- 58
- Citations by year
- 2026: 46 · 2025: 71 · 2024: 93 · 2023: 72 · 2022: 60 · 2021: 59 · 2020: 28 · 2019: 8
- FWCI
- 45.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Medical Robotics and Computer Assisted Surgery (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion)
- Institutional Research Information System University of Turin (University of Turin) (submittedVersion)
- Funders
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Topics
- Social Sciences › Law › Digitalization, Law, and Regulation
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- artificial intelligence, autonomous robotic surgery, surgical robots, AI standards, legal framework, regulatory framework, AI ethics, liability, accountability, culpability, explainable AI, black box problem, medical malpractice, tort law, privacy, artificial intelligence in warfare, autonomous vehicles
- MeSH terms
- Algorithms, Artificial Intelligence, Ethics, Medical, Europe, Humans, United States, Computer Security, Medical Errors, Robotic Surgical Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review