Can robots be responsible moral agents? And why should we care?
Open accessAbstract
This principle highlights the need for humans to accept responsibility for robot behaviour and in that it is commendable. However, it raises further questions about legal and moral responsibility. The issues considered here are (i) the reasons for assuming that humans and not robots are responsible agents, (ii) whether it is sufficient to design robots to comply with existing laws and human rights and (iii) the implications, for robot deployment, of the assumption that robots are not morally responsible.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Robot speech may lead users to attribute robots with intelligence, social agency, moral agency, and a uniquely potent combination of these factors.
“Because robot speech may lead users to attribute robots with intelligence [6, 14], social agency [28], moral agency [16, 52, 57], and the uniquely potent combination of these factors [27]”
From Robots for Social Justice (R4SJ): Toward a More Equitable Practice of Human-Robot Interaction (2024) · cites this paper as [57]
Section 1.2.1 says robots can be given the appearance of competent social actors, and the Summary warns that robots can create an illusion of understanding. These passages support the possibility of users overestimating robots’ social competence, but they do not say that robot speech leads users to attribute moral agency to them. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Autopoiesis and Cognition: The Realization of the Living
Maturana, H. R., & Varela, F. J. (1980) · Boston Studies in the Philosophy and History of Science · doi:10.1007/978-94-009-8947-4 · Cited by 5,815 · see citing works
Autopoiesis and Cognition: The Realization of the Living
Maturana, H. R., Varela, F. J., & Beer, S. (1980) · Cited by 4,667 · see citing works
Brosnan, S. F., & de Waal, F. Β. Μ. (2003) · Nature · doi:10.1038/nature01963 · Cited by 1,584 · see citing works
Granny and the robots: ethical issues in robot care for the elderly
Sharkey, A., & Sharkey, N. (2012) · Ethics and Information Technology · doi:10.1007/s10676-010-9234-6 · Cited by 985 · see citing works
Self-citationMoral machines: teaching robots right from wrong
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4493 · Cited by 793 · see citing works
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711 · cited 2× · see citing works
“This view is not universally held: some (e.g. Asaro, 2006; Wallach and Allen, 2009) have argued that moral agency”
BackgroundIn the hands of machines? The future of aged care
Sparrow, R., & Sparrow, L. (2006) · Minds and Machines · doi:10.1007/s11023-006-9030-6 · Cited by 649 · see citing works
Braintrust: What Neuroscience Tells Us about Morality
Churchland, P. S. (2011) · doi:10.1515/9781400838080 · Cited by 325 · see citing works
Wild justice: the moral lives of animals
(2009) · Choice Reviews Online · doi:10.5860/choice.47-1420 · Cited by 321 · see citing works
Bekoff, M., & Pierce, J. (2009) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226041667.001.0001 · Cited by 320 · see citing works
Braintrust: What Neuroscience Tells Us About Morality
Churchland, P. S. (2012) · Project Muse (Johns Hopkins University) · doi:10.14288/1.0076660 · Cited by 282 · see citing works
Computer systems: Moral entities but not moral agents
Johnson, D. G. (2006) · Ethics and Information Technology · doi:10.1007/s10676-006-9111-5 · Cited by 278 · see citing works
The crying shame of robot nannies: An ethical appraisal
Sharkey, N., & Sharkey, A. (2010) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.11.2.01sha · Cited by 223 · see citing works
Self-citationWhen Is a Robot a Moral Agent?
lll, J. P. S. (2006) · The International Review of Information Ethics · doi:10.29173/irie136 · Cited by 186 · see citing works
What Should We Want From a Robot Ethic?
Asaro, P. (2006) · The International Review of Information Ethics · doi:10.29173/irie134 · Cited by 167 · see citing works
When Is a Robot a Moral Agent?
Sullins, J. P. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511978036.013 · Cited by 152 · see citing works
The crying shame of robot nannies: An ethical appraisal
SHARKEY, N. E., & SHARKEY, A. J. C. (2010) · PhilPapers (PhilPapers Foundation) · Cited by 146 · see citing works
Self-citationTowards an Ethical Robot: Internal Models, Consequences and Ethical Action Selection
Winfield, A. F. T., Blum, C., & Liu, W. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10401-0_8 · Cited by 117 · see citing works
Computer systems: Moral entities but not moral agents
Johnson, D. G. (2020) · Routledge eBooks · doi:10.4324/9781003075011-6 · Cited by 112 · see citing works
Un-making artificial moral agents
Johnson, D. G., & Miller, K. (2008) · Ethics and Information Technology · doi:10.1007/s10676-008-9174-6 · Cited by 81 · see citing works
Mechanistic versus phenomenal embodiment: Can robot embodiment lead to strong AI?
SHARKEY, N. E., & Tom Ziemke, B. (2001) · Cognitive Systems Research · doi:10.1016/s1389-0417(01)00036-5 · Cited by 61 · see citing works
Using Stories to Teach Human Values to Artificial Agents
Riedl, M., & Harrison, B. E. (2016) · National Conference on Artificial Intelligence · Cited by 48 · see citing works
Oettinger, A. G. (1968) · Elsevier eBooks · doi:10.1016/b978-1-4831-9816-3.50010-0 · Cited by 27 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Malle, B. F., & Scheutz, M. (2014, June). Moral competence in social robots. Presented at the IEEE international symposium on ethics in engineering, science, and technology, Chicago, IL, pp. 30-35.
Cited by
Sorted by citations
Critiquing the Reasons for Making Artificial Moral Agents
van Wynsberghe, A., & Robbins, S. (2019) · Science and Engineering Ethics · doi:10.1007/s11948-018-0030-8 · Cited by 161 · see citing works
Robots for Social Justice (R4SJ): Toward a More Equitable Practice of Human-Robot Interaction
Zhu, Y., Wen, R., & Williams, T. (2024) · Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3610977.3634944 · Cited by 19 · see citing works
Artificial moral agents: should machines take ethical responsibility?
Reiter, P., Norman, U., Weinberger, N., & Bruno, B. (2025) · 2025 IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso64737.2025.11124921 · Cited by 2 · see citing works
- Authors
- Sharkey, A.
- Affiliations
- University of Sheffield (GB)
- Corresponding author
- Sharkey, Amanda
- ORCID
- Sharkey, Amanda
- Venue
- Connection Science
- Publisher
- Informa UK Limited
- Published
- 2017-05-30
- Volume
- 29
- Issue
- 3
- Pages
- 210-216
- ISSN
- 0954-0091 (ISSN-L)
- 1360-0494
- OpenAlex
- W2617359327
- Cited by
- 36
- References
- 23
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 8 · 2023: 6 · 2022: 4 · 2021: 6 · 2020: 4 · 2019: 1 · 2018: 1
- FWCI
- 3.76
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Connection Science (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › Literary and Philosophical Studies
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- legal responsibility, moral responsibility, human-robot interaction, robot design, human rights compliance, robot deployment, robot ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review