The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Against willing servitude: Autonomy in the ethics of advanced artificial intelligence
Open accessAbstract
Some people believe that advanced artificial intelligence systems (AIs) might, in the future, come to have moral status. Further, humans might be tempted to design such AIs that they serve us, carrying out tasks that make our lives better. This raises the question of whether designing AIs with moral status to be willing servants would problematically violate their autonomy. In this paper, I argue that it would in fact do so.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding mistreatment, one concern is that the status quo of treating AI systems as mere tools could-if we create digital minds-cause digital minds to suffer or harm them in ways comparable to rights violations that result from treating human persons as mere tools or submissive servants (Bales, 2025; Bostrom & Shulman, 2022; Dung, 2023; ms; Bradley & Saad, 2022, forthcoming a , forthcoming b ; Gloor, 2016; Schwitzgebel & Garza, 2015; 2020; Tomasik, 2017).”
From Futures with Digital Minds: Expert Forecasts in 2025 (2025) · cites this paper as Bales, 2025
Citations
Cites
Christman, J. (1991) · Canadian Journal of Philosophy · doi:10.1080/00455091.1991.10717234 · Cited by 422
Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
Butlin, P., Long, R., Elmoznino, E., Bengio, Y., Birch, J., Constant, A., Deane, G., Fleming, S. M., Frith, C., Ji, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.08708 · Cited by 196
Francken, J. C., Beerendonk, L., Molenaar, D., Fahrenfort, J. J., Kiverstein, J. D., Seth, A. K., & van Gaal, S. (2022) · Neuroscience of Consciousness · doi:10.1093/nc/niac011 · Cited by 136
Moral consideration for AI systems by 2030
Sebo, J., & Long, R. (2025) · AI and Ethics · doi:10.1007/s43681-023-00379-1 · Cited by 80
Research works printed but not linked: 46
- Arpaly, 2002, Unprincipled Virtue: an Inquiry into Moral Agency, 10.1093/0195152042.001.0001 · DOI
- Benson, 1994, Free Agency and Self-Worth, The Journal of Philosophy, 91, 650, 10.2307/2940760 · DOI
- Bourget, 2023, Philosophers on Philosophy: the 2020 Philpapers Survey, Philosophers’ Imprint, 23, 1, 10.3998/phimp.2109 · DOI
- Chalmers, 2022, Reality+: Virtual Worlds and the Problems of Philosophy
- Charles, 2010, How Should Feminist Autonomy Theorists Respond to the Problem of Internalized Oppression?, Social Theory and Practice, 36, 409, 10.5840/soctheorpract201036322 · DOI
- Chomanski, 2019, What's Wrong with Designing People to Serve?, Ethical Theory and Moral Practice, 22, 993, 10.1007/s10677-019-10029-3 · DOI
- Christman, 2009, The Politics of Persons: Individual Autonomy and Socio-historical Selves, 10.1017/CBO9780511635571 · DOI
- Christman, 2020, Autonomy in Moral and Political Philosophy
- Christman, 2022, Autonomy and Personal History, 178, 10.4324/9780429290411-19 · DOI
- Dai, 2023, Comment on ‘Sentience Matters
- DeGrazia, 2022, Robots with Moral Status?, Perspectives in Biology and Medicine, 65, 73, 10.1353/pbm.2022.0004 · DOI
- Dillon, 1992, Toward a Feminist Conception of Self-Respect, Hypatia, 7, 52, 10.1111/j.1527-2001.1992.tb00697.x · DOI
- Dworkin, 1976, Autonomy and Behavior Control, The Hastings Center Report, 6, 23, 10.2307/3560358 · DOI
- Friedman, 2003, Autonomy, Gender, Politics, 10.1093/0195138503.001.0001 · DOI
- Godfrey-Smith, 2020, Metazoa: Animal Life and the Birth of the Mind
- Goldstein, 2025, AI Wellbeing, 1
- Govier, 1993, Self-Trust, Autonomy, and Self-Esteem, Hypatia, 8, 99, 10.1111/j.1527-2001.1993.tb00630.x · DOI
- Hill, 1973, Servility and Self-Respect, The Monist, 57, 87, 10.5840/monist197357135 · DOI
- Kagan, 2019, How to Count Animals, More or Less, 10.1093/oso/9780198829676.001.0001 · DOI
- Kavka, 1982, The Paradox of Future Individuals, Philosophy & Public Affairs, 11, 93
- Landgrebe, 2023, Why Machines Will Never Rule the World: Artificial Intelligence without Fear
- Little, 2020, Nonrequiring, 393, 10.4324/9780429266768-33 · DOI
- Mackenzie, 2014, Three Dimensions of Autonomy: a Relational Analysis, 15, 10.1093/acprof:oso/9780199969104.003.0002 · DOI
- Mackenzie, 2021, Relational Autonomy, 10.1093/oxfordhb/9780190628925.013.29 · DOI
- Mackenzie, 2000, Introduction: Autonomy Refigured, 3, 10.1093/oso/9780195123333.003.0001 · DOI
- Mackenzie, 2000, Relational Autonomy: Feminist Perspectives on Autonomy, Agency, and the Social Self, 10.1093/oso/9780195123333.001.0001 · DOI
- McLeod, 2002, Self-trust and Reproductive Autonomy, 10.7551/mitpress/6157.001.0001 · DOI
- Mele, 1995, Autonomous Agents: from Self-Control to Autonomy
- Meyers, 1989, Self, Society, and Personal Choice
- Moosavi, 2023, Will Intelligent Machines Become Moral Patients?, Philosophy and Phenomenological Research, 109, 95, 10.1111/phpr.13019 · DOI
- Musiał, 2017, Designing (artificial) People to Serve–the Other Side of the Coin, Journal of Experimental & Theoretical Artificial Intelligence, 29, 1087, 10.1080/0952813X.2017.1309691 · DOI
- Parfit, 1984, Reasons and Persons
- Pereboom, 2001, Living without Free Will, 10.1017/CBO9780511498824 · DOI
- Petersen, 2007, The Ethics of Robot Servitude, Journal of Experimental and Theoretical Artificial Intelligence, 19, 43, 10.1080/09528130601116139 · DOI
- Petersen, 2011, Designing People to Serve, 43
- Raz, 1988, The Morality of Freedom, 10.1093/0198248075.001.0001 · DOI
- Schwitzgebel, 2015, A Defense of the Rights of Artificial Intelligence, Midwest Studies in Philosophy, 39, 98, 10.1111/misp.12032 · DOI
- Schwitzgebel, 2020, Designing AI with Rights, Consciousness, Self-Respect, and Freedom, 459, 10.1093/oso/9780190905033.003.0017 · DOI
- Searle, 1992, The Rediscovery of the Mind, 10.7551/mitpress/5834.001.0001 · DOI · Paper page
- Shiffrin, 1999, Wrongful Life, Procreative Responsibility, and the Significance of Harm, Legal Theory, 5, 117, 10.1017/S1352325299052015 · DOI
- Shulman, 2021, Sharing the World with Digital Minds, 306, 10.1093/oso/9780192894076.003.0018 · DOI
- Singer, 2015, Animal Liberation
- Smolkin, 1999, Toward a Rights-Based Solution to the Non-Identity Problem, Journal of Social Philosophy, 30, 194, 10.1111/0047-2786.t01-1-00012 · DOI
- Stoljar, 2000, Autonomy and the Feminist Intuition, 94, 10.1093/oso/9780195123333.003.0005 · DOI
- Wolf, 1982, Moral Saints, The Journal of Philosophy, 79, 419, 10.2307/2026228 · DOI
- Woodward, 1986, The Non-Identity Problem, Ethics, 96, 804, 10.1086/292801 · DOI
Cited by
Sorted by citations
Futures with Digital Minds: Expert Forecasts in 2025
Caviola, L., & Saad, B. (2025) · arXiv · doi:10.48550/arxiv.2508.00536 · Cited by 8
Metadata
- Authors
- Bales, A.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Bales, Adam
- ORCID
- Bales, Adam
- Venue
- The Philosophical Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2025-03-31
- ISSN
- 0031-8094 (ISSN-L)
- 1467-9213
- OpenAlex
- W4409020462
- Cited by
- 7
- References
- 4
- Citations by year
- 2026: 4 · 2025: 3
- FWCI
- 7.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The Philosophical Quarterly (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Literary and Philosophical Studies
- Social Sciences › Arts and Humanities › Philosophy › Philosophical Ethics and Theory
- Keywords
- AI ethics, moral status of AI, autonomy, AI design, personhood, moral status
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Against willing servitude: Autonomy in the ethics of advanced artificial intelligence. https://app.cochat.ai/papers/10.1093/pq/pqaf031
- The paper
- Bales, A. (2025). Against willing servitude: Autonomy in the ethics of advanced artificial intelligence. The Philosophical Quarterly. https://doi.org/10.1093/pq/pqaf031