The DOI matches its Crossref record; 27 of the 31 references it cites were found in a registry or an index.
The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The pursuit of long-term objectives can induce unexpected sub-goals or byproducts in nuanced environment even though the base model is safe-aligned: a phenomenon hypothesized as instrumental convergence52 and empirically observed as agentic misalignment53.”
From Understanding large language models demands distinguishing human projection from machine cognition (2026) · cites this paper as [52]
In the citing paper
“AI runaway: AI becomes self-governing, meaning that it sets up certain instrumental goals that was not present in our terminal instructions”
From Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education (2024) · cites this paper as Bostrom, 2012
In the citing paper
“The core intuition underlying concerns about power-seeking is Bostrom [2012]'s instrumental convergence thesis , which states that there are some subgoals that are instrumentally useful for achieving almost any final goal.”
From The alignment problem from a deep learning perspective (2022) · cites this paper as Bostrom, 2012
In the citing paper
“Other examples of instrumental subgoals which would be helpful for many possible final goals include: - Acquiring tools and resources (e.g. via earning money). - Convincing other agents to do what it wants (e.g. by manipulating them, or by forming coalitions with them). - Preserving its existing goals (e.g. by preventing other agents from modifying it).”
From The alignment problem from a deep learning perspective (2022) · cites this paper as Bostrom, 2012
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Journal of Consciousness Studies
(2022) · Journal of Consciousness Studies · doi:10.53765/20512201 · Cited by 6,832
Parfit, D. (1986) · Princeton University Press eBooks · doi:10.1093/019824908x.001.0001 · Cited by 5,045
The Humean Theory of Motivation
SMITH, M. (1987) · Mind · doi:10.1093/mind/xcvi.381.36 · Cited by 1,005
Computer Power and Human Reason: From Judgment to Calculation
Agassi, J., & Wiezenbaum, J. (1976) · Technology and Culture · doi:10.2307/3103715 · Cited by 877
Are We Living in a Computer Simulation?
Bostrom, N. (2003) · The Philosophical Quarterly · doi:10.1111/1467-9213.00309 · Cited by 816
Self-citationParfit, D., & Scheffler, S. (2011) · Cited by 772
Computer Power and Human Reason: From Judgement to Calculation.
Crowther, J. F., & Weizenbaum, J. (1977) · Contemporary Sociology · doi:10.2307/2062802 · Cited by 722
Frontiers in Artificial Intelligence and Applications
To, W., Tryfonas, T., & FARTHING, D. W. (2009) · IOS Press eBooks · Cited by 720
Artificial Intelligence as a Positive and Negative Factor in Global Risk
Yudkowsky, E. (2008) · Global Catastrophic Risks · doi:10.1093/oso/9780198570509.003.0021 · Cited by 431
Cited by
Walter, Y. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00448-3 · Cited by 1,113
“In such cases, there are two prompt techniques helping us out there.”
Research Priorities for Robust and Beneficial Artificial Intelligence
Russell, S., Dewey, D., & Tegmark, M. (2015) · AI Magazine · doi:10.1609/aimag.v36i4.2577 · Cited by 637
“If an AI system is selecting the actions that best allow it to complete a given task, then avoiding conditions that prevent the system from continuing to pursue the task is a natural subgoal (Omohundro 2007; Bostrom 2012) (and conversely, seeking unconstrained situations is sometimes a useful heuristic (Wissner-Gross…”
BackgroundImagining the thinking machine: Technological myths and the rise of artificial intelligence
Natale, S., & Ballatore, A. (2020) · Convergence: The International Journal of Research into New Media Technologies · doi:10.1177/1354856517715164 · Cited by 264
“More recently, philosopher Nick Bostrom has been discussing the risks of super-intelligent agents emerging from AI research (2012). Robert M. Geraci has aptly named this strand of beliefs ‘Apocalyptic AI’, showing that the thinking machines promised by AI provided fertile ground to re-cast religious dreams of purity,…”
Liability for damages caused by artificial intelligence
Čerka, P., Grigienė, J., & Sirbikytė, G. (2015) · Computer Law & Security Review · doi:10.1016/j.clsr.2015.03.008 · Cited by 217
Robots, law and the retribution gap
Danaher, J. (2016) · Ethics and Information Technology · doi:10.1007/s10676-016-9403-3 · Cited by 192
“In doing so, they can be instrumental reasoners par excellence, but, as Bostrom (2012; 2014) points out, there is no reason why their approach to such tasks would involve the functional analogues of mental states like beliefs and/or desires and intentions.”
Background
Metadata
- Authors
- Bostrom, N.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Bostrom, Nick
- Venue
- Minds and Machines
- Published
- 2012-05
- Volume
- 22
- Issue
- 2
- Pages
- 71-85
- ISSN
- 0924-6495 (ISSN-L)
- 1572-8641
- OpenAlex
- W2123028958
- Cited by
- 254
- References
- 31
- Citations by year
- 2026: 34 · 2025: 32 · 2024: 35 · 2023: 24 · 2022: 16 · 2021: 21 · 2020: 17 · 2019: 15 · 2018: 9 · 2017: 14 · 2016: 11 · 2015: 10 · 2014: 6 · 2013: 2 · 2012: 8
- FWCI
- 21.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Minds and Machines (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Social Sciences › Arts and Humanities › Philosophy › Philosophical Ethics and Theory
- Keywords
- artificial intelligence, motivation, instrumental rationality, orthogonality thesis, instrumental convergence, AI alignment, AI safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents. https://app.cochat.ai/papers/10.1007/s11023-012-9281-3
- The paper
- Bostrom, N. (2012). The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents. Minds and Machines. https://doi.org/10.1007/s11023-012-9281-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.