The DOI matches its Crossref record.
Superintelligence: paths, dangers, strategies
Abstract
The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. This profoundly ambitious and original book picks its way carefully through a vast tract of forbiddingly difficult intellectual terrain. Yet the writing is so lucid that it somehow makes it all seem easy. After an utterly engrossing journey that takes us to the frontiers of thinking about the human condition and the future of intelligent life, we find in Nick Bostrom's work nothing less than a reconceptualization of the essential task of our time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Items 101–111 of 111
Kenton, Z., Kumar, R., Farquhar, S., Richens, J., MacDermott, M., & Everitt, T. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103963 · Cited by 17
Hidden Incentives for Auto-Induced Distributional Shift
Krueger, D., Maharaj, T., & Leike, J. (2020) · arXiv · doi:10.48550/arxiv.2009.09153 · Cited by 14
Reasoning about causality in games
Hammond, L., Fox, J., Everitt, T., Carey, R., Abate, A., & Wooldridge, M. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103919 · Cited by 13
Fermi's paradox, extraterrestrial life and the future of humanity: a Bayesian analysis
Verendel, V., & Häggström, O. (2017) · International Journal of Astrobiology · doi:10.1017/s1473550415000452 · Cited by 11
Truthful AI: Developing and governing AI that does not lie
Evans, O., Cotton-Barratt, O., Finnveden, L., Bales, A., Balwit, A., Wills, P., Righetti, L., & Saunders, W. (2021) · arXiv · doi:10.48550/arxiv.2110.06674 · Cited by 39
AI and the Philosophy of Expertise and Epistemic Authority
Hauswald, R. (2025) · A Companion to Applied Philosophy of AI · doi:10.1002/9781394238651.ch5 · Cited by 5
Sabotage Evaluations for Frontier Models
Benton, J., Wagner, M., Christiansen, E., Anil, C., Perez, E., Srivastav, J., Durmus, E., Ganguli, D., Kravec, S., Shlegeris, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.21514 · Cited by 2
Birch, J. (2024) · The Edge of Sentience · doi:10.1093/9780191966729.003.0003 · Cited by 1
Futures with Digital Minds: Expert Forecasts in 2025
Caviola, L., & Saad, B. (2025) · arXiv · doi:10.48550/arxiv.2508.00536 · Cited by 8
Examining popular arguments against AI existential risk: a philosophical analysis
Swoboda, T., Uuk, R., Lauwaert, L., Rebera, A. P., Oimann, A.-K., Chomanski, B., & Prunkl, C. (2026) · Ethics and Information Technology · doi:10.1007/s10676-025-09881-y · Cited by 1
Low Impact Artificial Intelligences
Armstrong, S., & Levinstein, B. (2017) · arXiv · doi:10.48550/arxiv.1705.10720
Metadata
- Venue
- Choice Reviews Online
- Publisher
- American Library Association
- Published
- 2015-02-24
- Volume
- 52
- Issue
- 07
- Pages
- 52-3620-52-3620
- ISSN
- 0009-4978 (ISSN-L)
- 1523-8253
- OpenAlex
- W648152870
- Cited by
- 1,979
- References
- 0
- Type
- book review
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.