The DOI matches its Crossref record; 19 of the 24 references it cites were found in a registry or an index.
Future Progress in Artificial Intelligence: A Survey of Expert Opinion
Open accessAbstract
There is, in some quarters, concern about high–level machine intelligence and superintelligent AI coming up in a few decades, bringing with it significant risks for humanity. In other quarters, these issues are ignored or considered science fiction. We wanted to clarify what the distribution of opinions actually is, what probability the best experts currently assign to high–level machine intelligence coming up within a particular time–frame, which risks they see with that development, and how fast they see these developing. We thus designed a brief questionnaire and distributed it to four groups of experts in 2012/2013. The median estimate of respondents was for a one in two chance that high-level machine intelligence will be developed around 2040–2050, rising to a nine in ten chance by 2075. Experts expect that systems will move on to superintelligence in less than 30 years thereafter. They estimate the chance is about one in three that this development turns out to be ‘bad’ or ‘extremely bad’ for humanity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There seem to be wide disagreement among scholars and experts, but most seem to agree we would have achieved full automation within 100 years (Müller and Bostrom, 2016; Walsh, 2018).”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Müller and Bostrom, 2016
In the citing paper
“A survey of AI society members predicted a 50% likelihood of AGI being developed between 2040 and 2065, with 18% of participants believing that the development of AGI would be existentially catastrophic.58”
From Threats by artificial intelligence to human health and human existence (2023) · cites this paper as [58]
Citations
Cites
The Singularity Is near: When Humans Transcend Biology
Mead, W. R., & Kurzweil, R. (2006) · Foreign Affairs · doi:10.2307/20031996 · Cited by 3,429 · cited 1×
“Two main questions about this development are when to expect it, if at all (see Bostrom, 2006; Hubert L. Dreyfus, 2012; Kurzweil, 2005) and what the impact of it would be, in particular which risks it might entail, possibly up to a level of existential risk for humanity (see Bostrom, 2013; Müller,…”
BackgroundSuperintelligence: paths, dangers, strategies
(2015) · Choice Reviews Online · doi:10.5860/choice.187536 · Cited by 1,979
What computers still can't do: a critique of artificial reason
Penny, S., & Dreyfus, H. (1994) · Leonardo · doi:10.2307/1575958 · Cited by 1,637 · cited 1×
“…was conducted in August 2007 by Bruce J Klein (then of Novamente and the Singularity Institute) “… on the time–frame for when we may see greater– than–human level AI”, with a few numerical results and interesting comments, archived on Future Progress in Artificial Intelligence: A Poll Among Experts”
BackgroundTHE SINGULARITY IS NEAR: WHEN HUMANS TRANSCEND BIOLOGY
Kurzweil, R. (2005) · Cited by 741
Existential Risk Prevention as Global Priority
Bostrom, N. (2013) · Global Policy · doi:10.1111/1758-5899.12002 · Cited by 588 · cited 2×
“PT–AI: Participants of the conference on “Philosophy and Theory of AI”, Thessaloniki October 2011, organized by one of us (see Müller, 2012, 2013).”
BackgroundSelf-citationMapping the Landscape of Human-Level Artificial General Intelligence
Adams, S. S., Arel, I., Bach, J., Coop, R., Furlan, R., Goertzel, B., Hall, J. S., Samsonovich, A., Scheutz, M., Schlesinger, M., et al. (2012) · AI Magazine · doi:10.1609/aimag.v33i1.2322 · Cited by 213
How long until human-level AI? Results from an expert assessment
Baum, S. D., Goertzel, B., & Goertzel, T. G. (2010) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2010.09.006 · Cited by 150
(1998) · Cited by 143
Self-citationLinguistic and Philosophical Investigations
(2024) · doi:10.52783/lpi · Cited by 77
The errors, insights and lessons of famous AI predictions – and what they mean for the future
Armstrong, S., Sotala, K., & hÉigeartaigh, S. Ó. (2014) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2014.895105 · Cited by 70
Research works printed but not linked: 3
- Lighthill, J. (1973). Artificial intelligence: A general survey, Artificial intelligence: A Paper Symposium. London: Science Research Council.
- Moor, J. H. (2006). The Dartmouth College artificial intelligence conference: The next fifty years. AI Magazine, 27(4), 87–91.
- Müller, V. C. (Ed.). (2013). Theory and philosophy of artificial intelligence (SAPERE, Vol. 5). Berlin: Springer.
Cited by
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
How artificial intelligence will change the future of marketing
Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00696-0 · Cited by 2,875
“However, such capabilities remain distant; a 2016 survey of AI researchers indicated there was only a 50% chance of achieving context awareness (or its equivalent) by 2050 (Müller and Bostrom 2016).”
BackgroundThe Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911
“the danger of a malevolent AGI or existential threats is not discussed in any of the ethics guidelines, even though this is a thoroughly discussed topic in other contexts (Bostrom 2014; Tegmark 2017; Müller and Bostrom 2016; Omohundro 2014). This may be due to the fact that most of the guidelines are not written by re…”
BackgroundThe Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907
“the danger of a malevolent AGI or existential threats is not discussed in any of the ethics guidelines, even though this is a thoroughly discussed topic in other contexts (Bostrom 2014; Tegmark 2017; Müller and Bostrom 2016; Omohundro 2014). This may be due to the fact that most of the guidelines are not written by re…”
BackgroundThe forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866
“In a similar survey Muller and Bostrom (2013) asked hundreds of AI experts at a series of conference the following: “For the purposes of this question, assume that human scientific activity continues without major negative disruption.”
Background
Metadata
- Authors
- Müller, V. C., & Bostrom, N.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Müller, Vincent C.
- ORCID
- Müller, Vincent C.
- Venue
- Synthese Library
- Publisher
- Springer International Publishing
- Published
- 2016
- Pages
- 555-572
- ISSN
- 0166-6991 (ISSN-L)
- 2542-8292
- OpenAlex
- W2166400110
- Cited by
- 655
- References
- 24
- Citations by year
- 2026: 23 · 2025: 60 · 2024: 79 · 2023: 79 · 2022: 103 · 2021: 64 · 2020: 92 · 2019: 71 · 2018: 43 · 2017: 22 · 2016: 12
- FWCI
- 191.38
- Type
- book chapter
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Synthese Library/Synthese library (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- PhilPapers (PhilPapers Foundation) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Keywords
- artificial intelligence, machine intelligence, superintelligence, expert opinion, AI risks, future of AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Future Progress in Artificial Intelligence: A Survey of Expert Opinion. https://app.cochat.ai/papers/10.1007/978-3-319-26485-1_33
- The paper
- Müller, V. C., & Bostrom, N. (2016). Future Progress in Artificial Intelligence: A Survey of Expert Opinion. Synthese Library. https://doi.org/10.1007/978-3-319-26485-1_33
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.