Managing extreme AI risks amid rapid progress
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Preparation requires technical research and development, as well as adaptive, proactive governance
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Any advancement that increases the autonomous capabilities of AI systems introduces its own set of safety considerations (Bengio et al., 2024), especially for systems that improve in an open-ended way (Ecoffet et al., 2020; Clune, 2019).”
From Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents (2025) · cites this paper as Bengio et al., 2024
In the citing paper
“Advanced AI also introduces phenomena that differ fundamentally from previous generations of AI or other technologies, requiring new approaches to mitigating these risks (Bengio et al., 2024).”
From Multi-Agent Risks from Advanced AI (2025) · cites this paper as Bengio et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationA Survey on Large Language Model based Autonomous Agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.11432 · Cited by 1,925 · cited 2×
“However, AI is making progress in critical domains such as hacking, social manipulation, and strategic planning 24,31 , and may soon pose unprecedented con-trol challenges.”
BackgroundEmergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Augmenting large language models with chemistry tools
M. Bran, A., Cox, S., Schilter, O., Baldassari, C., White, A. D., & Schwaller, P. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00832-8 · Cited by 794
Taxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764 · cited 1×
“Especially in the hands of a few powerful actors, AI could cement or exacerbate global inequities, or facilitate automated warfare, customized mass manipulation, and pervasive surveillance 18–23 .”
BackgroundA graph placement methodology for fast chip design
Mirhoseini, A., Goldie, A., Yazgan, M., Jiang, J. W., Songhori, E., Wang, S., Lee, Y.-J., Johnson, E., Pathak, O., Nova, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03544-w · Cited by 618 · cited 1×
“Progress in AI also enables faster AI progress 8 : AI assistants are increasingly used to automate programming 9 , data collection 10,11 , and chip design 12 .”
MethodSuperhuman AI for multiplayer poker
Brown, N., & Sandholm, T. (2019) · Science · doi:10.1126/science.aay2400 · Cited by 592
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.17580 · Cited by 477
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1657 · Cited by 475
Research works printed but not linked: 8
- M. Kinniment et al. arXiv:2312.11671 (18 December 2023). · arXiv
- I. R.McKenzie. arXiv:2306.09479 (15 June 2023). · arXiv
- R.Ngo L.Chan S.Mindermann arXiv:2209.00626 (20 August 2022). · arXiv
- E.Hubinger. arXiv:2401.05566 (10 January 2024). · arXiv
- L.Koessler J.Schuett arXiv:2307.08823 (17 July 2023). · arXiv
- N. Kolt et al. arXiv:2404.02675 (3 April 2024). · arXiv
- M. Phuong et al. arXiv:2403.13793 (20 March 2024). · arXiv
- T. A. Kelly, SAE Trans. J. Mater. Manuf. 113, 257 (2004).
Cited by
Items 401–500 of 618
AI Legal Personhood: Digital Entity (DE) Status as a Game-Theoretic Solution to the Control ProblemPreprint
Lopez, P. A. (2025) · doi:10.36227/techrxiv.175877905.57989668/v1 · Cited by 1
Gould, D. S. W., Mlodozeniec, B., & Brown, S. F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.06111 · Cited by 1
“…effort to produce (Phan et al. 2025)), and those which are tuned to be sensitive to model performance at the point of publication are often quickly "saturated", as models progress faster than expected (Bengio et al. 2024) and reach indistinguishably-high performance (Hendrycks et al. 2021b).”
Alignment Is Not Enough: A Relational Framework for Moral Standing in Human-AI InteractionPreprint
Pasandi, F. B., & Pasandi, H. B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.00078 · Cited by 1
Policy myopia as a mechanism of gradual disempowerment in Post-AGI governance, Circa 2049Preprint
Sahoo, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.03267 · Cited by 1
Precautionary Governance of Autonomous AI: Legal Personhood as Functional InstrumentPreprint
Brensing, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6415178 · Cited by 1
Backchaining Loss of Control Mitigations from Mission-Specific Benchmarks in National SecurityPreprint
Pistillo, M., Faraone, S., & Herman, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.21095 · Cited by 1
“…rely on several approaches, including structured threat modelling (Stix et al., 2025; Murray et al., 2025), agentic pre-deployment evaluations (Bengio et al., 2024; Shevlane et al., 2023; Meinke et al., 2024) and realistic honeypots (Shah et al., 2025; Balesni et al., 2024), post-deployment…”
The Agentic Turn in Finance: AI Agents in Financial Decision-MakingPreprint
Schmitt, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7118938 · Cited by 3
Lu, S., Meng, W., Yu, A., Shao, K., Luan, J., He, R., & Liang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.15519 · Cited by 1
Ghoukasian, H., & Kratsios, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.13439 · Cited by 1
Large language model-powered AI systems achieve self-replication with no human intervention
Pan, X., Dai, J., Fan, Y., Luo, M., Li, C., & Yang, M. (2025) · arXiv · doi:10.48550/arxiv.2503.17378
“As Bengio et al. pointed out, “ AI systems that lacked certain capabilities in the tests may well demonstrate them in slightly different settings”[16] .”
Zhang, J., Zhao, B., Yang, W., Foerster, J., Clune, J., Jiang, M., Devlin, S., & Shavrina, T. (2026) · arXiv · doi:10.48550/arxiv.2603.19461
Self-citationSHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agents
Kutasov, J., Sun, Y., Colognese, P., van der Weij, T., Petrini, L., Zhang, C. B. C., Hughes, J., Deng, X., Sleight, H., Tracy, T., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.15740
“This increases their potential to cause substantial harm via misuse or misalignment [3, 4].”
Beyond computational functionalism: the behavioral inference principle for machine consciousness
Palminteri, S., & Wu, C. M. (2025) · doi:10.31234/osf.io/s7ptu_v3
Künstliche Intelligenz außer Kontrolle?: Interview mit Karl von Wendt
Wendt, K. V., & Heil, R. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.64
Conceivably Urgent Actions Could Provide Extreme Benefit
Woesler, R. (2024) · Dialogo · doi:10.51917/dialogo.2024.10.2.23
Gizatasunaz eta pentsamendu teknologikoaren ibilbideaz
Odriozola, J. M. (2024) · EKAIA Euskal Herriko Unibertsitateko Zientzi eta Teknologi Aldizkaria · doi:10.1387/ekaia.26245
“Edo, bestalde, datuen ustiaketa, mugimendu zelata, aztarna ekologikoa edo iritziaren eraketak hartzen du goiburua, makinaren lehentasuna bera kolokan jarri barik [2].”
BackgroundA+AI: Threats to Society, Remedies, and GovernancePreprint
Byrd, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.02219
da Silva, F. L., (NNSA), U. N. N. S. A., Glatt, R., Giera, B., Gonzales, C., Bremer, P., Newman, J. C., Corley, C. D., Stracuzzi, D. J., Kegelmeyer, P., et al. (2024) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/2475542
Self-citationSalmon, P. M. (2024) · Transportation Planning and Technology · doi:10.1080/03081060.2024.2427826
“Unfortunately, many have noted a failure to do so with contemporary AI technologies (Bengio et al., 2024; Hancock, 2019).”
A Social Outcomes and Priorities centered (SOP) Framework for AI policyPreprint
Shah, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.08241
“A segment of the scientific community has been warning against the potential existential risk of AI and advocating for some immediate thrust in relevant research areas (see, for instance, 5 ).”
Could AI safeguard us from AI?
Sheybani, L. (2024) · Brain Communications · doi:10.1093/braincomms/fcae401
“Safety risks posed by AI are insufficiently investigated according to many scientists, 4 and I believe that what could be an anec-dotal risk—the impact of multiplicity on statistical reliabil-ity—could be highly detrimental to both scientific rigour and trust.”
Solving A.I Safety and Alignment Issues Through Classical Safety Technology
Lin, B. Y. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia241459
Análisis comparado de tendencias formativas en periodismo en Chile
Villablanca, M. B. M., & Rodríguez, A. D. R. (2025) · Doxa Comunicación Revista interdisciplinar de estudios de comunicación y ciencias sociales · doi:10.31921/doxacom.n40a2179
Ciconte, W., Rozario, A., & Urcan, O. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5023685 · Cited by 3
Toward a new foundation for AI
Wollowski, M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-29246-0.00002-x
Gutiérrez-Jiménez, E., Carmona, J. A. L., & Cadavid-Sierra, J.-J. (2023) · Revista colombiana de pensamiento estético e historia del arte · doi:10.15446/rcpeha.n18.115938
DÖNÜŞÜMCÜ LİDERLİK VE RİSK YÖNETİMİ İLİŞKİSİ: BİR META ANALİZİ ÇALIŞMASI
Bayram, V. (2025) · R&S - Research Studies Anatolia Journal · doi:10.33723/rs.1610360
Riascos, A. J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5146720
Resilience of Free Will: A Quantum Cognitive Perspective of Individual ChoicePreprint
Yang, N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5090910
Research Agenda for Sociotechnical Approaches to AI SafetyPreprint
Curtis, S., Iyer, R., Kirk‐Giannini, C. D., Krakovna, V., Krueger, D., Lambert, N., Marnette, B., McKenzie, C., Michael, J., Miyazono, E., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5097286 · Cited by 4
Self-citationTowards an AI Course Based on Neural Networks
Wollowski, M. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i28.35179
Large Language Models Amplify Human Biases in Moral Decision-MakingPreprint
Cheung, V., Maier, M., & Lieder, F. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/aj46b_v1 · Cited by 4
Consciousness in AI Systems: A Review
Shueb, M. M., & Che, X. (2025) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2025.16205 · Cited by 1
“AI safety emphasizes transparency, explainability, fairness, robustness, and consideration of dangerous capabilities, as well as emerging challenges and human values to maintain trust in AI systems [18].”
Ethical Implications of Predictive Rehabilitation Technologies
Premavathi, T., Kumar, A. Y., Sathvika, G., Palaniappan, D., Parmar, K. J., & Jain, R. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0194-5.ch017
An AI-Human Collaboration Chatbot with Digital Representation of Users for Knowledge Sharing
Anand, S., Pillai, A. B., Sai, A. M. A., & Rao, S. N. (2025) · International Conference on Pervasive Computing and Social Networking (ICPCSN) · doi:10.1109/icpcsn65854.2025.11034859
“Rapid progress in artificial intelligence (AI) leads companies to develop generalist AI systems that can act autonomously and achieve goals [1].”
Artificial General Intelligence as a Continuum of Intelligence and Consciousness
Cai, H., & Cai, T. (2025) · Learning and analytics in intelligent systems · doi:10.1007/978-3-031-94266-2_24
Miranda, F. L., & Bravo, J. P. (2025) · Revista Portuguesa de Psicanálise · doi:10.51356/rpp.451a1
“Porém, as potencialida-des das invenções recentes projetam um futuro ainda mais desa fi ante, numa aceleração vertiginosa do progresso tecnológico (Bengio et al., 2024), com a previsão de sistemas de IA capazes de superar a inteli-gência humana, a integração do humano e da máquina numa expansão do…”
Estar quieto no es lo mismo que no hacer nada: la inteligencia artificial y los educadores
Becerra, M. C., Muñoz, S. J. M., & Wilches, E. L. R. (2025) · Voces y Silencios Revista Latinoamericana de Educación · doi:10.18175/vys16.2.2025.4
Addressing the potential social risk of self-reported data within a computational-intensive world
Pileggi, S. F. (2025) · SN Social Sciences · doi:10.1007/s43545-025-01129-2
“AI systems are indeed quickly and consistently evolving in terms of capability and autonomy towards General AI, in contrast with AI safety research, which is much slower and, consequently, lagging in a context of lack of consensus at a strategic and operational level (Bengio et al. 2024 ).”
Robustness evaluation against corruptions for Optical Diffraction Tomography-based classifiers
Cho, H., Lee, J., Ryu, D., Ki, J., & Ye, S. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110682
Visual Analysis of Corporate Social Responsibility and Corporate Governance Based on CiteSpace
Yin, J., Gan, H., Zheng, D., Zhu, H., Wu, C., Gao, X., Chen, J., Li, X., Yang, C., Zhong, K., et al. (2025) · International Conference on Digital Economy and Information Systems · doi:10.1145/3745133.3745235
Advancing Responsible AI in Public Sector Application: GPAI Edition
Singh, A. P., & Ravindran, B. (2025) · CRC Press eBooks · doi:10.1201/9781003663577
Evolving Regulatory and Governance Frameworks
Zou, M., Poncibò, C., Ebers, M., & Calo, R. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009492553.009
Strategic Integration of Aviation, AI, and Predictive Analytics in Humanitarian Logistics
Mızrak, F. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3643-5.ch010
Risks of Large Language Models Misalignment: Multi-Stakeholder Obligations and Governance
Wu, L., Zou, W., Li, J., & Qi, J. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-0880-8_22
Decision-making for technology-led transformation in research practices
Ulusoy, Ö. (2025) · AI & Society · doi:10.1007/s00146-025-02567-5
“Importantly, the potential changes and risks that researchers (and the public in general) face with Gen-AI implementations remain only partially understood (Bengio et al. 2024).”
Martinez, D. E., Chen, P. D., Thompson, S. A., & Kowalski, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5397140
First Year CS Students Exploring Implications of Social Media Recommendation Algorithms
Apiola, M. (2025) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro65660.2025.11131972
“The recent rapid developments in artificial intelligence (AI) have brought about new risks [1], [2] and related needs to reorient R&D to ensure AI safety and ethics [1].”
Conspiracy Theories as Culturally Evolved Epistemologies: A Perspective for the Age of AIPreprint
D'Errico, M., & Yasseri, T. (2025) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/4wsjv_v1
Uso inteligente de las tecnologías de inteligencia artificial
Useda, M. E. G. (2025) · Revista Educación en Ingeniería · doi:10.26507/rei.v20n40.1380
Role of governability and generative AI for healthcare
Gaur, L., & Abraham, A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-33124-4.00004-7
Elections: The Information Technology (IT) and Artificial Intelligence (AI) Perspective
Srivastava, B. (2025) · Springer eBooks · doi:10.1007/978-3-031-89853-2_1
Paton, C. (2025) · New Zealand Medical Student Journal · doi:10.57129/001c.144914
Position: AI agents should be regulated based on autonomous action sequences
Osogami, T. (2025) · HAL
Beyond Computational Equivalence: The Behavioral Inference Principle for Machine ConsciousnessPreprint
Palminteri, S., & Wu, C. M. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/s7ptu_v5
Die Asilomar-Prinzipien aus heutiger Sicht
Schmiedchen, F. (2025) · Springer eBooks · doi:10.1007/978-3-662-71567-3_22
Appicharla, S. K. (2025) · European Safety and Reliability Conference (ESREL) · doi:10.3850/978-981-94-3281-3_esrel-sra-e2025-p9239-cd
ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking AttackPreprint
Park, Y., Park, J., & Kang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.25843
Yao, J., Al-Hashimy, H. N. H., & Kasuma, S. A. A. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3710-4.ch001
Building Data Literacy for Sustainable Development: A Framework for Effective Training
Said, R. A., Mwitondi, K., Benseddik, L., & Chemlali, L. (2025) · Data · doi:10.3390/data10110188
“However, such algorithms, if not handled ethically, could harm the industry through bias and discriminatory practices [37,38].”
Misaligned by Design: Incentive Failures in Machine LearningPreprint
Autor, D., Caplin, A., Martín, D., & Marx, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.07699
Cascade Adversarial Attack Search
Wang, Z., Shen, D., Sun, X., Yang, S., Yu, X., & Tian, Y. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228300
AI-Integrated Data Governance Frameworks for Real-Time, Scalable, and Ethical Data Architectures
Jain, R., & Musengamana, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5616-7.ch006
Misaligned by Design: Incentive Failures in Machine Learning
Autor, D., Caplin, A., Martín, D., & Marx, P. (2025) · National Bureau of Economic Research · doi:10.3386/w34504 · Cited by 9
Dabrock, P. (2025) · De Gruyter eBooks · doi:10.1515/9783111709543-002
Theoretical Perspectives on Love and Artificial Intelligence: An Interdisciplinary Analysis
Yadav, H., & Vanderheiden, E. (2025) · Springer eBooks · doi:10.1007/978-3-031-94512-0_86
Modeling Emotions in Multimodal LLMs
Chang, E. Y. (2025) · ACM eBooks · doi:10.1145/3749421.3749433
Telemedicina e trasformazione delle relazioni nelle attività di cura
Zamarian, M., Rulli, G., Gasparre, A., Franceschi, R., Ponte, D., Zanutto, A., & Barbini, F. M. (2024) · AMS Acta (University of Bologna) · doi:10.6092/unibo/amsacta/7748
Gutfraind, A., & Bier, V. M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.17084
How to use the power of AI to reduce the impact of climate change on Switzerland
Adams, J. S., Altantzis, C., Beucler, T., Bingler, J., Brown, S., Brunschwiler, T., Senni, C. C., Muccione, V., Roeoesli, C., Schimanski, T., et al. (2024) · Archive ouverte UNIGE (University of Geneva) · doi:10.5167/uzh-270021
Khanjani, Z., Janeja, V., Mallinson, C., & Purushotham, S. (2025) · Maryland Shared Open Access Repository (USMAI Consortium) · doi:10.13016/m2fe5s-foeu
Operationalising Safe and Responsible AI: A System Level Perspective
Xia, B. (2025) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/31463 · Cited by 1
Reflection on the Reality of Publication in the Portuguese Journal of Internal Medicine
Mariz, J. (2024) · Medicina Interna · doi:10.24950/rspmi.2638
Saalbach, K. (2025) · osnaDocs (Osnabrück University) · doi:10.48693/734
Harmaala, R. V. (2025) · Osuva (University of Vaasa) · Cited by 1
Managing AI Organizational Strategy and Structure in The Between Times of Artificial Intelligence
Huber, D. M., Alexy, O. T., & München, T. U. (2024)
Huber, D. M. (2024) · mediaTUM (Technical University of Munich)
Reivo, J. (2024) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 5
No Joke: Refusal Policies for Cross-Cultural Sensitivity
Zhou, M., & Cao, X. (2025) · AIS Electronic Library (AISeL)
The AI Cloud: A Digital Intelligence Controlling the Web
Dhruvitkumar, V. T. (2024) · PhilPapers (PhilPapers Foundation)
Why Global South countries need to care about highly capable AI
Abungu, C., Iradukunda, M. V., Beggs, D. C., Hassan, A., & Sayidali, R. (2024) · Econstor (Econstor) · Cited by 2
Le développement de l'intelligence artificielle au Québec à l'aune de l'économie de la promesse
Lussier-Lejeune, F. (2025) · Archipel (Université du Québec à Montréal) · Cited by 1
Theoretical Perspectives on Love and Artificial Intelligence: An Interdisciplinary Analysis
Yadav, H., & Vanderheiden, E. (2025) · Springer eBooks · doi:10.1007/978-3-031-76665-7_86-1
From Catastrophic to Concrete: Reframing AI Risk Communication for Public MobilizationPreprint
Trippenbach, P., Scala, I., Bhambra, J., & Emslie, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.06525
“We need sensible policies in place to mitigate these risks (Bengio et al. 2024; Bengio et al. 2025).”
Brain-Inspired Planning for Better Generalization in Reinforcement LearningPreprint
Zhao, M. ". (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.06470
Okafor, M. U., Shaoan, M. R., Arif, M., Namanyane, T., & Feng, M. (2025) · Kwartalnik Pedagogiczny · doi:10.31338/2657-6007.kp.2025-2.4
AI is not a Tool: the Impact of Growing AI Agency on the Future of Work
van Biezen, A. (2025) · Izzivi prihodnosti · doi:10.37886/ip.2025.009
Advancements in numerical methods for quantum resources
Kožić, S. B., Torre, G., & Giampaolo, S. M. (2026) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/ae1ff9 · Cited by 1
AI sensemaking and adaptation through knowledge workers' career transition narratives
Li, L. (2025) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/9qcd-g721 · Cited by 1
Steerability of Instrumental-Convergence Tendencies in LLMsPreprint
Hościłowicz, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.01584 · Cited by 1
“[36, 42, 43]”
Lawless, W. F. (2026) · Frontiers in Physics · doi:10.3389/fphy.2025.1715888
AI and Human Rights in the Global Pursuit of Justice and Equity
Evangeline, S. I. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2597-2.ch011
Alsuhaymi, A. H. O., Alsarrani, A., Alraddadi, M., Aljohani, F. S., Alharbi, A. M. M., Fadhel, W. A. A., Alharbi, M. S. A., Albalawi, F., Almutairi, M. O., Alshammari, M., et al. (2024) · Saudi Journal of Medicine and Public Health · doi:10.64483/202412552
Systematic Review on AI Safety and Future Research Agenda
Zhang, S., & Lu, H. (2025) · International Conference on System Reliability and Safety Engineering (SRSE) · doi:10.1109/srse67406.2025.11357293
“Bengio et al. emphasize the rapid progress in AI and the associated risks, including large-scale social harms, malicious uses, and the potential loss of human control over autonomous systems [2].”
Biological risk and the AI capability shift
Turner, S. D. (2026) · doi:10.59350/zp9qy-3gg73
Consensus Building in AI Risk Management: Approaches to Global Cooperation
Qu, S., Zhou, Q., Lin, J., Cao, Y., Song, Y., Ben, Y., Lei, L., Zhang, F., & Huang, Q. G. H. (2026) · Frontiers of artificial intelligence, ethics and multidisciplinary applications. · doi:10.1007/978-3-032-05588-0_8
A Global Framework for Emerging Global AI Challenges
Cass-Beggs, D., & Samson, P. (2026) · Frontiers of artificial intelligence, ethics and multidisciplinary applications. · doi:10.1007/978-3-032-05588-0_12
Bläsius, K. H. (2026) · Springer eBooks · doi:10.1007/978-3-662-72526-9_4
Creativity and Teaching Identity: Problem solving and inventiveness as mediating factors
Wilson, C. J. (2025) · Aston Publications Explorer (Aston University) · doi:10.48780/publications.aston.ac.uk.00048749
Metadata
- Authors
- Bengio, Y., Hinton, G., Yao, A., Song, D., Abbeel, P., Darrell, T., Harari, Y. N., Zhang, Y.-Q., Xue, L., Shalev-Shwartz, S., Hadfield, G., Clune, J., Maharaj, T., Hutter, F., Baydin, A. G., McIlraith, S., Gao, Q., Acharya, A., Krueger, D., Dragan, A., Torr, P., Russell, S., Kahneman, D., Brauner, J., & Mindermann, S.
- Affiliations
- Mila - Quebec Artificial Intelligence Institute (CA)
- University of Toronto (CA)
- Tsinghua University (CN)
- University of California, Berkeley (US)
- Hebrew University of Jerusalem (IL)
- Institute for AI International Governance, Tsinghua University, Beijing, China.
- School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel.
- University of British Columbia (CA)
- University of Freiburg (DE)
- University of Oxford (GB)
- East China University of Political Science and Law (CN)
- RAND Corporation (US)
- University of Cambridge (GB)
- Princeton University (US)
- ORCID
- Venue
- Science
- Published
- 2024-05-24
- Volume
- 384
- Issue
- 6698
- Pages
- 842-845
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4398133596
- Cited by
- 349
- References
- 3
- Citations by year
- 2026: 125 · 2025: 161 · 2024: 59
- FWCI
- 142.99
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- AI risks, AI governance, risk management, proactive governance, AI safety
- MeSH terms
- COVID-19, Artificial Intelligence, Humans, Risk Management
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.