How do we know how smart AI systems are?
Abstract
In 1967, Marvin Minksy, a founder of the field of artificial intelligence (AI), made a bold prediction: "Within a generation…the problem of creating 'artificial intelligence' will be substantially solved." Assuming that a generation is about 30 years, Minsky was clearly overoptimistic. But now, nearly two generations later, how close are we to the original goal of human-level (or greater) intelligence in machines?
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Integration of diverse sensory inputs allows more nuanced and detailed interpretation of data, enhancing model's ability to accurately analyze and understand various types of information.
“This integration of diverse sensory inputs allows for a more nuanced and detailed interpretation of data, enhancing the model's ability to accurately analyze and understand various types of information [160].”
From From Google Gemini to OpenAI Q* (Q-Star): A Survey on Reshaping the Generative Artificial Intelligence (AI) Research Landscape (2025) · cites this paper as [160]
Cites
Still being checked.
Cited by
Sorted by citations
A Turing Test of Whether AI Chatbots Are Behaviorally Similar to Humans
Mei, Q., Xie, Y., Yuan, W., & Jackson, M. O. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2313925121 · Cited by 254 · see citing works
Artificial Intelligence and the Transformation of Higher Education Institutions: A Systems Approach
Katsamakas, E., Pavlov, O. V., & Saklad, R. (2024) · Sustainability · doi:10.3390/su16146118 · Cited by 195 · see citing works
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v4 · Cited by 173 · see citing works
McIntosh, T. R., Susnjak, T., Liu, T., Watters, P., Xu, D., Liu, D., & Halgamuge, M. N. (2025) · Technologies · doi:10.3390/technologies13020051 · Cited by 102 · see citing works
McCoy, R. T., Yao, S., Friedman, D., Hardy, M. D., & Griffiths, T. L. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2322420121 · Cited by 96 · see citing works
A tutorial on open-source large language models for behavioral science
Hussain, Z., Binz, M., Mata, R., & Wulff, D. U. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02455-8 · Cited by 91 · see citing works
Mess, S. A., Mackey, A., & Yarowsky, D. (2025) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000006450 · Cited by 82 · see citing works
Limitations of large language models in clinical problem-solving arising from inflexible reasoning
Kim, J., Podlasek, A., Shidara, K., Liu, F., Alaa, A., & Bernardo, D. (2025) · Scientific Reports · doi:10.1038/s41598-025-22940-0 · Cited by 78 · see citing works
Do large language models have a legal duty to tell the truth?
Wachter, S., Mittelstadt, B., & Russell, C. (2024) · Royal Society Open Science · doi:10.1098/rsos.240197 · Cited by 85 · see citing works
Introduction to large language models (LLMs) for dementia care and research
Treder, M. S., Lee, S., & Tsvetanov, K. A. (2024) · Frontiers in Dementia · doi:10.3389/frdem.2024.1385303 · Cited by 63 · see citing works
To protect science, we must use LLMs as zero-shot translators
Mittelstadt, B., Wachter, S., & Russell, C. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01744-0 · Cited by 58 · see citing works
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v3 · Cited by 62 · see citing works
Take caution in using LLMs as human surrogates
Gao, Y., Lee, D., Burtch, G., & Fazelpour, S. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2501660122 · Cited by 52 · see citing works
Implications of Large Language Models for Quality and Efficiency of Neurologic Care
Moura, L. M. V. R., Jones, D. T., Sheikh, I., Murphy, S. N., Kalfin, M., Kummer, B. R., Weathers, A. L., Grinspan, Z. M., Silsbee, H. M., Jones, L. K., et al. (2024) · Neurology · doi:10.1212/wnl.0000000000209497 · Cited by 53 · see citing works
Divergent creativity in humans and large language models
Bellemare-Pepin, A., Lespinasse, F., Thölke, P., Harel, Y., Mathewson, K. W., Olson, J. A., Bengio, Y., & Jerbi, K. (2026) · Scientific Reports · doi:10.1038/s41598-025-25157-3 · Cited by 52 · see citing works
Inductive reasoning in humans and large language models
Han, S. J., Ransom, K., Perfors, A., & Kemp, C. (2023) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101155 · Cited by 68 · see citing works
Yiu, E., Kosoy, E., & Alison Gopnik, C. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231201401 · Cited by 61 · see citing works
Language models and psychological sciences
Sartori, G., & Orrù, G. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1279317 · Cited by 49 · see citing works
How is AI Transforming Medical Research, Education and Practice?
Thurzo, A. (2025) · Bratislavské lekárske listy/Bratislava medical journal · doi:10.1007/s44411-025-00063-2 · Cited by 40 · see citing works
Nielbo, K. L., Karsdorp, F., Wevers, M., Lassche, A., Baglini, R., Kestemont, M., & Tahmasebi, N. (2024) · Nature Reviews Methods Primers · doi:10.1038/s43586-024-00302-w · Cited by 38 · see citing works
Is artificial consciousness achievable? Lessons from the human brain
Farisco, M., Evers, K., & Changeux, J. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106714 · Cited by 36 · see citing works
The high-dimensional psychological profile of ChatGPT
Zhang, Y., Shao, L. H., Yuan, X., Yuan, H., Che, Z., & Luo, S. (2025) · Science China Technological Sciences · doi:10.1007/s11431-025-2934-8 · Cited by 23 · see citing works
How to evaluate the cognitive abilities of LLMs
Ivanova, A. A. (2025) · Nature Human Behaviour · doi:10.1038/s41562-024-02096-z · Cited by 19 · see citing works
Farrell, H. J. (2025) · Annual Review of Political Science · doi:10.1146/annurev-polisci-040723-013245 · Cited by 21 · see citing works
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation
Eriksson, M., Purificato, E., Noroozian, A., Vinagre, J., Chaslot, G., Gomez, E., & Fernandez-Llorca, D. (2025) · arXiv · doi:10.48550/arxiv.2502.06559 · Cited by 35 · see citing works
Introducing ChatSQC: Enhancing statistical quality control with augmented AI
Megahed, F. M., Chen, Y., Zwetsloot, I. M., Knoth, S., Montgomery, D. C., & Jones‐Farmer, L. A. (2024) · Journal of Quality Technology · doi:10.1080/00224065.2024.2372328 · Cited by 19 · see citing works
Working Memory Capacity of ChatGPT: An Empirical Study
Gong, D., Wan, X., & Wang, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28868 · Cited by 13 · see citing works
Han, Z., Battaglia, F., Mansuria, K., Heyman, Y., & Terlecky, S. R. (2025) · AI · doi:10.3390/ai6010012 · Cited by 9 · see citing works
ChatGPT, extended: large language models and the extended mind
Smart, P., Clowes, R., & Clark, A. (2025) · Synthese · doi:10.1007/s11229-025-05046-y · Cited by 7 · see citing works
Bayes in the Age of Intelligent Machines
Griffiths, T. L., Zhu, J.-Q., Grant, E., & McCoy, R. T. (2024) · Current Directions in Psychological Science · doi:10.1177/09637214241262329 · Cited by 7 · see citing works
Calderon‐Uribe, S., Morales-Hernandez, L. A., Guzmán-Sandoval, V. M., Trejo, B. D., & Cruz-Albarrán, I. A. (2024) · Infrared Physics & Technology · doi:10.1016/j.infrared.2024.105669 · Cited by 7 · see citing works
A Turing Test: Are AI Chatbots Behaviorally Similar to Humans?Preprint
Mei, Q., Xie, Y., Yuan, W., & Jackson, M. O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4637354 · Cited by 7 · see citing works
Can large language models be used to code text for thematic analysis? An explorative study
Han, Z., Tavasi, A., Lee, J.-Y., Luzuriaga, J., Suresh, K., Oppenheim, M., Battaglia, F., & Terlecky, S. R. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00441-3 · Cited by 6 · see citing works
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0005 · Cited by 6 · see citing works
Relational & culture-sensitive AI innovation
Herzog, C. (2025) · Journal of Responsible Technology · doi:10.1016/j.jrt.2025.100135 · Cited by 7 · see citing works
Mind Over Model? Students' Evaluation and Use of ChatGPT ‐Generated Versus Human‐Generated Texts
Latini, N., Bråten, I., & Strømsø, H. I. (2026) · Reading Research Quarterly · doi:10.1002/rrq.70087 · Cited by 5 · see citing works
AI for brain-computer interfaces
Haslacher, D., Akmazoglu, T. B., van Beinum, A., Starke, G., Buthut, M., & Soekadar, S. R. (2024) · Developments in neuroethics and bioethics · doi:10.1016/bs.dnb.2024.02.003 · Cited by 6 · see citing works
Untrained neural networks can demonstrate memorization-independent abstract reasoning
Barak, T., & Loewenstein, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-78530-z · Cited by 4 · see citing works
The Computational Evolution of Cognitive Architectures
Kotseruba, I., & Tsotsos, J. K. (2025) · doi:10.1093/oso/9780192844835.001.0001 · Cited by 4 · see citing works
Self supervised learning and the poverty of the stimulus
Veres, C., & Sampson, J. (2023) · Data & Knowledge Engineering · doi:10.1016/j.datak.2023.102208 · Cited by 4 · see citing works
Editorial for the Special Issue on Algorithms in Our Lives
Bhatia, S., Galešić, M., & Mitchell, M. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231214452 · Cited by 4 · see citing works
Self-citationA comparison of human and GPT-4 use of probabilistic phrases in a coordination game
Maloney, L. T., Martello, M. D. D., Fei, V., & Ma, V. (2024) · Scientific Reports · doi:10.1038/s41598-024-56740-9 · Cited by 7 · see citing works
Exploring students’ (mis)conceptions about ChatGPT-generated text: A qualitative study
Bråten, I., Latini, N., & Strømsø, H. I. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-13938-w · Cited by 2 · see citing works
Why epidemiology should not be automated: the case for slow epidemiology
Tennant, P. W. G., Lu, H., & Westreich, D. J. (2026) · International Journal of Epidemiology · doi:10.1093/ije/dyag181 · Cited by 2 · see citing works
Davinci the Dualist: The Mind–Body Divide in Large Language Models and in Human Learners
Berent, I., & Sansiveri, A. (2024) · Open Mind · doi:10.1162/opmi_a_00120 · Cited by 1 · see citing works
Zhou, X., Ai, M., Adeli, E., Zhang, Y., Liu, Y. M., & Lin, F. V. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.30.697042 · Cited by 1 · see citing works
Dorka, F., Otmani, K. E., Hentsch, M., Künster, N., & Palm, D. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-65400-8_40
Frank, M. C. (2024) · doi:10.21428/e2759450.5e3f2bda
Han, Z., Battaglia, F., Mansuria, K., Heyman, Y., & Terlecky, S. R. (2024) · Research Square · doi:10.21203/rs.3.rs-5084169/v1
Why don’t transformers think like humans?
Khomyakov, A. B. (2025) · Philosophical Problems of IT & Cyberspace (PhilIT&C) · doi:10.17726/philit.2024.2.6
AI in the Lecture Room: Analysing Two Use Cases in the Context of Higher Education
Alén‐Savikko, A., Mäihäniemi, B., & Pasvenskienė, A. (2025) · Law, governance and technology series · doi:10.1007/978-3-031-80111-2_11
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.002.0005
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.002.0007
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0007
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0001
Taxonomies of Cognitive Architectures
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0004
Practical Applications of Cognitive Architectures
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0010
Cognitive Architectures, AI, and Cognitive Science
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0003
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.002.0004
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0008
Challenges of the Past and Opportunities Ahead
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0013
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0006
Cognitive Architectures in the Deep Learning Era
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0012
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0009
What Are Cognitive Architectures?
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0002
Evaluating Cognitive Architectures
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0011
Preaching to the ChoIR: Lessons IR Should Share with AI
Demartini, G., Hauff, C., Lease, M., Mizzaro, S., Roitero, K., Sanderson, M., Scholer, F., Shah, C. S., Spina, D., Thomas, P., et al. (2025) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3731120.3744612
What Smart AIs Can Do without Consciousness
Strasser, A. (2026) · Journal of Artificial Intelligence and Consciousness · doi:10.1142/s2705078526400023
Illusions of Understanding from Outsourcing Thinking to LLMs
Cruz, N. (2026) · Computational Brain & Behavior · doi:10.1007/s42113-026-00288-6
Discourse on Interrogative-Learning
Lastra, R., & Hepburn, G. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8800-7.ch002
Zinchenko, V., Polishchuk, O., Gomilko, O., Yakovleva, O., Сальнікова, Н., & Popovych, K.-D. (2026) · E3S Web of Conferences · doi:10.1051/e3sconf/202671901005
Revelatory and Substitutional Scaffolds: Architecture as a Moderator in the Media Psychology of AIPreprint
Dobson, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7332438
- Authors
- Mitchell, M.
- Affiliations
- Santa Fe Institute (US)
- Corresponding author
- Mitchell, Melanie
- ORCID
- Mitchell, Melanie
- Venue
- Science
- Published
- 2023-07-14
- Volume
- 381
- Issue
- 6654
- Pages
- adj5957-adj5957
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4384154861
- Cited by
- 71
- References
- 0
- Citations by year
- 2026: 10 · 2025: 32 · 2024: 21 · 2023: 8
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- artificial intelligence, machine intelligence, human-level intelligence, Minsky
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
