The DOI matches its Crossref record; 75 of the 79 references it cites were found in a registry or an index; 23 of the 68 sources its claims cite were checked for support.
Large Language Models and the Reverse Turing Test
Open accessAbstract
Large language models (LLMs) have been transformative. They are pretrained foundational models that are self-supervised and can be adapted with fine-tuning to a wide range of natural language tasks, each of which previously would have required a separate network model. This is one step closer to the extraordinary versatility of human language. GPT-3 and, more recently, LaMDA, both of them LLMs, can carry on dialogs with humans on many topics after minimal priming with a few examples. However, there has been a wide range of reactions and debate on whether these LLMs understand what they are saying or exhibit signs of intelligence. This high variance is exhibited in three interviews with LLMs reaching wildly different conclusions. A new possibility was uncovered that could explain this divergence. What appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the interviewer, a remarkable twist that could be considered a reverse Turing test. If so, then by studying interviews, we may be learning more about the intelligence and beliefs of the interviewer than the intelligence of the LLMs. As LLMs become more capable, they may transform the way we interact with machines and how they interact with each other. Increasingly, LLMs are being coupled with sensorimotor devices. LLMs can talk the talk, but can they walk the walk? A road map for achieving artificial general autonomy is outlined with seven major improvements inspired by brain systems and how LLMs could in turn be used to uncover new insights into brain function.
Overview
CoChat Summary
TL;DR
Sejnowski argues that apparent intelligence in large language models may often mirror the intelligence and expectations of the interviewer through priming, a phenomenon he calls a reverse Turing test. He reviews three divergent LLM interviews and outlines seven brain-inspired improvements needed for artificial general autonomy.
Key findings
- LLM responses depend heavily on priming: Hofstadter’s nonsense-primed GPT-3 produced nonsensical answers, but with explicit prompts GPT-3 could reply “Nonsense,” explain why, and handle counterfactuals; Lemoine’s sentience-leading prompt elicited sentience claims from LaMDA.
- The paper proposes the mirror hypothesis: LLMs may reflect the beliefs, expectations, and intelligence of the human partner, so interviews may reveal more about the interviewer than the LLM.
- LLMs are not simply parroting stored text; they form internal latent representations and generalize, as illustrated by DALL-E generating “a sunset on Mars” and GPT-3 summarizing a technical abstract for a second-grade student.
- Scale examples include LaMDA with 137 billion weights, GPT-3 with 175 billion weights, PaLM with 540 billion connections, and GPT-3 requiring 10^12 times more computing power to train than NETtalk in 1986.
- The AGA roadmap lists seven improvements: goals/motivation, long-term memory, dialog continuity, sensory experience, a body, autonomy in uncertain environments, and extended development.
Methods
- Design: conceptual/position paper, not a controlled empirical study; it analyzes published LLM interviews and illustrative priming examples.
- Data: three interviews—Agüera y Arcas with LaMDA, Hofstadter with GPT-3, and Lemoine with LaMDA—plus author-generated GPT-3 prompts on nonsense and counterfactuals.
- Analysis: qualitative comparison of how priming shapes LLM responses, used to motivate the mirror hypothesis and reverse Turing test; a formal test is proposed but not performed.
Limitations
- The paper states there is no accepted definition for consciousness or intelligence and no consensus criteria for evaluating LLM intelligence or understanding.
- It states that a formal test of the mirror hypothesis—having human raters assess interviewer and LLM intelligence and correlating them—could be done, but the paper only suggests informally scoring the three interviews.
- Evident from the text: the evidence is selective interview excerpts and author-chosen prompts rather than a controlled study, so the mirroring conclusion is interpretive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
21 Valid · 49 Not valid · 41 Not checked · 109 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“What it does imply is that LMMs have an exceptional ability to mimic many human personalities, especially when fine-tuned (Karra et al., 2022).”
What the sources say
- Partly supportedcites Karra et al., 2022 sourceExperimental — accuracy not yet measured
Section 5.4 (p. 22) reports significant changes in several personality-trait scores after fine-tuning GPT-2. But Section 5.4 (p. 23) calls the results only “initial promise,” and Section 4.3 (p. 12) says fine-tuning does not provide precise control. The paper therefore supports the ability to alter expressed traits, not the broader claim of an exceptional ability to mimic many human personalities. (LLM, conf=0.85)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, what Eliza did reveal was that humans are susceptible to projecting onto a chat bot an illusion of understanding, a valuable lesson that we should keep in mind.”
What the sources say
- Supportedcites Weizenbaum, 1966 source
The Discussion says ELIZA shows how easy it is to create and maintain an illusion of understanding. It also says the human speaker contributes to the plausibility of ELIZA’s responses and may believe they are being understood (Discussion, passages 2 and 5). (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Without explicit training on abstract reasoning tasks, humans can more effectively reach logical conclusions in familiar settings, and the same bias has been observed in LLMs (Dasgupta et al., 2022).”
What the sources say
- Supportedcites Dasgupta et al., 2022 source
The Figure 2 caption (Content effects on accuracy, p. 10) reports that humans and language models show similar content effects on reasoning tasks, including an advantage when content supports the logical inference. The Figure 17 caption (p. 60) also reports better model performance with realistic than arbitrary rules on the Wason task. (LLM, conf=0.92)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Without explicit training on abstract reasoning tasks, humans can more effectively reach logical conclusions in familiar settings, and the same bias has been observed in LLMs (Dasgupta et al., 2022).”
What the sources say
- Partly supportedcites Dasgupta et al., 2022 sourceExperimental — accuracy not yet measured
The Introduction (p. 2) says humans reason more accurately about familiar than abstract situations, and the study overview (p. 4) reports that language models show similar content effects. The paper does not establish the claim's qualifier that the humans lacked explicit training on abstract reasoning tasks. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Even more ambitious, an LLM has been embedded into the control system for a robot, which has an internal dialog with itself while carrying out tasks like fetching a glass of water (Huang et al., 2022).”
What the sources say
- Partly supportedcites Huang et al., 2022 sourceExperimental — accuracy not yet measured
Section 3.2 (p. 3) describes an LLM planner receiving feedback as a robot acts, and the Conclusion (p. 9) says this planning is fused with robotic control policies. The kitchen-task prompts (pp. 23–24) include bringing drinks and moving a water bottle, but do not show the robot fetching a glass of water specifically. (LLM, conf=0.85)
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
34 more claims · 2 with their cited sources checked
Create a free account to see all 220 claims and to verify the 8 references still open.
- It may state two separate claims as one. 62
- Probably not a substantial claim. 169
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, our understanding of how LLMs make decisions could help reveal general principles that govern both language intelligence and decision intelligence (70).”
From The emergence of economic rationality of GPT (2023) · cites this paper as [70]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In recent years, generative pre-trained transformer (GPT)-based models, AI tools generating large language models (LLMs), have been extensively testing and developing in healthcare at several levels, such as research, education, clinical decisions and patient communication [11,12,13].”
From Optimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge (2023) · cites this paper as [11]
Experimental — accuracy not yet measured
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“…made in the twentieth century inspired new machine learning algorithms: the hierarchy of areas in visual cortex inspired convolutional neural networks (LeCun et al., 1998, 2015), and operant conditioning inspired the temporal difference learning algorithm for reinforcement learning (Sutton, 1988).”
BackgroundBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“Another common comparison is with Eliza, a chat program developed by Joseph Weizenbaum in the early days of AI that mimicked a psychiatrist by literally parroting back to patients as a question what they had just said (Weizenbaum, 1966).”
BackgroundChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263 · cited 1×
“Are we intelligent enough to judge intelligence (de Waal, 2016)?”
BackgroundA general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590 · cited 2×
“Appendix C: Excerpts from Blake Lemoine’s (2022) Interview”
BackgroundMethodTowards a cognitive neuroscience of consciousness: basic evidence and a workspace framework
Dehaene, S. (2001) · Cognition · doi:10.1016/s0010-0277(00)00123-2 · Cited by 2,498 · cited 2×
“Now that we are able to interrogate neurons throughout the brain, we may be able to solve one of its greatest mysteries: how information globally distributed over so many neurons is integrated into unified percepts and brought together to make decisions (Dehaene & Naccache, 2001).”
BackgroundGlobal epigenomic reconfiguration during mammalian brain development
Lister, R., Mukamel, E. A., Nery, J. R., Urich, M., Puddifoot, C. A., Johnson, N. D., Lucero, J., Huang, Y., Dwork, A. J., Schultz, M. D., et al. (2013) · Science · doi:10.1126/science.1237905 · Cited by 1,830 · cited 1×
“During the first few years of life, the brain of a baby undergoes massive synaptogenesis in parallel with the emergence of language (Lister et al., 2013).”
BackgroundPRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS
ROSENBLATT, F. (1961) · doi:10.21236/ad0256582 · Cited by 1,691
The Book of Why: The New Science of Cause and Effect
Goldberg, L. R. (2019) · Notices of the American Mathematical Society · doi:10.1090/noti1912 · Cited by 1,655
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
Parallel Networks that Learn to Pronounce English Text
B, T. J. S. A. (1987) · Cited by 1,514
Self-citationAllostasis: A model of predictive regulation
Sterling, P. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2011.06.004 · Cited by 1,073 · cited 1×
“Brains have several hundred specialized subcortical brain areas responsible for homeostasis, energy regulation, sleep and many other essential functions necessary for autonomy, including allostasis – how the brain and body respond to stress to reach new levels of homeostasis (Sterling, 2012).”
BackgroundDota 2 with Large Scale Deep Reinforcement Learning
OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.06680 · Cited by 1,065
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2176 · Cited by 932
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.15556 · Cited by 929
Are We Smart Enough to Know How Smart Animals Are
de Waal, F. Β. Μ. (2016) · Medical Entomology and Zoology · Cited by 876
(2005) · Cited by 823
LaMDA: Language Models for Dialog Applications
Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.-T., Jin, A., Bos, T., Baker, L., Du, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2201.08239 · Cited by 778
The cerebellum: adaptive prediction for movement and cognition
Sokolov, A. A., Miall, R. C., & Ivry, R. B. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.02.005 · Cited by 691
Brain-inspired computing needs a master plan
Mehonic, A., & Kenyon, A. J. (2022) · Nature · doi:10.1038/s41586-021-04362-w · Cited by 632 · cited 2×
“We are in a period of explosive computational growth, especially over the past decade when graphics processing units (GPUs) were harnessed, leading to a six-fold inflection point in the doubling time in 2012 (Mehonic & Kenyon, 2022; see Figure 4).”
BackgroundFlatland: a Romance of Many Dimensions
TUCKER, R. (1884) · Nature · doi:10.1038/031076a0 · Cited by 486 · cited 1×
“Our intuitions about the geometry of space have been shaped by the world we live in and limit our imagination, just as the two-dimensional creatures that inhabited Flatland struggled to imagine a third dimension (Abbott, 1884).”
BackgroundSejnowski, T. J. (2018) · doi:10.7551/mitpress/11474.001.0001 · Cited by 438
What We Know Currently about Mirror Neurons
Kilner, J. M., & Lemon, R. N. (2013) · Current Biology · doi:10.1016/j.cub.2013.10.051 · Cited by 401
Compute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363
The unreasonable effectiveness of deep learning in artificial intelligence
Sejnowski, T. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1907373117 · Cited by 352 · cited 2×
“The dialog between AI and neuroscience is a virtuous circle that is enriching both fields (Hassabis et al., 2017; Sejnowski, 2020; Richards et al., 2022).”
BackgroundThe basal ganglia and cognitive pattern generators
Graybiel, A. M. (1997) · Schizophrenia Bulletin · doi:10.1093/schbul/23.3.459 · Cited by 351
(2000) · Medical Entomology and Zoology · Cited by 339
A theory of multineuronal dimensionality, dynamics and measurement
Gao, P., Trautmann, E., Yu, B., Santhanam, G., Ryu, S., Shenoy, K., & Ganguli, S. (2017) · doi:10.1101/214262 · Cited by 332 · cited 1×
“Another solution is to expand the complexity of the task over longer time intervals (Gao et al., 2017).”
BackgroundLaryngeal Motor Cortex and Control of Speech in Humans
Simonyan, K., & Horwitz, B. (2011) · The Neuroscientist · doi:10.1177/1073858410386727 · Cited by 310 · cited 2×
“The rapid articulatory sequences in the mouth and larynx are the fastest motor programs that brains are able to generate (Simonyan & Horwitz, 2011).”
BackgroundInner Monologue: Embodied Reasoning through Planning with Language Models
Huang, W., Xia, F., Xiao, T., Chan, H., Liang, J., Florence, P., Zeng, A., Tompson, J., Mordatch, I., Chebotar, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2207.05608 · Cited by 287
Harry Potter and the Sorcerer's Stone
(2002) · Journal of Religion & Film · doi:10.32873/uno.dc.jrf.06.01.12 · Cited by 245
Mind games: Game engines as an architecture for intuitive physics
Ullman, T. D., Spelke, E., Battaglia, P., & Tenenbaum, J. B. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.012 · Cited by 234 · cited 1×
“This may be how a baby’s brain rapidly learns the causal structure of the world by making predictions and observing outcomes while actively interacting with the world (Ullman et al., 2017).”
BackgroundAction to Language via the Mirror Neuron System
(2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511541599 · Cited by 229 · cited 1×
“Mirror neurons may also be involved in language acquisition (Arbib, 2010).”
BackgroundInteractive and Visual Prompt Engineering for Ad-hoc Task Adaptation With Large Language Models
Strobelt, H., Webson, A., Sanh, V., Hoover, B., Beyer, J., Pfister, H., & Rush, A. M. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3209479 · Cited by 204 · cited 1×
“Priming is a powerful way to influence the subsequent responses from LLMs and can contribute to the wide divergence among the interviews (Strobelt et al., 2022).”
BackgroundInteractive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models
Strobelt, H., Webson, A., Sanh, V., Hoover, B., Beyer, J., Pfister, H., & Rush, A. M. (2022) · arXiv · doi:10.48550/arxiv.2208.07852 · Cited by 204
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
Bartlett, P. L., Harvey, N., Liaw, C., & Mehrabian, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02930 · Cited by 188
Creativity—the unconscious foundations of the incubation period
Ritter, S. M., & Dijksterhuis, A. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00215 · Cited by 173 · cited 2×
“Subconscious processing is a source of creativity in all fields, from art to mathematics (Ritter and Dijksterhuis, 2014).”
BackgroundThe Language Organ: Linguistics as Cognitive Physiology
Anderson, S. R., & Lightfoot, D. W. (2002) · doi:10.1017/cbo9780511613869 · Cited by 149
A parallel network that learns to play backgammon
Tesauro, G., & Sejnowski, T. J. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90017-9 · Cited by 122 · cited 1×
“At the Dartmouth meeting, I talked about TD-Gammon, a neural network built by Gerald Tesauro at IBM that learned by playing itself to reach a world champion level of play in backgammon (Tesauro & Sejnowski, 1989; Tesauro, 1995).”
BackgroundSelf-citationIntuitive physics learning in a deep-learning model inspired by developmental psychology
Piloto, L. S., Weinstein, A., Battaglia, P., & Botvinick, M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01394-8 · Cited by 118 · cited 1×
“Steps are already being taken in this direction, and progress has been made in learning intuitive physics from videos using deep learning (Piloto et al., 2022).”
BackgroundWhy youth is not wasted on the young: immaturity in human development
(2008) · Choice Reviews Online · doi:10.5860/choice.45-4073 · Cited by 114 · cited 1×
“Brains pass through many stages during development that prepare them for the social and cultural complexities they need to navigate as adults (Bjorklund, 2007).”
BackgroundReplay in Deep Learning: Current Approaches and Missing Biological Elements
Hayes, T. L., Krishnan, G. P., Bazhenov, M., Siegelmann, H. T., Sejnowski, T. J., & Kanan, C. (2021) · Neural Computation · doi:10.1162/neco_a_01433 · Cited by 106
Artificial intelligence: a paper symposium
McCarthy, J. (1974) · Artificial Intelligence · doi:10.1016/0004-3702(74)90016-2 · Cited by 102
Evolutionary loss of complexity in human vocal anatomy as an adaptation for speech
Nishimura, T., Tokuda, I. T., Miyachi, S., Dunn, J. C., Herbst, C. T., Ishimura, K., Kaneko, A., Kinoshita, Y., Koda, H., Saers, J. P. P., et al. (2022) · Science · doi:10.1126/science.abm1574 · Cited by 102
From motor control to team play in simulated humanoid football
Liu, S., Lever, G., Wang, Z., Merel, J., Eslami, S. M. A., Hennes, D., Czarnecki, W. M., Tassa, Y., Omidshafiei, S., Abdolmaleki, A., et al. (2022) · Science Robotics · doi:10.1126/scirobotics.abo0235 · Cited by 88
Theory of the Multiregional Neocortex: Large-Scale Neural Dynamics and Distributed Cognition
Wang, X.-J. (2022) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-110920-035434 · Cited by 83
BRAIN 2.0: Transforming neuroscience
Ngai, J. (2022) · Cell · doi:10.1016/j.cell.2021.11.037 · Cited by 77 · cited 1×
“In parallel with the advances in artificial neural networks, the BRAIN Initiative has accelerated discoveries in neuroscience in this century by innovative neurotechnologies (Ngai, 2022).”
BackgroundLanguage models, like humans, show content effects on reasoning tasks
Lampinen, A. K., Dasgupta, I., Chan, S. C. Y., Sheahan, H. R., Creswell, A., Kumaran, D., McClelland, J. L., & Hill, F. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae233 · Cited by 69
Language models show human-like content effects on reasoning tasks
Dasgupta, I., Lampinen, A. K., Chan, S. C. Y., Sheahan, H. R., Creswell, A., Kumaran, D., McClelland, J. L., & Hill, F. (2022) · arXiv · doi:10.48550/arxiv.2207.07051 · Cited by 53
Nakahira, Y., Liu, Q., Sejnowski, T. J., & Doyle, J. C. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1916367118 · Cited by 49 · cited 4×
“Classical control is centralized, but nature has mastered distributed control to fluidly coordinate bodies with many degrees of freedom (Nakahira et al., 2021; Li, 2022b).”
BackgroundInfluentialSelf-citationLanguage models: past, present, and future
Li, H. (2022) · Communications of the ACM · doi:10.1145/3490443 · Cited by 45
Beyond modularity: Neural evidence for constructivist principles in development
Quartz, S. R., & Sejnowski, T. J. (1994) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00036839 · Cited by 39 · cited 2×
“Linguists concluded that this “poverty of the stimulus” was evidence that syntax is innate (Chomsky, 1971), but this ignored the ways that brains are constructed during development (Quartz & Sejnowski, 1995).”
BackgroundThe application of artificial intelligence to biology and neuroscience
Richards, B., Tsao, D., & Zador, A. (2022) · Cell · doi:10.1016/j.cell.2022.06.047 · Cited by 38
Estimating the Personality of White-Box Language Models
Karra, S. R., Nguyen, S. T., & Tulabandhula, T. (2022) · arXiv · doi:10.48550/arxiv.2204.12000 · Cited by 27 · cited 1×
“What it does imply is that LMMs have an exceptional ability to mimic many human personalities, especially when fine-tuned (Karra et al., 2022).”
BackgroundSejnowski, T., & Delbruck, T. (2012) · Scientific American · doi:10.1038/scientificamerican1012-54 · Cited by 20 · cited 1×
“Nature took inductive biases down to the molecular level to maximize energy efficiency, a path that we must also take if we want to reduce the rapidly growing energy budget of LLMs (Sejnowski & Delbruck, 2012).”
BackgroundInternal Feedback in Biological Control: Locality and System Level Synthesis
Li, J. S. (2022) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc53348.2022.9867769 · Cited by 9 · cited 6×
“Classical control is centralized, but nature has mastered distributed control to fluidly coordinate bodies with many degrees of freedom (Nakahira et al., 2021; Li, 2022).”
BackgroundInfluentialBrenner, S. (1996) · Current Biology · doi:10.1016/s0960-9822(02)70689-1 · Cited by 4 · cited 1×
“However, the paths taken by evolution do not follow the logic that humans use to design devices (Brenner, 1996).”
BackgroundMarcus, G. (2022) · Scientific American · doi:10.1038/scientificamerican1022-42 · Cited by 4
Sejnowski, T. (2019) · Think Tank · doi:10.12987/9780300235470-034 · Cited by 1 · cited 1×
“We do not have conscious access to dopamine signals, but they have a powerful impact on our motivation, and all addictive drugs work by manipulating dopamine activity (Sejnowski, 2019).”
BackgroundSelf-citationCompute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.05924
Internal Feedback in Biological Control: Locality and System Level Synthesis
Li, J. S. (2021) · arXiv · doi:10.48550/arxiv.2109.11757
Brain 2.0: Transforming Neuroscience
Ngai, J. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2023.02.079
Farewell, Marvin Minsky (1927–2016)
Wolfram, S. (2016) · doi:10.31855/23be5da7-056
Research works printed but not linked: 14
- Agüera y Arcas, 2022, Artificial neural networks are making strides towards consciousness, Economist
- Agüera y Arcas, 2022, Can machines learn how to behave?, Medium
- Allman, 1999, Evolving brains, Scientific American Library
- Amodei, 2018, AI and compute
- Arbib, 2010, The mirror system hypothesis, 3
- Bratton, 2022, The model is the message
- Chomsky, 1971, The case against B. F. Skinner, New York Review of Books, 7, 18
- Chomsky, 1986, Knowledge of language: Its nature, origins, and use
- Churchland, 2019, Conscience: The origins of moral intuition
- Hofstadter, 2022, Artificial neural networks are making strides towards consciousness, Economist
- Lemoine, 2022, Is LaMDA sentient?: An interview, Medium
- Lighthill, 1973, Artificial intelligence: A general survey
- Navlakha, 2018, Why animal extinction is crippling computer science, Wired
- Weinberg, 2020, Philosophers on GPT-3 (updated with replies by GPT-3), Daily Nous
Cited by
Katz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0254 · Cited by 420
“Details of these prompts and parameters are available in the online repository.”
BackgroundYu, H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1181712 · Cited by 409
“However, computer technology, programming, and algorithm theory at the time were still inadequate to meet the needs of AI development (Sejnowski, 2022).”
BackgroundLecler, A., Duron, L., & Soyer, P. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.003 · Cited by 385
The debate over understanding in AI’s large language models
Mitchell, M., & Krakauer, D. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2215907120 · Cited by 340
Catalyzing next-generation Artificial Intelligence through NeuroAI
Zador, A., Escola, S., Richards, B., Ölveczky, B., Bengio, Y., Boahen, K., Botvinick, M., Chklovskii, D., Churchland, A., Clopath, C., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37180-x · Cited by 300
“Inpart,theirsuccessrevealshoweasilywecanbetrickedintoimputing intelligence, agency, and even consciousness to our interlocutor 27 .”
Self-citation
Metadata
- Authors
- Sejnowski, T. J.
- Affiliations
- Salk Institute for Biological Studies, La Jolla, CA 92093, U.S.A.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2023-02-17
- Volume
- 35
- Issue
- 3
- Pages
- 309-342
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- PMC
- PMC10177005
- OpenAlex
- W4319301677
- Cited by
- 169
- References
- 79
- Citations by year
- 2026: 32 · 2025: 40 · 2024: 64 · 2023: 32
- FWCI
- 151.26
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2020624)
- Canadian Institute for Advanced Research
- National Institute of Biomedical Imaging and Bioengineering (R01EB026899)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, reverse Turing test, machine intelligence, interviewer bias, GPT-3, LaMDA, self-supervised pre-training, fine-tuning, human-machine interaction, sensorimotor coupling, brain-inspired AI
- MeSH terms
- Artificial Intelligence, Brain, Humans, Language, Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.