The DOI matches its Crossref record; 75 of the 79 references it cites were found in a registry or an index; 23 of the 68 sources its claims cite were checked for support.
Large Language Models and the Reverse Turing Test
Open accessAbstract
Large language models (LLMs) have been transformative. They are pretrained foundational models that are self-supervised and can be adapted with fine-tuning to a wide range of natural language tasks, each of which previously would have required a separate network model. This is one step closer to the extraordinary versatility of human language. GPT-3 and, more recently, LaMDA, both of them LLMs, can carry on dialogs with humans on many topics after minimal priming with a few examples. However, there has been a wide range of reactions and debate on whether these LLMs understand what they are saying or exhibit signs of intelligence. This high variance is exhibited in three interviews with LLMs reaching wildly different conclusions. A new possibility was uncovered that could explain this divergence. What appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the interviewer, a remarkable twist that could be considered a reverse Turing test. If so, then by studying interviews, we may be learning more about the intelligence and beliefs of the interviewer than the intelligence of the LLMs. As LLMs become more capable, they may transform the way we interact with machines and how they interact with each other. Increasingly, LLMs are being coupled with sensorimotor devices. LLMs can talk the talk, but can they walk the walk? A road map for achieving artificial general autonomy is outlined with seven major improvements inspired by brain systems and how LLMs could in turn be used to uncover new insights into brain function.
Overview
CoChat Summary
TL;DR
Sejnowski argues that apparent intelligence in large language models may often mirror the intelligence and expectations of the interviewer through priming, a phenomenon he calls a reverse Turing test. He reviews three divergent LLM interviews and outlines seven brain-inspired improvements needed for artificial general autonomy.
Key findings
- LLM responses depend heavily on priming: Hofstadter’s nonsense-primed GPT-3 produced nonsensical answers, but with explicit prompts GPT-3 could reply “Nonsense,” explain why, and handle counterfactuals; Lemoine’s sentience-leading prompt elicited sentience claims from LaMDA.
- The paper proposes the mirror hypothesis: LLMs may reflect the beliefs, expectations, and intelligence of the human partner, so interviews may reveal more about the interviewer than the LLM.
- LLMs are not simply parroting stored text; they form internal latent representations and generalize, as illustrated by DALL-E generating “a sunset on Mars” and GPT-3 summarizing a technical abstract for a second-grade student.
- Scale examples include LaMDA with 137 billion weights, GPT-3 with 175 billion weights, PaLM with 540 billion connections, and GPT-3 requiring 10^12 times more computing power to train than NETtalk in 1986.
- The AGA roadmap lists seven improvements: goals/motivation, long-term memory, dialog continuity, sensory experience, a body, autonomy in uncertain environments, and extended development.
Methods
- Design: conceptual/position paper, not a controlled empirical study; it analyzes published LLM interviews and illustrative priming examples.
- Data: three interviews—Agüera y Arcas with LaMDA, Hofstadter with GPT-3, and Lemoine with LaMDA—plus author-generated GPT-3 prompts on nonsense and counterfactuals.
- Analysis: qualitative comparison of how priming shapes LLM responses, used to motivate the mirror hypothesis and reverse Turing test; a formal test is proposed but not performed.
Limitations
- The paper states there is no accepted definition for consciousness or intelligence and no consensus criteria for evaluating LLM intelligence or understanding.
- It states that a formal test of the mirror hypothesis—having human raters assess interviewer and LLM intelligence and correlating them—could be done, but the paper only suggests informally scoring the three interviews.
- Evident from the text: the evidence is selective interview excerpts and author-chosen prompts rather than a controlled study, so the mirroring conclusion is interpretive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
21 Valid · 49 Not valid · 41 Not checked · 109 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“What it does imply is that LMMs have an exceptional ability to mimic many human personalities, especially when fine-tuned (Karra et al., 2022).”
What the sources say
- Partly supportedcites Karra et al., 2022 sourceExperimental — accuracy not yet measured
Section 5.4 (p. 22) reports significant changes in several personality-trait scores after fine-tuning GPT-2. But Section 5.4 (p. 23) calls the results only “initial promise,” and Section 4.3 (p. 12) says fine-tuning does not provide precise control. The paper therefore supports the ability to alter expressed traits, not the broader claim of an exceptional ability to mimic many human personalities. (LLM, conf=0.85)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, what Eliza did reveal was that humans are susceptible to projecting onto a chat bot an illusion of understanding, a valuable lesson that we should keep in mind.”
What the sources say
- Supportedcites Weizenbaum, 1966 source
The Discussion says ELIZA shows how easy it is to create and maintain an illusion of understanding. It also says the human speaker contributes to the plausibility of ELIZA’s responses and may believe they are being understood (Discussion, passages 2 and 5). (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Without explicit training on abstract reasoning tasks, humans can more effectively reach logical conclusions in familiar settings, and the same bias has been observed in LLMs (Dasgupta et al., 2022).”
What the sources say
- Supportedcites Dasgupta et al., 2022 source
The Figure 2 caption (Content effects on accuracy, p. 10) reports that humans and language models show similar content effects on reasoning tasks, including an advantage when content supports the logical inference. The Figure 17 caption (p. 60) also reports better model performance with realistic than arbitrary rules on the Wason task. (LLM, conf=0.92)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Without explicit training on abstract reasoning tasks, humans can more effectively reach logical conclusions in familiar settings, and the same bias has been observed in LLMs (Dasgupta et al., 2022).”
What the sources say
- Partly supportedcites Dasgupta et al., 2022 sourceExperimental — accuracy not yet measured
The Introduction (p. 2) says humans reason more accurately about familiar than abstract situations, and the study overview (p. 4) reports that language models show similar content effects. The paper does not establish the claim's qualifier that the humans lacked explicit training on abstract reasoning tasks. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Even more ambitious, an LLM has been embedded into the control system for a robot, which has an internal dialog with itself while carrying out tasks like fetching a glass of water (Huang et al., 2022).”
What the sources say
- Partly supportedcites Huang et al., 2022 sourceExperimental — accuracy not yet measured
Section 3.2 (p. 3) describes an LLM planner receiving feedback as a robot acts, and the Conclusion (p. 9) says this planning is fused with robotic control policies. The kitchen-task prompts (pp. 23–24) include bringing drinks and moving a water bottle, but do not show the robot fetching a glass of water specifically. (LLM, conf=0.85)
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
34 more claims · 2 with their cited sources checked
Create a free account to see all 220 claims and to verify the 8 references still open.
- It may state two separate claims as one. 62
- Probably not a substantial claim. 169
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, our understanding of how LLMs make decisions could help reveal general principles that govern both language intelligence and decision intelligence (70).”
From The emergence of economic rationality of GPT (2023) · cites this paper as [70]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In recent years, generative pre-trained transformer (GPT)-based models, AI tools generating large language models (LLMs), have been extensively testing and developing in healthcare at several levels, such as research, education, clinical decisions and patient communication [11,12,13].”
From Optimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge (2023) · cites this paper as [11]
Experimental — accuracy not yet measured
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“…made in the twentieth century inspired new machine learning algorithms: the hierarchy of areas in visual cortex inspired convolutional neural networks (LeCun et al., 1998, 2015), and operant conditioning inspired the temporal difference learning algorithm for reinforcement learning (Sutton, 1988).”
BackgroundBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Research works printed but not linked: 14
- Agüera y Arcas, 2022, Artificial neural networks are making strides towards consciousness, Economist
- Agüera y Arcas, 2022, Can machines learn how to behave?, Medium
- Allman, 1999, Evolving brains, Scientific American Library
- Amodei, 2018, AI and compute
- Arbib, 2010, The mirror system hypothesis, 3
- Bratton, 2022, The model is the message
- Chomsky, 1971, The case against B. F. Skinner, New York Review of Books, 7, 18
- Chomsky, 1986, Knowledge of language: Its nature, origins, and use
- Churchland, 2019, Conscience: The origins of moral intuition
- Hofstadter, 2022, Artificial neural networks are making strides towards consciousness, Economist
- Lemoine, 2022, Is LaMDA sentient?: An interview, Medium
- Lighthill, 1973, Artificial intelligence: A general survey
- Navlakha, 2018, Why animal extinction is crippling computer science, Wired
- Weinberg, 2020, Philosophers on GPT-3 (updated with replies by GPT-3), Daily Nous
Cited by
Katz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0254 · Cited by 420
“Details of these prompts and parameters are available in the online repository.”
BackgroundYu, H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1181712 · Cited by 409
“However, computer technology, programming, and algorithm theory at the time were still inadequate to meet the needs of AI development (Sejnowski, 2022).”
BackgroundLecler, A., Duron, L., & Soyer, P. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.003 · Cited by 385
The debate over understanding in AI’s large language models
Mitchell, M., & Krakauer, D. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2215907120 · Cited by 340
Catalyzing next-generation Artificial Intelligence through NeuroAI
Zador, A., Escola, S., Richards, B., Ölveczky, B., Bengio, Y., Boahen, K., Botvinick, M., Chklovskii, D., Churchland, A., Clopath, C., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37180-x · Cited by 300
“Inpart,theirsuccessrevealshoweasilywecanbetrickedintoimputing intelligence, agency, and even consciousness to our interlocutor 27 .”
Self-citationYu, H. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e24289 · Cited by 225
“To combat concerns of plagiarism, instruments like GPTZero and DetectGPT have been developed to discern AI-synthesized text [23].”
MethodRetractedKatz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2023) · doi:10.2139/ssrn.4389233 · Cited by 422
The emergence of economic rationality of GPT
Chen, Y., Liu, T. X., Shan, Y., & Zhong, S. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2316205120 · Cited by 164
“For example, our understanding of how LLMs make decisions could help reveal general principles that govern both language intelligence and decision intelligence (Sejnowski, 2023).”
BackgroundReddy, S. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101304 · Cited by 99
Roberts, J., Baker, M., & Andrew, J. (2024) · Critical Perspectives on Accounting · doi:10.1016/j.cpa.2024.102722 · Cited by 132
Hallucination or Confabulation? Neuroanatomy as metaphor in Large Language Models
Smith, A. L., Greaves, F., & Panch, T. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000388 · Cited by 117
Triguero, I., Molina, D., Poyatos, J., Del Ser, J., & Herrera, F. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102135 · Cited by 90
Generating meaning: active inference and the scope and limits of passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.10.002 · Cited by 80
“This suggests a lackofcausalunderstandingofactionsandthattheapparentmeaningfulnessofdialogueswithLLMsmightcomefromthe ease with which we project our mental states and agency into these systems [55,112].”
A bibliometric analysis of the rise of ChatGPT in medical research
Barrington, N. M., Gupta, N., Musmar, B., Doyle, D., Panico, N., Godbole, N., Reardon, T., & D’Amico, R. S. (2023) · Medical Sciences · doi:10.3390/medsci11030061 · Cited by 69
“LLMs have attracted a great deal of interest in the medical field [1] as they have the potential to revolutionize medical research, patient care, and education by processing vast quantities of data faster and more precisely than humans can [1–3].”
BackgroundLarge language models in psychiatry: Opportunities and challenges
Volkmer, S., Meyer‐Lindenberg, A., & Schwarz, E. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116026 · Cited by 77
Exploring the frontiers of LLMs in psychological applications: a comprehensive review
Ke, L., Tong, S., Cheng, P., & Peng, K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11297-5 · Cited by 147
“In psychological applications, these developments are reshaping interactions among data, language, and the environment (De Bot et al., 2007; Demszky et al., 2023), contributing significantly to various fields, including clinical (Thirunavukarasu et al., 2023), developmental (Frank, 2023;…”
Interactive repair and the foundations of language
Dingemanse, M., & Enfield, N. J. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.09.003 · Cited by 92
Foundation models are platform models: Prompting and the political economy of AI
Burkhardt, S., & Rieder, B. (2024) · Big Data & Society · doi:10.1177/20539517241247839 · Cited by 89
“…through some-times billions of labeled data examples, prompts describe them directly and intelligibly, using the capabilities of the underlying ‘ generalist ’ (Sejnowski, 2023) yet ‘ un fi nished ’ (Bommasani et al., 2022) general-purpose model as semantic embedding or, indeed, as foundation .”
Alvero, A. J., Lee, J., Regla-Vargas, A., Kizilcec, R. F., Joachims, T., & Antonio, A. L. (2024) · Journal of Big Data · doi:10.1186/s40537-024-00986-7 · Cited by 48
Attributions toward artificial agents in a modified Moral Turing Test
Aharoni, E., Fernandes, S., Brady, D. J., Alexander, C., Criner, M., Queen, K., Rando, J., Nahmias, E., & Crespo, V. (2024) · Scientific Reports · doi:10.1038/s41598-024-58087-7 · Cited by 46
La inteligencia artificial generativa y la educación universitaria: ¿Salió el genio de la lámpara?
Mendiola, M. S., & Carbajal-Degante, E. (2023) · Perfiles Educativos · doi:10.22201/iisue.24486167e.2023.especial.61692 · Cited by 135
“…indicios de una comprensión lectora de máquina asociada a la habilidad de procesar información textual similar a como lo haría un ser humano (Sejnowski, 2023 ), con tiempos de procesado menores, pero que incitan a la operabilidad en un marco ambiguo de información fidedigna, lo que causa…”
BackgroundXiao, X., Liang, J., Tong, J., & Wang, H. (2024) · Energies · doi:10.3390/en17102439 · Cited by 55
Observations on LLMs for Telecom Domain: Capabilities and Limitations
Soman, S., & Ranjani, H. G. (2023) · International Conference on AI-ML Systems (AIMLSystems) · doi:10.1145/3639856.3639892 · Cited by 54
“Motivated by recent evaluation reports [15–17], we investigate domain-specific capabilities and limitations of some models.”
Raghu Raman, R. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2273377 · Cited by 46
Predictive sequence learning in the hippocampal formation
Chen, Y., Zhang, H., Cameron, M., & B, T. J. S. A. (2024) · Neuron · doi:10.1016/j.neuron.2024.05.024 · Cited by 47
Self-citationPerformance without understanding: How ChatGPT relies on humans to repair conversational trouble
Pütz, O., & Esposito, E. (2024) · Discourse & Communication · doi:10.1177/17504813241271492 · Cited by 47
“As Sejnowski (2023) argues, what appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the users – not only, however, that of the current dialog partners who project onto them their beliefs and expectations, but also the intelligence of all the other humans…”
Research on Sentiment Analysis of Online Public Opinion Based on RoBERTa–BiLSTM–Attention Model
Deng, J., & Liu, Y. (2025) · Applied Sciences · doi:10.3390/app15042148 · Cited by 39
Levin, C., Suliman, M., Naimi, E., & Saban, M. (2024) · Journal of Clinical Nursing · doi:10.1111/jocn.17384 · Cited by 33
“The Turing Test, introduced by Alan Turing, is a method used to determine if a machine can exhibit intelligent behaviour that is equivalent or indistinguishable from human behaviour (Sejnowski, 2023 ).”
Beyond the Keyboard: Academic Writing in the Era of ChatGPT
Doskaliuk, B., & Zimba, O. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e207 · Cited by 29
Generative AI-Based Platform for Deliberate Teaching Practice: A Review and a Suggested Framework
Aperstein, Y., Cohen, Y., & Apartsin, A. (2025) · Education Sciences · doi:10.3390/educsci15040405 · Cited by 35
“In addition to standardized exams, LLMs have made significant strides in tasks like the Turing Test, which evaluates a machine’s ability to exhibit intelligent behavior indistinguishable from a human (Sejnowski, 2023).”
Exploring the role of large language models in radiation emergency response
Chandra, A., & Chakraborty, A. (2024) · Journal of Radiological Protection · doi:10.1088/1361-6498/ad270c · Cited by 27
“This output mimics human language in a strikingly natural manner, reflecting the effectiveness of the underlying foundational models [33].”
BackgroundEvaluating Privacy Compliance in Commercial Large Language Models - ChatGPT, Claude, and GeminiPreprint
Cartwright, O., Dunbar, H., & Radcliffe, T. (2024) · Research Square · doi:10.21203/rs.3.rs-4792047/v1 · Cited by 19
Li, D., Wu, L., Zhang, M., Shpyleva, S., Lin, Y.-C., Huang, H., Li, T., & Xu, J. (2024) · Frontiers in Drug Safety and Regulation · doi:10.3389/fdsfr.2024.1379260 · Cited by 20
“The potential to distill the essence of “ good reasoning ” through the lens of AI models opens new possibilities for re fi ning prompt structures and advancing the fi eld, as the AI could learn the intelligence underlying the prompt which was provided by human (Sejnowski, 2023) or another AI.”
Digital Dialogue—How Youth Are Interacting With Chatbots
Pratt, N., Madhavan, R., & Weleff, J. (2024) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2024.0084 · Cited by 20
Exploiting Privacy Vulnerabilities in Open Source LLMs Using Maliciously Crafted PromptsPreprint
Choquet, G., Aizier, A., & Bernollin, G. (2024) · Research Square · doi:10.21203/rs.3.rs-4584723/v1 · Cited by 27
Transformers and cortical waves: encoders for pulling in context across time
Muller, L., Churchland, P. S., & B, T. J. S. A. (2024) · Trends in Neurosciences · doi:10.1016/j.tins.2024.08.006 · Cited by 28
Self-citationAIsop: Exploring Immersive VR Storytelling Leveraging Generative AI
Gatti, E., Giunchi, D., Numan, N., & Steed, A. J. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw62533.2024.00229 · Cited by 17
“These models, trained on extensive datasets, can emulate patterns characteristic of human writing, often producing outputs nearly indistinguishable from human-authored texts [12].”
Enhancing Contextual Understanding of Mistral LLM with External Knowledge BasesPreprint
Sasaki, M., Watanabe, N., & Komanaka, T. (2024) · Research Square · doi:10.21203/rs.3.rs-4215447/v1 · Cited by 28
Animation and Artificial Intelligence
Stark, L. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658995 · Cited by 38
“…an animated entity entirely forecloses the need to entertain claims regarding its sentience or possession of rights analogous to those of humans [9,85]; highlights the specific mechanisms through which LLMs and other interactive AI systems draw and hold human attention; clarifies ChatGPT’s…”
BackgroundAn Inquiry Into the Use of Generative AI and Its Implications in Education: Boon or Bane
Baek, E. O., & Wilson, R. V. (2024) · International Journal of Adult Education and Technology · doi:10.4018/ijaet.349233 · Cited by 14
When Autonomy Breaks: The Hidden Existential Risk of AI
Krook, J. (2025) · AI & SOCIETY · doi:10.1007/s00146-025-02397-5 · Cited by 14
From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models
Messner, W., Greene, T., & Matalone, J. (2025) · Journal of Public Policy & Marketing · doi:10.1177/07439156251319788 · Cited by 26
“However, because we lack criteria for evaluating them, it is dif-fi cult to test whether they truly understand the content that they create (Sejnowski 2023).”
van Dijk, B., Kouwenhoven, T., Spruit, M. R., & van Duijn, M. J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.779 · Cited by 54
Di Paolo, L. D., White, B., Guénin-Carlut, A., Constant, A., & Clark, A. (2024) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2023.0148 · Cited by 14
“A more significant and pressing issue concerning LLMs is understanding how cognitive agents like us can best use LLMs’ capabilities, leveraging them in a way that aligns with the human cognitive landscape [17] (see also [18–22]).”
BackgroundUsability of large language models for building construction safety risk assessment
Oral, M., Alboga, Ö., Aydınlı, S., & Erdiş, E. (2025) · Engineering Construction & Architectural Management · doi:10.1108/ecam-08-2024-1143 · Cited by 19
“AI, will you help?” How learners use Artificial Intelligence when writing
Krajka, J., & Olszak, I. (2024) · XLinguae · doi:10.18355/xl.2024.17.01.03 · Cited by 26
Parker, J., Richard, V. M., & Becker, K. (2023) · The Qualitative Report · doi:10.46743/2160-3715/2023.6695 · Cited by 23
Manipulation and the Ai Act: Large Language Model Chatbots and the Danger of MirrorsPreprint
Krook, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4719835 · Cited by 23
Gomez, D., & Escobar, J. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ew4hs · Cited by 10
Wang, X., Tian, Y., Huang, K., & Liang, B. (2024) · Computers & Security · doi:10.1016/j.cose.2024.104113 · Cited by 13
“…through fine-tuning using specific datasets (Sejnowski, 2023), provides new ways to incorporate advanced AI into daily tasks in diverse domains (Sejnowski, 2023; Jiang et al., 2022; Bommasani et al., 2021), ranging from creative activities (Petridis et al., 2023; Mirowski et al., 2023; Jones…”
BackgroundLeveraging Large Language Models for Sustainable and Inclusive Web Accessibility
Andruccioli, M., Bassi, B., Delnevo, G., & Salomoni, P. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9100247 · Cited by 13
“LLMs are self-supervised foundational models that can be prompted or fine-tuned to perform a wide array of natural language processing tasks that once required separate, task-specific systems [33,34].”
Eight challenges in developing theory of intelligence
Huang, H. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1388166 · Cited by 12
“This raises a fundamental question what the nature of intelligence is or whether a single next-token context conditional prediction is a standard model of artificial general intelligence (Gerven, 2017; Lake et al., 2017; Sejnowski, 2023).”
BackgroundMongeau, J.-M., Yang, Y. J., Escalante, I., Cowan, N. J., & Jayaram, K. (2024) · Integrative and Comparative Biology · doi:10.1093/icb/icae121 · Cited by 12
Generating Meaning: Active Inference and the Scope and Limits of Passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2023) · doi:10.31234/osf.io/8xgzv · Cited by 8
Attention (to Virtuosity) Is All You Need: Religious Studies Pedagogy and Generative AI
Barlow, J., & Holt, L. (2024) · Religions · doi:10.3390/rel15091059 · Cited by 8
Roeschl, T., Hoffmann, M., Hashemi, D., Rarreck, F., Hinrichs, N., Trippel, T. D., Gröschel, M. I., Unbehaun, A., Klein, C., Kempfert, J., et al. (2025) · JMIRx Med · doi:10.2196/74899 · Cited by 24
“Basic research has indicated that LLMs struggle with lengthy texts [26] spanning over multiple prompts, potentially leading to memory loss [27] and texts with a low signal-to-noise ratio [28].”
Alif, H. A., Mashrafi, M. J., Islam, S. R., Fahim, A., Nath, A. D., & Ahmed, J. (2025) · Asian Conference on Innovation in Technology (ASIANCON) · doi:10.1109/asiancon66527.2025.11281210 · Cited by 9
“[ 2]There is little academic research on DeepSeek; nonetheless, it is presumed that the Mixture of Experts architecture facilitates organized and task-oriented replies, potentially advantageous in educational contexts.”
The new frontier: utilizing ChatGPT to expand craniofacial research
Zhang, A., Dimock, E., Gupta, R., & Chen, K. (2024) · Archives of Craniofacial Surgery · doi:10.7181/acfs.2024.00115 · Cited by 9
“LLMs are pretrained transformer models that are self-supervised and can be adapted with fine-tuning to a wide range of natural language tasks [1].”
BackgroundFine-tuning Llama with Case Law Data to Improve Legal Domain PerformancePreprint
Satterfield, N., Holbrook, P., & Wilcox, T. (2024) · doi:10.31219/osf.io/e6mjs · Cited by 8
Measuring the Perceived IQ of Multimodal Large Language Models Using Standardized IQ TestsPreprint
Wasilewski, E., & Jablonski, M. (2024) · doi:10.36227/techrxiv.171560572.29045385/v1 · Cited by 48
Automated Methodologies for Evaluating Lying, Hallucinations, and Bias in Large Language ModelsPreprint
Ecurali, G., & Thackeray, Z. (2024) · Research Square · doi:10.21203/rs.3.rs-4855434/v1 · Cited by 8
Stochastic Parrots or Intelligent Systems? A Perspective on True Depth of Understanding in LLMsPreprint
Borji, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4507038 · Cited by 12
Optimizing Knowledge Extraction in Large Language Models Using Dynamic Tokenization DictionariesPreprint
Chiappe, H., & Lennon, G. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/svj2z · Cited by 44
Capturing the full potential of Maltese language learning through ChatGPT
Żammit, J. (2024) · Technology in Language Teaching & Learning · doi:10.29140/tltl.v6n1.1082 · Cited by 14
Embodiment and agency in a digital world
Gangopadhyay, N., & Pichler, A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1392949 · Cited by 14
“In a further defense of ECA from the view of language as essentially an embodied skill, Sejnowski (2023) discusses the crucial role of embodiment in fine-tuning large language models (LLM) underlying artificial linguistic agents.”
BackgroundOptimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge
Pozzessere, C. (2023) · Tomography · doi:10.3390/tomography9020057 · Cited by 6
Shakespeare and Nonhuman Intelligence
Warren-Crow, H. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009202633 · Cited by 5
Chen, C. J., Bilolikar, V. K., VanNest, D., Raphael, J. S., & Shaffer, G. (2024) · Medicine Advances · doi:10.1002/med4.77 · Cited by 8
Messner, W. (2025) · Journal of World Business · doi:10.1016/j.jwb.2025.101622 · Cited by 10
Saad, O., Saban, M., Kerner, E., & Levin, C. (2025) · Journal of Primary Care & Community Health · doi:10.1177/21501319251326663 · Cited by 17
Huang, J., & Li, O. (2024) · doi:10.36227/techrxiv.171778886.62839657/v1 · Cited by 6
Yapay Zeka ve Bilinç: Anlamsal ve Duygusal/Heyecansal Boyutları Üzerinden Bir Değerlendirme
Karslı, T. A. (2024) · İnsan ve Toplum Bilimleri Araştırmaları Dergisi · doi:10.15869/itobiad.1517371 · Cited by 7
Barallat, J., Gómez, C., & Sancho-Cerro, A. (2023) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-0295 · Cited by 6
Rasenberg, M., Amha, A., Coler, M., van Koppen, M., van Miltenburg, E., de Rijk, L. E. M., Stommel, W., & Dingemanse, M. (2023) · Linguistics in the Netherlands · doi:10.1075/avt.00095.ras · Cited by 12
Comrie, D. (2023) · medRxiv · doi:10.1101/2023.04.17.23288681 · Cited by 5
Sak, M. E., Sonlu, S., & Güdükbay, U. (2025) · Computer Animation and Virtual Worlds · doi:10.1002/cav.70033 · Cited by 5
Training Users Against Human and GPT-4 Generated Social Engineering Attacks
Malloy, T., Ferreira, M. J., Fang, F., & González, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92833-8_4 · Cited by 10
Alvero, A., & Peña, C. (2023) · Journal of Social Computing · doi:10.23919/jsc.2023.0021 · Cited by 4
Xiaojian, Y., Zhanbo, Q., Chu, J., Wang, Z., Liu, J., Liu, J., Pan, Y., & Han, S. (2024) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-024-05992-z · Cited by 5
“Although LLMs were primarily used for text-based tasks, they have potential applications in molecular pathology, particularly in the integration and analysis of multimodal data, including text (such as clinical records) and images (such as pathology slides) (Sejnowski 2023).”
MethodIs it Possible to Preserve a Language using only Data?
Bensemann, J., Brown, J., Witbrock, M., & Yogarajan, V. (2023) · Cognitive Science · doi:10.1111/cogs.13300 · Cited by 5
Paolo, L. D. D., White, B. P., GUÉNIN--CARLUT, A., et al. (2024) · doi:10.31219/osf.io/zwa83 · Cited by 4
Zhang, C. C., & Wang, L. (2024) · Research Square · doi:10.21203/rs.3.rs-4560345/v1 · Cited by 5
Evaluating the Quality of Large Language Model-Generated Cybersecurity Advice in GRC SettingsPreprint
Li, Z., Wang, X., & Zhang, Q. (2024) · Research Square · doi:10.21203/rs.3.rs-4608321/v1 · Cited by 4
Evaluating the Impact of Environmental Semantic Distractions on Multimodal Large Language ModelsPreprint
Kuhozido, S., Dunfield, G., Ostrich, E., & Waterhouse, C. (2024) · Research Square · doi:10.21203/rs.3.rs-4880022/v1 · Cited by 4
Alleviating Elderly’s Medical Communication Issue with Personalized LLM-Generated Short-Form Video
Zhuang, N., Ma, Z., Zhou, Y., Li, X., Wang, P., Huang, Z., Zhai, S., & Ying, F. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240078 · Cited by 3
Natural Language Communication with Sensor Data Through a LLM-Integrated Protocol: A Case Study
Jia, F., Fonsati, A., & Gudmundsson, K. (2025) · Lecture notes in civil engineering · doi:10.1007/978-3-031-87364-5_6 · Cited by 5
Prisznyák, A. (2023) · Economy & finance · doi:10.33908/ef.2023.2.4 · Cited by 3
A challenge in A(G)I, cybernetics revived in the Ouroboros Model as one algorithm for all thinking
Thomsen, K. (2024) · Artificial Intelligence and Autonomous Systems · doi:10.55092/aias20240001 · Cited by 2
“Despite breathtaking recent advances in the demonstrated performance of Artificial Intelligence (AI), in particular of Large Language Models (LLMs), there are many prominent voices pointing out undeniable fundamental shortcomings of even the most powerful current approaches and programs [1–3].”
BackgroundThe Moral Turing Test: a defense
Bøhn, E. D. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00793-1 · Cited by 7
“10 9 For an interesting take on the relationship between LLM and TT, see Sejnowski (2023).”
Reevaluating development and embodiment in robotics
Asada, M., & Cangelosi, A. (2024) · Device · doi:10.1016/j.device.2024.100605 · Cited by 3
Modern Prometheus: tracing the ill-defined path to AGI
Landers, M. (2025) · AI & Society · doi:10.1007/s00146-025-02363-1 · Cited by 4
Attributions toward Artificial Agents in a modified Moral Turing TestPreprint
Aharoni, E., Fernandes, S., Brady, D. J., et al. (2024) · doi:10.31234/osf.io/4gxtk · Cited by 3
The role of trustworthy and reliable AI for multiple sclerosis
Werthen‐Brabants, L., Dhaene, T., & Deschrijver, D. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1507159 · Cited by 5
“For example, though Large Language Models have shown impressive results, they may still provide incorrect results, without any notion of uncertainty or trustworthiness (6).”
Qadir, J. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016479 · Cited by 17
“The effectiveness of each role relies heavily on the quality of the prompts, which—following the mirror hypothesis proposed by Sejnowski [29]—reflects the knowledge and intent of the prompt designer.”
Silicopathy: Artificial Empathy through Cognitive and Affective Development of Pain
Asada, M. (2025) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/icdl63968.2025.11204355 · Cited by 2
“While current LLMs lack developmental grounding [11], their semantic embeddings still reflect latent social associations related to pain, such as “dignity,” “fairness,” or “suffering.””
Ontology-Based Knowledge Graph Approach for Legal Queries
Pham, V. T., Dung, D. V., Ngo, H. Q., et al. (2026) · Informatica · doi:10.15388/25-infor617 · Cited by 2
Beyond computational equivalence: the behavioral inference principle for machine consciousness
Palminteri, S., & Wu, C. M. (2026) · Neuroscience of Consciousness · doi:10.1093/nc/niag002 · Cited by 7
“Thus, arriving at a consensus about what behavioral evidence warrants the attribution of consciousness to any given system will inevitably evolve as new data is acquired, new theories are proposed, and new goals are set (Mitchell & Krakauer, 2023; Sejnowski, 2023) .”
Prien, T., & Goldhammer, K. (2024) · Springer eBooks · doi:10.1007/978-3-658-34048-3_89-1 · Cited by 9
Can Language Models Trained on Written Monologue Learn to Predict Spoken Dialogue?
Umair, M., Mertens, J. B., Warnke, L., & de Ruiter, J. P. (2024) · Cognitive Science · doi:10.1111/cogs.70013 · Cited by 7
Around the Virtual Campfire: Early UX Insights into AI-Generated Stories in VR
Gatti, E., Giunchi, D., Numan, N., & Steed, A. J. (2025) · IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR) · doi:10.1109/aixvr63409.2025.00027 · Cited by 2
Metadata
- Authors
- Sejnowski, T. J.
- Affiliations
- Salk Institute for Biological Studies, La Jolla, CA 92093, U.S.A.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2023-02-17
- Volume
- 35
- Issue
- 3
- Pages
- 309-342
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- PMC
- PMC10177005
- OpenAlex
- W4319301677
- Cited by
- 169
- References
- 79
- Citations by year
- 2026: 32 · 2025: 40 · 2024: 64 · 2023: 32
- FWCI
- 151.26
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2020624)
- Canadian Institute for Advanced Research
- National Institute of Biomedical Imaging and Bioengineering (R01EB026899)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, reverse Turing test, machine intelligence, interviewer bias, GPT-3, LaMDA, self-supervised pre-training, fine-tuning, human-machine interaction, sensorimotor coupling, brain-inspired AI
- MeSH terms
- Artificial Intelligence, Brain, Humans, Language, Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.