Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 75 of the 79 references it cites were found in a registry or an index; 23 of the 68 sources its claims cite were checked for support.

Large Language Models and the Reverse Turing Test

Open access
Sejnowski, Terrence J. · 2023 · Neural Computation

Abstract

Large language models (LLMs) have been transformative. They are pretrained foundational models that are self-supervised and can be adapted with fine-tuning to a wide range of natural language tasks, each of which previously would have required a separate network model. This is one step closer to the extraordinary versatility of human language. GPT-3 and, more recently, LaMDA, both of them LLMs, can carry on dialogs with humans on many topics after minimal priming with a few examples. However, there has been a wide range of reactions and debate on whether these LLMs understand what they are saying or exhibit signs of intelligence. This high variance is exhibited in three interviews with LLMs reaching wildly different conclusions. A new possibility was uncovered that could explain this divergence. What appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the interviewer, a remarkable twist that could be considered a reverse Turing test. If so, then by studying interviews, we may be learning more about the intelligence and beliefs of the interviewer than the intelligence of the LLMs. As LLMs become more capable, they may transform the way we interact with machines and how they interact with each other. Increasingly, LLMs are being coupled with sensorimotor devices. LLMs can talk the talk, but can they walk the walk? A road map for achieving artificial general autonomy is outlined with seven major improvements inspired by brain systems and how LLMs could in turn be used to uncover new insights into brain function.

Overview

CoChat Summary

TL;DR

Sejnowski argues that apparent intelligence in large language models may often mirror the intelligence and expectations of the interviewer through priming, a phenomenon he calls a reverse Turing test. He reviews three divergent LLM interviews and outlines seven brain-inspired improvements needed for artificial general autonomy.

Key findings

  • LLM responses depend heavily on priming: Hofstadter’s nonsense-primed GPT-3 produced nonsensical answers, but with explicit prompts GPT-3 could reply “Nonsense,” explain why, and handle counterfactuals; Lemoine’s sentience-leading prompt elicited sentience claims from LaMDA.
  • The paper proposes the mirror hypothesis: LLMs may reflect the beliefs, expectations, and intelligence of the human partner, so interviews may reveal more about the interviewer than the LLM.
  • LLMs are not simply parroting stored text; they form internal latent representations and generalize, as illustrated by DALL-E generating “a sunset on Mars” and GPT-3 summarizing a technical abstract for a second-grade student.
  • Scale examples include LaMDA with 137 billion weights, GPT-3 with 175 billion weights, PaLM with 540 billion connections, and GPT-3 requiring 10^12 times more computing power to train than NETtalk in 1986.
  • The AGA roadmap lists seven improvements: goals/motivation, long-term memory, dialog continuity, sensory experience, a body, autonomy in uncertain environments, and extended development.

Methods

  • Design: conceptual/position paper, not a controlled empirical study; it analyzes published LLM interviews and illustrative priming examples.
  • Data: three interviews—Agüera y Arcas with LaMDA, Hofstadter with GPT-3, and Lemoine with LaMDA—plus author-generated GPT-3 prompts on nonsense and counterfactuals.
  • Analysis: qualitative comparison of how priming shapes LLM responses, used to motivate the mirror hypothesis and reverse Turing test; a formal test is proposed but not performed.

Limitations

  • The paper states there is no accepted definition for consciousness or intelligence and no consensus criteria for evaluating LLM intelligence or understanding.
  • It states that a formal test of the mirror hypothesis—having human raters assess interviewer and LLM intelligence and correlating them—could be done, but the paper only suggests informally scoring the three interviews.
  • Evident from the text: the evidence is selective interview excerpts and author-chosen prompts rather than a controlled study, so the mirroring conclusion is interpretive.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1162/neco_a_01563

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

21 Valid · 49 Not valid · 41 Not checked · 109 Own results and interpretations

34 more claims · 2 with their cited sources checked

Create a free account to see all 220 claims and to verify the 8 references still open.

See all claims — free account
  • It may state two separate claims as one. 62
  • Probably not a substantial claim. 169
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 79 references

Research works printed but not linked: 14

  1. Agüera y Arcas, 2022, Artificial neural networks are making strides towards consciousness, Economist
  2. Agüera y Arcas, 2022, Can machines learn how to behave?, Medium
  3. Allman, 1999, Evolving brains, Scientific American Library
  4. Amodei, 2018, AI and compute
  5. Arbib, 2010, The mirror system hypothesis, 3
  6. Bratton, 2022, The model is the message
  7. Chomsky, 1971, The case against B. F. Skinner, New York Review of Books, 7, 18
  8. Chomsky, 1986, Knowledge of language: Its nature, origins, and use
  9. Churchland, 2019, Conscience: The origins of moral intuition
  10. Hofstadter, 2022, Artificial neural networks are making strides towards consciousness, Economist
  11. Lemoine, 2022, Is LaMDA sentient?: An interview, Medium
  12. Lighthill, 1973, Artificial intelligence: A general survey
  13. Navlakha, 2018, Why animal extinction is crippling computer science, Wired
  14. Weinberg, 2020, Philosophers on GPT-3 (updated with replies by GPT-3), Daily Nous

Cited by

See all 169

Metadata

Authors
Sejnowski, T. J.
Affiliations
Salk Institute for Biological Studies, La Jolla, CA 92093, U.S.A.
Venue
Neural Computation
Publisher
MIT Press
Published
2023-02-17
Volume
35
Issue
3
Pages
309-342
ISSN
  • 0899-7667 (ISSN-L)
  • 1530-888X
OpenAlex
W4319301677
Cited by
169
References
79
Citations by year
2026: 32 · 2025: 40 · 2024: 64 · 2023: 32
FWCI
151.26
Type
journal article
Language
en
Open access
Locations
  • Neural Computation (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Science Foundation (2020624)
  • Canadian Institute for Advanced Research
  • National Institute of Biomedical Imaging and Bioengineering (R01EB026899)
Topics
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords
large language models, reverse Turing test, machine intelligence, interviewer bias, GPT-3, LaMDA, self-supervised pre-training, fine-tuning, human-machine interaction, sensorimotor coupling, brain-inspired AI
MeSH terms
Artificial Intelligence, Brain, Humans, Language, Learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Large Language Models and the Reverse Turing Test. https://app.cochat.ai/papers/10.1162/neco_a_01563
The paper
Sejnowski, T. J. (2023). Large Language Models and the Reverse Turing Test. Neural Computation. https://doi.org/10.1162/neco_a_01563

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.