Evidence of a predictive coding hierarchy in the human brain listening to speech
Open accessThe DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Abstract
Considerable progress has recently been made in natural language processing: deep learning algorithms are increasingly able to generate, summarize, translate and classify texts. Yet, these language models still fail to match the language abilities of humans. Predictive coding theory offers a tentative explanation to this discrepancy: while language models are optimized to predict nearby words, the human brain would continuously predict a hierarchy of representations that spans multiple timescales. To test this hypothesis, we analysed the functional magnetic resonance imaging brain signals of 304 participants listening to short stories. First, we confirmed that the activations of modern language models linearly map onto the brain responses to speech. Second, we showed that enhancing these algorithms with predictions that span multiple timescales improves this brain mapping. Finally, we showed that these predictions are organized hierarchically: frontoparietal cortices predict higher-level, longer-range and more contextual representations than temporal cortices. Overall, these results strengthen the role of hierarchical predictive coding in language processing and illustrate how the synergy between neuroscience and artificial intelligence can unravel the computational bases of human cognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Previous studies in the neural encoding literature all used LLMs that were only aware of the short-term context, i.e., where the context window size was as large as several tens of words1–10.”
From Incremental accumulation of linguistic context in artificial and biological neural networks (2025) · cites this paper as [5]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additionally, we focused on the intermediate-to-deep layers ( 𝑙 = 2 3 𝑛 𝑙𝑎𝑦𝑒𝑟𝑠 ) of each LLM, as suggested by Caucheteux et al. (2023). These layers merit particular attention due to their demonstrated superior predictive capabilities for human brain activity (Schrimpf et al., 2021; Caucheteux and King, 2022; Caucheteux et al., 2023).”
From Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis (2025) · cites this paper as Caucheteux et al., 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Recent studies have increasingly explored LLM representations as analogs to neuroimaging data, aligning and comparing the human brain with the LLM”
From Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis (2025) · cites this paper as Caucheteux et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“This finding is consistent with previous studies, which suggest that the 2 3 layer is optimal for predicting human brain activity (Schrimpf et al., 2021; Caucheteux and King, 2022; Caucheteux et al., 2023).”
From Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis (2025) · cites this paper as Caucheteux et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“While LLM representations are being increasingly studied as analogs of neuroimaging data when comparing and aligning human brain activity with LLM”
From Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis (2025) · cites this paper as Caucheteux et al., 2023
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 10×
“For each word, (1) we generated n = 10”
BackgroundMethodResultInfluentialScikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Self-citationGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0686-2 · Cited by 38,430
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 8×
“with F(Xk) = R(Xk ⊕ X̃k (d) ) − R(Xk) (equation (3)).”
MethodResultInfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Momentum Contrast for Unsupervised Visual Representation LearningPreprint
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. B. (2019) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1911.05722 · Cited by 16,321
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Research works printed but not linked: 6
- Toneva, M. & Wehbe, L. Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain). In Advances in Neural Information Processing Systems, Vol. 32 (Curran Associates, 2019).
- Holtzman, A., Buys, J., Maxwell Forbes, L. D. & Choi, Y. The curious case of neural text degeneration. In International Conference on Learning Representations (2020).
- Thakur, N., Reimers, N., Rücklé, A., Srivastava, A. & Gurevych, I. BEIR: a heterogenous benchmark for zero-shot evaluation of information retrieval models. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2) (2021).
- Caucheteux, C., Gramfort, A. & King, J.-R. Disentangling syntax and semantics in the brain with deep networks. In Proceedings of the 38th International Conference on Machine Learning, 1336-1348 (PMLR, 2021).
- Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, 4171–4186, (Association for Computational Linguistics, 2019).
- Bardes, A., Ponce, J. & LeCun, Y. VICReg: variance-invariance-covariance regularization for self-supervised learning. In International Conference on Learning Representations (2022).
Cited by
The language network as a natural kind within the broader landscape of the human brain
Fedorenko, E., Ivanova, A. A., & Regev, T. I. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-024-00802-4 · Cited by 293
“Indeed, this network is recruited for coherent texts more than for disconnected sentences 295,310,311 and can integrate information over multiple sentences 159,161,193,199,201 .”
BackgroundPrediction during language comprehension: what is next?
Ryskin, R., & Nieuwland, M. S. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.08.003 · Cited by 165
“tigations find that models engaged in (hierarchical multiscale) prediction provide the best fit to brain data [4,60,62,192].”
Driving and suppressing the human language network using large language models
Tuckute, G., Sathe, A., Srikant, S., Taliaferro, M., Wang, M., Schrimpf, M., Kay, K., & Fedorenko, E. G. (2024) · Nature Human Behaviour · doi:10.1038/s41562-023-01783-7 · Cited by 168
“…the LLMs were not developed with the goal of modelling human language processing, some of these models (especially the unidirectional Transformer architectures 14 ) have a remarkable capacity to mimic human language behaviour 16,17 and predict brain activity during language processing 18–23 .”
Shared functional specialization in transformer-based language models and the human brain
Kumar, S., Sumers, T. R., Yamakoshi, T., Goldstein, A., Hasson, U., Norman, K. A., Griffiths, T. L., Hawkins, R. D., & Nastase, S. A. (2024) · Nature Communications · doi:10.1038/s41467-024-49173-5 · Cited by 86
Zada, Z., Goldstein, A., Michelmann, S., Simony, E., Price, A. R., Hasenfratz, L., Barham, E., Zadbood, A., Doyle, W., Friedman, D. J., et al. (2024) · Neuron · doi:10.1016/j.neuron.2024.06.025 · Cited by 100
Metadata
- Authors
- Caucheteux, C., Gramfort, A., & King, J.-R.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- Centre National de la Recherche Scientifique (FR)
- Corresponding author
- Caucheteux, Charlotte
- King, Jean-Rémi
- Venue
- Nature Human Behaviour
- Published
- 2023-03-02
- Volume
- 7
- Issue
- 3
- Pages
- 430-441
- ISSN
- 2397-3374 (ISSN-L)
- PMC
- PMC10038805
- OpenAlex
- W4322766928
- Semantic Scholar
- 66c286df54551baba7351a1ed44019367e5aa7ea
- Cited by
- 308
- References
- 82
- Citations by year
- 2026: 78 · 2025: 109 · 2024: 76 · 2023: 43
- FWCI
- 45.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Human Behaviour (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HAL (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Philippe Foundation
- Agence Nationale de la Recherche (ANR-17-EURE-, ANR-17-EURE-0017, ANR-17)
- Université de Recherche Paris Sciences et Lettres (ANR-17-EURE-0017)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Keywords
- predictive coding, hierarchical predictive coding, speech perception, language processing, natural language models, short stories, frontoparietal cortex, temporal cortex, multiple time scales, computational neuroscience, artificial intelligence
- MeSH terms
- Artificial Intelligence, Auditory Perception, Brain, Humans, Speech, Temporal Lobe
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evidence of a predictive coding hierarchy in the human brain listening to speech. https://app.cochat.ai/papers/10.1038/s41562-022-01516-2
- The paper
- Caucheteux, C., Gramfort, A., & King, J.-R. (2023). Evidence of a predictive coding hierarchy in the human brain listening to speech. Nature Human Behaviour. https://doi.org/10.1038/s41562-022-01516-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.