CoChat

Are Pretrained Language Models Symbolic Reasoners over Knowledge?

Open access
Kassner, Nora, Krojer, Benno, Schütze, Hinrich · 2020 · Proceedings of the 24th Conference on Computational Natural Language Learning
Cited by 35

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Abstract

How can pretrained language models (PLMs) learn factual knowledge from the training set?We investigate the two most important mechanisms: reasoning and memorization.Prior work has attempted to quantify the number of facts PLMs learn, but we present, using synthetic data, the first study that investigates the causal relation between facts present in training and facts learned by the PLM.For reasoning, we show that PLMs seem to learn to apply some symbolic reasoning rules correctly but struggle with others, including two-hop reasoning.Further analysis suggests that even the application of learned reasoning rules is flawed.For memorization, we identify schema conformity (facts systematically supported by other facts) and frequency as key factors for its success.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2020.conll-1.45

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Cited by

  • Measuring and improving consistency in pretrained language models

    Elazar, Y., Kassner, N., Ravfogel, S., Ravichander, A., Hovy, E., Schütze, H., & Goldberg, Y. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00410 · Cited by 220

    “…2020) perform on linguistic tasks (Goldberg, 2019; Hewitt and Man-ning, 2019; Tenney et al., 2019; Elazar et al., 2021), commonsense (Forbes et al., 2019; Da and Kasai, 2019; Zhang et al., 2020) and reasoning (Talmor et al., 2020; Kassner et al., 2020), usually assessed by measures of accuracy.”
    BackgroundSelf-citation
  • Language Model Behavior: A Comprehensive Survey

    Chang, T. A., & Bergen, B. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00492 · Cited by 105

  • Impact of Pretraining Term Frequencies on Few-Shot Numerical Reasoning

    Razeghi, Y., Logan IV, R. L., Gardner, M., & Singh, S. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.59 · Cited by 89

    “Impact of Frequency on LM Performance Kassner et al. (2020) and Wei et al. (2021) perform controlled experiments varying pretraining data to characterize the extent to which pretraining affects LMs’ ability to memorize and reason with facts as well as learn generalizable syntax rules.”
    Method
  • AND does not mean OR: Using Formal Languages to Study Language Models’ Representations

    Traylor, A., Feiman, R., & Pavlick, E. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.18653/v1/2021.acl-short.21 · Cited by 19

    “Most closely re-lated is work that assesses whether models can perform symbolic reasoning about language (Kassner et al., 2020) e.g., quantifiers or negation (Talmor et al., 2020; Ettinger, 2020; Kassner and Sch¨utze, 2020; Wang et al., 2018) or by measuring the sys-tematicity of models’ inferences…”
    Background

See all 35

Metadata

Authors
Kassner, N., Krojer, B., & Schütze, H.
Venue
Proceedings of the 24th Conference on Computational Natural Language Learning
Published
2020
Pages
552-564
OpenAlex
W3091922147
Cited by
35
References
16
FWCI
3.02
Type
conference paper
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Are Pretrained Language Models Symbolic Reasoners over Knowledge? https://app.cochat.ai/papers/10.18653/v1/2020.conll-1.45
The paper
Kassner, N., Krojer, B., & Schütze, H. (2020). Are Pretrained Language Models Symbolic Reasoners over Knowledge? Proceedings of the 24th Conference on Computational Natural Language Learning. https://doi.org/10.18653/v1/2020.conll-1.45

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.