CoChat

Reasoning in Reference Games: Individual- vs. Population-Level Probabilistic Modeling

Open access
Franke, Michael, Degen, Judith · 2016 · PLOS ONE

The DOI matches its Crossref record; 102 of the 108 references it cites were found in a registry or an index.

Abstract

Recent advances in probabilistic pragmatics have achieved considerable success in modeling speakers' and listeners' pragmatic reasoning as probabilistic inference. However, these models are usually applied to population-level data, and so implicitly suggest a homogeneous population without individual differences. Here we investigate potential individual differences in Theory-of-Mind related depth of pragmatic reasoning in so-called reference games that require drawing ad hoc Quantity implicatures of varying complexity. We show by Bayesian model comparison that a model that assumes a heterogenous population is a better predictor of our data, especially for comprehension. We discuss the implications for the treatment of individual differences in probabilistic models of language use.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0154854

Cites

102 of 102 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Example contexts that require pragmatic reasoning of varying complexity.
Fig 1 Example contexts that require pragmatic reasoning of varying complexity.CC BY · PubMed Central
Fig 2 Left: proportions of target, competitor, and distractor choices in Experiment 1. Error bars indicate 95% bootstrapped confidence intervals. Right: proportion of target choices in simple and complex conditions by participant. Dot size indicates number of participants.
Fig 2 Left: proportions of target, competitor, and distractor choices in Experiment 1. Error bars indicate 95% bootstrapped confidence intervals. Right: proportion of target choices in simple and complex conditions by participant. Dot size indicates number of participants.CC BY · PubMed Central
Fig 3 Left: proportions of target, competitor, and distractor choices in Experiment 2. Error bars indicate 95% bootstrapped confidence intervals. Right: proportion of target choices in simple and complex conditions by participant. Dot size indicates number of participants.
Fig 3 Left: proportions of target, competitor, and distractor choices in Experiment 2. Error bars indicate 95% bootstrapped confidence intervals. Right: proportion of target choices in simple and complex conditions by participant. Dot size indicates number of participants.CC BY · PubMed Central
Fig 4 Probabilistic predictions of the rsa model under best-fitting parameter values (see main text), plotted against the observed choice frequencies. Each dot represents one choice option in one of our four reference games.
Fig 4 Probabilistic predictions of the rsa model under best-fitting parameter values (see main text), plotted against the observed choice frequencies. Each dot represents one choice option in one of our four reference games.CC BY · PubMed Central
Fig 5 Sketch of the full data-generating model as a probabilistic graphical model, using the conventions of [64]. The more abstract a parameter, the higher it is in the graph. Deterministic variables have double edges. Categorical variables have rectangular shape. Observed variables are shaded in gray. Boxes encircle the range of indices.
Fig 5 Sketch of the full data-generating model as a probabilistic graphical model, using the conventions of [64]. The more abstract a parameter, the higher it is in the graph. Deterministic variables have double edges. Categorical variables have rectangular shape. Observed variables are shaded in gray. Boxes encircle the range of indices.CC BY · PubMed Central
Fig 6 Marginal posterior for type priors Pτ (τi).
Fig 6 Marginal posterior for type priors Pτ (τi).CC BY · PubMed Central
Fig 7 Marginal posterior for participants' reasoning types τi.
Fig 7 Marginal posterior for participants' reasoning types τi.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 6

  1. P Baumann, 2014, Proceedings of CogSci
  2. JT Kao, 2014, Proceedings of CogSci
  3. C Qing, 2014, Proceedings of CogSci, 1204
  4. MH Tessler, 2014, Proceedings of CogSci
  5. M Franke, 2014, Proceedings of CogSci, 487
  6. M Franke, 2014, Semantics, Pragmatics and the Case of Scalar Implicatures. Palgrave Studies in Pragmatics Language and Cognition, 170

Cited by

See all 117

Metadata

Authors
Franke, M., & Degen, J.
Affiliations
  • University of Tübingen (DE)
  • Stanford University (US)
Corresponding author
  • Franke, Michael
  • Degen, Judith
Venue
PLOS ONE
Published
2016-05-05
Volume
11
Issue
5
Pages
e0154854
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2346168649
Cited by
115
References
108
Citations by year
2026: 4 · 2025: 3 · 2024: 11 · 2023: 2 · 2022: 6 · 2021: 13 · 2020: 3 · 2019: 41 · 2018: 24 · 2017: 4 · 2016: 4
FWCI
154.90
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • Deutsche Forschungsgemeinschaft (ZUK 63, DFG Schwerpunktprogramm 1727)
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (Early Postdoc.Mobility Award)
Topics
  • Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
  • Social Sciences › Psychology › Developmental and Educational Psychology › Child and Animal Learning Development
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
Keywords
reference games, individual differences, theory of mind, quantity implicature, Bayesian model selection, population heterogeneity, pragmatic reasoning, comprehension, language use
MeSH terms
Bayes Theorem, Decision Making, Games, Experimental, Humans, Models, Statistical, Comprehension

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.