Reasoning in Reference Games: Individual- vs. Population-Level Probabilistic Modeling
Open accessThe DOI matches its Crossref record; 102 of the 108 references it cites were found in a registry or an index.
Abstract
Recent advances in probabilistic pragmatics have achieved considerable success in modeling speakers' and listeners' pragmatic reasoning as probabilistic inference. However, these models are usually applied to population-level data, and so implicitly suggest a homogeneous population without individual differences. Here we investigate potential individual differences in Theory-of-Mind related depth of pragmatic reasoning in so-called reference games that require drawing ad hoc Quantity implicatures of varying complexity. We show by Bayesian model comparison that a model that assumes a heterogenous population is a better predictor of our data, especially for comprehension. We discuss the implications for the treatment of individual differences in probabilistic models of language use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




![Fig 5 Sketch of the full data-generating model as a probabilistic graphical model, using the conventions of [64]. The more abstract a parameter, the higher it is in the graph. Deterministic variables have double edges. Categorical variables have rectangular shape. Observed variables are shaded in gray. Boxes encircle the range of indices.](https://figures.cochat.ai/paper-figures/b5ebb41857d34d1793ee8e14603ef222/reasoning-in-reference-games-individual-vs-population-level-probabilistic-figure-5.jpg)


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Classically, the RSA framework is used to computationally model speakers’ and listeners’ behavior in communicative tasks such as the reference game [26,33,34,58].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [34]
The cited source says what the claim attributes to it.
In the citing paper
“The RSA model provides a framework to model different listener and speaker types that vary by the information they take into account to choose or interpret a message.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [34]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1093/oso/9780198503682.001.0001 · Cited by 7,878
Marr, D. (1982) · Cumulative Index of Computer Aided Architectural Design · Cited by 5,733
Barlow, H. B. (1983) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(83)90030-5 · Cited by 5,424
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Probability theory the logic of science
Jaynes, E. T., & Bretthorst, G. L. (2003) · Cited by 4,654
Probability Theory: The Logic of Science
Jaynes, E. T. (2003) · doi:10.1017/cbo9780511790423 · Cited by 4,045
Research works printed but not linked: 2
- Sobel J. Signaling Games. In: Sotomayor M, editor. Encyclopedia of Complexity and Systems Science. Springer Verlag; 2008.
- Jeffreys H. Theory of Probability. 3rd ed Oxford: Oxford University Press; 1961.
Cited by
Items 101–117 of 117
A Consideration of Experimental Techniques
Noveck, I. A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316027073.005
Noveck, I. A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316027073.006
Opinionated Conclusions and Considerations for the Future
Noveck, I. A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316027073.015
More Topics for Experimental Pragmatics: An All-You-Can-Eat Buffet
Noveck, I. A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316027073.014
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0008
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0007
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0006
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0001
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0004
Dogwhistles as a semantic/pragmatic phenomenon
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0002
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.002.0005
A probabilitic pragmatics for dogwhistles
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0003
Henderson, R. S., & McCready, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780191994319.003.0005
Duff, J., Mayn, A., & Demberg, V. (2026) · Open Mind · doi:10.1162/opmi.a.341 · Cited by 3
Polarity-like and discourse-sensitive distribution in Mandarin cónglái: A game-theoretic analysis
Li, Y., Hou, Y., Ma, C., & Jiang, Y. (2026) · Lingua · doi:10.1016/j.lingua.2026.104286
Evidence and Intervention: A Coupled Active-Inference Extension of Rational Speech Act ModelsPreprint
Gwon, Y., Murphy, E., & Chung, C. K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04347
(2026) · V&R unipress eBooks · doi:10.14220/9783737020428.209
Metadata
- Authors
- Franke, M., & Degen, J.
- Affiliations
- University of Tübingen (DE)
- Stanford University (US)
- Corresponding author
- Franke, Michael
- Degen, Judith
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-05-05
- Volume
- 11
- Issue
- 5
- Pages
- e0154854
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4858259
- OpenAlex
- W2346168649
- Cited by
- 115
- References
- 108
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 11 · 2023: 2 · 2022: 6 · 2021: 13 · 2020: 3 · 2019: 41 · 2018: 24 · 2017: 4 · 2016: 4
- FWCI
- 154.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (ZUK 63, DFG Schwerpunktprogramm 1727)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (Early Postdoc.Mobility Award)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Developmental and Educational Psychology › Child and Animal Learning Development
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- reference games, individual differences, theory of mind, quantity implicature, Bayesian model selection, population heterogeneity, pragmatic reasoning, comprehension, language use
- MeSH terms
- Bayes Theorem, Decision Making, Games, Experimental, Humans, Models, Statistical, Comprehension
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.