The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Colors in Context: A Pragmatic Neural Model for Grounded Language Understanding
Open accessAbstract
We present a model of pragmatic referring expression interpretation in a grounded communication task (identifying colors from descriptions) that draws upon predictions from two recurrent neural network classifiers, a speaker and a listener, unified by a recursive pragmatic reasoning framework. Experiments show that this combined pragmatic model interprets color descriptions more accurately than the classifiers from which it is built, and that much of this improvement results from combining the speaker and listener perspectives. We observe that pragmatic reasoning helps primarily in the hardest cases: when the model must distinguish very similar colors, or when few utterances adequately express the target color. Our findings make use of a newly-collected corpus of human utterances in color reference games, which exhibit a variety of pragmatic behaviors. We also show that the embedded speaker model reproduces many of these pragmatic behaviors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Modeling pragmatic agents based on neural network architectures can help to scale the applicability of the RSA framework [56,65–67].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [66]
The cited source says what the claim attributes to it.
In the citing paper
“Instead of the computationally costly Bayesian inference in the classical RSA paradigm, neural-network-based approaches for RSA-based referring expression generation approximate the inference, for example by directly taking into account the interpretation of an internal listener model [56,57,65–67].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [66]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Feature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Scorekeeping in a language game
Lewis, D. (1979) · Journal of Philosophical Logic · doi:10.1007/bf00258436 · Cited by 2,467
Referring as a collaborative process
Clark, H. H., & Wilkes-Gibbs, D. (1986) · Cognition · doi:10.1016/0010-0277(86)90010-7 · Cited by 2,401
Sharma, G., Wu, W., & Dalal, E. N. (2005) · Color Research & Application · doi:10.1002/col.20070 · Cited by 2,175
Information structure in discourse: Towards an integrated formal theory of pragmatics
Roberts, C. (2012) · Semantics and Pragmatics · doi:10.3765/sp.5.6 · Cited by 1,919
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Self-citationPredicting pragmatic reasoning in language games
Frank, M. C., & Goodman, N. D. (2012) · Science · doi:10.1126/science.1218633 · Cited by 868
Self-citationJournal of Philosophical Logic
(2013) · Journal of Philosophical Logic · doi:10.1007/10992.1573-0433 · Cited by 777
Pragmatic Language Interpretation as Probabilistic Inference
Goodman, N. D., & Frank, M. C. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.08.005 · Cited by 594
Self-citationThe effects of common ground and perspective on domains of referential interpretation
Hanna, J. E., Tanenhaus, M. K., & Trueswell, J. C. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(03)00022-6 · Cited by 531
Knowledge and Implicature: Modeling Language Understanding as Social Cognition
Goodman, N. D., & Stuhlmüller, A. (2013) · Topics in Cognitive Science · doi:10.1111/tops.12007 · Cited by 397
Self-citationKrauss, R. M., & Weinheimer, S. (1964) · Psychonomic Science · doi:10.3758/bf03342817 · Cited by 274
Brown‐Schmidt, S., & Tanenhaus, M. K. (2008) · Cognitive Science · doi:10.1080/03640210802066816 · Cited by 231 · cited 1×
“Since they offer the simplest experimental setup where many pragmatic and discourse-level phenomena emerge, these games have been used widely in cognitive science to study topics like common ground and conventionalization (Clark and Wilkes-Gibbs, 1986), referential domains (Brown-Schmidt and Tanenhaus, 2008), perspect…”
BackgroundPragmatic reasoning through semantic inference
Bergen, L., Lévy, R., & Goodman, N. D. (2016) · Semantics and Pragmatics · doi:10.3765/sp.9.20 · Cited by 211
Self-citationNonliteral understanding of number words
Kao, J. T., Wu, J. Y., Bergen, L., & Goodman, N. D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407479111 · Cited by 189
Self-citationAsking for Help Using Inverse Semantics
Tellex, S., Knepper, R., Li, A., Rus, D., & Roy, N. (2014) · Robotics: Science and Systems X · doi:10.15607/rss.2014.x.024 · Cited by 163
Factors causing overspecification in definite descriptions
Koolen, R., Albert Gatt, A., Goudbeek, M. B., & Krahmer, E. (2011) · Journal of Pragmatics · doi:10.1016/j.pragma.2011.06.008 · Cited by 137
A Game-Theoretic Approach to Generating Spatial Descriptions
Golland, D., Liang, P., & Klein, D. (2010) · Cited by 132
Reasoning about Pragmatics with Neural Listeners and Speakers
Andreas, J., & Klein, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1125 · Cited by 115
Language processing in the natural world
Tanenhaus, M. K., & Brown‐Schmidt, S. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2162 · Cited by 100
THE WORLD COLOR SURVEY DATABASE
Cook, R. S., Kay, P., & Regier, T. (2005) · Elsevier eBooks · doi:10.1016/b978-008044612-7/50064-0 · Cited by 71
A Bayesian Model of Grounded Color Semantics
McMahan, B., & Stone, M. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00126 · Cited by 59
Learning in the Rational Speech Acts Model
Monroe, W., & Potts, C. (2015) · Proceedings of the Amsterdam Colloquium · doi:10.53437/ph73fp56 · Cited by 57
Self-citationLearning and using language via recursive pragmatic reasoning about other agents
Smith, N. J., Goodman, N. D., & Frank, M. C. (2013) · neural information processing systems · Cited by 56
Self-citationSpeakers' and Listeners' Processes in a Word-Communication Task
Rosenberg, S., & Cohen, B. D. (1964) · Science · doi:10.1126/science.145.3637.1201 · Cited by 51
Conducting real-time multiplayer experiments on the web
Hawkins, R. X. D. (2014) · Behavior Research Methods · doi:10.3758/s13428-014-0515-6 · Cited by 44
Self-citationImplicatures and Nested Beliefs in Approximate Decentralized-POMDPs
Vogel, A. P., Potts, C., & Jurafsky, D. (2013) · Cited by 33
Self-citationGenerating and Resolving Vague Color Reference
Meo, T., McMahan, B., & Stone, M. (2014) · Cited by 24
Character Sequence Models for Colorful Words
Kawakami, K., Dyer, C., Routledge, B., & Smith, N. A. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1202 · Cited by 20
Learning to Generate Compositional Color Descriptions
Monroe, W., Goodman, N. D., & Potts, C. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1243 · Cited by 18
Self-citationA Multimodal Corpus of Rapid Dialogue Games
Paetzel, M., Racca, D. N., & DeVault, D. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2exnptwfkvbc · Cited by 14
Towards a Flexible Semantics: Colour Terms in Collaborative Reference Tasks
Baumgaertner, B. O., Fernández, R., Stone, M., Agirre, E., Bos, J., & Diab, M. (2012) · UvA-DARE (University of Amsterdam) · Cited by 5
Cited by
Speaker-Follower Models for Vision-and-Language Navigation
Fried, D., Hu, R., Cirik, V., Rohrbach, A., Andreas, J., Morency, L.-P., Berg-Kirkpatrick, T., Saenko, K., Klein, D., & Darrell, T. (2018) · arXiv · doi:10.48550/arxiv.1806.02724 · Cited by 291
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-Training
Hao, W., Li, C., Li, X., Carin, L., & Gao, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01315 · Cited by 264
ReferIt3D: Neural Listeners for Fine-Grained 3D Object Identification in Real-World Scenes
Achlioptas, P., Abdelreheem, A., Xia, F., Elhoseiny, M., & Guibas, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_25 · Cited by 253
Human-level play in the game of Diplomacy by combining language models with strategic reasoning
Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., et al. (2022) · Science · doi:10.1126/science.ade9097 · Cited by 241
ArtEmis: Affective Language for Visual Art
Achlioptas, P., Ovsjanikov, M., Haydarov, K., Elhoseiny, M., & Guibas, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01140 · Cited by 161
Metadata
- Authors
- Monroe, W., Hawkins, R. X. D., Goodman, N. D., & Potts, C.
- Affiliations
- Stanford University (US)
- Corresponding author
- Monroe, Will
- Hawkins, Robert X.D.
- Goodman, Noah D.
- Potts, Christopher
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2017-12
- Volume
- 5
- Pages
- 325-338
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2604397416
- Cited by
- 94
- References
- 38
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 13 · 2022: 7 · 2021: 23 · 2020: 16 · 2019: 14 · 2018: 9 · 2017: 3
- FWCI
- 14.96
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation ((DGE-114747, 114747, 1456077)
- Alfred P. Sloan Foundation
- Defense Advanced Research Projects Agency (FA8750, FA8750‐14‐2‐0009)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- referring expressions, pragmatic reasoning, color description, recurrent neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.