CoChat
Sign Up
PreprintCited by 4Language and cultural evolutionCategorization, perception, and languageMulti-Agent Systems and Negotiation

The DOI matches its DataCite record.

Emergence of hierarchical reference systems in multi-agent communication

Open access
Ohmer, Xenia, Duda, Marko, Bruni, Elia·2022·arXiv
DOI 10.48550/arxiv.2203.13176arXiv 2203.13176
Open this paper in CoChat — free accountOpen PDF

Abstract

In natural language, referencing objects at different levels of specificity is a fundamental pragmatic mechanism for efficient communication in context. We develop a novel communication game, the hierarchical reference game, to study the emergence of such reference systems in artificial agents. We consider a simplified world, in which concepts are abstractions over a set of primitive attributes (e.g., color, style, shape). Depending on how many attributes are combined, concepts are more general ("circle") or more specific ("red dotted circle"). Based on the context, the agents have to communicate at different levels of this hierarchy. Our results show that the agents learn to play the game successfully and can even generalize to novel concepts. To achieve abstraction, they use implicit (omitting irrelevant information) and explicit (indicating that attributes are irrelevant) strategies. In addition, the compositional structure underlying the concept hierarchy is reflected in the emergent protocols, indicating that the need to develop hierarchical reference systems supports the emergence of compositionality.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2203.13176

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 44

  1. Jacob Andreas and Dan Klein. 2016. Reasoning about pragmatics with neural listeners and speakers. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1173-1182, Austin, Texas. Association for Compu- tational Linguistics. · DOI · Paper page
  2. Douglas Appelt and Amichai Kronfeld. 1987. A com- putational model of referring. In Proceedings of the 10th International Joint Conference on Artificial In- telligence (IJCAI), pages 640-647, San Francisco, CA, USA.
  3. Douglas E. Appelt. 1985. Planning English referring expressions. Artificial Intelligence, 26(1):1-33. · DOI
  4. Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lap- ata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, and Joseph Turian. 2020. Experience grounds language. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8718-8735, Online. Association for Computational Linguistics. · DOI
  5. Henry Brighton and Simon Kirby. 2006. Understand- ing linguistic evolution by visualizing the emergence of topographic mappings. Artificial Life, 12(2):229- 242. · DOI
  6. Angelo Cangelosi and Domenico Parisi. 2002. Simulat- ing the Evolution of Language. Springer, London. · DOI
  7. Rahma Chaabouni, Eugene Kharitonov, Diane Boucha- court, Emmanuel Dupoux, and Marco Baroni. 2020. Compositionality and generalization in emergent languages. In Proceedings of the 58th Annual Meet- ing of the Association for Computational Linguistics, pages 4427-4442, Online. Association for Computa- tional Linguistics. · DOI
  8. Edward Choi, Angeliki Lazaridou, and Nando de Fre- itas. 2018. Compositional obverter communication learning from raw visual input. In 6th International Conference on Learning Representations.
  9. Gautier Dagan, Dieuwke Hupkes, and Elia Bruni. 2021. Co-evolution of language and agents in referential games. In Proceedings of the 16th Conference of the European Chapter of the Association for Computa- tional Linguistics: Main Volume, pages 2993-3004, Online. Association for Computational Linguistics. · DOI
  10. Robert Dale and Ehud Reiter. 1995. Computational interpretations of the gricean maxims in the gener- ation of referring expressions. Cognitive Science, 19(2):233-263. · DOI
  11. Roberto Dessi, Eugene Kharitonov, and Baroni Marco. 2021. Interpretable agent communication from scratch (with a generic visual processor emerging on the side). In Advances in Neural Information Processing Systems (NeurIPS), volume 34, pages 26937-26949.
  12. Jakob N. Foerster, Yannis M. Assael, Nando de Freitas, and Shimon Whiteson. 2016. Learning to commu- nicate with deep multi-agent reinforcement learning. In Advances in Neural Information Processing Sys- tems (NeurIPS), volume 30, pages 2145-2153, Red Hook, NY, USA.
  13. Michael C. Frank and Noah D. Goodman. 2012. Pre- dicting pragmatic reasoning in language games. Sci- ence, 336(6084):998-998. · DOI · Paper page
  14. Herbert P. Grice. 1975. Logic and conversation. In Syntax and Semantics 3: Speech Acts, pages 41-58. Academic Press, New York, NY.
  15. Serhii Havrylov and Ivan Titov. 2017. Emergence of language with multi-agent games: Learning to communicate with sequences of symbols. In Ad- vances in Neural Information Processing Systems (NeurIPS), volume 30, pages 2149-2159.
  16. Irina Higgins, Nicolas Sonnerat, Loic Matthey, Arka Pal, Christopher P. Burgess, Matko Bosnjak, Murray Shanahan, Matthew Botvinick, Demis Hassabis, and Alexander Lerchner. 2018. SCAN: Learning hierar- chical compositional visual concepts. In 6th Inter- national Conference on Learning Representations.
  17. Eric Jang, Shixiang Gu, and Ben Poole. 2017. Cate- gorical reparameterization with gumbel-softmax. In 5th International Conference on Learning Represen- tations.
  18. Yipeng Kang, Tonghan Wang, and Gerard de Melo. 2020. Incorporating pragmatic reasoning communi- cation into emergent language. In Advances in Neu- ral Information Processing Systems (NeurIPS), vol- ume 33, pages 10348-10359.
  19. Sahar Kazemzadeh, Vicente Ordonez, Mark Matten, and Tamara Berg. 2014. ReferItGame: Referring to objects in photographs of natural scenes. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 787-798, Doha, Qatar. Association for Com- putational Linguistics. · DOI
  20. Eugene Kharitonov, Rahma Chaabouni, Diane Boucha- court, and Marco Baroni. 2019. EGG: a toolkit for research on emergence of lanGuage in games. In Proceedings of the 2019 Conference on Empiri- cal Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations, pages 55-60, Hong Kong, China. Association for Computational Linguistics. · DOI
  21. Simon Kirby. 2002. Natural language from artificial life. Artificial life, 8(2):185-215. · DOI
  22. Satwik Kottur, José Moura, Stefan Lee, and Dhruv Batra. 2017. Natural language does not emerge 'naturally' in multi-agent dialog. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2962-2967, Copenhagen, Denmark. Association for Computa- tional Linguistics. · DOI · Paper page
  23. Emiel Krahmer and Kees van Deemter. 2012. Compu- tational generation of referring expressions: A sur- vey. Computational Linguistics, 38(1):173-218. · DOI
  24. Angeliki Lazaridou and Marco Baroni. 2020. Emer- gent multi-agent communication in the deep learning era. Computing Research Repository, arXiv:abs/2006.02419. Version
  25. Angeliki Lazaridou, Alexander Peysakhovich, and Marco Baroni. 2017. Multi-agent cooperation and the emergence of (natural) language. In 5th Interna- tional Conference on Learning Representations.
  26. Hieu Le, Taufiq Daryanto, Fabian Zhafransyah, Derry Wijaya, Elizabeth Coppock, and Sang Chin. 2022. Referring expressions with rational speech act framework: A probabilistic approach. Computing Research Repository, arXiv:2205.07795. · DOI
  27. David Lewis. 1969. Convention. Harvard University Press, Cambridge, MA.
  28. Gen Luo, Yiyi Zhou, Xiaoshuai Sun, Liujuan Cao, Chenglin Wu, Cheng Deng, and Rongrong Ji. 2020. Multi-task collaborative network for joint referring expression comprehension and segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). · DOI
  29. Ruotian Luo and Gregory Shakhnarovich. 2017. Comprehension-guided referring expressions. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3125-3134. · DOI
  30. Junhua Mao, Jonathan Huang, Alexander Toshev, Oana Camburu, Alan Yuille, and Kevin Murphy. 2016. Generation and comprehension of unambiguous ob- ject descriptions. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 11- 20. · DOI
  31. Will Monroe and Christopher Potts. 2015. Learning in the rational speech acts model. Computing Research Repository, arXiv:1510.06807. · DOI
  32. Martin A. Nowak, Joshua B. Plotkin, and Vincent A. A. Jansen. 2000. The evolution of syntactic communi- cation. Nature, 404(6777):495-498. · DOI
  33. Ehud Reiter and Robert Dale. 1992. A fast algorithm for the generation of referring expressions. In Pro- ceedings of the 14th International Conference on Computational Linguistics, pages 232-238, USA. Association for Computational Linguistics. · DOI
  34. Diana Rodríguez Luna, Edoardo Maria Ponti, Dieuwke Hupkes, and Elia Bruni. 2020. Internal and ex- ternal pressures on language emergence: least ef- fort, object constancy and frequency. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4428-4437, Online. Associa- tion for Computational Linguistics. · DOI
  35. Eleanor Rosch and Carolyn B Mervis. 1975. Family re- semblances: Studies in the internal structure of cate- gories. Cognitive Psychology, 7(4):573-605. · DOI · Paper page
  36. Eleanor Rosch, Carolyn B Mervis, Wayne D Gray, David M Johnson, and Penny Boyes-Braem. 1976. Basic objects in natural categories. Cognitive Psy- chology, 8(3):382-439. · DOI · Paper page
  37. Luc Steels. 2001. Language games for autonomous robots. IEEE Intelligent Systems, 16(5):16-22. · DOI
  38. Luc Steels. 2003. Evolving grounded communication for robots. Trends in Cognitive Sciences, 7(7):308- 312. · DOI
  39. Oskar van der Wal, Silvan de Boer, Elia Bruni, and Dieuwke Hupkes. 2020. The grammar of emergent languages. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Process- ing (EMNLP), pages 3339-3359, Online. Associa- tion for Computational Linguistics. · DOI
  40. Kyle Wagner, James A. Reggia, Juan Uriagereka, and Gerald S. Wilkinson. 2003. Progress in the sim- ulation of emergent communication and language. Adaptive Behavior, 11(1):37-69. · DOI
  41. Terry Winograd. 1972. Understanding natural lan- guage. Cognitive Psychology, 3(1):1-191. · DOI
  42. Licheng Yu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Mohit Bansal, and Tamara L. Berg. 2018. Mat- tnet: Modular attention network for referring expres- sion comprehension. In IEEE Conference on Com- puter Vision and Pattern Recognition (CVPR), pages 1307-1315. · DOI
  43. Licheng Yu, Patrick Poirson, Shan Yang, Alexander C. Berg, and Tamara L. Berg. 2016. Modeling context in referring expressions. In European Conference on Computer Vision (ECCV), pages 69-85, Cham. Springer International Publishing.
  44. Luyao Yuan, Zipeng Fu, Jingyue Shen, Lu Xu, Jun- hong Shen, and Song-Chun Zhu. 2020. Emergence of pragmatics from referential game between theory of mind agents. Computing Research Repository, arXiv:2001.07752. Version 2. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Ohmer, X., Duda, M., & Bruni, E.
Affiliations
Osnabrück University (DE)
ORCID
Ohmer, Xenia
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2203.13176
arXiv
2203.13176
OpenAlex
W4221147406
Cited by
4
References
0
Citations by year
2026: 1 · 2025: 1 · 2024: 2
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
Deutsche Forschungsgemeinschaft (GRK 2340)
Topics
  • Social Sciences › Cultural Studies › Language and cultural evolution
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
Keywords
multi-agent communication, concept hierarchy, compositional semantics, abstraction, communication games, artificial agents

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review