The DOI matches its Crossref record; 34 of the 39 references it cites were found in a registry or an index.
Emergence of Grounded Compositional Language in Multi-Agent Populations
Open accessAbstract
By capturing statistical patterns in large corpora, machine learning has enabled significant advances in natural language processing, including in machine translation, question answering, and sentiment analysis. However, for agents to intelligently interact with humans, simply capturing the statistical patterns is insufficient. In this paper we investigate if, and how, grounded compositional language can emerge as a means to achieve goals in multi-agent populations. Towards this end, we propose a multi-agent learning environment and learning methods that bring about emergence of a basic compositional language. This language is represented as streams of abstract discrete symbols uttered by agents over time, but nonetheless has a coherent structure that possesses a defined vocabulary and syntax. We also observe emergence of non-verbal communication such as pointing and guiding when language communication is unavailable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“While some studies in the machine-learning emergent communication literature have focused on other reinforcement learning settings (Foerster et al., 2016;Mordatch & Abbeel, 2018, e.g.,), they have not made direct contact with general, cognitively-motivate principles that are believed to underlie human language, such as IB.”
From Towards Human-Like Emergent Communication via Utility, Informativeness, and Complexity (2025) · cites this paper as Mordatch & Abbeel, 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,789
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
The Concrete Distribution: A Continuous Relaxation of Discrete Random VariablesPreprint
Maddison, C. J., Mnih, A., & Teh, Y. W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00712 · Cited by 2,170
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
Research works printed but not linked: 2
- Ng, A. 2011. Sparse autoencoder. CS294A Lecture notes 72(2011):1-19.
- Teh, Y. W. 2011. Dirichlet process. In Encyclopedia of machine learning . Springer. 280-287.
Cited by
Sorted by citations
Items 401–440 of 440
Viet, A. P., Galhenage, E. L., Neumann, A., Neumann, F., Uzunov, A. V., & Szabo, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4972-6_30
ACoL: From Abstractions to Grounded Languages for Robust Coordination of Task Planning Robots
Zhang, Y. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247212
Individual bounded rationality destabilizes cooperative dynamics in human–AI groupsPreprint
Tsutsui, K., Mizuguchi, N., Goto, Y., Onagawa, R., Kano, F., Kudo, K., Isaka, T., & Fujii, K. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.11.30.691459
Camouflage Adversarial Attacks on Multi-Agent Reinforcement Learning Systems
Lu, Z., Liu, G., Lai, L., & Xu, W. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3644869
Multi‐Agent Reinforcement Learning Algorithm Based on Local Observation Imitation Learning
Zhang, H., Fu, J., Zhang, Y., & Du, H. (2025) · IET Control Theory and Applications · doi:10.1049/cth2.70097 · Cited by 1
An Experimental Study of Linear Attention in Multi-Agent Transformer
Ta, X. D., Le, V. M., & Ta, V. C. (2025) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse68178.2025.11309571
Adaptive Confidence and Credibility-Aware Advising for Robust Ad Hoc Teamwork
Zhu, M. Y., & Xie, L. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-4821-7_16
Fındık, Y., & Azadeh, R. (2025) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc57313.2025.11312555
Privacy Preserving for Peer-to-Peer Communication in Multi-Agent Reinforcement Learning
Zhang, F., Liu, H., & Liu, Y. (2025) · IEEE International Conference on Control Theory and Applications (ICoCTA) · doi:10.1109/icocta66834.2025.11337367
Wang, Y., Han, Y., Xing, N., & Zhao, X. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-5021-0_9
Kuppala, N., Monish, G., Nivedha, V., & Pinnenti, B. (2025) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn67655.2025.11368234
A graph-based safe reinforcement learning method for multi-agent cooperation
Gou, F., Du, H., & Cai, Y. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.108693
The Utility and Implementation of Explicit Commands for Ad-Hoc Coordination
Flavin, T., & Sen, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-17542-7_3
Li, W. J., Lv, J., Liu, H., Huang, K., & Song, A. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3628971
Analyse d'opinion dans les interactions orales
Barriere, V. (2019) · theses.fr (ABES) · doi:10.70675/d65df106z9fe1z44f0zb9bbzb1caa1590c7a
Automatic Curriculum Learning for Developmental Machine Learners
Portelas, R. (2022) · theses.fr (ABES) · doi:10.70675/947677c7z2ec1z4b61zbae3z6f358c02b050
Emerging linguistic universals in communicating neural network agents
Chaabouni, R. (2021) · theses.fr (ABES) · doi:10.70675/bc536b46z9d4ez461bz8607zde5f498ca922
Improving Cooperation in Multi-agent Deep Reinforcement Learning for Mobile Robotics
Toquebiau, M. (2024) · theses.fr (ABES) · doi:10.70675/3385d0bbzc66cz4fceza9e0z8696ff61ff4e
Communicative feedback in language acquisition
Nikolaus, M. (2023) · theses.fr (ABES) · doi:10.70675/342c36b9z6940z46ebz8631ze90a4ba4ae7a
Enjeux éthiques de l'apprentissage automatique et du Big Data : une perspective herméneutique
Demichelis, R. (2023) · theses.fr (ABES) · doi:10.70675/c644fb5azca2bz4644zbed6z0e4f6b41dfe0
Louati, F., Ktata, F. B., & Amous, I. (2026) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-026-05076-5
MAGPIE: Utilizing Agent-Specific Preferences for Multi-Agent Reinforcement Learning
Mu, N., Luan, Y., & Jia, Q. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11486931 · Cited by 1
CovMADT: efficient offline multi-agent reinforcement learning via convex Markov games
Wen, S., Wang, R., Wu, D., & Wang, Z. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07241-x
Research on Multi-agent Game Methods Based on the Cournot Duopoly Strategy Model
Song, C., Yang, B., Liu, Y., Zhao, H., & Zhuang, Y. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-7648-7_41
Scaling Up Multi-Agent Reinforcement Learning for Large Agent Teams and Long-Horizon Tasks: A Survey
Geng, M., Pateria, S., Subagdja, B., & Tan, A. (2026) · ACM Computing Surveys · doi:10.1145/3817113 · Cited by 2
Learning Safe Multi-Robot Coordination in Industrial Cyber- Physical SystemsPreprint
Kyiewu, B., Amponsah, C., Bessa-Simons, L., Oppong-Asante, A., & Yiadom, C. B. (2026) · Research Square · doi:10.21203/rs.3.rs-9925827/v1
CTC: The Composite Task Challenge for Cooperative Multi-Agent Reinforcement LearningPreprint
Li, Y., Chen, Y., Yang, X. Y., Li, S., & Pan, G. (2026) · Research Square · doi:10.21203/rs.3.rs-10031846/v1
Troung, M. T., Pham, D. A., & Tran, V. B. (2026) · Mechanisms and machine science · doi:10.1007/978-3-032-29469-2_26
In Pursuit of the Emergence Point: Extracting Phase Transitions in Multi-Agent Communication
Chernyavskiy, A., Томилов, И. В., Gusarova, N., & Vatian, A. S. (2026) · Technologies · doi:10.3390/technologies14070432
Control of Self-organizing Robots using Multi-agent Deep Reinforcement Learning
Motosawa, T., & AKAGAWA, T. (2026) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.44.617
Wróbel, J., Owczarek, W., & Pęszor, D. (2026) · Applied Sciences · doi:10.3390/app16157448
SCALE-COMM: Shared, Contrastively-Aligned Latent Embeddings for MARL Communication
Abouelyazid, M., & Hammad, E. M. (2026) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv66570.2026.11623838
Consensus from Ambiguity: Language Emergence in Guessing Games
Joseph, A. G., & Kumar, V. (2026) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-026-09762-8
Kyiewu, B., Amponsah, C., Bessa-Simons, L., Oppong-Asante, A., & Yiadom, C. B. (2026) · Discover Robotics · doi:10.1007/s44430-026-00039-z
Fan, Y., Chen, B., Zhao, Y., Yue, Y., Shi, Y., Hu, F., & Li, Y. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3727505
Large language models in contexts of uncertainty: the “digital habitus” framework
Olivieri, M. G., & Iavarone, L. (2026) · Quality & Quantity · doi:10.1007/s11135-026-03049-6
Hierarchical Multi-Agent Systems with Dynamic Task Decomposition: A Novel Adaptive Framework
Ilesanmi, O., Anifowose, A., Fatuase, D., Ugwa, S., Akinbo, A., Oraegbunam, L., Amafili, A., & Obi, C. M. (2026) · International Conference on Machine Learning Technologies (ICMLT) · doi:10.1109/icmlt69916.2026.11688320
Ramurs, A. H., Vijayakumar, C., Senapati, A., Nambur, A. S., & Srinivas, C. (2026) · International Conference on Machine Learning Technologies (ICMLT) · doi:10.1109/icmlt69916.2026.11688719
Metadata
- Authors
- Mordatch, I., & Abbeel, P.
- Affiliations
- OpenAI (United States) (US)
- University of California, Berkeley (US)
- ORCID
- Abbeel, Pieter
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-25
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2602275733
- Cited by
- 440
- References
- 39
- Citations by year
- 2026: 24 · 2025: 43 · 2024: 60 · 2023: 68 · 2022: 55 · 2021: 45 · 2020: 57 · 2019: 43 · 2018: 27
- FWCI
- 397.13
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- compositional language, language emergence, multi-agent systems, nonverbal communication, pointing, guiding, human-agent interaction, goal-oriented communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review