The DOI matches its Crossref record; 34 of the 39 references it cites were found in a registry or an index.
Emergence of Grounded Compositional Language in Multi-Agent Populations
Open accessAbstract
By capturing statistical patterns in large corpora, machine learning has enabled significant advances in natural language processing, including in machine translation, question answering, and sentiment analysis. However, for agents to intelligently interact with humans, simply capturing the statistical patterns is insufficient. In this paper we investigate if, and how, grounded compositional language can emerge as a means to achieve goals in multi-agent populations. Towards this end, we propose a multi-agent learning environment and learning methods that bring about emergence of a basic compositional language. This language is represented as streams of abstract discrete symbols uttered by agents over time, but nonetheless has a coherent structure that possesses a defined vocabulary and syntax. We also observe emergence of non-verbal communication such as pointing and guiding when language communication is unavailable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“While some studies in the machine-learning emergent communication literature have focused on other reinforcement learning settings (Foerster et al., 2016;Mordatch & Abbeel, 2018, e.g.,), they have not made direct contact with general, cognitively-motivate principles that are believed to underlie human language, such as IB.”
From Towards Human-Like Emergent Communication via Utility, Informativeness, and Complexity (2025) · cites this paper as Mordatch & Abbeel, 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,789
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
The Concrete Distribution: A Continuous Relaxation of Discrete Random VariablesPreprint
Maddison, C. J., Mnih, A., & Teh, Y. W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00712 · Cited by 2,170
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
Flagged first, then by citations
5 of the 39 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Ng, A. 2011. Sparse autoencoder. CS294A Lecture notes 72(2011):1-19.
- Teh, Y. W. 2011. Dirichlet process. In Encyclopedia of machine learning . Springer. 280-287.
Cited by
Sorted by citations
Items 101–200 of 440
Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matching
Zhou, M. Q., Jiarui, J., Zhang, W., Zhi-wei, Q., Jiao, Y., Wang, C., Wu, G., Yu, Y. H., & Ye, J. (2019) · ACM Proceedings · Cited by 23
Improving sample efficiency in Multi-Agent Actor-Critic methods
Ye, Z., Chen, Y., Jiang, X., Song, G., Yang, B., & Fan, S. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02554-5 · Cited by 24
Optimized Consensus for Blockchain in Internet of Things Networks via Reinforcement Learning
Zou, Y., Jin, Z., Zheng, Y., Yu, D., & Lan, T. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2022.9010045 · Cited by 24
Coordination Between Individual Agents in Multi-Agent Reinforcement Learning
Zhang, Y., Yang, Q., An, D., & Zhang, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17357 · Cited by 22
Predator–prey survival pressure is sufficient to evolve swarming behaviors
Li, J., Li, L., & Zhao, S. (2023) · New Journal of Physics · doi:10.1088/1367-2630/acf33a · Cited by 22
Structural relational inference actor-critic for multi-agent reinforcement learning
Zhang, X., Liu, Y., Xu, X., Huang, Q. N., Mao, H., & Carie, A. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.014 · Cited by 22
Cooperative Multi-Agent Reinforcement Learning for Low-Level Wireless CommunicationPreprint
de Vrieze, C., Barratt, S. T., Tsai, D., & Sahai, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04541 · Cited by 22
Investigation of independent reinforcement learning algorithms in multi-agent environments
Lee, K. M., Subramanian, S. G., & Crowley, M. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.805823 · Cited by 21
Marchesini, E., & Farinelli, A. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812341 · Cited by 26
Li, Y., Niu, W., Tian, Y., Chen, T., Xie, Z., Wu, Y., Xiang, Y., Tong, E., Baker, T., & Liu, J. (2022) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2022.3162649 · Cited by 21
Decision-Making Under Uncertainty in Multi-Agent and Multi-Robot Systems: Planning and Learning
Amato, C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/805 · Cited by 21
Forbidden knowledge in machine learning reflections on the limits of research and publication
Hagendorff, T. (2020) · AI & Society · doi:10.1007/s00146-020-01045-4 · Cited by 25
With Whom to Communicate: Learning Efficient Communication for Multi-Robot Collision Avoidance
Serra-Gómez, Á., Brito, B., Zhu, H., Chung, J. J., & Alonso–Mora, J. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341762 · Cited by 21
Zhou, H., Lan, T., & Aggarwal, V. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3293193 · Cited by 25
Learning to Communicate via Supervised Attentional Message Processing
Peng, Z., Zhang, L., & Luo, T. (2018) · Computer Animation (CA) · doi:10.1145/3205326.3205346 · Cited by 20
Deep Multi-agent Reinforcement Learning in a Homogeneous Open Population
Rădulescu, R., Legrand, M., Efthymiadis, K., Roijers, D. M., & Nowé, A. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-31978-6_8 · Cited by 20
Learning to Communicate Implicitly by Actions
Tian, Z., Zou, S., Davies, I., Warr, T., Wu, L., Ammar, H. B., & Wang, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6217 · Cited by 21
Analytical sociology amidst a computational social science revolution
Jarvis, B. F., Keuschnigg, M., & Hedström, P. (2021) · Routledge eBooks · doi:10.4324/9781003024583-4 · Cited by 24
Word-order Biases in Deep-agent Emergent Communication
Chaabouni, R., Kharitonov, E., Lazaric, A., Emmanuel Dupoux, A., & Baroni, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1509 · Cited by 31
Emerging Complexity in Distributed Intelligent Systems
Guleva, V. Y., Shikov, E., Bochenina, K., Kovalchuk, S. V., Alodjants, A. P., & Boukhanovsky, A. V. (2020) · Entropy · doi:10.3390/e22121437 · Cited by 18
Zhao, Z., Zhao, F., Zhao, Y., Zeng, Y., & Sun, Y. (2023) · Patterns · doi:10.1016/j.patter.2023.100775 · Cited by 18
Distributed Multi-agent Target Search and Tracking With Gaussian Process and Reinforcement Learning
Kim, J., Jang, D., & Kim, H. J. (2023) · International Journal of Control Automation and Systems · doi:10.1007/s12555-022-0555-0 · Cited by 18
A Study of AI Population Dynamics with Million-agent Reinforcement Learning
Yang, Y., Yu, L., Bai, Y., Wen, Y., Zhang, W., & Wang, J. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/jkpb8439 · Cited by 28
Xie, J., Luo, J., Peng, Y., Xie, S., Pu, H., Li, X., Su, Z., Liu, Y., & Zhou, R. (2020) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-019-00857-6 · Cited by 17
Zhao, T., Xie, K., & Eskénazi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08858 · Cited by 17
Variational Autoencoders for Opponent Modeling in Multi-Agent SystemsPreprint
Papoudakis, G., & Albrecht, S. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.10829 · Cited by 36
A Contrastive-Enhanced Ensemble Framework for Efficient Multi-Agent Reinforcement Learning
Du, X., Chen, H., Xing, Y., Yu, P. S., & He, L. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123158 · Cited by 17
Marchesini, E., & Farinelli, A. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636349 · Cited by 24
The Church of AI - An examination of architecture in a posthuman design ecology
del Campo, M., Manninger, S., Sanche, M., & Wang, L. (2019) · Proceedings of the International Conference on Computer-Aided Architectural Design Research in Asia · doi:10.52842/conf.caadria.2019.2.767 · Cited by 16
Habitat 3.0: A Co-Habitat for Humans, Avatars, and Robots
Puig, X., Undersander, E., Szot, A., Cote, M. D., Yang, T.-Y., Partsey, R., Desai, R., Clegg, A. W., Hlavac, M., Min, S. Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.13724 · Cited by 15
“…space (e.g., grid-like mazes, tabular tasks, or Markov games) (Jaderberg et al., 2019; Samvelyan et al., 2019; oai; Resnick et al., 2018; Suarez et al., 2019; Baker et al., 2020; Giles & Jim, 2002; Lazaridou et al., 2016; Foerster et al., 2016; Sukhbaatar et al., 2016; Mordatch & Abbeel, 2018).”
BackgroundLearning multi-agent coordination through connectivity-driven communication
Pesce, E., & Montana, G. (2022) · Machine Learning · doi:10.1007/s10994-022-06286-6 · Cited by 17
Toward More Human-Like AI Communication: A Review of Emergent Communication Research
Brandizzi, N. (2023) · IEEE Access · doi:10.1109/access.2023.3339656 · Cited by 23
Leveraging Partial Symmetry for Multi-Agent Reinforcement Learning
Yu, X., Shi, R., Feng, P., Tian, Y., Li, S., Liao, S., & Wu, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29709 · Cited by 15
QDAP: Downsizing adaptive policy for cooperative multi-agent reinforcement learning
Zhao, Z., Zhang, Y., Wang, S., Zhang, F., Zhang, M., & Chen, W. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111719 · Cited by 15
A Penny for Your Thoughts: The Value of Communication in Ad Hoc Teamwork
Mirsky, R., Macke, W., Wang, A. Y.-D., Yedidsion, H., & Stone, P. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/36 · Cited by 15
Multi-Agent Reinforcement Learning for the Energy Optimization of Cyber-Physical Production Systems
Bakakeu, J., Kißkalt, D., Franke, J. E., Baer, S., Klos, H.-H., & Peschke, J. (2020) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece47787.2020.9255795 · Cited by 15
Bottom-up multi-agent reinforcement learning by reward shaping for cooperative-competitive tasks
Aotani, T., Kobayashi, T., & Sugimoto, K. (2021) · Applied Intelligence · doi:10.1007/s10489-020-02034-2 · Cited by 15
hammer: Multi-level coordination of reinforcement learning agents via learned messaging
Gupta, N., Srinivasaraghavan, G., Mohalik, S. K., Kumar, N., & Taylor, M. E. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09096-6 · Cited by 20
Learning Agile Locomotion via Adversarial Training
Tang, Y., Tan, J., & Harada, T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341777 · Cited by 15
The Emergence of the Shape Bias Results from Communicative Efficiency
Portelance, E., Frank, M. C., Jurafsky, D., Sordoni, A., & Laroche, R. (2021) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.48 · Cited by 15
Expected Value of Communication for Planning in Ad Hoc Teamwork
Macke, W., Mirsky, R., & Stone, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17346 · Cited by 15
Sun, Y., Tang, Y., Gao, Z., Pan, Z., Xu, C., Chen, Y., Qian, K., Wang, Z., Braud, T., Lee, C. H., et al. (2023) · SIGGRAPH Asia 2023 Art Papers · doi:10.1145/3610591.3616427 · Cited by 14
Zhu, Y., Huang, S., Zuo, B., Zhao, D., & Sun, C. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3501580 · Cited by 16
Multi Agent Deep Learning with Cooperative Communication
Simões, D., Lau, N., & Reis, L. P. (2020) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2020-0013 · Cited by 14
Cooperative Multi-Agent Reinforcement Learning With Approximate Model Learning
Park, Y. J., Lee, Y. J., & Kim, S. B. (2020) · IEEE Access · doi:10.1109/access.2020.3007219 · Cited by 14
GridToPix: Training Embodied Agents with Minimal Supervision
Jain, U., Liu, I.-J., Lazebnik, S., Kembhavi, A., Weihs, L., & Schwing, A. G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01486 · Cited by 14
Answerer in Questioner's Mind for Goal-Oriented Visual Dialogue.Preprint
Lee, S.-W., Heo, Y., & Zhang, B. (2018) · arXiv (Cornell University) · Cited by 14
Comparative Evaluation of Multi-Agent Deep Reinforcement Learning Algorithms.Preprint
Papoudakis, G., Christianos, F., Schäfer, L., & Albrecht, S. V. (2020) · arXiv (Cornell University) · Cited by 14
Time-to-smile, time-to-speak, time-to-resolve: timescales for shaping engagement in language
Rączaszek‐Leonardi, J., Główka, K., Nomikou, I., & Rossmanith, N. (2022) · Language Sciences · doi:10.1016/j.langsci.2022.101495 · Cited by 16
Learning scalable and efficient communication policies for multi-robot collision avoidance
Serra-Gómez, Á., Zhu, H., Brito, B., Böhmer, W., & Alonso–Mora, J. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10127-3 · Cited by 12
Multi-Agent Deep Reinforcement Learning with Emergent Communication
Simões, D., Lau, N., & Reis, L. P. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852293 · Cited by 16
Communication Learning via Backpropagation in Discrete Channels with Unknown Noise
Freed, B., Sartoretti, G., Hu, J., & Choset, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6205 · Cited by 16
MAIDRL: Semi-centralized Multi-Agent Reinforcement Learning using Agent Influence
Harris, A., & Liu, S. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619002 · Cited by 13
Learning indoor space perception
Sedlmeier, A., & Feld, S. (2018) · Journal of Location Based Services · doi:10.1080/17489725.2018.1539255 · Cited by 14
Chen, Q., & Heydari, B. (2022) · Journal of Mechanical Design · doi:10.1115/1.4055057 · Cited by 12
A Survey of Multi-Agent Reinforcement Learning for Cooperative Control in Multi-AUV Systems
Wibisono, A., Song, H.-K., & Lee, B. M. (2025) · IEEE Access · doi:10.1109/access.2025.3609457 · Cited by 14
Exploring communication protocols and centralized critics in multi-agent deep learning
Simões, D., Lau, N., & Reis, L. P. (2020) · Integrated Computer-Aided Engineering · doi:10.3233/ica-200631 · Cited by 12
Simultaneous Policy and Discrete Communication Learning for Multi-Agent Cooperation
Freed, B., Sartoretti, G., & Choset, H. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2972862 · Cited by 13
MFVFD: A Multi-Agent Q-Learning Approach to Cooperative and Non-Cooperative Tasks
Zhang, T., Ye, Q., Bian, J., Xie, G., & Liu, T. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/70 · Cited by 12
AHAC: Actor Hierarchical Attention Critic for Multi-Agent Reinforcement Learning
Wang, Y., Shi, D., Xue, C., Jiang, H., Wang, G., & Gong, P. L. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9283339 · Cited by 15
Emergent Communication under Competition
Noukhovitch, M., LaCroix, T., Lazaridou, A., & Courville, A. C. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/ptgw7037 · Cited by 12
Building human-like communicative intelligence: A grounded perspective
Dubova, M. (2021) · Cognitive Systems Research · doi:10.1016/j.cogsys.2021.12.002 · Cited by 15
ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learning
Yu, X., Shi, R., Feng, P., Tian, Y., Luo, J., & Wu, W. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230609 · Cited by 14
RGMComm: Return Gap Minimization via Discrete Communications in Multi-Agent Reinforcement Learning
Chen, J., Lan, T., & Joe‐Wong, C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29680 · Cited by 11
Intrinsic Action Tendency Consistency for Cooperative Multi-Agent Reinforcement Learning
Zhang, J., Zhang, Y., Zhang, X. S., Zang, Y., & Cheng, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29711 · Cited by 11
Multi-Task Multi-Agent Reinforcement Learning With Interaction and Task Representations
Li, C., Dong, S., Yang, S., Hu, Y., Ding, T., Li, W., & Gao, Y. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3475216 · Cited by 14
Coordinating Multi-Agent Reinforcement Learning via Dual Collaborative Constraints
Li, C., Dong, S., Yang, S., Hu, Y., Li, W., & Gao, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106858 · Cited by 11
ForMIC: Foraging via Multiagent RL With Implicit Communication
Shaw, S., Wenzel, E., Walker, A., & Sartoretti, G. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3152688 · Cited by 13
Representation Learning of Logic Words by an RNN: From Word Sequences to Robot Actions
Yamada, T., Murata, S., Arie, H., & Ogata, T. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00070 · Cited by 11
On the Potential for Open-Endedness in Neural Networks
Guttenberg, N., Virgo, N., & Penn, A. S. (2019) · Artificial Life · doi:10.1162/artl_a_00286 · Cited by 11
A Novel Method for Improving the Training Efficiency of Deep Multi-Agent Reinforcement Learning
Pan, Y., Jiang, H., Yang, H., & Zhang, J. (2019) · IEEE Access · doi:10.1109/access.2019.2942635 · Cited by 11
Seeded self-play for language learning
Gupta, A., Lowe, R., Foerster, J., Kiela, D., & Pineau, J. (2019) · doi:10.18653/v1/d19-6409 · Cited by 11
Emergence and evolution of language in multi-agent systems
Lipowska, D., & Lipowski, A. (2022) · Lingua · doi:10.1016/j.lingua.2022.103331 · Cited by 11
Cooperative Multi-Robot Hierarchical Reinforcement Learning
Setyawan, G. E., Hartono, P., & Sawada, H. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130904 · Cited by 11
Scalable Deep Multi-Agent Reinforcement Learning via Observation Embedding and Parameter Noise
Zhang, J., Pan, Y., Yang, H., & Fang, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2913235 · Cited by 12
Sparse Discrete Communication Learning for Multi-Agent Cooperation Through Backpropagation
Freed, B., James, R., Sartoretti, G., & Choset, H. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341079 · Cited by 13
Emergent Communication Pretraining for Few-Shot Machine Translation
Li, Y., Ponti, E. M., Vulić, I., & Korhonen, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.416 · Cited by 11
Wei, X., Huang, X., Yang, L., Cao, G., Tao, Z., Wang, B., & An, J. (2022) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-212795 · Cited by 10
RetractedA Scalable Deep Reinforcement Learning Algorithm for Partially Observable Pursuit-Evasion Game
Sun, Y., Yan, C., Lan, Z., Lin, B., Zhou, H., & Xiang, X. (2022) · International Conference on Machine Learning, Cloud Computing and Intelligent Mining (MLCCIM) · doi:10.1109/mlccim55934.2022.00070 · Cited by 10
Interpretable Learned Emergent Communication for Human–Agent Teams
Karten, S., Tucker, M., Li, H., Kailas, S., Lewis, M., & Sycara, K. P. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3236599 · Cited by 15
Interpretable and Pedagogical ExamplesPreprint
Milli, S., Abbeel, P., & Mordatch, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00694 · Cited by 10
Self-citationHierarchical Mean-Field Deep Reinforcement Learning for Large-Scale Multiagent Systems
Yu, C. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26387 · Cited by 9
PMAC: Personalized Multi-Agent Communication
Meng, X., & Tan, Y. C. R. S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29700 · Cited by 11
Flexible Formation Control Using Hausdorff Distance: A Multi-agent Reinforcement Learning Approach
Pan, C., Yan, Y., Zhang, Z., & Shen, Y. (2022) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco55093.2022.9909889 · Cited by 9
Ebara, H., Nakamura, T., Taniguchi, A., & Taniguchi, T. (2023) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai-winter61682.2023.00073 · Cited by 9
Hierarchical Multiagent Reinforcement Learning for Allocating Guaranteed Display Ads
Wang, L., Han, L., Chen, X., Li, C., Huang, J., Zhang, W., Zhang, W., He, X., & Luo, D. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070484 · Cited by 9
A Multi-Agent Reinforcement Learning Method for Impression Allocation in Online Display AdvertisingPreprint
Wu, D., Chen, C., Yang, X., Chen, X., Tan, Q., Xu, J., & Gai, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03152 · Cited by 9
Toward Semantic MAC Protocols for 6G: From Protocol Learning to Language-Oriented Approaches
Park, J., Ko, S., Choi, J., Kim, S., Choi, J. J., & Bennis, M. (2024) · IEEE BITS the Information Theory Magazine · doi:10.1109/mbits.2024.3491949 · Cited by 15
Pre-Learning Environment Representations for Data-Efficient Neural Instruction Following
Gaddy, D., & Klein, D. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1188 · Cited by 8
Learning to Resolve Alliance Dilemmas in Many-Player Zero-Sum Games
Hughes, E., Anthony, T. W., Eccles, T., Leibo, J. Z., Balduzzi, D., & Bachrach, Y. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/wuwb6150 · Cited by 15
Cooperative Multi-Agent Fairness and Equivariant Policies
Grupen, N. A., Selman, B., & Lee, D. D. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21166 · Cited by 12
Mixed Cooperative-Competitive Communication Using Multi-agent Reinforcement Learning
Vanneste, A., Wijnsberghe, W. V., Vanneste, S., Mets, K., Mercelis, S., Latré, S., & Hellinckx, P. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-89899-1_20 · Cited by 8
Avoiding collaborative paradox in multi‐agent reinforcement learning
Kim, H., Kim, S., Lee, D., & Jang, I. (2021) · ETRI Journal · doi:10.4218/etrij.2021-0010 · Cited by 8
Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning
Liu, I.-J., Ren, Z., Yeh, R. A., & Schwing, A. G. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636592 · Cited by 8
Interactive Reinforcement Learning for Object Grounding via Self-TalkingPreprint
Zhu, Y., Zhang, S., & Metaxas, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00576 · Cited by 8
Low-Bandwidth Communication Emerges Naturally in Multi-Agent Learning SystemsPreprint
Grupen, N. A., Lee, D. D., & Selman, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14890 · Cited by 11
Zan, L., Zhu, X., & Hu, Z.-L. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01145-w · Cited by 9
DPMAC: Differentially Private Communication for Cooperative Multi-Agent Reinforcement Learning
Zhao, C., Ze, Y., Dong, J., Wang, B., & Li, S. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/516 · Cited by 7
Learning Stigmergic Communication for Self-organising Coordination
Mariani, S., & Zambonelli, F. (2023) · IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS) · doi:10.1109/acsos58161.2023.00022 · Cited by 7
Chen, H.-C., Li, S., Chang, T.-H., Feng, H.-M., & Chen, Y.-C. (2024) · Applied Sciences · doi:10.3390/app14103960 · Cited by 7
Metadata
- Authors
- Mordatch, I., & Abbeel, P.
- Affiliations
- OpenAI (United States) (US)
- University of California, Berkeley (US)
- ORCID
- Abbeel, Pieter
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-25
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2602275733
- Cited by
- 440
- References
- 39
- Citations by year
- 2026: 24 · 2025: 43 · 2024: 60 · 2023: 68 · 2022: 55 · 2021: 45 · 2020: 57 · 2019: 43 · 2018: 27
- FWCI
- 397.13
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- compositional language, language emergence, multi-agent systems, nonverbal communication, pointing, guiding, human-agent interaction, goal-oriented communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review