The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Who2com: Collaborative Perception via Learnable Handshake Communication
Open accessAbstract
In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike existing work in robotics and multi-agent reinforcement learning, we formulate the problem as one where learned information must be shared across a set of agents in a bandwidth-sensitive manner to optimize for scene understanding tasks such as semantic segmentation. Inspired by networking communication protocols, we propose a multi-stage handshake communication mechanism where the neural network can learn to compress relevant information needed for each stage. Specifically, a target agent with degraded sensor data sends a compressed request, the other agents respond with matching scores, and the target agent determines who to connect with (i.e., receive information from). We additionally develop the AirSim-CP dataset and metrics based on the AirSim simulator where a group of aerial robots perceive diverse landscapes, such as roads, grasslands, buildings, etc. We show that for the semantic segmentation task, our handshake communication method significantly improves accuracy by approximately 20% over decentralized baselines, and is comparable to centralized ones using a quarter of the bandwidth.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles
Shah, S., Dey, D., Lovett, C., & Kapoor, A. (2018) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-319-67361-5_40 · Cited by 2,254
Cooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
Interaction Networks for Learning about Objects, Relations and Physics
Battaglia, P. W., Pascanu, R., Lai, M., Rezende, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1612.00222 · Cited by 969
Research works printed but not linked: 28
- zhang, 2013, Coordinating multi-agent reinforcement learning with limited communication, Proc Autonomous Agents and Multi-Agent Systems (AAMAS '06) Conf
- vaswani, 2017, Attention is all you need, Advances in Neural Information Processing Systems (NIPS)
- schmidhuber, 1996, A general method for multiagent reinforcement learning in unrestricted environments, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)
- 10.1002/rob.21620 · DOI · Paper page
- pesce, 2019, Improving Coordination in Multi-Agent Deep Reinforcement Learning through Memory-driven Communication, Neural Information Processing Systems Workshop
- 10.1016/B978-1-55860-307-3.50049-6 · DOI · Paper page
- sukhbaatar, 2016, Learning multiagent communication with backpropagation, Advances in Neural Information Processing Systems (NIPS)
- 10.1109/CVPR.2017.660 · DOI · Paper page
- foerster, 2016, Learning to communicate with deep multi-agent reinforcement learning, Advances in Neural Information Processing Systems (NIPS)
- hoshen, 2017, Vain: Attentional multi-agent predictive modeling, Advances in Neural Information Processing Systems (NIPS)
- 10.1109/CVPR.2019.00685 · DOI
- jiang, 2018, Learning attentional communication for multi-agent cooperation, Advances in Neural Information Processing Systems (NIPS)
- kim, 2019, Learning to Schedule Communication in Multi-agent Reinforcement Learning, Proceedings of the International Conference on Learning Representations (ICLR)
- 10.1609/aaai.v33i01.33016079 · DOI
- chen, 2019, Towards Scene Understanding: Unsupervised Monocular Depth Estimation With Semantic-Aware Representation, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- melo, 2011, QueryPOMDP: POMDP-based communication in multiagent systems, Proceedings of the 9th European conference on Multi-Agent Systems
- cunningham, 2010, DDF-SAM: Fully distributed SLAM using constrained factor graphs, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, 3025, 10.1109/IROS.2010.5652875 · DOI · Paper page
- cheng, 2019, Learning Image and Video Compression through Spatial-Temporal Energy Compaction, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 10071
- dobbe, 2017, Fully decentralized policies for multi-agent systems: An information theoretic approach, Advances in Neural Information Processing Systems (NIPS), 2941
- das, 2019, TarMAC: Targeted Multi-Agent Communication, Proceedings of the International Conference on Machine Learning (ICML)
- foerster, 2018, Counterfactual multi-agent policy gradients, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 10.1609/aaai.v32i1.11794 · DOI · Paper page
- bahdanau, 2015, Neural machine translation by jointly learning to align and translation, Proceedings of the International Conference on Learning Representations (ICLR)
- krause, 2007, Near-optimal observation selection using submodular functions, AAAI, 7, 1650
- 10.1016/B978-1-55860-335-6.50027-1 · DOI · Paper page
- kurose, 2005, Computer Networking A Top-Down Approach Featuring the Internet
- lowe, 2017, Multi-agent actor-critic for mixed cooperative-competitive environments, Advances in Neural Information Processing Systems (NIPS)
- 10.1109/CVPR.2015.7298965 · DOI · Paper page
- martins, 2016, From softmax to sparsemax: A sparse model of attention and multilabel classification, Proceedings of the International Conference on Machine Learning (ICML), 1614
Cited by
3D Object Detection for Autonomous Driving: A Comprehensive Survey
Mao, J., Shi, S., Wang, X., & Li, H. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01790-1 · Cited by 450
A Survey of Embodied AI: From Simulators to Research Tasks
Duan, J., Yu, S., Tan, H. L., Zhu, H., & Tan, C. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3141105 · Cited by 420
Yu, H., Yang, W., Ruan, H., Yang, Z., Tang, Y., Gao, X., Hao, X., Shi, Y., Pan, Y., Sun, N., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00531 · Cited by 182
Latency-Aware Collaborative Perception
Lei, Z., Ren, S., Hu, Y., Zhang, W., & Chen, S. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19824-3_19 · Cited by 147
Vehicle-to-Everything Communication in Intelligent Connected Vehicles: A Survey and Taxonomy
Zhang, X., Li, J., Zhou, J., Zhang, S., Wang, J., Yuan, Y., Liu, J., & Li, J. (2025) · Automotive Innovation · doi:10.1007/s42154-024-00310-2 · Cited by 103
Metadata
- Authors
- Liu, Y.-C., Tian, J., Ma, C.-Y., Glaser, N., Kuo, C.-W., & Kira, Z.
- Venue
- 2020 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2020-05
- Pages
- 6876-6883
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W3090375251
- Cited by
- 187
- References
- 8
- FWCI
- 4.74
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Who2com: Collaborative Perception via Learnable Handshake Communication. https://app.cochat.ai/papers/10.1109/icra40945.2020.9197364
- The paper
- Liu, Y.-C., Tian, J., Ma, C.-Y., Glaser, N., Kuo, C.-W., & Kira, Z. (2020). Who2com: Collaborative Perception via Learnable Handshake Communication. 2020 IEEE International Conference on Robotics and Automation (ICRA). https://doi.org/10.1109/icra40945.2020.9197364
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.