Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 187

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Who2com: Collaborative Perception via Learnable Handshake Communication

Open access
Liu, Yen-Cheng, Tian, Junjiao, Ma, Chih-Yao, Glaser, Nathan, Kuo, Chia-Wen, Kira, Zsolt·2020·2020 IEEE International Conference on Robotics and Automation (ICRA)

Abstract

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike existing work in robotics and multi-agent reinforcement learning, we formulate the problem as one where learned information must be shared across a set of agents in a bandwidth-sensitive manner to optimize for scene understanding tasks such as semantic segmentation. Inspired by networking communication protocols, we propose a multi-stage handshake communication mechanism where the neural network can learn to compress relevant information needed for each stage. Specifically, a target agent with degraded sensor data sends a compressed request, the other agents respond with matching scores, and the target agent determines who to connect with (i.e., receive information from). We additionally develop the AirSim-CP dataset and metrics based on the AirSim simulator where a group of aerial robots perceive diverse landscapes, such as roads, grasslands, buildings, etc. We show that for the semantic segmentation task, our handshake communication method significantly improves accuracy by approximately 20% over decentralized baselines, and is comparable to centralized ones using a quarter of the bandwidth.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/icra40945.2020.9197364

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 28

  1. zhang, 2013, Coordinating multi-agent reinforcement learning with limited communication, Proc Autonomous Agents and Multi-Agent Systems (AAMAS '06) Conf
  2. vaswani, 2017, Attention is all you need, Advances in Neural Information Processing Systems (NIPS)
  3. schmidhuber, 1996, A general method for multiagent reinforcement learning in unrestricted environments, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)
  4. 10.1002/rob.21620 · DOI · Paper page
  5. pesce, 2019, Improving Coordination in Multi-Agent Deep Reinforcement Learning through Memory-driven Communication, Neural Information Processing Systems Workshop
  6. 10.1016/B978-1-55860-307-3.50049-6 · DOI · Paper page
  7. sukhbaatar, 2016, Learning multiagent communication with backpropagation, Advances in Neural Information Processing Systems (NIPS)
  8. 10.1109/CVPR.2017.660 · DOI · Paper page
  9. foerster, 2016, Learning to communicate with deep multi-agent reinforcement learning, Advances in Neural Information Processing Systems (NIPS)
  10. hoshen, 2017, Vain: Attentional multi-agent predictive modeling, Advances in Neural Information Processing Systems (NIPS)
  11. 10.1109/CVPR.2019.00685 · DOI
  12. jiang, 2018, Learning attentional communication for multi-agent cooperation, Advances in Neural Information Processing Systems (NIPS)
  13. kim, 2019, Learning to Schedule Communication in Multi-agent Reinforcement Learning, Proceedings of the International Conference on Learning Representations (ICLR)
  14. 10.1609/aaai.v33i01.33016079 · DOI
  15. chen, 2019, Towards Scene Understanding: Unsupervised Monocular Depth Estimation With Semantic-Aware Representation, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  16. melo, 2011, QueryPOMDP: POMDP-based communication in multiagent systems, Proceedings of the 9th European conference on Multi-Agent Systems
  17. cunningham, 2010, DDF-SAM: Fully distributed SLAM using constrained factor graphs, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, 3025, 10.1109/IROS.2010.5652875 · DOI · Paper page
  18. cheng, 2019, Learning Image and Video Compression through Spatial-Temporal Energy Compaction, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 10071
  19. dobbe, 2017, Fully decentralized policies for multi-agent systems: An information theoretic approach, Advances in Neural Information Processing Systems (NIPS), 2941
  20. das, 2019, TarMAC: Targeted Multi-Agent Communication, Proceedings of the International Conference on Machine Learning (ICML)
  21. foerster, 2018, Counterfactual multi-agent policy gradients, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 10.1609/aaai.v32i1.11794 · DOI · Paper page
  22. bahdanau, 2015, Neural machine translation by jointly learning to align and translation, Proceedings of the International Conference on Learning Representations (ICLR)
  23. krause, 2007, Near-optimal observation selection using submodular functions, AAAI, 7, 1650
  24. 10.1016/B978-1-55860-335-6.50027-1 · DOI · Paper page
  25. kurose, 2005, Computer Networking A Top-Down Approach Featuring the Internet
  26. lowe, 2017, Multi-agent actor-critic for mixed cooperative-competitive environments, Advances in Neural Information Processing Systems (NIPS)
  27. 10.1109/CVPR.2015.7298965 · DOI · Paper page
  28. martins, 2016, From softmax to sparsemax: A sparse model of attention and multilabel classification, Proceedings of the International Conference on Machine Learning (ICML), 1614

Cited by

See all 187

Metadata

Authors
Liu, Y.-C., Tian, J., Ma, C.-Y., Glaser, N., Kuo, C.-W., & Kira, Z.
Venue
2020 IEEE International Conference on Robotics and Automation (ICRA)
Publisher
IEEE
Published
2020-05
Pages
6876-6883
ISSN
1050-4729 (ISSN-L)
OpenAlex
W3090375251
Cited by
187
References
8
FWCI
4.74
Type
conference paper
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Who2com: Collaborative Perception via Learnable Handshake Communication. https://app.cochat.ai/papers/10.1109/icra40945.2020.9197364
The paper
Liu, Y.-C., Tian, J., Ma, C.-Y., Glaser, N., Kuo, C.-W., & Kira, Z. (2020). Who2com: Collaborative Perception via Learnable Handshake Communication. 2020 IEEE International Conference on Robotics and Automation (ICRA). https://doi.org/10.1109/icra40945.2020.9197364

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.