Cited by 76Autonomous Vehicle Technology and SafetyRobotics and Sensor-Based LocalizationPrivacy-Preserving Technologies in Data

Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles

Open access
Zhang, Zijian, Wang, Shuai, Hong, Yuncong, Zhou, Liangkai, Hao, Qi·2021·2021 IEEE International Conference on Robotics and Automation (ICRA)

Abstract

The technology of dynamic map fusion among networked vehicles has been developed to enlarge sensing ranges and improve sensing accuracies for individual vehicles. This paper proposes a federated learning (FL) based dynamic map fusion framework to achieve high map quality despite unknown numbers of objects in fields of view (FoVs), various sensing and model uncertainties, and missing data labels for online learning. The novelty of this work is threefold: (1) developing a three-stage fusion scheme to predict the number of objects effectively and to fuse multiple local maps with fidelity scores; (2) developing an FL algorithm which fine-tunes feature models (i.e., representation learning networks for feature extraction) distributively by aggregating model parameters; (3) developing a knowledge distillation method to generate FL training labels when data labels are unavailable. The proposed framework is implemented in the CARLA simulation platform. Extensive experimental results are provided to verify the superior performance and robustness of the developed map fusion and FL schemes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/icra48506.2021.9561612

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Study [190] employed a three-stage map fusion (density-based spatial clustering, score-based averaging, and intersection-over-union-based pruning) to enable accurate, privacy-preserving trajectory predictions.

    “Meanwhile, [190] employed a map fusion in three stage (density-based spatial clustering, scorebased averaging, and intersection-over-union-based pruning) to enable accurate, privacy-preserving trajectory predictions.”

    From Privacy-preserving Machine Learning in Internet of Vehicle Applications: Fundamentals, Recent Advances, and Future Direction (2025) · cites this paper as [190]

    The Introduction (p. 2) explicitly lists the three fusion stages: DBSCAN clustering, score-based weighted averaging, and IoU-based box pruning. But the paper describes these stages as producing a global object map, not trajectory predictions; the cited passages also do not establish the claimed privacy-preserving outcome. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 24

  1. [1][1] N. Lu, N. Cheng, N. Zhang, X. Shen, and J. W. Mark, 'Connected vehicles: Solutions and challenges,' IEEE Internet of Things Journal , vol. 1, no. 4, pp. 289-299, Aug. 2014. -
  2. [2][2] A. Eskandarian, C. Wu, and C. Sun, 'Research Advances and Challenges of Autonomous and Connected Ground Vehicles,' IEEE Transactions on Intelligent Transportation Systems , vol. 22, no. 2, pp. 683-711, Feb. 2021. -
  3. [3][3] O. Shorinwa, J. Yu, T. Halsted, A. Koufos, and M. Schwager, 'Distributed multi-target tracking for autonomous vehicle fleets,' in Proceedings of 2020 IEEE International Conference on Robotics and Automation (ICRA) , Paris, France, May-Aug. 2020, pp. 3495-3501. -
  4. [4][4] E. Arnold, M. Dianati, R. de Temple, and S. Fallah, 'Cooperative perception for 3D object detection in driving scenarios using infrastructure sensors,' IEEE Transactions on Intelligent Transportation Systems , early access, Oct. 2020. DOI: 10.1109/TITS.2020.3028424. - · DOI
  5. [5][5] Q. Chen, X. Ma, S. Tang, J. Guo, Q. Yang, S. Fu, 'F-cooper: feature based cooperative perception for autonomous vehicle edge computing system using 3D point clouds,' in Proceedings of 2019 ACM/IEEE Symposium on Edge Computing , Arlington, Virginia, Nov. 2019, pp. 88100. -
  6. [6][6] E. E. Marvasti, A. Raftari, A. E. Marvasti, Y. P. Fallah, R. Guo, and H. Lu, 'Cooperative LiDAR object detection via feature sharing in deep networks,' 2020. [Online]. Available: arxiv preprint arXiv: 2002.08440. - · arXiv
  7. [7][7] T.-H. Wang, S. Manivasagam, M. Liang, B. Yang, W. Zeng, and R. Urtasun, 'V2VNet: Vehicle-to-vehicle communication for joint perception and prediction,' in Proceedings of 2020 European Conference on Computer Vision (ECCV) , Glasgow, Scotland, Aug. 2020. -
  8. [8][8] Z. Xiao, Z. Mo, K. Jiang, and D. Yang, 'Multimedia fusion at semantic level in vehicle cooperactive perception,' in Proceedings of 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) , San Diego, USA, Jul. 2018, pp. 1-6. -
  9. [9][9] Q. Chen, S. Tang, Q. Yang, and S. Fu, 'Cooper: Cooperative perception for connected autonomous vehicles based on 3d point clouds,' in Proceedings of 2019 IEEE International Conference on Distributed Computing Systems (ICDCS) , Dallas, TX, 2019, pp. 514-524. -
  10. [10][10] A. Miller, K. Rim, P. Chopra, P. Kelkar, and M. Likhachev, 'Cooperative perception and localization for cooperative driving,' in Proceedings of 2020 IEEE International Conference on Robotics and Automation (ICRA) , Paris, France, May-Aug. 2020, pp. 1256-1262. -
  11. [11][11] B. Hurl, R. Cohen, K. Czarnecki, and S. Waslander, 'TruPercept: Trust modelling for autonomous vehicle cooperative perception from synthetic data,' 2019. [Online]. Available: arXiv preprint arXiv:1909.07867. - · arXiv
  12. [12][12] M. Ambrosin, I. J. Alvarez, C. Buerkle, L. L. Yang, F. Oboril, M. R. Sastry, and K. Sivanesan, 'Object-level perception sharing among connected vehicles,' in Proceedings of 2019 IEEE Intelligent Transportation Systems Conference (ITSC) , Auckland, New Zealand, Oct. 2019, pp. 15661573. -
  13. [13][13] D. D. Yoon, G. M. N. Ali, and B. Ayalew, 'Cooperative perception in connected vehicle traffic under field-of-view and participation variations,' in Proceedings of 2019 IEEE Connected and Automated Vehicles Symposium (CAVS) , Honolulu, HI, Sep. 2019, pp. 1-6. -
  14. [14][14] R. Yee, E. Chan, B. Cheng, and G. Bansal, 'Collaborative perception for automated vehicles leveraging vehicle-to-vehicle communications,' in Proceedings of 2018 IEEE Intelligent Vehicles Symposium (IV) , Changshu, China, Jun. 2018, pp. 1099-1106. -
  15. [15][15] Z. Y. Rawashdeh and Z. Wang, 'Collaborative automated driving: A machine learning-based method to enhance the accuracy of shared information,' in Proceedings of 2018 International Conference on Intelligent Transportation Systems (ITSC) , Maui, HI, Nov. 2018, pp. 3961-3966. -
  16. [16][16] B. Liu, L. Wang, M. Liu, and C.-Z. Xu, 'Federated imitation learning: A novel framework for cloud robotic systems with heterogeneous sensor data,' IEEE Robotics and Automation Letters , vol. 5, no. 2, pp. 35093516, Apr. 2020. -
  17. [18][18] W. Zhuang, Y. Wen, X. Zhang, X. Gan, D. Yin, D. Zhou, S. Zhang, and S. Yi, 'Performance optimization for federated person re-identification via benchmark analysis,' 2020. [Online]. Available: arXiv preprint arXiv:2008.11560. - · arXiv
  18. [20][20] S. Wang, R. Wang, Q. Hao, Y.-C. Wu, and H. V. Poor, 'Learning centric power allocation for edge intelligence,' in Proceedings of 2020 IEEE International Conference on Communications (ICC) , Dublin, Ireland, Jun. 2020. -
  19. [21][21] Y. Sun, D. Li, X. Wu, and Q. Hao, 'Visual Perception Based Situation Analysis of Traffic Scenes for Autonomous Driving Applications,' in Proceedings of 2020 IEEE International Conference on Intelligent Transportation Systems (ITSC) , Rhodes, Greece, Jul. 2020, pp. 1-7. -
  20. [22][22] Q. Guo, X. Wang, Y. Wu, Z. Yu, D. Liang, X. Hu, and P. Luo, 'Online Knowledge Distillation via Collaborative Learning,' in Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , Seattle, WA, Jun. 2020, pp. 11017-11029. -
  21. [23][23] T. Lin, L. Kong, S. U. Stich, and M. Jaggi, 'Ensemble Distillation for Robust Model Fusion in Federated Learning,' in Proceedings of 2020 Conference on Neural Information Processing Systems (NeurIPS) , Vancouver, Canada, Dec. 2020, pp. 1-25. -
  22. [24][24] M. Ester, H. P. Kriegel, J. Sander, and X. Xu, 'A density-based algorithm for discovering clusters in large spatial databases with noise,' in Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD) , Portland, Oregon, 1996, pp. 226231. -
  23. [25][25] Y. Yan, Y. Mao, and B. Li, 'SECOND: Sparsely embedded convolutional detection,' Sensors , vol. 18, no. 10, pp. 3337, 2018. -
  24. [26][26] S. Shi, Z. Wang, J. Shi, X. Wang, and H. Li, 'From points to parts: 3D object detection from point cloud with part-aware and partaggregation network,' IEEE Trans. Pattern Anal. Mach. Intell. , 2020. DOI: 10.1109/TPAMI.2020.2977026. - · DOI

Cited by

Sorted by citations

Authors
Zhang, Z., Wang, S., Hong, Y., Zhou, L., & Hao, Q.
Affiliations
  • Harbin Institute of Technology (CN)
  • Southern University of Science and Technology (CN)
Venue
2021 IEEE International Conference on Robotics and Automation (ICRA)
Publisher
IEEE
Published
2021-05-30
Pages
953-959
ISSN
1050-4729 (ISSN-L)
OpenAlex
W3134982056
Cited by
76
References
3
Citations by year
2026: 4 · 2025: 14 · 2024: 18 · 2023: 12 · 2022: 18 · 2021: 10
FWCI
14.36
Type
conference paper
Language
en
Open access
Locations
  • Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Natural Science Foundation of China
Topics
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Keywords
federated learning, connected vehicles, representation learning, knowledge distillation, missing labels, online learning, CARLA simulator, autonomous driving

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review