Federated Transfer Reinforcement Learning for Autonomous Driving
Open accessAbstract
Reinforcement learning (RL) is widely used in autonomous driving tasks and training RL models typically involves in a multi-step process: pre-training RL models on simulators, uploading the pre-trained model to real-life robots, and fine-tuning the weight parameters on robot vehicles. This sequential process is extremely time-consuming and more importantly, knowledge from the fine-tuned model stays local and can not be re-used or leveraged collaboratively. To tackle this problem, we present an online federated RL transfer process for real-time knowledge extraction where all the participant agents make corresponding actions with the knowledge learned by others, even when they are acting in very different environments. To validate the effectiveness of the proposed approach, we constructed a real-life collision avoidance system with Microsoft Airsim simulator and NVIDIA JetsonTX2 car agents, which cooperatively learn from scratch to avoid collisions in indoor environment with obstacle objects. We demonstrate that with the proposed framework, the simulator car agents can transfer knowledge to the RC cars in real-time, with 27% increase in the average distance with obstacles and 42% decrease in the collision counts.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In real-world AIoT systems, there are always many related tasks involved, e.g., object detection and tracking, and semantic segmentation in video surveillance. Therefore, finding transfer learning dependencies across these tasks and leveraging such prior knowledge to learn better models are of practical value for AIoT [199], [200], [201], [202].
“In real-world AIoT systems, there are always many related tasks involved, e.g., object detection and tracking, and semantic segmentation in video surveillance. Therefore, finding the transfer learning dependencies across these tasks and leveraging such prior knowledge to learn better models, are of practical value for AIoT [199], [200], [201], [202].”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [199]
FL can be used to improve the perceiving and learning ability of AIoT devices such as connected vehicles for autonomous driving [199] and wearable devices for health monitoring [222], [197].
“For example, FL can be used to improve the perceiving and learning ability of AIoT devices such as connected vehicles for autonomous driving [199] and wearable devices for health monitoring [222], [197].”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [199]
DRL can be integrated into the FL framework for privacy-preserving learning [199], [216].
“Moreover, DRL can be integrated into the FL framework for privacy-preserving learning [199], [216].”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [199]
Recently, deep reinforcement learning has been used for autonomous robot control, e.g., self-driving vehicle [203], [199], medical robot [213], mobile service robot.
“Recently, deep reinforcement learning has been used for autonomous robot control, e.g., self-driving vehicle [203], [199], medical robot [213], mobile service robot.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [199]
Both domain adaptation and transfer learning methods are proposed by leveraging virtual 3D game engines to address the issue of unaffordable real-world training.
“To address the issue, both domain adaptation [203] and transfer learning methods [199] are proposed by leveraging virtual 3D game engines.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [199]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 24 · Cited by 131
- Authors
- Liang, X., Liu, Y., Chen, T., Liu, M., & Yang, Q.
- Affiliations
- Tsinghua University (CN)
- Hong Kong University of Science and Technology (HK)
- Corresponding author
- Liang, Xinle
- Liu, Yang
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 357-371
- ISSN
- 1867-4534 (ISSN-L)
- arXiv
- 1910.06001
- OpenAlex
- W2979766322
- Cited by
- 131
- References
- 24
- Citations by year
- 2026: 6 · 2025: 21 · 2024: 31 · 2023: 26 · 2022: 14 · 2021: 24 · 2020: 9
- FWCI
- 45.20
- Type
- book chapter
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Adaptation, learning, and optimization (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated reinforcement learning, transfer learning, autonomous driving, collision avoidance, NVIDIA Jetson, obstacle avoidance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
