Virtual to Real Reinforcement Learning for Autonomous Driving
Open accessAbstract
Reinforcement learning is considered as a promising direction for driving policy learning. However, training autonomous driving vehicle with reinforcement learning in real environment involves non-affordable trial-and-error. It is more desirable to first train in a virtual environment and then transfer to the real environment. In this paper, we propose a novel realistic translation network to make model trained in virtual environment be workable in real world. The proposed network can convert non-realistic virtual image input into a realistic one with similar scene structure. Given realistic frames as input, driving policy trained by reinforcement learning can nicely adapt to real world driving. Experiments show that our proposed virtual to real (VR) reinforcement learning (RL) works pretty well. To our knowledge, this is the first successful case of driving policy trained by reinforcement learning that can adapt to real world driving data.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
DRL can empower things with the ability to interact with and adapt to the dynamic world, making it useful in many AIoT applications, such as autonomous driving in smart transportation [203], [199], 3D-landmark detection of CT scans [212] and robot control [213] in smart healthcare, course recommendation in smart education [41], real-time scheduling for smart factory [214], load scheduling in smart
“DRL can empower things with the ability to interact with and adapt to the dynamic world, making it useful in many AIoT applications (Figure 9), such as autonomous driving in smart transportation [203], [199], 3D-landmark detection of CT scans [212] and robot control [213] in smart healthcare, course recommendation in smart education [41], real-time scheduling for smart factory [214], load”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [203]
Domain adaptation could be useful for AIoT applications when deploying models to new scenarios or new working modes of machines [128], [203], [204], [205], [206], e.g., 'synthetic → real', 'daytime → nighttime' or 'clear → rainy'.
“Domain adaptation could be useful for AIoT applications when deploying models to new scenarios or new working modes of machines [128], [203], [204], [205], [206], e.g., 'synthetic → real', 'daytime → nighttime' or 'clear → rainy'.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [203]
Both domain adaptation and transfer learning methods are proposed by leveraging virtual 3D game engines to address the issue of unaffordable real-world training.
“To address the issue, both domain adaptation [203] and transfer learning methods [199] are proposed by leveraging virtual 3D game engines.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [203]
Recently, deep reinforcement learning has been used for autonomous robot control, e.g., self-driving vehicle [203], [199], medical robot [213], mobile service robot.
“Recently, deep reinforcement learning has been used for autonomous robot control, e.g., self-driving vehicle [203], [199], medical robot [213], mobile service robot.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [203]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cited by
Sorted by citations
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774 · see citing works
A Survey of Deep Learning Applications to Autonomous Vehicle Control
Kuutti, S., Bowden, R., Jin, Y., Barber, P., & Fallah, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2962338 · Cited by 96 · see citing works
- Authors
- Pan, X., You, Y., Wang, Z., & Lu, C.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- arXiv
- 1704.03952
- OpenAlex
- W2962977206
- Cited by
- 326
- References
- 0
- Citations by year
- 2026: 4 · 2025: 26 · 2024: 29 · 2023: 36 · 2022: 49 · 2021: 64 · 2020: 54 · 2019: 43 · 2018: 16 · 2017: 3 · 2016: 1
- FWCI
- 14.47
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- British Machine Vision Conference (BMVC) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- autonomous driving, reinforcement learning, sim-to-real transfer, driving policy learning, virtual environment training, domain adaptation, realistic image synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
