Remote Driving Control With Real-Time Video Streaming Over Wireless Networks: Design and Evaluation
Open accessThe DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Abstract
There is currently a large gap between current AI based autonomous-driving cars and fully autonomous cars. In such situation, remote control of cars can be a unique solution to fill the gap. Human assistance through remote driving can provide more flexibility and intelligence than a single artificial intelligence. Furthermore, remote driving enables valuable operational data to be obtained, thus laying the groundwork for gradually providing autonomous driving performance in the future. Remote driving of a vehicle is to drive a vehicle remotely via communication infrastructure. Latency in communication technology has a significant impact on the real-time control of the vehicles as well as responding to unexpected situations. For remotely driven vehicles, real-time transmission of data and images is particularly important. The latency or delay between a vehicle and the controller depends on the communication methods and transport protocols of the video streaming. Furthermore, the control or driving performance also depends on the speed of the vehicle. Therefore, in this paper, we explore the impact of different communication methods of video streaming and vehicle “speed” on the performance of remote driving.We design a vehicle remote driving system based on ROS (Robot Operating System) with ROS as the core communication architecture to realize remote control of vehicles. The video stream is transmitted using three different streaming methods such as ROS multi-computer communication, TCP protocol, and UDP protocol. To be specific, we implement a simple remote driving system for a “model” car and let multiple people drive the car through the remote driving system at different speeds. Then, we analyze how the drivers perform in terms of whether the vehicle gets off the track while driving.We quantify the performance of remote driving at different speeds and with different protocols of video transmission methods and perform comparative analysis. We find that “UDP protocol based video streaming” to achieve 720P video streaming with a latency of less than 50ms, which is helpful for further research on remote driving. Furthermore, to evaluate the impact of the video streaming approach on remote driving, we conduct some experiments by “directly” observing the vehicle with eyes instead of using video streaming. In this way, we remove the latency of video streaming. The experiment results show that the speed of the vehicle and the video streaming methods have a significant impact on the driving performance and demonstrate that the UDP protocol-based video streaming method is better suited for remote driving. The results imply that remote driving should be used in a low-speed environment rather than at high speed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mystakidis, S. (2022) · Encyclopedia · doi:10.3390/encyclopedia2010031 · Cited by 1,977
Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles
Kukkala, V. K., Tunnell, J., Pasricha, S., & Bradley, T. (2018) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2018.2828440 · Cited by 372
Banks, V. A., Plant, K. L., & Stanton, N. A. (2018) · Safety Science · doi:10.1016/j.ssci.2017.12.023 · Cited by 175
Multimedia surveillance systems
Cucchiara, R. (2005) · ACM International Workshop on Video Surveillance & Sensor Networks (VSSN) · doi:10.1145/1099396.1099399 · Cited by 161
Teleoperation: The Holy Grail to Solve Problems of Automated Driving? Sure, but Latency Matters
Neumeier, S., Wintersberger, P., Frison, A.-K., Becher, A., Facchi, C., & Riener, A. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3342197.3344534 · Cited by 119
Chui, K. T., Liu, R. W., Zhao, M., & De Pablos, P. O. (2020) · IEEE Access · doi:10.1109/access.2020.2992869 · Cited by 119
Low-Rate Wireless Personal Area Networks
Gutierrez, J. A., Callaway, E. H., & Barrett, R. L. (2011) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9781118098882 · Cited by 109
Augmenting Self-Driving with Remote Control: Challenges and Directions
Kang, L., Zhao, W., Qi, B., & Banerjee, S. (2018) · Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications · doi:10.1145/3177102.3177104 · Cited by 94
The Effects of Time Lag on Driving Performance and a Possible Mitigation
Davis, J., Smyth, C., & McDowell, K. (2010) · IEEE Transactions on Robotics · doi:10.1109/tro.2010.2046695 · Cited by 88
Low-Power Wireless Sensor Networks: Protocols, Services and Applications
Suhonen, J., Kohvakka, M., Kaseva, V. A., Hämäläinen, T. D., & Hännikäinen, M. (2012) · Springer eBooks · doi:10.1007/978-1-4614-2173-3 · Cited by 86
Video Streaming for Mobile Video Surveillance
Gualdi, G., Prati, A., & Cucchiara, R. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2001378 · Cited by 85
Enhancing telepresence during the teleoperation of road vehicles using HMD-based mixed reality
Hosseini, A., & Lienkamp, M. (2016) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2016.7535568 · Cited by 80
An investigation of real world control of robotic assets under communication latency
Luck, J. P., McDermott, P. L., Allender, L., & Russell, D. C. (2006) · Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction · doi:10.1145/1121241.1121277 · Cited by 76
Investigating Remote Driving over the LTE Network
Liu, R., Kwak, D., Devarakonda, S., Bekris, K., & Iftode, L. (2017) · Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3122986.3123008 · Cited by 73 · cited 1×
“A study of remote driving in an LTE network environment in literature [11], [13] proved that the factor that has a significant impact on the driving performance of remote drivers is the unstable delay.”
BackgroundGraf, F. (2008) · Routledge eBooks · doi:10.4324/9780203581711 · Cited by 73
3G and 3.5G wireless network performance measured from moving cars and high-speed trains
Jang, K., Han, M., Cho, S., Ryu, H.-K., Lee, J., Lee, Y., & Moon, S. B. (2009) · doi:10.1145/1614255.1614261 · Cited by 65
WoZ Way: Enabling Real-time Remote Interaction Prototyping & Observation in On-road Vehicles
Martelaro, N., & Ju, W. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998293 · Cited by 50
Effects of streaming video quality of service on spatial comprehension in a reconnaissance task
Kempster, K. A., Darken, R. P., & Peterson, B. (2001) · Calhoun: The Naval Postgraduate School Institutional Archive (Naval Postgraduate School) · Cited by 44
TCP Performance over Mobile Networks in High-Speed Mobility Scenarios
Xiao, Q., Xu, K., Wang, D., Li, L., & Zhong, Y. (2014) · IEEE International Conference on Network Protocols (ICNP) · doi:10.1109/icnp.2014.49 · Cited by 40
Ouerhani, Y., Alfalou, A., Desthieux, M., & Brosseau, C. (2016) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2016.05.020 · Cited by 22
Teleoperated Driving Robust and Secure Data Connections
Chucholowski, F., Tang, T., & Lienkamp, M. (2014) · ATZelectronics worldwide · doi:10.1365/s38314-014-0226-x · Cited by 20
Redefining Safety in Autonomous Vehicle Through Remote Teleoperation
Fallah, Z., Shukla, V. K., & Khalid, M. N. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-981-16-2543-5_19 · Cited by 5
Autonomous trucks need people - [Opinion]
(2019) · IEEE Spectrum · doi:10.1109/mspec.2019.8651928 · Cited by 5
Kato, K., Suto, K., & Sato, K. (2021) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops50388.2021.9473522 · Cited by 4
5G Network Virtualization for the Remote Driving Enhancement
Kumar, N. S., Kaur, U., Anuradha, T., Majji, S., Karanam, S. R., & Deshmukh, R. G. (2021) · International Conference on Computing and Communications Technologies (ICCCT) · doi:10.1109/iccct53315.2021.9711894 · Cited by 4
Tele-driving an electric vehicle over a private LTE network
Joglekar, A., Rawat, A., Colaco, A. G., S, A. P. I., Ranjan, P., Doreswamy, R., Chopra, R., Amrutur, B. S., Govindraju, B., Rahman, F., et al. (2022) · International Conference on Communication Systems & Networks (COMSNETS) · doi:10.1109/comsnets53615.2022.9668498 · Cited by 3
Highly immersive driving simulator for scenario based testing of automated driving functions
Prokop, G., Tüschen, T., Eisenköck, N., & Bönninger, J. (2022) · Proceedings · doi:10.1007/978-3-658-37009-1_10 · Cited by 2
(2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
Research works printed but not linked: 8
- Litman, 2017, Autonomous Vehicle Implementation Predictions
- Driving, 2014, Levels of driving automation are defined in new SAE international standard J3016: 2014, SAE International: Warrendale, PA, USA, 1
- Forecast, 2019, Cisco visual networking index: Global mobile data traffic forecast update, 2017–2022, Update, 2017, 2022
- Shadrin, 2019, Analytical review of standard SAE J3016 taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles with latest updates, Avtomobil. Doroga. Infrastruktura., 3, 10
- Gibbs, 2017, Google sibling waymo launches fully autonomous ride-hailing service, Guardian, 7, 1
- Efrati, 2018, Uber finds deadly accident likely caused by software set to ignore objects on road, Information, 5, 7
- 2021, XYCAR-D
- So, 2022, NASA-TLX
Cited by
Kamtam, S. B., Lu, Q., Bouali, F., Haas, O. C. L., & Birrell, S. A. (2024) · Sensors · doi:10.3390/s24123957 · Cited by 124
Zhao, L., Nybacka, M., Aramrattana, M., Rothhämel, M., Habibovic, A., Drugge, L., & Jiang, F. J. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3362597 · Cited by 50
A Survey on Video Streaming for Next-Generation Vehicular Networks
Huang, C., Cheng, H.-W., Lien, Y.-H., & Jian, M.-E. (2024) · Electronics · doi:10.3390/electronics13030649 · Cited by 42
Nurkahfi, G. N., Triwinarko, A., Prawara, B., Armi, N., Juhana, T., Syambas, N. R., Mulyana, E., Dogheche, E. H., & Dayoub, I. (2023) · IEEE Access · doi:10.1109/access.2023.3341092 · Cited by 20
Cross-layer latency analysis for 5G NR in V2X communications
Horta, J., Siller, M., & Villarreal-Reyes, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0313772 · Cited by 18
Metadata
- Authors
- Yu, Y., & Lee, S.
- Affiliations
- Kookmin University (KR)
- Venue
- IEEE Access
- Published
- 2022
- Volume
- 10
- Pages
- 64920-64932
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4285153670
- Cited by
- 47
- References
- 29
- Citations by year
- 2026: 10 · 2025: 12 · 2024: 17 · 2023: 6 · 2022: 2
- FWCI
- 3.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Global Scholarship Program for Foreign Graduate Students at Kookmin University, South Korea
- Basic Science Research Program through the National Research Foundation of Korea (NRF), Ministry of Education (NRF-2019R1F1A1061136)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- remote driving, video streaming, wireless networks, UDP, TCP, communication delay, Robot Operating System, vehicle speed, autonomous driving, model cars, real-time control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.