CoChat
Sign Up
PreprintCited by 11Advanced Neural Network ApplicationsAutonomous Vehicle Technology and SafetyDomain Adaptation and Few-Shot Learning

The DOI matches its DataCite record.

Semantic Segmentation for Autonomous Driving: Model Evaluation, Dataset Generation, Perspective Comparison, and Real-Time Capability

Open access
Cakir, Senay, Gauß, Marcel, Häppeler, Kai, Ounajjar, Yassine, Heinle, Fabian, Marchthaler, Reiner·2022·arXiv
DOI 10.48550/arxiv.2207.12939arXiv 2207.12939
Open this paper in CoChat — free accountOpen PDF

Abstract

Environmental perception is an important aspect within the field of autonomous vehicles that provides crucial information about the driving domain, including but not limited to identifying clear driving areas and surrounding obstacles. Semantic segmentation is a widely used perception method for self-driving cars that associates each pixel of an image with a predefined class. In this context, several segmentation models are evaluated regarding accuracy and efficiency. Experimental results on the generated dataset confirm that the segmentation model FasterSeg is fast enough to be used in realtime on lowpower computational (embedded) devices in self-driving cars. A simple method is also introduced to generate synthetic training data for the model. Moreover, the accuracy of the first-person perspective and the bird's eye view perspective are compared. For a $320 \times 256$ input in the first-person perspective, FasterSeg achieves $65.44\,\%$ mean Intersection over Union (mIoU), and for a $320 \times 256$ input from the bird's eye view perspective, FasterSeg achieves $64.08\,\%$ mIoU. Both perspectives achieve a frame rate of $247.11$ Frames per Second (FPS) on the NVIDIA Jetson AGX Xavier. Lastly, the frame rate and the accuracy with respect to the arithmetic 16-bit Floating Point (FP16) and 32-bit Floating Point (FP32) of both perspectives are measured and compared on the target hardware.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2207.12939

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Still being checked.

Research works printed but not linked: 19

  1. [1][1] T. Nguyen and M. Yoo, 'Fusing LIDAR sensor and RGB camera for object detection in autonomous vehicle with fuzzy logic approach,' 2021 International Conference on Information Networking (ICOIN), 2021, pp. 788-791, doi: 10.1109/ICOIN50884.2021.9334015. - · DOI
  2. [2][2] K. Min, S. Han, D. Lee, D. Choi, K. Sung and J. Choi, 'SAE Level 3 Autonomous Driving Technology of the ETRI,' 2019 International Conference on Information and Communication Technology Convergence (ICTC), 2019, pp. 464-466, doi: 10.1109/ICTC46691.2019.8939765. - · DOI
  3. [3][3] L. Bartolomei, L. Teixeira and M. Chli, 'Perception-aware Path Planning for UAVs using Semantic Segmentation,' 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020, pp. 58085815, doi: 10.1109/IROS45743.2020.9341347. - · DOI
  4. [4][4] M. Hua, Y. Nan and S. Lian, 'Small Obstacle Avoidance Based on RGBD Semantic Segmentation,' 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), 2019, pp. 886-894, doi: 10.1109/ICCVW.2019.00117. - · DOI
  5. [12][12] Lin, T. Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., ... & Zitnick, C. L. (2014, September). Microsoft coco: Common objects in context. In European conference on computer vision (pp. 740-755). Springer, Cham -
  6. [13][13] M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, 'The Cityscapes Dataset for Semantic Urban Scene Understanding,' 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 3213-3223, doi: 10.1109/CVPR.2016.350. - · DOI · Paper page
  7. [14][14] H. Chen, K. Sun, Z. Tian, C. Shen, Y. Huang and Y. Yan, 'BlendMask: Top-Down Meets Bottom-Up for Instance Segmentation,' 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 8570-8578, doi: 10.1109/CVPR42600.2020.00860. - · DOI
  8. [15][15] D. Bolya, C. Zhou, F. Xiao and Y. J. Lee, 'YOLACT++ Better RealTime Instance Segmentation,' in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 2, pp. 1108-1121, 1 Feb. 2022, doi: 10.1109/TPAMI.2020.3014297 - · DOI · Paper page
  9. [16][16] Y. Lee and J. Park, 'CenterMask: Real-Time Anchor-Free Instance Segmentation,' 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 13903-13912, doi: 10.1109/CVPR42600.2020.01392. - · DOI · Paper page
  10. [17][17] D. Bolya, C. Zhou, F. Xiao and Y. J. Lee, 'YOLACT: RealTime Instance Segmentation,' 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 9156-9165, doi: 10.1109/ICCV.2019.00925. - · DOI · Paper page
  11. [18][18] P. Chao, C. -Y. Kao, Y. Ruan, C. -H. Huang and Y. -L. Lin, 'HarDNet: A Low Memory Traffic Network,' 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 3551-3560, doi: 10.1109/ICCV.2019.00365. - · DOI
  12. [20][20] M. Orˇ sic, I. Kreˇ so, P. Bevandi´ c, and S. ˇ Segvi´ c, 'In Defense of Pretrained ImageNet Architectures for Real-time Semantic Segmentation of Road-driving Images,' Apr. 12, 2019, arXiv:1903.08469v2. [Online]. Available: https://arxiv.org/pdf/1903.08469v2.pdf - · arXiv
  13. [21][21] C. Yu, C. Gao, J. Wang, G. Yu, C. Shen and N.Sang, 'BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation,' Apr. 5, 2020, arXiv:2004.02147v1. [Online]. Available: https://arxiv.org/pdf/2004.02147v1.pdf - · arXiv
  14. [22][22] W.Chen, X. Gong, X. Liu, Q. Zhang, Y. Li and Z. Wang, 'FASTERSEG: SEARCHING FOR FASTER REAL-TIME SEMANTIC SEGMENTATION,' Jan. 16, 2020, arXiv:1912.10917. [Online]. Available: https: //arxiv.org/pdf/1912.10917.pdf - · arXiv
  15. [23][23] C. Yu, J. Wang, C. Peng, C. Gao, G. Yu, and N.Sang. (2018). Bisenet: Bilateral segmentation network for real-time semantic segmentation. In Proceedings of the European conference on computer vision (ECCV) (pp. 325-341). -
  16. [25][25] DUONG, Tin Trung, PHAM, Cuong Cao, TRAN, Tai Huu-Phuong, et al. Near real-time ego-lane detection in highway and urban streets. In : 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia). IEEE, 2016. p. 1-4. -
  17. [26][26] KIM, ZuWhan. Robust lane detection and tracking in challenging scenarios. IEEE Transactions on intelligent transportation systems, 2008, vol. 9, no 1, p. 16-26. -
  18. [27][27] S. Minaee, Y. Y. Boykov, F. Porikli, A. J. Plaza, N. Kehtarnavaz and D. Terzopoulos, 'Image Segmentation Using Deep Learning: A Survey,' in IEEE Transactions on Pattern Analysis and Machine Intelligence, doi: 10.1109/TPAMI.2021.3059968 - · DOI · Paper page
  19. [28][28] Everingham, M., Eslami, S.M.A., Van Gool, L. et al. The Pascal Visual Object Classes Challenge: A Retrospective. Int J Comput Vis 111, 98?136 (2015). https://doi.org/10.1007/s11263-014-0733-5 · DOI · Paper page

Cited by

Sorted by citations

See all 11

Metadata

Authors
Cakir, S., Gauß, M., Häppeler, K., Ounajjar, Y., Heinle, F., & Marchthaler, R.
Affiliations
Esslingen University of Applied Sciences (DE)
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2207.12939
arXiv
2207.12939
OpenAlex
W4288099398
Cited by
11
References
0
Citations by year
2025: 4 · 2024: 2 · 2023: 5
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by-sa/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
semantic segmentation, autonomous driving, environmental perception, synthetic training data generation, bird's-eye view, first-person perspective, real-time inference, embedded devices, NVIDIA Jetson AGX Xavier

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Semantic Segmentation for Autonomous Driving: Model Evaluation, Dataset Generation, Perspective Comparison, and Real-Time Capability. https://app.cochat.ai/papers/10.48550/arxiv.2207.12939
The paper
Cakir, S., Gauß, M., Häppeler, K., Ounajjar, Y., Heinle, F., & Marchthaler, R. (2022). Semantic Segmentation for Autonomous Driving: Model Evaluation, Dataset Generation, Perspective Comparison, and Real-Time Capability. arXiv. https://doi.org/10.48550/arxiv.2207.12939