The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation
Open accessAbstract
Semantic segmentation is a challenging task that addresses most of the perception needs of intelligent vehicles (IVs) in an unified way. Deep neural networks excel at this task, as they can be trained end-to-end to accurately classify multiple object categories in an image at pixel level. However, a good tradeoff between high quality and computational resources is yet not present in the state-of-the-art semantic segmentation approaches, limiting their application in real vehicles. In this paper, we propose a deep architecture that is able to run in real time while providing accurate semantic segmentation. The core of our architecture is a novel layer that uses residual connections and factorized convolutions in order to remain efficient while retaining remarkable accuracy. Our approach is able to run at over 83 FPS in a single Titan X, and 7 FPS in a Jetson TX1 (embedded device). A comprehensive set of experiments on the publicly available Cityscapes data set demonstrates that our system achieves an accuracy that is similar to the state of the art, while being orders of magnitude faster to compute than other architectures that achieve top precision. The resulting tradeoff makes our model an ideal approach for scene understanding in IV applications. The code is publicly available at: https://github.com/Eromera/erfnet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Research works printed but not linked: 1
- badrinarayanan, 2015, Segnet A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling
Cited by
BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation
Yu, C., Gao, C., Wang, J., Yu, G., Shen, C., & Sang, N. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01515-2 · Cited by 1,813
Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.06.008 · Cited by 1,349
RangeNet ++: Fast and Accurate LiDAR Semantic Segmentation
Milioto, A., Vizzo, I., Behley, J., & Stachniss, C. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967762 · Cited by 1,240
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
Mehta, S., Rastegari, M., Caspi, A., Shapiro, L., & Hajishirzi, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_34 · Cited by 1,029
CGNet: A Light-Weight Context Guided Network for Semantic Segmentation
Wu, T., Tang, S., Zhang, R., Cao, J., & Zhang, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3042065 · Cited by 859
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation With Transformers
Zhang, J., Liu, H., Yang, K., Hu, X., Liu, R., & Stiefelhagen, R. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3300537 · Cited by 731
Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions
Muhammad, K., Ullah, A., Lloret, J., Ser, J. D., & de Albuquerque, V. H. C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3032227 · Cited by 659
Review the state-of-the-art technologies of semantic segmentation based on deep learning
Mo, Y., Wu, Y., Yang, X., Liu, F., & Liao, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.005 · Cited by 632
A Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
Survey on semantic segmentation using deep learning techniques
Lateef, F., & Ruichek, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.003 · Cited by 559
ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network
Mehta, S., Rastegari, M., Shapiro, L., & Hajishirzi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00941 · Cited by 551
Rtfnet: Rgb-thermal fusion network for semantic segmentation of urban scenes
Sun, Y., Zuo, W., & Liu, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2904733 · Cited by 546
“[12] E. Romera, J. M. Álvarez, L. M. Bergasa, and R. Arroyo, “ERFNet: efficient residual factorized convnet for real-time semantic segmentation,” IEEE Trans.”
BackgroundMethodInfluentialDeep Dual-Resolution Networks for Real-Time and Accurate Semantic Segmentation of Traffic Scenes
Pan, H., Hong, Y., Sun, W., & Jia, Y. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3228042 · Cited by 495
Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection
Tabelini, L., Berriel, R., Paixao, T. M., Badue, C., De Souza, A. F., & Oliveira-Santos, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00036 · Cited by 478
Channel-wise Knowledge Distillation for Dense Prediction
Shu, C., Liu, Y., Gao, J., Yan, Z., & Shen, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00526 · Cited by 452
Li, R., Zheng, S., Zhang, C., Duan, C., Wang, L., & Atkinson, P. M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.005 · Cited by 443
Automotive LiDAR Technology: A Survey
Roriz, R., Cabral, J., & Gomes, T. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3086804 · Cited by 442
Orsic, M., Kreso, I., Bevandic, P., & Segvic, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01289 · Cited by 416
Semantic Flow for Fast and Accurate Scene Parsing
Li, X., You, A., Zhu, Z., Zhao, H., Yang, M., Yang, K., Tan, S., & Tong, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_45 · Cited by 416
Lednet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation
Wang, Y., Zhou, Q., Liu, J., Xiong, J., Gao, G., Wu, X., & Latecki, L. J. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803154 · Cited by 411
IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environments
Varma, G., Subramanian, A., Namboodiri, A., Chandraker, M., & Jawahar, C. V. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00190 · Cited by 353
Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds
Simon, M., Amende, K., Kraus, A., Honer, J., Samann, T., Kaulbersch, H., Milz, S., & Gross, H. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00158 · Cited by 304
RESA: Recurrent Feature-Shift Aggregator for Lane Detection
Zheng, T., Fang, H., Zhang, Y., Tang, W., Yang, Z., Liu, H., & Cai, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16469 · Cited by 310
Sa, I., Popović, M., Khanna, R., Chen, Z., Lottes, P., Liebisch, F., Nieto, J., Stachniss, C., Walter, A., & Siegwart, R. (2018) · Remote Sensing · doi:10.3390/rs10091423 · Cited by 305
Efficient RGB-D Semantic Segmentation for Indoor Scene Analysis
Seichter, D., Kohler, M., Lewandowski, B., Wengefeld, T., & Gross, H.-M. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561675 · Cited by 330
“Efficient approaches with custom architectures such as ERFNet [26], LEDNet [27], and ESPNetv2 [32] are quite”
BackgroundMethodInfluentialSelf-supervised model adaptation for multimodal semantic segmentation
Valada, A., Mohan, R., & Burgard, W. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01188-y · Cited by 293
“60% with an inference time of 66.06ms, thereby out-performing both the unimodal RGB ERFnet model and the unimodal HHA ERFnet model.”
MethodInfluentialEff-UNet: A Novel Architecture for Semantic Segmentation in Unstructured Environment
Baheti, B., Innani, S., Gajre, S., & Talbar, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00187 · Cited by 278
XNect: real-time multi-person 3D motion capture with a single RGB camera
Mehta, D., Sotnychenko, O., Mueller, F., Xu, W., Elgharib, M., Fua, P., Seidel, H.-P., Rhodin, H., Pons-Moll, G., & Theobalt, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392410 · Cited by 274
Boundary-Aware Feature Propagation for Scene Segmentation
Ding, H., Jiang, X., Liu, A. Q., Thalmann, N. M., & Wang, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00692 · Cited by 271
FuseSeg: Semantic segmentation of urban scenes based on RGB and thermal data fusion
Sun, Y., Zuo, W., Yun, P., Wang, H., & Liu, M. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.2993143 · Cited by 270
PST900: RGB-Thermal Calibration, Dataset and Segmentation Network
Shivakumar, S. S., Rodrigues, N., Zhou, A., Miller, I. D., Kumar, V., & Taylor, C. J. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196831 · Cited by 263
Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes
Hong, Y., Pan, H., Sun, W., & Jia, Y. (2021) · arXiv · doi:10.48550/arxiv.2101.06085 · Cited by 261
Instance Segmentation by Jointly Optimizing Spatial Embeddings and Clustering Bandwidth
Neven, D., Brabandere, B. D., Proesmans, M., & Van Gool, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00904 · Cited by 258
HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentation
Nirkin, Y., Wolf, L., & Hassner, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00405 · Cited by 254
FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentation
Deng, F., Feng, H., Liang, M., Wang, H., Yang, Y., Gao, Y., Chen, J., Hu, J., Guo, X., & Lam, T. L. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636084 · Cited by 170
“Most of the existing deep learning-based semantic segmentation networks [4] [5] mainly deal with RGB images.”
BackgroundEdge-Aware Guidance Fusion Network for RGB–Thermal Scene Parsing
Zhou, W., Dong, S., Xu, C., & Qian, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20269 · Cited by 146
Physics-Based Rendering for Improving Robustness to Rain
Halder, S., Lalonde, J.-F., & Charette, R. D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01030 · Cited by 130
Polarization-driven semantic segmentation via efficient attention-bridged fusion
Xiang, K., Yang, K., & Wang, K. (2021) · Optics Express · doi:10.1364/oe.416130 · Cited by 111
A Review of Embedded Machine Learning Based on Hardware, Application, and Sensing Scheme
Biglari, A., & Tang, W. (2023) · Sensors · doi:10.3390/s23042131 · Cited by 86
ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions
Gao, H., Wang, Z., Cai, L., & Ji, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2975796 · Cited by 81
Machine learning in prostate MRI for prostate cancer: current status and future opportunities
Li, H., Lee, C. H., Chia, D., Lin, Z., Huang, W., & Tan, C. H. (2022) · Diagnostics · doi:10.3390/diagnostics12020289 · Cited by 74
“[48] compared three deep learning methods, UNet, an efficient neural network (ENet) [60], and efficiently residually factorize ConvNet (ERFNet) [61] in the PROSTATEx public dataset.”
MethodLi, G., Jiang, S., Yun, I., Kim, J., & Kim, J. (2020) · IEEE Access · doi:10.1109/access.2020.2971760 · Cited by 53
Visual Scene Understanding for Autonomous Driving Using Semantic Segmentation
Hofmarcher, M., Unterthiner, T., Arjona-Medina, J., Klambauer, G., Hochreiter, S., & Nessler, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_15 · Cited by 51
Hard pixel mining for depth privileged semantic segmentation
Gu, Z., Niu, L., Zhao, H., & Zhang, L. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3035231 · Cited by 41
Yang, C., Yang, Z., Liao, S., Guo, J., Yin, S., Liu, C., & Kang, Y. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105801 · Cited by 16
Singh, V. K., Yousef Kalafi, E., Cheah, E., Wang, S., Wang, J., Ozturk, A., Li, Q., Eldar, Y. C., Samir, A. E., & Kumar, V. (2022) · Diagnostics · doi:10.3390/diagnostics12123213 · Cited by 11
“With the great success of CNNs, 46 multiple popular segmentation methods have been developed such as FCN [11], U-Net 47 [12], SegNet [13], Attention-UNet [14], DeepLabv3+ [15], ERFNet [16], and BiseNetv2 [17] 48 that segment the objects or anatomies.”
MethodToward Real-World Voice Disorder Classification
Kuo, H.-C., Hsieh, Y.-P., Tseng, H.-H., Wang, C.-T., Fang, S.-H., & Tsao, Y. (2023) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2023.3270532 · Cited by 10
Metadata
- Authors
- Romera, E., Alvarez, J. M., Bergasa, L. M., & Arroyo, R.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2018-01
- Volume
- 19
- Issue
- 1
- Pages
- 263-272
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2762439315
- Cited by
- 1,484
- References
- 39
- FWCI
- 36.05
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Spanish MINECO through the SmartElderlyCar Project (TRA2015-70501-C2-1-R)
- RoboCity2030-III-CM Project
- Programas de actividades I D CAM
- EU Structural Funds
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.