Cited by 550Advanced Neural Network ApplicationsAdvanced Image Fusion TechniquesAutonomous Vehicle Technology and Safety

The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.

RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes

Sun, Yuxiang, Zuo, Weixun, Liu, Ming·2019·IEEE Robotics and Automation Letters

DOI 10.1109/lra.2019.2904733

Open this paper in CoChat — free account

Abstract

Semantic segmentation is a fundamental capability for autonomous vehicles. With the advancements of deep learning technologies, many effective semantic segmentation networks have been proposed in recent years. However, most of them are designed using RGB images from visible cameras. The quality of RGB images is prone to be degraded under unsatisfied lighting conditions, such as darkness and glares of oncoming headlights, which imposes critical challenges for the networks that use only RGB images. Different from visible cameras, thermal imaging cameras generate images using thermal radiations. They are able to see under various lighting conditions. In order to enable robust and accurate semantic segmentation for autonomous vehicles, we take the advantage of thermal images and fuse both the RGB and thermal information in a novel deep neural network. The main innovation of this letter is the architecture of the proposed network. We adopt the encoder–decoder design concept. ResNet is employed for feature extraction and a new decoder is developed to restore the feature map resolution. The experimental results prove that our network outperforms the state of the arts.

Integrity signals

Registry

Crossref · 10.1109/lra.2019.2904733

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Pyramid Scene Parsing Network
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Untitled work
(2010) · Cited by 14,134

Flagged first, then by citations

Show all 30 references

Research works printed but not linked: 1

vollmer, 2017, et�al

Sorted by citations

Items 201–300 of 550

Boosting Semantic Segmentation of Remote Sensing Images by Introducing Edge Extraction Network and Spectral Indices
Zhang, Y., Yang, R., Dai, Q., Zhao, Y., Xu, W., Wang, J., & Wang, L. (2023) · Remote Sensing · doi:10.3390/rs15215148 · Cited by 14
SICFNet: Shared Information Interaction and Complementary Feature Fusion Network for RGB-T traffic scene parsing
Zhang, B., Li, Z., Sun, F., Li, Z., Dong, X., Zhao, X., & Zhang, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127171 · Cited by 13
Texts as Lines: Text Detection with Weak Supervision
Wu, W., Xing, J., Yang, C., Wang, Y., & Zhou, H. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/3871897 · Cited by 13
An Enhanced Pedestrian Visual-Inertial SLAM System Aided with Vanishing Point in Indoor Environments
Chai, W., Li, C., Zhang, M., Sun, Z., Yuan, H., Lin, F., & Li, Q. (2021) · Sensors · doi:10.3390/s21227428 · Cited by 13
MPSA: A multi-level pixel spatial attention network for thermal image segmentation based on Deeplabv3+ architecture
Ren, S., Liu, Q., & Zhang, X. (2022) · Infrared Physics & Technology · doi:10.1016/j.infrared.2022.104193 · Cited by 13
AMFuse: Add–Multiply-Based Cross-Modal Fusion Network for Multi-Spectral Semantic Segmentation
Liu, H., Chen, F., Zeng, Z., & Tan, X. (2022) · Remote Sensing · doi:10.3390/rs14143368 · Cited by 13
FDFuse: Infrared and Visible Image Fusion Based on Feature Decomposition
Cheng, M., Huang, H., Liu, X., Mo, H., Wu, S., & Zhao, X. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3551460 · Cited by 12
Keep the Balance: A Parameter-Efficient Symmetrical Framework for RGB+X Semantic Segmentation
Cai, J., Su, J. K., Li, Q., Yang, W., Wang, S., Zhao, T., He, S., & Liu, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00990 · Cited by 12
MAFS: Masked Autoencoder for Infrared-Visible Image Fusion and Semantic Segmentation
Wang, L., Zhang, X., Jia, C., & Ma, S. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3611602 · Cited by 12
Multimodal Frequeny Spectrum Fusion Schema for RGB-T Image Semantic Segmentation
Liu, H., Zhang, W., Dai, T., Yin, L., & Ren, G. (2024) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn61486.2024.10637614 · Cited by 12
Asymmetric multimodal guidance fusion network for realtime visible and thermal semantic segmentation
Yang, B., Guo, Y., Ni, R., Liu, Y., Li, G., & Hu, C. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109881 · Cited by 12
HAPNet: Toward superior RGB-thermal scene parsing via hybrid, asymmetric, and progressive heterogeneous feature fusion
Li, J., Peng, Y., Xu, Y., Zhang, Y., Sun, M., Chen, Q., Alexander, I., & Fan, R. (2026) · Biomimetic Intelligence and Robotics · doi:10.1016/j.birob.2026.100309 · Cited by 12
Multi-modal body part segmentation of infants using deep learning
Voss, F., Brechmann, N., Lyra, S., Rixen, J., Leonhardt, S. K., & Antink, C. H. (2023) · BioMedical Engineering OnLine · doi:10.1186/s12938-023-01092-0 · Cited by 12
BVTNet: Multi-label Multi-class Fusion of Visible and Thermal Camera for Free Space and Pedestrian Segmentation
John, V., Boyali, A., Thompson, S., & Mita, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68780-9_24 · Cited by 12
Dual-branch deep cross-modal interaction network for semantic segmentation with thermal images
Dai, K., & Chen, S. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108820 · Cited by 11
Cosine similarity fusion network for real-time Red-Green-Blue and X-modality semantic segmentation of driving scenes
Qashqai, D., Mousavian, E., Shokouhi, S. B., & Mirzakuchaki, S. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114362 · Cited by 12
Multispectral Semantic Segmentation for UAVs: A Benchmark Dataset and Baseline
Li, Q. S., Yuan, H., Fu, T., Yu, Z., Zheng, B., & Chen, S. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3457674 · Cited by 12
PSNet: A Universal Algorithm for Multispectral Remote Sensing Image Segmentation
Zheng, Y., Chen, Z., Zheng, T., Tian, C., & Dong, W. (2025) · Remote Sensing · doi:10.3390/rs17040563 · Cited by 11
A comprehensive survey on image fusion: Which approach fits which need
Bernardi, G., Brisebarre, G., Roman, S., Ardabilian, M., & Dellandréa, E. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103594 · Cited by 15
A Multispectral Automated Transfer Technique (MATT) for Machine-Driven Image Labeling Utilizing the Segment Anything Model (SAM)
Gallagher, J., Gogia, A., & Oughton, E. J. (2024) · IEEE Access · doi:10.1109/access.2024.3522236 · Cited by 11
What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging
Tang, Z., Ye, W., Ma, W.-C., & Zhao, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01641 · Cited by 10
Semantic Guidance Fusion Network for Cross-Modal Semantic Segmentation
Zhang, P., Chen, M., & Gao, M. (2024) · Sensors · doi:10.3390/s24082473 · Cited by 10
Multimodal-XAD: Explainable Autonomous Driving Based on Multimodal Environment Descriptions
Feng, Y., Feng, Z., Hua, W., & Sun, Y. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3467175 · Cited by 10
Self-citation
RegSeg: An End-to-End Network for Multimodal RGB-Thermal Registration and Semantic Segmentation
Lai, W., Zeng, F., Hu, X., He, S., Liu, Z., & Jiang, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3501077 · Cited by 10
A novel method for monitoring material behaviour in urban buildings using aerial multi-modality imaging
Waqas, A., Araji, M. T., & Sherif, S. S. (2025) · Building and Environment · doi:10.1016/j.buildenv.2025.113300 · Cited by 10
Deep Visible and Thermal Camera-based Optimal Semantic Segmentation using Semantic Forecasting
John, V., Mita, S., Lakshmanan, A., Boyali, A., & Thompson, S. (2021) · Journal of Autonomous Vehicles and Systems · doi:10.1115/1.4052529 · Cited by 10
Dynamic Speed and Separation Monitoring Based on Scene Semantic Information
Yang, B., Xie, S., Chen, G., Ding, Z., & Wang, Z. (2022) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-022-01607-2 · Cited by 11
Computing Thermal Point Clouds by Fusing RGB-D and Infrared Images: From Dense Object Reconstruction to Environment Mapping
Zhang, T., Hu, L., Sun, Y., Li, L., & Navarro-Alarcón, D. (2022) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio55434.2022.10011817 · Cited by 10
Self-citation
HAFFseg: RGB-Thermal semantic segmentation network with hybrid adaptive feature fusion strategy
Yi, S., Chen, M., Liu, X., Li, J., & Chen, L. (2023) · Signal Processing Image Communication · doi:10.1016/j.image.2023.117027 · Cited by 10
OAFuser: Toward Omni-Aperture Fusion for Light Field Semantic Segmentation
Teng, F., Zhang, J., Peng, K., Wang, Y., Stiefelhagen, R., & Yang, K. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3457931 · Cited by 10
MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmark
Woo, S., Park, K., Shin, I., Kim, M., & Kweon, I. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02108 · Cited by 12
TAG-fusion: Two-stage attention guided multi-modal fusion network for semantic segmentation
Zhang, Z., Wang, W., Zhu, L., & Tang, Z. (2024) · Digital Signal Processing · doi:10.1016/j.dsp.2024.104807 · Cited by 9
Low-Light Enhancement and Global-Local Feature Interaction for RGB-T Semantic Segmentation
Guo, X., Liu, Y., Xue, W., Zhiwei, Z., & Zhuang, Y. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3545511 · Cited by 9
Detection of small water bodies for vector control using deep learning on multispectral imagery from unmanned aerial vehicles
Ngo, P. L., Pham, V. H., Bui, N. L., Phan, H. A. T., Vo, H. B., Velavan, T. P., & Tran, D.-K. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00422-6 · Cited by 9
AMDANet: Attention-Driven Multi-Perspective Discrepancy Alignment for RGB-Infrared Image Fusion and Segmentation
Zhong, H., Tang, F., Chen, Z., Chang, H. J., & Gao, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00991 · Cited by 9
Using thermal intensities to build conditional random fields for object segmentation at night
Dutta, A., Mandal, B., Ghosh, S., & Das, N. (2020) · International Conference on Computational Intelligence and Networks (CINE) · doi:10.1109/cine48825.2020.234402 · Cited by 9
DFAMNet: dual fusion attention multi-modal network for semantic segmentation on LiDAR point clouds
Li, M., Wang, G., Zhu, M., Li, C., Liu, H., Pan, X., & Qian, L. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05302-7 · Cited by 9
Learning Modality-Agnostic Representation for Semantic Segmentation from Any Modalities
Xu, Z., Lyu, Y., & Wang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72754-2_9 · Cited by 14
Capitalizing on RGB-FIR Hybrid Imaging for Road Detection
Zhang, Y., Xie, J., Álvarez, J. M., Xu, C., Yang, J. J., & Kong, H. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3129692 · Cited by 9
Saliency detection network with two-stream encoder and interactive decoder
Yang, A., Cheng, S., Song, S., Wang, J., Ji, Z., Pang, Y., & Cao, J. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.08.051 · Cited by 9
Illumination-aware window transformer for RGBT modality fusion
Zhou, L., & Chen, Z. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103725 · Cited by 9
SCFusion: Infrared and Visible Fusion Based on Salient Compensation
Liu, H., Ma, M., Wang, M., Chen, Z., & Zhao, Y. (2023) · Entropy · doi:10.3390/e25070985 · Cited by 9
CPAL: Cross-Prompting Adapter With LoRAs for RGB+X Semantic Segmentation
Liu, Y., Wu, P., Wang, M., & Liu, J. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3536086 · Cited by 11
Erasure-based interaction network for red-green-blue and thermal object detection and a unified benchmark
Wang, Q., Tu, Z., Li, C., Wang, H., & Wang, K. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111155 · Cited by 10
GF-ResFormer: A Hybrid Gabor-Fourier ResNet-Transformer Network for Precise Semantic Segmentation of High-Resolution Remote Sensing Imagery
Cao, Z., Huang, Y., Ji, Z., Zhou, Y., & Zhou, P. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3606691 · Cited by 8
Latent low-rank representation with sparse consistency constraint for infrared and visible image fusion
Tao, T., Liu, M.-X., Hou, Y., Wang, P., Yang, D., & Zhang, Q. (2022) · Optik · doi:10.1016/j.ijleo.2022.169102 · Cited by 8
Self-citation
A Review On Thermal Infrared Semantic Distribution for Nightfall Drive
Bandi, M., & Reeja, S. R. (2022) · International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT) · doi:10.1109/icicict54557.2022.9917651 · Cited by 8
Interactive Dual Network With Adaptive Density Map for Automatic Cell Counting
Liu, R., Zhu, Y., Wu, C., Guo, H., Dai, W., Wu, T., Wang, M., Li, W. J., & Liu, J. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3329973 · Cited by 8
CAFseg: A Semantic segmentation network with cross aggregation fusion strategy for RGB-thermal semantic segmentation
Yi, S., Wu, L., Liu, X., Li, J., & Jiang, G. (2023) · Infrared Physics & Technology · doi:10.1016/j.infrared.2023.105077 · Cited by 8
ShadowSense: Unsupervised Domain Adaptation and Feature Fusion for Shadow-Agnostic Tree Crown Detection from RGB-Thermal Drone Imagery
Kapil, R., Marvasti-Zadeh, S. M., Erbilgin, N., & Ray, N. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00808 · Cited by 8
Temporal Consistency for RGB-Thermal Data-Based Semantic Scene Understanding
Li, H., Chu, H. K., & Sun, Y. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3458594 · Cited by 8
Self-citation
Centering the Value of Every Modality: Towards Efficient and Resilient Modality-Agnostic Semantic Segmentation
Xu, Z., Lyu, Y., Zhou, J., & Wang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72890-7_12 · Cited by 8
Semantic Segmentation for Autonomous Driving
Yang, J., Guo, S., Bocus, M. J., Chen, Q., & Fan, R. (2023) · Advances in computer vision and pattern recognition · doi:10.1007/978-981-99-4287-9_4 · Cited by 8
We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain AdaptationPreprint
Fan, R., Wang, H., Bocus, M. J., & Liu, M. (2020) · doi:10.36227/techrxiv.12813323.v2 · Cited by 8
Self-citation
DEDNet: Dual-Encoder DeeplabV3+ Network for Rock Glacier Recognition Based on Multispectral Remote Sensing Image
Lin, L., Liu, L., Liu, M., Zhang, Q., Feng, M., Khalil, Y. S., & Yin, F. (2024) · Remote Sensing · doi:10.3390/rs16142603 · Cited by 7
Self-citation
Comparison of Asphalt Pavement Crack Segmentation Based on Different Fusion Methods of RGB Images and Thermal Images
Yu, Y., Kang, S., He, D., Kumar, R., Singh, V., & Wang, Z. (2025) · Journal of Transportation Engineering Part B Pavements · doi:10.1061/jpeodx.pveng-1747 · Cited by 7
Rethinking Early-Fusion Strategies for Improved Multimodal Image Segmentation
Shen, Z., Li, Y., Zhang, H., Weng, Y., & Wang, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889359 · Cited by 7
HMFENet: Hierarchical Matching Guided Feature Enhancement Network for Few-Shot RGB-Thermal Urban Scene Segmentation
Zhou, X., Ma, Y., Huang, J., Cai, Z., Zhu, Y., & Fan, F. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3549516 · Cited by 7
RT-X Net: RGB-Thermal Cross Attention Network for Low-Light Image Enhancement
Jha, R., Lenka, A., Ramanagopal, M. S., Sankaranarayanan, A. C., & Mitra, K. (2025) · Proceedings - International Conference on Image Processing · doi:10.1109/icip55913.2025.11084466 · Cited by 7
Fusion representation learning for foreground moving object detection
Wang, P., Wu, J., Fang, A., Zhu, Z., Wang, C., & Ren, S. (2023) · Digital Signal Processing · doi:10.1016/j.dsp.2023.104046 · Cited by 7
DDFL: Dual-Domain Feature Learning for nighttime semantic segmentation
Lin, X., Tan, P., Wang, Z., Ma, L., & Li, Y. (2024) · Displays · doi:10.1016/j.displa.2024.102685 · Cited by 7
SG-RoadSeg: End-to-End Collision-Free Space Detection Sharing Encoder Representations Jointly Learned via Unsupervised Deep Stereo
Wu, Z., Li, J., Feng, Y., Liu, C., Ye, W., Chen, Q., & Fan, R. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611191 · Cited by 7
Transferring Prior Thermal Knowledge for Snowy Urban Scene Semantic Segmentation
Guo, X., Liu, T., Mou, Y., Chai, S., Ren, B., Wang, Y., Shi, W., Liu, S., & Zhou, W. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3555617 · Cited by 7
Effective Free-Driving Region Detection for Mobile Robots by Uncertainty Estimation Using RGB-D Data
Nguyen, T.-K., Nguyen, P. T.-T., Nguyen, D.-D., & Kuo, C. (2022) · Sensors · doi:10.3390/s22134751 · Cited by 8
DepthFormer: Multimodal Positional Encodings and Cross-Input Attention for Transformer-based Segmentation Networks
Barbato, F., Rizzoli, G., & Zanuttigh, P. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096314 · Cited by 7
Thermal infrared image semantic segmentation for night-time driving scenes based on deep learning
Maheswari, B., & Reeja, S. R. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15882-0 · Cited by 7
AMFFNet: Asymmetric Multiscale Feature Fusion Network of RGB-NIR for Solid Waste Detection
Cai, Z., Fang, H., Jiang, F., Yang, J., Ji, T., Hu, Y., & Wang, X. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3300445 · Cited by 7
A Lightweight RGB-T Fusion Network for Practical Semantic Segmentation
Zhang, H., Li, Z., Wu, Z., & Wang, D. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10421911 · Cited by 7
IAFFNet: Illumination-Aware Feature Fusion Network for All-Day RGB-Thermal Semantic Segmentation of Road Scenes
Hou, Y.-L., Jia, Y., Hou, Z., Hao, X., & Shen, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3227771 · Cited by 7
Adaptive-Mask Fusion Network for Segmentation of Drivable Road and Negative Obstacle With Untrustworthy Features
Feng, Z., Feng, Y., Guo, Y., & Sun, Y. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186628 · Cited by 7
Self-citation
Towards Robust Training of Multi-Sensor Data Fusion Network Against Adversarial Examples in Semantic Segmentation
Yu, Y., Lee, H. J., Kim, B. C., Kim, J. U., & Ro, Y. M. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413772 · Cited by 7
VSLNet: Multimodal Data Fusion Network for Tree Species Classification in Overhead Transmission Line Corridors
Du, R., Zhang, H., Huang, Z., Zhong, H., Cao, Y., & Wang, Y. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3459014 · Cited by 6
MGFNet: a multiscale gated fusion network for multimodal semantic segmentation
Wu, H., Li, Z., & Wen, Z. (2025) · The Visual Computer · doi:10.1007/s00371-025-03912-x · Cited by 6
Robust Depth Estimation Under Sensor Degradations: A Multi-Sensor Fusion Perspective
Hu, J., Fan, C., Özay, M., Gao, Q. H., Guo, Y., & Lam, T. L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3581311 · Cited by 6
Multi-Stage Cross-Modality Feature Interaction for RGB-Thermal Multi-Object Tracking
Ma, J., Luo, H., Niu, S., Zhao, P., Liu, Y., Wei, Y., & Zhang, J. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3612499 · Cited by 6
DiFusionSeg: Diffusion-driven semantic segmentation with multi-modal image fusion for enhanced perception
Wang, Z., He, D., Zhao, L., Liu, B., Zheng, Y., & Zhang, X. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114481 · Cited by 7
Hierarchical Multi-Modal Enhancement for Robust Transmission Line Detection
Zhang, S., Zhang, X., Wan, S., Jiang, Y. M., Zhou, W., Shen, L., & Ren, W. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3706642 · Cited by 6
ERCU-Net: segmentation of road potholes using enhanced residual convolutional block based on U-Net for ADAS
Tripathi, R., Indu, S., & Kumar, R. (2024) · Signal Image and Video Processing · doi:10.1007/s11760-024-03161-w · Cited by 6
Diversity-oriented Contrastive Learning for RGB-T Scene Parsing
Liu, H., Ren, G., Dai, T., Zhang, D., Xu, P., Zhang, W., & Hu, B. (2023) · International Conference on Sensing, Measurement, Communication and Internet of Things Technologies (SMC-IoT) · doi:10.1109/smc-iot62253.2023.00035 · Cited by 6
SMALNet: Segment Anything Model Aided Lightweight Network for Infrared Image Segmentation
Ding, K., Xiang, S., & Pan, C. (2024) · Infrared Physics & Technology · doi:10.1016/j.infrared.2024.105540 · Cited by 6
Combined gated graph convolution neural networks with multi-modal geospatial data for forest type classification
Pei, H., Owari, T., Tsuyuki, S., Hiroshima, T., & Hong, D. (2025) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2025.104372 · Cited by 6
Real-Time Flame Segmentation based on RGB-Thermal Fusion
Guo, S., Hu, B., & Huang, R. (2021) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio54168.2021.9739283 · Cited by 6
Semantic Segmentation for Autonomous Driving
Divakarla, U., Bhat, R., Madagaonkar, S. B., Pranav, D. V., Shyam, C., & Chandrashekar, K. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-19-9304-6_61 · Cited by 6
Annals of Scientific Society for Assembly, Handling and Industrial Robotics 2022
Schüppstuhl, T., Tracht, K., & Fleischer, J. (2023) · Springer eBooks · doi:10.1007/978-3-031-10071-0 · Cited by 6
Smooth fusion of multi-spectral images via total variation minimization for traffic scene semantic segmentation
Li, Y., Fang, A., Guo, Y., Sun, W., Yang, X., & Wang, X. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107741 · Cited by 6
Robust Lane Marking Detection Algorithm Using Drivable Area Segmentation and Extended SLT
Ozgunalp, U., Fan, R., Cheng, S., Sun, Y., Zuo, W., Zhu, Y., Xue, B., Zheng, L., Qing, L., & Liu, M. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961686 · Cited by 6
Self-citation
Reliable Monocular Ego-Motion Estimation System in Rainy Urban Environments
Huang, H., Sun, Y., & Liu, M. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8916977 · Cited by 6
Self-citation
Multiple-object Tracking based on Monocular Camera and 3-D Lidar Fusion for Autonomous Vehicles
Chen, H., Xue, C., Liu, S., Sun, Y., & Chen, Y. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961438 · Cited by 6
Self-citation
We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain AdaptationPreprint
Fan, R., Wang, H., Bocus, M. J., & Liu, M. (2020) · doi:10.36227/techrxiv.12813323 · Cited by 6
Self-citation
NTFNet: Narrowing-Then-Fusing network for RGB-TIR semantic segmentation
Liu, Y., Ye, J., He, W., Qu, Z., & Xu, R. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06411-7 · Cited by 5
Modality-Incremental Learning with Disjoint Relevance Mapping Networks for Image-Based Semantic Segmentation
Hegde, N., Muralidhara, S., Schuster, R., & Stricker, D. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00541 · Cited by 5
Cooperative Multi-Modal Semantic Communication Scheme for Semantic Segmentation in Autonomous Driving Systems
Feng, Y., Shen, H., Shi, X., & Yang, Q. (2025) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc61545.2025.10978268 · Cited by 5
USformer: A U-Shaped Structure Transformer for RGB-Thermal Semantic Segmentation and Traffic Scene Understanding
Yang, F., Shao, F., Mu, B., Chai, X., & Jiang, Q. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3624821 · Cited by 5
Multimodal image fusion to enhance 3D reconstruction based on IKKD-tree registration and CSTDFusion
Li, H., Wen, S., Li, S., Cao, X., Geng, X., Wu, S., Yue, C., & Liu, S. (2025) · Infrared Physics & Technology · doi:10.1016/j.infrared.2025.106255 · Cited by 5
Mul-VMamba: Multimodal semantic segmentation using selection-fusion-based vision-Mamba
Ni, R., Guo, Y., Yang, B., Liu, Y., Wang, H., & Hu, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.115119 · Cited by 5
GEM-YOLO: A Lightweight and Real-Time RGBT Object Detector with Gated Multimodal Fusion
Wang, L., Bao, Z., & Lu, D. (2026) · Sensors · doi:10.3390/s26072035 · Cited by 5
Simple Scalable Multimodal Semantic Segmentation Model
Zhu, Y., & Xiao, N. (2024) · Sensors · doi:10.3390/s24020699 · Cited by 5
The Deep Learning Methods for Fusion Infrared and Visible Images: A Survey
Neamah, R. M., & Al-Asadi, T. A. (2024) · Revue d intelligence artificielle · doi:10.18280/ria.380221 · Cited by 5
HEFANet: hierarchical efficient fusion and aggregation segmentation network for enhanced rgb-thermal urban scene parsing
Shen, Z., Pan, Z., Weng, Y., Li, Y., Wang, J., & Wang, J. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05743-0 · Cited by 5
Illumination Robust Semantic Segmentation Based on Cross-Dimensional Multispectral Edge Fusion in Dynamic Traffic Scenes
Ni, P., Hu, W., Hu, J., Chen, X., & Liu, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3498896 · Cited by 5

Authors: Sun, Y., Zuo, W., & Liu, M.
Affiliations: Hong Kong University of Science and Technology (HK)
ORCID: Sun, Yuxiang
Zuo, Weixun
Liu, Ming
Venue: IEEE Robotics and Automation Letters
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 2019-07
Volume: 4
Issue: 3
Pages: 2576-2583
ISSN: 2377-3766 (ISSN-L)
2377-3774
DOI: 10.1109/lra.2019.2904733
OpenAlex: W2921749009
Cited by: 546
References: 30
Citations by year: 2026: 87 · 2025: 127 · 2024: 102 · 2023: 94 · 2022: 51 · 2021: 45 · 2020: 31 · 2019: 9
FWCI: 15.22
Type: journal article
Language: en
Open access: closed
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Robotics and Automation Letters (publishedVersion)
Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
Funders: Shenzhen Science, Technology, and Innovation Commission (JCYJ20160401100022706)
National Natural Science Foundation of China (U1713211)
Hong Kong University of Science and Technology Project (IGN16EG12)
Hong Kong Research Grant Council (11210017, 21202816)
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Engineering › Media Technology › Advanced Image Fusion Techniques
Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
Keywords: RGB-thermal fusion, semantic segmentation, urban scenes, autonomous vehicles, infrared thermography, encoder-decoder architecture, ResNet feature extraction, low-light conditions, headlight glare

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

RTFNet: RGB-Thermal Fusion Network for Semantic Segmentation of Urban Scenes

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks