Deep multimodal fusion for semantic image segmentation: A survey

Attention Is All You Need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148

U-Net: Convolutional Networks for Biomedical Image Segmentation

Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404

Deep learning

LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126

ImageNet: A large-scale hierarchical image database

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333

Gradient-based learning applied to document recognition

Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805

Microsoft COCO: Common Objects in Context

Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460

Fully convolutional networks for semantic segmentation

Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818

Xception: Deep Learning with Depthwise Separable Convolutions

Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054

SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation

Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631

The pascal visual object classes (VOC) challenge

Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599

Proceedings of IEEE Conference on Computer Vision and Pattern Recognition

(1993) · doi:10.1109/cvpr.1993 · Cited by 17,989

Pyramid Scene Parsing Network

Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438

A survey on deep learning in medical image analysis

Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint

Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273

Proceedings of IEEE International Conference on Computer Vision

(1995) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466933 · Cited by 13,117

The Cityscapes Dataset for Semantic Urban Scene Understanding

Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433

Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971

Untitled work

(2016) · Cited by 11,679

Vision meets robotics: The KITTI dataset

Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913

Multi-scale context aggregation by dilated convolutions

Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738

Rethinking Atrous Convolution for Semantic Image Segmentation

Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517

A systematic analysis of performance measures for classification tasks

Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471

Indoor segmentation and support inference from rgbd images

Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760

Adaptive Mixtures of Local Experts

Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384

Multimodal Machine Learning: A Survey and Taxonomy

Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018

Learning Deconvolution Network for Semantic Segmentation

Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422

ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes

Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T., & Niessner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.261 · Cited by 4,368

Combining Pattern Classifiers: Methods and Algorithms

Bagui, S. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 4,364

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196

Multi-view 3D Object Detection Network for Autonomous Driving

Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450

Scene Parsing through ADE20K Dataset

Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.544 · Cited by 3,326

RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation

Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287 · cited 1×

A Critical Review of Recurrent Neural Networks for Sequence LearningPreprint

Lipton, Z. C., Berkowitz, J. A., & Elkan, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.00019 · Cited by 3,159

Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors

Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743

Conditional Random Fields as Recurrent Neural Networks

Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 2×

The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes

Ros, G., Sellart, L., Materzynska, J., Vazquez, D., & Lopez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.352 · Cited by 2,338

Methods of combining multiple classifiers and their applications to handwriting recognition

Xu, L., Krzyżak, A., & Suen, C. Y. (1992) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.155943 · Cited by 2,192

Understanding Convolution for Semantic Segmentation

Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., & Cottrell, G. W. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00163 · Cited by 2,184

Multisensor data fusion: A review of the state-of-the-art

Khaleghi, B., Khamis, A. M., Karray, F. O., & Razavi, S. (2011) · Information Fusion · doi:10.1016/j.inffus.2011.08.001 · Cited by 2,097

Playing for Data: Ground Truth from Computer Games

Richter, S. R., Vineet, V., Roth, S., & Koltun, V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_7 · Cited by 1,981

SUN RGB-D: A RGB-D scene understanding benchmark suite

Song, S., Lichtenberg, S. P., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298655 · Cited by 1,943

ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation

Paszke, A., Chaurasia, A., Kim, S., & Culurciello, E. (2016) · arXiv · doi:10.48550/arxiv.1606.02147 · Cited by 1,826

Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network

Peng, C., Zhang, X., Yu, G., Luo, G., & Sun, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.189 · Cited by 1,750

Semantic contours from inverse detectors

Hariharan, B., Arbeláez, P., Bourdev, L. D., Maji, S., & Malik, J. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126343 · Cited by 1,743

ICNet for Real-Time Semantic Segmentation on High-Resolution Images

Zhao, H., Qi, X., Shen, X., Shi, J., & Jia, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_25 · Cited by 1,709

Learning Rich Features from RGB-D Images for Object Detection and Segmentation

Gupta, S., Girshick, R., Arbeláez, P., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_23 · Cited by 1,528

Attention to Scale: Scale-Aware Semantic Image Segmentation

Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.396 · Cited by 1,453

The Role of Context for Object Detection and Semantic Segmentation in the Wild

Mottaghi, R., Chen, X., Liu, X., Cho, N.-G., Lee, S.-W., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.119 · Cited by 1,438

The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes

Neuhold, G., Ollmann, T., Bulo, S. R., & Kontschieder, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.534 · Cited by 1,434

Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

Feng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425

2009 IEEE 12th International Conference on Computer Vision

(2009) · doi:10.1109/iccv15264.2009 · Cited by 1,374

Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects

Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296

Multimodal fusion for multimedia analysis: a survey

Atrey, P. K., Hossain, M. A., El Saddik, A., & Kankanhalli, M. S. (2010) · Multimedia Systems · doi:10.1007/s00530-010-0182-0 · Cited by 1,279

TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation

Shotton, J., Winn, J. M., Rother, C., & Criminisi, A. (2006) · Lecture notes in computer science · doi:10.1007/11744023_1 · Cited by 1,154

Deep multimodal learning: a survey on recent advances and trends

Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139 · cited 3×

Segmentation and Recognition Using Structure from Motion Point Clouds

Brostow, G. J., Shotton, J., Fauqueur, J., & Cipolla, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_5 · Cited by 1,050

A Review on Deep Learning Techniques Applied to Semantic SegmentationPreprint

García-García, A., Orts‐Escolano, S., Oprea, S., Villena-Martínez, V., & García‐Rodríguez, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.06857 · Cited by 1,049

Matrix Fourier optics enables a compact full-Stokes polarization camera

Rubin, N. A., D’Aversa, G., Chevalier, P., Shi, Z., Chen, W. T., & Capasso, F. (2019) · Science · doi:10.1126/science.aax1839 · Cited by 1,035

2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

(2017) · doi:10.1109/iros37595.2017 · Cited by 955

Deep semantic segmentation of natural and medical images: a review

Taghanaki, S. A., Abhishek, K., Cohen, J., Cohen‐Adad, J., & Hamarneh, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 929

FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-Based CNN Architecture

Hazirbas, C., Ma, L., Domokos, C., & Cremers, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54181-5_14 · Cited by 902

Instant dehazing of images using polarization

Schechner, Y. Y., Narasimhan, S. G., & Nayar, S. K. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990493 · Cited by 866

PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimation

Xu, D., Anguelov, D., & Jain, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00033 · Cited by 856

Thermal cameras and applications: A survey

Gade, R., & Moeslund, T. B. (2014) · Machine Vision and Applications · doi:10.1007/s00138-013-0570-5 · Cited by 780

DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation

Li, H., Xiong, P., Fan, H., & Sun, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00975 · Cited by 780

2015 IEEE International Conference on Robotics and Automation (ICRA)

(2015) · doi:10.1109/icra30979.2015 · Cited by 740

Decomposing a scene into geometric and semantically consistent regions

Gould, S. J., Fulton, R., & Koller, D. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459211 · Cited by 697

A review: Deep learning for medical image segmentation using multi-modality fusion

Zhou, T., Ruan, S., & Canu, S. (2019) · Array · doi:10.1016/j.array.2019.100004 · Cited by 696

MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes

Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., & Harada, T. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206396 · Cited by 693

Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks

Audebert, N., Saux, B. L., & Lefèvre, S. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.011 · Cited by 678

Multimodal deep learning for robust RGB-D object recognition

Eitel, A., Springenberg, J. T., Spinello, L., Riedmiller, M., & Burgard, W. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353446 · Cited by 667

Multispectral Deep Neural Networks for Pedestrian Detection

Liu, J., Zhang, S., Wang, S., & Metaxas, D. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.73 · Cited by 634

Detect What You Can: Detecting and Representing Objects Using Holistic Models and Body Parts

Chen, X., Mottaghi, R., Liu, X., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.254 · Cited by 605

ExFuse: Enhancing Feature Fusion for Semantic Segmentation

Zhang, Z., Zhang, X., Peng, C., Xue, X., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_17 · Cited by 604

Illumination-aware faster R-CNN for robust multispectral pedestrian detection

Li, C., Song, D., Tong, R., & Tang, M. A. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.005 · Cited by 568

Rtfnet: Rgb-thermal fusion network for semantic segmentation of urban scenes

Sun, Y., Zuo, W., & Liu, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2904733 · Cited by 546

2018 24th International Conference on Pattern Recognition (ICPR)

(2018) · doi:10.1109/icpr43097.2018 · Cited by 542

Recent progress in semantic image segmentation

Liu, X., Deng, Z., & Yang, Y. (2018) · Artificial Intelligence Review · doi:10.1007/s10462-018-9641-3 · Cited by 538

ScanNet: Richly-annotated 3D Reconstructions of Indoor ScenesPreprint

Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T. A., & Nießner, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.04405 · Cited by 537

Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition

(1992) · doi:10.1109/cvpr.1992 · Cited by 536

ACNET: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation

Hu, X., Yang, K., Fei, L., & Wang, K. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803025 · Cited by 500

Indoor Semantic Segmentation using depth information

Couprie, C., Farabet, C., Najman, L. A., & LeCun, Y. (2013) · HAL · doi:10.48550/arxiv.1301.3572 · Cited by 486

2016 IEEE International Conference on Robotics and Automation (ICRA)

(2016) · doi:10.1109/icra33126.2016 · Cited by 446

A medical image fusion method based on convolutional neural networks

Liu, Y., Chen, X., Cheng, J., & Peng, H. (2017) · International Conference on Information Fusion (FUSION) · doi:10.23919/icif.2017.8009769 · Cited by 438

2018 IEEE Intelligent Vehicles Symposium (IV)

(2018) · doi:10.1109/iv43497.2018 · Cited by 428

RGB-D-based human motion recognition with deep learning: A survey

Wang, P., Li, W., Ogunbona, P., Wan, J., & Escalera, S. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.04.007 · Cited by 412

Constraining object features using a polarization reflectance model

Wolff, L. B., & Boult, T. E. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85655 · Cited by 407

Learning Factored Representations in a Deep Mixture of ExpertsPreprint

Eigen, D., Ranzato, M., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.4314 · Cited by 401

KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving

Choi, Y., Kim, N., Hwang, S., Park, K., Yoon, J. S., An, K., & Kweon, I. S. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2791533 · Cited by 370

Deep Learning for Multi-task Medical Image Segmentation in Multiple Modalities

Moeskops, P., Wolterink, J. M., van der Velden, B. H. M., Gilhuijs, K. G. A., Leiner, T., Viergever, M. A., & Išgum, I. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_55 · Cited by 354

2018 IEEE Winter Conference on Applications of Computer Vision (WACV)

(2018) · doi:10.1109/wacv41190.2018 · Cited by 350

Progressively Complementarity-Aware Fusion Network for RGB-D Salient Object Detection

Chen, H., & Li, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00322 · Cited by 349

BiolD: a multimodal biometric identification system

Frischholz, R. W., & Dieckmann, U. (2000) · Computer · doi:10.1109/2.820041 · Cited by 347

Fusion of multispectral data through illumination-aware deep neural networks for pedestrian detection

Guan, D., Cao, Y., Yang, J., Cao, Y., & Yang, M. Y. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.017 · Cited by 342

2017 20th International Conference on Information Fusion (Fusion)

(2017) · doi:10.23919/fusion40051.2017 · Cited by 335

Multimodal end-to-end autonomous driving

Xiao, Y., Codevilla, F., Gurram, A., Urfalioglu, O., & Lopez, A. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3013234 · Cited by 319

RGB-D object recognition and pose estimation based on pre-trained convolutional neural network features

Schwarz, M., Schulz, H., & Behnke, S. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139363 · Cited by 317

ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation

Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. C. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 306

RDFNet: RGB-D Multi-level Residual Feature Fusion for Indoor Semantic Segmentation

Lee, S., Park, S., & Hong, K.-S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.533 · Cited by 294

Self-supervised model adaptation for multimodal semantic segmentation

Valada, A., Mohan, R., & Burgard, W. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01188-y · Cited by 293

Methods and datasets on semantic segmentation: A review

Yu, H., Yang, Z., Tan, L., Wang, Y., Sun, W. J., Sun, M., & Tang, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.037 · Cited by 284

A survey of infrared and visual image fusion methods

Jin, X., Jiang, Q., Yao, S., Zhou, D., Nie, R., Hai, J., & He, K. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.010 · Cited by 280

Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding

Sakaridis, C., Dai, D., Hecker, S., & Gool, L. V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_42 · Cited by 276

PST900: RGB-Thermal Calibration, Dataset and Segmentation Network

Shivakumar, S. S., Rodrigues, N., Zhou, A., Miller, I. D., Kumar, V., & Taylor, C. J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196831 · Cited by 273

Biometric recognition by gait: A survey of modalities and features

Connor, P. C., & Ross, A. A. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.01.007 · Cited by 272

RedNet: Residual Encoder-Decoder Network for indoor RGB-D Semantic SegmentationPreprint

Jiang, J., Zheng, L., Luo, F., & Zhang, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01054 · Cited by 259

Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001

(2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990448 · Cited by 253

Locality-Sensitive Deconvolution Networks with Gated Fusion for RGB-D Indoor Semantic Segmentation

Cheng, Y., Cai, R., Li, Z., Zhao, X., & Huang, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.161 · Cited by 244

Multispectral Pedestrian Detection using Deep Fusion Convolutional Neural Networks.

Wagner, J., Fischer, V., Herman, M., & Behnke, S. (2016) · The European Symposium on Artificial Neural Networks · Cited by 244

2016 International Symposium on Experimental Robotics

Kulić, D., Nakamura, Y., Khatib, O., & Venture, G. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-50115-4 · Cited by 239

Deep multimodal learning for Audio-Visual Speech Recognition

Mroueh, Y., Marcheret, E., & Goel, V. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178347 · Cited by 228

Polarization vision: a new sensory approach to image understanding

Wolff, L. B. (1997) · Image and Vision Computing · doi:10.1016/s0262-8856(96)01123-7 · Cited by 228

Multimodal vehicle detection: fusing 3D-LIDAR and color camera data

Asvadi, A., Garrote, L., Premebida, C., Peixoto, P., & J. Nunes, U. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.09.038 · Cited by 225

Deep Multispectral Semantic Scene Understanding of Forested Environments Using Multimodal Fusion

Valada, A., Oliveira, G. L., Brox, T., & Burgard, W. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-50115-4_41 · Cited by 211

AdapNet: Adaptive semantic segmentation in adverse environmental conditions

Valada, A., Vertens, J., Dhall, A., & Burgard, W. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989540 · Cited by 209

Multispectral Object Detection for Autonomous Vehicles

Karasawa, T., Watanabe, K., Ha, Q., Tejero-de-Pablos, A., Ushiku, Y., & Harada, T. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126727 · Cited by 195

RailSem19: A Dataset for Semantic Rail Scene Understanding

Zendel, O., Murschitz, M., Zeilinger, M., Steininger, D., Abbasi, S., & Beleznai, C. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00161 · Cited by 182

LSTM-CF: Unifying Context Modeling and Fusion with LSTMs for RGB-D Scene Labeling

Li, Z., Gan, Y., Liang, X., Yu, Y., Cheng, H., & Lin, L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_34 · Cited by 180

Learning Common and Specific Features for RGB-D Semantic Segmentation with Deconvolutional Networks

Wang, J., Wang, Z., Tao, D., See, S. C. W., & Wang, G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_40 · Cited by 169

WildDash - Creating Hazard-Aware Benchmarks

Zendel, O., Honauer, K., Murschitz, M., Steininger, D., & Domínguez, G. F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_25 · Cited by 164

Multi-view deep learning for consistent semantic mapping with RGB-D cameras

Ma, L., Stückler, J., Kerl, C., & Cremers, D. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202213 · Cited by 158

Cascaded Feature Network for Semantic Segmentation of RGB-D Images

Lin, D., Chen, G., Cohen‐Or, D., Heng, P., & Huang, H. F. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.147 · Cited by 155

2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS)

(2016) · doi:10.1109/icsess38249.2016 · Cited by 150

Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art

Janai, J., Güney, F., Behl, A., & Geiger, A. (2017) · arXiv · doi:10.48550/arxiv.1704.05519 · Cited by 141

Learn to combine modalities in multimodal deep learning

Liu, K., Li, Y., Xu, N., & Natarajan, P. (2018) · arXiv · doi:10.48550/arxiv.1805.11730 · Cited by 136

Indoor Scene Understanding in 2.5/3D for Autonomous Agents: A Survey

Naseer, M., Khan, S. S., & Porikli, F. (2018) · IEEE Access · doi:10.1109/access.2018.2886133 · Cited by 133

Exploring Context with Deep Structured Models for Semantic Segmentation

Lin, G., Shen, C., van den Hengel, A., & Reid, I. D. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2708714 · Cited by 130

Efficient ConvNet for real-time semantic segmentation

Romera, E., Álvarez, J. M., Bergasa, L. M., & Arroyo, R. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995966 · Cited by 127

Multi-Level Feature Abstraction from Convolutional Neural Networks for Multimodal Biometric Identification

Soleymani, S., Dabouei, A., Kazemi, H., Dawson, J. M., & Nasrabadi, N. M. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545061 · Cited by 111

International Conference on Computer Vision (ICCV 2017)

Kalogeiton, V. S., Weinzaepfel, P., Ferrari, V., & Schmid, C. (2017) · Cited by 110

Sensor fusion for semantic segmentation of urban scenes

Zhang, R., Candra, S. A., Vetter, K., & Zakhor, A. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139439 · Cited by 108

On-Board Object Detection: Multicue, Multimodal, and Multiview Random Forest of Local Experts

González, A., Vázquez, D., López, A. M., & Amores, J. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2593940 · Cited by 108

A New Metric for Evaluating Semantic Segmentation: Leveraging Global and Contour Accuracy

Fernández-Moral, E., Martins, R., Wolf, D. F., & Rives, P. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500497 · Cited by 106

Multi-modal deep feature learning for RGB-D object detection

Xu, X., Li, Y., Wu, G., & Luo, J. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.07.026 · Cited by 100

See clearer at night: towards robust nighttime semantic segmentation through day-night image conversion

Sun, L., Wang, K., Yang, K., & Xiang, K. (2019) · Artificial Intelligence and Machine Learning in Defense Applications · doi:10.1117/12.2532477 · Cited by 96

Choosing smartly: Adaptive multimodal fusion for object detection in changing environments

Mees, O., Eitel, A., & Burgard, W. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759048 · Cited by 96

RFBNet: Deep Multimodal Networks with Residual Fusion Blocks for RGB-D Semantic SegmentationPreprint

Deng, L., Yang, M. Z., Li, T., He, Y., & Wang, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00135 · Cited by 92

Detect What You Can: Detecting and Representing Objects using Holistic Models and Body PartsPreprint

Chen, X., Mottaghi, R., Liu, X., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2031 · Cited by 91

2018 21st International Conference on Information Fusion (FUSION)

(2018) · doi:10.23919/fusion35459.2018 · Cited by 89

Linear Depth Estimation from an Uncalibrated, Monocular Polarisation Image

Smith, W. A. P., Ramamoorthi, R., & Tozza, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_7 · Cited by 87

Depth From a Polarisation + RGB Stereo Pair

Zhu, D., & Smith, W. A. P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00777 · Cited by 87

When to use what data set for your self-driving car algorithm: An overview of publicly available driving datasets

Yin, H., & Berger, C. (2017) · 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317828 · Cited by 79

Fusion strategies in multimodal biometric verification

Fiérrez, J., Ortega-García, J., & González-Rodríguez, J. (2003) · doi:10.1109/icme.2003.1221234 · Cited by 61

Sensor modality fusion with CNNs for UGV autonomous driving in indoor environments

Patel, N., Choromanska, A., Krishnamurthy, P., & Khorrami, F. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8205958 · Cited by 59

Multimodal Person Recognition for Human-Vehicle Interaction

Erzin, E., Yemez, Y., Tekalp, A. M., Erçi̇l, A., Erdoğan, H., & Abut, H. (2006) · IEEE Multimedia · doi:10.1109/mmul.2006.37 · Cited by 57

DFANet: Deep Feature Aggregation for Real-Time Semantic SegmentationPreprint

Li, H., Xiong, P., Fan, H., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02216 · Cited by 56

A survey on indoor RGB-D semantic segmentation: from hand-crafted features to deep convolutional neural networks

Fooladgar, F., & Kasaei, S. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-7684-3 · Cited by 54

Global Aggregation then Local Distribution in Fully Convolutional NetworksPreprint

Li, X., Zhang, L., You, A., Yang, M., Yang, K., & Tong, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.07229 · Cited by 54

Optimal Sensor Data Fusion Architecture for Object Detection in Adverse Weather Conditions

Pfeuffer, A., & Dietmayer, K. (2018) · International Conference on Information Fusion (FUSION) · doi:10.23919/icif.2018.8455757 · Cited by 54

PixelNet: Towards a General Pixel-level ArchitecturePreprint

Bansal, A., Chen, X., Russell, B. C., Gupta, A. K., & Ramanan, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.06694 · Cited by 51

RANUS: RGB and NIR Urban Scene Dataset for Deep Scene Parsing

Choe, G., Kim, S., Im, S., Lee, J., Narasimhan, S. G., & Kweon, I. S. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801390 · Cited by 45

Learning Scene Geometry for Visual Localization in Challenging Conditions

Piasco, N., Désiré Sidibé, A., Gouet-Brunet, V., & Demonceaux, C. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794221 · Cited by 44

Multimodal Neural Networks: RGB-D for Semantic Segmentation and Object Detection

Schneider, L., Jasch, M., Fröhlich, B., Weber, T., Franke, U., Pollefeys, M., & Rätsch, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59126-1_9 · Cited by 42

Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic SegmentationPreprint

Cheng, B., Collins, M. D., Zhu, Y., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10194 · Cited by 41

Near infrared face recognition: A literature survey

Farokhi, S., Flusser, J., & Sheikh, U. U. (2016) · Computer Science Review · doi:10.1016/j.cosrev.2016.05.003 · Cited by 39

Effective Fusion of Multi-Modal Remote Sensing Data in a Fully Convolutional Network for Semantic Labeling

Zhang, W., Huang, H. B., Schmitz, M., Sun, X., Wang, H., & Mayer, H. (2017) · Remote Sensing · doi:10.3390/rs10010052 · Cited by 39

Semantics-guided multi-level RGB-D feature fusion for indoor semantic segmentation

Li, Y., Zhang, J., Cheng, Y., Huang, K., & Tan, T. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296484 · Cited by 37

Incorporating depth into both CNN and CRF for indoor semantic segmentation

Jiang, J., Zhang, Z., Huang, Y., & Zheng, L. (2017) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess.2017.8342970 · Cited by 37

Colour image dehazing using near‐infrared fusion

Jang, D., & Park, R. (2017) · IET Image Processing · doi:10.1049/iet-ipr.2017.0192 · Cited by 36

2017 European Conference on Mobile Robots (ECMR)

(2017) · doi:10.1109/ecmr40756.2017 · Cited by 35

GFF: Gated Fully Fusion for Semantic SegmentationPreprint

Li, X., Zhao, H., Han, L., Tong, Y., & Yang, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01803 · Cited by 34

Exploration of Deep Learning-based Multimodal Fusion for Semantic Road Scene Segmentation

Zhang, Y., Morel, O., Blanchon, M., Seulin, R., Rastgoo, M., & Désiré Sidibé, A. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007360400002108 · Cited by 34

Seeing Through Fog Without Seeing Fog: Deep Sensor Fusion in the Absence of Labeled Training Data.Preprint

Bijelic, M., Mannan, F., Gruber, T., Ritter, W., Dietmayer, K., & Heide, F. (2019) · arXiv (Cornell University) · Cited by 32

Near-Infrared Fusion for Photorealistic Image Dehazing

Dümbgen, F., Helou, M. E., Gucevska, N., & Susstrunk, S. E. (2018) · Electronic Imaging · doi:10.2352/issn.2470-1173.2018.16.color-321 · Cited by 30

Speedup of deep learning ensembles for semantic segmentation using a model compression technique

Holliday, A. G. C., Barekatain, M., Laurmaa, J., Kandaswamy, C., & Prendinger, H. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.05.004 · Cited by 29

Exploring New Backbone and Attention Module for Semantic Segmentation in Street Scenes

Fan, L., Wang, W.-C., Zha, F.-Y., & Yan, J. (2018) · IEEE Access · doi:10.1109/access.2018.2880877 · Cited by 25

ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic SegmentationPreprint

Hu, X., Yang, K., Fei, L., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10089 · Cited by 25

Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays.

Qiu, S., Fu, Q., Wang, C., & Heidrich, W. (2019) · Vision Modeling and Visualization · Cited by 24

Attention-guided Unified Network for Panoptic SegmentationPreprint

Li, Y., Chen, X., Zhu, Z. D., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03904 · Cited by 24

A multimodal vision sensor for autonomous driving

Sun, D., Huang, X. M., & Yang, K. (2019) · Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies · doi:10.1117/12.2535552 · Cited by 23

Multimodal Trip Hazard Affordance Detection on Construction Sites

McMahon, S., Sünderhauf, N., Upcroft, B., & Milford, M. J. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2719763 · Cited by 22

Predicting Polarization Beyond Semantics for Wearable Robotics

Yang, K., Bergasa, L. M., Romera, E., Huang, X. M., & Wang, K. (2018) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2018.8625005 · Cited by 21

Background subtraction with multispectral video sequences

Benezeth, Y., Sidibé, D., & Thomas, J. (2014) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 21

FANet: Quality-Aware Feature Aggregation Network for RGB-T Tracking.

Zhu, Y., Li, C., Lu, Y., Lin, L., Luo, B., & Tang, J. (2018) · Cited by 19

Multi-View Deep Learning for Consistent Semantic Mapping with RGB-D CamerasPreprint

Ma, L., Stückler, J., Kerl, C., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.08866 · Cited by 19

Outdoor Scenes Pixel-wise Semantic Segmentation using Polarimetry and Fully Convolutional Network

Blanchon, M., Morel, O., Zhang, Y., Seulin, R., Crombez, N., & Désiré Sidibé, A. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007360203280335 · Cited by 17

Modular Sensor Fusion for Semantic Segmentation

Blum, H., Gawel, A., Siegwart, R., & Cadena, C. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593786 · Cited by 17

Exploration of Deep Learning-based Multimodal Fusion for Semantic Road Scene Segmentation

Zhang, Y., Morel, O., Blanchon, M., et al. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007360403360343 · Cited by 16

Integrating visual cues for object segmentation and recognition

Edelman, S., & Poggio, T. (1989) · Optics News · doi:10.1364/on.15.5.000008 · Cited by 15

ESANN 2016 - 24th European Symposium on Artificial Neural Networks

Takala, P. (2016) · Cited by 14

"Look at this one" detection sharing between modality-independent classifiers for robotic discovery of people

Guerry, J., Saux, B. L., & Filliat, D. (2017) · European Conference on Mobile Robots · doi:10.1109/ecmr.2017.8098679 · Cited by 14

Attitude Estimation from Polarimetric Cameras

Rastgoo, M., Demonceaux, C., Seulin, R., & Morel, O. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593575 · Cited by 14

Learning Common and Specific Features for RGB-D Semantic Segmentation with Deconvolutional NetworksPreprint

Wang, J., Wang, Z., Tao, D., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.01082 · Cited by 12

Incorporating Depth into both CNN and CRF for Indoor Semantic SegmentationPreprint

Jiang, J., Zhang, Z., Huang, Y., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07383 · Cited by 11

End-to-End Instance Segmentation with Recurrent AttentionPreprint

Ren, M., & Zemel, R. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09410 · Cited by 11

Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature AggregationPreprint

Tian, Z., He, T., Shen, C., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02120 · Cited by 8

Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding

Sakaridis, C., Dai, D., Hecker, S., et al. (2018) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000305722 · Cited by 7

Optimal Sensor Data Fusion Architecture for Object Detection in Adverse Weather ConditionsPreprint

Pfeuffer, A., & Dietmayer, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02323 · Cited by 7

FANet: Quality-Aware Feature Aggregation Network for Robust RGB-T TrackingPreprint

Zhu, Y., Li, C., Luo, B., & Tang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09855 · Cited by 4

Adaptive Fusion for RGB-D Salient Object DetectionPreprint

Wang, N., & Gong, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01369 · Cited by 4

A Multimodal Vision Sensor for Autonomous DrivingPreprint

Sun, D., Huang, X. M., & Yang, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05649 · Cited by 3

CATS 2: Color And Thermal Stereo Scenes with Semantic Labels

Treible, W., Saponaro, P. J., Liu, Y., Gupta, A. D., Veerendraveer, V., Sorensen, S., & Kambhamettu, C. (2019) · Cited by 3

Incorporating Luminance, Depth and Color Information by a Fusion-based Network for Semantic SegmentationPreprint

Hung, S.-W., Lo, S.-Y., & Hang, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.09077 · Cited by 3

Depth from a polarisation + RGB stereo pairPreprint

Zhu, D., & Smith, W. A. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.12061 · Cited by 2

Deep multimodal data fusion

Zhao, F., Zhang, C., & Geng, B. (2024) · ACM Computing Surveys · doi:10.1145/3649447 · Cited by 480

Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity

Tang, L., Zhang, H., Xu, H., & Ma, J. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101870 · Cited by 418

A review on 2D instance segmentation based on deep neural networks

Gu, W., Bai, S., & Kong, L. (2022) · Image and Vision Computing · doi:10.1016/j.imavis.2022.104401 · Cited by 258

CMGFNet: A deep cross-modal gated fusion network for building extraction from very high-resolution remote sensing images

Hosseinpour, H., Samadzadegan, F., & Javan, F. D. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.12.007 · Cited by 233

A survey of multimodal information fusion for smart healthcare: Mapping the journey from data to wisdom

Shaik, T., Tao, X., Li, L., Xie, H., & Velasquez, J. D. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102040 · Cited by 228

A review: Deep learning for medical image segmentation using multi-modality fusion

Zhou, T., Ruan, S., & Canu, S. (2019) · Array · doi:10.1016/j.array.2019.100004 · Cited by 696

Emerging Advances in Multimodal Imaging and Fusion Techniques

Vyavahare, A. J., & Sawant, D. A. (2025) · International Journal of Electronics and Computer Applications · doi:10.70968/ijeaca.v2i1.d1019

Application on the Loop of Multimodal Image Fusion: Trends on Deep-Learning Based Approaches

Guacho, G. K. B., Vallejo, P. X. M., Vintimilla, B. X., & Sappa, A. D. (2023) · International Conference on Pattern Recognition Systems (ICPRS) · doi:10.1109/icprs58416.2023.10179005 · Cited by 3

Multi-semantic depth collaborative multi-modality image fusion network

Zhu, H., Li, X., Chen, R., Liu, Q., Chang, X., & Yuan, D. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.115756 · Cited by 3

A central multimodal fusion framework for outdoor scene image segmentation

Zhang, Y., Morel, O., Seulin, R., Mériaudeau, F., & Sidibé, D. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10357-y · Cited by 5