The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Semantic Foggy Scene Understanding with Synthetic Data
Open accessAbstract
This work addresses the problem of semantic foggy scene understanding (SFSU). Although extensive research has been performed on image dehazing and on semantic scene understanding with clear-weather images, little attention has been paid to SFSU. Due to the difficulty of collecting and annotating foggy images, we choose to generate synthetic fog on real images that depict clear-weather outdoor scenes, and then leverage these partially synthetic data for SFSU by employing state-of-the-art convolutional neural networks (CNN). In particular, a complete pipeline to add synthetic fog to real, clear-weather images using incomplete depth information is developed. We apply our fog synthesis on the Cityscapes dataset and generate Foggy Cityscapes with 20,550 images. SFSU is tackled in two ways: (1) with typical supervised learning, and (2) with a novel type of semi-supervised learning, which combines (1) with an unsupervised supervision transfer from clear-weather images to their synthetic foggy counterparts. In addition, we carefully study the usefulness of image dehazing for SFSU. For evaluation, we present Foggy Driving, a dataset with 101 real-world images depicting foggy driving scenes, which come with ground truth annotations for semantic segmentation and object detection. Extensive experiments show that (1) supervised learning with our synthetic data significantly improves the performance of state-of-the-art CNN for SFSU on Foggy Driving; (2) our semi-supervised learning strategy further improves performance; and (3) image dehazing marginally advances SFSU with our learning strategy. The datasets, models and code are made publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 3×
“Given the fact that large-scale annotated data are available for clear-weather images [15, 19, 24, 58], we present an automatic pipeline to add synthetic yet highly realistic fog to such datasets.”
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433 · cited 9×
“The leap of computer vision in recent years can to an important extent be attributed to the availability of large, labeled datasets [15, 19, 58].”
InfluentialMean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 7×
“Our model of choice for conducting experiments on semantic segmentation with the supervised pipeline is the modern dilated convolutions network (DCN) [72].”
InfluentialSingle image haze removal using dark channel prior
He, K., Sun, J., & Tang, X. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.168 · Cited by 7,601
A NEW MEASURE OF RANK CORRELATION
KENDALL, M. G. (1938) · Biometrika · doi:10.1093/biomet/30.1-2.81 · Cited by 7,269
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Stereo Processing by Semiglobal Matching and Mutual Information
Hirschmuller, H. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1166 · Cited by 4,195
RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation
Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656 · cited 1×
“More recently, a domain adversarial based approach was proposed to adapt semantic segmentation models both at pixel level and feature level from simulated to real environments (Hoffman et al. 2017).”
BackgroundRos, G., Sellart, L., Materzynska, J., Vazquez, D., & Lopez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.352 · Cited by 2,338
Visibility in bad weather from a single image
Tan, R. T. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587643 · Cited by 2,280
Fattal, R. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360671 · Cited by 2,114
Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068
Playing for Data: Ground Truth from Computer Games
Richter, S. R., Vineet, V., Roth, S., & Koltun, V. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_7 · Cited by 1,815
Single Image Dehazing via Multi-scale Convolutional Neural Networks
Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., & Yang, M.-H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_10 · Cited by 1,759
Narasimhan, S. G., & Nayar, S. K. (2002) · International Journal of Computer Vision · doi:10.1023/a:1016328200723 · Cited by 1,720
Contrast restoration of weather degraded images
Narasimhan, S. G., & Nayar, S. K. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1201821 · Cited by 1,642
Berman, D., Treibitz, T., & Avidan, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.185 · Cited by 1,642
Synthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
Colorization using optimization
Levin, A., Lischinski, D., & Weiss, Y. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015780 · Cited by 1,411
Fast visibility restoration from a single color or gray level image
Tarel, J.-P., & Hautiere, N. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459251 · Cited by 1,313
Fattal, R. (2014) · ACM Transactions on Graphics · doi:10.1145/2651362 · Cited by 1,167
Multiscale Combinatorial Grouping
Arbelaez, P., Pont-Tuset, J., Barron, J., Marques, F., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.49 · Cited by 1,155
Segmentation and Recognition Using Structure from Motion Point Clouds
Brostow, G. J., Shotton, J., Fauqueur, J., & Cipolla, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_5 · Cited by 1,050
Recent progress in road and lane detection: A survey
Bar Hillel, A., Lerner, R., Levi, D., & Raz, G. (2014) · Machine Vision and Applications · doi:10.1007/s00138-011-0404-2 · Cited by 775 · cited 1×
“Typical examples include road and lane detection [5], traffic light detection [35], car and pedestrian detection [24], and a dense, pixel-level segmentation of road scenes into most of the relevant semantic classes [8, 15].”
Theorie der horizontalen sichtweite
Koschmieder, H. (1924) · Medical Entomology and Zoology · Cited by 663
A Review of Computer Vision Techniques for the Analysis of Urban Traffic
Buch, N., Velastin, S. A., & Orwell, J. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2119372 · Cited by 653
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Driving in the Matrix: Can virtual worlds replace human-generated annotations for real world tasks?
Johnson-Roberson, M., Barto, C., Mehta, R., Sridhar, S. N., Rosaen, K., & Vasudevan, R. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989092 · Cited by 622
Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing
Tang, K., Yang, J., & Wang, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.383 · Cited by 605
FlowNet: Learning Optical Flow with Convolutional Networks
Fischer, P., Dosovitskiy, A., Ilg, E., Haeusser, P., Hazırbaş, C., Golkov, V., van der Smagt, P., Cremers, D., & Brox, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06852 · Cited by 562
ON THE METHOD OF PAIRED COMPARISONS
Kendall, M. G., & Smith, B. B. (1940) · Biometrika · doi:10.1093/biomet/31.3-4.324 · Cited by 557
Cross Modal Distillation for Supervision Transfer
Gupta, S., Hoffman, J., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.309 · Cited by 530
Colorization using optimization
Levin, A., Lischinski, D., & Weiss, Y. (2004) · ACM SIGGRAPH 2004 Papers · doi:10.1145/1186562.1015780 · Cited by 478
Vision Enhancement in Homogeneous and Heterogeneous Fog
Tarel, J.-P., Hautiere, N., Caraffa, L., Cord, A., Halmaoui, H., & Gruyer, D. (2012) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2012.2189969 · Cited by 424
Nishino, K., Kratz, L., & Lombardi, S. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-011-0508-1 · Cited by 387
Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation
Dai, D., & Yang, W. (2011) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2055033 · Cited by 362
Self-citationA comparative study of image retargeting
Rubinstein, M., Gutiérrez, D., Sorkine‐Hornung, O., & Shamir, A. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866186 · Cited by 343
Fast Image Dehazing Method Based on Linear Transformation
Wang, W., Yuan, X., Wu, X., & Liu, Y. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2652069 · Cited by 319
Improved visibility of road scene images under heterogeneous fog
Tarel, J.-P., Hautiere, N., Cord, A., Gruyer, D., & Halmaoui, H. (2010) · 2010 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548128 · Cited by 272
A comparative study of image retargeting
Rubinstein, M. H., Gutiérrez, D., Sorkine, O., et al. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866186 · Cited by 269
Nighttime Haze Removal with Glow and Multiple Light Colors
Li, Y., Tan, R. T., & Brown, M. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.34 · Cited by 268
Vision for Looking at Traffic Lights: Issues, Survey, and Perspectives
Jensen, M. B., Philipsen, M. P., Mogelmose, A., Moeslund, T. B., & Trivedi, M. M. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2509509 · Cited by 250
Xu, Y., Wen, J., Fei, L., & Zhang, Z. (2016) · IEEE Access · doi:10.1109/access.2015.2511558 · Cited by 220
Virtual and Real World Adaptation for Pedestrian Detection
Vazquez, D., Lopez, A. M., Marin, J., Ponsa, D., & Geronimo, D. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.163 · Cited by 178
Stereoscopic inpainting: Joint color and depth completion from stereo images
Wang, L., Jin, H., Yang, R., & Gong, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587704 · Cited by 170
Haze visibility enhancement: A Survey and quantitative benchmarking
Li, Y., You, S., Brown, M. S., & Tan, R. T. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.09.003 · Cited by 170
Nighttime haze removal based on a new imaging model
Zhang, J., Cao, Y. H., & Wang, Z. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025924 · Cited by 167
Single Image Defogging by Multiscale Depth Fusion
Wang, Y.-K., & Fan, C.-T. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2358076 · Cited by 166
Efficient spatio-temporal hole filling strategy for Kinect depth maps
Camplani, M., & Salgado, L. (2012) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.911909 · Cited by 165
Layer Depth Denoising and Completion for Structured-Light RGB-D Cameras
Shen, J., & Cheung, S.-C. S. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.157 · Cited by 153
Joint Transmission Map Estimation and Dehazing using Deep Networks
Zhang, H., Sindagi, V. A., & Patel, V. M. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2912145 · Cited by 145
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2017) · arXiv · doi:10.48550/arxiv.1704.05519 · Cited by 141
Image based fog detection in vehicles
Pavlić, M., Belzner, H., Rigoll, G., & Ilić, S. (2012) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232256 · Cited by 90
Exponential Contrast Restoration in Fog Conditions for Driving Assistance
Negru, M., Nedevschi, S., & Peter, I. R. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2405013 · Cited by 74
Towards night fog detection through use of in-vehicle multipurpose cameras
Gallen, R., Cord, A. M., Hautière, N., & Aubert, D. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940486 · Cited by 49
Fast fog detection for camera based Advanced Driver Assistance Systems
Spinneker, R., Koch, C., Park, S.-B., et al. (2014) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6957878 · Cited by 48
Sequential Bayesian Model Update under Structured Scene Prior for Semantic Road Scenes Labeling
Levinkov, E., & Fritz, M. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.167 · Cited by 32
Learning deep transmission network for single image dehazing
Ling, Z., Fan, G., Wang, Y., & Lu, X. B. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532768 · Cited by 31
Metric imitation by manifold transfer for efficient vision applications
Dai, D., Kroeger, T., Timofte, R., & Gool, L. V. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298975 · Cited by 25
Self-citationAugmented Reality meets Deep Learning
Alhaija, H. A., Mustikovela, S. K., Mescheder, L., Geiger, A., & Rother, C. (2017) · British Machine Vision Conference · doi:10.5244/c.31.81 · Cited by 24
Cited by
Benchmarking Single-Image Dehazing and Beyond
Li, B., Ren, W., Fu, D., Tao, D., Feng, D., Zeng, W., & Wang, Z. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2867951 · Cited by 2,301
Domain Adaptive Faster R-CNN for Object Detection in the Wild
Chen, Y., Li, W., Sakaridis, C., Dai, D., & Van Gool, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00352 · Cited by 1,672
Self-citationMulti-Scale Boosted Dehazing Network With Dense Feature Fusion
Dong, H., Pan, J., Xiang, L., Hu, Z., Zhang, X., Wang, F., & Yang, M.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00223 · Cited by 1,087
Gated Fusion Network for Single Image Dehazing
Ren, W., Ma, L., Zhang, J., Pan, J., Cao, X., Liu, W., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00343 · Cited by 973
Contrastive Learning for Compact Single Image Dehazing
Wu, H., Qu, Y., Lin, S., Zhou, J., Qiao, R., Zhang, Z., Xie, Y., & Ma, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01041 · Cited by 926
Metadata
- Authors
- Sakaridis, C., Dai, D., & Van Gool, L.
- Venue
- International Journal of Computer Vision
- Published
- 2018-03-23
- Volume
- 126
- Issue
- 9
- Pages
- 973-992
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2748021867
- Cited by
- 1,341
- References
- 74
- FWCI
- 37.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.