The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Effects of Image Degradation and Degradation Removal to CNN-Based Image Classification
Abstract
Just like many other topics in computer vision, image classification has achieved significant progress recently by using deep learning neural networks, especially the Convolutional Neural Networks (CNNs). Most of the existing works focused on classifying very clear natural images, evidenced by the widely used image databases, such as Caltech-256, PASCAL VOCs, and ImageNet. However, in many real applications, the acquired images may contain certain degradations that lead to various kinds of blurring, noise, and distortions. One important and interesting problem is the effect of such degradations to the performance of CNN-based image classification and whether degradation removal helps CNN-based image classification. More specifically, we wonder whether image classification performance drops with each kind of degradation, whether this drop can be avoided by including degraded images into training, and whether existing computer vision algorithms that attempt to remove such degradations can help improve the image classification performance. In this article, we empirically study those problems for nine kinds of degraded images-hazy images, motion-blurred images, fish-eye images, underwater images, low resolution images, salt-and-peppered images, images with white Gaussian noise, Gaussian-blurred images, and out-of-focus images. We expect this article can draw more interests from the community to study the classification of degraded images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Single image haze removal using dark channel prior
He, K., Sun, J., & Tang, X. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.168 · Cited by 7,601
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Residual Dense Network for Image Super-Resolution
Zhang, Y., Tian, Y., Kong, Y., Zhong, B., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00262 · Cited by 4,168
DehazeNet: An End-to-End System for Single Image Haze Removal
Cai, B., Xu, X., Jia, K., Qing, C., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2598681 · Cited by 3,367
Scope of validity of PSNR in image/video quality assessment
Huynh-Thu, Q., & Ghanbari, M. (2008) · Electronics Letters · doi:10.1049/el:20080522 · Cited by 2,959
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206757 · Cited by 2,828
A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior
Zhu, Q., Mai, J., & Shao, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2446191 · Cited by 2,469
Image Super-Resolution via Deep Recursive Residual Network
Tai, Y., Yang, J., & Liu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.298 · Cited by 2,415
Acquiring linear subspaces for face recognition under variable lighting
Lee, K.-C., Ho, J., & Kriegman, D. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.92 · Cited by 2,391
AOD-Net: All-in-One Dehazing Network
Li, B., Peng, X., Wang, Z., Xu, J., & Feng, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.511 · Cited by 2,342
Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring
Nah, S., Kim, T. H., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.35 · Cited by 2,275
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
Learning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116 · cited 1×
“For the research on images with white Gaussian noise , Kai et al. [59] trained a set of fast and effective CNN denoisers and integrated them into model-based optimization for solving inverse problems.”
MethodUnderstanding deep image representations by inverting them
Mahendran, A., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299155 · Cited by 1,827
Single Image Dehazing via Multi-scale Convolutional Neural Networks
Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., & Yang, M.-H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_10 · Cited by 1,759
DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks
Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., & Matas, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00854 · Cited by 1,706
Berman, D., Treibitz, T., & Avidan, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.185 · Cited by 1,642
Deep Back-Projection Networks for Super-Resolution
Haris, M., Shakhnarovich, G., & Ukita, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00179 · Cited by 1,599
Scale-Recurrent Network for Deep Image Deblurring
Tao, X., Gao, H., Shen, X., Wang, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00853 · Cited by 1,316
Fast visibility restoration from a single color or gray level image
Tarel, J.-P., & Hautiere, N. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459251 · Cited by 1,313
Recovering Realistic Texture in Image Super-Resolution by Deep Spatial Feature Transform
Wang, X., Yu, K., Dong, C., & Change Loy, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00070 · Cited by 1,170
Efficient Image Dehazing with Boundary Constraint and Contextual Regularization
Meng, G., Wang, Y., Duan, J., Xiang, S., & Pan, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.82 · Cited by 1,164
Gated Fusion Network for Single Image Dehazing
Ren, W., Ma, L., Zhang, J., Pan, J., Cao, X., Liu, W., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00343 · Cited by 973
Fast and Accurate Single Image Super-Resolution via Information Distillation Network
Hui, Z., Wang, X., & Gao, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00082 · Cited by 955
A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses
Kannala, J., & Brandt, S. S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.153 · Cited by 949
Learning a convolutional neural network for non-uniform motion blur removal
Sun, J., Cao, W., Xu, Z., & Ponce, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298677 · Cited by 906
Blind Image Deblurring Using Dark Channel Prior
Pan, J., Sun, D., Pfister, H., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.180 · Cited by 779
Enhanced Pix2pix Dehazing Network
Qu, Y., Chen, Y., Huang, J., & Xie, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00835 · Cited by 762
Single Image Dehazing via Conditional Generative Adversarial Network
Li, R., Pan, J., Li, Z., & Tang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00856 · Cited by 427
Durand, T., Mordan, T., Thome, N., & Cord, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.631 · Cited by 342
Image partial blur detection and classification
Liu, R., Li, Z., & Jia, J. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587465 · Cited by 275
High-dimensional signature compression for large-scale image classification
Sanchez, J., & Perronnin, F. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995504 · Cited by 272
Improved visibility of road scene images under heterogeneous fog
Tarel, J.-P., Hautiere, N., Cord, A., Gruyer, D., & Halmaoui, H. (2010) · 2010 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548128 · Cited by 272
Studying Very Low Resolution Recognition Using Deep Networks
Wang, Z., Chang, S., Yang, Y., Liu, D., & Huang, T. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.518 · Cited by 235 · cited 2×
“In [13], special degradations of low image resolution were studied in the applications of face identification, digit recognition and font recognition.”
BackgroundDegraded image analysis: an invariant approach
Flusser, J., & Suk, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.683773 · Cited by 233
Image Super-Resolution via Dual-State Recurrent Networks
Han, W., Chang, S., Liu, D., Yu, M., Witbrock, M., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00178 · Cited by 227
Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning
Yu, K., Dong, C., Lin, L., & Loy, C. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00259 · Cited by 211
What is the Space of Attenuation Coefficients in Underwater Computer Vision?
Akkaynak, D., Treibitz, T., Shlesinger, T., Loya, Y., Tamir, R., & Iluz, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.68 · Cited by 203
Fast Haze Removal for Nighttime Image Using Maximum Reflectance Prior
Zhang, J., Cao, Y., Fang, S., Kang, Y., & Chen, C. W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.742 · Cited by 201
Unsupervised Domain-Specific Deblurring via Disentangled Representations
Lu, B., Chen, J.-C., & Chellappa, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01047 · Cited by 165
How Image Degradations Affect Deep CNN-Based Face Recognition?
Karahan, S., Yildirum, M. K., Kirtac, K., Rende, F. S., Butun, G., & Ekenel, H. K. (2016) · International Conference of the Biometrics Special Interest Group (BIOSIG) · doi:10.1109/biosig.2016.7736924 · Cited by 163
Deep Generative Filter for Motion Deblurring
Ramakrishnan, S., Pachori, S., Gangopadhyay, A., & Raman, S. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.353 · Cited by 139
Multi-scale Weighted Nuclear Norm Image Restoration
Yair, N., & Michaeli, T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00334 · Cited by 110
Does Haze Removal Help CNN-Based Image Classification?
Pei, Y., Huang, Y., Zou, Q., Lu, Y., & Wang, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_42 · Cited by 110
Self-citationA Blur-Robust Descriptor with Applications to Face Recognition
Gopalan, R., Taheri, S., Turaga, P. K., et al. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.15 · Cited by 84
DeFusionNET: Defocus Blur Detection via Recurrently Fusing and Refining Multi-Scale Deep Features
Tang, C., Zhu, X., Liu, X., Wang, L., & Zomaya, A. Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00281 · Cited by 82
Enhancing Diversity of Defocus Blur Detectors via Cross-Ensemble Network
Zhao, W., Zheng, B., Lin, Q., & Lu, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00911 · Cited by 67
Enhance Visual Recognition Under Adverse Conditions via Deep Networks
Liu, D., Cheng, B., Wang, Z., Zhang, H., & Huang, T. S. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2908802 · Cited by 53
A convolutional neural networks denoising approach for salt and pepper noise
Fu, B., Zhao, X., Li, Y., et al. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6521-4 · Cited by 52
Motion Deblurring: Algorithms and Systems
(2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781107360181 · Cited by 44
Baek, I., Davies, A., Yan, G., & Rajkumar, R. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500455 · Cited by 43
People detection in top-view fisheye imaging
Krams, O., & Kiryati, N. (2017) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078535 · Cited by 42
Forgery Authentication in Extreme Wide-Angle Lens Using Distortion Cue and Fake Saliency Map
Fu, H., & Cao, X. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2195492 · Cited by 28
DCT-based local motion blur detection
Kalalembang, E., Usman, K., & Gunawan, I. P. (2009) · International Conference on Instrumentation, Communications, Information Technology, and Biomedical Engineering · doi:10.1109/icici-bme.2009.5417252 · Cited by 26
Active Learning for the Classification of Species in Underwater Images from a Fixed Observatory
Nilssen, I., Möller, T., & Nattkemper, T. W. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.341 · Cited by 12
Feature matching in underwater environments using sparse linear combinations
Oliver, K., Hou, W. W., & Wang, S. (2010) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2010.5543905 · Cited by 3
Self-citation
Cited by
Learning in the Frequency Domain
Xu, K., Qin, M., Sun, F., Wang, Y., Chen, Y.-K., & Ren, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00181 · Cited by 563
Transfer adaptation learning: A decade survey
Zhang, L., & Gao, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183326 · Cited by 314
The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review
Schwabe, D., Becker, K., Seyferth, M., Klaß, A., & Schaeffter, T. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01196-4 · Cited by 169
Metadata
- Authors
- Pei, Y., Huang, Y., Zou, Q., Zhang, X., & Wang, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-04-01
- Volume
- 43
- Issue
- 4
- Pages
- 1239-1253
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2985321619
- Cited by
- 253
- References
- 67
- FWCI
- 8.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.