The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Closed-Loop Matters: Dual Regression Networks for Single Image Super-Resolution
Open accessAbstract
Deep neural networks have exhibited promising performance in image super-resolution (SR) by learning a nonlinear mapping function from low-resolution (LR) images to high-resolution (HR) images. However, there are two underlying limitations to existing SR methods. First, learning the mapping function from LR to HR images is typically an ill-posed problem, because there exist infinite HR images that can be downsampled to the same LR image. As a result, the space of the possible functions can be extremely large, which makes it hard to find a good solution. Second, the paired LR-HR data may be unavailable in real-world applications and the underlying degradation method is often unknown. For such a more general case, existing SR models often incur the adaptation problem and yield poor performance. To address the above issues, we propose a dual regression scheme by introducing an additional constraint on LR data to reduce the space of the possible functions. Specifically, besides the mapping from LR to HR images, we learn an additional dual regression mapping estimates the down-sampling kernel and reconstruct LR images, which forms a closed-loop to provide additional supervision. More critically, since the dual regression process does not depend on HR images, we can directly learn from LR images. In this sense, we can easily adapt SR models to real-world data, e.g., raw video frames from YouTube. Extensive experiments with paired training data and unpaired real-world data demonstrate our superiority over existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
Image Super-Resolution Using Very Deep Residual Channel Attention Networks
Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., & Fu, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_18 · Cited by 5,708
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., & Loy, C. C. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_5 · Cited by 4,731
Single image super-resolution from transformed self-exemplars
Huang, J.-B., Singh, A., & Ahuja, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299156 · Cited by 3,472
On Single Image Scale-Up Using Sparse-Representations
Zeyde, R., Elad, M., & Protter, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-27413-8_47 · Cited by 3,352
Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.618 · Cited by 2,976
Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
Bevilacqua, M., Roumy, A., Guillemot, C., & Morel, M.-L. A. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.135 · Cited by 2,701
DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
Yi, Z., Zhang, H., Tan, P., & Gong, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.310 · Cited by 2,134
Second-Order Attention Network for Single Image Super-Resolution
Dai, T., Cai, J., Zhang, Y., Xia, S.-T., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01132 · Cited by 2,010
Lempitsky, V., Vedaldi, A., & Ulyanov, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00984 · Cited by 1,916
Zhang, Y., Xiang, T., Hospedales, T. M., & Lu, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00454 · Cited by 1,752
Deep Back-Projection Networks for Super-Resolution
Haris, M., Shakhnarovich, G., & Ukita, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00179 · Cited by 1,599
NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results
Timofte, R., Agustsson, E., Gool, L. V., Yang, M.-H., Zhang, L., Lim, B., Son, S., Kim, H., Nah, S., Lee, K. M., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.149 · Cited by 1,441
Sketch-based manga retrieval using manga109 dataset
Matsui, Y., Ito, K., Aramaki, Y., Fujimoto, A., Ogawa, T., Yamasaki, T., & Aizawa, K. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4020-z · Cited by 1,432
Image Super-Resolution Using Dense Skip Connections
Tong, T., Li, G., Liu, X., & Gao, Q. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.514 · Cited by 1,373
Cubic splines for image interpolation and digital filtering
Hou, H., & Andrews, H. (1978) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1978.1163154 · Cited by 1,270
Learning a Single Convolutional Super-Resolution Network for Multiple Degradations
Zhang, K., Zuo, W., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00344 · Cited by 1,124
Foundations of Machine Learning
Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018) · doi:10.7551/mitpress/10290.001.0001 · Cited by 1,122
Foundations of Machine Learning
(2012) · Boosting · doi:10.7551/mitpress/8291.003.0006 · Cited by 1,074
Feedback Network for Image Super-Resolution
Li, Z., Yang, J., Liu, Z., Yang, X., Jeon, G., & Wu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00399 · Cited by 883
Deep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 719
Dual Learning for Machine Translation
Xia, Y., He, D., Qin, T., Wang, L., Yu, N., Liu, T., & Ma, W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00179 · Cited by 636
Unsupervised Image Super-Resolution Using Cycle-in-Cycle Generative Adversarial Networks
Yuan, Y., Liu, S., Zhang, J., Zhang, Y., Dong, C., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00113 · Cited by 594
Graph Convolutional Networks for Temporal Action Localization
Zeng, R., Huang, W., Gan, C., Tan, M., Rong, Y., Zhao, P., & Huang, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00719 · Cited by 551
Self-citationRankSRGAN: Generative Adversarial Networks With Ranker for Image Super-Resolution
Zhang, W., Liu, Y., Dong, C., & Qiao, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00319 · Cited by 405
Dense Regression Network for Video Grounding
Zeng, R., Xu, H., Huang, W., Chen, P., Tan, M., & Gan, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01030 · Cited by 286
Self-citationDiscrimination-aware Network Pruning for Deep Model Compression
Liu, J., Zhuang, B., Zhuang, Z., Guo, Y. F., Huang, J., Zhu, J., & Tan, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3066410 · Cited by 196
Self-citationCollaborative Unsupervised Domain Adaptation for Medical Image Diagnosis
Zhang, Y., Wei, Y., Wu, Q., Zhao, P., Niu, S., Huang, J., & Tan, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3006377 · Cited by 185
Self-citationKernel Modeling Super-Resolution on Real Low-Resolution Images
Zhou, R., & Susstrunk, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00252 · Cited by 172
NAT: Neural Architecture Transformer for Accurate and Compact ArchitecturesPreprint
Guo, Y., Zheng, Y., Tan, M., Chen, Q., Chen, J., Zhao, P.-L., & Huang, J.-Z. (2019) · Neural Information Processing Systems · doi:10.48550/arxiv.1910.14488 · Cited by 107
Self-citationZeng, R., Gan, C., Chen, P., Huang, W., Wu, Q., & Tan, M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2922108 · Cited by 100
Self-citationAuto-Embedding Generative Adversarial Networks For High Resolution Image Synthesis
Guo, Y. F., Chen, Q., Chen, J., Wu, Q., Shi, Q., & Tan, M. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2908352 · Cited by 86
Self-citationRelation Attention for Temporal Action Localization
Chen, P., Gan, C., Shen, G., Huang, W., Zeng, R., & Tan, M. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2959977 · Cited by 83
Self-citationSuper-Resolution 1H Magnetic Resonance Spectroscopic Imaging Utilizing Deep Learning
Iqbal, Z., Nguyen, D. T. D., Hangel, G. J., Motyka, S., Bogner, W., & Jiang, S. B. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.01010 · Cited by 75
Intelligent Home 3D: Automatic 3D-House Design From Linguistic Descriptions Only
Chen, Q., Wu, Q., Tang, R., Wang, Y., Wang, S., & Tan, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01264 · Cited by 70
Self-citationQin, T. (2020) · Springer eBooks · doi:10.1007/978-981-15-8884-6_7 · Cited by 68
Zhang, Y., Chen, H., Wei, Y., Zhao, P., Cao, J., Fan, X., Lou, X., Liu, H., Hou, J., Han, X., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32239-7_40 · Cited by 67
Self-citationHierarchical Neural Architecture Search for Single Image Super-Resolution
Guo, Y., Luo, Y., He, Z., Huang, J., & Chen, J. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3003517 · Cited by 60
Self-citationHu, Z., Luo, Y., Lin, J., Yan, Y., & Chen, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/111 · Cited by 57
Self-citationMulti-way backpropagation for training compact deep neural networks
Guo, Y. F., Chen, J., Du, Q., van den Hengel, A., Shi, Q., & Tan, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.03.001 · Cited by 39
Self-citationUnsupervised Degradation Learning for Single Image Super-ResolutionPreprint
Zhao, T., Ren, W., Zhang, C., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04240 · Cited by 31
Double Forward Propagation for Memorized Batch Normalization
Guo, Y. F., Wu, Q., Deng, C., Chen, J., & Tan, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11717 · Cited by 22
Self-citationThe Shallow End: Empowering Shallower Deep-Convolutional Networks through Auxiliary OutputsPreprint
Guo, Y. F., Chen, J., Du, Q., van den Hengel, A., Shi, Q., & Tan, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01773 · Cited by 14
Self-citationDual Reconstruction Nets for Image Super-Resolution with Gradient Sensitive LossPreprint
Guo, Y. F., Chen, Q., Chen, J., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.07099 · Cited by 11
Self-citation
Research works printed but not linked: 5
- maas, 0, Rectifier nonlinearities improve neural network acoustic models, International Conference on Machine Learning, 30, 3
- bell-kligler, 0, Blind super-resolution kernel estimation using an internal-gan, Advances in neural information processing systems, 284
- cao, 0, Adversarial learning with local coordinate coding, International Conference on Machine Learning
- cao, 0, Multi-marginal wasserstein gan, Advances in neural information processing systems, 1774
- xia, 0, Model-level dual learning, International Conference on Machine Learning
Cited by
SwinIR: Image Restoration Using Swin Transformer
Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., & Timofte, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00210 · Cited by 4,734
Self-citationProceedings of the 29th ACM International Conference on Multimedia
(2021) · doi:10.1145/3474085 · Cited by 922
SRDiff: Single image super-resolution with diffusion probabilistic models
Li, H., Yang, Y., Chang, M., Chen, S., Feng, H., Xu, Z., Li, Q., & Chen, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.029 · Cited by 777
Residual Feature Distillation Network for Lightweight Image Super-Resolution
Liu, J., Tang, J., & Wu, G. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-67070-2_2 · Cited by 541
Towards Real-World Blind Face Restoration with Generative Facial Prior
Wang, X., Li, Y., Zhang, H., & Shan, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00905 · Cited by 538
Metadata
- Authors
- Guo, Y., Chen, J., Wang, J., Chen, Q., Cao, J., Deng, Z., Xu, Y., & Tan, M.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 5406-5415
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035467803
- Cited by
- 352
- References
- 53
- FWCI
- 21.33
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.