The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
From Motion Blur to Motion Flow: A Deep Learning Solution for Removing Heterogeneous Motion Blur
Open accessAbstract
Removing pixel-wise heterogeneous motion blur is challenging due to the ill-posed nature of the problem. The predominant solution is to estimate the blur kernel by adding a prior, but extensive literature on the subject indicates the difficulty in identifying a prior which is suitably informative, and general. Rather than imposing a prior based on theory, we propose instead to learn one from the data. Learning a prior over the latent image would require modeling all possible image content. The critical observation underpinning our approach, however, is that learning the motion flow instead allows the model to focus on the cause of the blur, irrespective of the image content. This is a much easier learning task, but it also avoids the iterative process through which latent image priors are typically applied. Our approach directly estimates the motion flow from the blurred image through a fully-convolutional deep neural network (FCN) and recovers the unblurred image from the estimated motion flow. Our FCN is the first universal end-to-end mapping from the blurred image to the dense motion flow. To train the FCN, we simulate motion flows to generate synthetic blurred-image-motion-flow pairs thus avoiding the need for human labeling. Extensive experiments on challenging realistic blurred images demonstrate that the proposed method outperforms the state-of-the-art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Removing camera shake from a single photograph
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141956 · Cited by 1,815
From learning models of natural image patches to whole image restoration
Zoran, D., & Weiss, Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126278 · Cited by 1,522
Understanding and evaluating blind deconvolution algorithms
Levin, A., Weiss, Y., Durand, F., & Freeman, W. T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206815 · Cited by 1,208
Total variation blind deconvolution
Chan, T. F., & Wong, C.-K. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661187 · Cited by 1,201
Blind deconvolution using a normalized sparsity measure
Krishnan, D., Tay, T., & Fergus, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995521 · Cited by 1,119
Unnatural L0 Sparse Representation for Natural Image Deblurring
Xu, L., Zheng, S., & Jia, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.147 · Cited by 1,079
Two-Phase Kernel Estimation for Robust Motion Deblurring
Xu, L., & Jia, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_12 · Cited by 1,027
Cho, S., & Lee, S. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618491 · Cited by 942
Learning a convolutional neural network for non-uniform motion blur removal
Sun, J., Cao, W., Xu, Z., & Ponce, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298677 · Cited by 906
Deep Convolutional Neural Network for Image Deconvolution
Li, X., Ren, J., Liu, C., & Jia, J. (2014) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836
Blind Image Deblurring Using Dark Channel Prior
Pan, J., Sun, D., Pfister, H., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.180 · Cited by 779
Efficient marginal likelihood optimization in blind deconvolution
Levin, A., Weiss, Y., Durand, F., & Freeman, W. T. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995308 · Cited by 628
Generative Image Modeling Using Style and Structure Adversarial Networks
Wang, X., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_20 · Cited by 574
Non-uniform Deblurring for Shaken Images
Whyte, O., Sivic, J., Zisserman, A., & Ponce, J. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-011-0502-7 · Cited by 490
Deblurring Text Images via L0-Regularized Intensity and Gradient Prior
Pan, J., Hu, Z., Su, Z., & Yang, M.-H. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.371 · Cited by 457
Edge-based blur kernel estimation using patch priors
Sun, L., Cho, S., Wang, J., & Hays, J. (2013) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2013.6528301 · Cited by 440
A Neural Approach to Blind Motion Deblurring
Chakrabarti, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_14 · Cited by 400
Blind Motion Deblurring Using Image Statistics
Levin, A. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0110 · Cited by 396
Single Image Deblurring Using Motion Density Functions
Gupta, A., Joshi, N., Lawrence Zitnick, C., Cohen, M., & Curless, B. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_13 · Cited by 345
Designing deep networks for surface normal estimation
Wang, X., Fouhey, D. F., & Gupta, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298652 · Cited by 338
Cho, S., & Lee, S. (2009) · ACM SIGGRAPH Asia 2009 papers · doi:10.1145/1661412.1618491 · Cited by 336
Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections
Mao, X.-J., Shen, C., & Yang, Y.-B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.08921 · Cited by 323
Self-citationA Machine Learning Approach for Non-blind Image Deconvolution
Schuler, C. J., Burger, H. C., Harmeling, S., & Scholkopf, B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.142 · Cited by 319
Fast removal of non-uniform camera shake
Hirsch, M., Schuler, C. J., Harmeling, S., & Scholkopf, B. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126276 · Cited by 318
Richardson-Lucy Deblurring for Scenes under a Projective Motion Path
Tai, Y.-W., Tan, P., & Brown, M. S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.222 · Cited by 287
Total Variation Blind Deconvolution: The Devil Is in the Details
Perrone, D., & Favaro, P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.372 · Cited by 280
Efficient filter flow for space-variant multiframe blind deconvolution
Hirsch, M., Sra, S., Scholkopf, B., & Harmeling, S. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540158 · Cited by 227
Analyzing spatially-varying blur
Chakrabarti, A., Zickler, T., & Freeman, W. T. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539954 · Cited by 196
Segmentation-Free Dynamic Scene Deblurring
Kim, T. H., & Lee, K. M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.348 · Cited by 194
Kim, T. H., Ahn, B., & Lee, K. M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.392 · Cited by 179
Dense Optical Flow Prediction from a Static Image
Walker, J., Gupta, A., & Hebert, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.281 · Cited by 163
Multi-image Blind Deblurring Using a Coupled Adaptive Sparse Prior
Zhang, H., Wipf, D., & Zhang, Y. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.140 · Cited by 160
Self-citationDiscriminative Non-blind Deblurring
Schmidt, U., Rother, C., Nowozin, S., Jancsary, J., & Roth, S. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.84 · Cited by 143
Soft-Segmentation Guided Object Motion Deblurring
Pan, J., Hu, Z., Su, Z., Lee, H.-Y., & Yang, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.56 · Cited by 106
Learning to Estimate and Remove Non-uniform Image Blur
Couzinié-Devy, F., Sun, J. Z., Alahari, K., & Ponce, J. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.143 · Cited by 102
Joint Depth Estimation and Camera Shake Removal from Single Blurry Image
Hu, Z., Li, X., & Yang, M. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.370 · Cited by 87
Blind Image Deconvolution by Automatic Gradient Activation
Gong, D., Tan, M., Zhang, Y., van den Hengel, A., & Shi, Q. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.202 · Cited by 87
Self-citationSellent, A., Rother, C., & Roth, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_35 · Cited by 51
Zheng, S., Xu, L., & Jia, J. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.185 · Cited by 46
Non-uniform camera shake removal using a spatially-adaptive sparse penalty
Zhang, H., & Wipf, D. (n.d.) · Cited by 35
End-to-End Learning for Image Burst Deblurring
Wieschollek, P., Schölkopf, B., Lensch, H. P. A., & Hirsch, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54190-7_3 · Cited by 34
Cited by
Multi-Stage Progressive Image Restoration
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01458 · Cited by 2,095
DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better
Kupyn, O., Martyniuk, T., Wu, J., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00897 · Cited by 1,148
Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network
Su, S., Yan, Q., Zhu, Y., Zhang, C., Ge, X., Sun, J., & Zhang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00372 · Cited by 848
Self-citationHINet: Half Instance Normalization Network for Image Restoration
Chen, L., Lu, X., Zhang, J., Chu, X., & Chen, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00027 · Cited by 647
Toward Real-World Single Image Super-Resolution: A New Benchmark and a New Model
Cai, J., Zeng, H., Yong, H., Cao, Z., & Zhang, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00318 · Cited by 583
Metadata
- Authors
- Gong, D., Yang, J., Liu, L., Zhang, Y., Reid, I., Shen, C., Van Den Hengel, A., & Shi, Q.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 3806-3815
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2564023417
- Cited by
- 439
- References
- 47
- FWCI
- 12.05
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.