The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Deep joint demosaicking and denoising
Open accessAbstract
Demosaicking and denoising are the key first stages of the digital imaging pipeline but they are also a severely ill-posed problem that infers three color values per pixel from a single noisy measurement. Earlier methods rely on hand-crafted filters or priors and still exhibit disturbing visual artifacts in hard cases such as moiré or thin edges. We introduce a new data-driven approach for these challenges: we train a deep neural network on a large corpus of images instead of using hand-tuned filters. While deep learning has shown great success, its naive application using existing training datasets does not give satisfactory results for our problem because these datasets lack hard cases. To create a better training set, we present metrics to identify difficult patches and techniques for mining community photographs for such patches. Our experiments show that this network and training procedure outperform state-of-the-art both on noisy and noise-free data. Furthermore, our algorithm is an order of magnitude faster than the previous best performing techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
The MIR flickr retrieval evaluation
Huiskes, M. J., & Lew, M. S. (2008) · Proceedings of the 1st ACM international conference on Multimedia information retrieval · doi:10.1145/1460096.1460104 · Cited by 1,836
Image denoising: Can plain neural networks compete with BM3D?
Burger, H. C., Schuler, C. J., & Harmeling, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247952 · Cited by 1,325
Deep Convolutional Neural Network for Image Deconvolution
Li, X., Ren, J., Liu, C., & Jia, J. (2014) · neural information processing systems · Cited by 1,044
Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data
Foi, A., Trimeche, M., Katkovnik, V., & Egiazarian, K. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2001399 · Cited by 928
(2013) · doi:10.1145/2491956.2462176 · Cited by 885
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925974 · Cited by 814
Mantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964935 · Cited by 685
Learning to generate chairs with convolutional neural networks
Dosovitskiy, A., Springenberg, J. T., & Brox, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298761 · Cited by 640
Color plane interpolation using alternating projections
Gunturk, B. K., Altunbasak, Y., & Mersereau, R. M. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.801121 · Cited by 621
Deep Stereo: Learning to Predict New Views from the World's Imagery
Flynn, J., Neulander, I., Philbin, J., & Snavely, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.595 · Cited by 574
Cheng, Z., Yang, Q., & Sheng, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.55 · Cited by 557
Color demosaicking by local directional interpolation and nonlocal adaptive thresholding
Wu, X. (2011) · Journal of Electronic Imaging · doi:10.1117/1.3600632 · Cited by 544
Learning photographic global tonal adjustment with a database of input/output image pairs
Bychkovsky, V., Paris, S., Chan, E., & Durand, F. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995413 · Cited by 536
Self-citationLearning photographic global tonal adjustment with a database of input / output image pairs
Bychkovsky, V., Paris, S., Chan, E., & Durand, F. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995332 · Cited by 529
Self-citationRagan-Kelley, J., Barnes, C., Adams, A., Paris, S., Durand, F., & Amarasinghe, S. (2013) · ACM SIGPLAN Notices · doi:10.1145/2499370.2462176 · Cited by 513
Self-citationMantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964935 · Cited by 467
Restoring an Image Taken through a Window Covered with Dirt or Rain
Eigen, D., Krishnan, D., & Fergus, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.84 · Cited by 454
Adaptive homogeneity-directed demosaicing algorithm
Hirakawa, K., & Parks, T. W. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.838691 · Cited by 439
Image demosaicing: a systematic survey
Li, X., Gunturk, B., & Zhang, L. (2008) · SPIE Proceedings · doi:10.1117/12.766768 · Cited by 419
Designing deep networks for surface normal estimation
Wang, X., Fouhey, D. F., & Gupta, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298652 · Cited by 338
FlexISP: a flexible camera image processing framework
Heide, F., Steinberger, M., Tsai, Y.-T., Rouf, M., Pająk, D., Reddy, D., Gallo, O., Liu, J., Heidrich, W., Egiazarian, K., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2661229.2661260 · Cited by 298
Li, X., Ren, J., Yan, Q., Liao, R., & Jia, J. (2015) · International Conference on Machine Learning · Cited by 230
Demosaicing by successive approximation
Li, X. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.840683 · Cited by 221
Self-Similarity Driven Color Demosaicking
Buades, A., Coll, B., Morel, J., & Sbert, C. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2017171 · Cited by 152
Joint demosaicing and denoising
Hirakawa, K., & Parks, T. W. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.875241 · Cited by 138
Patch Complexity, Finite Pixel Correlations and Optimal Denoising
Levin, A., Nadler, B., Durand, F., & Freeman, W. T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_6 · Cited by 125
Self-citationLearning Representations for Automatic ColorizationPreprint
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06668 · Cited by 125
Effective use of spatial and spectral correlations for color filter array demosaicking
Chang, L., & Tan, Y. (2004) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2004.1277885 · Cited by 121
Joint Demosaicing and Denoising via Learned Nonparametric Random Fields
Khashabi, D., Nowozin, S., Jancsary, J., & Fitzgibbon, A. W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2359774 · Cited by 109
Learning joint demosaicing and denoising based on sequential energy minimization
Klatzer, T., Hammernik, K., Knöbelreiter, P., & Pock, T. (2016) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2016.7492871 · Cited by 89
International Conference on Image Processing
(2009) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2009.2038640 · Cited by 85
Joint demosaicking and denoising by total variation minimization
Condat, L., & Mosaddegh, S. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6467476 · Cited by 81
Jeon, G., & Dubois, É. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214041 · Cited by 47
A New Color Filter Array With Optimal Properties for Noiseless and Noisy Color Image Acquisition
Condat, L. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2114355 · Cited by 45
Self-learning approach to color demosaicking via support vector regression
He, F.-L., Wang, Y.-C. F., & Hua, K. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6467472 · Cited by 24
Tian, Q., Lansel, S., Farrell, J., et al. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2042565 · Cited by 14
Perceptual Evaluation of Demosaicing Artefacts
Sergej, T., & Mantiuk, R. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11758-4_5 · Cited by 8
Cited by
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00917 · Cited by 4,332
Chen, C., Chen, Q., Xu, J., & Koltun, V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00347 · Cited by 1,376
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
Underexposed Photo Enhancement Using Deep Illumination Estimation
Wang, R., Zhang, Q., Fu, C.-W., Shen, X., Zheng, W.-S., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00701 · Cited by 983
Learning Enriched Features for Real Image Restoration and Enhancement
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58595-2_30 · Cited by 946
Metadata
- Authors
- Gharbi, M., Chaurasia, G., Paris, S., & Durand, F.
- Venue
- ACM Transactions on Graphics
- Published
- 2016-11-11
- Volume
- 35
- Issue
- 6
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2556872594
- Cited by
- 473
- References
- 56
- FWCI
- 27.15
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.