Non-Local Auto-Encoder With Collaborative Stabilization for Image Restoration
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Deep neural networks have been applied to image restoration to achieve the top-level performance. From a neuroscience perspective, the layerwise abstraction of knowledge in a deep neural network can, to some extent, reveal the mechanisms of how visual cues are processed in human brain. A pivotal property of human brain is that similar visual cues can stimulate the same neuron to induce similar neurological signals. However, conventional neural networks do not consider this property, and the resulting models are, as a result, unstable regarding their internal propagation. In this paper, we develop the (stacked) non-local auto-encoder, which exploits self-similar information in natural images for stability. We propose that similar inputs should induce similar network propagation. This is achieved by constraining the difference between the hidden representations of non-local similar image blocks during training. By applying the proposed model to image restoration, we then develop a collaborative stabilization step to further rectify forward propagation. To obtain a reliable deep model, we employ several strategies to simplify training and improve testing. Extensive image restoration experiments, including image denoising and super-resolution, demonstrate the effectiveness of the proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216 · cited 1×
“2) Obtain More Training Data: In our experiments, we use the Berkeley segmentation dataset [44],3 which contains 500 images.”
MethodA Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616 · cited 10×
“[26] presented the idea of NLM, the redundancy caused by patch recurrence in natural images has become a dominant concept in modern image restoration techniques.”
BackgroundMethodInfluentialImage Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Weighted Nuclear Norm Minimization with Application to Image Denoising
Gu, S., Zhang, L., Zuo, W., & Feng, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.366 · Cited by 2,316
From learning models of natural image patches to whole image restoration
Zoran, D., & Weiss, Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126278 · Cited by 1,522
Image denoising: Can plain neural networks compete with BM3D?
Burger, H. C., Schuler, C. J., & Harmeling, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247952 · Cited by 1,325
Shrinkage Fields for Effective Image Restoration
Schmidt, U., & Roth, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.349 · Cited by 543
A Machine Learning Approach for Non-blind Image Deconvolution
Schuler, C. J., Burger, H. C., Harmeling, S., & Scholkopf, B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.142 · Cited by 319 · cited 1×
“tasks including image non-blind deblurring [16] and maskspecific inpainting [17].”
Deep Network Cascade for Image Super-resolution
Cui, Z., Chang, H., Shan, S., Zhong, B., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_4 · Cited by 255 · cited 3×
“Note also that our method differs from the collaborative local auto-encoder (CLA) [20], since CLA imposes a similarity constraint on the output space while the non-local auto-encoder constrains hidden representations under a different motivation.”
MethodInfluential
Cited by
Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network
Chen, H., Zhang, Y., Kalra, M. K., Lin, F., Chen, Y., Liao, P., Zhou, J., & Wang, G. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2715284 · Cited by 1,866
A survey on deep learning for big data
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.006 · Cited by 1,226
Chen, Z., Yu, B., Yang, C., Zhou, Y., Yao, S., Qian, X., Wang, C., Wu, B., & Wu, J. (2021) · Earth System Science Data · doi:10.5194/essd-13-889-2021 · Cited by 923
aLow-dose CT via convolutional neural network
Chen, H., Zhang, Y., Zhang, W., Liao, P., Li, K., Zhou, J., & Wang, G. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.000679 · Cited by 755
Convolutional Neural Networks for Inverse Problems in Imaging: A Review
McCann, M. T., Jin, K. H., & Unser, M. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2739299 · Cited by 646
Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems
Wei, Z., & Chen, X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2869221 · Cited by 497
Weighted Schatten $p$ -Norm Minimization for Image Denoising and Background Subtraction
Xie, Y., Gu, S., Liu, Y., Zuo, W., Zhang, W., & Zhang, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2599290 · Cited by 412
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 318
The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review
Schwabe, D., Becker, K., Seyferth, M., Klaß, A., & Schaeffter, T. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01196-4 · Cited by 169
“The overarching topics Theearly data quality research in the 1980s and 1990s uncovered the lackofobjectivemeasurestoassesdataquality,whichledtotheintroduction oftask-dependentdimensionsandtheestablishmentofadataqualityfra-meworkfromtheperspectiveofthedataconsumer 57 .”
Background
Metadata
- Authors
- Wang, R., & Tao, D.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2016-05
- Volume
- 25
- Issue
- 5
- Pages
- 2117-2129
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2327669213
- Cited by
- 76
- References
- 11
- FWCI
- 10.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.