An Iterative Regularization Method for Total Variation-Based Image Restoration
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
We introduce a new iterative regularization procedure for inverse problems based on the use of Bregman distances, with particular focus on problems arising in image processing. We are motivated by the problem of restoring noisy and blurry images via variational methods by using total variation regularization. We obtain rigorous convergence results and effective stopping criteria for the general procedure. The numerical results for denoising appear to give significant improvement over standard models, and preliminary results for deblurring/denoising are very encouraging.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“TV can create watercolor-like artifacts”
From Learning Deep CNN Denoiser Prior for Image Restoration (2017) · cites this paper as [43]
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
Self-citationFronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations
Osher, S., & Sethian, J. A. (1988) · Journal of Computational Physics · doi:10.1016/0021-9991(88)90002-2 · Cited by 14,062
Self-citationRegularization of Inverse Problems
Engl, H. W., Hanke, M., & Neubauer, A. (1996) · Springer eBooks · doi:10.1007/978-94-009-1740-8 · Cited by 5,275
Convex Analysis and Variational Problems
(1976) · Studies in Mathematics and Its Applications · doi:10.1016/c2009-0-19672-1 · Cited by 3,806
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
Bregman, L. M. (1967) · USSR Computational Mathematics and Mathematical Physics · doi:10.1016/0041-5553(67)90040-7 · Cited by 2,618
Computational Methods for Inverse Problems
Vogel, C. R. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717570 · Cited by 2,370
Convex Analysis and Variational Problems
Ekeland, I., & Témam, R. (1999) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611971088 · Cited by 1,599
Image recovery via total variation minimization and related problems
Chambolle, A., & Lions, P.-L. (1997) · Numerische Mathematik · doi:10.1007/s002110050258 · Cited by 1,569
Total variation blind deconvolution
Chan, T. F., & Wong, C.-K. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661187 · Cited by 1,201
Research works printed but not linked: 1
- 10.1023/B:JMIV.0000011325.36760.1e · DOI · Paper page
Cited by
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
“Over the past few decades, various models have been exploited for modeling image priors, including nonlocal self-similarity (NSS) models [1], [2], [3], [4], sparse models [4], [5], [6], gradient models [7], [8], [9] and Markov random field (MRF) models [10], [11], [12].”
BackgroundRobust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
A Singular Value Thresholding Algorithm for Matrix Completion
Cai, J.-F., Candès, E. J., & Shen, Z. (2010) · SIAM Journal on Optimization · doi:10.1137/080738970 · Cited by 5,809
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
Agustsson, E., & Timofte, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.150 · Cited by 4,295
“Single image super-resolution as well as image restoration research literature spans over decades [36, 20, 4, 13, 16, 3, 15, 14, 6, 32, 54, 30, 17, 23, 12, 47, 48, 10, 21].”
BackgroundThe Split Bregman Method for L1-Regularized Problems
Goldstein, T., & Osher, S. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080725891 · Cited by 4,282
Self-citationA Review of Image Denoising Algorithms, with a New One
Buades, A., Coll, B., & Morel, J. M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040616024 · Cited by 4,083
Learning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116
“Existing denoiser priors that have been adopted in model-based optimization methods to solve other inverse problems include total variation (TV) [10, 43], Gaussian mixture models (GMM) [66], K-SVD [25], non-local means [7] and BM3D [17].”
MethodAn Interior-Point Method for Large-Scale -Regularized Least Squares
Kim, S.-J., Koh, K., Lustig, M., Boyd, S., & Gorinevsky, D. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910971 · Cited by 2,083
Bregman Iterative Algorithms for $\ell_1$-Minimization with Applications to Compressed Sensing
Yin, W., Osher, S., Goldfarb, D., & Darbon, J. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/070703983 · Cited by 1,414
Self-citationAlternating Direction Algorithms for $\ell_1$-Problems in Compressive Sensing
Yang, J., & Zhang, Y. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/090777761 · Cited by 1,201
Deep Learning on Image Denoising: An overview
Tian, C., Fei, L., Zheng, W., Xu, Y., Zuo, W., & Lin, C.-W. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.025 · Cited by 1,091
A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation
Fu, X., Zeng, D., Huang, Y., Zhang, X.-P., & Ding, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.304 · Cited by 1,081
Liu, R., Ma, L., Zhang, J., Fan, X., & Luo, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01042 · Cited by 1,057
Fixed point and Bregman iterative methods for matrix rank minimization
Ma, S., Goldfarb, D., & Chen, L. (2011) · Mathematical Programming · doi:10.1007/s10107-009-0306-5 · Cited by 1,048
Self-citationReal Image Denoising With Feature Attention
Anwar, S., & Barnes, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00325 · Cited by 784
Nonlocal Image and Movie Denoising
Buades, A., Coll, B., & Morel, J.-M. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0052-1 · Cited by 769
Deep learning in optical metrology: a review
Zuo, C., Qian, J., Feng, S., Yin, W., Li, Y., Fan, P., Han, J., Qian, K., & Chen, Q. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-00714-x · Cited by 711
Self-citationBregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction
Zhang, X., Burger, M., Bresson, X., & Osher, S. (2010) · SIAM Journal on Imaging Sciences · doi:10.1137/090746379 · Cited by 688
Self-citationSplit Bregman Methods and Frame Based Image Restoration
Cai, J.-F., Osher, S., & Shen, Z. (2010) · Multiscale Modeling & Simulation · doi:10.1137/090753504 · Cited by 670
Self-citationTotal-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration
He, W., Zhang, H., Zhang, L., & Shen, H. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2452812 · Cited by 667
An efficient augmented Lagrangian method with applications to total variation minimization
Li, C., Yin, W., Jiang, H., & Zhang, Y. (2013) · Computational Optimization and Applications · doi:10.1007/s10589-013-9576-1 · Cited by 656
Self-citationNonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach
Dong, W., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2221729 · Cited by 655
Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection
Aujol, J.-F., Gilboa, G., Chan, T., & Osher, S. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-4331-z · Cited by 630
Self-citationWu, C., & Tai, X.-C. (2010) · SIAM Journal on Imaging Sciences · doi:10.1137/090767558 · Cited by 615
A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical
Milanfar, P. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.2179329 · Cited by 605
A Fast Alternating Direction Method for TVL1-L2 Signal Reconstruction From Partial Fourier Data
Yang, J., Zhang, Y., & Yin, W. (2010) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2010.2042333 · Cited by 571
Self-citationImage super-resolution: the techniques, applications, and future
Yue, L., Shen, H., Li, J., Yuan, Q., Zhang, H., & Zhang, L. (2016) · Signal Processing · doi:10.1016/j.sigpro.2016.05.002 · Cited by 554
A Systematic Review of Compressive Sensing: Concepts, Implementations and Applications
Rani, M., Dhok, S. B., & Deshmukh, R. B. (2018) · IEEE Access · doi:10.1109/access.2018.2793851 · Cited by 530
A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration
Yang, J., Yin, W., Zhang, Y., & Wang, Y. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080730421 · Cited by 529
Self-citationDenoising Prior Driven Deep Neural Network for Image Restoration
Dong, W., Wang, P., Yin, W., Shi, G., Wu, F., & Lu, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873610 · Cited by 515
Self-citationNonlocal Linear Image Regularization and Supervised Segmentation
Gilboa, G., & Osher, S. (2007) · Multiscale Modeling & Simulation · doi:10.1137/060669358 · Cited by 468
Self-citationFu, X., Liao, Y., Zeng, D., Huang, Y., Zhang, X.-P., & Ding, X. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2474701 · Cited by 467
Sparsity-based image denoising via dictionary learning and structural clustering
Dong, W., Li, X., Zhang, L., & Shi, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995478 · Cited by 465
Image Super-Resolution by TV-Regularization and Bregman Iteration
Marquina, A., & Osher, S. J. (2008) · Journal of Scientific Computing · doi:10.1007/s10915-008-9214-8 · Cited by 458
Self-citationGeometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction
Goldstein, T., Bresson, X., & Osher, S. (2010) · Journal of Scientific Computing · doi:10.1007/s10915-009-9331-z · Cited by 452
Self-citationBayesian retinex underwater image enhancement
Zhuang, P., Li, C., & Wu, J. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104171 · Cited by 434
Seislet transform and seislet frame
Fomel, S., & Liu, Y. (2010) · Geophysics · doi:10.1190/1.3380591 · Cited by 432
A Unified Primal-Dual Algorithm Framework Based on Bregman Iteration
Zhang, X., Burger, M., & Osher, S. (2011) · Journal of Scientific Computing · doi:10.1007/s10915-010-9408-8 · Cited by 419
Self-citationA review on CT image noise and its denoising
Diwakar, M., & Kumar, M. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.01.010 · Cited by 416
Modern regularization methods for inverse problems
Benning, M., & Burger, M. (2018) · Acta Numerica · doi:10.1017/s0962492918000016 · Cited by 412
Self-citationPatch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising
Xu, J., Zhang, L., Zuo, W., Zhang, D., & Feng, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.36 · Cited by 393
Self-citationDeblurring and Denoising of Images by Nonlocal Functionals
Kindermann, S., Osher, S., & Jones, P. W. (2005) · Multiscale Modeling & Simulation · doi:10.1137/050622249 · Cited by 369
Self-citationImage restoration: Total variation, wavelet frames, and beyond
Cai, J.-F., Dong, B., Osher, S., & Shen, Z. (2012) · Journal of the American Mathematical Society · doi:10.1090/s0894-0347-2012-00740-1 · Cited by 339
Self-citationHandbook of Mathematical Methods in Imaging
(2011) · Springer eBooks · doi:10.1007/978-0-387-92920-0 · Cited by 334
Compressed Sensing With Quantized Measurements
Zymnis, A., Boyd, S., & Candes, E. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2009.2035667 · Cited by 316
Fast algorithms for nonconvex compressive sensing: MRI reconstruction from very few data
Chartrand, R. (2009) · 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro · doi:10.1109/isbi.2009.5193034 · Cited by 312
Deep Generalized Unfolding Networks for Image Restoration
Mou, C., Wang, Q., & Zhang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01688 · Cited by 290
A Combined First and Second Order Variational Approach for Image Reconstruction
Papafitsoros, K., & Schönlieb, C. B. (2014) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-013-0445-4 · Cited by 289
Smooth PARAFAC Decomposition for Tensor Completion
Yokota, T., Zhao, Q., & Cichocki, A. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2586759 · Cited by 279
Rudin-Osher-Fatemi Total Variation Denoising using Split Bregman
Getreuer, P. (2012) · Image Processing On Line · doi:10.5201/ipol.2012.g-tvd · Cited by 272
Manjón, J. V., Coupé, P., Buades, A., Fonov, V., Louis Collins, D., & Robles, M. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.05.010 · Cited by 271
Hyperspectral Image Denoising via Noise-Adjusted Iterative Low-Rank Matrix Approximation
He, W., Zhang, H., Zhang, L., & Shen, H. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2398433 · Cited by 269
Graph and Total Variation Regularized Low-Rank Representation for Hyperspectral Anomaly Detection
Cheng, T., & Wang, B. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2936609 · Cited by 266
Proximity algorithms for image models: denoising
Micchelli, C. A., Shen, L., & Xu, Y. (2011) · Inverse Problems · doi:10.1088/0266-5611/27/4/045009 · Cited by 265
Multi-energy CT based on a prior rank, intensity and sparsity model (PRISM)
Gao, H., Yu, H., Osher, S., & Wang, G. (2011) · Inverse Problems · doi:10.1088/0266-5611/27/11/115012 · Cited by 264
Self-citationCompressed sensing based cone‐beam computed tomography reconstruction with a first‐order methoda)
Choi, K., Wang, J., Zhu, L., Suh, T., Boyd, S., & Xing, L. (2010) · Medical Physics · doi:10.1118/1.3481510 · Cited by 255
Deep Learning for Handling Kernel/model Uncertainty in Image Deconvolution
Nan, Y., & Ji, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00246 · Cited by 66
“For example, the ℓ 1 -norm relating regularization, including total-variation (TV) method [29]) and wavelet methods [3, ?”
MethodLocal‐ and Global‐Statistics‐Based Active Contour Model for Image Segmentation
Wu, B., & Yang, Y. (2012) · Mathematical Problems in Engineering · doi:10.1155/2012/791958 · Cited by 30
Accurate retrieval of region of interest for estimating point spread function and image deblurring
Mohd Shapri, A. H., & Abdullah, M. Z. (2017) · The Imaging Science Journal · doi:10.1080/13682199.2017.1341457 · Cited by 6
“In solving this problem, Wen et al. [14] introduced a blind deconvolution (BD) based on improved total variation algorithm with split Bregman ’ s iteration [15].”
MethodResultAugmented distributed optimization for networked systems
Xu, J. (2019) · doi:10.32657/10356/68805 · Cited by 5
Self-citation
Metadata
- Authors
- Osher, S., Burger, M., Goldfarb, D., Xu, J., & Yin, W.
- Affiliations
- University of California, Los Angeles (US)
- Johannes Kepler University of Linz (AT)
- Columbia University (US)
- Venue
- Multiscale Modeling & Simulation
- Published
- 2005-01
- Volume
- 4
- Issue
- 2
- Pages
- 460-489
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W2011181254
- Cited by
- 1,787
- References
- 50
- Citations by year
- 2026: 30 · 2025: 50 · 2024: 79 · 2023: 82 · 2022: 116 · 2021: 93 · 2020: 116 · 2019: 109 · 2018: 109 · 2017: 136 · 2016: 123 · 2015: 106 · 2014: 120 · 2013: 120 · 2012: 112
- FWCI
- 28.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multiscale Modeling and Simulation (publishedVersion)
- Funders
- National Science Foundation (P20MH65166, 0321917, 0312222)
- U.S. Department of Energy
- Austrian Science Fund
- National Institutes of Health
- Office of Naval Research (N00014)
- National Institute of Mental Health (P20MH065166)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Physical Sciences › Mathematics › Mathematical Physics › Numerical methods in inverse problems
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Keywords
- iterative regularization, Bregman distance, total variation regularization, image restoration, image denoising, image deblurring, inverse problems, convergence analysis, stopping rules, variational methods
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.