The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems
Open accessAbstract
We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly nonsmooth) regularizer is minimized under the constraint that the solution explains the observations sufficiently well. Although the regularizer and constraint are usually convex, several particular features of these problems (huge dimensionality, nonsmoothness) preclude the use of off-the-shelf optimization tools and have stimulated a considerable amount of research. In this paper, we propose a new efficient algorithm to handle one class of constrained problems (often known as basis pursuit denoising) tailored to image recovery applications. The proposed algorithm, which belongs to the family of augmented Lagrangian methods, can be used to deal with a variety of imaging IPLIP, including deconvolution and reconstruction from compressive observations (such as MRI), using either total-variation or wavelet-based (or, more generally, frame-based) regularization. The proposed algorithm is an instance of the so-called alternating direction method of multipliers, for which convergence sufficient conditions are known; we show that these conditions are satisfied by the proposed algorithm. Experiments on a set of image restoration and reconstruction benchmark problems show that the proposed algorithm is a strong contender for the state-of-the-art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donoho, D. L. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.871582 · Cited by 23,994
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Rockafellar, R. T. (1970) · Princeton University Press eBooks · doi:10.1515/9781400873173 · Cited by 10,801
Stable signal recovery from incomplete and inaccurate measurements
Candès, E. J., Romberg, J. K., & Tao, T. (2006) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20124 · Cited by 7,036
Sparse MRI: The application of compressed sensing for rapid MR imaging
Lustig, M., Donoho, D., & Pauly, J. M. (2007) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21391 · Cited by 6,952
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
An iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
Figueiredo, M. A. T., Nowak, R. D., & Wright, S. J. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910281 · Cited by 3,524
Self-citationchambolle (2004) · doi:10.1023/b:jmiv.0000011321.19549.88 · Cited by 3,227
Eckstein, J., & Bertsekas, D. P. (1992) · Mathematical Programming · doi:10.1007/bf01581204 · Cited by 2,791
Signal Recovery by Proximal Forward-Backward Splitting
Combettes, P. L., & Wajs, V. R. (2005) · Multiscale Modeling & Simulation · doi:10.1137/050626090 · Cited by 2,678
Fast Discrete Curvelet Transforms
Candès, E., Demanet, L., Donoho, D., & Ying, L. (2006) · Multiscale Modeling & Simulation · doi:10.1137/05064182x · Cited by 2,573
A dual algorithm for the solution of nonlinear variational problems via finite element approximation
Gabay, D., & Mercier, B. (1976) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(76)90003-1 · Cited by 2,514
Smooth minimization of non-smooth functions
Nesterov, Y. (2005) · Mathematical Programming · doi:10.1007/s10107-004-0552-5 · Cited by 2,455
Multiplier and gradient methods
Hestenes, M. R. (1969) · Journal of Optimization Theory and Applications · doi:10.1007/bf00927673 · Cited by 2,446
An Interior-Point Method for Large-Scale -Regularized Least Squares
Kim, S.-J., Koh, K., Lustig, M., Boyd, S., & Gorinevsky, D. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910971 · Cited by 2,083
A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064 · cited 2×
“For solving problems of the form (4), some of the state-of-the-art algorithms belong to the iterative shrinkage/thresholding (IST) family [18], [21], [30], [36], and its two-step (TwIST [9] and FISTA [5]) and accelerated (SpaRSA [54]) variants.”
BackgroundMethodSelf-citationA New Alternating Minimization Algorithm for Total Variation Image Reconstruction
Wang, Y., Yang, J., Yin, W., & Zhang, Y. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/080724265 · Cited by 1,975
Probing the Pareto Frontier for Basis Pursuit Solutions
van den Berg, E., & Friedlander, M. P. (2009) · SIAM Journal on Scientific Computing · doi:10.1137/080714488 · Cited by 1,939
Introduction to Inverse Problems in Imaging
Bertero, M., & Boccacci, P. (1998) · Institute of Physics eBooks · doi:10.1887/0750304359 · Cited by 1,899
Sparse Reconstruction by Separable Approximation
Wright, S. J., Nowak, R. D., & Figueiredo, M. A. T. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016892 · Cited by 1,854
Self-citationVariational methods for the solution of problems of equilibrium and vibrations
Courant, R. (1943) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1943-07818-4 · Cited by 1,711
Complex Wavelets for Shift Invariant Analysis and Filtering of Signals
Kingsbury, N. (2001) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.2000.0343 · Cited by 1,675
Bregman Iterative Algorithms for $\ell_1$-Minimization with Applications to Compressed Sensing
Yin, W., Osher, S., Goldfarb, D., & Darbon, J. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/070703983 · Cited by 1,414
Fast Image Recovery Using Variable Splitting and Constrained Optimization
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2047910 · Cited by 1,223
Self-citationAn EM algorithm for wavelet-based image restoration
Figueiredo, M. A. T., & Nowak, R. D. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.814255 · Cited by 1,219
Self-citationNESTA: A Fast and Accurate First-Order Method for Sparse Recovery
Becker, S., Bobin, J., & Candès, E. J. (2011) · SIAM Journal on Imaging Sciences · doi:10.1137/090756855 · Cited by 848
Analysis versus synthesis in signal priors
Elad, M., Milanfar, P., & Rubinstein, R. (2007) · Inverse Problems · doi:10.1088/0266-5611/23/3/007 · Cited by 698
Split Bregman Methods and Frame Based Image Restoration
Cai, J.-F., Osher, S., & Shen, Z. (2010) · Multiscale Modeling & Simulation · doi:10.1137/090753504 · Cited by 670
Majorization–Minimization Algorithms for Wavelet-Based Image Restoration
Figueiredo, M. A. T., Bioucas-Dias, J. M., & Nowak, R. D. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909318 · Cited by 548
Self-citationA Douglas–Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery
Combettes, P. L., & Pesquet, J.-C. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910264 · Cited by 490
Noise reduction using an undecimated discrete wavelet transform
Lang, M., Guo, H., Odegard, J. E., Burrus, C. S., & Wells, R. O. (1996) · IEEE Signal Processing Letters · doi:10.1109/97.475823 · Cited by 484
Restoration of Poissonian Images Using Alternating Direction Optimization
Figueiredo, M. A. T., & Bioucas-Dias, J. M. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2053941 · Cited by 372
Self-citationHilbert transform pairs of wavelet bases
Selesnick, I. W. (2001) · IEEE Signal Processing Letters · doi:10.1109/97.923042 · Cited by 348
Split Bregman Algorithm, Douglas-Rachford Splitting and Frame Shrinkage
Setzer, S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02256-2_39 · Cited by 191
Signal restoration with overcomplete wavelet transforms: comparison of analysis and synthesis priors
Selesnick, I. W., & Figueiredo, M. A. T. (2009) · SPIE Proceedings · doi:10.1117/12.826663 · Cited by 175
Self-citationBioucas-Dias, J. M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863972 · Cited by 175
Self-citationAlgorithms and software for total variation image reconstruction via first-order methods
Dahl, J., Hansen, P. C., Jensen, S. H., & Jensen, T. L. (2010) · Numerical Algorithms · doi:10.1007/s11075-009-9310-3 · Cited by 159
Image Denoising with Shrinkage and Redundant Representations
Elad, M., Matalon, B., & Zibulevsky, M. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.143 · Cited by 91
An iterative algorithm for linear inverse problems with compound regularizers
Bioucas‐Dias, J. M., & Figueiredo, M. A. T. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711847 · Cited by 54
Self-citationAfonso, M. V., Bioucas‐Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5495758 · Cited by 33
Self-citationFast frame-based image deconvolution using variable splitting and constrained optimization
Figueiredo, M. A. T., Bioucas-Dias, J. M., & Afonso, M. V. (2009) · IEEE Statistical Signal Processing Workshop (SSP) · doi:10.1109/ssp.2009.5278628 · Cited by 33
Self-citation
Cited by
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing
Zhang, J., & Ghanem, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00196 · Cited by 1,309
Semantic Image Inpainting with Deep Generative Models
Yeh, R. A., Chen, C., Lim, T. Y., Schwing, A. G., Hasegawa-Johnson, M., & Do, M. N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.728 · Cited by 1,206
The Little Engine That Could: Regularization by Denoising (RED)
Romano, Y., Elad, M., & Milanfar, P. (2017) · SIAM Journal on Imaging Sciences · doi:10.1137/16m1102884 · Cited by 934
A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization
Simoes, M., Bioucas-Dias, J., Almeida, L. B., & Chanussot, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2375320 · Cited by 826
Self-citation
Metadata
- Authors
- Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2011-03
- Volume
- 20
- Issue
- 3
- Pages
- 681-695
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2123031198
- Cited by
- 938
- References
- 43
- FWCI
- 37.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.