The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
A Generalized Forward-Backward Splitting
Open accessAbstract
This paper introduces a generalized forward-backward splitting algorithm for finding a zero of a sum of maximal monotone operators $B + \sum_{i=1}^n A_i$, where $B$ is cocoercive. It involves the computation of $B$ in an explicit (forward) step and the parallel computation of the resolvents of the $A_i$'s in a subsequent implicit (backward) step. We prove the algorithm's convergence in infinite dimension and its robustness to summable errors on the computed operators in the explicit and implicit steps. In particular, this allows efficient minimization of the sum of convex functions $f + \sum_{i=1}^n g_i$, where $f$ has a Lipschitz-continuous gradient and each $g_i$ is simple in the sense that its proximity operator is easy to compute. The resulting method makes use of the regularity of $f$ in the forward step, and the proximity operators of the $g_i$'s are applied in parallel in the backward step. While the forward-backward algorithm cannot deal with more than $n = 1$ nonsmooth function, we generalize it to the case of arbitrary $n$. Examples on inverse problems in imaging demonstrate the advantage of the proposed methods in comparison to other splitting algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
An iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
Chambolle, A., & Pock, T. (2011) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-010-0251-1 · Cited by 4,336
Convex Analysis and Monotone Operator Theory in Hilbert Spaces
Bauschke, H. H., & Combettes, P. L. (2017) · CMS Books in Mathematics · doi:10.1007/978-3-319-48311-5 · Cited by 3,307
The Numerical Solution of Parabolic and Elliptic Differential Equations
Peaceman, D. W., & Rachford, Jr. (1955) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0103003 · Cited by 3,255
Convex Analysis and Monotone Operator Theory in Hilbert Spaces
Bauschke, H. H., & Combettes, P. L. (2011) · CMS Books in Mathematics · doi:10.1007/978-1-4419-9467-7 · Cited by 2,962
Eckstein, J., & Bertsekas, D. P. (1992) · Mathematical Programming · doi:10.1007/bf01581204 · Cited by 2,791
Signal Recovery by Proximal Forward-Backward Splitting
Combettes, P. L., & Wajs, V. R. (2005) · Multiscale Modeling & Simulation · doi:10.1137/050626090 · Cited by 2,678
A dual algorithm for the solution of nonlinear variational problems via finite element approximation
Gabay, D., & Mercier, B. (1976) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(76)90003-1 · Cited by 2,514
Splitting Algorithms for the Sum of Two Nonlinear Operators
Lions, P. L., & Mercier, B. (1979) · SIAM Journal on Numerical Analysis · doi:10.1137/0716071 · Cited by 1,972
A Wavelet Tour of Signal Processing
(2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374370-1.x0001-8 · Cited by 1,886
On the numerical solution of heat conduction problems in two and three space variables
Douglas, J., & Rachford, H. H. (1956) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1956-0084194-4 · Cited by 1,744
Varberg, D. E. (1973) · Cited by 1,700
The extragradient method for finding saddle points and other problems
Korpelevich, G. M. (1976) · Medical Entomology and Zoology · Cited by 1,607
Proximité et dualité dans un espace hilbertien
Moreau, J. J. (1965) · Bulletin de la Société mathématique de France · doi:10.24033/bsmf.1625 · Cited by 1,462
Gradient methods for minimizing composite functions
Nesterov, Y. (2013) · Mathematical Programming · doi:10.1007/s10107-012-0629-5 · Cited by 1,298
A Modified Forward-Backward Splitting Method for Maximal Monotone Mappings
Tseng, P. (2000) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012998338806 · Cited by 1,223
Fast Image Recovery Using Variable Splitting and Constrained Optimization
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2047910 · Cited by 1,223
An EM algorithm for wavelet-based image restoration
Figueiredo, M. A. T., & Nowak, R. D. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.814255 · Cited by 1,219
Monotone (nonlinear) operators in Hilbert space
Minty, G. J. (1962) · Duke Mathematical Journal · doi:10.1215/s0012-7094-62-02933-2 · Cited by 1,135
Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics
Glowinski, R., & Tallec, P. L. (1989) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970838 · Cited by 1,015
Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics.
Oden, J. T., Glowinski, R., & Tallec, P. L. (1992) · Mathematics of Computation · doi:10.2307/2153048 · Cited by 972
Condat, L. (2013) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-012-0245-9 · Cited by 912
Gradient methods for minimizing composite objective function
Nesterov, Y. E. (2007) · Cited by 867
Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems
(1983) · Studies in Mathematics and Its Applications · doi:10.1016/s0168-2024(08)x7003-1 · Cited by 760
Ergodic convergence to a zero of the sum of monotone operators in Hilbert space
Passty, G. B. (1979) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(79)90234-8 · Cited by 609
Studies in Linear and Non-Linear Programming.
Suzuki, G., Arrow, K. J., Hurwicz, L., & Uzawa, H. (1959) · Mathematical Tables and Other Aids to Computation · doi:10.2307/2002823 · Cited by 520
Fixed-Point Algorithms for Inverse Problems in Science and Engineering
Bauschke, H. H., Burachik, R. S., Combettes, P. L., Elser, V., Luke, D. R., & Wolkowicz, H. (2011) · Springer optimization and its applications · doi:10.1007/978-1-4419-9569-8 · Cited by 508
A Douglas–Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery
Combettes, P. L., & Pesquet, J.-C. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910264 · Cited by 490
Tseng, P. (1991) · SIAM Journal on Control and Optimization · doi:10.1137/0329006 · Cited by 467
Solving monotone inclusions via compositions of nonexpansive averaged operators
Combettes *, P. L. (2004) · Optimization · doi:10.1080/02331930412331327157 · Cited by 457
A proximal-based decomposition method for convex minimization problems
Chen, G., & Teboulle, M. (1994) · Mathematical Programming · doi:10.1007/bf01582566 · Cited by 392
Restoration of Poissonian Images Using Alternating Direction Optimization
Figueiredo, M. A. T., & Bioucas-Dias, J. M. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2053941 · Cited by 372
Combettes, P. L., & Pesquet, J.-C. (2011) · Set-Valued and Variational Analysis · doi:10.1007/s11228-011-0191-y · Cited by 371
Convergence theorems for sequences of nonlinear operators in Banach spaces
Browder, F. E. (1967) · Mathematische Zeitschrift · doi:10.1007/bf01109805 · Cited by 341
Inpainting and Zooming Using Sparse Representations
Fadili, M. J., Starck, J.-L., & Murtagh, F. (2008) · The Computer Journal · doi:10.1093/comjnl/bxm055 · Cited by 333
Restoration of Poissonian images using alternating direction optimization
Figueiredo, M. A. T., & Bioucas‐Dias, J. M. (2010) · Cited by 325
Convergence Rates in Forward--Backward Splitting
Chen, G. H.-G., & Rockafellar, R. T. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623495290179 · Cited by 285
Proximal Methods for Hierarchical Sparse Coding
Jenatton, R., Mairal, J., Obozinski, G., & Bach, F. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1009.2139 · Cited by 272
Linear convergence of iterative soft-thresholdingPreprint
Bredies, K., & Lorenz, D. A. (2012) · Cited by 265
A variational formulation for frame-based inverse problems
Chaux, C., Combettes, P. L., Pesquet, J.-C., & Wajs, V. R. (2007) · Inverse Problems · doi:10.1088/0266-5611/23/4/008 · Cited by 249
Linear Convergence of Iterative Soft-Thresholding
Bredies, K., & Lorenz, D. A. (2008) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-008-9041-1 · Cited by 228
A proximal decomposition method for solving convex variational inverse problems
Combettes, P. L., & Pesquet, J.-C. (2008) · Inverse Problems · doi:10.1088/0266-5611/24/6/065014 · Cited by 207
A Proximal Iteration for Deconvolving Poisson Noisy Images Using Sparse Representations
Dupe, F.-X., Fadili, J. M., & Starck, J.-L. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2008223 · Cited by 203
Self-citation9 A PROXIMAL DECOMPOSITION METHOD FOR SOLVING CONVEX VARIATIONAL INVERSE PROBLEMS∗
Combettes, P. L., Pesquet, J.-C., & Paris-est, U. (2009) · Cited by 203
Monteiro, R. D. C., & Svaiter, B. F. (2013) · SIAM Journal on Optimization · doi:10.1137/110849468 · Cited by 188
Partial inverse of a monotone operator
Spingarn, J. E. (1983) · Applied Mathematics & Optimization · doi:10.1007/bf01448388 · Cited by 185
Parallel alternating direction multiplier decomposition of convex programs
Eckstein, J. (1994) · Journal of Optimization Theory and Applications · doi:10.1007/bf02196592 · Cited by 152
Parallel Proximal Algorithm for Image Restoration Using Hybrid Regularization
Pustelnik, N., Chaux, C., & Pesquet, J.-C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2128335 · Cited by 150
Sparsity and persistence: mixed norms provide simple signal models with dependent coefficients
Kowalski, M., & Torrésani, B. (2008) · Signal Image and Video Processing · doi:10.1007/s11760-008-0076-1 · Cited by 134
Alternating Projection-Proximal Methods for Convex Programming and Variational Inequalities
Tseng, P. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623495279797 · Cited by 123
Dualization of Signal Recovery Problems
Combettes, P. L., Dũng, Ð., & Vũ, B. C. (2010) · Set-Valued and Variational Analysis · doi:10.1007/s11228-010-0147-7 · Cited by 116
Total Variation Projection With First Order Schemes
Fadili, J. M., & Gabriel Peyré, A. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2072512 · Cited by 113
Self-citationA Parallel Inertial Proximal Optimization Method
Pesquet, J.-C., & Pustelnik, N. (2012) · HAL · Cited by 97
General Projective Splitting Methods for Sums of Maximal Monotone Operators
Eckstein, J., & Svaiter, B. F. (2009) · SIAM Journal on Control and Optimization · doi:10.1137/070698816 · Cited by 94
Nested Iterative Algorithms for Convex Constrained Image Recovery Problems
Chaux, C., Pesquet, J.-C., & Pustelnik, N. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080727749 · Cited by 92
Proximal Algorithms for Multicomponent Image Recovery Problems
Briceño-Arias, L. M., Combettes, P. L., Pesquet, J.-C., & Pustelnik, N. (2010) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-010-0243-1 · Cited by 66
Briceño-Arias, L. M., & Combettes, P. L. (2009) · Numerical Mathematics Theory Methods and Applications · doi:10.4208/nmtma.2009.m9009s · Cited by 38
Dupé, F.-X., Fadili, J. M., & Starck, J. (2011) · Statistical Methodology · doi:10.1016/j.stamet.2011.04.008 · Cited by 25
Self-citation
Cited by
Condat, L. (2013) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-012-0245-9 · Cited by 912
Graph Structure Learning for Robust Graph Neural Networks
Jin, W., Ma, Y., Liu, X., Tang, X., Wang, S., & Tang, J. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403049 · Cited by 644
An introduction to continuous optimization for imaging
Chambolle, A., & Pock, T. (2016) · Acta Numerica · doi:10.1017/s096249291600009x · Cited by 545
An Inertial Forward-Backward Algorithm for Monotone Inclusions
Lorenz, D. A., & Pock, T. (2015) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-014-0523-2 · Cited by 445
Karahanoğlu, F. I., & Van De Ville, D. (2015) · Nature Communications · doi:10.1038/ncomms8751 · Cited by 333
Metadata
- Authors
- Raguet, H., Fadili, J., & Peyré, G.
- Venue
- SIAM Journal on Imaging Sciences
- Published
- 2013-01
- Volume
- 6
- Issue
- 3
- Pages
- 1199-1226
- ISSN
- 1936-4954 (ISSN-L)
- OpenAlex
- W2030254567
- Cited by
- 352
- References
- 63
- FWCI
- 36.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.