Proximal Algorithms
The DOI matches its Crossref record; 180 of the 182 references it cites were found in a registry or an index.
Abstract
This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton’s method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton’s method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Here, we discuss the many different interpretations of proximal operators and algorithms, describe their connections to many other topics in optimization and applied mathematics, survey some popular algorithms, and provide a large number of examples of proximal operators that commonly arise in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Self-citationRegression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Self-citation(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Self-citationA method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Research works printed but not linked: 37
- Arrow, 1958, Studies in Linear and Nonlinear Programming
- Attouch, 1977, Convergence de fonctions convexes, de sous-différentiels et semi-groupes, C.R Acad. Sei. Paris, 284, 539
- Beck, 2010, Convex Optimization in Signal Processing and Communications, 42
- Bertsekas, 1999, Nonlinear Programming
- Bertsekas, 1989, Parallel and Distributed Computation: Numerical Methods
- Blackford, 1997, ScaLAPACK user’s guide, 10.1137/1.9780898719642 · DOI · Paper page
- Boyd, 2007, Localization and cutting-plane methods
- Candès, 2009, Robust principal component analysis?
- Chandrasekaran, 2009, Allerton 2009, 962
- Daniilidis, 2013, Orthogonal invariance and identifiability
- Demmel, 1993, Parallel numerical linear algebra, 10.1017/S096249290000235X · doi:10.1017/s096249290000235x
- Dempster, 1972, Covariance selection, Biometrics, 28, 157, 10.2307/2528966 · DOI · Paper page
- Duchi, 2008, Efficient projections onto the Q-ball for learning in high dimensions, 272
- Franklin, 1994, Feedback Control of Dynamic Systems, 10.1115/IMECE1994-0541 · doi:10.1115/imece1994-0541
- Gabay, 1983, Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems
- Goldfarb, 2011, Fast first-order methods for composite convex optimization with line search
- Granas, 2003, Fixed Point Theory, 10.1007/978-0-387-21593-8 · doi:10.1007/978-0-387-21593-8
- Lusem, 1999, Augmented Lagrangian methods and proximal point methods for convex optimization, Investigación Operativa, 8, 11
- Jenatton, 2010, Proximal methods for sparse hierarchical dictionary learning
- Kachurovskii, 1960, Monotone operators and convex functionals, Uspekhi Matematicheskikh Nauk, 15, 213
- Kim, 2009, ℓ1 trend filtering, SIAM Review, 51, 339, 10.1137/070690274 · DOI · Paper page
- Lemaire, 1989, The proximal algorithm, 73
- Ma, 2012, Alternating direction methods for latent variable gaussian graphical model selection
- Martinet, 1970, Régularisation d’inéquations variationnelles par approximations successives
- Martinet, 1972, Détermination approchée d’un point fixe d’une application pseudo-contractante, C.R. Acad. Sei. Paris, 274A, 163
- Nedic, 2010, Convex Optimization in Signal Processing and Communications
- Nesterov, 1983, A method of solving a convex programming problem with convergence rate O(1/k2), Soviet Mathematics Doklady, 27, 372
- Quattoni, 2009, An efficient projection for ℓ1,∞ regularization, 857
- Rockafellar, 1970, Convex Analysis, 10.1515/9781400873173 · DOI · Paper page
- Rockafellar, 1998, Variational Analysis, 10.1007/978-3-642-02431-3 · DOI · Paper page
- Tseng, 2008, On accelerated proximal gradient methods for convex-concave optimization
- Vandenberghe, 2010, Optimization methods for large-scale systems
- von Neumann, 1937, Some matrix inequalities and metrization of matrix space, Tomsk University Review, 1, 286
- von Neumann, Functional Operators, Volume 2: The Geometry of Orthogonal Spaces
- Yosida, 1968, Functional Analysis, 10.1007/978-3-662-11791-0 · doi:10.1007/978-3-662-11791-0
- Zarantonello, 1960, Solving functional equations by contractive averaging
- Zarantonello, 1971, Projections on convex sets in Hilbert space and spectral theory. I. Projections on convex sets, 237
Cited by
Items 201–300 of 1,007
scarlet: Source separation in multi-band images by Constrained Matrix Factorization
Melchior, P., Moolekamp, F., Jerdee, M., Armstrong, R., Sun, A.-L., Bosch, J., & Lupton, R. (2018) · Astronomy and Computing · doi:10.1016/j.ascom.2018.07.001 · Cited by 93
Robust Support Matrix Machine for Single Trial EEG Classification
Zheng, Q., Zhu, F., & Heng, P. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2794534 · Cited by 104
Causally Regularized Learning with Agnostic Data Selection Bias
Shen, Z., Cui, P., Kuang, K., Li, B., & Chen, P. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240577 · Cited by 119
Single Image Blind Deblurring Using Multi-Scale Latent Structure Prior
Bai, Y., Jia, H., Jiang, M. F., Liu, X., Xie, X., & Gao, W. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2919159 · Cited by 96
Large-Scale Low-Rank Matrix Learning with Nonconvex Regularizers
Yao, Q., Kwok, J. T.-Y., Wang, T., & Liu, T. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858249 · Cited by 105
On the convergence of the forward–backward splitting method with linesearches
Bello-Cruz, Y., & Nghia, T. T. A. (2016) · Optimization methods & software · doi:10.1080/10556788.2016.1214959 · Cited by 100
Fagot-Bouquet, L., Audigier, R., Dhome, Y., & Lerasle, F. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_47 · Cited by 94
Separable and Localized System-Level Synthesis for Large-Scale Systems
Wang, Y.-S., Matni, N., & Doyle, J. C. (2018) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2819246 · Cited by 120
Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
Attouch, H., Chbani, Z., & Riahi, H. (2017) · ESAIM Control Optimisation and Calculus of Variations · doi:10.1051/cocv/2017083 · Cited by 109
Near-Optimal Rapid MPC Using Neural Networks: A Primal-Dual Policy Learning Framework
Zhang, X., Bujarbaruah, M., & Borrelli, F. (2020) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2020.3024571 · Cited by 115
RMIST-Net: Joint Range Migration and Sparse Reconstruction Network for 3-D mmW Imaging
Wang, M., Wei, S., Liang, J., Zeng, X., Wang, C., Shi, J., & Zhang, X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3068405 · Cited by 90
Proximal-Gradient Algorithms for Tracking Cascades Over Social Networks
Baingana, B., Mateos, G., & Giannakis, G. B. (2014) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2014.2317284 · Cited by 103
Zhou, N., Xu, Y., Cheng, H., Fang, J., & Pedrycz, W. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.12.008 · Cited by 96
Accelerated quadratic proxy for geometric optimization
Kovalsky, S. Z., Galun, M., & Lipman, Y. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925920 · Cited by 92
Sparse Signal Approximation via Nonseparable Regularization
Selesnick, I., & Farshchian, M. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2669904 · Cited by 91
Dictionary Learning Over Distributed Models
Chen, J., Towfic, Z. J., & Sayed, A. H. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2385045 · Cited by 95
A Unified Successive Pseudoconvex Approximation Framework
Yang, Y., & Pesavento, M. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2684748 · Cited by 94
Analysis and Optimization of Loss Functions for Multiclass, Top-k, and Multilabel Classification
Lapin, M., Hein, M., & Schiele, B. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2751607 · Cited by 112
Customized Regression Model for Airbnb Dynamic Pricing
Peng, Y., Qian, J., Chen, J., Wu, C.-H., Zhou, Y., Mars, S. D., Yang, F., & Zhang, L. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219830 · Cited by 126
Dalsasso, E., Yang, X., Denis, L., Tupin, F., & Yang, W. (2020) · Remote Sensing · doi:10.3390/rs12162636 · Cited by 101
You Only Search Once: Single Shot Neural Architecture Search via Direct Sparse Optimization
Zhang, X., Huang, Z., Wang, N., Xiang, S., & Pan, C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3020300 · Cited by 107
A strong convergence result involving an inertial forward–backward algorithm for monotone inclusions
Dong, Q., Jiang, D. L., Cholamjiak, P., & Shehu, Y. (2017) · Journal of Fixed Point Theory and Applications · doi:10.1007/s11784-017-0472-7 · Cited by 101
numpywren: serverless linear algebraPreprint
Shankar, V., Krauth, K., Pu, Q., Jonas, E., Venkataraman, S., Stoica, I. G., Recht, B., & Ragan‐Kelley, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.09679 · Cited by 109
Daneshmand, H., Gomez-Rodriguez, M., Song, L., & Schölkopf, B. (2014) · PubMed · doi:10.48550/arxiv.1405.2936 · Cited by 86
Parallel and Distributed Successive Convex Approximation Methods for Big-Data Optimization
Scutari, G., & Sun, Y. (2018) · Lecture notes in mathematics · doi:10.1007/978-3-319-97142-1_3 · Cited by 121
A Novel Cooperative NOMA for Designing UAV-Assisted Wireless Backhaul Networks
Nguyen, T. M., Ajib, W., & Assi, C. M. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2874136 · Cited by 88
Graph Moving Object Segmentation
Giraldo, J. H., Javed, S., & Bouwmans, T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3042093 · Cited by 101
ADMM Projective Dynamics: Fast Simulation of Hyperelastic Models with Dynamic Constraints
Overby, M., Brown, G. E., Li, J., & Narain, R. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2730875 · Cited by 85
Parsimonious trajectory design of connected automated traffic
Li, L., & Li, X. S. (2018) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2018.11.006 · Cited by 87
Bauschke, H. H., & Koch, V. (2015) · Contemporary mathematics - American Mathematical Society · doi:10.1090/conm/636/12726 · Cited by 85
Deep neural networks are robust to weight binarization and other non-linear distortions
Merolla, P. A., Appuswamy, R., Arthur, J. V., Esser, S. K., & Modha, D. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01981 · Cited by 74
From capture to simulation: connecting forward and inverse problems in fluids
Gregson, J., Ihrke, I., Thuerey, N., & Heidrich, W. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601147 · Cited by 103
A Class of Randomized Primal-Dual Algorithms for Distributed OptimizationPreprint
Pesquet, J.-C., & Repetti, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6404 · Cited by 93
Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
Attouch, H., & Cabot, A. (2017) · Journal of Differential Equations · doi:10.1016/j.jde.2017.06.024 · Cited by 92
Graph Signal Processing for Geometric Data and Beyond: Theory and Applications
Hu, W., Pang, J., Liu, X., Tian, D., Lin, C., & Vetro, A. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3111440 · Cited by 98
Narayana, P., Jatoth, C., & Parvataneni, P. (2021) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6163 · Cited by 88
Neural architecture search: A contemporary literature review for computer vision applications
Poyser, M., & Breckon, T. P. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110052 · Cited by 105
Continual Learning with Node-Importance based Adaptive Group Sparse RegularizationPreprint
Jung, S., Ahn, H., Cha, S., & Moon, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13726 · Cited by 186
Distributed Saddle-Point Subgradient Algorithms With Laplacian Averaging
Mateos‐Núñez, D., & Cortés, J. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2616646 · Cited by 82
Statistical estimation and testing via the sorted L1 normPreprint
Bogdan, M., van den Berg, E., Su, W., & Candès, E. J. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.1969 · Cited by 118
Beampattern Synthesis With Sidelobe Control and Applications
Gemechu, A. Y., Cui, G., Yu, X., & Kong, L. (2019) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2019.2938730 · Cited by 80
A primal dual active set with continuation algorithm for the ℓ 0 -regularized optimization problem
Jiao, Y., Jin, B., & Lu, X. (2014) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2014.10.001 · Cited by 80
Fast Partitioning of Vector-Valued Images
Storath, M., & Weinmann, A. (2014) · SIAM Journal on Imaging Sciences · doi:10.1137/130950367 · Cited by 89
Asynchronous Distributed Optimization Via Randomized Dual Proximal Gradient
Notarnicola, I., & Notarstefano, G. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2607023 · Cited by 82
Rainbow particle imaging velocimetry for dense 3D fluid velocity imaging
Xiong, J., Idoughi, R., Aguirre‐Pablo, A. A., Aljedaani, A. B., Dun, X., Fu, Q., Thoroddsen, S. T., & Heidrich, W. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073662 · Cited by 90
Computationally efficient deep neural network for computed tomography image reconstruction
Wu, D., Kim, K., & Li, Q. (2019) · Medical Physics · doi:10.1002/mp.13627 · Cited by 95
Sahu, D. R., Yao, J., Verma, M., & Shukla, K. K. (2020) · Optimization · doi:10.1080/02331934.2019.1702040 · Cited by 80
Convergence of a Relaxed Inertial Forward–Backward Algorithm for Structured Monotone Inclusions
Attouch, H., & Cabot, A. (2019) · Applied Mathematics & Optimization · doi:10.1007/s00245-019-09584-z · Cited by 85
Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging ProblemsPreprint
Wei, K., Avilés-Rivero, A. I., Liang, J., Fu, Y., Schönlieb, C., & Huang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09611 · Cited by 125
Huang, Y., Schell, C., Huber, T. B., Şimşek, A. N., Hersch, N., Merkel, R., Gompper, G., & Sabass, B. (2019) · Scientific Reports · doi:10.1038/s41598-018-36896-x · Cited by 93
Agrawal, A., Ali, A., & Boyd, S. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000090 · Cited by 74
Self-citationModular proximal optimization for multidimensional total-variation regularizationPreprint
Barbero, Á., & Sra, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.0589 · Cited by 105
High-dimensional generalizations of asymmetric least squares regression and their applications
Gu, Y., & Zou, H. (2016) · The Annals of Statistics · doi:10.1214/15-aos1431 · Cited by 77
Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction
Pan, J., Yu, H., Gao, Z., Wang, S., Zhang, H., & Wu, W. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3351382 · Cited by 81
A Fast Algorithm for Convolutional Structured Low-Rank Matrix Recovery
Ongie, G., & Jacob, M. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2017.2721819 · Cited by 93
ProxQuant: Quantized Neural Networks via Proximal Operators
Bai, Y., Wang, Y.-X., & Liberty, E. (2018) · arXiv · doi:10.48550/arxiv.1810.00861 · Cited by 76
Improving the efficiency of deconvolution algorithms for sound source localization
Lylloff, O., Fernández-Grande, E., Agerkvist, F. T., Hald, J., Roig, E. T., & Andersen, M. S. (2015) · The Journal of the Acoustical Society of America · doi:10.1121/1.4922516 · Cited by 77
Grayscale-Thermal Object Tracking via Multitask Laplacian Sparse Representation
Li, C., Sun, X., Wang, X., Zhang, L., & Tang, J. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2627052 · Cited by 76
Accelerated Schemes for the $L_1/L_2$ Minimization
Wang, C., Yan, M., Rahimi, Y., & Lou, Y. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2985298 · Cited by 96
Diagonal scaling in Douglas-Rachford splitting and ADMM
Giselsson, P., & Boyd, S. (2014) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2014.7040175 · Cited by 103
Self-citationTrust-PCL: An Off-Policy Trust Region Method for Continuous ControlPreprint
Nachum, O., Norouzi, M., Xu, K., & Schuurmans, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01891 · Cited by 100
A Regularized Framework for Sparse and Structured Neural Attention
Niculae, V., & Blondel, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07704 · Cited by 71
Sparsity and locally low rank regularization for MR fingerprinting
da Cruz, G. J. L., Bustin, A., Jaubert, O., Schneider, T., Botnar, R. M., & Prieto, C. (2019) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27665 · Cited by 80
Low-rank tensor completion via smooth matrix factorization
Zheng, Y., Huang, T., Ji, T.-Y., Zhao, X.-L., Jiang, T.-X., & Ma, T.-H. (2019) · Applied Mathematical Modelling · doi:10.1016/j.apm.2019.02.001 · Cited by 74
Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics
Attouch, H., Chbani, Z., & Riahi, H. (2019) · SIAM Journal on Optimization · doi:10.1137/18m1230207 · Cited by 78
Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection
Kieu, T., Yang, B., Guo, C., Jensen, C. S., Zhao, Y. L., Huang, F., & Zheng, K. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00273 · Cited by 99
Sharp MSE Bounds for Proximal Denoising
Oymak, S., & Hassibi, B. (2015) · Foundations of Computational Mathematics · doi:10.1007/s10208-015-9278-4 · Cited by 92
A Computational Framework for Multivariate Convex Regression and Its Variants
Mazumder, R., Choudhury, A., Iyengar, G., & Sen, B. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1407771 · Cited by 74
Zhang, S., & Xin, J. X. (2017) · Communications in Mathematical Sciences · doi:10.4310/cms.2017.v15.n2.a9 · Cited by 88
Joint Maximum Likelihood Estimation for High-Dimensional Exploratory Item Factor Analysis
Chen, Y., Li, X., & Zhang, S. (2018) · Psychometrika · doi:10.1007/s11336-018-9646-5 · Cited by 122
GAN Slimming: All-in-One GAN Compression by a Unified Optimization Framework
Wang, H., Gui, S., Yang, H., Liu, J., & Wang, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_4 · Cited by 90
Core Imaging Library - Part I: a versatile Python framework for tomographic imaging
Jørgensen, J. S., Серверовна, А. Э., Burca, G., Fardell, G., Papoutsellis, E., Pasca, E., Thielemans, K., Turner, M., Warr, R., Lionheart, W. R. B., et al. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0192 · Cited by 109
Fan, W., Liang, J., Lu, G., Fan, X., & So, H. C. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3052997 · Cited by 73
Lin, C.-H., Lin, Y.-C., & Tang, P.-W. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3111007 · Cited by 77
Energy Management in Prosumer Communities: A Coordinated Approach
Verschae, R., Kato, T., & Matsuyama, T. (2016) · Energies · doi:10.3390/en9070562 · Cited by 76
Low-Rank and Adaptive Sparse Signal (LASSI) Models for Highly Accelerated Dynamic Imaging
Ravishankar, S., Moore, B. E., Nadakuditi, R. R., & Fessler, J. A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2650960 · Cited by 76
Wang, M., Huang, J., Liu, M., & Zhang, D. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102063 · Cited by 76
Sparsity and Adaptivity for the Blind Separation of Partially Correlated Sources
Bobin, J., Rapin, J., Larue, A., & Starck, J. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2391071 · Cited by 72
Exact Worst-Case Convergence Rates of the Proximal Gradient Method for Composite Convex Minimization
Taylor, A., Hendrickx, J. M., & Glineur, F. (2018) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-018-1298-1 · Cited by 80
Highly undersampled magnetic resonance imaging reconstruction using autoencoding priors
Liu, Q., Yang, Q., Cheng, H., Wang, S., Zhang, M., & Liang, D. (2019) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27921 · Cited by 77
Block Coordinate Regularization by Denoising
Sun, Y., Liu, J., & Kamilov, U. S. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2996385 · Cited by 83
Interdependent Strategic Security Risk Management With Bounded Rationality in the Internet of Things
Chen, J., & Zhu, Q. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2911112 · Cited by 75
Robust Visual Tracking Revisited: From Correlation Filter to Template Matching
Liu, F., Gong, C., Huang, X., Zhou, T., Yang, J., & Tao, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2813161 · Cited by 72
Chen, G., Hong, X., Ding, Q., Zhang, Y., Chen, H., Fu, S., Zhao, Y., Zhang, X., Ji, H., Wang, G., et al. (2020) · Medical Physics · doi:10.1002/mp.14170 · Cited by 74
Deep Learning-Based Reconstruction for Cardiac MRI: A Review
Oscanoa, J., Middione, M. J., Alkan, C., Yurt, M., Loecher, M., Vasanawala, S. S., & Ennis, D. B. (2023) · Bioengineering · doi:10.3390/bioengineering10030334 · Cited by 87
Asynchronous Optimization Over Heterogeneous Networks Via Consensus ADMM
Kumar, S., Jain, R., & Rajawat, K. (2016) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2016.2593896 · Cited by 78
DOA Estimation in Impulsive Noise via Low-Rank Matrix Approximation and Weakly Convex Optimization
Liu, Q., Gu, Y., & So, H. C. (2019) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2019.2909728 · Cited by 72
Frostig, R., Ge, R., Kakade, S. M., & Sidford, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.07512 · Cited by 70
Network Lasso: Clustering and Optimization in Large Graphs
Hallac, D., Leskovec, J., & Boyd, S. (2015) · PubMed · doi:10.48550/arxiv.1507.00280 · Cited by 72
Self-citationLagrangian Duality for Constrained Deep Learning
Fioretto, F., Hentenryck, P. V., Mak, T. W. K., Tran, C., Baldo, F., & Lombardi, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67670-4_8 · Cited by 128
Operator Splitting for a Homogeneous Embedding of the Linear Complementarity Problem
O’Donoghue, B. (2021) · SIAM Journal on Optimization · doi:10.1137/20m1366307 · Cited by 88
The Lasso with general Gaussian designs with applications to hypothesis testing
Celentano, M., Andrea Montanari, A., & Wei, Y. (2023) · The Annals of Statistics · doi:10.1214/23-aos2327 · Cited by 129
Stable low-rank matrix recovery via null space properties
Kabanava, M., Kueng, R., Rauhut, H., & Terstiege, U. (2016) · Information and Inference A Journal of the IMA · doi:10.1093/imaiai/iaw014 · Cited by 69
Estimating Treatment Effect in the Wild via Differentiated Confounder Balancing
Kuang, K., Cui, P., Li, B., Jiang, M., & Yang, S. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098032 · Cited by 71
Latent Complete Row Space Recovery for Multi-View Subspace Clustering
Tao, H., Hou, C., Qian, Y., Zhu, J., & Yi, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3010631 · Cited by 70
Proximal Deep Structured Models
Wang, S., Fidler, S., & Urtasun, R. (2016) · neural information processing systems · Cited by 112
Kougioumtzoglou, I. A., Petromichelakis, I., & Psaros, A. F. (2020) · Probabilistic Engineering Mechanics · doi:10.1016/j.probengmech.2020.103082 · Cited by 75
Logarithmic Norm Regularized Low-Rank Factorization for Matrix and Tensor Completion
Chen, L., Jiang, X., Liu, X.-Z., & Zhou, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3061908 · Cited by 63
Zhang, Y., Jia, J., Chen, X., Chen, A., Zhang, Y., Liu, S., Ding, K., & Liu, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72998-0_22 · Cited by 270
Maximum-a-Posteriori Estimation with Bayesian Confidence Regions
Pereyra, M. (2017) · SIAM Journal on Imaging Sciences · doi:10.1137/16m1071249 · Cited by 80
Metadata
- Authors
- Parikh, N., & Boyd, S.
- Affiliations
- Stanford University (US)
- Venue
- Foundations and Trends® in Optimization
- Publisher
- Emerald
- Published
- 2014-01-13
- Volume
- 1
- Issue
- 3
- Pages
- 127-239
- ISSN
- 2167-3888 (ISSN-L)
- 2167-3918
- OpenAlex
- W2913535645
- Cited by
- 4,102
- References
- 182
- Citations by year
- 2026: 204 · 2025: 310 · 2024: 331 · 2023: 321 · 2022: 312 · 2021: 432 · 2020: 443 · 2019: 460 · 2018: 407 · 2017: 315 · 2016: 278 · 2015: 189 · 2014: 85
- FWCI
- 299.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Optimization (publishedVersion)
- now publishers, Inc. eBooks (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Keywords
- proximal operator, proximal algorithms, convex optimization, distributed optimization, nonsmooth optimization, large-scale optimization, high-dimensional data, projection onto convex sets, iterative optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.