Proximal Algorithms
The DOI matches its Crossref record; 180 of the 182 references it cites were found in a registry or an index.
Abstract
This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton’s method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton’s method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Here, we discuss the many different interpretations of proximal operators and algorithms, describe their connections to many other topics in optimization and applied mathematics, survey some popular algorithms, and provide a large number of examples of proximal operators that commonly arise in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Self-citationRegression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Self-citation(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Self-citationA method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Research works printed but not linked: 37
- Arrow, 1958, Studies in Linear and Nonlinear Programming
- Attouch, 1977, Convergence de fonctions convexes, de sous-différentiels et semi-groupes, C.R Acad. Sei. Paris, 284, 539
- Beck, 2010, Convex Optimization in Signal Processing and Communications, 42
- Bertsekas, 1999, Nonlinear Programming
- Bertsekas, 1989, Parallel and Distributed Computation: Numerical Methods
- Blackford, 1997, ScaLAPACK user’s guide, 10.1137/1.9780898719642 · DOI · Paper page
- Boyd, 2007, Localization and cutting-plane methods
- Candès, 2009, Robust principal component analysis?
- Chandrasekaran, 2009, Allerton 2009, 962
- Daniilidis, 2013, Orthogonal invariance and identifiability
- Demmel, 1993, Parallel numerical linear algebra, 10.1017/S096249290000235X · doi:10.1017/s096249290000235x
- Dempster, 1972, Covariance selection, Biometrics, 28, 157, 10.2307/2528966 · DOI · Paper page
- Duchi, 2008, Efficient projections onto the Q-ball for learning in high dimensions, 272
- Franklin, 1994, Feedback Control of Dynamic Systems, 10.1115/IMECE1994-0541 · doi:10.1115/imece1994-0541
- Gabay, 1983, Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems
- Goldfarb, 2011, Fast first-order methods for composite convex optimization with line search
- Granas, 2003, Fixed Point Theory, 10.1007/978-0-387-21593-8 · doi:10.1007/978-0-387-21593-8
- Lusem, 1999, Augmented Lagrangian methods and proximal point methods for convex optimization, Investigación Operativa, 8, 11
- Jenatton, 2010, Proximal methods for sparse hierarchical dictionary learning
- Kachurovskii, 1960, Monotone operators and convex functionals, Uspekhi Matematicheskikh Nauk, 15, 213
- Kim, 2009, ℓ1 trend filtering, SIAM Review, 51, 339, 10.1137/070690274 · DOI · Paper page
- Lemaire, 1989, The proximal algorithm, 73
- Ma, 2012, Alternating direction methods for latent variable gaussian graphical model selection
- Martinet, 1970, Régularisation d’inéquations variationnelles par approximations successives
- Martinet, 1972, Détermination approchée d’un point fixe d’une application pseudo-contractante, C.R. Acad. Sei. Paris, 274A, 163
- Nedic, 2010, Convex Optimization in Signal Processing and Communications
- Nesterov, 1983, A method of solving a convex programming problem with convergence rate O(1/k2), Soviet Mathematics Doklady, 27, 372
- Quattoni, 2009, An efficient projection for ℓ1,∞ regularization, 857
- Rockafellar, 1970, Convex Analysis, 10.1515/9781400873173 · DOI · Paper page
- Rockafellar, 1998, Variational Analysis, 10.1007/978-3-642-02431-3 · DOI · Paper page
- Tseng, 2008, On accelerated proximal gradient methods for convex-concave optimization
- Vandenberghe, 2010, Optimization methods for large-scale systems
- von Neumann, 1937, Some matrix inequalities and metrization of matrix space, Tomsk University Review, 1, 286
- von Neumann, Functional Operators, Volume 2: The Geometry of Orthogonal Spaces
- Yosida, 1968, Functional Analysis, 10.1007/978-3-662-11791-0 · doi:10.1007/978-3-662-11791-0
- Zarantonello, 1960, Solving functional equations by contractive averaging
- Zarantonello, 1971, Projections on convex sets in Hilbert space and spectral theory. I. Projections on convex sets, 237
Cited by
Items 101–200 of 1,007
Deep Equilibrium Architectures for Inverse Problems in Imaging
Gilton, D., Ongie, G., & Willett, R. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3118944 · Cited by 163
Partially functional linear regression in high dimensions
Kong, D., Xue, K., Yao, F., & Zhang, H. H. (2016) · Biometrika · doi:10.1093/biomet/asv062 · Cited by 171
Stochastic Primal-Dual Hybrid Gradient Algorithm with Arbitrary Sampling and Imaging Applications
Chambolle, A., Ehrhardt, M. J., Richtárik, P., & Schönlieb, C.-B. (2018) · SIAM Journal on Optimization · doi:10.1137/17m1134834 · Cited by 170
Optimal Construction of Koopman Eigenfunctions for Prediction and Control
Korda, M., & Mezic, I. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.2978039 · Cited by 164
Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning
Hussein, S., Cao, K., Song, Q., & Bagci, U. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_20 · Cited by 161
Multimodal Task-Driven Dictionary Learning for Image Classification
Bahrampour, S., Nasrabadi, N. M., Ray, A., & Jenkins, W. K. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2496275 · Cited by 177
Mokhtari, A., Ozdaglar, A., & Pattathil, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08511 · Cited by 330
Global Structure-from-Motion by Similarity Averaging
Cui, Z., & Tan, P. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.105 · Cited by 160
Accelerating cardiac cine MRI using a deep learning‐based ESPIRiT reconstruction
Sandino, C. M., Lai, P., Vasanawala, S. S., & Cheng, J. Y. (2021) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28420 · Cited by 161
Learning Heat Diffusion Graphs
Thanou, D., Dong, X., Kressner, D., & Frossard, P. (2017) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2017.2731164 · Cited by 159
Sparse Principal Component Analysis via Variable Projection
Erichson, N. B., Zheng, P., Manohar, K., Brunton, S. L., Kutz, J. N., & Aravkin, A. Y. (2020) · SIAM Journal on Applied Mathematics · doi:10.1137/18m1211350 · Cited by 182
Solving 3D Inverse Problems Using Pre-Trained 2D Diffusion Models
Chung, H., Ryu, D., McCann, M. T., Klasky, M., & Ye, J. C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02159 · Cited by 274
A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights
Su, W., Boyd, S., & Candès, E. J. (2014) · neural information processing systems · Cited by 155
Self-citationPhysics-Based Learned Design: Optimized Coded-Illumination for Quantitative Phase Imaging
Kellman, M. R., Bostan, E., Repina, N. A., & Waller, L. (2019) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2019.2905434 · Cited by 158
How a well-adapted immune system is organized
Mayer, A., Balasubramanian, V., Mora, T., & Walczak, A. M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1421827112 · Cited by 155
A Survey of Recent Advances in Optimization Methods for Wireless Communications
Liu, Y., Chang, T., Hong, M., Wu, Z., So, A. M., Jorswieck, E. A., & Yu, W. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3443759 · Cited by 225
Multi-image Matching via Fast Alternating Minimization
Zhou, X., Zhu, M., & Daniilidis, K. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.459 · Cited by 171
Proximal Markov chain Monte Carlo algorithms
Pereyra, M. (2015) · Statistics and Computing · doi:10.1007/s11222-015-9567-4 · Cited by 229
Proximal Algorithms in Statistics and Machine Learning
Polson, N. G., Scott, J. G., & Willard, B. T. (2015) · Statistical Science · doi:10.1214/15-sts530 · Cited by 204
Algorithms for Leader Selection in Stochastically Forced Consensus Networks
Lin, F., Fardad, M., & Jovanovic, M. R. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2314223 · Cited by 156
Online Optimization as a Feedback Controller: Stability and Tracking
Colombino, M., Dall’Anese, E., & Bernstein, A. (2019) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2019.2906916 · Cited by 149
A Survey on Large-Scale Machine Learning
Wang, M., Fu, W., He, X., Hao, S., & Wu, X. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3015777 · Cited by 215
Deep plug-and-play priors for spectral snapshot compressive imaging
Zheng, S., Liu, Y., Meng, Z., Qiao, M., Tong, Z., Yang, X., Han, S., & Yuan, X. (2020) · Photonics Research · doi:10.1364/prj.411745 · Cited by 171
Efficient and Modular Implicit Differentiation
Blondel, M., Berthet, Q., Cuturi, M., Frostig, R., Hoyer, S., Llinares-López, F., Pedregosa, F., & Vert, J. (2022) · neural information processing systems · doi:10.52202/068431-0378 · Cited by 534
Nonsmooth Analysis and OptimizationPreprint
Clason, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.04180 · Cited by 155
Communication-Efficient Accurate Statistical Estimation
Fan, J., Guo, Y., & Wang, K. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2021.1969238 · Cited by 197
Simple Algorithms for Optimization on Riemannian Manifolds with Constraints
Liu, C., & Boumal, N. (2019) · Applied Mathematics & Optimization · doi:10.1007/s00245-019-09564-3 · Cited by 142
Sparse Representation for 3D Shape Estimation: A Convex Relaxation Approach
Zhou, X., Zhu, M., Leonardos, S., & Daniilidis, K. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2605097 · Cited by 144
Encrypted Control for Networked Systems: An Illustrative Introduction and Current Challenges
Darup, M. S., Alexandru, A. B., Quevedo, D. E., & Pappas, G. J. (2021) · IEEE Control Systems · doi:10.1109/mcs.2021.3062956 · Cited by 185
Small Networks Encode Decision-Making in Primary Auditory Cortex
Francis, N. A., Winkowski, D. E., Sheikhattar, A., Armengol, K., Babadi, B., & Kanold, P. O. (2018) · Neuron · doi:10.1016/j.neuron.2018.01.019 · Cited by 147
A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization
Chang, T. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2544743 · Cited by 156
The Proximal Augmented Lagrangian Method for Nonsmooth Composite Optimization
Dhingra, N. K., Khong, S. Z., & Jovanovic, M. R. (2018) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2867589 · Cited by 149
Chen, Q., Wang, L., Wu, Y., Wu, G., Guo, Z., & Waslander, S. L. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.11.011 · Cited by 150
RetractedSmoothed quantile regression with large-scale inference
He, X., Pan, X., Tan, K. M., & Zhou, W. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.07.010 · Cited by 149
Voltage Regulation Algorithms for Multiphase Power Distribution Grids
Kekatos, V., Zhang, L., Giannakis, G. B., & Baldick, R. (2015) · IEEE Power Engineering Society General Meeting · doi:10.1109/pesgm.2016.7741390 · Cited by 139
Maximal Sparsity with Deep Networks?Preprint
Xin, B., Wang, Y., Gao, W., & Wipf, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01636 · Cited by 139
Rigie, D. S., & Rivière, P. J. L. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/5/1741 · Cited by 162
On the Graph Fourier Transform for Directed Graphs
Sardellitti, S., Barbarossa, S., & Lorenzo, P. D. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2726979 · Cited by 161
Learning Deep Gradient Descent Optimization for Image Deconvolution
Gong, D., Zhang, Z., Shi, Q., van den Hengel, A., Shen, C., & Zhang, Y. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2968289 · Cited by 148
ADMM for High-Dimensional Sparse Penalized Quantile Regression
Gu, Y., Fan, J., Kong, L., Ma, S., & Zou, H. (2017) · Technometrics · doi:10.1080/00401706.2017.1345703 · Cited by 156
Blind Universal Bayesian Image Denoising With Gaussian Noise Level Learning
Helou, M. E., & Susstrunk, S. E. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2976814 · Cited by 156
Simultaneously Sparse and Low-Rank Abundance Matrix Estimation for Hyperspectral Image Unmixing
Giampouras, P. V., Themelis, K. E., Rontogiannis, A. A., & Koutroumbas, K. D. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2551327 · Cited by 134
Convolutional Dictionary Learning: Acceleration and Convergence
Chun, I. Y., & Fessler, J. A. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2761545 · Cited by 132
Learning to Optimize: A Primer and A BenchmarkPreprint
Chen, T., Chen, X., Chen, W., Heaton, H., Liu, J., Wang, Z., & Yin, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.12828 · Cited by 199
3D shape estimation from 2D landmarks: A convex relaxation approach
Zhou, X., Leonardos, S., Hu, X., & Daniilidis, K. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299074 · Cited by 139
Content-Aware Scalable Deep Compressed Sensing
Chen, B., & Zhang, J. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3195319 · Cited by 147
Latafat, P., & Patrinos, P. (2017) · Computational Optimization and Applications · doi:10.1007/s10589-017-9909-6 · Cited by 149
Do, C. T., Tran, N. H., Pham, C., Alam, M. G. R., Son, J. H., & Hong, C. S. (2015) · 2015 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2015.7057905 · Cited by 122
Nonlocal Tensor-Ring Decomposition for Hyperspectral Image Denoising
Chen, Y., He, W. P., Yokoya, N., Huang, T., & Zhao, X.-L. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2946050 · Cited by 123
Distributed Optimization in Distribution Systems: Use Cases, Limitations, and Research Needs
Patari, N., Venkataramanan, V., Srivastava, A. K., Molzahn, D. K., Li, N., & Annaswamy, A. M. (2021) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2021.3132348 · Cited by 151
Blind Universal Bayesian Image Denoising with Gaussian Noise Level Learning
Helou, M. E., & Susstrunk, S. E. (2019) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 122
Chordal Graphs and Semidefinite Optimization
Vandenberghe, L., & Andersen, M. S. (2015) · now publishers, Inc. eBooks · doi:10.1561/9781680830392 · Cited by 119
Linearized ADMM for Nonconvex Nonsmooth Optimization With Convergence Analysis
Liu, Q., Shen, X., & Gu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2914461 · Cited by 153
Gao, Y., & Cao, L. (2023) · Light Advanced Manufacturing · doi:10.37188/lam.2023.006 · Cited by 122
Regularization by Denoising via Fixed-Point Projection (RED-PRO)
Cohen, R., Elad, M., & Milanfar, P. (2021) · SIAM Journal on Imaging Sciences · doi:10.1137/20m1337168 · Cited by 168
Large-Scale Convex Optimization for Dense Wireless Cooperative Networks
Shi, Y., Zhang, J., O'Donoghue, B., & Letaief, K. B. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2443731 · Cited by 118
Solving (most) of a set of quadratic equalities: composite optimization for robust phase retrieval
Duchi, J. C., & Ruan, F. (2018) · Information and Inference A Journal of the IMA · doi:10.1093/imaiai/iay015 · Cited by 117
Globally Convergent Type-I Anderson Acceleration for Nonsmooth Fixed-Point Iterations
Zhang, J., O’Donoghue, B., & Boyd, S. (2020) · SIAM Journal on Optimization · doi:10.1137/18m1232772 · Cited by 194
Self-citationSur, P., Chen, Y., & Candès, E. J. (2019) · Probability Theory and Related Fields · doi:10.1007/s00440-018-00896-9 · Cited by 128
Qian, J., Tanigawa, Y., Du, W., Aguirre, M., Chang, C. C., Tibshirani, R. J., Rivas, M. A., & Hastie, T. J. (2020) · PLoS Genetics · doi:10.1371/journal.pgen.1009141 · Cited by 144
Practical Detection of Trojan Neural Networks: Data-Limited and Data-Free Cases
Wang, R., Zhang, G., Liu, S., Chen, P., Xiong, J., & Wang, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_14 · Cited by 167
Majumdar, A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2838679 · Cited by 129
Transformed ℓ1 regularization for learning sparse deep neural networks
Ma, R., Miao, J., Niu, L., & Zhang, P. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.08.015 · Cited by 150
FedSplit: An algorithmic framework for fast federated optimization
Pathak, R., & Wainwright, M. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05238 · Cited by 86
Sub-picosecond photon-efficient 3D imaging using single-photon sensors
Heide, F., Diamond, S., Lindell, D. B., & Wetzstein, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-35212-x · Cited by 128
Feature Graph Learning for 3D Point Cloud Denoising
Hu, W., Gao, X., Cheung, G., & Guo, Z. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2978617 · Cited by 131
Anomaly Detection in Images With Smooth Background via Smooth-Sparse Decomposition
Yan, H., Paynabar, K., & Shi, J. (2017) · Technometrics · doi:10.1080/00401706.2015.1102764 · Cited by 111
Homogeneous codes for energy-efficient illumination and imaging
O’Toole, M., Achar, S., Narasimhan, S. G., & Kutulakos, K. N. (2015) · ACM Transactions on Graphics · doi:10.1145/2766897 · Cited by 111
Proximal stochastic methods for nonsmooth nonconvex finite-sum optimization
Reddi, S. J., Sra, S., Póczos, B., & Smola, A. J. (2016) · neural information processing systems · Cited by 111
SLOPE is adaptive to unknown sparsity and asymptotically minimax
Su, W., & Candès, E. J. (2016) · The Annals of Statistics · doi:10.1214/15-aos1397 · Cited by 162
Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists
Condat, L., Kitahara, D., Contreras, A., & Hirabayashi, A. (2023) · SIAM Review · doi:10.1137/20m1379344 · Cited by 211
Block splitting for distributed optimization
Parikh, N., & Boyd, S. (2013) · Mathematical Programming Computation · doi:10.1007/s12532-013-0061-8 · Cited by 132
Self-citationAsymptotic and finite-sample properties of estimators based on stochastic gradients
Toulis, P., & Airoldi, E. M. (2017) · The Annals of Statistics · doi:10.1214/16-aos1506 · Cited by 187
Physics-Inspired Compressive Sensing: Beyond deep unrolling
Zhang, J., Chen, B., Xiong, R., & Zhang, Y. (2023) · IEEE Signal Processing Magazine · doi:10.1109/msp.2022.3208394 · Cited by 127
A general system for heuristic minimization of convex functions over non-convex sets
Diamond, S., Takapoui, R., & Boyd, S. (2017) · Optimization methods & software · doi:10.1080/10556788.2017.1304548 · Cited by 138
Self-citationLearning to Push the Limits of Efficient FFT-Based Image Deconvolution
Kruse, J., Rother, C., & Schmidt, U. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.491 · Cited by 114
Wen, B., Chen, X., & Pong, T. K. (2017) · SIAM Journal on Optimization · doi:10.1137/16m1055323 · Cited by 115
Gleich, D. F., Lim, L., & Yu, Y. (2015) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/140985160 · Cited by 116
Point Cloud Denoising via Feature Graph Laplacian Regularization
Dinesh, C., Cheung, G., & Bajić, I. V. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2969052 · Cited by 124
Driver Anomaly Detection: A Dataset and Contrastive Learning Approach
Kopuklu, O., Zheng, J., Xu, H., & Rigoll, G. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00014 · Cited by 100
Catalyst Acceleration for First-order Convex Optimization: from Theory to PracticePreprint
Lin, H., Mairal, J., & Harchaoui, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05654 · Cited by 111
Interference Nulling Using Reconfigurable Intelligent Surface
Jiang, T., & Yu, W. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3143220 · Cited by 109
Poudel, J., Lou, Y., & Anastasio, M. A. (2019) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab2017 · Cited by 109
Efficient Neural Architecture Search via Proximal Iterations
Yao, Q., Xu, J., Tu, W.-W., & Zhu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6143 · Cited by 122
Epigraphical projection and proximal tools for solving constrained convex optimization problems
Chierchia, G., Pustelnik, N., Pesquet, J.-C., & Pesquet‐Popescu, B. (2014) · Signal Image and Video Processing · doi:10.1007/s11760-014-0664-1 · Cited by 117
Rigie, D., & Rivière, P. J. L. (2014) · Cited by 104
Automated reference-free detection of motion artifacts in magnetic resonance images
Küstner, T., Liebgott, A., Mauch, L., Martirosian, P., Bamberg, F., Nikolaou, K., Yang, B., Schick, F., & Gatidis, S. (2018) · Magnetic Resonance Materials in Physics Biology and Medicine · doi:10.1007/s10334-017-0650-z · Cited by 102
LRSLibrary: Low-Rank and Sparse Tools for Background Modeling and Subtraction in Videos
Sobral, A. C., Bouwmans, T., & Zahzah, E.-H. (2016) · CRC Press eBooks · doi:10.1201/b20190-24 · Cited by 102
Chen, Y., Chi, Y., Fan, J., Ma, C., & Yan, Y. (2020) · SIAM Journal on Optimization · doi:10.1137/19m1290000 · Cited by 194
A Convex Approach for Image Restoration with Exact Poisson--Gaussian Likelihood
Chouzenoux, É., Jezierska, A., Pesquet, J.-C., & Talbot, H. (2015) · SIAM Journal on Imaging Sciences · doi:10.1137/15m1014395 · Cited by 108
Exact Worst-Case Performance of First-Order Methods for Composite Convex Optimization
Taylor, A., Hendrickx, J. M., & Glineur, F. (2017) · SIAM Journal on Optimization · doi:10.1137/16m108104x · Cited by 130
LassoNet: A Neural Network with Feature SparsityPreprint
Lemhadri, I., Ruan, F., Abraham, L., & Tibshirani, R. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.12207 · Cited by 113
Convolutional Sparse Coding for High Dynamic Range Imaging
Serrano, A., Heide, F., Gutiérrez, D., Wetzstein, G., & Masiá, B. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12819 · Cited by 100
Robust Volume Minimization-Based Matrix Factorization for Remote Sensing and Document Clustering
Fu, X., Huang, K., Yang, B., Ma, W., & Sidiropoulos, N. D. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2602800 · Cited by 105
1-bit Massive MU-MIMO Precoding in VLSI
Castañeda, O., Jacobsson, S., Durisi, G., Coldrey, M., Goldstein, T., & Studer, C. (2017) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2017.2772191 · Cited by 102
Noise-Tolerant Wireless Sensor Networks Localization via Multinorms Regularized Matrix Completion
Xiao, F., Liu, W., Li, Z., Chen, L., & Wang, R. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2771805 · Cited by 100
A Fast Proximal Point Method for Computing Exact Wasserstein DistancePreprint
Xie, Y., Wang, X., Wang, R., & Hongyuan Zha, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04307 · Cited by 99
Haeffele, B. D., Young, E. D., & Vidal, R. (2014) · Cited by 128
Room Impulse Response Interpolation Using a Sparse Spatio-Temporal Representation of the Sound Field
Antonello, N., Sena, E. D., Moonen, M., Naylor, P. A., & van Waterschoot, T. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2730284 · Cited by 98
Scalable Plug-and-Play ADMM With Convergence Guarantees
Sun, Y., Wu, Z., Xu, X., Wohlberg, B. E., & Kamilov, U. S. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3094062 · Cited by 140
Metadata
- Authors
- Parikh, N., & Boyd, S.
- Affiliations
- Stanford University (US)
- Venue
- Foundations and Trends® in Optimization
- Publisher
- Emerald
- Published
- 2014-01-13
- Volume
- 1
- Issue
- 3
- Pages
- 127-239
- ISSN
- 2167-3888 (ISSN-L)
- 2167-3918
- OpenAlex
- W2913535645
- Cited by
- 4,102
- References
- 182
- Citations by year
- 2026: 204 · 2025: 310 · 2024: 331 · 2023: 321 · 2022: 312 · 2021: 432 · 2020: 443 · 2019: 460 · 2018: 407 · 2017: 315 · 2016: 278 · 2015: 189 · 2014: 85
- FWCI
- 299.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Optimization (publishedVersion)
- now publishers, Inc. eBooks (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Keywords
- proximal operator, proximal algorithms, convex optimization, distributed optimization, nonsmooth optimization, large-scale optimization, high-dimensional data, projection onto convex sets, iterative optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.