Proximal Algorithms
The DOI matches its Crossref record; 180 of the 182 references it cites were found in a registry or an index.
Abstract
This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton’s method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton’s method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Here, we discuss the many different interpretations of proximal operators and algorithms, describe their connections to many other topics in optimization and applied mathematics, survey some popular algorithms, and provide a large number of examples of proximal operators that commonly arise in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Self-citationRegression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Self-citation(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Self-citationA method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Research works printed but not linked: 37
- Arrow, 1958, Studies in Linear and Nonlinear Programming
- Attouch, 1977, Convergence de fonctions convexes, de sous-différentiels et semi-groupes, C.R Acad. Sei. Paris, 284, 539
- Beck, 2010, Convex Optimization in Signal Processing and Communications, 42
- Bertsekas, 1999, Nonlinear Programming
- Bertsekas, 1989, Parallel and Distributed Computation: Numerical Methods
- Blackford, 1997, ScaLAPACK user’s guide, 10.1137/1.9780898719642 · DOI · Paper page
- Boyd, 2007, Localization and cutting-plane methods
- Candès, 2009, Robust principal component analysis?
- Chandrasekaran, 2009, Allerton 2009, 962
- Daniilidis, 2013, Orthogonal invariance and identifiability
- Demmel, 1993, Parallel numerical linear algebra, 10.1017/S096249290000235X · doi:10.1017/s096249290000235x
- Dempster, 1972, Covariance selection, Biometrics, 28, 157, 10.2307/2528966 · DOI · Paper page
- Duchi, 2008, Efficient projections onto the Q-ball for learning in high dimensions, 272
- Franklin, 1994, Feedback Control of Dynamic Systems, 10.1115/IMECE1994-0541 · doi:10.1115/imece1994-0541
- Gabay, 1983, Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems
- Goldfarb, 2011, Fast first-order methods for composite convex optimization with line search
- Granas, 2003, Fixed Point Theory, 10.1007/978-0-387-21593-8 · doi:10.1007/978-0-387-21593-8
- Lusem, 1999, Augmented Lagrangian methods and proximal point methods for convex optimization, Investigación Operativa, 8, 11
- Jenatton, 2010, Proximal methods for sparse hierarchical dictionary learning
- Kachurovskii, 1960, Monotone operators and convex functionals, Uspekhi Matematicheskikh Nauk, 15, 213
- Kim, 2009, ℓ1 trend filtering, SIAM Review, 51, 339, 10.1137/070690274 · DOI · Paper page
- Lemaire, 1989, The proximal algorithm, 73
- Ma, 2012, Alternating direction methods for latent variable gaussian graphical model selection
- Martinet, 1970, Régularisation d’inéquations variationnelles par approximations successives
- Martinet, 1972, Détermination approchée d’un point fixe d’une application pseudo-contractante, C.R. Acad. Sei. Paris, 274A, 163
- Nedic, 2010, Convex Optimization in Signal Processing and Communications
- Nesterov, 1983, A method of solving a convex programming problem with convergence rate O(1/k2), Soviet Mathematics Doklady, 27, 372
- Quattoni, 2009, An efficient projection for ℓ1,∞ regularization, 857
- Rockafellar, 1970, Convex Analysis, 10.1515/9781400873173 · DOI · Paper page
- Rockafellar, 1998, Variational Analysis, 10.1007/978-3-642-02431-3 · DOI · Paper page
- Tseng, 2008, On accelerated proximal gradient methods for convex-concave optimization
- Vandenberghe, 2010, Optimization methods for large-scale systems
- von Neumann, 1937, Some matrix inequalities and metrization of matrix space, Tomsk University Review, 1, 286
- von Neumann, Functional Operators, Volume 2: The Geometry of Orthogonal Spaces
- Yosida, 1968, Functional Analysis, 10.1007/978-3-662-11791-0 · doi:10.1007/978-3-662-11791-0
- Zarantonello, 1960, Solving functional equations by contractive averaging
- Zarantonello, 1971, Projections on convex sets in Hilbert space and spectral theory. I. Projections on convex sets, 237
Cited by
Items 601–700 of 1,007
LIDIA: Lightweight Learned Image Denoising with Instance Adaptation
Vaksman, G., Elad, M., & Milanfar, P. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00270 · Cited by 36
Gerbelot, C., Abbara, A., & Krząkała, F. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3222913 · Cited by 69
CPGD: Cadzow Plug-and-Play Gradient Descent for Generalised FRI
Simeoni, M., Besson, A., Hurley, P., & Vetterli, M. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3041089 · Cited by 37
Sparse Index Tracking With K-Sparsity or ϵ-Deviation Constraint via ℓ 0 -Norm Minimization
Li, X. P., Shi, Z.-L., Leung, C.-S., & So, H. C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3171819 · Cited by 36
Fault Diagnosis of DAB Converters Based on ResNet With Adaptive Threshold Denoising
Cai, F., Zhan, M., Chai, Q., & Jiang, J. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3180409 · Cited by 39
Operto, S., Gholami, A., Aghamiry, H. S., Guo, G., Beller, S., Aghazade, K., Ozoumet, F. W. M., Combe, L., & Ribodetti, A. (2023) · Geophysics · doi:10.1190/geo2022-0758.1 · Cited by 36
A Unified Feature Selection Framework for Graph Embedding on High Dimensional Data
Chen, M. Y., Tsang, I. W.-H., Tan, M., & Cham, T. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2382599 · Cited by 36
Zare, A., Chen, Y., Jovanović, M. R., & Georgiou, T. T. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2595761 · Cited by 36
Yang, Y., Pesavento, M., Chatzinotas, S., & Ottersten, B. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2877584 · Cited by 40
Forward-backward truncated Newton methods for convex composite optimizationPreprint
Patrinos, P., Stella, L., & Bemporad, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.6655 · Cited by 36
Stochastic, Distributed and Federated Optimization for Machine LearningPreprint
Konečný, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01155 · Cited by 44
Manifold Graph Signal Restoration Using Gradient Graph Laplacian Regularizer
Chen, F., Cheung, G., & Zhang, X. J. (2024) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3343560 · Cited by 37
On Stochastic Proximal Gradient Algorithms
Atchadé, Y. F., Fort, G., & Moulines, É. (2017) · HAL · Cited by 36
GPU-accelerated compressive holography
Endo, Y., Shimobaba, T., Kakue, T., & Ito, T. (2016) · Optics Express · doi:10.1364/oe.24.008437 · Cited by 35
Square-Root Lasso With Nonconvex Regularization: An ADMM Approach
Shen, X., Chen, L., Gu, Y., & So, H. C. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2567482 · Cited by 37
Distributed Nash Equilibrium Seeking via the Alternating Direction Method of Multipliers
Salehisadaghiani, F., & Pavel, L. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.983 · Cited by 41
Efficient Sparse Low-Rank Tensor Completion Using the Frank-Wolfe Algorithm
Guo, X., Yao, Q., & Kwok, J. T.-Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10886 · Cited by 35
A new generalized shrinkage conjugate gradient method for sparse recovery
Esmaeili, H., Shabani, S., & Kimiaei, M. (2018) · CALCOLO · doi:10.1007/s10092-018-0296-x · Cited by 35
Understanding generalization error of SGD in nonconvex optimization
Zhou, Y., Liang, Y., & Zhang, H. (2021) · Machine Learning · doi:10.1007/s10994-021-06056-w · Cited by 48
An ADMM-Based Universal Framework for Adversarial Attacks on Deep Neural Networks
Zhao, P., Liu, S., Wang, Y., & Lin, X. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240639 · Cited by 43
Quantitative Phase and Intensity Microscopy Using Snapshot White Light Wavefront Sensing
Wang, C., Fu, Q., Dun, X., & Heidrich, W. (2019) · Scientific Reports · doi:10.1038/s41598-019-50264-3 · Cited by 42
REDAEP: Robust and Enhanced Denoising Autoencoding Prior for Sparse-View CT Reconstruction
Zhang, F., Zhang, M., Qin, B., Zhang, Y., Xu, Z., Liang, D., & Liu, Q. (2020) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2020.2989634 · Cited by 36
A Proximal Atomic Coordination Algorithm for Distributed Optimization
Romvary, J. J., Ferro, G., Haider, R., & Annaswamy, A. M. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3053907 · Cited by 45
Time-Varying Graph Learning With Constraints on Graph Temporal Variation
Yokota, H., Yamada, K., Tanaka, Y., & Ortega, A. (2026) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2026.3712068 · Cited by 46
Ferraris, V., Dobigeon, N., Wei, Q., & Chabert, M. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2017.2692645 · Cited by 35
Projection methods and applications for seismic nonlinear inverse problems with multiple constraints
Peters, B., Smithyman, B., & Herrmann, F. J. (2018) · Geophysics · doi:10.1190/geo2018-0192.1 · Cited by 35
Denoising and Inpainting of Sonar Images Using Convolutional Sparse Representation
Vishwakarma, A. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3246527 · Cited by 34
Singh, R., Wu, A. P., Mudide, A., & Berger, B. (2024) · Cell Systems · doi:10.1016/j.cels.2024.04.005 · Cited by 43
Learning Distributed Representations for Structured Output Prediction
Srikumar, V., & Manning, C. D. (2014) · neural information processing systems · Cited by 34
Neural Networks Leverage Corpus-wide Information for Part-of-speech Tagging
Tsuboi, Y. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1101 · Cited by 35
Energy-Efficient Beam Coordination Strategies With Rate-Dependent Processing Power
Tervo, O., Tölli, A., Juntti, M. J., & Tran, L. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2728501 · Cited by 35
Learning Patch-Based Dynamic Graph for Visual Tracking
Li, C., Lin, L., Zuo, W., & Tang, J. (2017) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11200 · Cited by 33
Shu, K., Wang, S., Tang, J., Wang, Y., & Liu, H. (2018) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3159652.3159692 · Cited by 34
Convergence Analysis of an Inexact Three-Operator Splitting Algorithm
Zong, C., Tang, Y., & Cho, Y. J. (2018) · Symmetry · doi:10.3390/sym10110563 · Cited by 38
Distributed Optimization for Network Resource Allocation With Nonsmooth Utility Functions
Iiduka, H. (2018) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2018.2889011 · Cited by 34
Warp-and-project tomography for rapidly deforming objects
Zang, G., Idoughi, R., Tao, R., Lubineau, G., Wonka, P., & Heidrich, W. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322965 · Cited by 38
A P2P network based edge computing smart grid model for efficient resources coordination
Hou, W., Jiang, Y., Lei, W., Xu, A., Wen, H., & Chen, S. (2020) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-019-00870-9 · Cited by 35
Zhang, S., Zhu, Z., Zhang, B., Feng, B., Yu, T., & Li, Z. (2020) · Sensors · doi:10.3390/s20174749 · Cited by 37
Klosa, J., Simon, N., Westermark, P. O., Liebscher, V., & Wittenburg, D. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-03725-w · Cited by 35
On the Linear Convergence of Forward–Backward Splitting Method: Part I—Convergence Analysis
Bello-Cruz, Y., Li, G., & Nghia, T. T. A. (2020) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-020-01787-7 · Cited by 34
Optimal control in chemical engineering: Past, present and future
Nolasco, E., Vassiliadis, V. S., Kähm, W., Adloor, S. D., Ismaili, R. A., Conejeros, R., Espaas, T. A., Gangadharan, N., Mappas, V. K., Scott, F., et al. (2021) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2021.107528 · Cited by 38
LRSLibrary: Low-Rank and Sparse Tools for Background Modeling and Subtraction in Videos
(2016) · CRC Press eBooks · doi:10.1201/b20190-19 · Cited by 34
Power Spectra Separation via Structured Matrix Factorization
Fu, X., Sidiropoulos, N. D., & Ma, W. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2560142 · Cited by 34
Total variation superiorized conjugate gradient method for image reconstruction
Zibetti, M. V. W., Lin, C., & Herman, G. T. (2018) · Inverse Problems · doi:10.1088/1361-6420/aaa49b · Cited by 39
Deep Physics-Guided Unrolling Generalization for Compressed Sensing
Chen, B., Song, J., Xie, J., & Zhang, J. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01814-w · Cited by 41
Social Spammer and Spam Message Co-Detection in Microblogging with Social Context Regularization
Wu, F., Shu, J., Huang, Y., & Yuan, Z. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806560 · Cited by 33
Learning Recurrent Waveforms Within EEGs
Brockmeier, A. J., & Príncipe, J. C. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2499241 · Cited by 42
Distributed subgradient methods for saddle-point problems
Mateos‐Núñez, D., & Cortés, J. (2015) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2015.7403075 · Cited by 34
Multi-Task Feature Interaction Learning
Lin, K., Xu, J., Baytaş, İ. M., Ji, S., & Zhou, J. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939834 · Cited by 33
A Distributed Algorithm for Computing a Common Fixed Point of a Finite Family of Paracontractions
Fullmer, D., & Morse, A. S. (2018) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2800644 · Cited by 33
Yatabe, K., & Oikawa, Y. (2016) · Applied Optics · doi:10.1364/ao.55.004632 · Cited by 33
Adaptive Speech Dereverberation Using Constrained Sparse Multichannel Linear Prediction
Jukic, A., van Waterschoot, T., & Doclo, S. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2640939 · Cited by 33
Sparse regression with Multi-type Regularized Feature modeling
Devriendt, S., Antonio, K., Reynkens, T., & Verbelen, R. (2020) · Insurance Mathematics and Economics · doi:10.1016/j.insmatheco.2020.11.010 · Cited by 33
Cheng, S., Lu, F., Peng, P., & Wu, S. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.05.023 · Cited by 34
Misfit function for full waveform inversion based on the Wasserstein metric with dynamic formulation
Yong, P., Liao, W., Huang, J., Li, Z., & Lin, Y. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108911 · Cited by 36
Sparse Recovery and Dictionary Learning From Nonlinear Compressive Measurements
Rencker, L., Bach, F., Wang, W., & Plumbley, M. D. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2941070 · Cited by 34
GraphBGS: Background Subtraction via Recovery of Graph Signals
Giraldo, J. H., & Bouwmans, T. (2020) · International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412999 · Cited by 31
Optimizing Regularized Cholesky Score for Order-Based Learning of Bayesian Networks
Ye, Q., Amini, A. A., & Zhou, Q. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2990820 · Cited by 45
Learning Sampling and Model-Based Signal Recovery for Compressed Sensing MRI
Huijben, I. A. M., Veeling, B. S., & van Sloun, R. J. G. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053331 · Cited by 33
Sparse Regularization-Based Approach for Point Cloud Denoising and Sharp Features Enhancement
Leal, E., Torres, G. S., & Branch, J. W. (2020) · Sensors · doi:10.3390/s20113206 · Cited by 33
SAR Imaging Based on Deep Unfolded Network With Approximated Observation
Kang, L., Sun, T., Luo, Y., Ni, J., & Zhang, Q. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3177927 · Cited by 37
FedADMM: A federated primal-dual algorithm allowing partial participation
Wang, H., Marella, S., & Anderson, J. (2022) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc51059.2022.9992745 · Cited by 72
Vector and Matrix Optimal Mass Transport: Theory, Algorithm, and Applications
Ryu, E. K., Chen, Y., Li, W., & Osher, S. (2018) · SIAM Journal on Scientific Computing · doi:10.1137/17m1163396 · Cited by 47
An Image Enhancing Pattern-Based Sparsity for Real-Time Inference on Mobile Devices
Ma, X., Niu, W., Zhang, T., Liu, S., Lin, S., Li, H., Wen, W., Chen, X., Tang, J., Ma, K., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58601-0_37 · Cited by 44
Large-Scale Inventory Optimization: A Recurrent Neural Networks–Inspired Simulation Approach
Wang, T., & Hong, L. J. (2022) · INFORMS journal on computing · doi:10.1287/ijoc.2022.1253 · Cited by 43
Recent Advances in Deep Learning for Channel Coding: A Survey
Matsumine, T., & Ochiai, H. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3472094 · Cited by 44
The Discrete Dantzig Selector: Estimating Sparse Linear Models via Mixed Integer Linear Optimization
Mazumder, R., & Radchenko, P. (2017) · IEEE Transactions on Information Theory · doi:10.1109/tit.2017.2658023 · Cited by 42
Microblog sentiment classification with heterogeneous sentiment knowledge
Wu, F., Song, Y., & Huang, Y. (2016) · Information Sciences · doi:10.1016/j.ins.2016.09.002 · Cited by 34
Image Reconstruction via Manifold Constrained Convolutional Sparse Coding for Image Sets
Yang, L., Li, C., Han, J., Chen, C., Ye, Q., Zhang, B., Cao, X., & Liu, W. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2743683 · Cited by 32
Chen, L., Zhang, H., Lu, J., Thung, K., Aibaidula, A., Liu, L., Chen, S., Jin, L., Wu, J., Wang, Q., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2807590 · Cited by 34
Identifying Gene Network Rewiring by Integrating Gene Expression and Gene Network Data
Xu, T., Ou-Yang, L., Hu, X. T., & Zhang, X.-F. (2018) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2018.2809603 · Cited by 36
Robust sparse recovery via weakly convex optimization in impulsive noise
Liu, Q., Yang, C. N., Gu, Y., & So, H. C. (2018) · Signal Processing · doi:10.1016/j.sigpro.2018.05.020 · Cited by 32
AUTALASSO: an automatic adaptive LASSO for genome-wide prediction
Waldmann, P., Ferenčaković, M., Mészáros, G., Khayatzadeh, N., Čurik, I., & Sölkner, J. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2743-3 · Cited by 32
Semi-implicit relaxed Douglas-Rachford algorithm (sDR) for ptychography
Pham, M., Rana, A., Miao, J., & Osher, S. (2019) · Optics Express · doi:10.1364/oe.27.031246 · Cited by 32
Thi, H. A. L., Le, H. M., Phan, D. N., & Tran, B. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.08.024 · Cited by 32
ADMM-Net for Communication Interference Removal in Stepped-Frequency Radar
Johnston, J., Li, Y., Lops, M., & Wang, X. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3076900 · Cited by 35
Angular Domain Channel Estimation for mmWave Massive MIMO With One-Bit ADCs/DACs
Xu, L., Qian, C., Gao, F., Zhang, W., & Ma, S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3029400 · Cited by 33
SGD-Net: Efficient Model-Based Deep Learning With Theoretical Guarantees
Liu, J., Sun, Y., Gan, W., Xu, X., Wohlberg, B. E., & Kamilov, U. S. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3085534 · Cited by 42
MRIReco.jl: An MRI reconstruction framework written in Julia
Knopp, T., & Grosser, M. (2021) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28792 · Cited by 32
The Analysis of Optimization Algorithms: A Dissipativity Approach
Lessard, L. (2022) · IEEE Control Systems · doi:10.1109/mcs.2022.3157115 · Cited by 32
High dynamic range and super-resolution from raw image bursts
Lecouat, B., Eboli, T., Ponce, J., & Mairal, J. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530180 · Cited by 43
Pricing Electricity in Residential Communities Using Game-Theoretical Billings
Hupez, M., Toubeau, J., Atzeni, I., Grève, Z. D., & Vallée, F. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3206912 · Cited by 32
A 3-D Sparse SAR Imaging Method Based on Plug-and-Play
Wang, Y., He, Z., Zhan, X., Zeng, Q., & Hu, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3221934 · Cited by 37
SuperMann: A Superlinearly Convergent Algorithm for Finding Fixed Points of Nonexpansive Operators
Themelis, A., & Patrinos, P. (2019) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2906393 · Cited by 32
Topology optimization of freely vibrating continuum structures based on nonsmooth optimization
Zhou, P., Du, J., & Lü, Z. (2017) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-017-1677-5 · Cited by 32
Blind Multiclass Ensemble Classification
Traganitis, P. A., Pagés-Zamora, A., & Giannakis, G. B. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2860562 · Cited by 38
Total Variation Denoising With Non-Convex Regularizers
Zou, J. X., Shen, M., Zhang, Y., Li, H., Liu, G., & Ding, S. (2018) · IEEE Access · doi:10.1109/access.2018.2888944 · Cited by 35
Accelerated and Inexact Soft-Impute for Large-Scale Matrix and Tensor Completion
Yao, Q., & Kwok, J. T.-Y. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2867533 · Cited by 33
Ma, W., & Chen, G. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12774 · Cited by 52
Dathathri, S., Dvijotham, K., Kurakin, A., Raghunathan, A., Uesato, J., Bunel, R., Shankar, S., Steinhardt, J., Goodfellow, I., Liang, P., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11645 · Cited by 37
Liaudat, T. I., Starck, J., & Kilbinger, M. (2023) · Frontiers in Astronomy and Space Sciences · doi:10.3389/fspas.2023.1158213 · Cited by 43
Gligorić, Z., Görçün, Ö. F., Gligorić, M., Pamucar, D. S., Šimić, V., & Küçükönder, H. (2024) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2024.102079 · Cited by 31
Accelerated inexact soft-impute for fast large-scale matrix completion
Yao, Q., & Kwok, J. T.-Y. (2015) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 31
On Proximal Subgradient Splitting Method for Minimizing the sum of two Nonsmooth Convex Functions
Bello-Cruz, Y. (2016) · Set-Valued and Variational Analysis · doi:10.1007/s11228-016-0376-5 · Cited by 34
Deeply Aggregated Alternating Minimization for Image Restoration
Kim, Y., Jung, H., Min, D., & Sohn, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.38 · Cited by 31
Proximal methods for calibration transfer
Boucher, T. F., Dyar, M. D., & Mahadevan, S. (2017) · Journal of Chemometrics · doi:10.1002/cem.2877 · Cited by 31
A Distributed Control Algorithm for Waterfilling of Networked Control Systems via Consensus
Carli, R., & Dotoli, M. (2017) · IEEE Control Systems Letters · doi:10.1109/lcsys.2017.2716190 · Cited by 31
A Review of Depth and Normal Fusion Algorithms
Antensteiner, D., Štolc, S., & Pock, T. (2018) · Sensors · doi:10.3390/s18020431 · Cited by 34
Kitkuan, D., Kumam, P., Padcharoen, A., Kumam, W., & Thounthong, P. (2018) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2018.04.057 · Cited by 31
A Novel Cooperative Non-Orthogonal Multiple Access (NOMA) in Wireless Backhaul Two-Tier HetNets
Nguyen, T. M., Ajib, W., & Assi, C. M. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2832625 · Cited by 31
Metadata
- Authors
- Parikh, N., & Boyd, S.
- Affiliations
- Stanford University (US)
- Venue
- Foundations and Trends® in Optimization
- Publisher
- Emerald
- Published
- 2014-01-13
- Volume
- 1
- Issue
- 3
- Pages
- 127-239
- ISSN
- 2167-3888 (ISSN-L)
- 2167-3918
- OpenAlex
- W2913535645
- Cited by
- 4,102
- References
- 182
- Citations by year
- 2026: 204 · 2025: 310 · 2024: 331 · 2023: 321 · 2022: 312 · 2021: 432 · 2020: 443 · 2019: 460 · 2018: 407 · 2017: 315 · 2016: 278 · 2015: 189 · 2014: 85
- FWCI
- 299.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Optimization (publishedVersion)
- now publishers, Inc. eBooks (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Keywords
- proximal operator, proximal algorithms, convex optimization, distributed optimization, nonsmooth optimization, large-scale optimization, high-dimensional data, projection onto convex sets, iterative optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.