Proximal Algorithms
The DOI matches its Crossref record; 180 of the 182 references it cites were found in a registry or an index.
Abstract
This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton’s method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton’s method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Here, we discuss the many different interpretations of proximal operators and algorithms, describe their connections to many other topics in optimization and applied mathematics, survey some popular algorithms, and provide a large number of examples of proximal operators that commonly arise in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Self-citationRegression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Self-citation(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Self-citationA method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Research works printed but not linked: 37
- Arrow, 1958, Studies in Linear and Nonlinear Programming
- Attouch, 1977, Convergence de fonctions convexes, de sous-différentiels et semi-groupes, C.R Acad. Sei. Paris, 284, 539
- Beck, 2010, Convex Optimization in Signal Processing and Communications, 42
- Bertsekas, 1999, Nonlinear Programming
- Bertsekas, 1989, Parallel and Distributed Computation: Numerical Methods
- Blackford, 1997, ScaLAPACK user’s guide, 10.1137/1.9780898719642 · DOI · Paper page
- Boyd, 2007, Localization and cutting-plane methods
- Candès, 2009, Robust principal component analysis?
- Chandrasekaran, 2009, Allerton 2009, 962
- Daniilidis, 2013, Orthogonal invariance and identifiability
- Demmel, 1993, Parallel numerical linear algebra, 10.1017/S096249290000235X · doi:10.1017/s096249290000235x
- Dempster, 1972, Covariance selection, Biometrics, 28, 157, 10.2307/2528966 · DOI · Paper page
- Duchi, 2008, Efficient projections onto the Q-ball for learning in high dimensions, 272
- Franklin, 1994, Feedback Control of Dynamic Systems, 10.1115/IMECE1994-0541 · doi:10.1115/imece1994-0541
- Gabay, 1983, Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems
- Goldfarb, 2011, Fast first-order methods for composite convex optimization with line search
- Granas, 2003, Fixed Point Theory, 10.1007/978-0-387-21593-8 · doi:10.1007/978-0-387-21593-8
- Lusem, 1999, Augmented Lagrangian methods and proximal point methods for convex optimization, Investigación Operativa, 8, 11
- Jenatton, 2010, Proximal methods for sparse hierarchical dictionary learning
- Kachurovskii, 1960, Monotone operators and convex functionals, Uspekhi Matematicheskikh Nauk, 15, 213
- Kim, 2009, ℓ1 trend filtering, SIAM Review, 51, 339, 10.1137/070690274 · DOI · Paper page
- Lemaire, 1989, The proximal algorithm, 73
- Ma, 2012, Alternating direction methods for latent variable gaussian graphical model selection
- Martinet, 1970, Régularisation d’inéquations variationnelles par approximations successives
- Martinet, 1972, Détermination approchée d’un point fixe d’une application pseudo-contractante, C.R. Acad. Sei. Paris, 274A, 163
- Nedic, 2010, Convex Optimization in Signal Processing and Communications
- Nesterov, 1983, A method of solving a convex programming problem with convergence rate O(1/k2), Soviet Mathematics Doklady, 27, 372
- Quattoni, 2009, An efficient projection for ℓ1,∞ regularization, 857
- Rockafellar, 1970, Convex Analysis, 10.1515/9781400873173 · DOI · Paper page
- Rockafellar, 1998, Variational Analysis, 10.1007/978-3-642-02431-3 · DOI · Paper page
- Tseng, 2008, On accelerated proximal gradient methods for convex-concave optimization
- Vandenberghe, 2010, Optimization methods for large-scale systems
- von Neumann, 1937, Some matrix inequalities and metrization of matrix space, Tomsk University Review, 1, 286
- von Neumann, Functional Operators, Volume 2: The Geometry of Orthogonal Spaces
- Yosida, 1968, Functional Analysis, 10.1007/978-3-662-11791-0 · doi:10.1007/978-3-662-11791-0
- Zarantonello, 1960, Solving functional equations by contractive averaging
- Zarantonello, 1971, Projections on convex sets in Hilbert space and spectral theory. I. Projections on convex sets, 237
Cited by
Items 901–1,000 of 1,007
Matrix-Free Convex Optimization Modeling
Diamond, S., & Boyd, S. (2016) · Springer optimization and its applications · doi:10.1007/978-3-319-42056-1_7 · Cited by 33
Self-citationKnowledge Graph Fact Prediction Via Knowledge-Enriched Tensor FactorizationPreprint
Padia, A., Kalpakis, K., Ferraro, F., & Finin, T. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3331039 · Cited by 31
Anderson Acceleration of Proximal Gradient MethodsPreprint
Mai, V. V., & Johansson, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08590 · Cited by 26
The estimation error of general first order methodsPreprint
Celentano, M., Andrea Montanari, A., & Wu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12903 · Cited by 24
Federated Learning of Generalized Linear Causal Networks
Ye, Q., Amini, A. A., & Zhou, Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3381860 · Cited by 38
Zhao, Y., He, X., Zhou, M., & Huang, T. (2024) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124380 · Cited by 23
Qu, J., Wu, X., Dong, W., Cui, J., & Li, Y. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3551531 · Cited by 23
Power-Efficient Distributed Beamforming for Full-Duplex MIMO Relaying Networks
Xu, X., Chen, X., Zhao, M., Zhou, S., Chi, C., & Wang, J. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2551376 · Cited by 23
Nguyen, H. D. (2017) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1198 · Cited by 33
Image Guided Fuzzy C-Means for Image Segmentation
Guo, L., Chen, L., Wu, Y., & Chen, C. L. P. (2017) · International Journal of Fuzzy Systems · doi:10.1007/s40815-017-0322-1 · Cited by 23
Quality prediction for multi-grade batch process using sparse flexible clustered multi-task learning
Yamaguchi, T., & Yamashita, Y. (2021) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2021.107320 · Cited by 23
Proximal Normalized Subband Adaptive Filtering for Acoustic Echo Cancellation
Guo, G., Yu, Y., de Lamare, R. C., Zheng, Z., Lu, L., & Cai, Q. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3087951 · Cited by 23
Zhang, J., Liu, H., So, A. M., & Ling, Q. H. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3092347 · Cited by 27
Graph Signal Restoration Using Nested Deep Algorithm Unrolling
Nagahama, M., Yamada, K., Tanaka, Y., Chan, S. H., & Eldar, Y. C. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3180546 · Cited by 43
Optimizing Generalized Gini Indices for Fairness in Rankings
Do, V., & Usunier, N. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532035 · Cited by 52
Proximal nested sampling for high-dimensional Bayesian model selection
Cai, X., McEwen, J. D., & Pereyra, M. (2022) · Statistics and Computing · doi:10.1007/s11222-022-10152-9 · Cited by 42
On Maximum a Posteriori Estimation with Plug & Play Priors and Stochastic Gradient Descent
Laumont, R., Bortoli, V. D., Almansa, A., Delon, J., Durmus, A., & Pereyra, M. (2023) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-022-01134-7 · Cited by 38
DISA: A Dual Inexact Splitting Algorithm for Distributed Convex Composite Optimization
Guo, L., Shi, X., Yang, S., & Cao, J. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3301289 · Cited by 31
Efficient Near-Field Millimeter-Wave Sparse Imaging Technique Utilizing One-Bit Measurements
Ge, S., Song, S., Feng, D., Wang, J., Chen, L., Zhu, J., & Huang, X. (2024) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2024.3379978 · Cited by 23
Coordinated energy management for inter-community imbalance minimization
Verschae, R., Kawashima, H., Kato, T., & Matsuyama, T. (2015) · Renewable Energy · doi:10.1016/j.renene.2015.07.039 · Cited by 26
Low Complexity Regularization of Linear Inverse Problems
Vaiter, S., Peyré, G., & Fadili, J. M. (2015) · Applied and numerical harmonic analysis · doi:10.1007/978-3-319-19749-4_3 · Cited by 37
Variational perspective on local graph clustering
Fountoulakis, K., Roosta, F., Shun, J., Cheng, X., & Mahoney, M. W. (2017) · Mathematical Programming · doi:10.1007/s10107-017-1214-8 · Cited by 23
Four-directional fractional-order total variation regularization for image denoising
Wu, L., Chen, Y., Jin, J., Du, H., & Qiu, B. (2017) · Journal of Electronic Imaging · doi:10.1117/1.jei.26.5.053003 · Cited by 24
Optimal Sensor Selection via Proximal Optimization Algorithms
Zare, A., & Jovanović, M. R. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619761 · Cited by 23
Fully distributed security constrained optimal power flow with primary frequency control
Velay, M., Vinyals, M., Bésanger, Y., & Retiere, N. M. (2019) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2019.03.028 · Cited by 23
On electricity market equilibria with storage: Modeling, uniqueness, and a distributed ADMM
Grübel, J., Kleinert, T., Krebs, V., Orlinskaya, G., Schewe, L., Schmidt, M., & Thürauf, J. (2019) · Computers & Operations Research · doi:10.1016/j.cor.2019.104783 · Cited by 24
Xu, J., Bobin, J., de Vismes, A., & Bobin, C. (2019) · Applied Radiation and Isotopes · doi:10.1016/j.apradiso.2019.108903 · Cited by 23
A New Recurrent Plug-and-Play Prior Based on the Multiple Self-Similarity Network
Song, G., Sun, Y., Liu, J., Wang, Z., & Kamilov, U. S. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.2977214 · Cited by 24
High-dimensional embedding network derived prior for compressive sensing MRI reconstruction
Zhang, M., Li, M., Zhou, J., Zhu, Y., Wang, S., Liang, D., Chen, Y., & Liu, Q. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101717 · Cited by 23
Wang, A., & Shi, J. (2020) · IISE Transactions · doi:10.1080/24725854.2020.1786197 · Cited by 24
Peridynamics enabled learning partial differential equations
Bekar, A. C., & Madenci, E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110193 · Cited by 23
Camlibel, K., Iannelli, L., & Tanwani, A. (2021) · Mathematical Programming · doi:10.1007/s10107-021-01666-7 · Cited by 23
Boosting the Performance of Plug-and-Play Priors via Denoiser Scaling
Xu, X., Liu, J., Sun, Y., Wohlberg, B. E., & Kamilov, U. S. (2020) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf51394.2020.9443410 · Cited by 30
Auto-Sizing Neural Networks: With Applications to n-gram Language Models
Murray, K., & Chiang, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1107 · Cited by 23
Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein DistancesPreprint
Can, B., Gürbüzbalaban, M., & Zhu, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07445 · Cited by 24
Toeplitz Inverse Covariance-Based Clustering of Multivariate Time Series DataPreprint
Hallac, D., Vare, S., Boyd, S., & Leskovec, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03161 · Cited by 23
Self-citationExact NLMS Algorithm with ${\ell _p}$ -Norm Constraint
Weruaga, L., & Jimaa, S. A. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2360889 · Cited by 22
Gomez-Rodriguez, M., Song, L., Daneshmand, H., & Schölkopf, B. (2016) · MPG.PuRe (Max Planck Society) · doi:10.5555/2946645.3007043 · Cited by 22
Large margin relative distance learning for person re‐identification
Dong, H., Gong, S., Liu, C., Ji, Y., & Zhong, S. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0265 · Cited by 22
Computation for Latent Variable Model Estimation: A Unified Stochastic Proximal Framework
Zhang, S., & Chen, Y. (2022) · Psychometrika · doi:10.1007/s11336-022-09863-9 · Cited by 32
Data and Image Prior Integration for Image Reconstruction Using Consensus Equilibrium
Ghani, M. U., & Karl, W. C. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3062986 · Cited by 22
Multi-CCD modelling of the point spread function
Liaudat, T. I., Bonnin, J., Starck, J., Schmitz, M. A., Guinot, A., Kilbinger, M., & Gwyn, S. (2020) · Astronomy and Astrophysics · doi:10.1051/0004-6361/202039584 · Cited by 22
Learnable Empirical Mode Decomposition based on Mathematical Morphology
Velasco-Forero, S., Pagès, R., & Angulo, J. (2022) · SIAM Journal on Imaging Sciences · doi:10.1137/21m1417867 · Cited by 28
Rethinking data-driven point spread function modeling with a differentiable optical model
Liaudat, T. I., Starck, J., Kilbinger, M., & Frugier, P.-A. (2023) · Inverse Problems · doi:10.1088/1361-6420/acb664 · Cited by 24
He, H., Ling, C., & Xu, H. (2015) · Journal of Scientific Computing · doi:10.1007/s10915-015-0078-4 · Cited by 29
Fast localized voltage regulation in single-phase distribution grids
Kekatos, V., Zhang, L., Giannakis, G. B., & Baldick, R. (2015) · IEEE International Conference on Smart Grid Communications (SmartGridComm) · doi:10.1109/smartgridcomm.2015.7436387 · Cited by 36
Functional Graphical Models for Manufacturing Process Modeling
Sun, H., Huang, S., & Jin, R. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2017.2693398 · Cited by 22
A primal–dual augmented Lagrangian penalty-interior-point filter line search algorithm
Kuhlmann, R., & Büskens, C. (2017) · Mathematical Methods of Operations Research · doi:10.1007/s00186-017-0625-x · Cited by 22
FLaME: Fast Lightweight Mesh Estimation Using Variational Smoothing on Delaunay Graphs
Greene, W. N., & Roy, N. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.502 · Cited by 33
Lin, A. T., Chow, Y. T., & Osher, S. (2018) · Communications in Mathematical Sciences · doi:10.4310/cms.2018.v16.n7.a9 · Cited by 32
Distributed Tensor Decomposition for Large Scale Health Analytics
He, H., Henderson, J., & Ho, J. C. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313548 · Cited by 28
A sequential approximation framework for coded distributed optimization
Zhu, J., Pu, Y., Gupta, V., Tomlin, C. J., & Ramchandran, K. (2017) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2017.8262879 · Cited by 23
Fu, K., Ji, T., Zhao, L., & Lu, C.-T. (2019) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/3347146.3359381 · Cited by 22
Distributed Iterative CT Reconstruction Using Multi-Agent Consensus Equilibrium
Sridhar, V., Wang, X., Buzzard, G. T., & Bouman, C. A. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.3008782 · Cited by 25
Aghamiry, H. S., Gholami, A., & Operto, S. (2020) · Geophysics · doi:10.1190/geo2019-0596.1 · Cited by 22
Photothermal image reconstruction in opaque media with virtual wave backpropagation
Thummerer, G., Mayr, G., Hirsch, P. D., Ziegler, M., & Burgholzer, P. (2020) · NDT & E International · doi:10.1016/j.ndteint.2020.102239 · Cited by 22
Proving and Disproving Information Inequalities: Theory and Scalable Algorithms
Ho, S., Ling, L., Tan, C. W., & Yeung, R. W. (2020) · IEEE Transactions on Information Theory · doi:10.1109/tit.2020.2982642 · Cited by 26
Learnable MIMO Detection Networks Based on Inexact ADMM
Kim, M., & Park, D. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3026471 · Cited by 22
Architectural Adversarial Robustness: The Case for Deep Pursuit
Cazenavette, G., Murdock, C., & Lucey, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00707 · Cited by 22
A stochastic extra-step quasi-Newton method for nonsmooth nonconvex optimization
Yang, M., Milzarek, A., Wen, Z., & Zhang, T. (2021) · Mathematical Programming · doi:10.1007/s10107-021-01629-y · Cited by 23
Directional TGV-Based Image Restoration under Poisson Noise
di Serafino, D., Landi, G., & Viola, M. (2021) · Journal of Imaging · doi:10.3390/jimaging7060099 · Cited by 22
Additive Tensor Decomposition Considering Structural Data Information
Mou, S., Wang, A., Zhang, C., & Shi, J. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2021.3096964 · Cited by 24
Accelerated Graph Learning From Smooth Signals
Saboksayr, S. S., & Mateos, G. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3123459 · Cited by 23
Inverse design of gradient-index volume multimode converters
Barré, N., & Jesacher, A. (2022) · Optics Express · doi:10.1364/oe.450196 · Cited by 22
Convolutional sparse coding classification model for image classification
Chen, B., Li, J., Ma, B., & Wei, G. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532692 · Cited by 22
Low-rankness of Complex-valued Spectrogram and Its Application to Phase-aware Audio Processing
Masuyama, Y., Yatabe, K., & Oikawa, Y. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683100 · Cited by 22
Adaptive smoothing algorithms for nonsmooth composite convex minimization
Tran-Dinh, Q. (2016) · Computational Optimization and Applications · doi:10.1007/s10589-016-9873-6 · Cited by 23
TGAN: Deep Tensor Generative Adversarial Nets for Large Image GenerationPreprint
Ding, Z., Liu, X.-Y., Yin, M., & Kong, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09953 · Cited by 28
A Critique of Self-Expressive Deep Subspace ClusteringPreprint
Haeffele, B. D., You, C., & Vidal, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03697 · Cited by 22
Zheng, J., Ju, X., Zhang, N., & Xu, D. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106247 · Cited by 22
Constrained convex minimization via model-based excessive gap
Tran-Dinh, Q., & Cevher, V. (2014) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 30
3D Shape Reconstruction from 2D Landmarks: A Convex Formulation.
Zhou, X., Leonardos, S., Hu, X., & Daniilidis, K. (2014) · Cited by 21
Sparse Proximal Reinforcement Learning via Nested Optimization
Song, T., Li, D., Jin, Q., & Hirasawa, K. (2018) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2018.2865505 · Cited by 23
Cho, J., & Lee, M. (2019) · Sensors · doi:10.3390/s19194307 · Cited by 22
Sparse methods for automatic relevance determination
Rudy, S., & Sapsis, T. P. (2021) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2021.132843 · Cited by 24
Training Neural Networks by Lifted Proximal Operator Machines
Li, J., Xiao, M., Fang, C., Dai, Y., Xu, C., & Lin, Z. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3048430 · Cited by 28
Grouped variable selection with discrete optimization: Computational and statistical perspectives
Hazimeh, H., Mazumder, R., & Radchenko, P. (2023) · The Annals of Statistics · doi:10.1214/21-aos2155 · Cited by 29
Fast and robust phase retrieval for masked coherent diffractive imaging
Song, L., & Lam, E. Y. M. (2022) · Photonics Research · doi:10.1364/prj.447862 · Cited by 21
Low-Complexity PAPR-Aware Precoding for Massive MIMO-OFDM Downlink Systems
Hua, L., Wang, Y., Lian, Z., Su, Y., & Xie, Z. (2022) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2022.3166892 · Cited by 21
Low-Rank Room Impulse Response Estimation
Jälmby, M., Elvander, F., & van Waterschoot, T. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3240650 · Cited by 21
Noise Prior Knowledge Informed Bayesian Inference Network for Hyperspectral Super-Resolution
Dong, W., Qu, J., Xiao, S., Zhang, T., Li, Y., & Jia, X. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3278080 · Cited by 24
Variable-Wise Diagonal Preconditioning for Primal-Dual Splitting: Design and Applications
Naganuma, K., & Ono, S. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3304789 · Cited by 28
Hu, J., Chen, Z., Zheng, T., Schober, R., & Luo, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3322788 · Cited by 31
Adaptive and robust multi-task learning
Duan, Y., & Wang, K. (2023) · The Annals of Statistics · doi:10.1214/23-aos2319 · Cited by 38
Improved Robust PCA using low-rank denoising with optimal singular value shrinkage
Moore, B. E., Nadakuditi, R. R., & Fessler, J. A. (2014) · IEEE Statistical Signal Processing Workshop (SSP) · doi:10.1109/ssp.2014.6884563 · Cited by 21
A systematic review of structured sparse learning
Qiao, L., Zhang, B.-F., Su, J., & Lu, X. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1601489 · Cited by 24
Performance limits of stochastic sub-gradient learning, part II: Multi-agent case
Ying, B., & Sayed, A. H. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.10.007 · Cited by 21
Distributed Linearized ADMM for Network Cost Minimization
Cao, X., & Liu, K. J. R. (2018) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2018.2806841 · Cited by 24
VLSI Designs for Joint Channel Estimation and Data Detection in Large SIMO Wireless Systems
Castañeda, O., Goldstein, T., & Studer, C. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2756821 · Cited by 21
A Generative Model for OCT Retinal Layer Segmentation by Groupwise Curve Alignment
Duan, W., Zheng, Y., Ding, Y., Hou, S., Tang, Y., Xu, Y. L., Qin, M., Wu, J., Shen, D. G., & Bi, H. (2018) · IEEE Access · doi:10.1109/access.2018.2825397 · Cited by 21
Phase Corrected Total Variation for Audio Signals
Yatabe, K., & Oikawa, Y. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461541 · Cited by 21
Accelerated Randomized Mirror Descent Algorithms for Composite Non-strongly Convex Optimization
Hien, L. T. K., Nguyen, C. V., Xu, H., Lu, C., & Feng, J. (2019) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-018-01469-5 · Cited by 21
Rapid compositional mapping of knee cartilage with compressed sensing MRI
Zibetti, M. V. W., Baboli, R., Chang, G. A., Otazo, R., & Regatte, R. R. (2018) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.26274 · Cited by 21
Faster Gradient-Free Proximal Stochastic Methods for Nonconvex Nonsmooth Optimization
Huang, F., Gu, B., Huo, Z., Chen, S., & Huang, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011503 · Cited by 21
Wang, H., Aragam, B., & Xing, E. P. (2017) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2017.8217687 · Cited by 25
Convex Formulation of Overparameterized Deep Neural Networks
Fang, C., Gu, Y., Zhang, W., & Zhang, T. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3163341 · Cited by 37
Efficient focused energy delivery with grating lobe mitigation for precision electronic warfare
Chen, S., Xu, C., & Zhang, J. (2019) · Signal Processing · doi:10.1016/j.sigpro.2019.107409 · Cited by 21
Split Bregman iteration for multi-period mean variance portfolio optimization
Corsaro, S., Simone, V. D., & Marino, Z. (2020) · Applied Mathematics and Computation · doi:10.1016/j.amc.2020.125715 · Cited by 25
Lyu, Q., Neph, R., O’Connor, D., Ruan, D., Boucher, S., & Sheng, K. (2020) · Physics in Medicine and Biology · doi:10.1088/1361-6560/abcbd0 · Cited by 21
Multi-Material Decomposition for Single Energy CT Using Material Sparsity Constraint
Xue, Y., Qin, W., Luo, C., Yang, P., Jiang, Y., Tsui, T., He, H., Wang, L., Qin, J., Xie, Y., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3051416 · Cited by 22
Metadata
- Authors
- Parikh, N., & Boyd, S.
- Affiliations
- Stanford University (US)
- Venue
- Foundations and Trends® in Optimization
- Publisher
- Emerald
- Published
- 2014-01-13
- Volume
- 1
- Issue
- 3
- Pages
- 127-239
- ISSN
- 2167-3888 (ISSN-L)
- 2167-3918
- OpenAlex
- W2913535645
- Cited by
- 4,102
- References
- 182
- Citations by year
- 2026: 204 · 2025: 310 · 2024: 331 · 2023: 321 · 2022: 312 · 2021: 432 · 2020: 443 · 2019: 460 · 2018: 407 · 2017: 315 · 2016: 278 · 2015: 189 · 2014: 85
- FWCI
- 299.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Optimization (publishedVersion)
- now publishers, Inc. eBooks (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Keywords
- proximal operator, proximal algorithms, convex optimization, distributed optimization, nonsmooth optimization, large-scale optimization, high-dimensional data, projection onto convex sets, iterative optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.