Proximal Algorithms
The DOI matches its Crossref record; 180 of the 182 references it cites were found in a registry or an index.
Abstract
This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton’s method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton’s method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Here, we discuss the many different interpretations of proximal operators and algorithms, describe their connections to many other topics in optimization and applied mathematics, survey some popular algorithms, and provide a large number of examples of proximal operators that commonly arise in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Self-citationRegression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Self-citation(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Self-citationA method for the solution of certain non-linear problems in least squares
Levenberg, K. (1944) · Quarterly of Applied Mathematics · doi:10.1090/qam/10666 · Cited by 12,359
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Research works printed but not linked: 37
- Arrow, 1958, Studies in Linear and Nonlinear Programming
- Attouch, 1977, Convergence de fonctions convexes, de sous-différentiels et semi-groupes, C.R Acad. Sei. Paris, 284, 539
- Beck, 2010, Convex Optimization in Signal Processing and Communications, 42
- Bertsekas, 1999, Nonlinear Programming
- Bertsekas, 1989, Parallel and Distributed Computation: Numerical Methods
- Blackford, 1997, ScaLAPACK user’s guide, 10.1137/1.9780898719642 · DOI · Paper page
- Boyd, 2007, Localization and cutting-plane methods
- Candès, 2009, Robust principal component analysis?
- Chandrasekaran, 2009, Allerton 2009, 962
- Daniilidis, 2013, Orthogonal invariance and identifiability
- Demmel, 1993, Parallel numerical linear algebra, 10.1017/S096249290000235X · doi:10.1017/s096249290000235x
- Dempster, 1972, Covariance selection, Biometrics, 28, 157, 10.2307/2528966 · DOI · Paper page
- Duchi, 2008, Efficient projections onto the Q-ball for learning in high dimensions, 272
- Franklin, 1994, Feedback Control of Dynamic Systems, 10.1115/IMECE1994-0541 · doi:10.1115/imece1994-0541
- Gabay, 1983, Augmented Lagrangian Methods: Applications to the Solution of Boundary-Value Problems
- Goldfarb, 2011, Fast first-order methods for composite convex optimization with line search
- Granas, 2003, Fixed Point Theory, 10.1007/978-0-387-21593-8 · doi:10.1007/978-0-387-21593-8
- Lusem, 1999, Augmented Lagrangian methods and proximal point methods for convex optimization, Investigación Operativa, 8, 11
- Jenatton, 2010, Proximal methods for sparse hierarchical dictionary learning
- Kachurovskii, 1960, Monotone operators and convex functionals, Uspekhi Matematicheskikh Nauk, 15, 213
- Kim, 2009, ℓ1 trend filtering, SIAM Review, 51, 339, 10.1137/070690274 · DOI · Paper page
- Lemaire, 1989, The proximal algorithm, 73
- Ma, 2012, Alternating direction methods for latent variable gaussian graphical model selection
- Martinet, 1970, Régularisation d’inéquations variationnelles par approximations successives
- Martinet, 1972, Détermination approchée d’un point fixe d’une application pseudo-contractante, C.R. Acad. Sei. Paris, 274A, 163
- Nedic, 2010, Convex Optimization in Signal Processing and Communications
- Nesterov, 1983, A method of solving a convex programming problem with convergence rate O(1/k2), Soviet Mathematics Doklady, 27, 372
- Quattoni, 2009, An efficient projection for ℓ1,∞ regularization, 857
- Rockafellar, 1970, Convex Analysis, 10.1515/9781400873173 · DOI · Paper page
- Rockafellar, 1998, Variational Analysis, 10.1007/978-3-642-02431-3 · DOI · Paper page
- Tseng, 2008, On accelerated proximal gradient methods for convex-concave optimization
- Vandenberghe, 2010, Optimization methods for large-scale systems
- von Neumann, 1937, Some matrix inequalities and metrization of matrix space, Tomsk University Review, 1, 286
- von Neumann, Functional Operators, Volume 2: The Geometry of Orthogonal Spaces
- Yosida, 1968, Functional Analysis, 10.1007/978-3-662-11791-0 · doi:10.1007/978-3-662-11791-0
- Zarantonello, 1960, Solving functional equations by contractive averaging
- Zarantonello, 1971, Projections on convex sets in Hilbert space and spectral theory. I. Projections on convex sets, 237
Cited by
Items 501–600 of 1,007
Improving Design Preference Prediction Accuracy Using Feature Learning
Burnap, A., Pan, Y., Liu, Y., Ren, Y., Lee, H., Gonzalez, R., & Papalambros, P. Y. (2016) · Journal of Mechanical Design · doi:10.1115/1.4033427 · Cited by 42
Tian, X. S., Li, K., Zhang, W., Wang, Z., & Ma, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3278928 · Cited by 49
Scalable and Flexible Multiview MAX-VAR Canonical Correlation Analysis
Fu, X., Huang, K., Hong, M., Sidiropoulos, N. D., & So, A. M. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2698365 · Cited by 45
Fast Approximation Algorithms for a Class of Non-convex QCQP Problems Using First-Order Methods
Konar, A., & Sidiropoulos, N. D. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2690386 · Cited by 42
Dong, H., Lu, P., Zhong, S., Liu, C., Ji, Y., & Gong, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.013 · Cited by 42
Sparse Supervised Representation-Based Classifier for Uncontrolled and Imbalanced Classification
Shu, T., Zhang, B., & Tang, Y. Y. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2884444 · Cited by 42
A hierarchical distributed predictive control approach for microgrids energy management
Dao, L. A., Dehghani-Pilehvarani, A., Markou, A., & Ferrarini, L. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101536 · Cited by 43
Fast Low-Rank Matrix Learning with Nonconvex Regularization
Yao, Q., Kwok, J. T.-Y., & Zhong, W. (2015) · Proceedings · doi:10.1109/icdm.2015.9 · Cited by 46
Fitting a Kalman Smoother to Data
Barratt, S. T., & Boyd, S. (2020) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc45564.2020.9147485 · Cited by 42
Self-citationA Novel Regularization Based on the Error Function for Sparse Recovery
Guo, W., Lou, Y., Qin, J., & Yan, M. (2021) · Journal of Scientific Computing · doi:10.1007/s10915-021-01443-w · Cited by 48
Modeling Alzheimer's disease cognitive scores using multi-task sparse group lasso
Liu, X., Gonçalves, A. R., Cao, P., Zhao, D., & Banerjee, A. (2017) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2017.11.001 · Cited by 45
Proximal Reinforcement Learning: A New Theory of Sequential Decision Making in Primal-Dual SpacesPreprint
Mahadevan, S., Liu, B., Thomas, P. S., Dabney, W., Giguere, S., Jacek, N., Gemp, I., & Liu, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.6757 · Cited by 62
Federated Learning in Heterogeneous Networks With Unreliable Communication
Zheng, P., Zhu, Y. L., Hu, Y., Zhang, Z. J., & Schmeink, A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3311824 · Cited by 51
Zhang, H., & Cheng, L. (2014) · Optimization Letters · doi:10.1007/s11590-014-0795-x · Cited by 41
Denoising-Based Turbo Compressed Sensing
Xue, Z., Ma, J., & Yuan, X. (2017) · IEEE Access · doi:10.1109/access.2017.2697978 · Cited by 41
Consensus Convolutional Sparse Coding
Choudhury, B., Swanson, R., Heide, F., Wetzstein, G., & Heidrich, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.459 · Cited by 42
Stochastic Proximal Algorithms for AUC Maximization
Natole, M., Ying, Y., & Lyu, S. (2018) · International Conference on Machine Learning · Cited by 41
Graph-Based Joint Dequantization and Contrast Enhancement of Poorly Lit JPEG Images
Liu, X., Cheung, G., Ji, X., Zhao, D., & Gao, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2872871 · Cited by 47
Efficient Dynamic Parallel MRI Reconstruction for the Low-Rank Plus Sparse Model
Lin, C. Y., & Fessler, J. A. (2018) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2018.2882089 · Cited by 41
Hierarchical Load Balancing and Clustering Technique for Home Edge Computing
Babou, C. S. M., Fall, D., Kashihara, S., Taenaka, Y., Bhuyan, M. H., Niang, I., & Kadobayashi, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3007944 · Cited by 49
Inexact accelerated high-order proximal-point methods
Nesterov, Y. E. (2021) · Mathematical Programming · doi:10.1007/s10107-021-01727-x · Cited by 41
Optimization-inspired deep learning high-resolution inversion for seismic data
Chen, H., Gao, J., Jiang, X., Gao, Z., & Zhang, W. (2021) · Geophysics · doi:10.1190/geo2020-0034.1 · Cited by 43
Operator Splitting Methods in Control
Stathopoulos, G., Shukla, H., Szűcs, A., Pu, Y., & Jones, C. N. (2016) · Foundations and Trends® in Systems and Control · doi:10.1561/2600000008 · Cited by 67
Convergence guarantees for a class of non-convex and non-smooth optimization problemsPreprint
Khamaru, K., & Wainwright, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09629 · Cited by 77
Tutorial on Amortized Optimization
Amos, B. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000102 · Cited by 207
Parameter Selection and Preconditioning for a Graph Form Solver
Fougner, C., & Boyd, S. (2018) · Lecture notes in control and information sciences - proceedings · doi:10.1007/978-3-319-67068-3_4 · Cited by 53
Self-citationMultifrequency Compressed Sensing for 2-D Near-Field Synthetic Aperture Radar Image Reconstruction
Bi, D., Xie, Y., Ma, L., Li, X., Yang, X., & Zheng, Y. R. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2654578 · Cited by 40
A Large Scale Analysis of Logistic Regression: Asymptotic Performance and New Insights
Mai, X., Liao, Z., & Couillet, R. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683376 · Cited by 40
Yue, M., Zhou, Z., & So, A. M. (2018) · Mathematical Programming · doi:10.1007/s10107-018-1280-6 · Cited by 40
Afshar, A., Perros, I., Papalexakis, E. E., Searles, E., Ho, J. C., & Sun, J. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271775 · Cited by 40
Yang, L., Li, P., Zhang, S., Zhao, L., Zhou, S., & Xing, M. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2972972 · Cited by 40
Learned Proximal Networks for Quantitative Susceptibility Mapping
Lai, K.-W., Aggarwal, M., van Zijl, P. C. M., Li, X., & Sulam, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59713-9_13 · Cited by 54
Nonsmooth Resource Allocation of Multiagent Systems With Disturbances: A Proximal Approach
Zhu, Y., Wen, G., Yu, W., & Yu, X. (2021) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2021.3068349 · Cited by 43
Proximal and Sparse Resolution of Constrained Dynamic Equations
Carpentier, J., Budhiraja, R., & Mansard, N. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.017 · Cited by 40
A Review of multilayer extreme learning machine neural networks
Vásquez-Coronel, J. A., Mora, M., & Vilches-Ponce, K. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10478-4 · Cited by 47
Joint Cross-Attention Network With Deep Modality Prior for Fast MRI Reconstruction
Sun, K., Wang, Q., & Shen, D. G. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3314008 · Cited by 45
Microblog Sentiment Classification with Contextual Knowledge Regularization
Wu, F., Song, Y., & Huang, Y. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9503 · Cited by 39
Supervised Distributed Hashing for Large-Scale Multimedia Retrieval
Zhai, D., Liu, X., Ji, X., Zhao, D., Satoh, S., & Gao, W. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2749160 · Cited by 40
Joint Virtual Computing and Radio Resource Allocation in Limited Fronthaul Green C-RANs
Luong, P., Gagnon, F., Despins, C. L., & Tran, L. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2799859 · Cited by 39
Jolivet, F., Momey, F., Denis, L., Méès, L., Faure, N., Grosjean, N., Pinston, F., Marié, J.-L., & Fournier, C. (2018) · Optics Express · doi:10.1364/oe.26.008923 · Cited by 45
A novel optimization framework for VMAT with dynamic gantry couch rotation
Lyu, Q., Yu, V., Ruan, D., Neph, R., O’Connor, D., & Sheng, K. (2018) · Physics in Medicine and Biology · doi:10.1088/1361-6560/aac704 · Cited by 44
Kumar, A., Ravi‐Chandar, K., & Lopez‐Pamies, O. (2018) · International Journal of Fracture · doi:10.1007/s10704-018-0302-y · Cited by 39
Image-Based Prognostics Using Penalized Tensor Regression
Fang, X., Paynabar, K., & Gebraeel, N. (2018) · Technometrics · doi:10.1080/00401706.2018.1527727 · Cited by 45
Quantization and Training of Low Bit-Width Convolutional Neural Networks for Object Detection
Yin, P., Zhang, S., Qi, Y., & Xin, J. X. (2018) · Journal of Computational Mathematics · doi:10.4208/jcm.1803-m2017-0301 · Cited by 53
Multi-Channel and Multi-Model-Based Autoencoding Prior for Grayscale Image Restoration
Li, S., Qin, B., Xiao, J., Liu, Q., Wang, Y., & Liang, D. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2931240 · Cited by 40
Semi-Supervised Learning in Network-Structured Data via Total Variation Minimization
Jung, A., Hero, A. O., Mara, A. C., Jahromi, S. H., Heimowitz, A., & Eldar, Y. C. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2953593 · Cited by 50
Basiri, M. H., Ghojogh, B., Azad, N. L., Fischmeister, S., Karray, F., & Crowley, M. (2020) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc42340.2020.9304180 · Cited by 39
SuperMann : a superlinearly convergent algorithm for finding fixed points of nonexpansive operatorsPreprint
Themelis, A., & Patrinos, P. (2016) · Lirias · Cited by 39
On the Resolution Probability of Conditional and Unconditional Maximum Likelihood DoA Estimation
Mestre, X., & Vallet, P. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3015046 · Cited by 38
Real-Time Grayscale-Thermal Tracking via Laplacian Sparse Representation
Li, C., Hu, S., Gao, S., & Tang, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27674-8_6 · Cited by 38
Mesnil, O., Yan, H., Ruzzene, M., Paynabar, K., & Shi, J. (2016) · Structural Health Monitoring · doi:10.1177/1475921716636375 · Cited by 38
An Accelerated Composite Gradient Method for Large-Scale Composite Objective Problems
Florea, M. I., & Vorobyov, S. A. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2866409 · Cited by 41
Generalized self-concordant functions: a recipe for Newton-type methods
Sun, T., & Tran-Dinh, Q. (2018) · Mathematical Programming · doi:10.1007/s10107-018-1282-4 · Cited by 41
Nonlinear Precoding for Phase-Quantized Constant-Envelope Massive MU-MIMO-OFDM
Jacobsson, S., Castañeda, O., Jeon, C., Durisi, G., & Studer, C. (2018) · doi:10.1109/ict.2018.8464896 · Cited by 38
Compressive Channel Estimation and Multi-User Detection in C-RAN With Low-Complexity Methods
He, Q., Quek, T. Q. S., Chen, Z., Zhang, Q., & Li, S. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2818125 · Cited by 38
Structured SUMCOR Multiview Canonical Correlation Analysis for Large-Scale Data
Kanatsoulis, C. I., Fu, X., Sidiropoulos, N. D., & Hong, M. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2878544 · Cited by 38
Non-Exhaustive, Overlapping Clustering
Whang, J. J., Hou, Y., Gleich, D. F., & Dhillon, I. S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2863278 · Cited by 43
3D CNN Acceleration on FPGA using Hardware-Aware Pruning
Sun, M., Zhao, P., Gungor, M., Pedram, M., Leeser, M. E., & Lin, X. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218571 · Cited by 42
Energy layer optimization via energy matrix regularization for proton spot‐scanning arc therapy
Zhang, G., Shen, H., Lin, Y.-T., Chen, R. C., Long, Y. Q., & Gao, H. (2022) · Medical Physics · doi:10.1002/mp.15836 · Cited by 38
Contact and friction simulation for computer graphics
Andrews, S., Erleben, K., & Ferguson, Z. (2022) · ACM SIGGRAPH Courses · doi:10.1145/3532720.3535640 · Cited by 57
SCRIP: Successive Convex Optimization Methods for Risk Parity Portfolio Design
Feng, Y., & Palomar, D. P. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2452219 · Cited by 38
Wang, J., Olsen, P. A., Conn, A. R., & Lozano, A. C. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.301 · Cited by 41
Parallel Direction Method of MultipliersPreprint
Wang, H., Banerjee, A., & Luo, Z.-Q. T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.4064 · Cited by 39
Geometry-Aware Gradient Algorithms for Neural Architecture SearchPreprint
Li, L., Khodak, M., Balcan, M.-F., & Talwalkar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07802 · Cited by 60
An accelerated proximal gradient method for multiobjective optimization
Tanabe, H., Fukuda, E. H., & Yamashita, N. (2023) · Computational Optimization and Applications · doi:10.1007/s10589-023-00497-w · Cited by 37
Principal Component-Based Semi-Supervised Extreme Learning Machine for Soft Sensing
Shi, X., Kang, Q., Bao, H., Huang, W., & An, J. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3290352 · Cited by 38
Practical Compact Deep Compressed Sensing
Chen, B., & Zhang, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3504490 · Cited by 51
Spatial Source Subtraction Based on Incomplete Measurements of Relative Transfer Function
Koldovský, Z., Málek, J., & Gannot, S. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2425213 · Cited by 37
Zeng, H., & Song, A. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2475618 · Cited by 42
Personalized Microblog Sentiment Classification via Multi-Task Learning
Wu, F., & Huang, Y. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10378 · Cited by 38
A new framework for peer-to-peer energy sharing and coordination in the energy internet
Zhou, Y., Ci, S., Li, H., & Yang, Y. (2017) · International Conference on Communications · doi:10.1109/icc.2017.7996424 · Cited by 45
Support Vector Data Descriptions and $k$ -Means Clustering: One Class?
Görnitz, N., Lima, L. A., Müller, K., Kloft, M., & Nakajima, S. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2737941 · Cited by 44
On Solving Contact Problems with Coulomb Friction: Formulations and Numerical Comparisons
Acary, V., Brémond, M., & Huber, O. (2018) · Springer eBooks · doi:10.1007/978-3-319-75972-2_10 · Cited by 59
Panoramic Robust PCA for Foreground–Background Separation on Noisy, Free-Motion Camera Video
Moore, B. E., Gao, C., & Nadakuditi, R. R. (2019) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2019.2891389 · Cited by 44
A Proximal Diffusion Strategy for Multiagent Optimization With Sparse Affine Constraints
Alghunaim, S. A., Yuan, K., & Sayed, A. H. (2019) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2960265 · Cited by 44
TOA-Based Localization With NLOS Mitigation via Robust Multidimensional Similarity Analysis
Xiong, W., & So, H. C. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2929860 · Cited by 37
General phase regularized reconstruction using phase cycling
Ong, F., Cheng, J. Y., & Lustig, M. S. (2017) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27011 · Cited by 37
Algorithmic Analysis and Statistical Estimation of SLOPE via Approximate Message Passing
Bu, Z., Klusowski, J. M., Rush, C., & Su, W. (2020) · IEEE Transactions on Information Theory · doi:10.1109/tit.2020.3025272 · Cited by 37
Toward a Retail Market for Distribution Grids
Haider, R., Baros, S., Wasa, Y., Romvary, J. J., Uchida, K., & Annaswamy, A. M. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2996565 · Cited by 43
Determined BSS Based on Time-Frequency Masking and Its Application to Harmonic Vector Analysis
Yatabe, K., & Kitamura, D. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3073863 · Cited by 37
On Plug-and-Play Regularization Using Linear Denoisers
Gavaskar, R. G., Athalye, C. D., & Chaudhury, K. N. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3075092 · Cited by 40
Improved Noise2Noise Denoising with Limited Data
Calvarons, A. F. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00089 · Cited by 46
RSS-Based Localization in the Presence of Malicious Nodes in Sensor Networks
Mukhopadhyay, B., Srirangarajan, S., & Kar, S. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3104385 · Cited by 37
Pokala, P. K., Hemadri, R. V., & Seelamantula, C. S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3122259 · Cited by 37
Aspelmeier, T., Charitha, C., & Luke, D. R. (2016) · SIAM Journal on Imaging Sciences · doi:10.1137/15m103580x · Cited by 45
IoT-Based Proactive Energy Supply Control for Connected Electric Vehicles
Hu, Y., Chen, C., He, J., Yang, B., & Guan, X. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2899928 · Cited by 39
Machine Learning Optimization Algorithms & Portfolio Allocation
Perrin, S., & Roncalli, T. (2020) · Wiley eBooks · doi:10.1002/9781119751182.ch8 · Cited by 47
Preconditioning in fast dual gradient methods
Giselsson, P., & Boyd, S. (2014) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2014.7040176 · Cited by 36
Self-citationEfficient and Robust Image Restoration Using Multiple-Feature L2-Relaxed Sparse Analysis Priors
Portilla, J., Tristán‐Vega, A., & Selesnick, I. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2478405 · Cited by 37
Iterative Sparsification-Projection: Fast and Robust Sparse Signal Approximation
Sadeghi, M., & Babaie‐Zadeh, M. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2585123 · Cited by 36
SCALPEL: Extracting neurons from calcium imaging data
Petersen, A. J., Simon, N., & Witten, D. (2018) · The Annals of Applied Statistics · doi:10.1214/18-aoas1159 · Cited by 37
Zibetti, M. V. W., Helou, E. S., & Pipa, D. R. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2699483 · Cited by 36
LS-Decomposition for Robust Recovery of Sensory Big Data
Liu, X.-Y., & Wang, X. (2017) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2017.2763170 · Cited by 36
Convergence diagnostics for stochastic gradient descent with constant learning rate.
Chee, J., & Toulis, P. (2018) · International Conference on Artificial Intelligence and Statistics · Cited by 36
Guo, F., He, R., Jin, D., Dang, J., Wang, L., & Li, X. (2018) · International Conference on Computational Linguistics · Cited by 50
Monotone FISTA With Variable Acceleration for Compressed Sensing Magnetic Resonance Imaging
Zibetti, M. V. W., Helou, E. S., Regatte, R. R., & Herman, G. T. (2018) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2018.2882681 · Cited by 43
Optimal Placement of Actuators Via Sparse Learning for Composite Fuselage Shape Control
Du, J., Yue, X., Hunt, J. H., & Shi, J. (2019) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4044249 · Cited by 36
Relaxation methods for solving the tensor equation arising from the higher‐order Markov chains
Liu, D., Li, W., & Vong, S. (2019) · Numerical Linear Algebra with Applications · doi:10.1002/nla.2260 · Cited by 36
From Fienup’s phase retrieval techniques to regularized inversion for in-line holography: tutorial
Momey, F., Denis, L., Olivier, T., & Fournier, C. (2019) · Journal of the Optical Society of America A · doi:10.1364/josaa.36.000d62 · Cited by 36
Adaptation and Learning Over Networks Under Subspace Constraints—Part I: Stability Analysis
Nassif, R., Vlaski, S., & Sayed, A. H. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2970336 · Cited by 36
Metadata
- Authors
- Parikh, N., & Boyd, S.
- Affiliations
- Stanford University (US)
- Venue
- Foundations and Trends® in Optimization
- Publisher
- Emerald
- Published
- 2014-01-13
- Volume
- 1
- Issue
- 3
- Pages
- 127-239
- ISSN
- 2167-3888 (ISSN-L)
- 2167-3918
- OpenAlex
- W2913535645
- Cited by
- 4,102
- References
- 182
- Citations by year
- 2026: 204 · 2025: 310 · 2024: 331 · 2023: 321 · 2022: 312 · 2021: 432 · 2020: 443 · 2019: 460 · 2018: 407 · 2017: 315 · 2016: 278 · 2015: 189 · 2014: 85
- FWCI
- 299.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Foundations and Trends® in Optimization (publishedVersion)
- now publishers, Inc. eBooks (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Keywords
- proximal operator, proximal algorithms, convex optimization, distributed optimization, nonsmooth optimization, large-scale optimization, high-dimensional data, projection onto convex sets, iterative optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.