The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Introduction to Online Convex Optimization
Abstract
Introduction to Online Convex Optimization portrays optimization as a process. In many practical applications the environment is so complex that it is infeasible to lay out a comprehensive theoretical model and use classical algorithmic theory and mathematical optimization. It is necessary as well as beneficial to take a robust approach, by applying an optimization method that learns as one goes along, learning from experience as more aspects of the problem are observed. This view of optimization as a process has become prominent in varied fields and has led to some spectacular success in modeling and systems that are now part of our daily lives. Introduction to Online Convex Optimization is intended to serve as a reference for a self-contained course on online convex optimization and the convex optimization approach to machine learning for the educated graduate student in computer science/electrical engineering/ operations research/statistics and related fields. It is also an ideal reference for the researcher diving into this fascinating world at the intersection of optimization and machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
The pricing of options and corporate liabilities
Black, F., & Scholes, M. (1973) · Journal of Political Economy · doi:10.1086/260062 · Cited by 29,074
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
(2010) · Cited by 8,261
Exact Matrix Completion via Convex Optimization
Candès, E. J., & Recht, B. (2009) · Foundations of Computational Mathematics · doi:10.1007/s10208-009-9045-5 · Cited by 4,877
Spencer, J. (1991) · Medical Entomology and Zoology · Cited by 4,310
Introductory Lectures on Convex Optimization: A Basic Course
Nesterov, Y. E. (2014) · Medical Entomology and Zoology · Cited by 3,557
Prediction, Learning, and Games
Cesa-Bianchi, N., & Lugosi, G. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546921 · Cited by 3,162
An algorithm for quadratic programming
Frank, M., & Wolfe, P. (1956) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800030109 · Cited by 3,030
Bachelier, L. (1900) · Annales scientifiques de l'École normale supérieure · doi:10.24033/asens.476 · Cited by 2,539
(2002) · doi:10.1137/s0097539701398375 · Cited by 2,275
Some aspects of the sequential design of experiments
Robbins, H. (1952) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1952-09620-8 · Cited by 2,184
The Weighted Majority Algorithm
Littlestone, N., & Warmuth, M. K. (1994) · Information and Computation · doi:10.1006/inco.1994.1009 · Cited by 1,975
(2003) · Cited by 1,733
An Introduction to Computational Learning Theory
Kearns, M. J., & Vazirani, U. (1994) · doi:10.7551/mitpress/3897.001.0001 · Cited by 1,697
Pegasos: primal estimated sub-gradient solver for SVM
Shalev-Shwartz, S., Singer, Y., Srebro, N., & Cotter, A. (2011) · Mathematical Programming · doi:10.1007/s10107-010-0420-4 · Cited by 1,477
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems
Bubeck, S. (2012) · now publishers, Inc. eBooks · doi:10.1561/9781601986276 · Cited by 1,404
Problem complexity and method efficiency in optimization
(1984) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(84)90101-0 · Cited by 1,329
Online Learning and Online Convex Optimization
Shalev-Shwartz, S. (2011) · now publishers, Inc. eBooks · doi:10.1561/9781601985477 · Cited by 1,095
A Simple Adaptive Procedure Leading to Correlated Equilibrium
Hart, S., & Mas-Colell, A. (2000) · Econometrica · doi:10.1111/1468-0262.00153 · Cited by 1,088
Convex Optimization: Algorithms and Complexity
Bubeck, S. (2015) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000050 · Cited by 1,001
Brownian Motion in the Stock Market
Osborne, M. F. M. (1959) · Operations Research · doi:10.1287/opre.7.2.145 · Cited by 945
Fast maximum margin matrix factorization for collaborative prediction
Rennie, J. D. M., & Srebro, N. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102441 · Cited by 939
Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization
Jaggi, M. (2013) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 911
Exponentiated Gradient versus Gradient Descent for Linear Predictors
Kivinen, J., & Warmuth, M. K. (1997) · Information and Computation · doi:10.1006/inco.1996.2612 · Cited by 864
Logarithmic regret algorithms for online convex optimization
Hazan, E., Agarwal, A., & Kale, S. (2007) · Machine Learning · doi:10.1007/s10994-007-5016-8 · Cited by 828
Self-citationEfficient algorithms for online decision problems
Kalai, A., & Vempala, S. (2005) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2004.10.016 · Cited by 591
Online convex optimization in the bandit setting: gradient descent without a gradient
Flaxman, A. D., Kalai, A. T., & McMahan, H. B. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0408007 · Cited by 546
Fast Approximation Algorithms for Fractional Packing and Covering Problems
Plotkin, S. A., Shmoys, D. B., & Tardos, É. (1995) · Mathematics of Operations Research · doi:10.1287/moor.20.2.257 · Cited by 542
Adaptive Game Playing Using Multiplicative Weights
Freund, Y., & Schapire, R. E. (1999) · Games and Economic Behavior · doi:10.1006/game.1999.0738 · Cited by 515
Making Gradient Descent Optimal for Strongly Convex Stochastic Optimization
Rakhlin, A., Shamir, O., & Sridharan, K. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1109.5647 · Cited by 492
On the Generalization Ability of On-Line Learning Algorithms
Cesa-Bianchi, N., Conconi, A., & Gentile, C. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.833339 · Cited by 426
Convex Analysis and Nonlinear Optimization
Borwein, J. M., & Lewis, A. S. (2000) · Springer eBooks · doi:10.1007/978-1-4757-9859-3 · Cited by 394
Minimax policies for adversarial and stochastic bandits
Audibert, J.-Y., Est, U. P., & Bubeck, S. (2009) · HAL · Cited by 346
Online Learning: Theory, Algorithms, and Applications
Shalev‐Shwartz, S. (2007) · Cited by 314
Relative Loss Bounds for On-Line Density Estimation with the Exponential Family of Distributions
Azoury, K. S., & Warmuth, M. K. (2001) · Machine Learning · doi:10.1023/a:1010896012157 · Cited by 298
Algorithms for portfolio management based on the Newton method
Agarwal, A., Hazan, E., Kale, S., & Schapire, R. E. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143846 · Cited by 230
Self-citationLearning with matrix factorizations
Srebro, N., & Jaakkola, T. (2004) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 224
Hazan, E., & Kale, S. (2014) · Journal of Machine Learning Research · Cited by 221
Self-citationA Simple Algorithm for Nuclear Norm Regularized Problems
Jaggi, M., & Sulovský, M. (2010) · Cited by 214
Competing in the dark: An efficient algorithm for bandit linear optimization
Abernethy, J., Hazan, E., & Rakhlin, A. (2008) · Cited by 193
Self-citationOnline linear optimization and adaptive routing
Awerbuch, B., & Kleinberg, R. (2007) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2007.04.016 · Cited by 177
Block-Coordinate Frank-Wolfe Optimization for Structural SVMsPreprint
Lacoste-Julien, S., Jaggi, M., Schmidt, M., & Pletscher, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4747 · Cited by 176
Intrinsic Robustness of the Price of Anarchy
Roughgarden, T. (2015) · Journal of the ACM · doi:10.1145/2806883 · Cited by 173
A primal-dual perspective of online learning algorithms
Shalev-Shwartz, S., & Singer, Y. (2007) · Machine Learning · doi:10.1007/s10994-007-5014-x · Cited by 168
The Price of Bandit Information for Online Optimization
Dani, V., Kakade, S. M., & Hayes, T. P. (2007) · ScholarlyCommons (University of Pennsylvania) · Cited by 161
Collaborative Filtering in a Non-Uniform World: Learning with the Weighted Trace Norm
Srebro, N., & Salakhutdinov, R. (2010) · neural information processing systems · Cited by 158
Universal portfolios with and without transaction costs
Blum, A. L., & Kalai, A. T. (1997) · Annual Conference on Computational Learning Theory (COLT) · doi:10.1145/267460.267518 · Cited by 153
Efficient algorithms for universal portfolios
Kalai, A. T., & Vempala, S. (2002) · Annual Symposium on Foundations of Computer Science · doi:10.1109/sfcs.2000.892136 · Cited by 143
Relative Loss Bounds for Multidimensional Regression Problems
Kivinen, J., & Warmuth, M. K. (2001) · Machine Learning · doi:10.1023/a:1017938623079 · Cited by 135
Practical Large-Scale Optimization for Max-norm Regularization
Lee, J. D., Recht, B., Srebro, N., Tropp, J. A., & Salakhutdinov, R. (2010) · CaltechAUTHORS (California Institute of Technology) · Cited by 124
From on-line to batch learning
Littlestone, N. (1989) · Conference on Learning Theory · doi:10.5555/93335.93365 · Cited by 121
Greedy Algorithms for Structurally Constrained High Dimensional Problems
Tewari, A., Ravikumar, P., & Dhillon, I. S. (2011) · Cited by 121
General Convergence Results for Linear Discriminant Updates
Grove, A. J., Littlestone, N., & Schuurmans, D. (2001) · Machine Learning · doi:10.1023/a:1010844028087 · Cited by 118
Extracting certainty from uncertainty: regret bounded by variation in costs
Hazan, E., & Kale, S. (2010) · Machine Learning · doi:10.1007/s10994-010-5175-x · Cited by 112
Self-citationSublinear optimization for machine learning
Clarkson, K. L., Hazan, E., & Woodruff, D. P. (2012) · Journal of the ACM · doi:10.1145/2371656.2371658 · Cited by 102
Self-citationOnline Markov Decision Processes Under Bandit Feedback
Neu, G., György, A., Szepesvári, C., & Antos, A. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2292137 · Cited by 101
Lifted coordinate descent for learning with trace-norm regularization
Dudík, M., Harchaoui, Z., & Malick, J. (2012) · Cited by 96
Large-scale image classification with trace-norm regularization
Harchaoui, Z., Douze, M., Paulin, M., Dudı́k, M., & Malick, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248078 · Cited by 87
Improved Risk Tail Bounds for On-Line Algorithms
Cesa‐Bianchi, N., & Gentile, C. (2008) · IEEE Transactions on Information Theory · doi:10.1109/tit.2007.911292 · Cited by 51
Beating SGD: Learning SVMs in Sublinear Time
Hazan, E., Koren, T., & Srebro, N. (2011) · Cited by 49
Self-citationData Dependent Concentration Bounds for Sequential Prediction Algorithms
Zhang, T. (2005) · Lecture notes in computer science · doi:10.1007/11503415_12 · Cited by 39
Efficient algorithms for online convex optimization and their applications
Arora, S., & Hazan, E. (2006) · Cited by 35
Self-citationPlaying Non-linear Games with Linear Oracles
Garber, D., & Hazan, E. (2013) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2013.52 · Cited by 28
Self-citationBeating the adaptive bandit with high probability
Abernethy, J., & Rakhlin, A. (2009) · ScholarlyCommons (University of Pennsylvania) · Cited by 27
Statistical Learning and Sequential Prediction
Rakhlin, A., & Sridharan, K. (2014) · Cited by 16
Valiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Shamir, O., & Zhang, T. (2012) · arXiv · doi:10.48550/arxiv.1212.1824
Cited by
Introduction to Multi-Armed Bandits
Slivkins, A. (2019) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000068 · Cited by 780
Online learning: A comprehensive survey
Hoi, S. C. H., Sahoo, D., Lu, J., & Zhao, P. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.112 · Cited by 746
Mathematics for Machine Learning
Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108679930 · Cited by 573
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405
Test-Time Training with Self-Supervision for Generalization under Distribution Shifts
Sun, Y., Wang, X., Liu, Z., Miller, J., Efros, A. A., & Hardt, M. (2019) · arXiv · doi:10.48550/arxiv.1909.13231 · Cited by 393
Metadata
- Authors
- Hazan, E.
- Venue
- now publishers, Inc. eBooks
- Publisher
- now Publishers Inc
- Published
- 2016
- OpenAlex
- W2513180554
- Cited by
- 813
- References
- 74
- FWCI
- 38.21
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.