The DOI matches its Crossref record; 172 of the 172 references it cites were found in a registry or an index.
A unified framework for stochastic optimization
Abstract
Abstract Stochastic optimization is an umbrella term that includes over a dozen fragmented communities, using a patchwork of sometimes overlapping notational systems with algorithmic strategies that are suited to specific classes of problems. This paper reviews the canonical models of these communities, and proposes a universal modeling framework that encompasses all of these competing approaches. At the heart is an objective function that optimizes over policies that is standard in some approaches, but foreign to others. We then identify four meta-classes of policies that encompasses all of the approaches that we have identified in the research literature or industry practice. In the process, we observe that any adaptive learning algorithm, whether it is derivative-based or derivative-free, is a form of policy that can be tuned to optimize either the cumulative reward (similar to multi-armed bandit problems) or final reward (as is used in ranking and selection or stochastic search). We argue that the principles of bandit problems, long a niche community, should become a core dimension of mainstream stochastic optimization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
(2010) · Cited by 8,261
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Optimization of conditional value-at-risk
Rockafellar, R. T., & Uryasev, S. (2000) · The Journal of Risk · doi:10.21314/jor.2000.038 · Cited by 6,725
Introduction to Stochastic Programming
Birge, J. R., & Louveaux, F. (2011) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-1-4614-0237-4 · Cited by 6,469
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316887 · Cited by 6,024
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Bertsimas, D., & Sim, M. (2004) · Operations Research · doi:10.1287/opre.1030.0065 · Cited by 4,557
Conditional value-at-risk for general loss distributions
Rockafellar, R. T., & Uryasev, S. (2002) · Journal of Banking & Finance · doi:10.1016/s0378-4266(02)00271-6 · Cited by 3,820
Kirk, D. E. (1970) · Cited by 3,804
Lee, J. H., Kaisare, N. S., & García, C. E. (2007) · Springer eBooks · doi:10.1002/9781394333325.fmatter · Cited by 3,766
Discrete-Event System Simulation
Morgan, C. B. (1984) · Technometrics · doi:10.1080/00401706.1984.10487955 · Cited by 3,593
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
Optimal Statistical Decisions.
Siegmund, D., & DeGroot, M. H. (1972) · Journal of the American Statistical Association · doi:10.2307/2284675 · Cited by 3,386
Dynamic Programming and Markov Processes.
Freimer, M., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,378
Simulation and the Monte Carlo Method
Rubinstein, R. Y., & Kroese, D. P. (2016) · Wiley Series in Probability and Statistics · doi:10.1002/9781118631980 · Cited by 3,356
Introduction to Stochastic Control Theory
(1970) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)x6015-7 · Cited by 3,220
Valuing American Options by Simulation: A Simple Least-Squares Approach
Longstaff, F. A., & Schwartz, E. S. (2001) · Review of Financial Studies · doi:10.1093/rfs/14.1.113 · Cited by 3,216
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Proceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Design and Analysis of Experiments
Grice, J. V., & Montgomery, D. C. (2000) · Technometrics · doi:10.2307/1271458 · Cited by 2,654
Numerical Methods in Economics
Judd, K. L. (1998) · MIT Press Books · Cited by 2,580
Simulation and the Monte Carlo Method
Rubinstein, R. Y., & Kroese, D. P. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/9780470230381 · Cited by 2,454
Asymptotically efficient adaptive allocation rules
Lai, T. L., & Robbins, H. (1985) · Advances in Applied Mathematics · doi:10.1016/0196-8858(85)90002-8 · Cited by 2,406
Introduction to Stochastic Processes
(2014) · Stochastic Numerical Methods · doi:10.1002/9783527683147.ch6 · Cited by 2,383
Online Computation and Competitive Analysis
Borodin, A., & El‐Yaniv, R. (1998) · Cited by 2,333
Approximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781118029176 · Cited by 2,297
Self-citationStochastic Programming: The State of the Art In Honor of George B. Dantzig
(2010) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-1-4419-1642-6 · Cited by 2,239
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,159
The Sample Average Approximation Method for Stochastic Discrete Optimization
Kleywegt, A. J., Shapiro, A., & Homem-de-Mello, T. (2002) · SIAM Journal on Optimization · doi:10.1137/s1052623499363220 · Cited by 1,983
Interpolation of Spatial Data: Some Theory for Kriging
Rathbun, S. L., & Stein, M. L. (2000) · Journal of the American Statistical Association · doi:10.2307/2669494 · Cited by 1,916
Stochastic Approximation and Recursive Algorithms and Applications
(2003) · Stochastic Modelling and Applied Probability · doi:10.1007/b97441 · Cited by 1,838
Lectures on Stochastic Programming: Modeling and Theory
Shapiro, A., Dentcheva, D., & Ruszczyński, A. (2009) · Cited by 1,735
Cressie, N. (1990) · Mathematical Geology · doi:10.1007/bf00889887 · Cited by 1,728
Optimal control theory: An introduction
Levine, W. (1972) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1972.1100008 · Cited by 1,623
Bandit processes and dynamic allocation indices
Gittins, J. C. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01068.x · Cited by 1,487
The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
Smallwood, R. D., & Sondik, E. J. (1973) · Operations Research · doi:10.1287/opre.21.5.1071 · Cited by 1,479
The theory of dynamic programming
Bellman, R. (1954) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1954-09848-8 · Cited by 1,459
Stochastic Approximation Methods for Constrained and Unconstrained Systems
Kushner, H. J., & Clark, D. S. (1978) · Applied Mathematical Sciences · doi:10.1007/978-1-4684-9352-8 · Cited by 1,459
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Cited by 1,427
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems
Bubeck, S. (2012) · now publishers, Inc. eBooks · doi:10.1561/9781601986276 · Cited by 1,404
Multi-stage stochastic optimization applied to energy planning
Pereira, M. V. F., & Pinto, L. M. V. G. (1991) · Mathematical Programming · doi:10.1007/bf01582895 · Cited by 1,361
Scenarios and Policy Aggregation in Optimization Under Uncertainty
Rockafellar, R. T., & Wets, R. J.-B. (1991) · Mathematics of Operations Research · doi:10.1287/moor.16.1.119 · Cited by 1,340
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems
Bubeck, S., & Cesa-Bianchi, N. (2012) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000024 · Cited by 1,295
L-Shaped Linear Programs with Applications to Optimal Control and Stochastic Programming
Van Slyke, R. M., & Wets, R. (1969) · SIAM Journal on Applied Mathematics · doi:10.1137/0117061 · Cited by 1,281
A review of dynamic vehicle routing problems
Pillac, V., Gendreau, M., Guéret, C., & Medaglia, A. L. (2013) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.08.015 · Cited by 1,253
Yong, J., & Zhou, X. Y. (1999) · doi:10.1007/978-1-4612-1466-3 · Cited by 1,243
Linear Programming under Uncertainty
Dantzig, G. B. (1955) · Management Science · doi:10.1287/mnsc.1.3-4.197 · Cited by 1,225
Uncertainty Quantification: Theory, Implementation, and Applications
Smith, R. C. (2013) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611973228 · Cited by 1,138
Stochastic Simulation: Algorithms and Analysis
Asmussen, S., & Glynn, P. W. (2007) · Stochastic Modelling and Applied Probability · doi:10.1007/978-0-387-69033-9 · Cited by 1,121
Algorithms for Reinforcement Learning
Szepesvári, C. (2010) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01551-9 · Cited by 1,049
Scenario reduction in stochastic programming
Dupa?ov�, J., Gr�we-Kuska, N., & R�misch, W. (2003) · Mathematical Programming · doi:10.1007/s10107-002-0331-0 · Cited by 1,041
Ширяев, А. Н. (1977) · Medical Entomology and Zoology · Cited by 1,039
INTRODUCTION TO STOCHASTIC SEARCH AND OPTIMIZATION: ESTIMATION, SIMULATION, AND CONTROL
Nowak, W. (2012) · Medical Entomology and Zoology · Cited by 1,033
Optimal Stopping Times for Detecting Changes in Distributions
Moustakides, G. V. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350164 · Cited by 1,020
Multi-Armed Bandit Allocation Indices.
Bather, J. A., & Gittins, J. C. (1990) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982809 · Cited by 998
Randolph, P. H. (1970) · Technometrics · doi:10.1080/00401706.1970.10488715 · Cited by 986
Design and Analysis of Experiments: Advanced Experimental Design
Hinkelmann, K., & Kempthorne, O. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471709948 · Cited by 961
Proceedings Of The International Joint Conference On Neural Networks 2003
(2003) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223944 · Cited by 950
(2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_588 · Cited by 950
Distributionally Robust Convex Optimization
Wiesemann, W., Kuhn, D., & Sim, M. (2014) · Operations Research · doi:10.1287/opre.2014.1314 · Cited by 947
Reinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
Point-based value iteration: an anytime algorithm for POMDPs
Pineau, J., Gordon, G., & Thrun, S. (2003) · Cited by 918
Recent advances in robust optimization: An overview
Gabrel, V., Murat, C., & Thiele, A. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2013.09.036 · Cited by 912
Handbook of Learning and Approximate Dynamic Programming
Si, J., Barto, A. G., Powell, W. B., & Wunsch, D. (2004) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544785 · Cited by 856
Self-citationAnalysis of Thompson Sampling for the multi-armed bandit problem
Agrawal, S., & Goyal, N. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.1797 · Cited by 819
Introduction to Stochastic Processes
Gillings, D. (1974) · Technometrics · doi:10.1080/00401706.1974.10489162 · Cited by 784
Interpolation of Spatial Data: Some Theory for Kriging
Woodard, R. (2000) · Technometrics · doi:10.1080/00401706.2000.10485731 · Cited by 779
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 770
Feature Article: Optimization for simulation: Theory vs. Practice
Fu, M. C. (2002) · INFORMS Journal on Computing · doi:10.1287/ijoc.14.3.192.113 · Cited by 742
Acting Optimally in Partially Observable Stochastic Domains
Cassandra, A. R., Kaelbling, L. P., & Littman, M. L. (1994) · National Conference on Artificial Intelligence · Cited by 722
Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches
White, D. A., & Sofge, D. (1992) · Medical Entomology and Zoology · Cited by 705
A Robust Optimization Approach to Inventory Theory
Bertsimas, D., & Thiele, A. (2006) · Operations Research · doi:10.1287/opre.1050.0238 · Cited by 705
Multi‐Armed Bandit Allocation Indices
Gittins, J., Glazebrook, K., & Weber, R. (2011) · Wiley eBooks · doi:10.1002/9780470980033 · Cited by 684
Dynamic pickup and delivery problems
Berbeglia, G., Cordeau, J.-F., & Laporte, G. (2010) · European Journal of Operational Research · doi:10.1016/j.ejor.2009.04.024 · Cited by 679
Distributionally Robust Optimization and Its Tractable Approximations
Goh, J., & Sim, M. (2010) · Operations Research · doi:10.1287/opre.1090.0795 · Cited by 668
Approximate dynamic programming: solving the curses of dimensionality
Pardalos, P. M. (2009) · Optimization Methods and Software · doi:10.1080/10556780802583108 · Cited by 666
On the Complexity of Best Arm Identification in Multi-Armed Bandit Models
Kaufmann, E., Cappé, O., & Garivier, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.4443 · Cited by 661
Model predictive control: Review of the three decades of development
Lee, J. H. (2011) · International Journal of Control, Automation and Systems · doi:10.1007/s12555-011-0300-6 · Cited by 641
Dynamic Programming and Markov Processes.
Kaufman, H., & Howard, R. A. (1961) · The American Mathematical Monthly · doi:10.2307/2312519 · Cited by 638
Numerical Techniques for Stochastic Optimization
(1988) · Springer Series in Computational Mathematics · doi:10.1007/978-3-642-61370-8 · Cited by 632
The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting
Werbos, P. J. (1994) · Medical Entomology and Zoology · Cited by 623
Stochastic Kriging for Simulation Metamodeling
Ankenman, B., Nelson, B. L., & Staum, J. (2010) · Operations Research · doi:10.1287/opre.1090.0754 · Cited by 622
Regression methods for pricing complex American-style options
Tsitsiklis, J. N., & Van Roy, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.935083 · Cited by 612
Sondik, E. J. (1978) · Operations Research · doi:10.1287/opre.26.2.282 · Cited by 536
A survey of algorithmic methods for partially observed Markov decision processes
Lovejoy, W. S. (1991) · Annals of Operations Research · doi:10.1007/bf02055574 · Cited by 532
Multidimensional Stochastic Approximation Methods
Blum, J. R. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728659 · Cited by 523
Scenario reduction in stochastic programming: An approach using probability metrics
Dupačová, J., Gröwe‐Kuska, N., & Römisch, W. (2000) · doi:10.18452/2876 · Cited by 517
PROCEEDINGS OF THE 1997 WINTER SIMULATION CONFERENCE
Healy, K. J. (1997) · Cited by 508
Online Planning Algorithms for POMDPs
Ross, S., Pineau, J., Paquet, S., & Chaib-draa, B. (2008) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2567 · Cited by 496
Learning to Optimize via Posterior Sampling
Russo, D., & Van Roy, B. (2014) · Mathematics of Operations Research · doi:10.1287/moor.2014.0650 · Cited by 493
Asynchronous stochastic approximation and Q-learning
Tsitsiklis, J. N. (1994) · Machine Learning · doi:10.1007/bf00993306 · Cited by 453
A Knowledge-Gradient Policy for Sequential Information Collection
Frazier, P. I., Powell, W. B., & Dayanik, S. (2008) · SIAM Journal on Control and Optimization · doi:10.1137/070693424 · Cited by 447
Self-citationBest Arm Identification in Multi-Armed Bandits
Audibert, J.-Y., Bubeck, S., & Munos, R. (2010) · HAL · Cited by 446
Accelerated Stochastic Approximation
Kesten, H. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706705 · Cited by 433
Introduction to Uncertainty Quantification
Sullivan, T. J. (2015) · Texts in Applied Mathematics · doi:10.1007/978-3-319-23395-6 · Cited by 432
A survey of point-based POMDP solvers
Shani, G., Pineau, J., & Kaplow, R. (2013) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-012-9200-2 · Cited by 422
Çinlar, E. (2011) · Graduate Texts in Mathematics · doi:10.1007/978-0-387-87859-1 · Cited by 421
Proceedings of the 2000 winter simulation conference
Joines, J. A., & Barton, R. R. (2000) · Cited by 414
Optimal maintenance models for systems subject to failure–A Review
Sherif, Y. S., & Smith, M. L. (1981) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800280104 · Cited by 409
Stochastic Optimal Control: Theory and Application
Stengel, R. F. (1986) · Medical Entomology and Zoology · Cited by 408
The Knowledge-Gradient Policy for Correlated Normal Beliefs
Frazier, P., Powell, W., & Dayanik, S. (2009) · INFORMS Journal on Computing · doi:10.1287/ijoc.1080.0314 · Cited by 408
Self-citationProceedings of the Winter Simulation Conference
Rose, O., & Uhrmacher, A. M. (2012) · Winter Simulation Conference · Cited by 401
On the pricing of American options
Karatzas, I. (1988) · Applied Mathematics & Optimization · doi:10.1007/bf01448358 · Cited by 382
2008 Winter Simulation Conference
(2008) · doi:10.1109/wsc14613.2008 · Cited by 376
Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control
Frey, J. (2004) · Journal of the American Statistical Association · doi:10.1198/jasa.2004.s362 · Cited by 375
Dynamic Programming and Suboptimal Control: A Survey from ADP to MPC*
Bertsekas, D. P. (2005) · European Journal of Control · doi:10.3166/ejc.11.310-334 · Cited by 366
Regression and Kriging metamodels with their experimental designs in simulation: A review
Kleijnen, J. P. C. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.06.041 · Cited by 324
Dvoretzky, A. (1956) · Contribution to the Theory of Statistics · doi:10.1525/9780520313880-007 · Cited by 323
Retailer-Supplier Flexible Commitments Contracts: A Robust Optimization Approach
Ben-Tal, A., Golany, B., Nemirovski, A., & Vial, J.-P. (2005) · Manufacturing & Service Operations Management · doi:10.1287/msom.1050.0081 · Cited by 322
Optimal Starting Times for End-of-Season Sales and Optimal Stopping Times for Promotional Fares
Feng, Y., & Gallego, G. (1995) · Management Science · doi:10.1287/mnsc.41.8.1371 · Cited by 314
Discrete Optimization via Simulation Using COMPASS
Hong, L. J., & Nelson, B. L. (2006) · Operations Research · doi:10.1287/opre.1050.0237 · Cited by 298
stochastic quasigradient methods and their application to system optimization†
Ermoliev, Y. (1983) · Stochastics · doi:10.1080/17442508308833246 · Cited by 280
Multi-armed Bandit Allocation Indices
Jones, P. W. (1989) · Journal of the Operational Research Society · doi:10.1057/jors.1989.200 · Cited by 280
Keyvanshokooh, E., Ryan, S. M., & Kabir, E. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.08.028 · Cited by 271
Optimal and Approximate Q-value Functions for Decentralized POMDPs
Oliehoek, F. A., Spaan, M. T. J., & Vlassis, N. (2008) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2447 · Cited by 265
Albers, S. (2003) · Mathematical Programming · doi:10.1007/s10107-003-0436-0 · Cited by 259
Ivanov, D., & Sokolov, B. (2013) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.08.021 · Cited by 241
Optimal learning: computational procedures for bayes-adaptive markov decision processes
Duff, M. O., & Barto, A. G. (2002) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 239
Munos, R. (2014) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000038 · Cited by 233
A review of simulation optimization techniques
Andradottir, S. (2002) · 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274) · doi:10.1109/wsc.1998.744910 · Cited by 204
Dynamic-Programming Approximations for Stochastic Time-Staged Integer Multicommodity-Flow Problems
Topaloğlu, H., & Powell, W. B. (2006) · INFORMS journal on computing · doi:10.1287/ijoc.1040.0079 · Cited by 195
Self-citationSimulation optimization methodologies
Azadivar, F. (1999) · Proceedings of the 31st conference on Winter simulation Simulation---a bridge to the future - WSC '99 · doi:10.1145/324138.324168 · Cited by 194
The fundamental risk quadrangle in risk management, optimization and statistical estimation
Rockafellar, R. T., & Uryasev, S. (2013) · Surveys in Operations Research and Management Science · doi:10.1016/j.sorms.2013.03.001 · Cited by 186
Robust multiobjective optimization & applications in portfolio optimization
Fliege, J., & Werner, R. (2013) · European Journal of Operational Research · doi:10.1016/j.ejor.2013.10.028 · Cited by 185
An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application
Simão, H. P., Day, J., George, A. P., Gifford, T., Nienow, J., & Powell, W. B. (2009) · Transportation Science · doi:10.1287/trsc.1080.0238 · Cited by 182
Self-citationAdaptive Online Gradient Descent
Hazan, E., Rakhlin, A., & Bartlett, P. L. (2007) · neural information processing systems · Cited by 182
The Allocation of Aircraft to Routes—An Example of Linear Programming Under Uncertain Demand
Ferguson, A. R., & Dantzig, G. B. (1956) · Management Science · doi:10.1287/mnsc.3.1.45 · Cited by 180
The Optimal Control of Partially Observable Markov Decision Processes.
Sondik, E. J. (1971) · Medical Entomology and Zoology · Cited by 170
Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming
George, A. P., & Powell, W. B. (2006) · Machine Learning · doi:10.1007/s10994-006-8365-9 · Cited by 164
Self-citationBayesian Optimization with GradientsPreprint
Wu, J., Poloczek, M., Wilson, A. G., & Frazier, P. I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04389 · Cited by 155
Petkau, A. J., Shiryayev, A. N., & Aries, A. B. (1979) · Journal of the American Statistical Association · doi:10.2307/2287018 · Cited by 154
Sequential Sampling to Myopically Maximize the Expected Value of Information
Chick, S. E., Branke, J., & Schmidt, C. (2009) · INFORMS journal on computing · doi:10.1287/ijoc.1090.0327 · Cited by 151
Chen, V. C. P., Ruppert, D., & Shoemaker, C. A. (1999) · Operations Research · doi:10.1287/opre.47.1.38 · Cited by 148
Best Arm Identification: A Unified Approach to Fixed Budget and Fixed Confidence
Gabillon, V., Ghavamzadeh, M., Lazaric, A., Lazaric, A., & Lazaric, R. (2012) · Cited by 144
Tutorial on Stochastic Optimization in Energy—Part I: Modeling and Policies
Powell, W. B., & Meisel, S. (2015) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2015.2424974 · Cited by 137
Self-citationThe Knowledge-Gradient Algorithm for Sequencing Experiments in Drug Discovery
Negoescu, D. M., Frazier, P. I., & Powell, W. B. (2010) · INFORMS journal on computing · doi:10.1287/ijoc.1100.0417 · Cited by 137
Self-citationRepresentation results for law invariant time consistent functions
Kupper, M., & Schachermayer, W. (2009) · Mathematics and Financial Economics · doi:10.1007/s11579-009-0019-9 · Cited by 133
Functional approximations and dynamic programming
Bellman, R., & Dreyfus, S. E. (1959) · Mathematics of Computation · doi:10.1090/s0025-5718-1959-0107376-8 · Cited by 131
A Hierarchy of Near-Optimal Policies for Multistage Adaptive Optimization
Bertsimas, D., Iancu, D. A., & Parrilo, P. A. (2011) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2011.2162878 · Cited by 130
Backpropagation and neurocontrol: a review and prospectus
Werbos, P. J. (1989) · doi:10.1109/ijcnn.1989.118583 · Cited by 129
On the complexity of best-arm identification in multi-armed bandit models
KaufmannEmilie, CappéOlivier, & GarivierAurélien (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.2946646 · Cited by 124
A Sequential Sampling Procedure for Stochastic Programming
Bayraksan, G., & Morton, D. P. (2011) · Operations Research · doi:10.1287/opre.1110.0926 · Cited by 117
Randomized smoothing for (parallel) stochastic optimization
Duchi, J. C., Bartlett, P. L., & Wainwright, M. J. (2012) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426698 · Cited by 114
Tutorial on Stochastic Optimization in Energy—Part II: An Energy Storage Illustration
Powell, W. B., & Meisel, S. (2015) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2015.2424980 · Cited by 110
Self-citationLuo, J., Hong, L. J., Nelson, B. L., & Yang, W. (2015) · Operations Research · doi:10.1287/opre.2015.1413 · Cited by 106
Online Routing Problems: Value of Advanced Information as Improved Competitive Ratios
Jaillet, P., & Wagner, M. R. (2006) · Transportation Science · doi:10.1287/trsc.1060.0147 · Cited by 101
On the Convergence Rates of Expected Improvement Methods
Ryzhov, I. O. (2016) · Operations Research · doi:10.1287/opre.2016.1494 · Cited by 98
An empirical analysis of scenario generation methods for stochastic optimization
Löhndorf, N. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.05.021 · Cited by 95
Hierarchical Knowledge Gradient for Sequential Sampling
Mes, M., Powell, W. B., & Frazier, P. I. (2011) · doi:10.5555/1953048.2078200 · Cited by 88
Self-citationBroadie, M. N., Cicek, D. M., & Zeevi, A. J. (2011) · Operations Research · doi:10.1287/opre.1110.0970 · Cited by 84
Efficient Ranking And Selection In Parallel Computing Environments
Ni, E. C. (2016) · eCommons (Cornell University) · Cited by 75
Agachi, P. Ș., Cristea, M. V., Csavdári, A. A., & Szilágyi, B. (2016) · De Gruyter eBooks · doi:10.1515/9783110306637-003 · Cited by 71
On the Stochastic Approximation Method of Robbins and Monro
Wolfowitz, J. (1952) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729391 · Cited by 70
Simulation-optimization via Kriging and bootstrapping: a survey
Kleijnen, J. P. C. (2014) · Journal of Simulation · doi:10.1057/jos.2014.4 · Cited by 49
A Distributional Interpretation of Robust Optimization
Xu, H., Caramanis, C., & Mannor, S. (2012) · Mathematics of Operations Research · doi:10.1287/moor.1110.0531 · Cited by 47
A Unified Framework for Optimization Under Uncertainty
Powell, W. B. (2016) · doi:10.1287/educ.2016.0149 · Cited by 43
Self-citationScenario Trees and Policy Selection for Multistage Stochastic Programming Using Machine Learning
Defourny, B., Ernst, D., & Wehenkel, L. A. (2012) · INFORMS journal on computing · doi:10.1287/ijoc.1120.0516 · Cited by 30
Theoretical Analysis of Heuristic Search Methods for Online POMDPs.
Ross, S., Pineau, J., & Chaib-draa, B. (2008) · PubMed · Cited by 28
Advances in Risk-Averse Optimization
Ruszczyński, A. (2013) · doi:10.1287/educ.2013.0110 · Cited by 18
Optimal learning for sequential sampling with non-parametric beliefs
Barut, E., & Powell, W. B. (2013) · Journal of Global Optimization · doi:10.1007/s10898-013-0050-5 · Cited by 14
Self-citationStochastic control theory : dynamic programming principle
西尾, 真. (2015) · Springer eBooks · Cited by 11
Saxena, A., & Bhardwaj, F. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-1062-5.ch001 · Cited by 10
Parallel Nonstationary Direct Policy Search for Risk-Averse Stochastic Optimization
Moazeni, S., Powell, W. B., Defourny, B., & Bouzaïene-Ayari, B. (2017) · INFORMS journal on computing · doi:10.1287/ijoc.2016.0733 · Cited by 9
Self-citation
Cited by
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Schrotenboer, A. H., Veenstra, A. A. T., uit het Broek, M. A. J., & Ursavas, E. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112744 · Cited by 296
Computational sustainability: computing for a better world and a sustainable future
Gomes, C., Dietterich, T., Barrett, C., Conrad, J., Dilkina, B., Ermon, S., Fang, F., Farnsworth, A., Fern, A., Fern, X., et al. (2019) · Communications of the ACM · doi:10.1145/3339399 · Cited by 126
Self-citationGoerigk, M., & Khosravi, M. (2023) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.03.019 · Cited by 20
Metadata
- Authors
- Powell, W. B.
- Venue
- European Journal of Operational Research
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 275
- Issue
- 3
- Pages
- 795-821
- ISSN
- 0377-2217 (ISSN-L)
- OpenAlex
- W2884675571
- Cited by
- 314
- References
- 172
- FWCI
- 17.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.