The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Is optimization optimistically biased?
Abstract
Does optimization systematically lead to solutions that appear better than they actually turn out to be when implemented? The answer can be yes if there are errors in estimating objective function coefficients. Even if such errors are unbiased, the calculated value of the objective function for the optimal solution will, in an expected value sense, overstate that solution's true performance. This presupposes that errors in the constraint set are relatively unimportant. The existence of such a bias is shown by proof; Monte Carlo simulations of two realistic water resources optimization problems show its significance for water planners. The most important implication is that the estimated net benefits of model solutions may be exaggerated compared to existing water systems, whose performance is generally known with more accuracy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Regret in Decision Making under Uncertainty
Bell, D. E. (1982) · Operations Research · doi:10.1287/opre.30.5.961 · Cited by 3,025
Applied Statistical Decision Theory
Lindley, D. V., Raiffa, H., & Schlaifer, R. (1962) · Econometrica · doi:10.2307/1909900 · Cited by 2,183
Applied Statistical Decision Theory.
Roberts, H. V., Raiffa, H., & Schlaifer, R. (1962) · Journal of the American Statistical Association · doi:10.2307/2282452 · Cited by 1,466
Disappointment in Decision Making Under Uncertainty
Bell, D. E. (1985) · Operations Research · doi:10.1287/opre.33.1.1 · Cited by 1,260
Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability
Bartlett, M. S. (1963) · Technometrics · doi:10.1080/00401706.1963.10490087 · Cited by 1,184
Water resource systems planning and analysis
Loucks, D. P., Stedinger, J. R., & Haith, D. A. (1981) · Medical Entomology and Zoology · Cited by 673
Water resource systems planning and analysis
France, P. W. (1981) · Advances in Water Resources · doi:10.1016/0309-1708(81)90046-4 · Cited by 537
On the Solution of Two-stage Linear Programs under Uncertainty
Dantzig, G. B., & Medansky, A. (1961) · Project Euclid (Cornell University) · Cited by 195
(2011) · SpringerReference · doi:10.1007/springerreference_6206 · Cited by 178
Use of systems analysis in water management
Rogers, P. P., & Fiering, M. B. (1986) · Water Resources Research · doi:10.1029/wr022i09sp0146s · Cited by 148
Research works printed but not linked: 3
- Read E. G. J. F.Boshier Biases in stochastic reservoir scheduling modelsBellman Workshop on Dynamic Programming in Water ResourcesNat. Sci. Found.Atlanta Ga.June 1986.
- ThomasJr. H. A. Capacity expansion of public works report 14Harvard Univ. Cambridge Mass.January 1967.
- Wyatt T. P. E.Robinson T. C.Muir Systems simulation and optimization—Useless useful or essential?in Proceedings Sixth World Congress of the International Water Resources Association OttawaInternational Water Resources AssociationUrbana Ill. 1988.
Cited by
Sorted by citations
Salvato, E., Fenu, G., Medvet, E., & Pellegrino, F. A. (2021) · IEEE Access · doi:10.1109/access.2021.3126658 · Cited by 200
Kangas, A. S., & Kangas, J. (2004) · Forest Policy and Economics · doi:10.1016/s1389-9341(02)00083-7 · Cited by 155
Stochastic Optimization of Sub-Hourly Economic Dispatch With Wind Energy
Gangammanavar, H., Sen, S., & Zavala, V. M. (2015) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2015.2410301 · Cited by 106
“, hourly resolution models) tend to choose “optimal” settings with little room for error [11].”
BackgroundMultiple‐use planning of forest resources by using the analytic hierarchy process
Kangas, J. (1992) · Scandinavian Journal of Forest Research · doi:10.1080/02827589209382718 · Cited by 94
Scenario-Based Robust Optimization of Regional Water and Wastewater Infrastructure
Kang, D., & Lansey, K. (2012) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0000236 · Cited by 80
Data-Efficient Domain Randomization With Bayesian Optimization
Muratore, F., Eilers, C., Gienger, M., & Peters, J. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3052391 · Cited by 77
Combining physics and deep learning to learn continuous-time dynamics models
Lutter, M., & Peters, J. (2023) · The International Journal of Robotics Research · doi:10.1177/02783649231169492 · Cited by 94
“Furthermore, it has been shown that the MSE is not a good substitute to predict the control performance of a learned model and commonly overestimates the performance (Hobbs and Hepenstal 1989; Lambert et al. 2020; Lutter et al. 2021a).”
BackgroundMultiperiod Planning of Water Supply Infrastructure Based on Scenario Analysis
Kang, D., & Lansey, K. (2012) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0000310 · Cited by 75
“When scenarios other than the design scenario actually occur, the actual costs will be higher than the optimal cost and the implemented design is always inferior to the optimal design (Hobbs and Hepenstal 1989).”
BackgroundAssessing Transferability From Simulation to Reality for Reinforcement Learning
Muratore, F., Gienger, M., & Peters, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2952353 · Cited by 67
A Global Optimization Approach to a Water Distribution Network Design Problem
Sherali, H. D., & Smith, E. P. (1997) · Journal of Global Optimization · doi:10.1023/a:1008207817095 · Cited by 63
“Hobbs and Hepenstal (1989) suggest another enhancement based on using Monte-Carlo simulation techniques to assess the network performance under various random operating conditions within the design process.”
MethodKangas, J., Hokkanen, J., Kangas, A. S., Lahdelma, R., & Salminen, P. (2003) · Forest Science · doi:10.1093/forestscience/49.6.928 · Cited by 51
He, L., Huang, G., Zeng, G., & Lu, H. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.009 · Cited by 48
“…systems for patterns recognition and knowledge discovery (Avci, 2007; Ceylan & Özbay, 2007; Duport, Girel, & Chassery, 1996; Galal, 2002; Hobbs & Hepenstal, 1989; Hsieh & Kuo, 2008; Li & Shue, 2004; Lung, 2006, 2007; Mallat, 1989; Murtagh, Starck, & Bijaoui, 1995; Osowski & Nghia,…”
Optimization bias in forest management planning solutions due to errors in forest variables
Kangas, A. S., & Kangas, J. (1999) · Silva Fennica · doi:10.14214/sf.651 · Cited by 44
“This means that the value of the optimal solution will be overestimated if there are random errors in the objective function coefficients (Hobbs and Hepenstal 1989).”
BackgroundCanada's electricity system transition under alternative policy scenarios
Arjmand, R., & McPherson, M. (2022) · Energy Policy · doi:10.1016/j.enpol.2022.112844 · Cited by 39
A Real‐Time Approach to Management and Monitoring of Groundwater Hydraulics
Andričević, R. (1990) · Water Resources Research · doi:10.1029/wr026i011p02747 · Cited by 38
Domain Randomization for Simulation-Based Policy Optimization with Transferability Assessment
Muratore, F., Treede, F., Gienger, M., & Peters, J. (2018) · MPG.PuRe (Max Planck Society) · Cited by 34
Estimation of Downside Risks in Project Portfolio Selection
Kettunen, J., & Salo, A. A. (2017) · Production and Operations Management · doi:10.1111/poms.12727 · Cited by 26
“Hobbs and Hepenstal (1989) analyzed this phenomenon in water resources optimization problems calling it optimistically biased optimization .”
BackgroundRandom Variables versus Uncertain Values: Stochastic Modeling and Design
Lund, J. R. (1991) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)0733-9496(1991)117:2(179 · Cited by 20
Scenario-Based Multistage Construction of Water Supply Infrastructure
Kang, D., & Lansey, K. (2012) · World Environmental and Water Resources Congress (EWRI) · doi:10.1061/9780784412312.328 · Cited by 17
Sherali, H. D., Smith, E. P., & Kim, S.-I. (1996) · Nonconvex optimization and its applications · doi:10.1007/978-1-4757-5331-8_11 · Cited by 14
Sechi, G. M., Gaivoronski, A. A., & Napolitano, J. (2019) · Water Resources Management · doi:10.1007/s11269-019-02219-6 · Cited by 9
Multiperiod Optimization Framework for Urban Drainage System Planning: A Scenario-Based Approach
Kwon, S. H., & Jung, D. (2023) · Journal of Water Resources Planning and Management · doi:10.1061/jwrmd5.wreng-6119 · Cited by 8
Mallit, ennusteet ja simulointi metsätalouden laskentajärjestelmissä
Kangas, A. S., & Kangas, J. (1970) · Metsätieteen aikakauskirja · doi:10.14214/ma.6478 · Cited by 8
Ekologiset mallit ja ekologisten riskien hallinta metsäsuunnittelussa
Kangas, A. S., & Kangas, J. (1970) · Metsätieteen aikakauskirja · doi:10.14214/ma.6963 · Cited by 8
Bayesian Domain Randomization for Sim-to-Real Transfer.Preprint
Muratore, F., Eilers, C., Gienger, M., & Peters, J. (2020) · arXiv (Cornell University) · Cited by 8
Mathematical Modelling for Optimal Vaccine Dose Finding: Maximising Efficacy and Minimising Toxicity
Benest, J., Rhodes, S., Evans, T. G., & White, R. G. (2022) · Vaccines · doi:10.3390/vaccines10050756 · Cited by 6
“We note that an overestimation bias is expected in both model-based [48,49] and traditional comparative dose-selection [54]”
BackgroundMethodChang, S., Liaw, S., Railsback, S. F., & Salé, M. J. (1992) · Water Resources Research · doi:10.1029/92wr01607 · Cited by 4
OPTIMAL SIZING OF IRRIGATION DELIVERY SYSTEMS USING A TWO-STAGE STOCHASTIC PROGRAMMING APPROACH
Elshorbagy, W. E., Lansey, K., & Slack, D. C. (2001) · Civil Engineering and Environmental Systems · doi:10.1080/02630250108970307 · Cited by 4
Kangas, A. S., Kurttila, M., Hujala, T., Eyvindson, K., & Kangas, J. (2015) · Managing forest ecosystems · doi:10.1007/978-3-319-23522-6_8 · Cited by 2
A Study on Objective Functions for the Multi-purpose Dam Operation Plan in Korea
Eum, H., Kim, Y.-O., Yun, J.-H., & Ko, I.-H. (2005) · Journal of Korea Water Resources Association · doi:10.3741/jkwra.2005.38.9.737 · Cited by 2
Combining Physics and Deep Learning for Continuous-Time Dynamics Models
Lutter, M. (2023) · Springer tracts in advanced robotics · doi:10.1007/978-3-031-37832-4_3 · Cited by 2
SEQUENTIAL APPROACH TO GROUNDWATER MONITORING AND MANAGEMENT
Andričević, R., & Falls, A. (1990)
Metadata
- Authors
- Hobbs, B. F., & Hepenstal, A.
- ORCID
- Hobbs, Benjamin F.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 1989-02
- Volume
- 25
- Issue
- 2
- Pages
- 152-160
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W1990277704
- Cited by
- 33
- References
- 24
- Citations by year
- 2023: 3 · 2022: 2 · 2021: 2 · 2020: 1 · 2019: 3 · 2018: 1 · 2017: 1 · 2015: 2 · 2012: 3
- FWCI
- 6.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Water Resources Research (publishedVersion)
- Topics
- Physical Sciences › Environmental Science › Water Science and Technology › Water resources management and optimization
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimization and Mathematical Programming
- Social Sciences › Decision Sciences › Management Science and Operations Research › Risk and Portfolio Optimization
- Keywords
- water resources planning, water allocation model
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
