The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
A review of approaches to uncertainty assessment in energy system optimization models
Open accessAbstract
Abstract Energy system optimization models (ESOMs) have been used extensively in providing insights to decision makers on issues related to climate and energy policy. However, there is a concern that the uncertainties inherent in the model structures and input parameters are at best underplayed and at worst ignored. Compared to other types of energy models, ESOMs tend to use scenarios to handle uncertainties or treat them as a marginal issue. Without adequately addressing uncertainties, the model insights may be limited, lack robustness, and may mislead decision makers. This paper provides an in-depth review of systematic techniques that address uncertainties for ESOMs. We have identified four prevailing uncertainty approaches that have been applied to ESOM type models: Monte Carlo analysis, stochastic programming, robust optimization, and modelling to generate alternatives. For each method, we review the principles, techniques, and how they are utilized to improve the robustness of the model results to provide extra policy insights. In the end, we provide a critical appraisal on the use of these methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McKay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.2307/1271432 · Cited by 7,415
Introduction to Stochastic Programming
Birge, J. R., & Louveaux, F. (2011) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-1-4614-0237-4 · Cited by 6,469
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
(2004) · Cited by 5,198
McKay, M. D., Beckman, R. J., & Conover, W. J. (1979) · Technometrics · doi:10.1080/00401706.1979.10489755 · Cited by 3,220
Theory and Applications of Robust Optimization
Brown, D. B., Caramanis, C., & Bertsimas, D. (2010) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,524
Stochastic Programming: The State of the Art In Honor of George B. Dantzig
(2010) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-1-4419-1642-6 · Cited by 2,239
Soyster, A. L. (1973) · Operations Research · doi:10.1287/opre.21.5.1154 · Cited by 1,822
Lectures on Stochastic Programming: Modeling and Theory
Shapiro, A., Dentcheva, D., & Ruszczyński, A. (2009) · Cited by 1,735
Robust optimization ? methodology and applications
Ben-Tal, A., & Nemirovski, A. (2002) · Mathematical Programming · doi:10.1007/s101070100286 · Cited by 1,409
Linear Programming Under Uncertainty
Dantzig, G. B. (2004) · Management Science · doi:10.1287/mnsc.1040.0261 · Cited by 1,173
Energy systems modeling for twenty-first century energy challenges
Pfenninger, S., Hawkes, A., & Keirstead, J. (2014) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2014.02.003 · Cited by 1,164
How to avoid a perfunctory sensitivity analysis
Saltelli, A., & Annoni, P. (2010) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2010.04.012 · Cited by 974
Sachs, L. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 973
Robust Solutions to Uncertain Semidefinite Programs
El Ghaoui, L., Oustry, F., & Lebret, H. (1998) · SIAM Journal on Optimization · doi:10.1137/s1052623496305717 · Cited by 935
OSeMOSYS: The Open Source Energy Modeling System
Howells, M., Rogner, H., Strachan, N., Heaps, C., Huntington, H., Kypreos, S., Hughes, A., Silveira, S., DeCarolis, J., Bazillian, M., et al. (2011) · Energy Policy · doi:10.1016/j.enpol.2011.06.033 · Cited by 850
Self-citationUse (and abuse) of expert elicitation in support of decision making for public policy
Morgan, M. G. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319946111 · Cited by 702
Jebaraj, S., & Iniyan, S. (2006) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2004.09.004 · Cited by 685
Importance Sampling for Stochastic Simulations
Glynn, P. W., & Iglehart, D. L. (1989) · Management Science · doi:10.1287/mnsc.35.11.1367 · Cited by 635
Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming
Soyster, A. L. (2016) · Cited by 628
Decision making under uncertainty in energy systems: State of the art
Soroudi, A., & Amraee, T. (2013) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2013.08.039 · Cited by 548
An overview of methods to evaluate uncertainty of deterministic models in decision support
Uusitalo, L., Lehikoinen, A., Helle, I., & Myrberg, K. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.09.017 · Cited by 538
Bazmi, A. A., & Zahedi, G. (2011) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2011.05.003 · Cited by 470
Formalizing best practice for energy system optimization modelling
DeCarolis, J., Daly, H., Dodds, P., Keppo, I., Li, F., McDowall, W., Pye, S., Strachan, N., Trutnevyte, E., Usher, W., et al. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.03.001 · Cited by 389
Self-citationUncertainty in Integrated Assessment Modelling
van Asselt, M. B. A., & Rotmans, J. (2002) · Climatic Change · doi:10.1023/a:1015783803445 · Cited by 379
The Use and Misuse of Models for Climate Policy
Pindyck, R. S. (2017) · Review of Environmental Economics and Policy · doi:10.1093/reep/rew012 · Cited by 374
Ravets, J. R. (1999) · Futures · Cited by 369
Riahi, K., Kriegler, E., Johnson, N., Bertram, C., den Elzen, M., Eom, J., Schaeffer, M., Edmonds, J., Isaac, M., Krey, V., et al. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2013.09.016 · Cited by 360
A review of energy system models
Bhattacharyya, S. C., & Timilsina, G. R. (2010) · International Journal of Energy Sector Management · doi:10.1108/17506221011092742 · Cited by 348
Information-gap decision theory : decisions under severe uncertainty
Ben‐Haim, Y. (2001) · Academic Press eBooks · Cited by 329
Soft-linking of a power systems model to an energy systems model
Deane, J. P., Chiodi, A., Gargiulo, M., & Ó Gallachóir, B. P. (2012) · Energy · doi:10.1016/j.energy.2012.03.052 · Cited by 271
Self-citationHourcade, J.-C., Jaccard, M., Bataille, C., & Ghersif, F. (2006) · The Energy Journal · doi:10.5547/issn0195-6574-ej-volsi2006-nosi2-1 · Cited by 260
Edenhofer, O., Lessmann, K., Kemfert, C., Grubb, M., & Köhler, J. (2006) · The Energy Journal · doi:10.5547/issn0195-6574-ej-volsi2006-nosi1-3 · Cited by 237
Applied Statistics—A Handbook of Techniques
Schmee, J. (1985) · Technometrics · doi:10.1080/00401706.1985.10488024 · Cited by 187
Modeling for insight using Tools for Energy Model Optimization and Analysis (Temoa)
Hunter, K., Sreepathi, S., & DeCarolis, J. F. (2013) · Energy Economics · doi:10.1016/j.eneco.2013.07.014 · Cited by 174
Self-citationO’Hagan, A. (2011) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2011.03.003 · Cited by 154
Energy/Environmental Modeling with the MARKAL Family of Models
Seebregts, A. J., Goldstein, G. A., & Smekens, K. (2002) · Springer eBooks · doi:10.1007/978-3-642-50282-8_10 · Cited by 148
Improving the way we think about projecting future energy use and emissions of carbon dioxide
Morgan, M. G., & Keith, D. W. (2008) · Climatic Change · doi:10.1007/s10584-008-9458-1 · Cited by 148
Modelling to generate alternatives with an energy system optimization model
DeCarolis, J. F., Babaee, S., Li, B., & Kanungo, S. K. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.11.019 · Cited by 143
Self-citationApproaches for performing uncertainty analysis in large-scale energy/economic policy models
Kann, A., & Weyant, J. P. (2000) · Environmental Modeling & Assessment · doi:10.1023/a:1019041023520 · Cited by 137
Information gap decision theory approach to deal with wind power uncertainty in unit commitment
Soroudi, A., Rabiee, A., & Keane, A. (2017) · Electric Power Systems Research · doi:10.1016/j.epsr.2017.01.001 · Cited by 135
An integrated systematic analysis of uncertainties in UK energy transition pathways
Pye, S., Sabio, N., & Strachan, N. D. (2015) · Energy Policy · doi:10.1016/j.enpol.2014.12.031 · Cited by 132
Self-citationZeng, Y., Cai, Y., Huang, G., & Dai, J. (2011) · Energies · doi:10.3390/en4101624 · Cited by 118
Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis
Linstone, H. A. (2003) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2003.09.006 · Cited by 116
Price, J., & Keppo, I. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.03.065 · Cited by 115
Sensitivity to Energy Technology Costs: A Multi-Model Comparison AnalysisPreprint
Bosetti, V., Marangoni, G., Borgonovo, E., Anadón, L. D., Barron, R., McJeon, H. C., Politis, S., & Friley, P. (2016) · SSRN Electronic Journal · doi:10.1016/j.enpol.2014.12.012 · Cited by 114
Chiodi, A., Gargiulo, M., Rogan, F., Deane, P., Lavigne, D., Rout, U. K., & Gallachóir, B. Ó. (2012) · Energy Policy · doi:10.1016/j.enpol.2012.10.045 · Cited by 114
Self-citationEnergy scenario choices: Insights from a retrospective review of UK energy futures
Trutnevyte, E., McDowall, W., Tomei, J., & Keppo, I. (2015) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.10.067 · Cited by 113
Critical mid-term uncertainties in long-term decarbonisation pathways
Usher, W., & Strachan, N. D. (2011) · Energy Policy · doi:10.1016/j.enpol.2011.11.004 · Cited by 103
Long‐term energy models: Principles, characteristics, focus, and limitations
Gargiulo, M., & Gallachóir, B. Ó. (2013) · Wiley Interdisciplinary Reviews Energy and Environment · doi:10.1002/wene.62 · Cited by 102
Self-citationReinvigorating the scenario technique to expand uncertainty consideration
Trutnevyte, E., Guivarch, C., Lempert, R. J., & Strachan, N. D. (2016) · Climatic Change · doi:10.1007/s10584-015-1585-x · Cited by 102
Li, F. G. N., & Pye, S. (2017) · Energy Research & Social Science · doi:10.1016/j.erss.2017.10.003 · Cited by 86
Self-citationLi, F. G. N., & Trutnevyte, E. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.12.047 · Cited by 83
Self-citationA global renewable energy system: A modelling exercise in ETSAP/TIAM
Føyn, T. H. Y., Karlsson, K. B., Balyk, O., & Grohnheit, P. E. (2010) · Applied Energy · doi:10.1016/j.apenergy.2010.05.003 · Cited by 81
Electrification of the Canadian road transportation sector: A 2050 outlook with TIMES-Canada
Bahn, O., Marcy, M., Vaillancourt, K., & Waaub, J. (2013) · Energy Policy · doi:10.1016/j.enpol.2013.07.023 · Cited by 79
Guivarch, C., Lempert, R. J., & Trutnevyte, E. (2017) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.07.017 · Cited by 78
Formulating an optimal long-term energy supply strategy for Syria using MESSAGE model
Hainoun, A., Aldin, M. S., & Almoustafa, S. (2010) · Energy Policy · doi:10.1016/j.enpol.2009.11.032 · Cited by 73
Dutta, M., & Mukherjee, S. (2010) · Energy Policy · doi:10.1016/j.enpol.2010.07.056 · Cited by 70
Trutnevyte, E. (2013) · Applied Energy · doi:10.1016/j.apenergy.2013.04.083 · Cited by 66
Myopic decision making in energy system decarbonisation pathways. A UK case study
Nerini, F. F., Keppo, I., & Strachan, N. D. (2017) · Energy Strategy Reviews · doi:10.1016/j.esr.2017.06.001 · Cited by 65
Biofuel futures in road transport – A modeling analysis for Sweden
Börjesson, M., Ahlgren, E. O., Lundmark, R., & Athanassiadis, D. (2014) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2014.08.002 · Cited by 63
Hydrogen perspectives in Italy: Analysis of possible deployment scenarios
Contaldi, M., Gracceva, F., & Mattucci, A. (2008) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2007.12.035 · Cited by 59
Conditions for the successful deployment of electric vehicles – A global energy system perspective
Densing, M., Turton, H., & Bäuml, G. (2012) · Energy · doi:10.1016/j.energy.2012.09.011 · Cited by 59
Gracceva, F., & Zeniewski, P. (2013) · Energy · doi:10.1016/j.energy.2013.06.006 · Cited by 56
Chiodi, A., Gargiulo, M., Deane, P., Lavigne, D., Rout, U. K., & Gallachóir, B. Ó. (2013) · Energy Policy · doi:10.1016/j.enpol.2013.07.129 · Cited by 52
Self-citationIncorporating Uncertainty into World Energy Modelling: the PROMETHEUS Model
Fragkos, P. F., Kouvaritakis, N., & Capros, P. (2015) · Environmental Modeling & Assessment · doi:10.1007/s10666-015-9442-x · Cited by 51
Energy Security Analysis: The case of constrained oil supply for Ireland
Glynn, J. D. M., Chiodi, A., Gargiulo, M., Deane, P., Bazilian, M., & Gallachóir, B. Ó. (2013) · Energy Policy · doi:10.1016/j.enpol.2013.11.043 · Cited by 42
Self-citationLEAPs and Bounds—an Energy Demand and Constraint Optimised Model of the Irish Energy System
Rogan, F., Cahill, C. J., Daly, H., Dineen, D., Deane, P., Heaps, C., Welsch, M., Howells, M., Bazilian, M., & Gallachóir, B. Ó. (2013) · Energy Efficiency · doi:10.1007/s12053-013-9231-9 · Cited by 40
Self-citationYeh, S., Loughlin, D. H., Lenox, C. S., & Gage, C. L. (2006) · Proceedings of the IEEE · doi:10.1109/jproc.2006.883719 · Cited by 38
How much can nuclear power reduce climate mitigation cost? – Critical parameters and sensitivity
Lehtveer, M., & Hedenus, F. (2014) · Energy Strategy Reviews · doi:10.1016/j.esr.2014.11.003 · Cited by 35
Kemp, L. (2017) · Nature Climate Change · doi:10.1038/nclimate3309 · Cited by 33
The Role of Bioenergy in Ireland’s Low Carbon Future – Is it Sustainable?
Chiodi, A., Deane, P., Gargiulo, M., & Gallachóir, B. Ó. (2015) · Journal of Sustainable Development of Energy Water and Environment Systems · doi:10.13044/j.sdewes.2015.03.0016 · Cited by 32
Self-citationStrategic responses to CO2 emission reduction targets drive shift in U.S. electric sector water use
Cameron, C., Yelverton, W. H., Dodder, R., & West, J. J. (2014) · Energy Strategy Reviews · doi:10.1016/j.esr.2014.07.003 · Cited by 27
Durbach, I. N., Merven, B., & McCall, B. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.11.007 · Cited by 27
Czyrnek-Delêtre, M. M., Chiodi, A., Murphy, J. D., & Gallachóir, B. Ó. (2016) · Clean Technologies and Environmental Policy · doi:10.1007/s10098-016-1145-8 · Cited by 26
Self-citationCosts of Reducing Carbon Emissions: An Integrated Modeling Framework Approach
Gritsevskyi, A., & Schrattenholzer, L. (2003) · Climatic Change · doi:10.1023/a:1021364008426 · Cited by 22
Labriet, M., Nicolas, C., Tchung-Ming, S., Kanudia, A., & Loulou, R. (2015) · Lecture notes in energy · doi:10.1007/978-3-319-16540-0_4 · Cited by 17
Validity of CVM related to the type of environmental good; and empirical test
Wierstra, E., Geurts, P., & van der Veen, A. (2001) · Integrated Assessment · doi:10.1023/a:1011569408162 · Cited by 8
Applying Bayesian model averaging for uncertainty estimation of input data in energy modelling
Culka, M. (2014) · Energy Sustainability and Society · doi:10.1186/s13705-014-0021-9 · Cited by 7
Cited by
Classification and challenges of bottom-up energy system models - A review
Prina, M. G., Manzolini, G., Moser, D., Nastasi, B., & Sparber, W. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109917 · Cited by 403
Metadata
- Authors
- Yue, X., Pye, S., DeCarolis, J., Li, F. G. N., Rogan, F., & Gallachóir, B. Ó.
- Venue
- Energy Strategy Reviews
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 21
- Pages
- 204-217
- ISSN
- 2211-467X (ISSN-L)
- OpenAlex
- W2884899745
- Cited by
- 256
- References
- 79
- FWCI
- 6.30
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.