The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A review of methods to match building energy simulation models to measured data
Open accessAbstract
Renewable and Sustainable Energy Reviews 37 (2014) 123–141 Contents lists available at ScienceDirect Renewable and Sustainable Energy Reviews journal homepage: www.elsevier.com/locate/rser A review of methods to match building energy simulation models to measured data Daniel Coakley a,b, n , Paul Raftery c , Marcus Keane a,b a Department of Civil Engineering, NUI Galway, Ireland Informatics Research Unit for Sustainable Engineering (IRUSE), NUI Galway, Ireland c Centre for the Built Environment (CBE), University of California, Berkeley, United States b art ic l e i nf o a b s t r a c t Article history: Received 19 March 2014 Accepted 3 May 2014 Whole building energy simulation (BES) models play a significant role in the design and optimisation of buildings. Simulation models may be used to compare the cost-effectiveness of energy-conservation measures (ECMs) in the design stage as well as assessing various performance optimisation measures during the operational stage. However, due to the complexity of the built environment and prevalence of large numbers of independent interacting variables, it is difficult to achieve an accurate representation of real-world building operation. Therefore, by reconciling model outputs with measured data, we can achieve more accurate and reliable results. This reconciliation of model outputs with measured data is known as calibration. This paper presents a detailed review of current approaches to model development and calibration, highlighting the importance of uncertainty in the calibration process. This is accompanied by a detailed assessment of the various analytical and mathematical/statistical tools employed by practitioners to date, as well as a discussion on both the problems and the merits of the presented approaches. & 2014 Elsevier Ltd. All rights reserved. Keywords: Review Calibration Optimisation Simulation EnergyPlus Uncertainty Contents Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Building energy performance simulation (BEPS) tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Benefits of BEPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 2. Problems with BEPS and model calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 3. Methods for assessing calibration performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 4. Uncertainty in building simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 5. Current approaches to BEPS calibration: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Analytical tools and techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Mathematical/statistical techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Summary of manual calibration developments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Characterisation techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Advanced graphical approaches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Procedural extensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Summary of automated calibration developments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 Optimisation techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 Alternative modelling techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 6. Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 7. Graphical summary of reviewed papers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Appendix A. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 n Corresponding author at: Department of Civil Engineering, NUI Galway, Ireland. Tel.: þ 353 87 2285147. E-mail address: daniel.coakley@nuigalway.ie (D. Coakley). http://dx.doi.org/10.1016/j.rser.2014.05.007 1364-0321/& 2014 Elsevier Ltd. All rights reserved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
System Identification: Theory for the User
Lennart Ljung, A. (1987) · Cited by 17,690
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Oreskes, N., Shrader-Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,010
EnergyPlus: creating a new-generation building energy simulation program
Crawley, D. B., Lawrie, L. K., Winkelmann, F. C., Buhl, W. F., Huang, Y. J., Pedersen, C. O., Strand, R. K., Liesen, R. J., Fisher, D. E., Witte, M. J., et al. (2001) · Energy and Buildings · doi:10.1016/s0378-7788(00)00114-6 · Cited by 2,822
Contrasting the capabilities of building energy performance simulation programs
Crawley, D. B., Hand, J. W., Kummert, M., & Griffith, B. T. (2008) · Building and Environment · doi:10.1016/j.buildenv.2006.10.027 · Cited by 1,858
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
McCulloch, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2005.358_16.x · Cited by 1,842
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004) · Cited by 1,797
Uncertainty and Quality in Science for Policy
Funtowicz, S. O., & Ravetz, J. R. (1990) · doi:10.1007/978-94-009-0621-1 · Cited by 1,575
Dynamic System Identification - Experiment Design and Data Analysis
(1977) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6188-0 · Cited by 1,398
Sensitivity Analysis for Importance Assessment
Saltelli, A. (2002) · Risk Analysis · doi:10.1111/0272-4332.00040 · Cited by 1,302
Prophecy, reality and uncertainty in distributed hydrological modelling
Beven, K. (1993) · Advances in Water Resources · doi:10.1016/0309-1708(93)90028-e · Cited by 1,169
Life itself: a comprehensive inquiry into the nature, origin, and fabrication of life
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4505 · Cited by 1,039
Bayesian analysis of computer code outputs: A tutorial
O’Hagan, A. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.025 · Cited by 755
Neto, A. H., & Fiorelli, F. A. S. (2008) · Energy and Buildings · doi:10.1016/j.enbuild.2008.06.013 · Cited by 611
Calibration of building energy models for retrofit analysis under uncertainty
Heo, Y., Choudhary, R., & Augenbroe, G. A. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2011.12.029 · Cited by 597
Artificial neural networks for the prediction of the energy consumption of a passive solar building
Kalogirou, S. A. (2000) · Energy · doi:10.1016/s0360-5442(99)00086-9 · Cited by 533
Do LEED-certified buildings save energy? Not really…
Scofield, J. H. (2009) · Energy and Buildings · doi:10.1016/j.enbuild.2009.08.006 · Cited by 352
Modeling and predicting building's energy use with artificial neural networks: Methods and results
Karatasou, S., Santamouris, M., & Geros, V. (2006) · Energy and Buildings · doi:10.1016/j.enbuild.2005.11.005 · Cited by 332
Analysis of uncertainty in building design evaluations and its implications
de Wit, S., & Augenbroe, G. (2002) · Energy and Buildings · doi:10.1016/s0378-7788(02)00070-1 · Cited by 317
Calibrating whole building energy models: An evidence-based methodology
Raftery, P., Keane, M. M., & O’Donnell, J. (2011) · Energy and Buildings · doi:10.1016/j.enbuild.2011.05.020 · Cited by 291
Self-citationAronica, G., Hankin, B., & Beven, K. (1998) · Advances in Water Resources · doi:10.1016/s0309-1708(98)00017-7 · Cited by 278
A methodology for meta-model based optimization in building energy models
Eisenhower, B., O’Neill, Z., Narayanan, S., Fonoberov, V. A., & Mezić, I. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2011.12.001 · Cited by 270
Reddy, T. A. (2006) · ASHRAE winter conference papers · Cited by 253
Sensitivity analysis of energy performance of office buildings
Lam, J. C., & Hui, S. C. M. (1996) · Building and Environment · doi:10.1016/0360-1323(95)00031-3 · Cited by 243
Manfren, M., Aste, N., & Moshksar, R. (2013) · Applied Energy · doi:10.1016/j.apenergy.2012.10.031 · Cited by 214
Augenbroe, G. (2002) · Building and Environment · doi:10.1016/s0360-1323(02)00041-0 · Cited by 208
Wang, L., Mathew, P., & Pang, X. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2012.06.017 · Cited by 198
Reddy, T. A., Maor, I., & Panjapornpon, C. (2007) · HVAC&R Research · doi:10.1080/10789669.2007.10390952 · Cited by 195
96/05445 Sensitivity analysis of energy performance of office buildings
(1996) · Fuel and Energy Abstracts · doi:10.1016/0140-6701(96)80114-7 · Cited by 193
DOE-2 supplement: Version 2.1E
Lab., C. (. S. L. B., Winkelmann, F. C., USDOE, W., Hirsch (James J.) and Associates, C., Birdsall, B., Buhl, W. F., Ellington, K. L., Erdem, A., Hirsch, J., & Gates, S. (1993) · doi:10.2172/10147851 · Cited by 170
Uncertainty and sensitivity decomposition of building energy models
Eisenhower, B., O'Neill, Z., Fonoberov, V. A., & Mezić, I. (2012) · Journal of Building Performance Simulation · doi:10.1080/19401493.2010.549964 · Cited by 168
Modelling the heat consumption in district heating systems using a grey-box approach
Nielsen, H. A., & Madsen, H. (2005) · Energy and Buildings · doi:10.1016/j.enbuild.2005.05.002 · Cited by 159
On the energy consumption in residential buildings
Mihalakakou, G. K., Santamouris, M., & Tsangrassoulis, A. (2002) · Energy and Buildings · doi:10.1016/s0378-7788(01)00137-2 · Cited by 153
Bayesian Non-Linear Modeling for the Prediction Competition
Mackay, D. (1996) · Springer eBooks · doi:10.1007/978-94-015-8729-7_18 · Cited by 143
Green Building Performance Evaluation: Measured Results from LEED-New Construction Buildings
Turner, C., & Frankel, M. (2008) · Cited by 133
Analytical and comparative testing of EnergyPlus using IEA HVAC BESTEST E100–E200 test suite
Henninger, R. H., Witte, M. J., & Crawley, D. B. (2004) · Energy and Buildings · doi:10.1016/j.enbuild.2004.01.025 · Cited by 132
de Wilde, P., & Tian, W. (2009) · Building Simulation · doi:10.1007/s12273-009-9116-1 · Cited by 115
Global Sensitivity Analysis: An Introduction
Saltelli, A., Tarantola, S., & Campolongo, F. (2005) · Cited by 105
A hierarchical Bayesian framework for calibrating micro-level models with macro-level data
Booth, A. T., Choudhary, R., & Spiegelhalter, D. J. (2013) · Journal of Building Performance Simulation · doi:10.1080/19401493.2012.723750 · Cited by 90
Reddy, T. A., & Andersen, K. K. (2002) · Science and Technology for the Built Environment · doi:10.1080/10789669.2002.10391291 · Cited by 78
Coakley, D., Raftery, P., Molloy, P., & White, G. (2011) · Cited by 42
Self-citationPredicting hourly building energy usage
Kreider, J. F., & Haberl, J. S. (1994) · ASHRAE journal · Cited by 31
Calibration of a building energy model using measured data
Monfet, D., Charneux, R., Zmeureanu, R., & Lemire, N. (2009) · Espace ÉTS (ETS) · Cited by 20
A CALIBRATED WHOLE BUILDING SIMULATION APPROACH TO ASSESSING RETROFIT OPTIONS FOR BIRMINGHAM AIRPORT
Parker, J., Cropper, P. C., & Shao, L. (2012) · DMU Open Research Archive (De Montfort University) · Cited by 14
Cited by
Data-driven predictive control for unlocking building energy flexibility: A review
Kathirgamanathan, A., De Rosa, M., Mangina, E., & Finn, D. P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110120 · Cited by 321
Chou, J.-S., & Tran, D.-S. (2018) · Energy · doi:10.1016/j.energy.2018.09.144 · Cited by 279
Building model calibration using energy and environmental data
Royapoor, M., & Roskilly, T. (2015) · Energy and Buildings · doi:10.1016/j.enbuild.2015.02.050 · Cited by 277
Sokol, J., Cerezo Davila, C., & Reinhart, C. F. (2017) · Energy and Buildings · doi:10.1016/j.enbuild.2016.10.050 · Cited by 270
Urban building energy modeling: State of the art and future prospects
Johari, F., Peronato, G., Sadeghian, P., Zhao, X., & Widén, J. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109902 · Cited by 263
Metadata
- Authors
- Coakley, D., Raftery, P., & Keane, M.
- Venue
- Renewable and Sustainable Energy Reviews
- Publisher
- Elsevier BV
- Published
- 2014-09
- Volume
- 37
- Pages
- 123-141
- ISSN
- 1364-0321 (ISSN-L)
- OpenAlex
- W2172172920
- Cited by
- 889
- References
- 46
- FWCI
- 70.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.