Large sample behaviors of the generalized likelihood uncertainty estimation (GLUE) in assessing the uncertainty of rainfall‐runoff simulations
Open accessThe DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
Several methods have been recently proposed for quantifying the uncertainty of hydrological models. These techniques are based upon different hypotheses, are diverse in nature, and produce outputs that can significantly differ in some cases. One of the favored methods for uncertainty assessment in rainfall‐runoff modeling is the generalized likelihood uncertainty estimation (GLUE). However, some fundamental questions related to its application remain unresolved. One such question is that GLUE relies on some explicit and implicit assumptions, and it is not fully clear how these may affect the uncertainty estimation when referring to large samples of data. The purpose of this study is to address this issue by assessing how GLUE performs in detecting uncertainty in the simulation of long series of synthetic river flows. The study aims to (1) discuss the hypotheses underlying GLUE and derive indications about their effects on the uncertainty estimation, and (2) compare the GLUE prediction limits with a large sample of data that is to be simulated in the presence of known sources of uncertainty. The analysis shows that the prediction limits provided by GLUE do not necessarily include a percentage close to their confidence level of the observed data. In fact, in all the experiments, GLUE underestimates the total uncertainty of the simulation provided by the hydrological model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly studies such as Montanari (2005) have shown that GLUE can underestimate the posterior output uncertainty.”
From A theoretical and real world evaluation of two Bayesian techniques for the calibration of variety parameters in a sugarcane crop model (2016) · cites this paper as Montanari (2005)
Citations
Cites
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674 · cited 2×
“As examples, Cameron et al. [1999] used the Nash and Sutcliffe [1970] efficiency to evaluate the likelihood of the simulation of a continuous hydrograph, and Beven and Freer [2001] present a list of likelihood measures that can be used in rainfall-runoff modeling.”
MethodLocally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,742 · cited 1×
“Smoothing was conducted by using the loess smoother that operates through a local regression model [Cleveland and Devlin, 1988].”
MethodThe future of distributed models: model calibration and uncertainty prediction
Beven, K., & Binley, A. (1992) · Hydrological Processes · doi:10.1002/hyp.3360060305 · Cited by 4,527 · cited 1×
“[3] One of the most known and used uncertainty assessment methods in hydrological modeling is the generalized likelihood uncertainty estimation (GLUE), proposed by Beven and Binley [1992] , that is briefly described in section 2 of the present article.”
MethodGuidelines for predicting crop water requirements
Doorenbos, J. (1977) · Medical Entomology and Zoology · Cited by 3,331
Effective and efficient global optimization for conceptual rainfall‐runoff models
Duan, Q., Sorooshian, S., & Gupta, V. (1992) · Water Resources Research · doi:10.1029/91wr02985 · Cited by 3,310 · cited 2×
“[31] By using a 30-year-long record of uncorrupted synthetic data (years from 1 to 30 of the synthetic records), HYMOD was first calibrated in an optimality context by minimizing the squared difference between Qobs(t) and Qsim(t) through a generic algorithm [Duan et al., 1992].”
MethodStatistics for Long-Memory Processes.
Ray, W. D., & Beran, J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983481 · Cited by 2,686 · cited 3×
“Thus model calibration can be carried out by minimizing [Beran, 1994] W qð Þ ¼ XN=2 j¼1 log fM lj; q þ fe lj;f þ J lj fM lj; q þ fe lj;f ( ) : ð10Þ In the above expression, the spectral density function of the model, fM(lj, q), has been estimated by computing the smoothed periodogram of a long…”
MethodA manifesto for the equifinality thesis
Beven, K. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.07.007 · Cited by 2,581 · cited 10×
“There is an implicit assumption in GLUE that the errors in the prediction will be similar to those in the evaluation period [ Beven, 2005 ].”
BackgroundResultInfluentialBeven, K., & Freer, J. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(01)00421-8 · Cited by 2,189 · cited 1×
“[7] It is important to remark that even in the ideal context this study refers to, one should not expect that a specified proportion of synthetic observations will lie within the GLUE prediction limits [Beven and Freer, 2001].”
BackgroundStatistics for Long-Memory Processes.
Percival, D. B., & Beran, J. (1996) · Journal of the American Statistical Association · doi:10.2307/2291761 · Cited by 1,480
Vrugt, J. A., Gupta, H. V., Bouten, W., & Sorooshian, S. (2003) · Water Resources Research · doi:10.1029/2002wr001642 · Cited by 1,196
Research works printed but not linked: 1
- Boyle D. P.(2000) Multicriteria calibration of hydrological models Ph.D. dissertation Dep. of Hydrol. and Water Resour. Univ. of Ariz. Tucson.
Cited by
Items 201–244 of 244
Improved Data Uncertainty Handling in Hydrologic Modeling and Forecasting Applications
Liu, H. (2019) · UWSpace (University of Waterloo) · Cited by 3
Widespread increase of root zone storage capacity in the United StatesPreprint
Liang, J., Gao, H., Fenicia, F., Xi, Q., Wang, Y., & Savenije, H. H. G. (2024) · doi:10.5194/egusphere-2024-550 · Cited by 2
Zhou, X. (2018) · theses.fr (ABES) · doi:10.70675/af5cc8a9z4bbcz4814z9c05zd6f2b82f0aed · Cited by 2
Haghbin, S., & Mahjouri, N. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.108578 · Cited by 1
Evaluation of Uncertainties in the Simulation of Watershed Nutrient Load: A Case Study
Karamouz, ., Taheriyoun, M., Seyedabadi, M., & Behboodian, S. (2009) · World Environmental and Water Resources Congress (EWRI) · doi:10.1061/41036(342)650 · Cited by 1
Global and Low-Cost Topographic Data to Support Flood Studies
Yan, K., Neal, J. C., SOLOMATINE, D. P., & Baldassarre, G. D. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-394846-5.00004-7 · Cited by 2
Vallam, P., Qin, X., & Yu, J. J. (2015) · International Journal of Environmental Science and Development · doi:10.7763/ijesd.2015.v6.555 · Cited by 1
Pokorny, S., Stadnyk, T., & Ali, G. A. (2023) · Journal of Hydrologic Engineering · doi:10.1061/jhyeff.heeng-5833 · Cited by 1
Comparison of different approaches to quantify the reliability of hydrological simulations
Gattke, C., & Schumann, A. H. (2007) · Advances in geosciences · doi:10.5194/adgeo-11-15-2007 · Cited by 1
Analyse des processus d'écoulement lors de crues à cinétique rapide sur l'arc méditerranéen
Douinot, A. (2016) · theses.fr (ABES) · doi:10.70675/29377a0dzae38z4e0fz84fezfc8eaec30830 · Cited by 4
“La méthodologie GLUE possède néanmoins quelques limites, détaillées dans plusieurs publications [Mantovan and Todini, 2006; Montanari, 2005; Clark et al., 2011].”
BackgroundReview of global change pressures on Urban Water Cycle Systems. Assessment of TRUST Pilots
Ramôa, A. R., Toth, E., de Oliveira, R. P., di Frederico, V., Montanari, A., & Monteiro, A. J. (2015) · RiuNet (Universitat Politècnica de València)
Self-citationVincendon, B. (2010) · Thèses en ligne de l'Université Toulouse III (Université Toulouse III) · Cited by 10
UNCERTAINTY AND SENSITIVITY ANALYSIS FOR WATERSHED MODELS WITH CALIBRATED PARAMETERS
Lee, S. (2010) · eCommons (Cornell University)
Hassanabadi, M. S. (2014) · UWSpace (University of Waterloo)
郑, 言. (2012) · Journal of Water Resources Research · doi:10.12677/jwrr.2012.13013
Avaliação de incertezas na calibração automática do modelo SWMM
Shinma, T. A. (2016) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.18.2016.tde-10052016-104935
“Por outro lado, Christensen (2004), Montanari (2005), Mantovan & Todini (2006), e Stedinger et al. (2008) publicaram estudos segundo os quais o GLUE falha em gerar resultados semelhantes a métodos comprovados de análise de incerteza.”
BackgroundTowards Improved Model Evaluation: Diagnostic, Likelihood-free, Bayesian Inference
Sadegh, M. (2015) · eScholarship (California Digital Library) · Cited by 1
Lee, H. (2006) · UWA Profiles and Research Repository (University of Western Australia)
Dobor, L. (2016) · Eötvös Loránd Tudományegyetem · doi:10.15476/elte.2016.055 · Cited by 2
(2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-40-rc1
Wang, Y. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-ac3
(2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-ec1
The application of approximate bayesian computation in the calibration of hydrological models
Brown, J. J. (2014) · Montana State University ScholarWorks (Montana State University)
(2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-rc1
(2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-rc2
Hillslope and Watershed Hydrology
Duffy, C. J., & Yu, X. (2018) · MDPI eBooks · doi:10.3390/books978-3-03842-952-4
Castelletti, A. F. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-40-ac1
(2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-cc1
Anonymous (2017) · doi:10.5194/hess-2017-121-ac1
Wang, Y. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-ac1
Castelletti, A. F. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-40-ac2
Wang, Y. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-371-ac2
(2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-40-ec1
Global and low-cost topographic data to support flood studies
Yan, K., Neal, J. C., SOLOMATINE, D. P., & Baldassarre, G. D. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-819101-9.00010-8
Gao, H. (2024) · doi:10.5194/egusphere-2024-550-ac1
Yu, H.-L., Chang, K.-H., & Chang, T. (2025) · International Journal of Energy Research · doi:10.1155/er/9235993
“…has been widely used in many fi elds to assess relevant uncertainties because of its simplicity for implementation and demonstrated capability for uncertainty analysis, for example, in the hydrological models [25 – 27], fl ood inundation models [28 – 31], and rainfall-runoff models [32, 33], etc.”
Delrieu, G. (2008) · Research Repository (Delft University of Technology)
Sahraei, S. (2021) · Mspace (University of Manitoba)
Vk, A., Sreelash, K., Amrutha, S. R., Jose, K. S., & Singh, S. (2026) · Journal of Hydrology · doi:10.1016/j.jhydrol.2026.135178
Prévision d'ensemble des crues rapides méditerranéennes
Édouard, S. (2016) · theses.fr (ABES) · doi:10.70675/27766159z05e6z4728zbf95ze2089f69bfef · Cited by 2
An exploration of post-processing uncertainty estimation in conceptual rainfall-runoff modelling
Lombardo, L. (2026) · PORTO@Iris
Metadata
- Authors
- Montanari, A.
- Affiliations
- University of Bologna (IT)
- Corresponding author
- Montanari, Alberto
- ORCID
- Montanari, Alberto
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2005-08
- Volume
- 41
- Issue
- 8
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2099329408
- Cited by
- 231
- References
- 45
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 5 · 2023: 5 · 2022: 10 · 2021: 19 · 2020: 4 · 2019: 11 · 2018: 9 · 2017: 9 · 2016: 11 · 2015: 10 · 2014: 22 · 2013: 16 · 2012: 18
- FWCI
- 14.08
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Water Resources Research (publishedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Environmental Engineering › Groundwater flow and contamination studies
- Keywords
- generalized likelihood uncertainty estimation, adhesives, uncertainty analysis, rainfall-runoff modeling, hydrological model uncertainty, limits of prediction, confidence level, large sample behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.