Large sample behaviors of the generalized likelihood uncertainty estimation (GLUE) in assessing the uncertainty of rainfall‐runoff simulations
Open accessThe DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
Several methods have been recently proposed for quantifying the uncertainty of hydrological models. These techniques are based upon different hypotheses, are diverse in nature, and produce outputs that can significantly differ in some cases. One of the favored methods for uncertainty assessment in rainfall‐runoff modeling is the generalized likelihood uncertainty estimation (GLUE). However, some fundamental questions related to its application remain unresolved. One such question is that GLUE relies on some explicit and implicit assumptions, and it is not fully clear how these may affect the uncertainty estimation when referring to large samples of data. The purpose of this study is to address this issue by assessing how GLUE performs in detecting uncertainty in the simulation of long series of synthetic river flows. The study aims to (1) discuss the hypotheses underlying GLUE and derive indications about their effects on the uncertainty estimation, and (2) compare the GLUE prediction limits with a large sample of data that is to be simulated in the presence of known sources of uncertainty. The analysis shows that the prediction limits provided by GLUE do not necessarily include a percentage close to their confidence level of the observed data. In fact, in all the experiments, GLUE underestimates the total uncertainty of the simulation provided by the hydrological model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly studies such as Montanari (2005) have shown that GLUE can underestimate the posterior output uncertainty.”
From A theoretical and real world evaluation of two Bayesian techniques for the calibration of variety parameters in a sugarcane crop model (2016) · cites this paper as Montanari (2005)
Citations
Cites
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674 · cited 2×
“As examples, Cameron et al. [1999] used the Nash and Sutcliffe [1970] efficiency to evaluate the likelihood of the simulation of a continuous hydrograph, and Beven and Freer [2001] present a list of likelihood measures that can be used in rainfall-runoff modeling.”
MethodLocally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,742 · cited 1×
“Smoothing was conducted by using the loess smoother that operates through a local regression model [Cleveland and Devlin, 1988].”
MethodThe future of distributed models: model calibration and uncertainty prediction
Beven, K., & Binley, A. (1992) · Hydrological Processes · doi:10.1002/hyp.3360060305 · Cited by 4,527 · cited 1×
“[3] One of the most known and used uncertainty assessment methods in hydrological modeling is the generalized likelihood uncertainty estimation (GLUE), proposed by Beven and Binley [1992] , that is briefly described in section 2 of the present article.”
MethodGuidelines for predicting crop water requirements
Doorenbos, J. (1977) · Medical Entomology and Zoology · Cited by 3,331
Effective and efficient global optimization for conceptual rainfall‐runoff models
Duan, Q., Sorooshian, S., & Gupta, V. (1992) · Water Resources Research · doi:10.1029/91wr02985 · Cited by 3,310 · cited 2×
“[31] By using a 30-year-long record of uncorrupted synthetic data (years from 1 to 30 of the synthetic records), HYMOD was first calibrated in an optimality context by minimizing the squared difference between Qobs(t) and Qsim(t) through a generic algorithm [Duan et al., 1992].”
MethodStatistics for Long-Memory Processes.
Ray, W. D., & Beran, J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983481 · Cited by 2,686 · cited 3×
“Thus model calibration can be carried out by minimizing [Beran, 1994] W qð Þ ¼ XN=2 j¼1 log fM lj; q þ fe lj;f þ J lj fM lj; q þ fe lj;f ( ) : ð10Þ In the above expression, the spectral density function of the model, fM(lj, q), has been estimated by computing the smoothed periodogram of a long…”
MethodA manifesto for the equifinality thesis
Beven, K. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.07.007 · Cited by 2,581 · cited 10×
“There is an implicit assumption in GLUE that the errors in the prediction will be similar to those in the evaluation period [ Beven, 2005 ].”
BackgroundResultInfluentialBeven, K., & Freer, J. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(01)00421-8 · Cited by 2,189 · cited 1×
“[7] It is important to remark that even in the ideal context this study refers to, one should not expect that a specified proportion of synthetic observations will lie within the GLUE prediction limits [Beven and Freer, 2001].”
BackgroundStatistics for Long-Memory Processes.
Percival, D. B., & Beran, J. (1996) · Journal of the American Statistical Association · doi:10.2307/2291761 · Cited by 1,480
Vrugt, J. A., Gupta, H. V., Bouten, W., & Sorooshian, S. (2003) · Water Resources Research · doi:10.1029/2002wr001642 · Cited by 1,196
Research works printed but not linked: 1
- Boyle D. P.(2000) Multicriteria calibration of hydrological models Ph.D. dissertation Dep. of Hydrol. and Water Resour. Univ. of Ariz. Tucson.
Cited by
Items 101–200 of 244
Wang, Y., & Karimi, H. A. (2022) · Hydrology and earth system sciences · doi:10.5194/hess-26-2387-2022 · Cited by 34
Interannual stability of grid cell snow depletion curves as estimated from MODIS images
Kolberg, S. A., & Gottschalk, L. (2010) · Water Resources Research · doi:10.1029/2008wr007617 · Cited by 33
“…of errors is a well‐known problem in hydrological modeling, and its effect on likelihood‐based parameter estimation is at the core of a recent debate on coherence in parameter estimation techniques [Montanari, 2005; Mantovan and Todini, 2006; Beven et al., 2008; and references therein].”
BackgroundEnhancing the SWAT model for simulating denitrification in riparian zones at the river basin scale
Hoang, L. T., van Griensven, A., & Mynett, A. E. (2017) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.03.017 · Cited by 33
Liu, X., Muzi, L., Chai, Y., Jue, T., & Jinyan, G. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105126 · Cited by 38
Comment on: ‘On undermining the science?’ by Keith Beven
Todini, E., & Mantovan, P. (2007) · Hydrological Processes · doi:10.1002/hyp.6670 · Cited by 36
Uncertainty in the estimation of backwater effects at bridge crossings
Brandimarte, L., & Woldeyes, M. K. (2012) · Hydrological Processes · doi:10.1002/hyp.9350 · Cited by 31
“The GLUE method has been widely used in hydrological modelling (e.g. Montanari, 2005; Winsemius et al., 2009; Krueger et al., 2010) because of its easiness in implementation and computational efficiency.”
MethodZhang, H., Zhou, J., Ye, L., Zeng, X., & Chen, Y. (2015) · Water Resources Management · doi:10.1007/s11269-015-1131-7 · Cited by 30
“The criteria discussed above have been extensively used, separately or together to assess the PI (Montanari 2005; Olsson and Lindstrom 2008).”
BackgroundDaily streamflow prediction with uncertainty in ephemeral catchments using the GLUE methodology
Viola, F., Noto, L., Cannarozzo, M., & Loggia, G. L. (2009) · Physics and Chemistry of the Earth Parts A/B/C · doi:10.1016/j.pce.2009.06.006 · Cited by 30
Probabilistic programming: A review for environmental modellers
Krapu, C., & Borsuk, M. E. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.01.014 · Cited by 31
Dai, Q., Han, D., Rico‐Ramirez, M. A., & Islam, T. (2014) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.865841 · Cited by 30
Comparison of parameter uncertainty analysis techniques for a TOPMODEL application
Li, B., Liang, Z., He, Y., Hu, L. Y., Zhao, W., & Acharya, K. (2016) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-016-1319-2 · Cited by 29
Impact of climate change on runoff and uncertainty analysis
Chang, J., Zhang, H., Wang, Y., & Zhang, L. (2017) · Natural Hazards · doi:10.1007/s11069-017-2909-0 · Cited by 29
“The generalized likelihood uncertainty estimation (GLUE) method is widely used to investigate the uncertainties of hydrological models (Montanari 2005, 2007; Vrugt et al. 2009; Mirzaei et al. 2015).”
MethodCervi, F., Petronici, F., Castellarin, A., Marcaccio, M., Bertolini, A., & Borgatti, L. (2017) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2017.11.231 · Cited by 29
Naranjo, R. C., Pohll, G. M., Niswonger, R. G., Stone, M., & Mckay, A. (2013) · Water Resources Research · doi:10.1002/wrcr.20306 · Cited by 28
Zhou, R., Yu, L. J., Lu, D., Liu, H., & Zhou, H. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.06.030 · Cited by 27
Alazzy, A. A., Lü, H., & Zhu, Y. (2015) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0001174 · Cited by 27
Cunha, M. D. C. (2023) · Water Resources Management · doi:10.1007/s11269-023-03429-9 · Cited by 26
“1 and details in the next section), is widely discussed in the literature (Beven et al., 1992, Montanari 2005, Pianosi and Wagener 2016).”
BackgroundLehbab-Boukezzi, Z., Boukezzi, L., & Errih, M. (2016) · Arabian Journal of Geosciences · doi:10.1007/s12517-016-2771-5 · Cited by 26
“Other authors have strongly criticized it for not being formally Bayesian resulting in an unreliable and incorrect estimation of parameters and predictive uncertainty (Montanari 2005; Mantovan and Todini, 2006; Stedinger et al. 2008).”
BackgroundPapacharalampous, G., Koutsoyiannis, D., & Montanari, A. (2019) · Advances in Water Resources · doi:10.1016/j.advwatres.2019.103471 · Cited by 29
“…within various hydrological contexts, including some more relevant to the present study (see e.g., Kavetski et al. 2002; Vrugt et al. 2005; Montanari 2005; Montanari and Koutsoyiannis 2012; Montanari and Di Baldassarre 2013; Papacharalampous et al. 2018, 2019a; Renard et al. 2010; Sadegh…”
BackgroundSelf-citationNasseri, M., Ansari, A., & Zahraie, B. (2014) · Water Resources Research · doi:10.1002/2012wr013382 · Cited by 25
“…from the whole parameter space which represent suitable prior distribution of the selected parameters and their dependency to the selected statistical likelihood criteria are other important issues related to this category of uncertainty evaluation [Montanari, 2005; Mantovan and Todini, 2006].”
BackgroundProbabilistic nonlinear prediction of river flows
Tamea, S., Laio, F., & Ridolfi, L. (2005) · Water Resources Research · doi:10.1029/2005wr004136 · Cited by 26
“Moreover, these results provide a proof that the probabilistic NLP accounts for the global forecast error, and not only for some components of this error as occurs for example in the GLUE procedure (see the numerical experiments by Montanari [2005] ).”
MethodDavid, C. H., Hobbs, J., Turmon, M., Emery, C., Reager, J. T., & Famiglietti, J. S. (2019) · Geophysical Research Letters · doi:10.1029/2019gl083342 · Cited by 26
“…et al., 1996; Garen & Burges, 1981; Georgakakos et al., 2004; Gupta & Sorooshian, 1985; Ibbitt, 1972; Sorooshian & Dracup, 1980; Uhlenbrook et al., 1999; Wood, 1976), and (5) relative effects of various sources of uncertainty (e.g., Montanari, 2005; Montanari & Brath, 2004; Muleta & Nicklow, 2005).”
BackgroundLin, K., Liu, P., He, Y., & Guo, S. (2013) · Journal of Hydroinformatics · doi:10.2166/hydro.2013.204 · Cited by 24
Tran, V. N., & Kim, J. (2019) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-019-01703-0 · Cited by 25
Sharafati, A., Khazaei, M. R., Nashwan, M. S., Al-Ansari, N. A., Yaseen, Z. M., & Shahid, S. (2020) · Advances in Civil Engineering · doi:10.1155/2020/7948902 · Cited by 24
Assessing the impact of flood inundation dynamics on an urban environment
Gao, P., Gao, W., & Ke, N. (2021) · Natural Hazards · doi:10.1007/s11069-021-04868-6 · Cited by 23
“, lower water depths along rising and falling limbs of a hydrograph) (Krause et al. 2005; Montanari 2005).”
Shrestha, D. L. (2026) · CRC Press eBooks · doi:10.1201/9781003759904 · Cited by 23
An, Y., Zhang, Y., & Yan, X. (2022) · Water · doi:10.3390/w14152447 · Cited by 22
Samadi, S., Tufford, D. L., & Carbone, G. J. (2017) · JAWRA Journal of the American Water Resources Association · doi:10.1111/1752-1688.12596 · Cited by 22
“The selection of the threshold value is an entirely arbitrary choice that affects prediction uncertainty (e.g., Montanari, 2005; Mantovan and Todini, 2006).”
BackgroundSpatial Pattern Oriented Multicriteria Sensitivity Analysis of a Distributed Hydrologic Model
Demirel, M. C., Koch, J., González, G. M., & Stisen, S. (2018) · Water · doi:10.3390/w10091188 · Cited by 22
“In the generalized likelihood uncertainty estimation (GLUE)-based uncertainty analysis framework, numerous random parameter sets are sampled and, from those, only the parameter sets that deliver a performance level that is above a predefined minimum threshold are retained and classified as behavioral models [61].”
BackgroundOuyang, S., Puhlmann, H., Shunli, W., Wilpert, K. V., & Sun, O. J. (2014) · Ecological Processes · doi:10.1186/s13717-014-0014-9 · Cited by 20
Skinner, C., Bellerby, T. J., Greatrex, H., & Grimes, D. I. F. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.12.052 · Cited by 20
“…the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ 18 produced by Generalised Likelihood Uncertainty Estimation (GLUE) methods (Beven and Binley, 1992; Montanari, 2005) and was later formalised in Xiong and Connor (2008).”
MethodInfluentialUncertainty assessment of sewer sediment erosion modelling
Freni, G., Mannina, G., & Viviani, G. (2008) · Urban Water Journal · doi:10.1080/15730620701737033 · Cited by 20
“Such approach may be considered as a modelling sensitivity analysis weighted on the basis of modelling performance (Montanari 2005).”
BackgroundMethodNasseri, M., Zahraie, B., Ansari, A., & SOLOMATINE, D. P. (2013) · Journal of Hydroinformatics · doi:10.2166/hydro.2013.159 · Cited by 20
Mirzaei, M., Galavi, H., Faghih, M., Huang, Y. F., Lee, T. S., & El‐Shafie, A. (2013) · AQUA - Water Infrastructure Ecosystems and Society · doi:10.2166/aqua.2013.038 · Cited by 20
Cumulative Effects of Uncertainty on Simulated Streamflow in a Hydrologic Modeling Environment
Pokorny, S., Stadnyk, T., Ali, G. A., Lilhare, R., Déry, S. J., & Koenig, K. A. (2021) · Elementa Science of the Anthropocene · doi:10.1525/elementa.431 · Cited by 20
“observed benchmark (Montanari, 2005), and sharpness is”
BackgroundMethodDistributed Models and Uncertainty in Flood Risk Management
Beven, K. J. (2010) · Wiley eBooks · doi:10.1002/9781444324846.ch14 · Cited by 19
Tan, J., Cao, J., Cui, Y., Duan, Q., & Gong, W. (2019) · Agronomy Journal · doi:10.2134/agronj2018.05.0336 · Cited by 20
Beven, K. J. (2019) · Simulation foundations, methods and applications · doi:10.1007/978-3-319-70766-2_32 · Cited by 23
Evaluating the uncertainty of urban flood model using glue approach
Kobarfard, M., Fazloula, R., Zarghami, M., & Akbarpour, A. (2022) · Urban Water Journal · doi:10.1080/1573062x.2022.2053865 · Cited by 18
He, L., Huang, G., Lu, H., Wang, S., & Xu, Y. (2012) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2012.03.067 · Cited by 18
Sreelash, K., Sekhar, M., Ruiz, L., Tomer, S. K., Guérif, M., Buis, S., Durand, P., & Gascuel, C. (2012) · Journal of Hydrology · doi:10.1016/j.jhydrol.2012.06.012 · Cited by 18
Appraisal of the Generalized Likelihood Uncertainty Estimation (GLUE) Method
Vogel, R. M., Stedinger, J. R., Batchelder, R., & Lee, S. U. (2008) · World Environmental and Water Resources Congress (EWRI) · doi:10.1061/40976(316)611 · Cited by 18
Umar, F., Zulkafli, Z., Yusuf, B. B., & Nurhidayu, S. (2021) · Water · doi:10.3390/w13030317 · Cited by 17
Disentangling sources of future uncertainties for water management in sub-Saharan river basins
Amaranto, A., Juízo, D., & Castelletti, A. F. (2022) · Hydrology and earth system sciences · doi:10.5194/hess-26-245-2022 · Cited by 17
Liu, H., Wood, A. W., Newman, A. J., & Clark, M. (2022) · Journal of Hydrometeorology · doi:10.1175/jhm-d-21-0176.1 · Cited by 16
Pokorny, S., Stadnyk, T., Lilhare, R., Ali, G. A., Déry, S. J., & Koenig, K. A. (2020) · Water · doi:10.3390/w12102751 · Cited by 17
“Maximum and minimum bounds are useful for estimating total possible reliability for the ensemble, as defined by Montanari [44], but likely represent an overestimation of uncertainty beyond what would be considered useful in an operational setting, or for design purposes.”
BackgroundRainfall Uncertainty in Flood Forecasting: Belgian Case Study of Rivierbeek
Steenbergen, N. V., & Willems, P. (2014) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0001004 · Cited by 17
Addressing the Uncertainty in Modeling Watershed Nonpoint Source Pollution
Zheng, Y., Han, F., Tian, Y., Wu, B., & Lin, Z. (2014) · Developments in environmental modelling · doi:10.1016/b978-0-444-63249-4.00006-3 · Cited by 15
Li, G., Wang, Q., Liu, G., Zhao, Y., Wang, Y., Peng, S., Wei, Y., & Jinnan, W. (2020) · Sustainability · doi:10.3390/su12156021 · Cited by 14
UNCERTAINTY MODELLING IN RAINFALL-RUNOFF SIMULATIONS BASED ON PARALLEL MONTE CARLO METHOD
Golasowski, M., Litschmannová, M., Kuchař, Š., Podhorányi, M., & Martinovič, J. (2015) · Neural Network World · doi:10.14311/nnw.2015.25.014 · Cited by 14
“This method provides tools for comparing different modelling solutions and their parameters between each other [12].”
MethodCho, H., & Olivera, F. (2012) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0000330 · Cited by 14
“GLUE has been widely used for uncertainty estimation of environmental and hydrologic models (Beven and Binley 1992; Freer et al. 1996; Aronica et al. 1998; Beven et al. 2000; Beven and Freer 2001; Makowski et al. 2002; Muleta and Nicklow 2005; Zheng and Keller 2007).”
MethodPossibilistic uncertainty analysis of a conceptual model of snowmelt runoff
Jacquin, A. P. (2010) · Hydrology and earth system sciences · doi:10.5194/hess-14-1681-2010 · Cited by 13
“As in the study by Montanari (2005), the performance of the uncertainty bounds is assessed in terms of their ability to enclose the discharge observations.”
BackgroundParameter uncertainty assessment of a flood forecasting model using multiple objectives
Pang, B., Yue, J., Huang, Z., & Zhang, R. (2018) · Journal of Flood Risk Management · doi:10.1111/jfr3.12493 · Cited by 13
“…that this method is not formally Bayesian, and the parameter and predictive distributions are statistically incoherent and unreliable in numerous cases (Christensen, 2004; Mantovan & Todini, 2006; Montanari, 2005; Vogel, Stedinger, Batchelder, & Lee, 2008; Vrugt, Braak, Gupta, & Robinson, 2009).”
MethodKNN vs. Bluecat—Machine Learning vs. Classical Statistics
Rozos, E., Koutsoyiannis, D., & Montanari, A. (2022) · Hydrology · doi:10.3390/hydrology9060101 · Cited by 13
“KNN is an instance-based non-parametric model [17].”
MethodInfluentialSelf-citationUncertainty Quantification of Hydrologic Model
Vallam, P., Qin, X., & Yu, J. (2014) · APCBEE Procedia · doi:10.1016/j.apcbee.2014.10.042 · Cited by 13
Shrestha, D. L., Kayastha, N., SOLOMATINE, D. P., & Price, R. K. (2013) · Journal of Hydroinformatics · doi:10.2166/hydro.2013.242 · Cited by 13
Bao, Z., Ji, L. J., Zhang, J., Fu, G., Wang, G., Yan, X. L., Zhang, A., Xu, Q., & Shang, M. (2011) · doi:10.5194/hessd-8-7017-2011 · Cited by 13
“…I Back Close Full Screen / Esc Printer-friendly Version Interactive Discussion D iscussion P aper | D iscussion P aper | D iscussion P aper | D iscussion P aper | 2005; Khu and Werner, 2003; Montanari, 2005; Morse and Pohll, 2003; Rojas et al., 2010; Stedinger et al., 2008; Zheng and Keller, 2007).”
BackgroundChou, C. (2014) · Water · doi:10.3390/w6040912 · Cited by 12
Characterizing the uncertainty in river stage forecasts conditional on point forecast values
Yan, J., Liao, G., Gebremichael, M., Shedd, R., & Vallee, D. R. (2012) · Water Resources Research · doi:10.1029/2012wr011818 · Cited by 15
“Limitations of the GLUE method include high computational demand (especially when dealing with distributed models) and incorrect uncertainty estimation [e.g., Thiemann et al., 2001; Montanari, 2005; Mantovan and Todini, 2006; Blasone et al., 2008].”
MethodA computationally efficient method for uncertainty analysis of SWAT model simulations
Athira, P., Nanda, C., & Sudheer, K. P. (2018) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-018-1538-9 · Cited by 12
“Despite, some studies have reported certain limitations of the GLUE method (Christensen 2004; Montanari 2005; Mantovan and Todini 2006; Stedinger and Vogel 2008)—the major criticisms being the use of informal likelihood and subjectivity in the selection of threshold.”
MethodScale-dependence of observational and modelling uncertainties in forensic flash flood analysis
Amponsah, W., Marra, F., Zoccatelli, D., Marchi, L., Crema, S., Pirastru, M., & Borga, M. (2022) · Journal of Hydrology · doi:10.1016/j.jhydrol.2022.127502 · Cited by 12
The probabilistic behavior of AquaCrop parameters: a Monte-Carlo study
Etedali, H. R., Adabi, V., Gorgin, F., & Azizian, A. (2022) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-022-02309-9 · Cited by 11
“(Christensen 2004; Y. Liu and Gupta 2007; Mantovan and Todini 2006; Montanari 2005; Vogel et al. 2008).”
BackgroundModeling the effects of plant uptake dynamics on nitrogen removal of a bioretention system
Yu, S., & Qin, H. (2023) · Water Research · doi:10.1016/j.watres.2023.120763 · Cited by 11
Pakdehi, M., & Ahmadisharaf, E. (2025) · Water Resources Research · doi:10.1029/2024wr039244 · Cited by 10
“Bayesian approaches like Generalized Likelihood Uncertainty Estimation (Bates et al., 2004; K. Beven & Binley, 2014; Hunter et al., 2005; Montanari, 2005) can be coupled with the ML model to quantify the uncertainty of model outputs.”
Leveraging ensemble meteorological forcing data to improve parameter estimation of hydrologic models
Liu, H., Tolson, B. A., Newman, A. J., & Wood, A. W. (2021) · Hydrological Processes · doi:10.1002/hyp.14410 · Cited by 10
“Previous studies have reported on the influences of different objective functions and/or behavioural thresholds on the resulting uncertainty quantifications (e.g., see Beven & Freer, 2001; Freer et al., 1996; Montanari, 2005; Shafii et al., 2015).”
BackgroundElshamy, M., Baldassarre, G. D., & van Griensven, A. (2012) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0000656 · Cited by 9
Effect of Baseflow Separation on Uncertainty of Hydrological Modeling in the Xinanjiang Model
Lin, K., Lian, Y., & He, Y. (2014) · Mathematical Problems in Engineering · doi:10.1155/2014/985054 · Cited by 9
“The definitions of these two indices are well introduced in the literatures [14, 24, 30–32] and can be calculated as follows:”
BackgroundXue, L., Dai, C., Wu, Y., & Wang, L. (2018) · Water · doi:10.3390/w10040412 · Cited by 9
Wong, J. S., Freer, J. E., Bates, P., Warburton, J., & Coulthard, T. J. (2021) · Earth Surface Processes and Landforms · doi:10.1002/esp.5140 · Cited by 9
“Since there is no objective method to choose the threshold for some informal likelihood measures (Mantovan & Todini, 2006; Montanari, 2005), GLUE has been criticized for its subjective distinction between behavioural and non-behavioural model.”
MethodSeong, Y., Choi, C., & Jung, Y. (2022) · Water · doi:10.3390/w14142210 · Cited by 9
LASH MODEL: A HYDROLOGICAL SIMULATION TOOL IN GIS FRAMEWORK
Beskow, S. (2014) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 9
Quantifying soil hydraulic properties and their uncertainties by modified GLUE method
Yan, Y., Liu, J., Zhang, J., Li, X., & Zhao, Y. (2017) · International Agrophysics · doi:10.1515/intag-2016-0056 · Cited by 8
“On the other hand, in recent years some authors criticised GLUE for not being formal Bayesian, and requiring subjective decisions on the likelihood measure and threshold (Christensen, 2004; Mantovan and Todini, 2006; Montanari, 2005).”
BackgroundParameter estimation and uncertainty assessment in hydrological modelling
Blasone, R.-S. (2007) · Cited by 7
Valdés‐Pineda, R., Valdés, J. B., Wi, S., Serrat‐Capdevila, A., & Roy, T. (2021) · Hydrology · doi:10.3390/hydrology8040188 · Cited by 7
A New Uncertainty Measure for Assessing the Uncertainty Existing in Hydrological Simulation
Shi, P., Yang, T., Yong, B., Li, Z., Xu, C., Shao, Q., Wang, X., Zhou, X., & Qin, Y. (2019) · Water · doi:10.3390/w11040812 · Cited by 7
“Properties Name Calculation Coverage Containing ratio(CR) CR = nc/N [23] Band-width Average band-width (B) B = 1/N N ∑”
BackgroundPractice driven and state-of-the-art methods to quantify hydrologic model uncertainty
Skahill, B. (2013) · This Digital Resource was created in Microsoft Word and Adobe Acrobat · Cited by 7
Determining the dynamic response of maize to compound low-temperature and drought stress
Zhao, Y., Wei, S., Chen, D., Guo, Y., Ma, B., Riao, D., Zhang, J., Tong, Z., Liu, X., & Zhao, C. (2025) · European Journal of Agronomy · doi:10.1016/j.eja.2025.127842 · Cited by 7
Mediero, L., Garrote, L., & Chavez-Jimenez, A. (2012) · Natural hazards and earth system sciences · doi:10.5194/nhess-12-3719-2012 · Cited by 6
Diagnostic Evaluation of Hydrologic Models Employing Flow Duration Curve
Chilkoti, V., Bolisetti, T., & Balachandar, R. (2019) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0001778 · Cited by 6
Chen, S., Qin, W., Cui, T., Qian, J., & Zheng, J. (2024) · Journal of Contaminant Hydrology · doi:10.1016/j.jconhyd.2024.104441 · Cited by 5
Pizarro, A., Koutsoyiannis, D., & Montanari, A. (2025) · Hydrology and earth system sciences · doi:10.5194/hess-29-4913-2025 · Cited by 12
“…to not being formally Bayesian (for that reason, GLUE includes the term "generalized" in its name), leading to possibly statistically incoherent and potentially unreliable parameter and predictive distributions (Christensen, 2004; Mantovan and Todini, 2006; Montanari, 2005; Stedinger et al., 2008).”
Self-citationZhang, J., Qiao, R., Song, Y., & Lai, Y. (2021) · Water and Environment Journal · doi:10.1111/wej.12748 · Cited by 5
“Because hydrological models digitize natural systems, there are many inherent uncertainties in the model structure (Montanari, 2005).”
BackgroundKing, D. (2009) · Victoria University Research Repository (Victoria University) · Cited by 5
Bayesian calibration of HEC-HMS model using two different algorithms
Lehbab-Boukezzi, Z., & Boukezzi, L. (2019) · Arabian Journal of Geosciences · doi:10.1007/s12517-019-4944-5 · Cited by 4
“By contrast, studies conducted by Montanari (2005) and Mantovan and Todini (2006) proved that prediction limits estimated by GLUE and Bayesian methods are very different.”
ResultBourgin, F. (2014) · theses.fr (ABES) · doi:10.70675/05da1e5eza4efz4a85z84efz7190f313556a · Cited by 32
Moghbel, F., Fazel, F., Aguilar, J., Howell, N. L., & Enciso, J. (2025) · Agricultural Water Management · doi:10.1016/j.agwat.2025.109675 · Cited by 3
Mrokowska, M. M., & Osuch, M. (2011) · GeoPlanet: earth and planetary sciences · doi:10.1007/978-3-642-17475-9_16 · Cited by 3
“Some scientists argue that GLUE methodology is not formally Bayesian and thus not statistically correct ( Montanari 2005; Moradkhani et al. 2005; Mantovan and Todini 2006).”
BackgroundENSEMBLE FLOOD PREDICTION BY CASCADING THE UNCERTAINTY FROM RAINFALL TO RUNOFF SHORT-TERM PREDICTION
Hapsari, R. I., Oishi, S., & Sunada, K. (2012) · Journal of Japan Society of Civil Engineers Ser B1 (Hydraulic Engineering) · doi:10.2208/jscejhe.68.i_139 · Cited by 3
Conceptual Model Uncertainty in the Management of the Chi River Basin, Thailand
Nettasana, T. (2012) · UWSpace (University of Waterloo) · Cited by 4
Ma, J. (2017) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/72502 · Cited by 3
Métadier, M. (2011) · theses.fr (ABES) · doi:10.70675/7a619ce8zab18z42faz99a3z73034ae83a2f · Cited by 18
Yu, S., Qin, H., & Ding, W. P. (2025) · Ecological Engineering · doi:10.1016/j.ecoleng.2025.107781 · Cited by 3
Wang, S., Zhang, K., Chao, L., Chen, G., Xia, Y., Bao, H., & Zhang, C. (2023) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2023.105917 · Cited by 2
Uncertainty Assessment in Reservoir Water Quality Modeling: Implication for Model Improvement
Huang, Y. (2014) · Journal of Environmental Engineering · doi:10.1061/(asce)ee.1943-7870.0000886 · Cited by 2
A Blueprint for Process-Based Modeling of
Montanari, A., & Koutsoyiannis, D. (2012) · Cited by 2
Self-citationBrazier, R. E., Krueger, T., & Wainwright, J. (2013) · Springer eBooks · doi:10.1007/978-94-007-5727-1_10 · Cited by 2
Chang, T., Chang, K.-H., Yu, H.-L., Chen, C.-Y., & Pan, S.-Y. (2024) · International Journal of Energy Research · doi:10.1155/2024/6383680 · Cited by 2
“…simplicity for implementation and its demonstrated capability for uncertainty analysis, 3 International Journal of Energy Research e.g. , in the hydrological models [39 – 41], fl ood inundation models [42 – 45], and rainfall-runo ff models [46, 47], to access the uncertainties of studied problems.”
BackgroundBayesian Saltwater Intrusion Prediction and Remediation Design under Uncertainty
Chitsazan, N. (2014) · Louisiana State University · doi:10.31390/gradschool_dissertations.394 · Cited by 2
“…method is the generalized liklihood uncertainty estimation (GLUE) (Beven and Binley 1992) that has been used in several hydrological problems (Beven 2011; Blasone et al. 2008a; Blasone et al. 2008b; Christensen 2004; Hassan et al. 2008; Montanari 2005; Morse et al. 2003; Pappenberger et al. 2004).”
MethodHydrological Modelling for Integrated Water Resources Management in a Changing Climate
Abbas, S. A. (2018) · Cronfa (Swansea University) · doi:10.23889/suthesis.43733 · Cited by 3
Metadata
- Authors
- Montanari, A.
- Affiliations
- University of Bologna (IT)
- Corresponding author
- Montanari, Alberto
- ORCID
- Montanari, Alberto
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2005-08
- Volume
- 41
- Issue
- 8
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2099329408
- Cited by
- 231
- References
- 45
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 5 · 2023: 5 · 2022: 10 · 2021: 19 · 2020: 4 · 2019: 11 · 2018: 9 · 2017: 9 · 2016: 11 · 2015: 10 · 2014: 22 · 2013: 16 · 2012: 18
- FWCI
- 14.08
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Water Resources Research (publishedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Environmental Engineering › Groundwater flow and contamination studies
- Keywords
- generalized likelihood uncertainty estimation, adhesives, uncertainty analysis, rainfall-runoff modeling, hydrological model uncertainty, limits of prediction, confidence level, large sample behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.