An integrated hydrologic Bayesian multimodel combination framework: Confronting input, parameter, and model structural uncertainty in hydrologic prediction
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
The conventional treatment of uncertainty in rainfall‐runoff modeling primarily attributes uncertainty in the input‐output representation of the model to uncertainty in the model parameters without explicitly addressing the input, output, and model structural uncertainties. This paper presents a new framework, the Integrated Bayesian Uncertainty Estimator (IBUNE), to account for the major uncertainties of hydrologic rainfall‐runoff predictions explicitly. IBUNE distinguishes between the various sources of uncertainty including parameter, input, and model structural uncertainty. An input error model in the form of a Gaussian multiplier has been introduced within IBUNE. These multipliers are assumed to be drawn from an identical distribution with an unknown mean and variance which were estimated along with other hydrological model parameters by a Monte Carlo Markov Chain (MCMC) scheme. IBUNE also includes the Bayesian model averaging (BMA) scheme which is employed to further improve the prediction skill and address model structural uncertainty using multiple model outputs. A series of case studies using three rainfall‐runoff models to predict the streamflow in the Leaf River basin, Mississippi, are used to examine the necessity and usefulness of this technique. The results suggest that ignoring either input forcings error or model structural uncertainty will lead to unrealistic model simulations and incorrect uncertainty bounds.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Experience in many fields - ranging from meteorology, soil chemistry, and stocks to the Netflix Challenge and others - have demonstrated that ensemble models have smaller prediction error than the best single model [54-61].”
From Modeling causes of death: an integrated approach using CODEm (2012) · cites this paper as [57]
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
The EM Algorithm and Extensions
Kushary, D. (1998) · Technometrics · doi:10.1080/00401706.1998.10485534 · Cited by 5,417
The future of distributed models: model calibration and uncertainty prediction
Beven, K., & Binley, A. (1992) · Hydrological Processes · doi:10.1002/hyp.3360060305 · Cited by 4,527
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 2×
“[5] The second group such as Bayesian model averaging (BMA) [Madigan et al., 1996; Hoeting et al., 1999] uses probabilistic techniques which derive the consensus prediction from competing predictions using likelihood measures as model weights.”
MethodBayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
Effective and efficient global optimization for conceptual rainfall‐runoff models
Duan, Q., Sorooshian, S., & Gupta, V. (1992) · Water Resources Research · doi:10.1029/91wr02985 · Cited by 3,310
Self-citationVariable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828
Research works printed but not linked: 3
- Boyle D.(2001) Multicriteria calibration of hydrological models Ph.D. dissertation Univ. of Ariz. Tucson.
- Madigan D., 1996, Proceedings of the AAAI Workshop on Integrating Multiple Learned Models, 77
- Marshall L., 2003, Proceedings of the International Congress on Modelling and Simulation (MODSIM2003), 831
Cited by
Hydrological drought explained
Van Loon, A. F. (2015) · WIREs Water · doi:10.1002/wat2.1085 · Cited by 1,786
Vrugt, J. A., ter Braak, C. J. F., Clark, M. P., Hyman, J. M., & Robinson, B. A. (2008) · Water Resources Research · doi:10.1029/2007wr006720 · Cited by 891
“To further reduce ambiguity about the inferred record of wholecatchment rainfall, future analysis should include multiple conceptual watershed models using emerging (Bayesian) model averaging approaches in surface water hydrology [Ajami et al., 2007; Vrugt and Robinson, 2007b].”
BackgroundMethodComparing uncertainty analysis techniques for a SWAT application to the Chaohe Basin in China
Yang, J., Reichert, P., Abbaspour, K. C., Xia, J., & Yang, H. (2008) · Journal of Hydrology · doi:10.1016/j.jhydrol.2008.05.012 · Cited by 800
“…and data assimilation (Vrugt et al., 2005), sequential data assimilation (Moradkhani et al., 2005), integrated Bayesian uncertainty estimation (Ajami et al., 2007), and use of time-dependent parameters for exploring model deficits and considering input and model structure uncertainty…”
MethodFatichi, S., Vivoni, E. R., Ogden, F. L., Ivanov, V. Y., Mirus, B., Gochis, D., Downer, C. W., Camporese, M., Davison, J. H., Ebel, B., et al. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.03.026 · Cited by 671
“Calibration procedures that do not account for uncertainty in input and output observations and model structure inevitably lead to biased parameter values (e.g. Restrepo and Bras, 1985; Ajami et al., 2007; Renard et al., 2010).”
Modeling causes of death: an integrated approach using CODEm
Foreman, K. J., Lozano, R., Lopez, A. D., & Murray, C. J. (2012) · Population Health Metrics · doi:10.1186/1478-7954-10-1 · Cited by 564
“Experience in many fields - ranging from meteorology, soil chemistry, and stocks to the Netflix Challenge and others - have demonstrated that ensemble models have smaller prediction error than the best single model [54-61].”
BackgroundBenchmarking observational uncertainties for hydrology: rainfall, river discharge and water quality
McMillan, H., Krueger, T., & Freer, J. (2012) · Hydrological Processes · doi:10.1002/hyp.9384 · Cited by 522
“, DREAM (Vrugt et al., 2008; Schoups and Vrugt, 2010), IBUNE (Ajami et al., 2007) and extended GLUE (Beven, 2006; Beven et al., 2006; Pappenberger et al., 2006; Liu et al., 2009; Krueger et al., 2010a; in press; Quinton et al., 2011 ).”
BackgroundLiu, Y., Weerts, A. H., Clark, M., Hendricks Franssen, H.-J., Kumar, S., Moradkhani, H., Seo, D.-J., Schwanenberg, D., Smith, P., van Dijk, A. I. J. M., et al. (2012) · Hydrology and Earth System Sciences · doi:10.5194/hess-16-3863-2012 · Cited by 487
“Uncertainty in hydrologic predictions can originate from several major sources, including errors in the model structure and model parameters, as well as model initial conditions and hydrometeorologic forcing (e.g., Ajami et al., 2007; Kavetski et al., 2006a, b; Salamon and Feyen, 2010).”
BackgroundOne decade of multi-objective calibration approaches in hydrological modelling: a review
Efstratiadis, A., & Koutsoyiannis, D. (2010) · Hydrological Sciences Journal · doi:10.1080/02626660903526292 · Cited by 479
“, 2005), multi-model averaging methods (Ajami et al., 2007) and coupled schemes (Blasone at al.”
MethodAppraisal of the generalized likelihood uncertainty estimation (GLUE) method
Stedinger, J. R., Vogel, R. M., Lee, S. U., & Batchelder, R. (2008) · Water Resources Research · doi:10.1029/2008wr006822 · Cited by 386
Vrugt, J. A., & Robinson, B. A. (2007) · Water Resources Research · doi:10.1029/2005wr004838 · Cited by 334
“…than other available multimodel techniques [George and McCulloch, 1993; Raftery et al., 1997; Clyde, 1999; Raftery and Zheng, 2003; Ye et al., 2004; Ajami et al., 2005, 2007; Q. Duan et al., Multi-model ensemble hydrologic prediction using Bayesian model averaging, submitted to Advances in Water…”
MethodBlasone, R.-S., Vrugt, J. A., Madsen, H., Rosbjerg, D., Robinson, B. A., & Zyvoloski, G. A. (2008) · Advances in Water Resources · doi:10.1016/j.advwatres.2007.12.003 · Cited by 336
Review: Sources of Hydrological Model Uncertainties and Advances in Their Analysis
Moges, E., Demissie, Y., Larsen, L., & Yassin, F. (2020) · Water · doi:10.3390/w13010028 · Cited by 327
“On the other hand, Bayesian total error analysis (BATEA [74]) and integrated Bayesian uncertainty estimator (IBUNE [73]) estimate input uncertainty along with model parameters.”
BackgroundJiang, S., Ren, L., Hong, Y., Yong, B., Yang, X., Yuan, F., & Ma, M. (2012) · Journal of Hydrology · doi:10.1016/j.jhydrol.2012.05.055 · Cited by 294
“The SCEM-UA was able to simultaneously identify the most likely parameter set and its associated posterior probability distribution in every model run (Ajami et al., 2007).”
MethodInfluentialSalas, J. D., Govindaraju, R. S., Anderson, M., Arabi, M., Francés, F., Suarez, W., Lavado-Casimiro, W. S., & Green, T. R. (2014) · Modern Water Resources Engineering · doi:10.1007/978-1-62703-595-8_1 · Cited by 290
An evaluation of adaptive surrogate modeling based optimization with two benchmark problems
Wang, C., Duan, Q., Gong, W., Ye, A., Di, Z., & Miao, C. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.05.026 · Cited by 271
“It is also a benchmark problem for evaluation of many parameter estimation methods (Duan et al., 1992, 1994; Yapo et al., 1998; Ajami et al., 2007).”
BackgroundSelf-citationEvaluation of the Current State of Distributed Watershed Nutrient Water Quality Modeling
Wellen, C., Kamran-Disfani, A.-R., & Arhonditsis, G. B. (2015) · Environmental Science & Technology · doi:10.1021/es5049557 · Cited by 270
Assessing the uncertainties of hydrologic model selection in climate change impact studies
Najafi, M. R., Moradkhani, H., & Jung, I. W. (2011) · Hydrological Processes · doi:10.1002/hyp.8043 · Cited by 259
“Despite the tremendous progress, efforts, and investment put into developing more hydrologic models, there is no plausible reason that any particular model in existence is superior to other models for various applications and under all circumstances (Ajami et al., 2007; Hsu et al., 2009; Raftery et al., 2005).”
BackgroundMethodChen, X., Long, D., Hong, Y., Zeng, C., & Yan, D. (2017) · Water Resources Research · doi:10.1002/2016wr019656 · Cited by 257
“Merging remotely sensed and gauge-based precipitation may further improve model performance [Ajami et al., 2007; Jiang et al., 2012].”
MethodRainfall uncertainty in hydrological modelling: An evaluation of multiplicative error models
McMillan, H., Jackson, B., Clark, M., Kavetski, D., & Woods, R. (2011) · Journal of Hydrology · doi:10.1016/j.jhydrol.2011.01.026 · Cited by 253
Ensemble flood forecasting: Current status and future opportunities
Wu, W., Emerton, R., Duan, Q., Wood, A. W., Wetterhall, F., & Robertson, D. E. (2020) · WIREs Water · doi:10.1002/wat2.1432 · Cited by 252
“Multi-model predictions have shown to have more skills than single model predictions in many studies (Ajami et al., 2006; Ajami, 2007; Duan et al., 2007; Madadgar & Moradkhani, 2014) and could be a promising approach to consider uncertainty in ensemble flood forecasting for flood management.”
BackgroundMethodInfluentialSelf-citationBastola, S., Murphy, C., & Sweeney, J. (2011) · Advances in Water Resources · doi:10.1016/j.advwatres.2011.01.008 · Cited by 248
A review on statistical postprocessing methods for hydrometeorological ensemble forecasting
Li, W., Duan, Q., Miao, C., Ye, A., Gong, W., & Di, Z. (2017) · WIREs Water · doi:10.1002/wat2.1246 · Cited by 247
Self-citationBreuer, L., Huisman, J. A., Willems, P., Bormann, H., Bronstert, A., Croke, B. F. W., Frede, H.-G., Gräff, T., Hubrechts, L., Jakeman, A. J., et al. (2009) · Advances in Water Resources · doi:10.1016/j.advwatres.2008.10.003 · Cited by 219
“New tools have recently been proposed to improve the combination of models into a multi-model ensemble, including deterministic (model average and median, trimmed means, linear regression, artificial neural networks; see for example [37,74]) as well as probabilistic techniques (Bayesian model averaging, Kalman filteri…”
Vrugt, J. A., ter Braak, C. J. F., Diks, C. G. H., & Schoups, G. (2013) · Advances in Water Resources · doi:10.1016/j.advwatres.2012.04.002 · Cited by 217
“That research has primarily focused on six different issues: (1) the development of specialized objective functions that appropriately represent and summarize the residual errors between model predictions and observations [53,106,66,5,57,99], (2) the search for efficient optimization algorithms that can reliably solve…”
Generating Ensemble Streamflow Forecasts: A Review of Methods and Approaches Over the Past 40 Years
Troin, M., Arsenault, R., Wood, A. W., Brissette, F., & Martel, J. (2021) · Water Resources Research · doi:10.1029/2020wr028392 · Cited by 209
“ti-model combination is based on the fact that models inevitably include errors, which can be reduced with optimal multi-model combinations (Ajami et al., 2007).”
BackgroundKarssenberg, D., Schmitz, O., Salamon, P., de Jong, K., & Bierkens, M. F. P. (2010) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2009.10.004 · Cited by 205
“…(Sydelko et al., 2001; Gimblett et al., 2003), spread of diseases (Breukers et al., 2006), criminology (Groff, 2007), land degradation and geomorphology (Karssenberg and Bridge, 2008; Wilkinson et al., 2009), or hydrology (Beven, 2002; Ajami et al., 2007; Blo¨schl et al., 2008; Brown et al., 2008).”
BackgroundFarinotti, D., Usselmann, S., Huss, M., Bauder, A., & Funk, M. (2012) · Hydrological Processes · doi:10.1002/hyp.8276 · Cited by 198
Günther, D., Marke, T., Essery, R., & Strasser, U. (2019) · Water Resources Research · doi:10.1029/2018wr023403 · Cited by 186
“…in conceptual rainfall-runoff modeling, where parameter calibration techniques are used, accounting for various sources of uncertainty was shown to improve the robustness of the optimized parameter sets and hence improved simulation results and output uncertainty estimations (Ajami et al., 2007).”
Convergence of approaches toward reducing uncertainty in predictions in ungauged basins
Wagener, T., & Montanari, A. (2011) · Water Resources Research · doi:10.1029/2010wr009469 · Cited by 180
“, 2010], the model structure and its parameters [Beven and Binley, 1992; Kuczera and Parent, 1998; Vrugt et al., 2003; Butts et al., 2004; Marshall et al., 2007; Ajami et al., 2007; Clark et al., 2008], and initial conditions [Koutsoyiannis, 2010].”
BackgroundBaroni, G., & Tarantola, S. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2013.09.022 · Cited by 173
Toward reduction of model uncertainty: Integration of Bayesian model averaging and data assimilation
Parrish, M. A., Moradkhani, H., & DeChant, C. M. (2012) · Water Resources Research · doi:10.1029/2011wr011116 · Cited by 168
“, 2009], or by using optimization techniques such as the expectation maximization algorithm [e.g., Rafterty et al., 2005; Ajami et al., 2007; Duan et al., 2007].”
MethodToward diagnostic model calibration and evaluation: Approximate Bayesian computation
Vrugt, J. A., & Sadegh, M. (2013) · Water Resources Research · doi:10.1002/wrcr.20354 · Cited by 165
“, 2008a, 2008b, 2009a; Laloy and Vrugt, 2012], (Bayesian) model averaging [Butts et al., 2004; Ajami et al., 2007; Vrugt and Robinson, 2007], the hypothetico-inductive data-based mechanistic modeling framework of Young [2012], and Bayesian data assimilation [Bulygina and Gupta, 2011].”
BackgroundMethodShafii, M., & Tolson, B. A. (2015) · Water Resources Research · doi:10.1002/2014wr016520 · Cited by 163
Liu, Y., Freer, J., Beven, K., & Matgen, P. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.01.016 · Cited by 162
Improved B ayesian multimodeling: Integration of copulas and B ayesian model averaging
Madadgar, S., & Moradkhani, H. (2014) · Water Resources Research · doi:10.1002/2014wr015965 · Cited by 172
“They applied BMA in developing the predictive PDF of an ensemble of meteorological forecasts, which motivated several applications of BMA in surface hydrology (Vrugt et al., 2006; Duan et al., 2007; Vrugt and Robinson, 2007; Ajami et al., 2007).”
Bayesian flood forecasting methods: A review
Han, S., & Coulibaly, P. (2017) · Journal of Hydrology · doi:10.1016/j.jhydrol.2017.06.004 · Cited by 169
Yen, H., Wang, X., Fontane, D. G., Harmel, R. D., & Arabi, M. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.01.004 · Cited by 163
“Predictive uncertainty contributed by model input data has been explored and proven to have significant impact on model calibration (Kavetski et al., 2002; Ajami et al., 2007; Strauch et al., 2012).”
BackgroundMethodInfluentialGuthke, A., Wöhling, T., Samaniego, L., & Nowak, W. (2014) · Water Resources Research · doi:10.1002/2014wr016062 · Cited by 166
“…, 2005; Ye et al ., 2010a], geostatistics [ Neuman , 2003; Ye et al ., 2004], vadose zone hydrology [ W € ohling and Vrugt , 2008], and surface hydrology [ Ajami et al ., 2007; Vrugt and Robinson , 2007; Renard et al ., 2010], to name only a few selected examples from the field of water resources.”
BackgroundNew challenges in integrated water quality modelling
Rode, M., Arhonditsis, G. B., Balin, D., Kebede, T., Krysanova, V., van Griensven, A., & van der Zee, S. E. A. T. M. (2010) · Hydrological Processes · doi:10.1002/hyp.7766 · Cited by 174
“…has proven to be a valuable means for evaluating the effects of the different sources of uncertainty in simple lumped as well as in more complex fully distributed hydrological models (Kavetski et al., 2002, 2006; Balin, 2004; Ajami et al., 2007; Huard and Mailhot, 2006; Marshall et al., 2006).”
BackgroundLane, R. A., Coxon, G., Freer, J. E., Wagener, T., Johnes, P. J., Bloomfield, J. P., Greene, S., Macleod, C. J. A., & Reaney, S. M. (2019) · Hydrology and Earth System Sciences · doi:10.5194/hess-23-4011-2019 · Cited by 99
The Role of Satellite-Based Remote Sensing in Improving Simulated Streamflow: A Review
Jiang, D., & Wang, K. (2019) · Water · doi:10.3390/w11081615 · Cited by 156
Ensemble Bayesian model averaging using Markov Chain Monte Carlo sampling
Vrugt, J. A., Diks, C. G. H., & Clark, M. (2008) · Environmental Fluid Mechanics · doi:10.1007/s10652-008-9106-3 · Cited by 153
“Studies applying the BMA method to a range of different forecasting problems have demonstrated that BMA produces more accurate and reliable predictions than other available multi-model techniques [1,17,19,20,23,30].”
MethodKhatami, S., Peel, M., Peterson, T. J., & Western, A. W. (2019) · Water Resources Research · doi:10.1029/2018wr023750 · Cited by 164
“…sources of uncertainty into account such as model inputs (e.g., Blazkova & Beven, 2009; Haydon & Deletic, 2009; Kavetski et al., 2006; Liu et al., 2009; Vrugt et al., 2008) or structural uncertainty (Ajami et al., 2007; Bulygina & Gupta, 2009, 2010, 2011; Butts et al., 2004; Renard et al., 2010).”
BackgroundGong, W., Gupta, H. V., Yang, D., Sricharan, K., & Hero, A. O. (2013) · Water Resources Research · doi:10.1002/wrcr.20161 · Cited by 144
“, 2006], and, particularly, for the explicit integration of multiple sources of uncertainty [Kavetski et al., 2006a, 2006b; Ajami et al., 2007; Marshall et al., 2007; Zhang et al., 2009].”
BackgroundSustainable water resource management under hydrological uncertainty
Ajami, N., Hornberger, G. M., & Sunding, D. L. (2008) · Water Resources Research · doi:10.1029/2007wr006736 · Cited by 147
“[15] The IBUNE procedure resulted in a simulation of time-variant probability distributions of streamflow (Figure 3).”
BackgroundMethodInfluentialSelf-citationSellami, H., Jeunesse, I. L., Benabdallah, S., & Vanclooster, M. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.837222 · Cited by 123
“The BMA aims to jointly assess model structure and parameter uncertainties while the multi-model ensemble approach aims to assess model structure uncertainty by sampling from the output distribution.”
MethodModeling residual hydrologic errors with Bayesian inference
Smith, T. J., Marshall, L. A., & Sharma, A. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.05.051 · Cited by 118
Rojas, R., Kahunde, S., Peeters, L. J. M., Batelaan, O., Feyen, L., & Dassargues, A. (2010) · Journal of Hydrology · doi:10.1016/j.jhydrol.2010.09.016 · Cited by 133
“…for uncertainties arising from inputs 27 (forcing data), parameters and the definition of alternative conceptual models have been 28 proposed in the literature (Beven and Binley, 1992; Neuman, 2003; Poeter and Anderson, 29 2005; Refsgaard et al., 2006; Ajami et al., 2007; Rojas et al., 2008).”
Liu, Z., Zhou, P., Chen, G., & GUO, L.-D. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.06.050 · Cited by 116
“More recently, it has been further improved and successfully applied in different problems of prediction such as signal processing, stock price forecasting and traffic flow prediction (Cao and Tay, 2001; Chang and Lin, 2001; Hong, 2011; Kao et al., 2013). In addition to those applications, SVR has also gained populari…”
BackgroundMethodNielsen‐Gammon, J. W., Banner, J. L., Cook, B. I., Tremaine, D. M., Wong, C. I., Mace, R. E., Gao, H., Yang, Z., Gonzalez, M. F., Hoffpauir, R., et al. (2020) · Earth s Future · doi:10.1029/2020ef001552 · Cited by 133
“This source of error is called structural uncertainty (Ajami et al., 2007).”
BackgroundCalibration of hydrological model GR2M using Bayesian uncertainty analysis
Huard, D., & Mailhot, A. (2008) · Water Resources Research · doi:10.1029/2007wr005949 · Cited by 121
“…seen an increasing number of strategies designed to account for structural errors in calibration or prediction [Refsgaard et al., 2006], taking advantage of Bayesian model averaging [Ajami et al., 2007], ensembles simulations [Vrugt et al., 2005] or Gaussian processes [Kennedy and O’Hagan, 2001].”
BackgroundA novel approach to parameter uncertainty analysis of hydrological models using neural networks
Shrestha, D. L., Kayastha, N., & SOLOMATINE, D. P. (2009) · Hydrology and earth system sciences · doi:10.5194/hess-13-1235-2009 · Cited by 121
“A version of the MC simulation method was introduced under the term “generalised likelihood uncertainty estimation” (GLUE) by Beven and Binley(1992). GLUE is one of the popular methods for analysing parameter uncertainty in hydrological modelling and has been widely used over the past ten years to analyse and estimate…”
MethodInfluentialEnsemble evaluation of hydrological model hypotheses
Krueger, T., Freer, J. E., Quinton, J. N., Macleod, C. J. A., Bilotta, G. S., Brazier, R. E., Butler, P., & Haygarth, P. M. (2010) · Water Resources Research · doi:10.1029/2009wr007845 · Cited by 115
“…in a Bayesian framework is an input error term [Kavetski et al., 2003; Vrugt et al., 2005; Kavetski et al., 2006a, 2006b; Huard and Mailhot, 2006; Ajami et al., 2007; Huard and Mailhot, 2008; Vrugt et al., 2008], which, again, may be difficult to estimate in practice [Beven, 2005; Kavetski et…”
BackgroundLi, Z., Xu, Z., Shao, Q., & Yang, J. (2009) · Hydrological Processes · doi:10.1002/hyp.7371 · Cited by 110
“Many studies have shown that the effects of model structure uncertainty on simulation results can be larger than those of parameter uncertainties in hydrological modelling (e.g. Butts et al., 2004; Ajami et al., 2007; Parasuraman and Elshorbagy, 2007).”
BackgroundLi, D., Marshall, L. A., Liang, Z., Sharma, A., & Zhou, Y. (2021) · Water Resources Research · doi:10.1029/2021wr029772 · Cited by 117
“Bayesian inference is one such popular probabilistic framework that has been successfully applied in many aspects of hydrology (e.g., Ajami et al., 2007; Bates & Campbell, 2001; Jeremiah et al., 2011; Kavet-ski et al., 2006; Marshall et al., 2004; Tang et al., 2019).”
MethodLiu, Z., & Merwade, V. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.08.009 · Cited by 116
Uncertainty in streamflow rating curves: methods, controls and consequences
Tomkins, K. M. (2012) · Hydrological Processes · doi:10.1002/hyp.9567 · Cited by 106
“Many studies assume that model errors follow a normal distribution, yet rarely is this verified or empirically defined (Ajami et al., 2007; Schaefli et al., 2007; Huard andMailhot, 2008).”
BackgroundWilkinson, S. N., Dougall, C., Henderson, A., Searle, R., Ellis, R., & Bartley, R. (2013) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2013.07.049 · Cited by 107
A framework to quantify GCM uncertainties for use in impact assessment studies
Woldemeskel, F., Sharma, A., Sivakumar, B., & Mehrotra, R. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.09.025 · Cited by 116
DeChant, C. M., & Moradkhani, H. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.05.045 · Cited by 105
“Multi-modeling via 84 Bayesian Model Averaging (BMA) is becoming an increasingly popular technique throughout 85 hydrologic forecasting (Ajami et al., 2007; Duan et al., 2007; Raftery et al., 2005), which has 86 also been extended to estimate the posterior model probability sequentially in time,…”
MethodDevelopment of a formal likelihood function for improved Bayesian inference of ephemeral catchments
Smith, T. J., Sharma, A., Marshall, L. A., Mehrotra, R., & Sisson, S. A. (2010) · Water Resources Research · doi:10.1029/2010wr009514 · Cited by 105
Estimating uncertainty of streamflow simulation using Bayesian neural networks
Zhang, X., Liang, F., Srinivasan, R., & Liew, M. W. V. (2009) · Water Resources Research · doi:10.1029/2008wr007030 · Cited by 102
“But the structural error inherent in any model cannot be avoided in ensemble strategies using multiparameter sets [Georgakakos et al., 2004; Ajami et al., 2007; Duan et al., 2007; Vrugt and Robinson, 2007].”
BackgroundMethodInfluentialThe hydrologist’s guide to Bayesian model selection, averaging and combination
Höge, M., Guthke, A., & Nowak, W. (2019) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.01.072 · Cited by 104
Kasiviswanathan, K. S., Cibin, R., Sudheer, K. P., & Chaubey, I. (2013) · Journal of Hydrology · doi:10.1016/j.jhydrol.2013.06.043 · Cited by 94
Liang, Z., Li, Y., Hu, Y., Li, B., & Wang, J. (2017) · Theoretical and Applied Climatology · doi:10.1007/s00704-017-2186-6 · Cited by 94
“may meet the requirements of long-term runoff forecasting (Wood and Rodríguez-Iturbe 1975; Kavetski et al. 2006a; Ajami et al. 2007).”
BackgroundProcess‐based characterization of evapotranspiration sources over the North American monsoon region
Bohn, T. J., & Vivoni, E. R. (2015) · Water Resources Research · doi:10.1002/2015wr017934 · Cited by 97
Zeng, Q., Chen, H., Xu, C.-Y., Jie, M.-X., Chen, J., Guo, S., & Liu, J. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.05.058 · Cited by 104
Land-surface parameter optimisation using data assimilation techniques: the adJULES system V1.0
Raoult, N., Jupp, T. E., Cox, P. M., & Luke, C. M. (2016) · Geoscientific model development · doi:10.5194/gmd-9-2833-2016 · Cited by 105
“(2006a, b), Ajami et al. (2007)). Process uncertainty includes the misrepresentation of land-surface processes and also the neglect of important processes (such as nitrogen-limitations on plant growth, see for example Thornton et al. (2007); Zaehle et al. (2010)), or canopy light interception (Mercado et al.”
BackgroundMethodInfluentialGeneralizing a nonlinear geophysical flood theory to medium‐sized river networks
Gupta, V. K., Mantilla, R. I., Troutman, B. M., Dawdy, D. R., & Krajewski, W. F. (2010) · Geophysical Research Letters · doi:10.1029/2009gl041540 · Cited by 91
“By contrast, diagnosis using conceptual RF‐RO models is complicated by the fact that these models are often highly parameterized, so it may be difficult to separate parameter error from other sources of model error, especially if parameter calibration is performed [Ajami et al., 2007].”
MethodLi, Y., Grimaldi, S., Walker, J., & Pauwels, V. (2016) · Remote Sensing · doi:10.3390/rs8060456 · Cited by 81
Review of the uncertainty analysis of groundwater numerical simulation
Wu, J., & Zeng, X. (2013) · Chinese Science Bulletin · doi:10.1007/s11434-013-5950-8 · Cited by 101
Accounting for three sources of uncertainty in ensemble hydrological forecasting
Thiboult, A., Anctil, F., & Boucher, M. (2016) · Hydrology and earth system sciences · doi:10.5194/hess-20-1809-2016 · Cited by 108
Assessment of the different sources of uncertainty in a SWAT model of the River Senne (Belgium)
Leta, O. T., Nossent, J., Vélez, C. E., Shrestha, N. K., van Griensven, A., & Bauwens, W. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.02.010 · Cited by 97
“In general, neglecting different sources of uncertainty during the model optimization may result in model outputs that cannot consistently represent the observations (Ajami et al., 2007).”
InfluentialRathinasamy, M., Adamowski, J., & Khosa, R. (2013) · Journal of Hydrology · doi:10.1016/j.jhydrol.2013.09.025 · Cited by 89
“For example, in hydrology, Ajami et al. (2007) and Duan et al.”
BackgroundMethodMirzaei, M., Huang, Y. F., El‐Shafie, A., & Shatirah, A. (2015) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-014-1000-6 · Cited by 96
Wöhling, T., & Vrugt, J. A. (2008) · Water Resources Research · doi:10.1029/2008wr007154 · Cited by 86
“, 2006a], streamflow [e.g., Kuczera et al., 2006; Vrugt and Robinson, 2007b; Ajami et al., 2007], and permeability structures in groundwater hydrology [Neuman, 2003; Ye et al.”
BackgroundLiu, Y. R., Li, Y., Ma, Y., Jia, Q., & Su, Y. Y. (2019) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.124349 · Cited by 86
Multivariate postprocessing techniques for probabilistic hydrological forecasting
Hemri, S., Lisniak, D., & Klein, B. (2015) · Water Resources Research · doi:10.1002/2014wr016473 · Cited by 96
Bridging the gap between GLUE and formal statistical approaches: approximate Bayesian computation
Sadegh, M., & Vrugt, J. A. (2013) · Hydrology and earth system sciences · doi:10.5194/hess-17-4831-2013 · Cited by 98
Estimating lake temperature profile and evaporation losses by leveraging MODIS LST data
Zhao, G., Gao, H., & Cai, X. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.112104 · Cited by 88
A sequential Bayesian approach for hydrologic model selection and prediction
Hsu, K., Moradkhani, H., & Sorooshian, S. (2009) · Water Resources Research · doi:10.1029/2008wr006824 · Cited by 90
Self-citationBrown, J. D., & Seo, D. (2010) · Journal of Hydrometeorology · doi:10.1175/2009jhm1188.1 · Cited by 90
“Forecasts of hydrometeorological and hydrologic variables often contain large uncertainties (Beven and Binley 1992; Anderson and Bates 2001; Gupta et al. 2005; NRC 2006; Ajami et al. 2007).”
BackgroundPropagation of structural uncertainty in watershed hydrologic models
Gupta, A., & Govindaraju, R. S. (2019) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.05.026 · Cited by 88
Product‐error‐driven generator of probable rainfall conditioned on WSR‐88D precipitation estimates
Villarini, G., Krajewski, W. F., Ciach, G. J., & Zimmerman, D. L. (2009) · Water Resources Research · doi:10.1029/2008wr006946 · Cited by 81
“…1991; Pessoa et al., 1993; Michaud and Sorooshian, 1994; O’Connell and Todini, 1996; Gupta et al., 1998; Winchell et al., 1998; Bell and Moore, 2000; Ogden et al., 2000; Borga, 2002; National Research Council, 2002; Syed et al., 2003; Smith et al., 2004; Ajami et al., 2007; Gabellani et al., 2007].”
BackgroundInfluentialTroldborg, M., Nowak, W., Tuxen, N., Bjerg, P. L., Helmig, R., & Binning, P. J. (2010) · Water Resources Research · doi:10.1029/2010wr009227 · Cited by 86
“In many of the above studies Bayesian model averaging (BMA) [Hoeting et al., 1999] has been applied in order to combine and aggregate the output from the competing models [see, e.g., Ajami et al., 2007; Li and Tsai, 2009; Neuman, 2003; Rojas et al., 2008; Ye et al., 2004].”
MethodInfluentialCharacterizing parameter sensitivity and uncertainty for a snow model across hydroclimatic regimes
He, M., Hogue, T. S., Franz, K. J., Margulis, S. A., & Vrugt, J. A. (2010) · Advances in Water Resources · doi:10.1016/j.advwatres.2010.10.002 · Cited by 92
“Some methods have recently emerged to investigate model forcing and/or structural uncertainty [1,24,50,63], however, they have not been commonly applied.”
MethodEstimating the Uncertainty of Hydrological Predictions through Data-Driven Resampling Techniques
Sikorska‐Senoner, A. E., Montanari, A., & Koutsoyiannis, D. (2014) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0000926 · Cited by 84
“Another possible solution is the 77 use of multi-modeling techniques like Bayesian Model Averaging (Ajami et al. 2007; 78 Neuman 2003).”
MethodLi, M., Wang, Q. J., Bennett, J., & Robertson, D. (2016) · Hydrology and earth system sciences · doi:10.5194/hess-20-3561-2016 · Cited by 82
“Various attempts have been made to identify and decompose the sources of errors, using methods such as sequential optimization and data assimilation (Vrugt et al., 2005), sequential assimilation (Moradkhani et al., 2005), the Bayesian total error analysis (BATEA) (Kavetski et al., 2006a, b; Kuczera et al., 2006), and…”
MethodJoint and respective effects of long- and short-term forecast uncertainties on reservoir operations
Zhao, T., & Zhao, J. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.04.063 · Cited by 76
Uncertainty quantification in watershed hydrology: Which method to use?
Gupta, A., & Govindaraju, R. S. (2022) · Journal of Hydrology · doi:10.1016/j.jhydrol.2022.128749 · Cited by 82
On the value of conditioning data to reduce conceptual model uncertainty in groundwater modeling
Rojas, R., Feyen, L., Batelaan, O., & Dassargues, A. (2010) · Water Resources Research · doi:10.1029/2009wr008822 · Cited by 79
“, 1999] has recently gained popularity [e.g., Neuman, 2003; Ajami et al., 2005; Vrugt et al., 2006; Ajami et al., 2007; Duan et al., 2007; Vrugt and Robinson, 2007; Ajami et al., 2008; Tsai and Li, 2008; Wöhling and Vrugt, 2008; Hsu et al., 2009; Li and Tsai, 2009; Singh et al., 2010; Ye et al., 2010a].”
BackgroundInfluentialLin, K., Zhang, Q., & Chen, X. (2010) · Journal of Hydrology · doi:10.1016/j.jhydrol.2010.09.012 · Cited by 58
Yen, H., Bailey, R. T., Arabi, M., Ahmadi, M., White, M. J., & Arnold, J. G. (2014) · Journal of Environmental Quality · doi:10.2134/jeq2013.03.0110 · Cited by 80
Xie, Z., Liu, S., Zeng, Y., Gao, J., Qin, P., Jia, B., Xie, J., Liu, B., Li, R., Wang, Y., et al. (2018) · Journal of Geophysical Research Atmospheres · doi:10.1029/2018jd028369 · Cited by 74
“The modeling uncertainties can be quantified by ensemble simulations (Ajami et al., 2007; Duan et al., 2007).”
BackgroundGayler, S., Wöhling, T., Grzeschik, M., Ingwersen, J., Wizemann, H., Warrach‐Sagi, K., Högy, P., Attinger, S., Streck, T., & Wulfmeyer, V. (2014) · Water Resources Research · doi:10.1002/2013wr014634 · Cited by 75
“The level of this uncertainty can be quite large and even greater than the uncertainty associated with input and parameter uncertainty [Ajami et al., 2007].”
BackgroundZhang, Q., Shi, L., Holzman, M. E., Ye, M., Wang, Y., Carmona, F., & Zha, Y. (2019) · Advances in Water Resources · doi:10.1016/j.advwatres.2019.103407 · Cited by 75
Identification of the best multi-model combination for simulating river discharge
Kumar, A. R., Singh, R. P., Jena, P. P., Chatterjee, C., & Mishra, A. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.03.060 · Cited by 76
Huang, X., Huang, G., Yu, C., Ni, S., & Yu, L. (2017) · Field Crops Research · doi:10.1016/j.fcr.2017.06.011 · Cited by 73
Sun, R., Yuan, H., & Yang, Y. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.09.024 · Cited by 71
Metadata
- Authors
- Ajami, N. K., Duan, Q., & Sorooshian, S.
- Affiliations
- University of California, Berkeley (US)
- Lawrence Livermore National Laboratory (US)
- University of California, Irvine (US)
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2007-01
- Volume
- 43
- Issue
- 1
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W1527594523
- Semantic Scholar
- f3cacfdeaefba2220804654e2bf1e0e9a64dd82d
- Cited by
- 597
- References
- 49
- Citations by year
- 2026: 20 · 2025: 25 · 2024: 23 · 2023: 40 · 2022: 37 · 2021: 29 · 2020: 28 · 2019: 39 · 2018: 39 · 2017: 38 · 2016: 45 · 2015: 34 · 2014: 46 · 2013: 31 · 2012: 27
- FWCI
- 26.18
- Type
- journal article
- Language
- en
- Open access
- green
- escholarship.org
- Locations
- Water Resources Research (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Environmental Engineering › Hydrological Forecasting Using AI
- Keywords
- rainfall-runoff modeling, parameter uncertainty, model structure uncertainty, Bayesian model averaging, streamflow forecasting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.