Combining multiobjective optimization and Bayesian model averaging to calibrate forecast ensembles of soil hydraulic models
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Most studies in vadose zone hydrology use a single conceptual model for predictive inference and analysis. Focusing on the outcome of a single model is prone to statistical bias and underestimation of uncertainty. In this study, we combine multiobjective optimization and Bayesian model averaging (BMA) to generate forecast ensembles of soil hydraulic models. To illustrate our method, we use observed tensiometric pressure head data at three different depths in a layered vadose zone of volcanic origin in New Zealand. A set of seven different soil hydraulic models is calibrated using a multiobjective formulation with three different objective functions that each measure the mismatch between observed and predicted soil water pressure head at one specific depth. The Pareto solution space corresponding to these three objectives is estimated with AMALGAM and used to generate four different model ensembles. These ensembles are postprocessed with BMA and used for predictive analysis and uncertainty estimation. Our most important conclusions for the vadose zone under consideration are (1) the mean BMA forecast exhibits similar predictive capabilities as the best individual performing soil hydraulic model, (2) the size of the BMA uncertainty ranges increase with increasing depth and dryness in the soil profile, (3) the best performing ensemble corresponds to the compromise (or balanced) solution of the three‐objective Pareto surface, and (4) the combined multiobjective optimization and BMA framework proposed in this paper is very useful to generate forecast ensembles of soil hydraulic models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Ensemble models that are weighted combinations of the posterior distributions of component models provide lower error for the point estimate and more accurate uncertainty intervals [62-66].”
From Modeling causes of death: an integrated approach using CODEm (2012) · cites this paper as [62]
Citations
Cites
A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated Soils
van Genuchten, M. T. (1980) · Soil Science Society of America Journal · doi:10.2136/sssaj1980.03615995004400050002x · Cited by 27,578 · cited 1×
“In particular, the Mualem-van Genuchten [van Genuchten, 1980] (MVG) model has become the standard choice for analyzing unsaturated porous media.”
MethodMulti-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
A new model for predicting the hydraulic conductivity of unsaturated porous media
Mualem, Y. (1976) · Water Resources Research · doi:10.1029/wr012i003p00513 · Cited by 8,300
The future of distributed models: model calibration and uncertainty prediction
Beven, K., & Binley, A. (1992) · Hydrological Processes · doi:10.1002/hyp.3360060305 · Cited by 4,527 · cited 1×
“There is significant uncertainty associated with the correct formulation of these processes underlying the system of interest [Beven and Binley, 1992; Gupta et al., 1998; Kuczera et al., 2006; Vrugt and Robinson, 2007a].”
BackgroundHoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 3×
“Bayesian model averaging (BMA [Leamer, 1978; Kass and Raftery, 1995; Hoeting et al., 1999]) provides a way to combine inferences and predictions of several different conceptual models and to jointly assess their predictive uncertainty.”
BackgroundMethodProperties of Porous Media Affecting Fluid Flow
Brooks, R. H., & Corey, A. T. (1966) · Journal of the Irrigation and Drainage Division · doi:10.1061/jrcea4.0000425 · Cited by 2,327
Simulation of field water use and crop yield
Feddes, R. A., Kowalik, P. J., & Zaradny, H. (1978) · Socio-Environmental Systems Modeling · Cited by 1,994
Using Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915
A general mass‐conservative numerical solution for the unsaturated flow equation
Celia, M. A., Bouloutas, E. T., & Zarba, R. L. (1990) · Water Resources Research · doi:10.1029/wr026i007p01483 · Cited by 1,774
Gupta, H. V., Sorooshian, S., & Yapo, P. O. (1998) · Water Resources Research · doi:10.1029/97wr03495 · Cited by 1,426 · cited 2×
“There is significant uncertainty associated with the correct formulation of these processes underlying the system of interest [Beven and Binley, 1992; Gupta et al., 1998; Kuczera et al., 2006; Vrugt and Robinson, 2007a].”
BackgroundVrugt, J. A., Gupta, H. V., Bouten, W., & Sorooshian, S. (2003) · Water Resources Research · doi:10.1029/2002wr001642 · Cited by 1,196
Self-citationHydraulic conductivity estimation for soils with heterogeneous pore structure
Durner, W. (1994) · Water Resources Research · doi:10.1029/93wr02676 · Cited by 1,175
Specification Searches: Ad Hoc Inference with Non-Experimental Data.
Richard, J.-F., & Leamer, E. E. (1981) · Economica · doi:10.2307/2553491 · Cited by 1,114
Šimůnek, J., Jarvis, N. J., van Genuchten, M. T., & Gärdenäs, A. (2003) · Journal of Hydrology · doi:10.1016/s0022-1694(02)00252-4 · Cited by 982
Lognormal Distribution Model for Unsaturated Soil Hydraulic Properties
Kosugi, K. (1996) · Water Resources Research · doi:10.1029/96wr01776 · Cited by 744
Effective and efficient algorithm for multiobjective optimization of hydrologic models
Vrugt, J. A., Gupta, H. V., Bastidas, L. A., Bouten, W., & Sorooshian, S. (2003) · Water Resources Research · doi:10.1029/2002wr001746 · Cited by 624
Self-citationImproved evolutionary optimization from genetically adaptive multimethod search
Vrugt, J. A., & Robinson, B. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610471104 · Cited by 614
Self-citationAjami, N. K., Duan, Q., & Sorooshian, S. (2007) · Water Resources Research · doi:10.1029/2005wr004745 · Cited by 597 · cited 2×
“, 2006a], streamflow [e.g., Kuczera et al., 2006; Vrugt and Robinson, 2007b; Ajami et al., 2007], and permeability structures in groundwater hydrology [Neuman, 2003; Ye et al.”
BackgroundCriteria for Evaluation of Watershed Models
ASCE Task Committee on Definition of Criteria for Evaluation of Watershed Models of the Watershed Management Committee, I. A. D. D. (1993) · Journal of Irrigation and Drainage Engineering · doi:10.1061/(asce)0733-9437(1993)119:3(429 · Cited by 528
Maximum likelihood Bayesian averaging of uncertain model predictions
Neuman, S. P. (2003) · Stochastic Environmental Research and Risk Assessment (SERRA) · doi:10.1007/s00477-003-0151-7 · Cited by 459 · cited 2×
“…forecasting of surface temperature [Raftery et al., 2005], surface temperature and sea level pressure [Vrugt et al., 2006a], streamflow [e.g., Kuczera et al., 2006; Vrugt and Robinson, 2007b; Ajami et al., 2007], and permeability structures in groundwater hydrology [Neuman, 2003; Ye et al., 2004].”
BackgroundMethodVogel, T., van Genuchten, M. T., & Cislerova, M. (2000) · Advances in Water Resources · doi:10.1016/s0309-1708(00)00037-3 · Cited by 419 · cited 1×
“The modified Mualem-van Genuchten model (nonhysteretic) (MVG [Vogel et al., 2001]) is as follows: Se ¼ q qr qs qr ¼ qr þ 1 1þ ahj jn½ m h hs 1 h hs 8 : ð8Þ K Seð Þ ¼ KsSle 1 1 S1=me mh i2 ð9Þ W12432 WÖHLING AND VRUGT: BAYESIAN MODEL AVERAGING OF SOIL HYDRAULIC MODELS 3 of 18 W12432 where Se is…”
MethodVrugt, J. A., & Robinson, B. A. (2007) · Water Resources Research · doi:10.1029/2005wr004838 · Cited by 334
Self-citationKuczera, G., Kavetski, D., Franks, S., & Thyer, M. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2006.05.010 · Cited by 333 · cited 2×
“There is significant uncertainty associated with the correct formulation of these processes underlying the system of interest [Beven and Binley, 1992; Gupta et al., 1998; Kuczera et al., 2006; Vrugt and Robinson, 2007a].”
BackgroundOn model selection criteria in multimodel analysis
Ye, M., Meyer, P. D., & Neuman, S. P. (2008) · Water Resources Research · doi:10.1029/2008wr006803 · Cited by 262
Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff
Ye, M., Neuman, S. P., & Meyer, P. D. (2004) · Water Resources Research · doi:10.1029/2003wr002557 · Cited by 211 · cited 2×
“…forecasting of surface temperature [Raftery et al., 2005], surface temperature and sea level pressure [Vrugt et al., 2006a], streamflow [e.g., Kuczera et al., 2006; Vrugt and Robinson, 2007b; Ajami et al., 2007], and permeability structures in groundwater hydrology [Neuman, 2003; Ye et al., 2004].”
BackgroundWöhling, T., Vrugt, J. A., & Barkle, G. (2008) · Soil Science Society of America Journal · doi:10.2136/sssaj2007.0176 · Cited by 141 · cited 5×
“This decision was made because water flow in the highly porous volcanic vadose zone at the Spydia field site occurs primarily under wet conditions, and the soil hydraulic conductivity declines rapidly with decreasing soil water pressure heads [Wöhling et al., 2008].”
BackgroundMethodInfluentialSelf-citationMertens, J., Madsen, H., Kristensen, M., Jacques, D., & Feyen, J. (2004) · Hydrological Processes · doi:10.1002/hyp.5591 · Cited by 113 · cited 1×
“[3] Single deterministic soil hydraulic models are often used for studying flow and transport through the vadose zone [e.g., Mertens et al., 2005; Guber et al., 2006; Sansoulet et al., 2008].”
MethodGuber, A. K., Pachepsky, Y. A., van Genuchten, M. T., Rawls, W. J., Simunek, J., Jacques, D., Nicholson, T. J., & Cady, R. E. (2006) · Vadose Zone Journal · doi:10.2136/vzj2005.0111 · Cited by 91 · cited 1×
“[3] Single deterministic soil hydraulic models are often used for studying flow and transport through the vadose zone [e.g., Mertens et al., 2005; Guber et al., 2006; Sansoulet et al., 2008].”
MethodHow well does your model fit the data?
Hall, M. J. (2001) · Journal of Hydroinformatics · doi:10.2166/hydro.2001.0006 · Cited by 77 · cited 2×
“Ce is a widely used fitting criterion and may assume a negative value if the mean square error of the best prediction exceeds the variance of the observations [Hall, 2001].”
MethodInfluentialMulti‐objective calibration of forecast ensembles using Bayesian model averaging
Vrugt, J. A., Clark, M. P., Diks, C. G. H., Duan, Q., & Robinson, B. A. (2006) · Geophysical Research Letters · doi:10.1029/2006gl027126 · Cited by 74 · cited 3×
“The use of multiple different computational nodes within a distributed computing environment would significantly reduce the time needed for calibration [Vrugt et al., 2006b].”
BackgroundMethodInfluentialSelf-citationApplication of parallel computing to stochastic parameter estimation in environmental models
Vrugt, J. A., Nualláin, B. Ó., Robinson, B. A., Bouten, W., Dekker, S. C., & Sloot, P. M. A. (2006) · Computers & Geosciences · doi:10.1016/j.cageo.2005.10.015 · Cited by 68
Self-citationSansoulet, J., Cabidoche, Y., Cattan, P., Ruy, S., & Šimůnek, J. (2008) · Vadose Zone Journal · doi:10.2136/vzj2007.0073 · Cited by 46
Using Bayesian Model Averaging to Calibrate Forecast Ensembles
Raftery, A. E., Balabdaoui, F., Gneiting, T., & Polakowski, M. (2003) · doi:10.21236/ada459828 · Cited by 41
Cited by
Modeling causes of death: an integrated approach using CODEm
Foreman, K. J., Lozano, R., Lopez, A. D., & Murray, C. J. (2012) · Population Health Metrics · doi:10.1186/1478-7954-10-1 · Cited by 564
“Ensemble models that are weighted combinations of the posterior distributions of component models provide lower error for the point estimate and more accurate uncertainty intervals [62-66].”
BackgroundA short exploration of structural noise
Doherty, J., & Welter, D. (2010) · Water Resources Research · doi:10.1029/2009wr008377 · Cited by 208
“[9] An approach that bears some similarity to that taken by Beven and his coworkers is that adopted by (among others) Gupta et al. [1998], Madsen [2000, 2003], Vrugt et al. [2003] and Wohling and Vrugt [2008] .”
ResultComparison of point forecast accuracy of model averaging methods in hydrologic applications
Diks, C. G. H., & Vrugt, J. A. (2010) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-010-0378-z · Cited by 165
“A detailed description of each of these seven models has been given in Wöhling and Vrugt (2008) and so will not be repeated here.”
InfluentialSelf-citationYen, H., Wang, X., Fontane, D. G., Harmel, R. D., & Arabi, M. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.01.004 · Cited by 163
“For example, Expectation-Maximization (EM) algorithm and the Shuffled Complex Evolution Metropolis algorithm (Raftery et al., 2005; Duan et al., 2007; Wöhling and Vrugt, 2008).”
MethodGuthke, A., Wöhling, T., Samaniego, L., & Nowak, W. (2014) · Water Resources Research · doi:10.1002/2014wr016062 · Cited by 166
Self-citation
Metadata
- Authors
- Wöhling, T., & Vrugt, J. A.
- Affiliations
- Lincoln Environmental Research Lincoln Ventures Ltd. Hamilton New Zealand
- Los Alamos National Laboratory (US)
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2008-12
- Volume
- 44
- Issue
- 12
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W1483053213
- Cited by
- 86
- References
- 34
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 5 · 2023: 6 · 2022: 5 · 2021: 3 · 2020: 3 · 2019: 3 · 2018: 4 · 2016: 4 · 2015: 14 · 2014: 12 · 2013: 6 · 2012: 4
- FWCI
- 15.93
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Water Resources Research (publishedVersion)
- Funders
- Foundation for Research, Science and Technology
- Los Alamos National Laboratory
- Topics
- Physical Sciences › Engineering › Civil and Structural Engineering › Soil and Unsaturated Flow
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Physical Sciences › Environmental Science › Environmental Engineering › Soil Moisture and Remote Sensing
- Keywords
- Bayesian model averaging, multi-objective optimization, forecast ensembles, vadose zone hydrology, model calibration, uncertainty estimation, Pareto front, amalgam, soil water pressure head
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.