Worldwide evaluation of mean and extreme runoff from six global-scale hydrological models that account for human impacts
Open accessAbstract
Global-scale hydrological models are routinely used to assess water scarcity, flood hazards and droughts worldwide. Recent efforts to incorporate anthropogenic activities in these models have enabled more realistic comparisons with observations. Here we evaluate simulations from an ensemble of six models participating in the second phase of the Inter-Sectoral Impact Model Inter-comparison Project (ISIMIP2a). We simulate monthly runoff in 40 catchments, spatially distributed across eight global hydrobelts. The performance of each model and the ensemble mean is examined with respect to their ability to replicate observed mean and extreme runoff under human-influenced conditions. Application of a novel integrated evaluation metric to quantify the models' ability to simulate timeseries of monthly runoff suggests that the models generally perform better in the wetter equatorial and northern hydrobelts than in drier southern hydrobelts. When model outputs are temporally aggregated to assess mean annual and extreme runoff, the models perform better. Nevertheless, we find a general trend in the majority of models towards the overestimation of mean annual runoff and all indicators of upper and lower extreme runoff. The models struggle to capture the timing of the seasonal cycle, particularly in northern hydrobelts, while in southern hydrobelts the models struggle to reproduce the magnitude of the seasonal cycle. It is noteworthy that over all hydrological indicators, the ensemble mean fails to perform better than any individual model—a finding that challenges the commonly held perception that model ensemble estimates deliver superior performance over individual models. The study highlights the need for continued model development and improvement. It also suggests that caution should be taken when summarising the simulations from a model ensemble based upon its mean output.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For global-scale applications, hydrologic models are often uncalibrated, leading to large predictive uncertainty.
“For global-scale applications, however, models are often uncalibrated (Hattermann et al., 2017;Zaherpour et al., 2018), leading to large predictive uncertainty.”
From The suitability of differentiable, physics-informed machine learning hydrologic models for ungauged regions and climate change impact assessment (2023) · cites this paper as Zaherpour et al., 2018
Cites
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862 · see citing works
Müller Schmied, H., Eisner, S., Franz, D., Wattenbach, M., Portmann, F. T., Flörke, M., & Döll, P. (2014) · Hydrology and Earth System Sciences · doi:10.5194/hess-18-3511-2014 · Cited by 415 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Feng, D., Beck, H., Lawson, K., & Shen, C. (2023) · Hydrology and Earth System Sciences · doi:10.5194/hess-27-2357-2023 · Cited by 197 · see citing works
Porkka, M., Virkki, V., Wang-Erlandsson, L., Gerten, D., Gleeson, T., Mohan, C., Fetzer, I., Jaramillo, F., Staal, A., te Wierik, S., et al. (2024) · doi:10.31223/x5bp8f · Cited by 78 · see citing works
Self-citationMohan, C., Gleeson, T., Famiglietti, J. S., Virkki, V., Kummu, M., Porkka, M., Huggins, X., Wang-Erlandsson, L., Gerten, D., & Jähnig, S. C. (2022) · doi:10.1002/essoar.10507838.2 · Cited by 14 · see citing works
Self-citation
- Authors
- Zaherpour, J., Gosling, S. N., Mount, N., Schmied, H. M., Veldkamp, T. I. E., Dankers, R., Eisner, S., Gerten, D., Gudmundsson, L., Haddeland, I., Hanasaki, N., Kim, H., Leng, G., Liu, J., Masaki, Y., Oki, T., Pokhrel, Y., Satoh, Y., Schewe, J., & Wada, Y.
- Affiliations
- University of Nottingham (GB)
- Goethe University Frankfurt (DE)
- International Institute for Applied Systems Analysis (AT)
- Met Office (GB)
- University of Kassel (DE)
- Humboldt-Universität zu Berlin (DE)
- ETH Zurich (CH)
- Norwegian Public Roads Administration (NO)
- National Institute for Environmental Studies (JP)
- Institute of Industrial Science, The University of Tokyo (JP)
- University of Oxford (GB)
- Southern University of Science and Technology (CN)
- Hirosaki University (JP)
- United Nations University (JP)
- Michigan State University (US)
- Potsdam Institute for Climate Impact Research (DE)
- Corresponding author
- Zaherpour, Jamal
- ORCID
- Venue
- Environmental Research Letters
- Publisher
- IOP Publishing
- Published
- 2018-06-12
- Volume
- 13
- Issue
- 6
- Pages
- 065015
- ISSN
- 1748-9326 (ISSN-L)
- OpenAlex
- W2803414577
- Cited by
- 174
- References
- 2
- Citations by year
- 2026: 13 · 2025: 22 · 2024: 22 · 2023: 16 · 2022: 38 · 2021: 29 · 2020: 19 · 2019: 12 · 2018: 3
- FWCI
- 6.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Environmental Research Letters (publishedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (publishedVersion, cc-by)
- IIASA PURE (International Institute of Applied Systems Analysis) (acceptedVersion)
- Socio-Environmental Systems Modeling (acceptedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Nottingham ePrints (University of Nottingham) (submittedVersion)
- Informationszentrum Lebenswissenschaften (ZB MED) (submittedVersion, cc-by)
- RENATE (submittedVersion, cc-by-nc-nd)
- Oxford University Research Archive (ORA) (University of Oxford) (submittedVersion, cc-by)
- Publication Database PIK (Potsdam Institute for Climate Impact Research (PIK)) (submittedVersion, other-oa)
- VU Research Portal (submittedVersion, other-oa)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- RENATE (cc-by)
- ETH Zürich Research Collection (cc-by)
- Funders
- U.S. Department of Energy (DE-AC05?, DE‐AC05‐76RLO1830)
- Battelle (DE-AC05, DE‐AC05‐76RLO 1830)
- European Commission (603864)
- Grains Research and Development Corporation
- National Natural Science Foundation of China (G01296001, DE-AC05-76RLO1830, 41625001, 41571022, 41571022, 41625001)
- Islamic Development Bank
- Norges Forskningsråd (243803/E10, 243803)
- Southern University of Science and Technology (41625001, G01296001)
- Office of Science (DE-AC05-76RLO 1830)
- Leibniz-Gemeinschaft (SAW-2013-PIK-5)
- Japan Society for the Promotion of Science (16H06291)
- Pacific Northwest National Laboratory (DE-AC05-76RLO 1830)
- Topics
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Environmental Science › Environmental Engineering › Soil Moisture and Remote Sensing
- Keywords
- extreme runoff, mean annual runoff, ISIMIP2a, model intercomparison, human impacts on hydrology, seasonal cycle, model evaluation metrics, water scarcity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review