The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Evaluating model performance: towards a non-parametric variant of the Kling-Gupta efficiency
Open accessAbstract
Goodness-of-fit measures are important for an objective evaluation of runoff model performance. The Kling-Gupta efficiency (RKG), which has been introduced as an improvement of the widely used Nash-Sutcliffe efficiency, considers different types of model errors, namely the error in the mean, the variability, and the dynamics. The calculation of RKG is implicitly based on the assumptions of data linearity, data normality, and the absence of outliers. In this study, we propose a modification of RKG as an efficiency measure comprising non-parametric components, i.e. the Spearman rank correlation and the normalized flow–duration curve. The performances of model simulations for 100 catchments using the new measure were compared to those obtained using RKG based on a number of statistical metrics and hydrological signatures. The new measure resulted overall in better or comparable model performances, and thus it was concluded that efficiency measures with non-parametric components provide a suitable alternative to commonly used measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation
Legates, D. R., & McCabe, G. J. (1999) · Water Resources Research · doi:10.1029/1998wr900018 · Cited by 4,591
Comparison of different efficiency criteria for hydrological model assessment
Krause, P., Boyle, D. P., & Bäse, F. (2005) · Advances in Geosciences · doi:10.5194/adgeo-5-89-2005 · Cited by 2,809
Gupta, H. V., Sorooshian, S., & Yapo, P. O. (1998) · Water Resources Research · doi:10.1029/97wr03495 · Cited by 1,426
Development and test of the distributed HBV-96 hydrological model
Lindström, G., Johansson, B., Persson, M., Gardelin, M., & Bergström, S. (1997) · Journal of Hydrology · doi:10.1016/s0022-1694(97)00041-3 · Cited by 1,131
Skill Scores Based on the Mean Square Error and Their Relationships to the Correlation Coefficient
Murphy, A. H. (1988) · Monthly Weather Review · doi:10.1175/1520-0493(1988)116<2417:ssbotm>2.0.co;2 · Cited by 881
Development and application of a conceptual runoff model for Scandinavian catchments
Bergström, S. (1976) · Cited by 794
Newman, A. J., Clark, M. P., Sampson, K., Wood, A., Hay, L. E., Bock, A., Viger, R. J., Blodgett, D., Brekke, L., Arnold, J. R., et al. (2015) · Hydrology and Earth System Sciences · doi:10.5194/hess-19-209-2015 · Cited by 777
Boyle, D. P., Gupta, H. V., & Sorooshian, S. (2000) · Water Resources Research · doi:10.1029/2000wr900207 · Cited by 696
Yilmaz, K. K., Gupta, H. V., & Wagener, T. (2008) · Water Resources Research · doi:10.1029/2007wr006716 · Cited by 681
Perrin, C., Michel, C., & Andréassian, V. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(00)00393-0 · Cited by 632
Teaching hydrological modeling with a user-friendly catchment-runoff-model software package
(2012) · doi:10.5194/hess-16-3315-2012 · Cited by 616
Global‐scale regionalization of hydrologic model parameters
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Miralles, D. G., McVicar, T. R., Schellekens, J., & Bruijnzeel, L. A. (2016) · Water Resources Research · doi:10.1002/2015wr018247 · Cited by 511
One decade of multi-objective calibration approaches in hydrological modelling: a review
Efstratiadis, A., & Koutsoyiannis, D. (2010) · Hydrological Sciences Journal · doi:10.1080/02626660903526292 · Cited by 479
Madsen, H. (2002) · Advances in Water Resources · doi:10.1016/s0309-1708(02)00092-1 · Cited by 462
FLOW DURATION CURVES II: A REVIEW OF APPLICATIONS IN WATER RESOURCES PLANNING 1
Vogel, R. M., & Fennessey, N. M. (1995) · JAWRA Journal of the American Water Resources Association · doi:10.1111/j.1752-1688.1995.tb03419.x · Cited by 367
Multi-criteria calibration of a conceptual runoff model using a genetic algorithm
Seibert, J. (2000) · Hydrology and earth system sciences · doi:10.5194/hess-4-215-2000 · Cited by 360
Self-citationCalibration of hydrological models using flow-duration curves
Westerberg, I. K., Guerrero, J.-L., Younger, P. M., Beven, K. J., Seibert, J., Halldin, S., Freer, J. E., & Xu, C.-Y. (2011) · Hydrology and Earth System Sciences · doi:10.5194/hess-15-2205-2011 · Cited by 254
Self-citationPfannerstill, M., Guse, B., & Fohrer, N. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2013.12.044 · Cited by 204
Technical note: Pitfalls in using log-transformed flows within the KGE criterion
Santos, L., Thirel, G., & Perrin, C. (2018) · Hydrology and Earth System Sciences · doi:10.5194/hess-22-4583-2018 · Cited by 148 · cited 2×
“This approach should be avoided for computing RKG, because using log-transformed discharge would result in RKG values that are sensitive to discharge close to zero and that are dependent on the chosen flow unit (Santos et al. 2018).”
MethodPokhrel, P., Yılmaz, K. K., & Gupta, H. V. (2008) · Journal of Hydrology · doi:10.1016/j.jhydrol.2008.12.004 · Cited by 138
Which objective function to calibrate rainfall–runoff models for low-flow index simulations?
Garcia, F., Folton, N., & Oudin, L. (2017) · Hydrological Sciences Journal · doi:10.1080/02626667.2017.1308511 · Cited by 138
A Simple Automatic Calibration Routine for the HBV Model
Lindström, G. (1997) · Hydrology research · doi:10.2166/nh.1997.0009 · Cited by 137
Global-scale regionalization of hydrologic model parameters
Beck, H., I.j.m., V. D. A., Arie, D. R., et al. (2016) · Joint Research Centre (European Commission) · doi:10.1002/2015wr018247/full · Cited by 132
Model Calibration Criteria for Estimating Ecological Flow Characteristics
Vis, M. J. P., Knight, R. R., Pool, S., Wolfe, W., & Seibert, J. (2015) · Water · doi:10.3390/w7052358 · Cited by 71
Self-citationMulti-metric calibration of hydrological model to capture overall flow regimes
Zhang, Y., Shao, Q., Zhang, S., Zhai, X., & She, D. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.05.053 · Cited by 66
Patterns of regional hydroclimatic shifts: An analysis of changing hydrologic regimes
Coopersmith, E. J., Minsker, B. S., & Sivapalan, M. (2014) · Water Resources Research · doi:10.1002/2012wr013320 · Cited by 58
Cited by
Knoben, W. J. M., Freer, J. E., & Woods, R. A. (2019) · Hydrology and Earth System Sciences · doi:10.5194/hess-23-4323-2019 · Cited by 1,432
The Abuse of Popular Performance Metrics in Hydrologic Modeling
Clark, M. P., Vogel, R. M., Lamontagne, J. R., Mizukami, N., Knoben, W. J. M., Tang, G., Gharari, S., Freer, J. E., Whitfield, P. H., Shook, K. R., et al. (2021) · Water Resources Research · doi:10.1029/2020wr029001 · Cited by 306
Dembélé, M., Hrachowitz, M., Savenije, H. H. G., Mariéthoz, G., & Schaefli, B. (2020) · Water Resources Research · doi:10.1029/2019wr026085 · Cited by 253
Metadata
- Authors
- Pool, S., Vis, M., & Seibert, J.
- Venue
- Hydrological Sciences Journal
- Publisher
- Informa UK Limited
- Published
- 2018-10-26
- Volume
- 63
- Issue
- 13-14
- Pages
- 1941-1953
- ISSN
- 0262-6667 (ISSN-L)
- 2150-3435
- OpenAlex
- W2900581768
- Cited by
- 295
- References
- 29
- FWCI
- 8.59
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.