The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Do Nash values have value?
Open accessAbstract
How Do We Communicate Model Performance?The process of model performance evaluation is of primary importance, not only in the model development and calibration process, but also when communicating the results to other researchers and to stakeholders.The basic 'rule' is that every modelling result should be put into context, for example, by indicating the model performance using appropriate indicators, and by highlighting potential sources of uncertainty, and this practice has found its entry into the large majority of papers and conference presentations.While the question of how to communicate the performance of a model to potential end-users is currently receiving increasing interest (e.g.Pappenberger and Beven, 2006), we-as well as many other colleagues-observe regularly that researchers take much less care when communicating model performance amongst ourselves.We seem to assume that we are speaking about familiar performance concepts and that they have comparable significance for various types of model applications and case studies.In doing so, we do not pay sufficient attention to making clear what the values represented by our performance measures really mean.Even concepts as simple as the bias between an observed and a simulated time series need to be put into proper context: whereas a 10% bias in simulation of simulated discharge may be unacceptable in a climate change impact assessment, it may be of less concern in the context of real-time flood forecasting.While some performance measures can have an absolute meaning, such as the common measure of linear correlation, the vast majority of performance measures, and in particular quadratic-error-based measures, can only be properly interpreted when viewed in the context of a reference value.For hydrologists, the Nash-Sutcliffe efficiency measure (Nash and Sutcliffe, 1970) (Equation (1)) has become a common part of our everyday jargon when reporting the results of a catchment modelling study.Somehow, we seem to ignore the fact that modellers in other fields of environmental sciences are not often familiar with what a 'Nash value' is.More important, it is worth asking whether we ourselves know what it means when we report that a model has a 'Nash value of 0•87'.The reality is that the Nash efficiency value, while a convenient and normalized (-inf to 1•0) measure of model performance does not provide a reliable basis for comparing the results of different case studies.In stating this, we are not pointing out anything not already well known (e.g.Martinec and Rango, 1989; Legates and McCabe, 1999; Seibert, 2001), but we think that it is worth recalling, with the hope that the following discussion will encourage hydrologists to use performance measures in a more useful manner-which is to always provide appropriate reference values-so that reported Nash values can be properly interpreted. Nash Values Need a BaselineThe Nash-Sutcliffe performance measure (Nash and Sutcliffe, 1970), called, hereafter, the Nash-Sutcliffe efficiency (NSE), is computed as follows:
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674
Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation
Legates, D. R., & McCabe, G. J. (1999) · Water Resources Research · doi:10.1029/1998wr900018 · Cited by 4,591
Stochastic climate models: Part I. Theory
Hasselmann, K. (1976) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v28i6.11316 · Cited by 1,396
Vrugt, J. A., Gupta, H. V., Bouten, W., & Sorooshian, S. (2003) · Water Resources Research · doi:10.1029/2002wr001642 · Cited by 1,196
Self-citationStochastic climate models Part I. Theory
Hasselmann, K. (1976) · Tellus · doi:10.1111/j.2153-3490.1976.tb00696.x · Cited by 954
(2001) · Birkhäuser Basel eBooks · doi:10.1007/978-3-0348-8287-3 · Cited by 718
Ignorance is bliss: Or seven reasons not to use uncertainty analysis
Pappenberger, F., & Beven, K. J. (2006) · Water Resources Research · doi:10.1029/2005wr004820 · Cited by 555
A comparison of regionalisation methods for catchment model parameters
Párajka, J., Merz, R., & Blöschl, G. (2005) · Hydrology and earth system sciences · doi:10.5194/hess-9-157-2005 · Cited by 450
A conceptual glacio-hydrological model for high mountainous catchments
Schaefli, B., Hingray, B., Niggli, M., & Musy, A. (2005) · Hydrology and earth system sciences · doi:10.5194/hess-9-95-2005 · Cited by 278
Self-citationGurtz, J., Baltensweiler, A., & Lang, H. (1999) · Hydrological Processes · doi:10.1002/(sici)1099-1085(19991215)13:17<2751::aid-hyp897>3.0.co;2-o · Cited by 189
Cited by
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
Self-citationKnoben, W. J. M., Freer, J. E., & Woods, R. A. (2019) · Hydrology and Earth System Sciences · doi:10.5194/hess-23-4323-2019 · Cited by 1,432
A decade of Predictions in Ungauged Basins (PUB)—a review
Hrachowitz, M., Savenije, H. H. G., Blöschl, G., McDonnell, J. J., Sivapalan, M., Pomeroy, J. W., Arheimer, B., Blume, T., Clark, M. P., Ehret, U., et al. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.803183 · Cited by 1,295
Self-citationRitter, A., & Muñoz-Carpena, R. (2013) · Journal of Hydrology · doi:10.1016/j.jhydrol.2012.12.004 · Cited by 991
Beck, H. E., Vergopolan, N., Pan, M., Levizzani, V., van Dijk, A. I. J. M., Weedon, G. P., Brocca, L., Pappenberger, F., Huffman, G. J., & Wood, E. F. (2017) · Hydrology and Earth System Sciences · doi:10.5194/hess-21-6201-2017 · Cited by 891
Clark, M. P., Slater, A. G., Rupp, D. E., Woods, R. A., Vrugt, J. A., Gupta, H. V., Wagener, T., & Hay, L. E. (2008) · Water Resources Research · doi:10.1029/2007wr006735 · Cited by 638
Self-citationImproving the representation of hydrologic processes in Earth System Models
Clark, M. P., Fan, Y., Lawrence, D. M., Adam, J. C., Bolster, D., Gochis, D. J., Hooper, R. P., Kumar, M., Leung, L. R., Mackay, D. S., et al. (2015) · Water Resources Research · doi:10.1002/2015wr017096 · Cited by 636
Global‐scale regionalization of hydrologic model parameters
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Miralles, D. G., McVicar, T. R., Schellekens, J., & Bruijnzeel, L. A. (2016) · Water Resources Research · doi:10.1002/2015wr018247 · Cited by 511
Using the Climate Forecast System Reanalysis as weather input data for watershed models
Fuka, D. R., Walter, M. T., MacAlister, C., Degaetano, A. T., Steenhuis, T. S., & Easton, Z. M. (2014) · Hydrological Processes · doi:10.1002/hyp.10073 · Cited by 421
Large-sample hydrology: a need to balance depth with breadth
Gupta, H. V., Perrin, C., Blöschl, G., Montanari, A., Kumar, R., Clark, M., & Andréassian, V. (2014) · Hydrology and Earth System Sciences · doi:10.5194/hess-18-463-2014 · Cited by 358
Self-citationThe Abuse of Popular Performance Metrics in Hydrologic Modeling
Clark, M. P., Vogel, R. M., Lamontagne, J. R., Mizukami, N., Knoben, W. J. M., Tang, G., Gharari, S., Freer, J. E., Whitfield, P. H., Shook, K. R., et al. (2021) · Water Resources Research · doi:10.1029/2020wr029001 · Cited by 306
Global evaluation of runoff from 10 state-of-the-art hydrological models
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Dutra, E., Fink, G., Orth, R., & Schellekens, J. (2017) · Hydrology and Earth System Sciences · doi:10.5194/hess-21-2881-2017 · Cited by 289
Coupled modelling of glacier and streamflow response to future climate scenarios
Stahl, K., Moore, R. D., Shea, J. M., Hutchinson, D., & Cannon, A. J. (2008) · Water Resources Research · doi:10.1029/2007wr005956 · Cited by 280
Calibration of hydrological models using flow-duration curves
Westerberg, I. K., Guerrero, J.-L., Younger, P. M., Beven, K. J., Seibert, J., Halldin, S., Freer, J. E., & Xu, C.-Y. (2011) · Hydrology and Earth System Sciences · doi:10.5194/hess-15-2205-2011 · Cited by 254
Dembélé, M., Hrachowitz, M., Savenije, H. H. G., Mariéthoz, G., & Schaefli, B. (2020) · Water Resources Research · doi:10.1029/2019wr026085 · Cited by 253
Self-citationTechnical note: Pitfalls in using log-transformed flows within the KGE criterion
Santos, L., Thirel, G., & Perrin, C. (2018) · Hydrology and Earth System Sciences · doi:10.5194/hess-22-4583-2018 · Cited by 148
Metadata
- Authors
- Schaefli, B., & Gupta, H. V.
- Venue
- Hydrological Processes
- Publisher
- Wiley
- Published
- 2007-06-18
- Volume
- 21
- Issue
- 15
- Pages
- 2075-2080
- ISSN
- 0885-6087 (ISSN-L)
- 1099-1085
- OpenAlex
- W1994616231
- Cited by
- 663
- References
- 13
- FWCI
- 21.57
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.