The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation
Abstract
Correlation and correlation‐based measures (e.g., the coefficient of determination) have been widely used to evaluate the “goodness‐of‐fit” of hydrologic and hydroclimatic models. These measures are oversensitive to extreme values (outliers) and are insensitive to additive and proportional differences between model predictions and observations. Because of these limitations, correlation‐based measures can indicate that a model is a good predictor, even when it is not. In this paper, useful alternative goodness‐of‐fit or relative error measures (including the coefficient of efficiency and the index of agreement) that overcome many of the limitations of correlation‐based measures are discussed. Modifications to these statistics to aid in interpretation are presented. It is concluded that correlation and correlation‐based measures should not be used to assess the goodness‐of‐fit of a hydrologic or hydroclimatic model and that additional evaluation measures (such as summary statistics and absolute error measures) should supplement model evaluation tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674
An Approach toward a Rational Classification of Climate
Thornthwaite, C. W. (1948) · Geographical Review · doi:10.2307/210739 · Cited by 9,087
Willmott, C. J. (1981) · Physical Geography · doi:10.1080/02723646.1981.10642213 · Cited by 4,916
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Statistics for the evaluation and comparison of models
Willmott, C. J., Ackleson, S. G., Davis, R. E., Feddema, J. J., Klink, K. M., Legates, D. R., O'Donnell, J., & Rowe, C. M. (1985) · Journal of Geophysical Research: Oceans · doi:10.1029/jc090ic05p08995 · Cited by 2,026
Self-citationNonparametric estimates of standard error: The jackknife, the bootstrap and other methods
EFRON, B. (1981) · Biometrika · doi:10.1093/biomet/68.3.589 · Cited by 1,399
Estimating Evapotranspiration from Solar Radiation
Jensen, M. E., & Haise, H. R. (1963) · Journal of the Irrigation and Drainage Division · doi:10.1061/jrcea4.0000287 · Cited by 943
Nonparametric standard errors and confidence intervals
Efron, B. (1981) · Canadian Journal of Statistics · doi:10.2307/3314608 · Cited by 679
Precipitation-runoff modeling system; user's manual
(1983) · doi:10.3133/wri834238 · Cited by 632
Elementary statistics for geographers
Burt, J. E., Barber, G. M., & Rigby, D. L. (1995) · Medical Entomology and Zoology · Cited by 560
On the Evaluation of Model Performance in Physical Geography
Willmott, C. J. (1984) · Spatial Statistics and Models · doi:10.1007/978-94-017-3048-8_23 · Cited by 494
A search for human influences on the thermal structure of the atmosphere
Santer, B. D., Taylor, K. E., Wigley, T. M. L., Johns, T. C., Jones, P. D., Karoly, D. J., Mitchell, J. F. B., Oort, A. H., Penner, J. E., Ramaswamy, V., et al. (1996) · Nature · doi:10.1038/382039a0 · Cited by 450
Detecting Greenhouse-Gas-Induced Climate Change with an Optimal Fingerprint Method
Hegerl, G. C., von Storch, H., Hasselmann, K., Santer, B. D., Cubasch, U., & Jones, P. D. (1996) · Journal of Climate · doi:10.1175/1520-0442(1996)009<2281:dggicc>2.0.co;2 · Cited by 363
Potential evaporation: The combination concept and its experimental verification
Van Bavel, C. H. M. (1966) · Water Resources Research · doi:10.1029/wr002i003p00455 · Cited by 360
Climatologically aided interpolation (CAI) of terrestrial air temperature
Willmott, C. J., & Robeson, S. M. (1995) · International Journal of Climatology · doi:10.1002/joc.3370150207 · Cited by 355
Towards the detection and attribution of an anthropogenic effect on climate
Santer, B. D., Taylor, K. E., Wigley, T. M. L., Penner, J. E., Jones, P. D., & Cubasch, U. (1995) · Climate Dynamics · doi:10.1007/bf00223722 · Cited by 209
Statistics: Concepts and Controversies.
Wooff, D., & Moore, D. S. (1993) · The Statistician · doi:10.2307/2349000 · Cited by 173
A criterion of efficiency for rainfall-runoff models
Garrick, M., Cunnane, C., & Nash, J. E. (1978) · Journal of Hydrology · doi:10.1016/0022-1694(78)90155-5 · Cited by 157
A proposed index for comparing hydrographs
McCuen, R. H., & Snyder, W. M. (1975) · Water Resources Research · doi:10.1029/wr011i006p01021 · Cited by 80
Cited by
Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations
Moriasi, D. N., Arnold, J. G., Liew, M. W. V., Bingner, R. L., Harmel, R. D., & Veith, T. L. (2007) · Transactions of the ASABE · doi:10.13031/2013.23153 · Cited by 13,446
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
SWAT: Model Use, Calibration, and Validation
Arnold, J. G., Moriasi, D. N., Gassman, P. W., Abbaspour, K. C., White, M. J., Srinivasan, R., Santhi, C., Harmel, R. D., van Griensven, A., Liew, M. W. V., et al. (2012) · Transactions of the ASABE · doi:10.13031/2013.42256 · Cited by 3,450
“, 1997); (2) multiple evaluation techniques (ASCE, 1993; Legates and McCabe, 1999; Boyle et al., 2000); (3) calibrating all constituents to be evaluated; and (4) verification that other important model outputs are reasonable.”
Daly, C., Halbleib, M., Smith, J. I., Gibson, W. P., Doggett, M. K., Taylor, G. H., Curtis, J., & Pasteris, P. P. (2008) · International Journal of Climatology · doi:10.1002/joc.1688 · Cited by 3,100
Comparison of different efficiency criteria for hydrological model assessment
Krause, P., Boyle, D. P., & Bäse, F. (2005) · Advances in Geosciences · doi:10.5194/adgeo-5-89-2005 · Cited by 2,809
Metadata
- Authors
- Legates, D. R., & McCabe, G. J.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 1999-01
- Volume
- 35
- Issue
- 1
- Pages
- 233-241
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2037460094
- Cited by
- 4,591
- References
- 19
- FWCI
- 34.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.