The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
A process‐based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model
Open accessAbstract
Distributed hydrological models have the potential to provide improved streamflow forecasts along the entire channel network, while also simulating the spatial dynamics of evapotranspiration, soil moisture content, water quality, soil erosion, and land use change impacts. However, they are perceived as being difficult to parameterize and evaluate, thus translating into significant predictive uncertainty in the model results. Although a priori parameter estimates derived from observable watershed characteristics can help to minimize obstacles to model implementation, there exists a need for powerful automated parameter estimation strategies that incorporate diagnostic information regarding the causes of poor model performance. This paper investigates a diagnostic approach to model evaluation that exploits hydrological context and theory to aid in the detection and resolution of watershed model inadequacies, through consideration of three of the four major behavioral functions of any watershed system; overall water balance, vertical redistribution, and temporal redistribution (spatial redistribution was not addressed). Instead of using classical statistical measures (such as mean squared error), we use multiple hydrologically relevant “signature measures” to quantify the performance of the model at the watershed outlet in ways that correspond to the functions mentioned above and therefore help to guide model improvements in a meaningful way. We apply the approach to the Hydrology Laboratory Distributed Hydrologic Model (HL‐DHM) of the National Weather Service and show that diagnostic evaluation has the potential to provide a powerful and intuitive basis for deriving consistent estimates of the parameters of watershed models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
North American Regional Reanalysis
Mesinger, F., DiMego, G., Kalnay, E., Mitchell, K., Shafran, P. C., Ebisuzaki, W., Jović, D., Woollen, J., Rogers, E., Berbery, E. H., et al. (2006) · Bulletin of the American Meteorological Society · doi:10.1175/bams-87-3-343 · Cited by 3,378
Effective and efficient global optimization for conceptual rainfall‐runoff models
Duan, Q., Sorooshian, S., & Gupta, V. (1992) · Water Resources Research · doi:10.1029/91wr02985 · Cited by 3,310
Computer Models of Watershed Hydrology
Singh, V. P. (1995) · Medical Entomology and Zoology · Cited by 3,273
Beven, K., & Freer, J. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(01)00421-8 · Cited by 2,189
Smakhtin, V. U. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(00)00340-1 · Cited by 1,702
Marlatt, W. E., Budyko, M. I., & Miller, D. H. (1975) · Journal of Range Management · doi:10.2307/3897455 · Cited by 1,619
Changing ideas in hydrology — The case of physically-based models
Beven, K. (1989) · Journal of Hydrology · doi:10.1016/0022-1694(89)90101-7 · Cited by 1,601
Gupta, H. V., Sorooshian, S., & Yapo, P. O. (1998) · Water Resources Research · doi:10.1029/97wr03495 · Cited by 1,426
Self-citationMulti-objective global optimization for hydrologic models
Yapo, P. O., Gupta, H. V., & Sorooshian, S. (1998) · Journal of Hydrology · doi:10.1016/s0022-1694(97)00107-8 · Cited by 908
Self-citationParameterisation, calibration and validation of distributed hydrological models
Refsgaard, J. C. (1997) · Journal of Hydrology · doi:10.1016/s0022-1694(96)03329-x · Cited by 863
Research works printed but not linked: 27
- 10.1016/j.jhydrol.2005.07.020 · doi:10.1016/j.jhydrol.2005.07.020
- 10.1029/2002WR001487 · doi:10.1029/2002wr001487
- Atkinson S., 2003, Dominant physical controls of hourly streamflow predictions and an examination of the role of spatial variability: Mahurangi catchment, New Zealand, Adv. Water Resour., 26, 219, 10.1016/S0309-1708(02)00183-5 · doi:10.1016/s0309-1708(02)00183-5
- 10.1061/(ASCE)1084-0699(2006)11:5(451) · doi:10.1061/(asce)1084-0699(2006)11:5(451
- 10.1111/j.1752-1688.1997.tb04077.x · doi:10.1111/j.1752-1688.1997.tb04077.x
- 10.1007/978-94-009-4678-1_2 · doi:10.1007/978-94-009-4678-1_2
- 10.1016/j.jhydrol.2004.03.032 · doi:10.1016/j.jhydrol.2004.03.032
- 10.1029/WS003p0077 · doi:10.1029/ws003p0077
- 10.1029/2006WR005563 · doi:10.1029/2006wr005563
- 10.1029/WR006i003p00862 · doi:10.1029/wr006i003p00862
- 10.2166/nh.1991.0002 · doi:10.2166/nh.1991.0002
- 10.1016/S0022-1694(01)00496-6 · doi:10.1016/s0022-1694(01)00496-6
- Koren V. M.Smith D.Wang andZ.Zhang(2000) Use of soil property data in the derivation of conceptual rainfall‐runoff model parameters Preprints in15th Conference on Hydrology pp.103–106 AMS Long Beach CA 10 – 14 January.
- 10.1029/WS006p0239 · doi:10.1029/ws006p0239
- 10.1016/j.jhydrol.2003.12.039 · doi:10.1016/j.jhydrol.2003.12.039
- Leavesley G. H., 2003, Calibration of Watershed Models, WaterScience, and Application
- 10.1016/j.jhydrol.2004.03.031 · doi:10.1016/j.jhydrol.2004.03.031
- Refsgaard J. C., 1995, Computer Models of Watershed Hydrology, 809
- Simas M. J.(1996) Lag time characteristics for small watersheds in the US Ph.D. dissertation 170 pp. School of Renewable Natural Resources University of Arizona Tuscon AZ.
- Smith R. E., 1995, Computer Models of Watershed Hydrology, 697
- 10.1029/WS006p0133 · doi:10.1029/ws006p0133
- 10.1029/WS006p0153 · doi:10.1029/ws006p0153
- 10.1016/S0022-1694(02)00308-6 · doi:10.1016/s0022-1694(02)00308-6
- Woolhiser D. A. R. E.Smith andD. C.Goodrich(1990) KINEROS: A kinematic runoff and erosion model USDA.Agric. Res. Serv. ARS‐77 pp. 130.
- 10.1061/(ASCE)1084-0699(2004)9:5(440) · doi:10.1061/(asce)1084-0699(2004)9:5(440
- Yilmaz K. K.(2007) Towards improved modeling for hydrologic predictions in poorly gauged basins Ph.D. dissertation 263 pp. Department of Hydrology and Water Resources University of Arizona Tuscon AZ.
- 10.1002/(SICI)1099-1085(19971015)11:12<1671::AID-HYP497>3.0.CO;2-G · doi:10.1002/(sici)1099-1085(19971015)11:12<1671::aid-hyp497>3.0.co;2-g
Cited by
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
Self-citationRainfall–runoff modelling using Long Short-Term Memory (LSTM) networks
(2018) · doi:10.5194/hess-22-6005-2018 · Cited by 2,114
Sensitivity analysis of environmental models: A systematic review with practical workflow
Pianosi, F., Beven, K., Freer, J., Hall, J. W., Rougier, J., Stephenson, D. B., & Wagener, T. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.02.008 · Cited by 1,704
Self-citationCharacterising performance of environmental models
Bennett, N. D., Croke, B. F. W., Guariso, G., Guillaume, J. H. A., Hamilton, S. H., Jakeman, A. J., Marsili-Libelli, S., Newham, L. T. H., Norton, J. P., Perrin, C., et al. (2013) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2012.09.011 · Cited by 1,536
A decade of Predictions in Ungauged Basins (PUB)—a review
Hrachowitz, M., Savenije, H. H. G., Blöschl, G., McDonnell, J. J., Sivapalan, M., Pomeroy, J. W., Arheimer, B., Blume, T., Clark, M. P., Ehret, U., et al. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.803183 · Cited by 1,295
Self-citationKratzert, F., Klotz, D., Shalev, G., Klambauer, G., Hochreiter, S., & Nearing, G. (2019) · Hydrology and Earth System Sciences · doi:10.5194/hess-23-5089-2019 · Cited by 1,223
Hartmann, A., Goldscheider, N., Wagener, T., Lange, J., & Weiler, M. (2014) · Reviews of Geophysics · doi:10.1002/2013rg000443 · Cited by 1,068
Self-citationWhat Role Does Hydrological Science Play in the Age of Machine Learning?
Nearing, G. S., Kratzert, F., Sampson, A. K., Pelissier, C. S., Klotz, D., Frame, J. M., Prieto, C., & Gupta, H. V. (2021) · Water Resources Research · doi:10.1029/2020wr028091 · Cited by 894
Self-citationNewman, A. J., Clark, M. P., Sampson, K., Wood, A., Hay, L. E., Bock, A., Viger, R. J., Blodgett, D., Brekke, L., Arnold, J. R., et al. (2015) · Hydrology and Earth System Sciences · doi:10.5194/hess-19-209-2015 · Cited by 777
Clark, M. P., Slater, A. G., Rupp, D. E., Woods, R. A., Vrugt, J. A., Gupta, H. V., Wagener, T., & Hay, L. E. (2008) · Water Resources Research · doi:10.1029/2007wr006735 · Cited by 638
Self-citationImproving the representation of hydrologic processes in Earth System Models
Clark, M. P., Fan, Y., Lawrence, D. M., Adam, J. C., Bolster, D., Gochis, D. J., Hooper, R. P., Kumar, M., Leung, L. R., Mackay, D. S., et al. (2015) · Water Resources Research · doi:10.1002/2015wr017096 · Cited by 636
Feng, D., Fang, K., & Shen, C. (2020) · Water Resources Research · doi:10.1029/2019wr026793 · Cited by 633
Pursuing the method of multiple working hypotheses for hydrological modeling
Clark, M. P., Kavetski, D., & Fenicia, F. (2011) · Water Resources Research · doi:10.1029/2010wr009827 · Cited by 594
Deep learning rainfall–runoff predictions of extreme events
Frame, J. M., Kratzert, F., Klotz, D., Gauch, M., Shalev, G., Gilon, O., Qualls, L. M., Gupta, H. V., & Nearing, G. S. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-3377-2022 · Cited by 396
Self-citationClark, M. P., Bierkens, M. F. P., Samaniego, L., Woods, R. A., Uijlenhoet, R., Bennett, K. E., Pauwels, V. R. N., Cai, X., Wood, A. W., & Peters-Lidard, C. D. (2017) · Hydrology and Earth System Sciences · doi:10.5194/hess-21-3427-2017 · Cited by 384
Jiang, S., Zheng, Y., & Solomatine, D. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088229 · Cited by 365
Rainfall–runoff prediction at multiple timescales with a single Long Short-Term Memory network
Gauch, M., Kratzert, F., Klotz, D., Nearing, G., Lin, J., & Hochreiter, S. (2021) · Hydrology and Earth System Sciences · doi:10.5194/hess-25-2045-2021 · Cited by 363
A Ranking of Hydrological Signatures Based on Their Predictability in Space
Addor, N., Nearing, G., Prieto, C., Newman, A. J., Le Vine, N., & Clark, M. P. (2018) · Water Resources Research · doi:10.1029/2018wr022606 · Cited by 359
Large-sample hydrology: a need to balance depth with breadth
Gupta, H. V., Perrin, C., Blöschl, G., Montanari, A., Kumar, R., Clark, M., & Andréassian, V. (2014) · Hydrology and Earth System Sciences · doi:10.5194/hess-18-463-2014 · Cited by 358
Self-citationKumar, R., Samaniego, L., & Attinger, S. (2013) · Water Resources Research · doi:10.1029/2012wr012195 · Cited by 354
Review: Sources of Hydrological Model Uncertainties and Advances in Their Analysis
Moges, E., Demissie, Y., Larsen, L., & Yassin, F. (2020) · Water · doi:10.3390/w13010028 · Cited by 327
Are seemingly physically similar catchments truly hydrologically similar?
Oudin, L., Kay, A., Andréassian, V., & Perrin, C. (2010) · Water Resources Research · doi:10.1029/2009wr008887 · Cited by 308
Evaluating model performance: towards a non-parametric variant of the Kling-Gupta efficiency
Pool, S., Vis, M., & Seibert, J. (2018) · Hydrological Sciences Journal · doi:10.1080/02626667.2018.1552002 · Cited by 295
Global evaluation of runoff from 10 state-of-the-art hydrological models
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Dutra, E., Fink, G., Orth, R., & Schellekens, J. (2017) · Hydrology and Earth System Sciences · doi:10.5194/hess-21-2881-2017 · Cited by 289
Yucel, I., Onen, A., Yilmaz, K. K., & Gochis, D. J. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.01.042 · Cited by 288
Self-citationLees, T., Buechel, M., Anderson, B., Slater, L., Reece, S., Coxon, G., & Dadson, S. J. (2021) · Hydrology and Earth System Sciences · doi:10.5194/hess-25-5517-2021 · Cited by 278
A unified approach for process‐based hydrologic modeling: 2. Model implementation and case studies
Clark, M. P., Nijssen, B., Lundquist, J. D., Kavetski, D., Rupp, D. E., Woods, R. A., Freer, J. E., Gutmann, E. D., Wood, A. W., Gochis, D. J., et al. (2015) · Water Resources Research · doi:10.1002/2015wr017200 · Cited by 257
Uncertainty estimation with deep learning for rainfall–runoff modeling
Klotz, D., Kratzert, F., Gauch, M., Keefe Sampson, A., Brandstetter, J., Klambauer, G., Hochreiter, S., & Nearing, G. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-1673-2022 · Cited by 256
Calibration of hydrological models using flow-duration curves
Westerberg, I. K., Guerrero, J.-L., Younger, P. M., Beven, K. J., Seibert, J., Halldin, S., Freer, J. E., & Xu, C.-Y. (2011) · Hydrology and Earth System Sciences · doi:10.5194/hess-15-2205-2011 · Cited by 254
Kratzert, F., Klotz, D., Hochreiter, S., & Nearing, G. S. (2021) · Hydrology and Earth System Sciences · doi:10.5194/hess-25-2685-2021 · Cited by 213
Feng, D., Beck, H., Lawson, K., & Shen, C. (2023) · Hydrology and Earth System Sciences · doi:10.5194/hess-27-2357-2023 · Cited by 197
Feng, D., Lawson, K., & Shen, C. (2021) · Geophysical Research Letters · doi:10.1029/2021gl092999 · Cited by 162
“Integrating FDCs significantly improved the low flow part of the hydrograph, as shown by the distribution of percent bias of the bottom 30% FLV in Figure 3a, but only slightly improved the percent bias of the top 2% FHV in Figure 3b.”
BackgroundInfluentialLi, P., Song, Y., Pan, M., Lawson, K., & Shen, C. (2025) · Hydrology and Earth System Sciences · doi:10.5194/hess-29-6829-2025 · Cited by 7
Metadata
- Authors
- Yilmaz, K. K., Gupta, H. V., & Wagener, T.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2008-09
- Volume
- 44
- Issue
- 9
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2169744906
- Cited by
- 681
- References
- 33
- FWCI
- 14.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.