The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
A process‐based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model
Open accessAbstract
Distributed hydrological models have the potential to provide improved streamflow forecasts along the entire channel network, while also simulating the spatial dynamics of evapotranspiration, soil moisture content, water quality, soil erosion, and land use change impacts. However, they are perceived as being difficult to parameterize and evaluate, thus translating into significant predictive uncertainty in the model results. Although a priori parameter estimates derived from observable watershed characteristics can help to minimize obstacles to model implementation, there exists a need for powerful automated parameter estimation strategies that incorporate diagnostic information regarding the causes of poor model performance. This paper investigates a diagnostic approach to model evaluation that exploits hydrological context and theory to aid in the detection and resolution of watershed model inadequacies, through consideration of three of the four major behavioral functions of any watershed system; overall water balance, vertical redistribution, and temporal redistribution (spatial redistribution was not addressed). Instead of using classical statistical measures (such as mean squared error), we use multiple hydrologically relevant “signature measures” to quantify the performance of the model at the watershed outlet in ways that correspond to the functions mentioned above and therefore help to guide model improvements in a meaningful way. We apply the approach to the Hydrology Laboratory Distributed Hydrologic Model (HL‐DHM) of the National Weather Service and show that diagnostic evaluation has the potential to provide a powerful and intuitive basis for deriving consistent estimates of the parameters of watershed models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
North American Regional Reanalysis
Mesinger, F., DiMego, G., Kalnay, E., Mitchell, K., Shafran, P. C., Ebisuzaki, W., Jović, D., Woollen, J., Rogers, E., Berbery, E. H., et al. (2006) · Bulletin of the American Meteorological Society · doi:10.1175/bams-87-3-343 · Cited by 3,378
Effective and efficient global optimization for conceptual rainfall‐runoff models
Duan, Q., Sorooshian, S., & Gupta, V. (1992) · Water Resources Research · doi:10.1029/91wr02985 · Cited by 3,310
Computer Models of Watershed Hydrology
Singh, V. P. (1995) · Medical Entomology and Zoology · Cited by 3,273
Beven, K., & Freer, J. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(01)00421-8 · Cited by 2,189
Smakhtin, V. U. (2001) · Journal of Hydrology · doi:10.1016/s0022-1694(00)00340-1 · Cited by 1,702
Marlatt, W. E., Budyko, M. I., & Miller, D. H. (1975) · Journal of Range Management · doi:10.2307/3897455 · Cited by 1,619
Changing ideas in hydrology — The case of physically-based models
Beven, K. (1989) · Journal of Hydrology · doi:10.1016/0022-1694(89)90101-7 · Cited by 1,601
Gupta, H. V., Sorooshian, S., & Yapo, P. O. (1998) · Water Resources Research · doi:10.1029/97wr03495 · Cited by 1,426
Self-citationMulti-objective global optimization for hydrologic models
Yapo, P. O., Gupta, H. V., & Sorooshian, S. (1998) · Journal of Hydrology · doi:10.1016/s0022-1694(97)00107-8 · Cited by 908
Self-citationParameterisation, calibration and validation of distributed hydrological models
Refsgaard, J. C. (1997) · Journal of Hydrology · doi:10.1016/s0022-1694(96)03329-x · Cited by 863
Morton, F. I. (1983) · Journal of Hydrology · doi:10.1016/0022-1694(83)90177-4 · Cited by 815
Catchment Classification and Hydrologic Similarity
Wagener, T., Sivapalan, M., Troch, P., & Woods, R. (2007) · Geography Compass · doi:10.1111/j.1749-8198.2007.00039.x · Cited by 749
Self-citationBoyle, D. P., Gupta, H. V., & Sorooshian, S. (2000) · Water Resources Research · doi:10.1029/2000wr900207 · Cited by 696
Self-citationReconciling theory with observations: elements of a diagnostic approach to model evaluation
Gupta, H. V., Wagener, T., & Liu, Y. (2008) · Hydrological Processes · doi:10.1002/hyp.6989 · Cited by 644
Self-citationEffective and efficient algorithm for multiobjective optimization of hydrologic models
Vrugt, J. A., Gupta, H. V., Bastidas, L. A., Bouten, W., & Sorooshian, S. (2003) · Water Resources Research · doi:10.1029/2002wr001746 · Cited by 624
Self-citationA framework for development and application of hydrological models
Wagener, T., Boyle, D. P., Lees, M. J., Wheater, H. S., Gupta, H. V., & Sorooshian, S. (2001) · Hydrology and Earth System Sciences · doi:10.5194/hess-5-13-2001 · Cited by 560
Self-citationFlow‐Duration Curves. I: New Interpretation and Confidence Intervals
Vogel, R. M., & Fennessey, N. M. (1994) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)0733-9496(1994)120:4(485 · Cited by 539
Physically based hydrologic modeling: 2. Is the concept realistic?
Grayson, R. B., Moore, I. D., & McMahon, T. A. (1992) · Water Resources Research · doi:10.1029/92wr01259 · Cited by 499
Madsen, H. (2002) · Advances in Water Resources · doi:10.1016/s0309-1708(02)00092-1 · Cited by 462
Vörösmarty, C. J., Federer, C. A., & Schloss, A. L. (1998) · Journal of Hydrology · doi:10.1016/s0022-1694(98)00109-7 · Cited by 437
The distributed model intercomparison project (DMIP): motivation and experiment design
Smith, M. B., Seo, D.-J., Koren, V. I., Reed, S. M., Zhang, Z., Duan, Q., Moreda, F., & Cong, S. (2004) · Journal of Hydrology · doi:10.1016/j.jhydrol.2004.03.040 · Cited by 415
Conceptualization and scale in hydrology
Klemeš, V. (1983) · Journal of Hydrology · doi:10.1016/0022-1694(83)90208-1 · Cited by 398
Downward approach to hydrological prediction
Sivapalan, M., Blöschl, G., Zhang, L., & Vertessy, R. (2003) · Hydrological Processes · doi:10.1002/hyp.1425 · Cited by 393
Beven, K. (2002) · Hydrological Processes · doi:10.1002/hyp.343 · Cited by 358
The NWS River Forecast System - catchment modeling.
Burnash, R. J. C. (1995) · Cited by 350
Model identification for hydrological forecasting under uncertainty
Wagener, T., & Gupta, H. V. (2005) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-005-0006-5 · Cited by 339
Self-citationSpatial patterns in catchment hydrology: observations and modelling
(2002) · Choice Reviews Online · doi:10.5860/choice.39-3986 · Cited by 337
Yilmaz, K. K., Hogue, T. S., Hsu, K.-L., Sorooshian, S., Gupta, H. V., & Wagener, T. (2005) · Journal of Hydrometeorology · doi:10.1175/jhm431.1 · Cited by 259
Self-citationIvanov, V. Y., Vivoni, E. R., Bras, R. L., & Entekhabi, D. (2004) · Journal of Hydrology · doi:10.1016/j.jhydrol.2004.03.041 · Cited by 192
Gupta, V. K., & Sorooshian, S. (1983) · Water Resources Research · doi:10.1029/wr019i001p00269 · Cited by 140
Hanks, R. J., Klute, A., & Bresler, E. (1969) · Water Resources Research · doi:10.1029/wr005i005p01064 · Cited by 116
Multilevel calibration strategy for complex hydrologic simulation models
Brazil, L. E. (1988) · Cited by 68
Leavesley, G. H., Hay, L. E., Viger, R. J., & Markstrom, S. L. (2003) · Water science and application · doi:10.1029/ws006p0255 · Cited by 24
Research works printed but not linked: 27
- 10.1016/j.jhydrol.2005.07.020 · doi:10.1016/j.jhydrol.2005.07.020
- 10.1029/2002WR001487 · doi:10.1029/2002wr001487
- Atkinson S., 2003, Dominant physical controls of hourly streamflow predictions and an examination of the role of spatial variability: Mahurangi catchment, New Zealand, Adv. Water Resour., 26, 219, 10.1016/S0309-1708(02)00183-5 · doi:10.1016/s0309-1708(02)00183-5
- 10.1061/(ASCE)1084-0699(2006)11:5(451) · doi:10.1061/(asce)1084-0699(2006)11:5(451
- 10.1111/j.1752-1688.1997.tb04077.x · doi:10.1111/j.1752-1688.1997.tb04077.x
- 10.1007/978-94-009-4678-1_2 · doi:10.1007/978-94-009-4678-1_2
- 10.1016/j.jhydrol.2004.03.032 · doi:10.1016/j.jhydrol.2004.03.032
- 10.1029/WS003p0077 · doi:10.1029/ws003p0077
- 10.1029/2006WR005563 · doi:10.1029/2006wr005563
- 10.1029/WR006i003p00862 · doi:10.1029/wr006i003p00862
- 10.2166/nh.1991.0002 · doi:10.2166/nh.1991.0002
- 10.1016/S0022-1694(01)00496-6 · doi:10.1016/s0022-1694(01)00496-6
- Koren V. M.Smith D.Wang andZ.Zhang(2000) Use of soil property data in the derivation of conceptual rainfall‐runoff model parameters Preprints in15th Conference on Hydrology pp.103–106 AMS Long Beach CA 10 – 14 January.
- 10.1029/WS006p0239 · doi:10.1029/ws006p0239
- 10.1016/j.jhydrol.2003.12.039 · doi:10.1016/j.jhydrol.2003.12.039
- Leavesley G. H., 2003, Calibration of Watershed Models, WaterScience, and Application
- 10.1016/j.jhydrol.2004.03.031 · doi:10.1016/j.jhydrol.2004.03.031
- Refsgaard J. C., 1995, Computer Models of Watershed Hydrology, 809
- Simas M. J.(1996) Lag time characteristics for small watersheds in the US Ph.D. dissertation 170 pp. School of Renewable Natural Resources University of Arizona Tuscon AZ.
- Smith R. E., 1995, Computer Models of Watershed Hydrology, 697
- 10.1029/WS006p0133 · doi:10.1029/ws006p0133
- 10.1029/WS006p0153 · doi:10.1029/ws006p0153
- 10.1016/S0022-1694(02)00308-6 · doi:10.1016/s0022-1694(02)00308-6
- Woolhiser D. A. R. E.Smith andD. C.Goodrich(1990) KINEROS: A kinematic runoff and erosion model USDA.Agric. Res. Serv. ARS‐77 pp. 130.
- 10.1061/(ASCE)1084-0699(2004)9:5(440) · doi:10.1061/(asce)1084-0699(2004)9:5(440
- Yilmaz K. K.(2007) Towards improved modeling for hydrologic predictions in poorly gauged basins Ph.D. dissertation 263 pp. Department of Hydrology and Water Resources University of Arizona Tuscon AZ.
- 10.1002/(SICI)1099-1085(19971015)11:12<1671::AID-HYP497>3.0.CO;2-G · doi:10.1002/(sici)1099-1085(19971015)11:12<1671::aid-hyp497>3.0.co;2-g
Cited by
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
Self-citationRainfall–runoff modelling using Long Short-Term Memory (LSTM) networks
(2018) · doi:10.5194/hess-22-6005-2018 · Cited by 2,114
Sensitivity analysis of environmental models: A systematic review with practical workflow
Pianosi, F., Beven, K., Freer, J., Hall, J. W., Rougier, J., Stephenson, D. B., & Wagener, T. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.02.008 · Cited by 1,704
Self-citationCharacterising performance of environmental models
Bennett, N. D., Croke, B. F. W., Guariso, G., Guillaume, J. H. A., Hamilton, S. H., Jakeman, A. J., Marsili-Libelli, S., Newham, L. T. H., Norton, J. P., Perrin, C., et al. (2013) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2012.09.011 · Cited by 1,536
A decade of Predictions in Ungauged Basins (PUB)—a review
Hrachowitz, M., Savenije, H. H. G., Blöschl, G., McDonnell, J. J., Sivapalan, M., Pomeroy, J. W., Arheimer, B., Blume, T., Clark, M. P., Ehret, U., et al. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.803183 · Cited by 1,295
Self-citation
Metadata
- Authors
- Yilmaz, K. K., Gupta, H. V., & Wagener, T.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2008-09
- Volume
- 44
- Issue
- 9
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2169744906
- Cited by
- 681
- References
- 33
- FWCI
- 14.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.