CoChat
Cited by 45

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Comprehensive Analysis of the NOAA National Water Model: A Call for Heterogeneous Formulations and Diagnostic Model Selection

Johnson, J. Michael, Fang, Shiqi, Sankarasubramanian, Arumugam, Rad, Arash Modaresi, Kindl da Cunha, Luciana, Jennings, Keith S., Clarke, Keith C., Mazrooei, Amir, Yeghiazarian, Lilit · 2023 · Journal of Geophysical Research: Atmospheres

Published version of a preprint

Abstract

With an increasing number of continental‐scale hydrologic models, the ability to evaluate performance is key to understanding uncertainty and making improvements to the model(s). We hypothesize that any model, running a single set of physics, cannot be “properly” calibrated for the range of hydroclimatic diversity as seen in the contenintal United States. Here, we evaluate the NOAA National Water Model (NWM) version 2.0 historical streamflow record in over 4,200 natural and controlled basins using the Nash‐Sutcliffe Efficiency metric decomposed into relative performance, and conditional, and unconditional bias. Each of these is evaluated in the contexts of meteorologic, landscape, and anthropogenic characteristics to better understand where the model does poorly, what potentially causes the poor performance, and what similarities systemically poor performing areas share. The primary objective is to pinpoint traits in places with good/bad performance and low/high bias. NWM relative performance is higher when there is high precipitation, snow coverage (depth and fraction), and barren area. Low relative skill is associated with high potential evapotranspiration, aridity, moisture‐and‐energy phase correlation, and forest, shrubland, grassland, and imperviousness area. We see less bias in locations with high precipitation, moisture‐and‐energy phase correlation, barren, and grassland areas and more bias in areas with high aridity, snow coverage/fraction, and urbanization. The insights gained can help identify key hydrological factors underpinning NWM predictive skill; enforce the need for regionalized parameterization and modeling; and help inform heterogenous modeling systems, like the NOAA Next Generation Water Resource Modeling Framework, to enhance ongoing development and evaluation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1029/2023jd038534

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 76

  1. 10.1016/s0022-1694(96)03262-3 · DOI · Paper page
  2. 10.1029/95jd02416 · doi:10.1029/95jd02416
  3. 10.1016/B978-0-12-801884-2.00010-4 · DOI
  4. 10.3133/pp964 · DOI · Paper page
  5. 10.1002/2015wr017498 · DOI · Paper page
  6. 10.1002/2015wr017173 · DOI · Paper page
  7. 10.1111/1752-1688.12865 · DOI
  8. Burnash R., 1995, Computer models of watershed hydrology, 311
  9. 10.1002/2013jd020792 · DOI · Paper page
  10. 10.1002/2014JD022113 · doi:10.1002/2014jd022113
  11. 10.1023/b:clim.0000013684.13621.1f · DOI
  12. 10.1002/2015wr017096 · DOI · Paper page
  13. 10.4324/9780203771587 · DOI · Paper page
  14. 10.1029/2002jd003118 · DOI · Paper page
  15. 10.1002/hyp.7072 · DOI
  16. De Cicco L. A. Lorenz D. Hirsch R. M. Watkins W. &Johnson M.(2018).dataRetrieval: R packages for discovering and retrieving water data available from U.S. federal hydrologic web services (manual)[Software].U.S. Geological Survey.https://doi.org/10.5066/P9X4L3GE · doi:10.5066/p9x4l3ge
  17. Dewitz J., 2021, National Land Cover Database (NLCD) 2019 products [Land Cover L48]
  18. 10.5194/gmd-9-1937-2016 · DOI · Paper page
  19. Falcone J. A., 2011, GAGES‐II: Geospatial attributes of gages for evaluating streamflow
  20. 10.1029/2022wr032312 · DOI
  21. 10.1002/wat2.1487 · DOI · Paper page
  22. 10.5194/hess-18-463-2014 · DOI · Paper page
  23. 10.1111/1752-1688.12784 · DOI
  24. 10.1038/nclimate1911 · DOI · Paper page
  25. Jachens E. R., 2020, Effects of groundwater‐surface water exchange mechanism in the National Water Model over the northern high plains aquifer, USA
  26. 10.5194/hess-24-1081-2020 · DOI
  27. Johnson J. M. &Blodgett D. L.(2020).NOAA National Water Model reanalysis data at RENCI[Dataset].HydroShare. Retrieved fromhttp://www.hydroshare.org/resource/89b0952512dd4b378dc5be8d2093310f · doi:10.4211/hs.89b0952512dd4b378dc5be8d2093310f
  28. 10.1038/s41597-023-02316-7 · DOI
  29. 10.1080/15230406.2021.1892531 · doi:10.1080/15230406.2021.1892531
  30. 10.1111/1752-1688.12645 · DOI
  31. 10.5194/nhess-19-2405-2019 · DOI · Paper page
  32. 10.1002/aaai.12035 · DOI
  33. Kim D. H. D., 2023, Untangling the impacts of land cover representation and resampling in distributed hydrological model predictions, Environmental Modelling & Software, 105893
  34. 10.3390/rs14143284 · doi:10.3390/rs14143284
  35. 10.1029/2005wr004362 · DOI · Paper page
  36. Kitzmiller D. H., 2018, AGU fall meeting abstracts, H41H‐06
  37. 10.1002/2016wr019191 · DOI · Paper page
  38. 10.1029/2019wr026065 · DOI · Paper page
  39. 10.1029/2022wr033742 · DOI
  40. 10.1007/s00477-015-1158-6 · DOI
  41. 10.1111/1752-1688.12585 · DOI
  42. 10.1175/jcli-d-12-00508.1 · DOI · Paper page
  43. 10.1111/1752-1688.12474 · DOI · Paper page
  44. 10.1029/2000jd900828 · DOI · Paper page
  45. 10.1175/1520-0442(2002)015<3237:althbd>2.0.co;2 · DOI · Paper page
  46. 10.1002/2015JD023687 · doi:10.1002/2015jd023687
  47. 10.1061/(asce)1084-0699(2006)11:6(597) · doi:10.1061/(asce)1084-0699(2006)11:6(597 · Paper page
  48. 10.1029/2003jd003823 · DOI · Paper page
  49. 10.1175/jhm-d-11-0132.1 · DOI
  50. 10.13031/2013.23153 · DOI · Paper page
  51. 10.1175/1520-0493(1988)116<2417:ssbotm>2.0.co;2 · DOI · Paper page
  52. 10.1016/0022-1694(70)90255-6 · DOI · Paper page
  53. 10.5194/hess-19-209-2015 · DOI · Paper page
  54. 10.1175/1520-0442(2001)014<3307:ptdogr>2.0.co;2 · DOI · Paper page
  55. 10.1029/2010jd015139 · DOI · Paper page
  56. Nossent J., 2012, EGUGA, 237
  57. Ogden F. Avant B. Bartel R. Blodgett D. Clark E. Coon E. et al. (2021).The Next Generation Water Resources Modeling Framework: Open Source Standards Based Community Accessible Model Interoperability for Large Scale Water Prediction. InAGU Fall Meeting Abstracts(Vol.2021 pp. H43D‐01).
  58. 10.1016/j.cageo.2012.04.002 · doi:10.1016/j.cageo.2012.04.002
  59. 10.1016/j.jhydrol.2012.08.028 · doi:10.1016/j.jhydrol.2012.08.028
  60. 10.5194/hess-21-3701-2017 · DOI
  61. 10.1016/j.jhydrol.2012.12.004 · DOI · Paper page
  62. 10.1111/1752-1688.12820 · doi:10.1111/1752-1688.12820
  63. 10.1111/1752-1688.12586 · DOI
  64. 10.1029/2001wr000619 · doi:10.1029/2001wr000619
  65. 10.1175/ei-d-17-0011.1 · DOI
  66. Slack J. R., 1993, Hydro‐climatic data network (HCDN) streamflow data set, 1874‐1988
  67. 10.4300/JGME-D-12-00156.1 · DOI · Paper page
  68. 10.1029/2020wr028931 · DOI
  69. 10.5194/hess-27-1809-2023 · DOI
  70. 10.1175/jhm-d-21-0111.1 · DOI
  71. 10.1038/ngeo2646 · DOI · Paper page
  72. 10.3390/w12102897 · doi:10.3390/w12102897
  73. 10.1016/s0022-1694(98)00094-8 · DOI
  74. 10.1002/wat2.1345 · DOI
  75. 10.1029/2010wr010090 · DOI · Paper page
  76. 10.1016/j.isprsjprs.2018.09.006 · DOI · Paper page

Cited by

See all 45

Metadata

Authors
Johnson, J. M., Fang, S., Sankarasubramanian, A., Rad, A. M., Kindl da Cunha, L., Jennings, K. S., Clarke, K. C., Mazrooei, A., & Yeghiazarian, L.
Affiliations
  • Lynker Fort Collins CO USA
  • North Carolina State University Raleigh NC USA
  • NOAA/NWS Office of Water Prediction
  • Department of Geography University of California, Santa Barbara Santa Barbara CA USA
  • Research Applications Laboratory National Center for Atmospheric Research Boulder NC USA
  • University of Cincinnati Cincinnati OH USA
Venue
Journal of Geophysical Research: Atmospheres
Published
2023-12-22
Volume
128
Issue
24
ISSN
  • 2169-897X
  • 2169-8996
Cited by
45
References
3
Language
en
Funders
National Science Foundation (1937099, 2033607)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comprehensive Analysis of the NOAA National Water Model: A Call for Heterogeneous Formulations and Diagnostic Model Selection. https://app.cochat.ai/papers/10.1029/2023jd038534
The paper
Johnson, J. M., Fang, S., Sankarasubramanian, A., Rad, A. M., Kindl da Cunha, L., Jennings, K. S., Clarke, K. C., Mazrooei, A., & Yeghiazarian, L. (2023). Comprehensive Analysis of the NOAA National Water Model: A Call for Heterogeneous Formulations and Diagnostic Model Selection. Journal of Geophysical Research: Atmospheres. https://doi.org/10.1029/2023jd038534

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.