The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Comprehensive Analysis of the NOAA National Water Model: A Call for Heterogeneous Formulations and Diagnostic Model Selection
Published version of a preprint
Abstract
With an increasing number of continental‐scale hydrologic models, the ability to evaluate performance is key to understanding uncertainty and making improvements to the model(s). We hypothesize that any model, running a single set of physics, cannot be “properly” calibrated for the range of hydroclimatic diversity as seen in the contenintal United States. Here, we evaluate the NOAA National Water Model (NWM) version 2.0 historical streamflow record in over 4,200 natural and controlled basins using the Nash‐Sutcliffe Efficiency metric decomposed into relative performance, and conditional, and unconditional bias. Each of these is evaluated in the contexts of meteorologic, landscape, and anthropogenic characteristics to better understand where the model does poorly, what potentially causes the poor performance, and what similarities systemically poor performing areas share. The primary objective is to pinpoint traits in places with good/bad performance and low/high bias. NWM relative performance is higher when there is high precipitation, snow coverage (depth and fraction), and barren area. Low relative skill is associated with high potential evapotranspiration, aridity, moisture‐and‐energy phase correlation, and forest, shrubland, grassland, and imperviousness area. We see less bias in locations with high precipitation, moisture‐and‐energy phase correlation, barren, and grassland areas and more bias in areas with high aridity, snow coverage/fraction, and urbanization. The insights gained can help identify key hydrological factors underpinning NWM predictive skill; enforce the need for regionalized parameterization and modeling; and help inform heterogenous modeling systems, like the NOAA Next Generation Water Resource Modeling Framework, to enhance ongoing development and evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While it has been shown that the NWM has less skill in predicting low flows as opposed to high flows (Fang et al., 2023;Johnson, Fang, et al., 2023), here we test if the addition of greater floods as predictors compensates for this.”
From Enhancing River Channel Dimension Estimation: A Machine Learning Approach Leveraging the National Water Model, Hydrographic Networks, and Landscape Characteristics (2024) · cites this paper as Johnson, Fang, et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-resolution mapping of global surface water and its long-term changes
Pekel, J.-F., Cottam, A., Gorelick, N., & Belward, A. S. (2016) · Nature · doi:10.1038/nature20584 · Cited by 5,513
(2015) · Photogrammetric Engineering & Remote Sensing · doi:10.1016/s0099-1112(15)30100-2 · Cited by 2,584
USGS Water Data for the Nation
Survey, U. S. G. (1994) · U.S. Geological Survey · doi:10.5066/f7p55kjn · Cited by 1,478
Research works printed but not linked: 76
- 10.1016/s0022-1694(96)03262-3 · DOI · Paper page
- 10.1029/95jd02416 · doi:10.1029/95jd02416
- 10.1016/B978-0-12-801884-2.00010-4 · DOI
- 10.3133/pp964 · DOI · Paper page
- 10.1002/2015wr017498 · DOI · Paper page
- 10.1002/2015wr017173 · DOI · Paper page
- 10.1111/1752-1688.12865 · DOI
- Burnash R., 1995, Computer models of watershed hydrology, 311
- 10.1002/2013jd020792 · DOI · Paper page
- 10.1002/2014JD022113 · doi:10.1002/2014jd022113
- 10.1023/b:clim.0000013684.13621.1f · DOI
- 10.1002/2015wr017096 · DOI · Paper page
- 10.4324/9780203771587 · DOI · Paper page
- 10.1029/2002jd003118 · DOI · Paper page
- 10.1002/hyp.7072 · DOI
- De Cicco L. A. Lorenz D. Hirsch R. M. Watkins W. &Johnson M.(2018).dataRetrieval: R packages for discovering and retrieving water data available from U.S. federal hydrologic web services (manual)[Software].U.S. Geological Survey.https://doi.org/10.5066/P9X4L3GE · doi:10.5066/p9x4l3ge
- Dewitz J., 2021, National Land Cover Database (NLCD) 2019 products [Land Cover L48]
- 10.5194/gmd-9-1937-2016 · DOI · Paper page
- Falcone J. A., 2011, GAGES‐II: Geospatial attributes of gages for evaluating streamflow
- 10.1029/2022wr032312 · DOI
- 10.1002/wat2.1487 · DOI · Paper page
- 10.5194/hess-18-463-2014 · DOI · Paper page
- 10.1111/1752-1688.12784 · DOI
- 10.1038/nclimate1911 · DOI · Paper page
- Jachens E. R., 2020, Effects of groundwater‐surface water exchange mechanism in the National Water Model over the northern high plains aquifer, USA
- 10.5194/hess-24-1081-2020 · DOI
- Johnson J. M. &Blodgett D. L.(2020).NOAA National Water Model reanalysis data at RENCI[Dataset].HydroShare. Retrieved fromhttp://www.hydroshare.org/resource/89b0952512dd4b378dc5be8d2093310f · doi:10.4211/hs.89b0952512dd4b378dc5be8d2093310f
- 10.1038/s41597-023-02316-7 · DOI
- 10.1080/15230406.2021.1892531 · doi:10.1080/15230406.2021.1892531
- 10.1111/1752-1688.12645 · DOI
- 10.5194/nhess-19-2405-2019 · DOI · Paper page
- 10.1002/aaai.12035 · DOI
- Kim D. H. D., 2023, Untangling the impacts of land cover representation and resampling in distributed hydrological model predictions, Environmental Modelling & Software, 105893
- 10.3390/rs14143284 · doi:10.3390/rs14143284
- 10.1029/2005wr004362 · DOI · Paper page
- Kitzmiller D. H., 2018, AGU fall meeting abstracts, H41H‐06
- 10.1002/2016wr019191 · DOI · Paper page
- 10.1029/2019wr026065 · DOI · Paper page
- 10.1029/2022wr033742 · DOI
- 10.1007/s00477-015-1158-6 · DOI
- 10.1111/1752-1688.12585 · DOI
- 10.1175/jcli-d-12-00508.1 · DOI · Paper page
- 10.1111/1752-1688.12474 · DOI · Paper page
- 10.1029/2000jd900828 · DOI · Paper page
- 10.1175/1520-0442(2002)015<3237:althbd>2.0.co;2 · DOI · Paper page
- 10.1002/2015JD023687 · doi:10.1002/2015jd023687
- 10.1061/(asce)1084-0699(2006)11:6(597) · doi:10.1061/(asce)1084-0699(2006)11:6(597 · Paper page
- 10.1029/2003jd003823 · DOI · Paper page
- 10.1175/jhm-d-11-0132.1 · DOI
- 10.13031/2013.23153 · DOI · Paper page
- 10.1175/1520-0493(1988)116<2417:ssbotm>2.0.co;2 · DOI · Paper page
- 10.1016/0022-1694(70)90255-6 · DOI · Paper page
- 10.5194/hess-19-209-2015 · DOI · Paper page
- 10.1175/1520-0442(2001)014<3307:ptdogr>2.0.co;2 · DOI · Paper page
- 10.1029/2010jd015139 · DOI · Paper page
- Nossent J., 2012, EGUGA, 237
- Ogden F. Avant B. Bartel R. Blodgett D. Clark E. Coon E. et al. (2021).The Next Generation Water Resources Modeling Framework: Open Source Standards Based Community Accessible Model Interoperability for Large Scale Water Prediction. InAGU Fall Meeting Abstracts(Vol.2021 pp. H43D‐01).
- 10.1016/j.cageo.2012.04.002 · doi:10.1016/j.cageo.2012.04.002
- 10.1016/j.jhydrol.2012.08.028 · doi:10.1016/j.jhydrol.2012.08.028
- 10.5194/hess-21-3701-2017 · DOI
- 10.1016/j.jhydrol.2012.12.004 · DOI · Paper page
- 10.1111/1752-1688.12820 · doi:10.1111/1752-1688.12820
- 10.1111/1752-1688.12586 · DOI
- 10.1029/2001wr000619 · doi:10.1029/2001wr000619
- 10.1175/ei-d-17-0011.1 · DOI
- Slack J. R., 1993, Hydro‐climatic data network (HCDN) streamflow data set, 1874‐1988
- 10.4300/JGME-D-12-00156.1 · DOI · Paper page
- 10.1029/2020wr028931 · DOI
- 10.5194/hess-27-1809-2023 · DOI
- 10.1175/jhm-d-21-0111.1 · DOI
- 10.1038/ngeo2646 · DOI · Paper page
- 10.3390/w12102897 · doi:10.3390/w12102897
- 10.1016/s0022-1694(98)00094-8 · DOI
- 10.1002/wat2.1345 · DOI
- 10.1029/2010wr010090 · DOI · Paper page
- 10.1016/j.isprsjprs.2018.09.006 · DOI · Paper page
Cited by
Modaresi Rad, A., Johnson, J. M., Ghahremani, Z., Coll, J., & Frazier, N. (2024) · Journal of Geophysical Research: Machine Learning and Computation · doi:10.1029/2024jh000173 · Cited by 11
Self-citation
Metadata
- Authors
- Johnson, J. M., Fang, S., Sankarasubramanian, A., Rad, A. M., Kindl da Cunha, L., Jennings, K. S., Clarke, K. C., Mazrooei, A., & Yeghiazarian, L.
- Affiliations
- Lynker Fort Collins CO USA
- North Carolina State University Raleigh NC USA
- NOAA/NWS Office of Water Prediction
- Department of Geography University of California, Santa Barbara Santa Barbara CA USA
- Research Applications Laboratory National Center for Atmospheric Research Boulder NC USA
- University of Cincinnati Cincinnati OH USA
- ORCID
- Venue
- Journal of Geophysical Research: Atmospheres
- Publisher
- American Geophysical Union (AGU)
- Published
- 2023-12-22
- Volume
- 128
- Issue
- 24
- ISSN
- 2169-897X
- 2169-8996
- Cited by
- 45
- References
- 3
- Language
- en
- Funders
- National Science Foundation (1937099, 2033607)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.