The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Toward Improved Predictions in Ungauged Basins: Exploiting the Power of Machine Learning
Open accessAbstract
Long short‐term memory (LSTM) networks offer unprecedented accuracy for prediction in ungauged basins. We trained and tested several LSTMs on 531 basins from the CAMELS data set using k‐fold validation, so that predictions were made in basins that supplied no training data. The training and test data set included ∼30 years of daily rainfall‐runoff data from catchments in the United States ranging in size from 4 to 2,000 km 2 with aridity index from 0.22 to 5.20, and including 12 of the 13 IGPB vegetated land cover classifications. This effectively “ungauged” model was benchmarked over a 15‐year validation period against the Sacramento Soil Moisture Accounting (SAC‐SMA) model and also against the NOAA National Water Model reanalysis. SAC‐SMA was calibrated separately for each basin using 15 years of daily data. The out‐of‐sample LSTM had higher median Nash‐Sutcliffe Efficiencies across the 531 basins (0.69) than either the calibrated SAC‐SMA (0.64) or the National Water Model (0.58). This indicates that there is (typically) sufficient information in available catchment attributes data about similarities and differences between catchment‐level rainfall‐runoff behaviors to provide out‐of‐sample simulations that are generally more accurate than current models under ideal (i.e., calibrated) conditions. We found evidence that adding physical constraints to the LSTM models might improve simulations, which we suggest motivates future research related to physics‐guided machine learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Self-citationMatplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
(2017) · Cited by 11,625
Data Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032
The NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 9,381
Stationarity Is Dead: Whither Water Management?
Milly, P. C. D., Betancourt, J., Falkenmark, M., Hirsch, R. M., Kundzewicz, Z. W., Lettenmaier, D. P., & Stouffer, R. J. (2008) · Science · doi:10.1126/science.1151915 · Cited by 4,537
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks
(2018) · doi:10.5194/hess-22-6005-2018 · Cited by 2,114
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., & Kumar, V. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720168 · Cited by 1,752
Shuffled complex evolution approach for effective and efficient global minimization
Duan, Q. Y., Gupta, V. K., & Sorooshian, S. (1993) · Journal of Optimization Theory and Applications · doi:10.1007/bf00939380 · Cited by 1,722
Artificial Neural Network Modeling of the Rainfall‐Runoff Process
Hsu, K., Gupta, H. V., & Sorooshian, S. (1995) · Water Resources Research · doi:10.1029/95wr01955 · Cited by 1,515
Kirchner, J. W. (2006) · Water Resources Research · doi:10.1029/2005wr004362 · Cited by 1,321
A decade of Predictions in Ungauged Basins (PUB)—a review
Hrachowitz, M., Savenije, H. H. G., Blöschl, G., McDonnell, J. J., Sivapalan, M., Pomeroy, J. W., Arheimer, B., Blume, T., Clark, M. P., Ehret, U., et al. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.803183 · Cited by 1,295
SIVAPALAN, M., TAKEUCHI, K., FRANKS, S. W., GUPTA, V. K., KARAMBIRI, H., LAKSHMI, V., LIANG, X., McDONNELL, J. J., MENDIONDO, E. M., O'CONNELL, P. E., et al. (2003) · Hydrological Sciences Journal · doi:10.1623/hysj.48.6.857.51421 · Cited by 1,284
(2019) · doi:10.5194/hess-23-5089-2019 · Cited by 1,223
DeepTox: toxicity prediction using deep learning
Mayr, A., Klambauer, G., Unterthiner, T., & Hochreiter, S. (2016) · Frontiers in Environmental Science · doi:10.3389/fenvs.2015.00080 · Cited by 1,081
Self-citationThe CAMELS data set: catchment attributes and meteorology for large-sample studies
(2017) · doi:10.5194/hess-21-5293-2017 · Cited by 1,037
Multiscale parameter regionalization of a grid‐based hydrologic model at the mesoscale
Samaniego, L., Kumar, R., & Attinger, S. (2010) · Water Resources Research · doi:10.1029/2008wr007327 · Cited by 836
Newman, A. J., Clark, M. P., Sampson, K., Wood, A., Hay, L. E., Bock, A., Viger, R. J., Blodgett, D., Brekke, L., Arnold, J. R., et al. (2015) · Hydrology and Earth System Sciences · doi:10.5194/hess-19-209-2015 · Cited by 777
Machine, platform, crowd: Harnessing our digital future
Peregrina, Á. F. A. (2018) · Economía industrial · Cited by 681
Prediction in ungauged basins: a grand challenge for theoretical hydrology
Sivapalan, M. (2003) · Hydrological Processes · doi:10.1002/hyp.5155 · Cited by 483
Xia, Y., Mitchell, K., Ek, M., Cosgrove, B., Sheffield, J., Luo, L., Alonge, C., Wei, H., Meng, J., Livneh, B., et al. (2012) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2011jd016051 · Cited by 463
Streamflow Prediction in Ungauged Basins: Review of Regionalization Methods
Razavi, T., & Coulibaly, P. (2013) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0000690 · Cited by 449
Dilettantism in hydrology: Transition or destiny?
Klemeš, V. (1986) · Water Resources Research · doi:10.1029/wr022i09sp0177s · Cited by 407
End-to-End Differentiable Learning of Protein Structure
AlQuraishi, M. (2019) · Cell Systems · doi:10.1016/j.cels.2019.03.006 · Cited by 371
A Ranking of Hydrological Signatures Based on Their Predictability in Space
Addor, N., Nearing, G., Prieto, C., Newman, A. J., Le Vine, N., & Clark, M. P. (2018) · Water Resources Research · doi:10.1029/2018wr022606 · Cited by 359
Self-citationBenchmarking of a Physically Based Hydrologic Model
Newman, A. J., Mizukami, N., Clark, M. P., Wood, A. W., Nijssen, B., & Nearing, G. (2017) · Journal of Hydrometeorology · doi:10.1175/jhm-d-16-0284.1 · Cited by 213
Self-citationLearning to predict the cosmological structure formation
He, S., Li, Y., Feng, Y., Ho, S., Ravanbakhsh, S., Chen, W., & Póczos, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821458116 · Cited by 213
Toward seamless hydrologic predictions across spatial scales
Samaniego, L., Kumar, R., Thober, S., Rakovec, O., Zink, M., Wanders, N., Eisner, S., Müller Schmied, H., Sutanudjaja, E. H., Warrach-Sagi, K., et al. (2017) · Hydrology and Earth System Sciences · doi:10.5194/hess-21-4323-2017 · Cited by 178
Towards Real‐Time Continental Scale Streamflow Simulation in Continuous and Discrete Space
Salas, F. R., Somos‐Valenzuela, M. A., Dugger, A. L., Maidment, D. R., Gochis, D., David, C. H., Yu, W., Ding, D., Clark, E. P., & Noman, N. S. (2017) · JAWRA Journal of the American Water Resources Association · doi:10.1111/1752-1688.12586 · Cited by 150
A large-sample watershed-scale hydrometeorological dataset for the contiguous USA
Newman, A. (2013) · UCAR/NCAR · doi:10.5065/d6mw2f4d · Cited by 140
Application of stochastic parameter optimization to the Sacramento Soil Moisture Accounting model
Vrugt, J. A., Gupta, H. V., Dekker, S. C., Sorooshian, S., Wagener, T., & Bouten, W. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.10.041 · Cited by 136
The quantity and quality of information in hydrologic models
Nearing, G., & Gupta, H. V. (2014) · Water Resources Research · doi:10.1002/2014wr015895 · Cited by 132
Self-citationPrieto, C., Vine, N. L., Kavetski, D., García, E., & Medina, R. (2019) · Water Resources Research · doi:10.1029/2018wr023254 · Cited by 123
Benchmarking NLDAS-2 Soil Moisture and Evapotranspiration to Separate Uncertainty Contributions
Nearing, G., Mocko, D. M., Peters‐Lidard, C. D., Kumar, S. V., & Xia, Y. (2016) · Journal of Hydrometeorology · doi:10.1175/jhm-d-15-0063.1 · Cited by 110
Self-citationBenchmarking and Process Diagnostics of Land Models
Nearing, G., Ruddell, B. L., Clark, M., Nijssen, B., & Peters‐Lidard, C. D. (2018) · Journal of Hydrometeorology · doi:10.1175/jhm-d-17-0209.1 · Cited by 96
Self-citationCatchment attributes for large-sample studies
Addor, N., Newman, A. J., Mizukami, N., & Clark, M. P. (2017) · UCAR/NCAR · doi:10.5065/d6g73c3q · Cited by 70
Predictions in ungauged basins – where do we stand?
Blöschl, G. (2016) · Proceedings of the International Association of Hydrological Sciences · doi:10.5194/piahs-373-57-2016 · Cited by 30
“Grand Challenges” in Big Data and the Earth Sciences
Sellars, S. L. (2018) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-17-0304.1 · Cited by 30
Research works printed but not linked: 7
- 10.1126/science.aac7358 · doi:10.1126/science.aac7358
- 10.1016/j.jhydrol.2006.09.018 · doi:10.1016/j.jhydrol.2006.09.018
- Kingma D. P. &Ba J.(2014).Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980. · arXiv
- Kratzert F., 2018, Proceedings of the 2018 AGU fall meeting
- Liu Y. Racah E. Correa J. Khosrowshahi A. Lavers D. Kunkel K. Wehner M. Collins W. et al. (2016).Application of deep convolutional neural networks for detecting extreme weather in climate datasets. arXiv preprint arXiv:1605.01156. · arXiv
- 10.5194/hess-17-1783-2013 · doi:10.5194/hess-17-1783-2013
- 10.5194/piahs-371-1-2015 · doi:10.5194/piahs-371-1-2015
Cited by
What Role Does Hydrological Science Play in the Age of Machine Learning?
Nearing, G. S., Kratzert, F., Sampson, A. K., Pelissier, C. S., Klotz, D., Frame, J. M., Prieto, C., & Gupta, H. V. (2021) · Water Resources Research · doi:10.1029/2020wr028091 · Cited by 894
Self-citationA comprehensive review of deep learning applications in hydrology and water resources
Sit, M., Demiray, B. Z., Xiang, Z., Ewing, G. J., Sermet, Y., & Demir, I. (2020) · Water Science and Technology · doi:10.2166/wst.2020.369 · Cited by 618
Challenges in modeling and predicting floods and droughts: A review
Brunner, M. I., Slater, L., Tallaksen, L. M., & Clark, M. (2021) · WIREs Water · doi:10.1002/wat2.1520 · Cited by 467
Bentivoglio, R., Isufi, E., Jonkman, S. N., & Taormina, R. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-4345-2022 · Cited by 453
Deep learning rainfall–runoff predictions of extreme events
Frame, J. M., Kratzert, F., Klotz, D., Gauch, M., Shalev, G., Gilon, O., Qualls, L. M., Gupta, H. V., & Nearing, G. S. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-3377-2022 · Cited by 396
Self-citation
Metadata
- Authors
- Kratzert, F., Klotz, D., Herrnegger, M., Sampson, A. K., Hochreiter, S., & Nearing, G. S.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2019-12
- Volume
- 55
- Issue
- 12
- Pages
- 11344-11354
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2989857225
- Cited by
- 990
- References
- 38
- FWCI
- 29.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Robert Bosch (Australia) Pty
- Austrian Science Fund
- Nvidia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.