The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Differentiable, Learnable, Regionalized Process‐Based Models With Multiphysical Outputs can Approach State‐Of‐The‐Art Hydrologic Prediction Accuracy
Open accessAbstract
Predictions of hydrologic variables across the entire water cycle have significant value for water resources management as well as downstream applications such as ecosystem and water quality modeling. Recently, purely data‐driven deep learning models like long short‐term memory (LSTM) showed seemingly insurmountable performance in modeling rainfall runoff and other geoscientific variables, yet they cannot predict untrained physical variables and remain challenging to interpret. Here, we show that differentiable, learnable, process‐based models (called δ models here) can approach the performance level of LSTM for the intensively observed variable (streamflow) with regionalized parameterization. We use a simple hydrologic model HBV as the backbone and use embedded neural networks, which can only be trained in a differentiable programming framework, to parameterize, enhance, or replace the process‐based model's modules. Without using an ensemble or post‐processor, δ models can obtain a median Nash‐Sutcliffe efficiency of 0.732 for 671 basins across the USA for the Daymet forcing data set, compared to 0.748 from a state‐of‐the‐art LSTM model with the same setup. For another forcing data set, the difference is even smaller: 0.715 versus 0.722. Meanwhile, the resulting learnable process‐based models can output a full set of untrained variables, for example, soil and groundwater storage, snowpack, evapotranspiration, and baseflow, and can later be constrained by their observations. Both simulated evapotranspiration and fraction of discharge from baseflow agreed decently with alternative estimates. The general framework can work with models with various process complexity and opens up the path for learning physics from big data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674
(2017) · Cited by 11,625
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
MONTEITH, J. (1965) · PubMed · Cited by 5,169
Improvements to a MODIS global terrestrial evapotranspiration algorithm
Mu, Q., Zhao, M., & Running, S. W. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.02.019 · Cited by 2,816
A manifesto for the equifinality thesis
Beven, K. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.07.007 · Cited by 2,581
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
Maurer, E. P., Wood, A. W., Adam, J. C., Lettenmaier, D. P., & Nijssen, B. (2002) · Journal of Climate · doi:10.1175/1520-0442(2002)015<3237:althbd>2.0.co;2 · Cited by 1,441
Xia, Y., Mitchell, K., Ek, M., Sheffield, J., Cosgrove, B., Wood, E., Luo, L., Alonge, C., Wei, H., Meng, J., et al. (2012) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2011jd016048 · Cited by 1,300
A decade of Predictions in Ungauged Basins (PUB)—a review
Hrachowitz, M., Savenije, H. H. G., Blöschl, G., McDonnell, J. J., Sivapalan, M., Pomeroy, J. W., Arheimer, B., Blume, T., Clark, M. P., Ehret, U., et al. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.803183 · Cited by 1,295
Kratzert, F., Klotz, D., Shalev, G., Klambauer, G., Hochreiter, S., & Nearing, G. (2019) · Hydrology and Earth System Sciences · doi:10.5194/hess-23-5089-2019 · Cited by 1,223
Shen, C. (2018) · Water Resources Research · doi:10.1029/2018wr022643 · Cited by 1,133
Self-citationToward Improved Predictions in Ungauged Basins: Exploiting the Power of Machine Learning
Kratzert, F., Klotz, D., Herrnegger, M., Sampson, A. K., Hochreiter, S., & Nearing, G. S. (2019) · Water Resources Research · doi:10.1029/2019wr026065 · Cited by 990
What Role Does Hydrological Science Play in the Age of Machine Learning?
Nearing, G. S., Kratzert, F., Sampson, A. K., Pelissier, C. S., Klotz, D., Frame, J. M., Prieto, C., & Gupta, H. V. (2021) · Water Resources Research · doi:10.1029/2020wr028091 · Cited by 894
Automatic differentiation in machine learning: a survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2019.25 · Cited by 823
Development and application of a conceptual runoff model for Scandinavian catchments
Bergström, S. (1976) · Cited by 794
Newman, A. J., Clark, M. P., Sampson, K., Wood, A., Hay, L. E., Bock, A., Viger, R. J., Blodgett, D., Brekke, L., Arnold, J. R., et al. (2015) · Hydrology and Earth System Sciences · doi:10.5194/hess-19-209-2015 · Cited by 777
A Rainfall‐Runoff Model With LSTM‐Based Sequence‐to‐Sequence Learning
Xiang, Z., Yan, J., & Demir, I. (2020) · Water Resources Research · doi:10.1029/2019wr025326 · Cited by 768
Universal Differential Equations for Scientific Machine Learning
Rackauckas, C., Ma, Y., Martensen, J., Warner, C., Zubov, K., Supekar, R., Skinner, D., Ramadhan, A., & Edelman, A. (2020) · doi:10.21203/rs.3.rs-55125/v1 · Cited by 643
Feng, D., Fang, K., & Shen, C. (2020) · Water Resources Research · doi:10.1029/2019wr026793 · Cited by 633
Self-citationTeaching hydrological modeling with a user-friendly catchment-runoff-model software package
(2012) · doi:10.5194/hess-16-3315-2012 · Cited by 616
Defining and Using Reference Evapotranspiration
Hargreaves, G. H. (1994) · Journal of Irrigation and Drainage Engineering · doi:10.1061/(asce)0733-9437(1994)120:6(1132 · Cited by 601
Dominant flood generating mechanisms across the United States
Berghuijs, W. R., Woods, R. A., Hutton, C. J., & Sivapalan, M. (2016) · Geophysical Research Letters · doi:10.1002/2016gl068070 · Cited by 487
One decade of multi-objective calibration approaches in hydrological modelling: a review
Efstratiadis, A., & Koutsoyiannis, D. (2010) · Hydrological Sciences Journal · doi:10.1080/02626660903526292 · Cited by 479
Adjustment of global gridded precipitation for systematic bias
Adam, J. C., & Lettenmaier, D. P. (2003) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2002jd002499 · Cited by 458
Ines, A. V. M., Das, N. N., Hansen, J. W., & Njoku, E. G. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.07.018 · Cited by 442
Velpuri, N. M., Senay, G. B., Singh, R. K., Bohms, S., & Verdin, J. P. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.07.013 · Cited by 425
Hagemann, S., Chen, C., Clark, D. B., Folwell, S., Gosling, S. N., Haddeland, I., Hanasaki, N., Heinke, J., Ludwig, F., Voss, F., et al. (2013) · Earth System Dynamics · doi:10.5194/esd-4-129-2013 · Cited by 391
Jiang, S., Zheng, Y., & Solomatine, D. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088229 · Cited by 365
Kumar, R., Samaniego, L., & Attinger, S. (2013) · Water Resources Research · doi:10.1029/2012wr012195 · Cited by 354
Wunsch, A., Liesch, T., & Broda, S. (2021) · Hydrology and Earth System Sciences · doi:10.5194/hess-25-1671-2021 · Cited by 353
Guo, Y., Zhang, Y., Zhang, L., & Wang, Z. (2021) · WIREs Water · doi:10.1002/wat2.1487 · Cited by 336
Zhi, W., Feng, D., Tsai, W.-P., Sterle, G., Harpold, A., Shen, C., & Li, L. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.0c06783 · Cited by 329
Self-citationPhysics‐Constrained Machine Learning of Evapotranspiration
Zhao, W. L., Gentine, P., Reichstein, M., Zhang, Y., Zhou, S., Wen, Y., Lin, C., Li, X., & Qiu, G. Y. (2019) · Geophysical Research Letters · doi:10.1029/2019gl085291 · Cited by 315
Tsai, W.-P., Feng, D., Pan, M., Beck, H., Lawson, K., Yang, Y., Liu, J., & Shen, C. (2021) · Nature Communications · doi:10.1038/s41467-021-26107-z · Cited by 315
Self-citationFang, K., Shen, C., Kifer, D., & Yang, X. (2017) · Geophysical Research Letters · doi:10.1002/2017gl075619 · Cited by 297
Self-citationDembélé, M., Hrachowitz, M., Savenije, H. H. G., Mariéthoz, G., & Schaefli, B. (2020) · Water Resources Research · doi:10.1029/2019wr026085 · Cited by 253
Frame, J. M., Kratzert, F., Raney, A., Rahman, M., Salas, F. R., & Nearing, G. S. (2021) · JAWRA Journal of the American Water Resources Association · doi:10.1111/1752-1688.12964 · Cited by 248
Daymet: Daily Surface Weather Data on a 1-km Grid for North America, Version 4
Thornton, M., Shrestha, R., Wei, Y., THORNTON, P. E., & Kao, S. (2020) · Oak Ridge National Laboratory Distributed Active Archive Center for Biogeochemical Dynamics · doi:10.3334/ornldaac/1840 · Cited by 245
Towards seamless large‐domain parameter estimation for hydrologic models
Mizukami, N., Clark, M. P., Newman, A. J., Wood, A. W., Gutmann, E. D., Nijssen, B., Rakovec, O., & Samaniego, L. (2017) · Water Resources Research · doi:10.1002/2017wr020401 · Cited by 244
Konapala, G., Kao, S.-C., Painter, S. L., & Lu, D. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/aba927 · Cited by 236
Hydrological concept formation inside long short-term memory (LSTM) networks
Lees, T., Reece, S., Kratzert, F., Klotz, D., Gauch, M., De Bruijn, J., Kumar Sahu, R., Greve, P., Slater, L., & Dadson, S. J. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-3079-2022 · Cited by 226
MOD16A2 MODIS/Terra Net Evapotranspiration 8-Day L4 Global 500m SIN Grid V006
Running, S., Mu, Q., & Zhao, M. (2017) · NASA Land Processes Distributed Active Archive Center · doi:10.5067/modis/mod16a2.006 · Cited by 219
Kratzert, F., Klotz, D., Hochreiter, S., & Nearing, G. S. (2021) · Hydrology and Earth System Sciences · doi:10.5194/hess-25-2685-2021 · Cited by 213
The dynamic role of root-water uptake in coupling potential to actual transpiration
Lai, C.-T., & Katul, G. (2000) · Advances in Water Resources · doi:10.1016/s0309-1708(99)00023-8 · Cited by 207
The Data Synergy Effects of Time‐Series Deep Learning Models in Hydrology
Fang, K., Kifer, D., Lawson, K., Feng, D., & Shen, C. (2022) · Water Resources Research · doi:10.1029/2021wr029583 · Cited by 190
Self-citationThe Value of SMAP for Long-Term Soil Moisture Estimation With the Help of Deep Learning
Fang, K., Pan, M., & Shen, C. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2872131 · Cited by 186
Self-citationFang, K., & Shen, C. (2020) · Journal of Hydrometeorology · doi:10.1175/jhm-d-19-0169.1 · Cited by 182
Self-citationExplore Spatio‐Temporal Learning of Large Sample Hydrology Using Graph Neural Networks
Sun, A. Y., Jiang, P., Mudunuru, M. K., & Chen, X. (2021) · Water Resources Research · doi:10.1029/2021wr030394 · Cited by 182
A Standard Approach to Baseflow Separation Using The Lyne and Hollick Filter
Ladson, A. R., Brown, R., Neal, B., & Nathan, R. (2013) · Australasian Journal of Water Resources · doi:10.7158/13241583.2013.11465417 · Cited by 177
Conceptual Framework for the National Flood Interoperability Experiment
Maidment, D. R. (2017) · JAWRA Journal of the American Water Resources Association · doi:10.1111/1752-1688.12474 · Cited by 175
Feng, D., Lawson, K., & Shen, C. (2021) · Geophysical Research Letters · doi:10.1029/2021gl092999 · Cited by 162 · cited 2×
“LSTM is also not immune to performance degradation when applied to ungauged basins, but it has been shown to score higher than locally-calibrated hydrologic models even when tested out of sample (Feng et al., 2021; Kratzert, Klotz, Herrnegger, et al., 2019).”
BackgroundSelf-citationRosero, E., Yang, Z., Wagener, T., Gulden, L. E., Yatheendradas, S., & Niu, G. (2010) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2009jd012035 · Cited by 162
Rahmani, F., Lawson, K., Ouyang, W., Appling, A., Oliver, S. K., & Shen, C. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/abd501 · Cited by 148
Self-citationRientjes, T. H. M., Muthuwatta, L., Bos, M. G., Booij, M. J., & Bhatti, H. (2013) · Journal of Hydrology · doi:10.1016/j.jhydrol.2013.10.006 · Cited by 145
Solgi, R., Loáiciga, H. A., & Kram, M. (2021) · Journal of Hydrology · doi:10.1016/j.jhydrol.2021.126800 · Cited by 144
Shen, C., Niu, J., & Phanikumar, M. S. (2013) · Water Resources Research · doi:10.1002/wrcr.20189 · Cited by 143
Self-citationXiang, Z., & Demir, İ. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104761 · Cited by 143
A large-sample watershed-scale hydrometeorological dataset for the contiguous USA
Newman, A. (2013) · UCAR/NCAR · doi:10.5065/d6mw2f4d · Cited by 140
Editorial: Broadening the Use of Machine Learning in Hydrology
Shen, C., Chen, X., & Laloy, E. (2021) · Frontiers in Water · doi:10.3389/frwa.2021.681023 · Cited by 131
Self-citationApplication of a Conceptual Hydrologic Model in Teaching Hydrologic Processes
AghaKouchak, A., & Habib, E. (2010) · eScholarship (California Digital Library) · Cited by 122
Mackay, D. S., Roberts, D. E., Ewers, B. E., Sperry, J. S., McDowell, N. G., & Pockman, W. T. (2015) · Water Resources Research · doi:10.1002/2015wr017244 · Cited by 116
A Multiscale Deep Learning Model for Soil Moisture Integrating Satellite and In Situ Data
Liu, J., Rahmani, F., Lawson, K., & Shen, C. (2022) · Geophysical Research Letters · doi:10.1029/2021gl096847 · Cited by 114
Self-citationRakovec, O., Mizukami, N., Kumar, R., Newman, A. J., Thober, S., Wood, A. W., Clark, M., & Samaniego, L. (2019) · Journal of Geophysical Research Atmospheres · doi:10.1029/2019jd030767 · Cited by 112
Beck, H. E., Pan, M., Lin, P., Seibert, J., van Dijk, A. I. J. M., & Wood, E. F. (2020) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2019jd031485 · Cited by 109
Applications of Deep Learning in Hydrology
Shen, C., & Lawson, K. (2021) · Wiley eBooks · doi:10.1002/9781119646181.ch19 · Cited by 93
Self-citationBennett, A. R., & Nijssen, B. (2021) · Water Resources Research · doi:10.1029/2020wr029328 · Cited by 89
Rahmani, F., Shen, C., Oliver, S. K., Lawson, K., & Appling, A. (2021) · Hydrological Processes · doi:10.1002/hyp.14400 · Cited by 86
Self-citationCatchment attributes for large-sample studies
Addor, N., Newman, A. J., Mizukami, N., & Clark, M. P. (2017) · UCAR/NCAR · doi:10.5065/d6g73c3q · Cited by 70
Soil moisture from remote sensing to forecast desert locust presence
Piou, C., Gay, P., Benahi, A. S., Ebbe, M. A. O. B., Chihrane, J., Ghaout, S., Cissé, S., Diakité, F., Lazar, M., Cressman, K., et al. (2018) · Journal of Applied Ecology · doi:10.1111/1365-2664.13323 · Cited by 68
Niu, J., Shen, C., Li, S., & Phanikumar, M. S. (2014) · Water Resources Research · doi:10.1002/2014wr015589 · Cited by 67
Self-citationSahu, R. K., Müller, J., Park, J., Varadharajan, C., Arora, B., Faybishenko, B. A., & Agarwal, D. (2020) · Frontiers in Water · doi:10.3389/frwa.2020.573034 · Cited by 56
Deep Learning: A Next-Generation Big-Data Approach for Hydrology
Shen, C. (2018) · Eos · doi:10.1029/2018eo095649 · Cited by 29
Self-citationCAMELS Extended Maurer Forcing Data
Kratzert, F. (2019) · HydroShare Resources · doi:10.4211/hs.17c896843cf940339c3c3496d0c1c077 · Cited by 17
CAMELS Extended NLDAS Forcing Data
Kratzert, F. (2019) · HydroShare Resources · doi:10.4211/hs.0a68bfd7ddf642a8be9041d60f40868c · Cited by 7
Research works printed but not linked: 10
- Bergström S., 1992, The HBV model—Its structure and applications (RH No. 4; SMHI Reports)
- 10.1371/journal.pone.0161363 · doi:10.1371/journal.pone.0161363
- 10.1002/2016WR020283 · doi:10.1002/2016wr020283
- Hoedt P.‐J. Kratzert F. Klotz D. Halmich C. Holzleitner M. Nearing G. et al. (2021).MC‐LSTM: Mass‐conserving LSTM.ArXiv:2101.05186 [Cs Stat]. Retrieved fromhttp://arxiv.org/abs/2101.05186
- 10.1175/JHM-402.1 · doi:10.1175/jhm-402.1
- IPCC, 2021, Climate change 2021: The physical science basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change
- 10.5194/nhess-19-2405-2019 · DOI · Paper page
- 10.5194/hess-2020-221 · DOI
- 10.5194/hess-2021-566 · doi:10.5194/hess-2021-566
- 10.1002/hyp.11084 · DOI
Cited by
Differentiable modelling to unify machine learning and physical models for geosciences
Shen, C., Appling, A. P., Gentine, P., Bandai, T., Gupta, H., Tartakovsky, A., Baity-Jesi, M., Fenicia, F., Kifer, D., Li, L., et al. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00450-9 · Cited by 468
Self-citationHybrid forecasting: blending climate predictions with AI models
Slater, L. J., Arnal, L., Boucher, M.-A., Chang, A. Y.-Y., Moulds, S., Murphy, C., Nearing, G., Shalev, G., Shen, C., Speight, L., et al. (2023) · Hydrology and Earth System Sciences · doi:10.5194/hess-27-1865-2023 · Cited by 281
“Differentiable modelling can also provide diverse physical variable outputs, trained or untrained, which help develop a narrative (Feng et al., 2022b) Fleming et al. (2021) showed how hydroclimatic storylines can be produced for clients to make the forecast interpretable in terms of under-standable…”
BackgroundSelf-citationFeng, D., Beck, H., Lawson, K., & Shen, C. (2023) · Hydrology and Earth System Sciences · doi:10.5194/hess-27-2357-2023 · Cited by 197
Self-citationHuynh, N. N. T., Garambois, P.-A., Renard, B., Colleoni, F., Monnier, J., & Roux, H. (2025) · Hydrology and Earth System Sciences · doi:10.5194/hess-29-3589-2025 · Cited by 38
Li, P., Song, Y., Pan, M., Lawson, K., & Shen, C. (2025) · Hydrology and Earth System Sciences · doi:10.5194/hess-29-6829-2025 · Cited by 7
Self-citation
Metadata
- Authors
- Feng, D., Liu, J., Lawson, K., & Shen, C.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2022-10
- Volume
- 58
- Issue
- 10
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W4296344227
- Cited by
- 323
- References
- 77
- FWCI
- 17.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- Funders
- National Science Foundation (EAR #1832294, OAC #1940190, PHY #2018280, EAR #2221880)
- U.S. Department of Energy (DE‐SC0016605)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.