The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Process‐Guided Deep Learning Predictions of Lake Water Temperature
Open accessAbstract
The rapid growth of data in water resources has created new opportunities to accelerate knowledge discovery with the use of advanced deep learning tools. Hybrid models that integrate theory with state‐of‐the art empirical techniques have the potential to improve predictions while remaining true to physical laws. This paper evaluates the Process‐Guided Deep Learning (PGDL) hybrid modeling framework with a use‐case of predicting depth‐specific lake water temperatures. The PGDL model has three primary components: a deep learning model with temporal awareness (long short‐term memory recurrence), theory‐based feedback (model penalties for violating conversation of energy), and model pretraining to initialize the network with synthetic data (water temperature predictions from a process‐based model). In situ water temperatures were used to train the PGDL model, a deep learning (DL) model, and a process‐based (PB) model. Model performance was evaluated in various conditions, including when training data were sparse and when predictions were made outside of the range in the training data set. The PGDL model performance (as measured by root‐mean‐square error (RMSE)) was superior to DL and PB for two detailed study lakes, but only when pretraining data included greater variability than the training period. The PGDL model also performed well when extended to 68 lakes, with a median RMSE of 1.65 °C during the test period (DL: 1.78 °C, PB: 2.03 °C; in a small number of lakes PB or DL models were more accurate). This case‐study demonstrates that integrating scientific knowledge into deep learning tools shows promise for improving predictions of many important environmental variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Paerl, H. W., & Huisman, J. (2008) · Science · doi:10.1126/science.1155398 · Cited by 2,854
(2015) · Photogrammetric Engineering & Remote Sensing · doi:10.1016/s0099-1112(15)30100-2 · Cited by 2,584
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,573
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523 · cited 1×
“…underlying the data, known laws or theory are ignored (such as conservation of energy) and this omission can lead to spurious and inaccurate predictions (e.g., Lazer et al., 2014; Nayak et al., 2013), particularly when predictions are made outside the range of data used to train the DL models.”
BackgroundLearning to forget: continual prediction with LSTM
Gers, F. A. (1999) · 9th International Conference on Artificial Neural Networks: ICANN '99 · doi:10.1049/cp:19991218 · Cited by 2,337
The rise of deep learning in drug discovery
Chen, H., Engkvist, O., Wang, Y., Olivecrona, M., & Blaschke, T. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.01.039 · Cited by 1,770
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., & Kumar, V. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720168 · Cited by 1,752
Self-citationFlood Prediction Using Machine Learning Models: Literature Review
Mosavi, A., Ozturk, P., & Chau, K.-W. (2018) · Water · doi:10.3390/w10111536 · Cited by 1,672
Rapid and highly variable warming of lake surface waters around the globe
O'Reilly, C. M., Sharma, S., Gray, D. K., Hampton, S. E., Read, J. S., Rowley, R. J., Schneider, P., Lenters, J. D., McIntyre, P. B., Kraemer, B. M., et al. (2015) · Geophysical Research Letters · doi:10.1002/2015gl066235 · Cited by 1,303
Self-citationXia, Y., Mitchell, K., Ek, M., Sheffield, J., Cosgrove, B., Wood, E., Luo, L., Alonge, C., Wei, H., Meng, J., et al. (2012) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2011jd016048 · Cited by 1,300
Mitchell, K. E., Lohmann, D., Houser, P. R., Wood, E. F., Schaake, J. C., Robock, A., Cosgrove, B. A., Sheffield, J., Duan, Q., Luo, L., et al. (2004) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2003jd003823 · Cited by 1,297
A decade of Predictions in Ungauged Basins (PUB)—a review
Hrachowitz, M., Savenije, H. H. G., Blöschl, G., McDonnell, J. J., Sivapalan, M., Pomeroy, J. W., Arheimer, B., Blume, T., Clark, M. P., Ehret, U., et al. (2013) · Hydrological Sciences Journal · doi:10.1080/02626667.2013.803183 · Cited by 1,295
Shen, C. (2018) · Water Resources Research · doi:10.1029/2018wr022643 · Cited by 1,133
BRETT, J. R. (1971) · American Zoologist · doi:10.1093/icb/11.1.99 · Cited by 1,111
Temperature as an Ecological Resource
MAGNUSON, J. J., CROWDER, L. B., & MEDVICK, P. A. (1979) · American Zoologist · doi:10.1093/icb/19.1.331 · Cited by 1,091
Some applications of statistics to meteorology
Panofsky, H. A., Brier, G. W., & Best, W. H. (1958) · University of Michigan Library Repository · Cited by 1,083
Generalization of backpropagation with application to a recurrent gas market model
Werbos, P. J. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90007-x · Cited by 944
Big data and the future of ecology
Hampton, S. E., Strasser, C. A., Tewksbury, J. J., Gram, W. K., Budden, A. E., Batcheller, A. L., Duke, C. S., & Porter, J. H. (2013) · Frontiers in Ecology and the Environment · doi:10.1890/120103 · Cited by 924
Maier, H. R., Jain, A., Dandy, G. C., & Sudheer, K. P. (2010) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2010.02.003 · Cited by 871
Machine Learning Methods Without Tears: A Primer for Ecologists
Olden, J. D., Lawler, J. J., & Poff, N. L. (2008) · The Quarterly Review of Biology · doi:10.1086/587826 · Cited by 823
The future of hydrology: An evolving science for a changing world
Wagener, T., Sivapalan, M., Troch, P. A., McGlynn, B. L., Harman, C. J., Gupta, H. V., Kumar, P., Rao, P. S. C., Basu, N. B., & Wilson, J. S. (2010) · Water Resources Research · doi:10.1029/2009wr008906 · Cited by 731
Fatichi, S., Vivoni, E. R., Ogden, F. L., Ivanov, V. Y., Mirus, B., Gochis, D., Downer, C. W., Camporese, M., Davison, J. H., Ebel, B., et al. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.03.026 · Cited by 671
Iterative near-term ecological forecasting: Needs, opportunities, and challenges
Dietze, M. C., Fox, A., Beck-Johnson, L. M., Betancourt, J. L., Hooten, M. B., Jarnevich, C. S., Keitt, T. H., Kenney, M. A., Laney, C. M., Larsen, L. G., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710231115 · Cited by 604
Kollet, S. J., & Maxwell, R. M. (2008) · Water Resources Research · doi:10.1029/2007wr006004 · Cited by 582
Flood Prediction Using Machine Learning Models: Literature Review
Mosavi, A. H., Öztürk, P., & Chau, K. (2018) · QUT ePrints (Queensland University of Technology) · Cited by 521
Could Machine Learning Break the Convection Parameterization Deadlock?
Gentine, P., Pritchard, M., Rasp, S., Reinaudi, G., & Yacalis, G. (2018) · Geophysical Research Letters · doi:10.1029/2018gl078202 · Cited by 497
The Ecological Detective: Confronting Models with Data (MPB-28)
Hilborn, R., & Mangel, M. (2013) · Princeton University Press eBooks · doi:10.1515/9781400847310 · Cited by 487
Challenges and design choices for global weather and climate models based on machine learning
Dueben, P. D., & Bauer, P. (2018) · Geoscientific Model Development · doi:10.5194/gmd-11-3999-2018 · Cited by 395
Evaluation of the current state of mechanistic aquatic biogeochemical modeling
Arhonditsis, G., & Brett, M. (2004) · Marine Ecology Progress Series · doi:10.3354/meps271013 · Cited by 372
A DYNAMIC RESERVOIR SIMULATION MODEL - DYRESM: 5
Imberger, J., & Patterson, J. C. (1981) · Elsevier eBooks · doi:10.1016/b978-0-12-258152-6.50014-2 · Cited by 346
HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community
Shen, C., Laloy, E., Elshorbagy, A., Albert, A., Bales, J., Chang, F.-J., Ganguly, S., Hsu, K.-L., Kifer, D., Fang, Z., et al. (2018) · Hydrology and Earth System Sciences · doi:10.5194/hess-22-5639-2018 · Cited by 335
Shortridge, J. E., Guikema, S. D., & Zaitchik, B. F. (2016) · Hydrology and Earth System Sciences · doi:10.5194/hess-20-2611-2016 · Cited by 321
Mainali, K. P., Warren, D. L., Dhileepan, K., McConnachie, A., Strathie, L., Hassan, G., Karki, D., Shrestha, B. B., & Parmesan, C. (2015) · Global Change Biology · doi:10.1111/gcb.13038 · Cited by 314
Scher, S. (2018) · Geophysical Research Letters · doi:10.1029/2018gl080704 · Cited by 302
Fang, K., Shen, C., Kifer, D., & Yang, X. (2017) · Geophysical Research Letters · doi:10.1002/2017gl075619 · Cited by 297
Lenters, J. D., Kratz, T. K., & Bowser, C. J. (2004) · Journal of Hydrology · doi:10.1016/j.jhydrol.2004.10.028 · Cited by 290
Label-Free Supervision of Neural Networks with Physics and Domain Knowledge
Stewart, R., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10934 · Cited by 274
Humphrey, G. B., Gibbs, M. S., Dandy, G. C., & Maier, H. R. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.06.026 · Cited by 273
Hipsey, M. R., Bruce, L. C., Boon, C., Busch, B., Carey, C. C., Hamilton, D. P., Hanson, P. C., Read, J. S., de Sousa, E., Weber, M., et al. (2019) · Geoscientific Model Development · doi:10.5194/gmd-12-473-2019 · Cited by 271
Self-citationTongal, H., & Booij, M. J. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2018.07.004 · Cited by 267
Salman, A., Jalal, A., Shafait, F., Mian, A., Shortis, M., Seager, J., & Harvey, E. (2016) · Limnology and Oceanography: Methods · doi:10.1002/lom3.10113 · Cited by 247
Rezaee, M., Mahdianpari, M., Zhang, Y., & Salehi, B. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2846178 · Cited by 245
Jia, X., Willard, J., Karpatne, A., Read, J., Zwart, J., Steinbach, M., & Kumar, V. (2019) · Proceedings of the 2019 SIAM International Conference on Data Mining · doi:10.1137/1.9781611975673.63 · Cited by 227
Self-citationWater quality data for national‐scale aquatic research: The Water Quality Portal
Read, E. K., Carr, L., De Cicco, L., Dugan, H. A., Hanson, P. C., Hart, J. A., Kreft, J., Read, J. S., & Winslow, L. A. (2017) · Water Resources Research · doi:10.1002/2016wr019993 · Cited by 223
Self-citationProjected shifts in fish species dominance in Wisconsin lakes under climate change
Hansen, G. J. A., Read, J. S., Hansen, J. F., & Winslow, L. A. (2017) · Global Change Biology · doi:10.1111/gcb.13462 · Cited by 212
Self-citationMazzocchi, F. (2015) · EMBO reports · doi:10.15252/embr.201541001 · Cited by 188
Soranno, P. A., Bacon, L. C., Beauchene, M. S., Bednar, K. E., Bissell, E. G., Boudreau, C. K., Boyer, M., Bremigan, M. T., Carpenter, S. R., Carr, J., et al. (2017) · GigaScience · doi:10.1093/gigascience/gix101 · Cited by 154
Self-citationSimulating 2368 temperate lakes reveals weak coherence in stratification phenology
Read, J. S., Winslow, L., Hansen, G. J. A., Hoek, J. V. D., Hanson, P. C., Bruce, L. C., & Markfort, C. D. (2014) · Ecological Modelling · doi:10.1016/j.ecolmodel.2014.07.029 · Cited by 148
Self-citationImproving the theoretical underpinnings of process‐based hydrologic models
Clark, M., Schaefli, B., Schymanski, S. J., Samaniego, L., Luce, C. H., Jackson, B., Freer, J. E., Arnold, J. R., Moore, R. D., İstanbulluoğlu, E., et al. (2016) · Water Resources Research · doi:10.1002/2015wr017910 · Cited by 141
Rainfall-runoff modeling using conceptual, data driven, and wavelet based computing approach
Nayak, P. C., Venkatesh, B., Krishna, B., & Jain, S. K. (2013) · Journal of Hydrology · doi:10.1016/j.jhydrol.2013.04.016 · Cited by 139
Wind sheltering of a lake by a tree canopy or bluff topography
Markfort, C. D., Perez, A. L. S., Thill, J. W., Jaster, D. A., Porté‐Agel, F., & Stefan, H. G. (2010) · Water Resources Research · doi:10.1029/2009wr007759 · Cited by 123
Improving predictions of hydrological low-flow indices in ungaged basins using machine learning
Worland, S. C., Farmer, W. H., & Kiang, J. E. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.12.021 · Cited by 123
Hipsey, M. R., Hamilton, D. P., Hanson, P. C., Carey, C. C., Coletti, J. Z., Read, J. S., Ibelings, B. W., Valesini, F. J., & Brookes, J. D. (2015) · Water Resources Research · doi:10.1002/2015wr017175 · Cited by 108
Self-citationMapping inland lake water quality across the Lower Peninsula of Michigan using Landsat TM imagery
Torbick, N., Hession, S. L., Hagen, S. C., Wiangwang, N., Becker, B. L., & Qi, J. (2013) · International Journal of Remote Sensing · doi:10.1080/01431161.2013.822602 · Cited by 104
SPIGAN: Privileged Adversarial Learning from SimulationPreprint
Lee, K.-H., Ros, G., Li, J., & Gaidon, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03756 · Cited by 91
Schaeffer, B. A., Iiames, J. S., Dwyer, J. L., Urquhart, E. A., Salls, W. B., Rover, J., & Seegers, B. N. (2018) · International Journal of Remote Sensing · doi:10.1080/01431161.2018.1471545 · Cited by 86
Global Monitoring of Inland Water Dynamics: State-of-the-Art, Challenges, and Opportunities
Karpatne, A., Khandelwal, A., Chen, X., Mithal, V., Faghmous, J. H., & Kumar, V. (2016) · Studies in computational intelligence · doi:10.1007/978-3-319-31858-5_7 · Cited by 84
Self-citationDemissie, Y. K., Valocchi, A. J., Minsker, B. S., & Bailey, B. (2008) · Journal of Hydrology · doi:10.1016/j.jhydrol.2008.11.007 · Cited by 70
Wang, X., Hamilton, D. P., McBride, C. G., Abell, J. M., & Hicks, B. J. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.08.001 · Cited by 69
Chen, Y., & Han, D. (2016) · Journal of Hydroinformatics · doi:10.2166/hydro.2016.180 · Cited by 64
Winslow, L., Hansen, G. J. A., Read, J. S., & Notaro, M. (2017) · Scientific Data · doi:10.1038/sdata.2017.53 · Cited by 52
Self-citationMetamodeling for Groundwater Age Forecasting in the Lake Michigan Basin
Fienen, M. N., Nolan, B. T., Kauffman, L. J., & Feinstein, D. T. (2018) · Water Resources Research · doi:10.1029/2017wr022387 · Cited by 46
From concept to practice to policy: modeling coupled natural and human systems in lake catchments
Cobourn, K. M., Carey, C. C., Boyle, K., Duffy, C. J., Dugan, H. A., Farrell, K. J., Fitchett, L. L., Hanson, P. C., Hart, J. A., Henson, V. R., et al. (2018) · Ecosphere · doi:10.1002/ecs2.2209 · Cited by 40
Self-citationSeagrass Detection in Coastal Water Through Deep Capsule Networks
Islam, K. A., Pérez, D., Hill, V. J., Schaeffer, B. A., Zimmerman, R. C., & Li, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03335-4_28 · Cited by 27
The business impact of deep learning
Howard, J. (2013) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2487575.2491127 · Cited by 24
Bachmann, R. W., Sharma, S., Canfield, D. E., & Lecours, V. (2019) · Geosciences · doi:10.3390/geosciences9070296 · Cited by 12
Coto-Jiménez, M. (2018) · IEEE International Work Conference on Bioinspired Intelligence (IWOBI) · doi:10.1109/iwobi.2018.8464204 · Cited by 3
Cited by
Global lake responses to climate change
Woolway, R. I., Kraemer, B. M., Lenters, J. D., Merchant, C. J., O’Reilly, C. M., & Sharma, S. (2020) · Nature Reviews Earth & Environment · doi:10.1038/s43017-020-0067-5 · Cited by 1,538
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2023) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 878
Self-citationA comprehensive review of deep learning applications in hydrology and water resources
Sit, M., Demiray, B. Z., Xiang, Z., Ewing, G. J., Sermet, Y., & Demir, I. (2020) · Water Science and Technology · doi:10.2166/wst.2020.369 · Cited by 618
Deep Learning for Geophysics: Current and Future Trends
Yu, S., & Ma, J. (2021) · Reviews of Geophysics · doi:10.1029/2021rg000742 · Cited by 571
Differentiable modelling to unify machine learning and physical models for geosciences
Shen, C., Appling, A. P., Gentine, P., Bandai, T., Gupta, H., Tartakovsky, A., Baity-Jesi, M., Fenicia, F., Kifer, D., Li, L., et al. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00450-9 · Cited by 468
Self-citation
Metadata
- Authors
- Read, J. S., Jia, X., Willard, J., Appling, A. P., Zwart, J. A., Oliver, S. K., Karpatne, A., Hansen, G. J. A., Hanson, P. C., Watkins, W., Steinbach, M., & Kumar, V.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2019-11
- Volume
- 55
- Issue
- 11
- Pages
- 9173-9190
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2986457312
- Cited by
- 447
- References
- 70
- FWCI
- 16.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.