The DOI matches its Crossref record; 211 of the 211 references it cites were found in a registry or an index.
A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists
Open accessAbstract
Deep learning (DL), a new generation of artificial neural network research, has transformed industries, daily lives, and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to automatically engineer problem‐relevant features and capture highly complex data distributions. I argue that DL can help address several major new and old challenges facing research in water sciences such as interdisciplinarity, data discoverability, hydrologic scaling, equifinality, and needs for parameter regionalization. This review paper is intended to provide water resources scientists and hydrologists in particular with a simple technical overview, transdisciplinary progress update, and a source of inspiration about the relevance of DL to water. The review reveals that various physical and geoscientific disciplines have utilized DL to address data challenges, improve efficiency, and gain scientific insights. DL is especially suited for information extraction from image‐like data and sequential data. Techniques and experiences presented in other disciplines are of high relevance to water research. Meanwhile, less noticed is that DL may also serve as a scientific exploratory tool. A new area termed AI neuroscience, where scientists interpret the decision process of deep networks and derive insights, has been born. This budding subdiscipline has demonstrated methods including correlation‐based analysis, inversion of network‐extracted features, reduced‐order approximations by interpretable models, and attribution of network decisions to inputs. Moreover, DL can also use data to condition neurons that mimic problem‐specific fundamental organizing units, thus revealing emergent behaviors of these units. Vast opportunities exist for DL to propel advances in water sciences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–211 of 211
Shen, C., Riley, W. J., Smithgall, K., Melack, J. M., & Fang, K. (2016) · Water Resources Research · doi:10.1002/2015wr018086 · Cited by 45
Self-citationMonitoring Ethiopian Wheat Fungus with Satellite Imagery and Deep Feature Learning
Pryzant, R., Ermon, S., & Lobell, D. B. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.196 · Cited by 41
A Deep-Learning Based Precipitation Forecasting Approach Using Multiple Environmental Factors
Zhang, P., Zhang, L., LEUNG, H. K. N., & Wang, J. (2017) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdatacongress.2017.34 · Cited by 41
Modeling Urbanization Patterns with Generative Adversarial Networks
Albert, A., Strano, E., Kaur, J., & González, M. C. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8518032 · Cited by 41
Revealing Fundamental Physics from the Daya Bay Neutrino Experiment Using Deep Neural Networks
Racah, E., Ko, S., Sadowski, P., Bhimji, W., Tull, C. E., Oh, S., Baldi, P., & Prabhat (2016) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2016.0160 · Cited by 34
Phan, N., Dou, D., Piniewski, B., & Kil, D. (2016) · Social Network Analysis and Mining · doi:10.1007/s13278-016-0379-0 · Cited by 27
Soil moisture retrieval from SMOS observations using neural networks
Rodríguez-Fernández, N. J., Richaume, P., Aires, F., Prigent, C., Kerr, Y. H., Kolassa, J., Jiménez, C., Cabot, F., & Mahmoodi, A. (2014) · doi:10.1109/igarss.2014.6946963 · Cited by 20
Unifying Adversarial Training Algorithms with Flexible Deep Data Gradient RegularizationPreprint
Ororbia, A. G., Giles, C. L., & Kifer, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.07213 · Cited by 17
Greengard, S. (2016) · Communications of the ACM · doi:10.1145/2967979 · Cited by 17
Deep learning for studies of galaxy morphology
Tuccillo, D., Decencière, É., & Velasco-Forero, S. (2016) · Proceedings of the International Astronomical Union · doi:10.1017/s1743921317000552 · Cited by 16
Could machine learning break the convection parametrization deadlock?Preprint
Gentine, P., Pritchard, M., Rasp, S., Reinaudi, G., & Yacalis, G. (2018) · doi:10.31223/osf.io/hv95e · Cited by 3
Research works printed but not linked: 59
- 10.1175/JHM479.1 · doi:10.1175/jhm479.1
- 10.1002/2017WR020516 · doi:10.1002/2017wr020516
- 10.1109/Agro-Geoinformatics.2017.8047014 · doi:10.1109/agro-geoinformatics.2017.8047014
- Ballard D., 1987, Proceedings of the sixth National Conference on Artificial Intelligence, 279
- 10.1175/2009JHM1099.1 · doi:10.1175/2009jhm1099.1
- 10.1016/J.JHYDROL.2004.06.020 · doi:10.1016/j.jhydrol.2004.06.020
- Breiman L., 1984, Classification and regression trees
- Brin S. (2018).The spring of hope. Retrieved fromhttps://abc.xyz/investor/founders‐letters/2017/index.html
- 10.1007/s00376‐009‐8071‐1 · doi:10.1007/s00376-009-8071-1
- 10.1623/hysj.53.3.656 · doi:10.1623/hysj.53.3.656
- Coates A., 2011, Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, PMLR, 215
- Damianou A. C. &Lawrence N. D.(2013).Deep Gaussian processes. Proceedings of the 16th International Conference on Artificial Intelligence and Statistics. Retrieved fromhttp://arxiv.org/abs/1211.0358
- Drucker H., 1996, Proceedings of the 9th International Conference on Neural Information Processing Systems, 155
- Eldan R., 2016, Conference on Learning Theory 2016, Association for Computational Learning, 1
- 10.1002/2016WR020283 · doi:10.1002/2016wr020283
- 10.1007/s11242‐014‐0313‐8 · doi:10.1007/s11242-014-0313-8
- George D. Shen H. &Huerta E. A.(2017).Deep transfer learning: A new deep learning glitch classification method for advanced LIGO. Arxiv Preprint 1706.07446. Retrieved fromhttp://arxiv.org/abs/1706.07446 · arXiv
- Gomes J. Ramsundar B. Feinberg E. N. &Pande V. S.(2017).Atomic convolutional networks for predicting protein‐ligand binding affinity. arXiv: 1703.10603. Retrieved fromhttp://arxiv.org/abs/1703.10603 · arXiv
- Goodfellow I. Pouget‐Abadie J. Mirza M. Xu B. Warde‐Farley D. Ozair S. et al. (2014).Generative adversarial networks. Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS'14). Retrieved fromhttp://arxiv.org/abs/1406.2661
- 10.1007/978-94-015-9341-0 · doi:10.1007/978-94-015-9341-0
- Greff K. Srivastava R. K. Koutník J. Steunebrink B. R. &Schmidhuber J.(2015).LSTM: A search space odyssey. Retrieved fromhttp://arxiv.org/abs/1503.04069
- Gupta H. V., 2000, Effective and efficient modeling for streamflow forecasting, 7
- Hernández E., 2016, Rainfall prediction: A deep learning approach, 151
- Ho T. K.(1995).Random decision forests. Proceeding ICDAR'95 Proceedings of the Third International Conference on Document Analysis and Recognition.
- Hochreiter S., 2001, A field guide to dynamical recurrent neural networks, 237
- 10.1002/hyp.10166 · DOI
- 10.1016/j.cageo.2017.09.014 · doi:10.1016/j.cageo.2017.09.014
- 10.1007/s40808‐016‐0083‐0 · doi:10.1007/s40808-016-0083-0
- Kawaguchi K. Kaelbling L. P. &Bengio Y.(2017).Generalization in deep learning. arXiv:1710.05468. Retrieved fromhttp://arxiv.org/abs/1710.05468 · arXiv
- Koller D., 2009, Probabilistic graphical models: Principles and techniques
- Koza J. R., 1992, Genetic programming: On the programming of computers by means of natural selection
- 10.5194/hess‐2018‐247 · doi:10.5194/hess-2018-247
- Kumar D. &Menkovski V.(2016).Understanding anatomy classification through visualization. 30th NIPS Machine learning for Health Workshop. Retrieved fromhttps://arxiv.org/abs/1611.06284
- Lee W., 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE), 252
- 10.1002/2013WR014974 · doi:10.1002/2013wr014974
- Mehta P. &Schwab D. J.(2014).An exact mapping between the variational renormalization group and deep learning. arXiv:1410.3831. Retrieved fromhttp://arxiv.org/abs/1410.3831 · arXiv
- Morgan D. A. E., 2015, Proc. SPIE Algorithms for Synthetic Aperture Radar Imagery XXII, 94750F
- Mozer M. C., 1989, Complex systems, 349
- Nobelförsamligen(2014).The Nobel Prize in physiology or medicine 2014. Retrieved fromhttps://www.nobelprize.org/nobel_prizes/medicine/laureates/2014/press.html
- Ramsundar B. Kearnes S. Riley P. Webster D. Konerding D. &Pande V.(2015).Massively multitask networks for drug discovery. arXiv:1502.02072. Retrieved fromhttp://arxiv.org/abs/1502.02072 · arXiv
- Rasmussen C. E., 2006, Gaussian processes for machine learning
- 10.1088/1742‐6596/762/1/012035 · doi:10.1088/1742-6596/762/1/012035
- Semeniuta S., 2016, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, 1757
- Sharma J., 2017, Deep convolutional neural networks for fire detection in images, 183
- 10.1007/978-3-540-24855-2_74 · doi:10.1007/978-3-540-24855-2_74
- 10.1002/2017WR021396 · doi:10.1002/2017wr021396
- Snelson E., 2006, Sparse Gaussian processes using pseudo‐inputs, Advances in Neural Information Processing Systems, 18, 1257
- Sønderby S. K., 2015, Convolutional LSTM networks for subcellular localization of proteins, 68
- Strobelt H., 2016, IEEE Information Visualization 2017
- 10.1175/1520‐0450(2004)043<0576:ANNFTT>2.0.CO;2 · doi:10.1175/1520-0450(2004)043<0576:annftt>2.0.co;2
- 10.1029/2007WR006513 · doi:10.1029/2007wr006513
- Vapnik V., 1992, The nature of statistical learning theory
- 10.1016/j.rse.2005.05.017 · DOI
- 10.1017/CBO9780511551864.002 · doi:10.1017/cbo9780511551864.002
- Wu Z. Ramsundar B. Feinberg E. N. Gomes J. Geniesse C. Pappu A. S. et al. (2017).MoleculeNet: A benchmark for molecular machine learning. arXiv:1703.00564. Retrieved fromhttp://arxiv.org/abs/1703.00564 · arXiv
- Yosinski J. Clune J. Bengio Y. &Lipson H.(2014).How transferable are features in deep neural networks?NIPS 2014. Retrieved fromhttp://arxiv.org/abs/1411.1792
- Yosinski J., 2015, Deep learning workshop, 31st International Conference on Machine Learning
- Zhu X. X. Tuia D. Mou L. Xia G.‐S. Zhang L. Xu F. &Fraundorfer F.(2017).Deep learning in remote sensing: A review. IEEE Geoscience and Remote Sensing Magazine. Retrieved fromhttp://arxiv.org/abs/1710.03959
- Ziletti A. Kumar D. Scheffler M. &Ghiringhelli L. M.(2017).The face of crystals: Insightful classification using deep learning. arXiv:1709.02298. Retrieved fromhttps://arxiv.org/abs/1709.02298 · arXiv
Cited by
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks
(2018) · doi:10.5194/hess-22-6005-2018 · Cited by 2,114
Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda
Nishant, R., Kennedy, M., & Corbett, J. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102104 · Cited by 1,203
A review of the application of machine learning in water quality evaluation
Zhu, M., Wang, J., Yang, X., Zhang, Y., Zhang, L., Ren, H., Wu, B., & Ye, L. (2022) · Eco-Environment & Health · doi:10.1016/j.eehl.2022.06.001 · Cited by 793
Tyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
A review of machine learning applications in wildfire science and management
Jain, P., Coogan, S. C. P., Subramanian, S. G., Crowley, M., Taylor, S., & Flannigan, M. D. (2020) · Environmental Reviews · doi:10.1139/er-2020-0019 · Cited by 765
Metadata
- Authors
- Shen, C.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 2018-11
- Volume
- 54
- Issue
- 11
- Pages
- 8558-8593
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2775031014
- Cited by
- 1,133
- References
- 211
- FWCI
- 29.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 4 d)
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Funders
- National Science Foundation (EAR‐1832294)
- U.S. Department of Energy (SC0016605, DE‐SC0016605)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.