Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 1,133

The DOI matches its Crossref record; 211 of the 211 references it cites were found in a registry or an index.

A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists

Open access
Shen, Chaopeng · 2018 · Water Resources Research

Abstract

Deep learning (DL), a new generation of artificial neural network research, has transformed industries, daily lives, and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to automatically engineer problem‐relevant features and capture highly complex data distributions. I argue that DL can help address several major new and old challenges facing research in water sciences such as interdisciplinarity, data discoverability, hydrologic scaling, equifinality, and needs for parameter regionalization. This review paper is intended to provide water resources scientists and hydrologists in particular with a simple technical overview, transdisciplinary progress update, and a source of inspiration about the relevance of DL to water. The review reveals that various physical and geoscientific disciplines have utilized DL to address data challenges, improve efficiency, and gain scientific insights. DL is especially suited for information extraction from image‐like data and sequential data. Techniques and experiences presented in other disciplines are of high relevance to water research. Meanwhile, less noticed is that DL may also serve as a scientific exploratory tool. A new area termed AI neuroscience, where scientists interpret the decision process of deep networks and derive insights, has been born. This budding subdiscipline has demonstrated methods including correlation‐based analysis, inversion of network‐extracted features, reduced‐order approximations by interpretable models, and attribution of network decisions to inputs. Moreover, DL can also use data to condition neurons that mimic problem‐specific fundamental organizing units, thus revealing emergent behaviors of these units. Vast opportunities exist for DL to propel advances in water sciences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1029/2018wr022643

Cites

211 of 211 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Items 201–211 of 211

Research works printed but not linked: 59

  1. 10.1175/JHM479.1 · doi:10.1175/jhm479.1
  2. 10.1002/2017WR020516 · doi:10.1002/2017wr020516
  3. 10.1109/Agro-Geoinformatics.2017.8047014 · doi:10.1109/agro-geoinformatics.2017.8047014
  4. Ballard D., 1987, Proceedings of the sixth National Conference on Artificial Intelligence, 279
  5. 10.1175/2009JHM1099.1 · doi:10.1175/2009jhm1099.1
  6. 10.1016/J.JHYDROL.2004.06.020 · doi:10.1016/j.jhydrol.2004.06.020
  7. Breiman L., 1984, Classification and regression trees
  8. Brin S. (2018).The spring of hope. Retrieved fromhttps://abc.xyz/investor/founders‐letters/2017/index.html
  9. 10.1007/s00376‐009‐8071‐1 · doi:10.1007/s00376-009-8071-1
  10. 10.1623/hysj.53.3.656 · doi:10.1623/hysj.53.3.656
  11. Coates A., 2011, Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, PMLR, 215
  12. Damianou A. C. &Lawrence N. D.(2013).Deep Gaussian processes. Proceedings of the 16th International Conference on Artificial Intelligence and Statistics. Retrieved fromhttp://arxiv.org/abs/1211.0358
  13. Drucker H., 1996, Proceedings of the 9th International Conference on Neural Information Processing Systems, 155
  14. Eldan R., 2016, Conference on Learning Theory 2016, Association for Computational Learning, 1
  15. 10.1002/2016WR020283 · doi:10.1002/2016wr020283
  16. 10.1007/s11242‐014‐0313‐8 · doi:10.1007/s11242-014-0313-8
  17. George D. Shen H. &Huerta E. A.(2017).Deep transfer learning: A new deep learning glitch classification method for advanced LIGO. Arxiv Preprint 1706.07446. Retrieved fromhttp://arxiv.org/abs/1706.07446 · arXiv
  18. Gomes J. Ramsundar B. Feinberg E. N. &Pande V. S.(2017).Atomic convolutional networks for predicting protein‐ligand binding affinity. arXiv: 1703.10603. Retrieved fromhttp://arxiv.org/abs/1703.10603 · arXiv
  19. Goodfellow I. Pouget‐Abadie J. Mirza M. Xu B. Warde‐Farley D. Ozair S. et al. (2014).Generative adversarial networks. Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS'14). Retrieved fromhttp://arxiv.org/abs/1406.2661
  20. 10.1007/978-94-015-9341-0 · doi:10.1007/978-94-015-9341-0
  21. Greff K. Srivastava R. K. Koutník J. Steunebrink B. R. &Schmidhuber J.(2015).LSTM: A search space odyssey. Retrieved fromhttp://arxiv.org/abs/1503.04069
  22. Gupta H. V., 2000, Effective and efficient modeling for streamflow forecasting, 7
  23. Hernández E., 2016, Rainfall prediction: A deep learning approach, 151
  24. Ho T. K.(1995).Random decision forests. Proceeding ICDAR'95 Proceedings of the Third International Conference on Document Analysis and Recognition.
  25. Hochreiter S., 2001, A field guide to dynamical recurrent neural networks, 237
  26. 10.1002/hyp.10166 · DOI
  27. 10.1016/j.cageo.2017.09.014 · doi:10.1016/j.cageo.2017.09.014
  28. 10.1007/s40808‐016‐0083‐0 · doi:10.1007/s40808-016-0083-0
  29. Kawaguchi K. Kaelbling L. P. &Bengio Y.(2017).Generalization in deep learning. arXiv:1710.05468. Retrieved fromhttp://arxiv.org/abs/1710.05468 · arXiv
  30. Koller D., 2009, Probabilistic graphical models: Principles and techniques
  31. Koza J. R., 1992, Genetic programming: On the programming of computers by means of natural selection
  32. 10.5194/hess‐2018‐247 · doi:10.5194/hess-2018-247
  33. Kumar D. &Menkovski V.(2016).Understanding anatomy classification through visualization. 30th NIPS Machine learning for Health Workshop. Retrieved fromhttps://arxiv.org/abs/1611.06284
  34. Lee W., 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE), 252
  35. 10.1002/2013WR014974 · doi:10.1002/2013wr014974
  36. Mehta P. &Schwab D. J.(2014).An exact mapping between the variational renormalization group and deep learning. arXiv:1410.3831. Retrieved fromhttp://arxiv.org/abs/1410.3831 · arXiv
  37. Morgan D. A. E., 2015, Proc. SPIE Algorithms for Synthetic Aperture Radar Imagery XXII, 94750F
  38. Mozer M. C., 1989, Complex systems, 349
  39. Nobelförsamligen(2014).The Nobel Prize in physiology or medicine 2014. Retrieved fromhttps://www.nobelprize.org/nobel_prizes/medicine/laureates/2014/press.html
  40. Ramsundar B. Kearnes S. Riley P. Webster D. Konerding D. &Pande V.(2015).Massively multitask networks for drug discovery. arXiv:1502.02072. Retrieved fromhttp://arxiv.org/abs/1502.02072 · arXiv
  41. Rasmussen C. E., 2006, Gaussian processes for machine learning
  42. 10.1088/1742‐6596/762/1/012035 · doi:10.1088/1742-6596/762/1/012035
  43. Semeniuta S., 2016, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, 1757
  44. Sharma J., 2017, Deep convolutional neural networks for fire detection in images, 183
  45. 10.1007/978-3-540-24855-2_74 · doi:10.1007/978-3-540-24855-2_74
  46. 10.1002/2017WR021396 · doi:10.1002/2017wr021396
  47. Snelson E., 2006, Sparse Gaussian processes using pseudo‐inputs, Advances in Neural Information Processing Systems, 18, 1257
  48. Sønderby S. K., 2015, Convolutional LSTM networks for subcellular localization of proteins, 68
  49. Strobelt H., 2016, IEEE Information Visualization 2017
  50. 10.1175/1520‐0450(2004)043<0576:ANNFTT>2.0.CO;2 · doi:10.1175/1520-0450(2004)043<0576:annftt>2.0.co;2
  51. 10.1029/2007WR006513 · doi:10.1029/2007wr006513
  52. Vapnik V., 1992, The nature of statistical learning theory
  53. 10.1016/j.rse.2005.05.017 · DOI
  54. 10.1017/CBO9780511551864.002 · doi:10.1017/cbo9780511551864.002
  55. Wu Z. Ramsundar B. Feinberg E. N. Gomes J. Geniesse C. Pappu A. S. et al. (2017).MoleculeNet: A benchmark for molecular machine learning. arXiv:1703.00564. Retrieved fromhttp://arxiv.org/abs/1703.00564 · arXiv
  56. Yosinski J. Clune J. Bengio Y. &Lipson H.(2014).How transferable are features in deep neural networks?NIPS 2014. Retrieved fromhttp://arxiv.org/abs/1411.1792
  57. Yosinski J., 2015, Deep learning workshop, 31st International Conference on Machine Learning
  58. Zhu X. X. Tuia D. Mou L. Xia G.‐S. Zhang L. Xu F. &Fraundorfer F.(2017).Deep learning in remote sensing: A review. IEEE Geoscience and Remote Sensing Magazine. Retrieved fromhttp://arxiv.org/abs/1710.03959
  59. Ziletti A. Kumar D. Scheffler M. &Ghiringhelli L. M.(2017).The face of crystals: Insightful classification using deep learning. arXiv:1709.02298. Retrieved fromhttps://arxiv.org/abs/1709.02298 · arXiv

Cited by

See all 1,133

Metadata

Authors
Shen, C.
Venue
Water Resources Research
Published
2018-11
Volume
54
Issue
11
Pages
8558-8593
ISSN
  • 0043-1397 (ISSN-L)
  • 1944-7973
OpenAlex
W2775031014
Cited by
1,133
References
211
FWCI
29.60
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
  • National Science Foundation (EAR‐1832294)
  • U.S. Department of Energy (SC0016605, DE‐SC0016605)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.