The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Deep learning of subsurface flow via theory-guided neural network
Open accessAbstract
Active researches are currently being performed to incorporate the wealth of scientific knowledge into data-driven approaches (e.g., neural networks) in order to improve the latter's effectiveness. In this study, the Theory-guided Neural Network (TgNN) is proposed for deep learning of subsurface flow. In the TgNN, as supervised learning, the neural network is trained with available observations or simulation data while being simultaneously guided by theory (e.g., governing equations, other physical constraints, engineering controls, and expert knowledge) of the underlying problem. The TgNN can achieve higher accuracy than the ordinary Artificial Neural Network (ANN) because the former provides physically feasible predictions and can be more readily generalized beyond the regimes covered with the training data. Furthermore, the TgNN model is proposed for subsurface flow with heterogeneous model parameters. Several numerical cases of two-dimensional transient saturated flow are introduced to test the performance of the TgNN. In the learning process, the loss function contains data mismatch, as well as PDE constraint, engineering control, and expert knowledge. After obtaining the parameters of the neural network by minimizing the loss function, a TgNN model is built that not only fits the data, but also adheres to physical/engineering constraints. Predicting the future response can be easily realized by the TgNN model. In addition, the TgNN model is tested in more complicated scenarios, such as prediction with changed boundary conditions, learning from noisy data or outliers, transfer learning, and engineering controls. Numerical results demonstrate that the TgNN model achieves much better predictability, reliability, and generalizability than ANN models due to the physical/engineering constraints in the former.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“In this subsection, the concept of ‘transfer learning’ is introduced to deal with the ‘boundary condition changing’ situation in a more efficient manner (Pan & Yang, 2009).”
BackgroundRaissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2017) · Cited by 11,625
Stochastic Finite Elements: A Spectral Approach
Ghanem, R., & Spanos, P. D. (1991) · Springer eBooks · doi:10.1007/978-1-4612-3094-6 · Cited by 6,552
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., & Kumar, V. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720168 · Cited by 1,752
A Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,201
Shen, C. (2018) · Water Resources Research · doi:10.1029/2018wr022643 · Cited by 1,133
Zhu, Y., & Zabaras, N. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.018 · Cited by 704
Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.048 · Cited by 513
Self-citationLiang, L., Liu, M., Martin, C., & Sun, W. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0844 · Cited by 502
Physics-Guided Neural Networks (PGNN): An Application in Lake Temperature Modeling
Daw, A., Karpatne, A., Watkins, W. D., Read, J. S., & Kumar, V. (2022) · Knowledge-Guided Machine Learning · doi:10.1201/9781003143376-15 · Cited by 472
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2011) · Chapman & Hall/CRC Computer Science & Data Analysis · doi:10.1201/b11429-4 · Cited by 460
Training‐Image Based Geostatistical Inversion Using a Spatial Generative Adversarial Neural Network
Laloy, E., Hérault, R., Jacques, D., & Linde, N. (2018) · Water Resources Research · doi:10.1002/2017wr022148 · Cited by 382
Mo, S., Zhu, Y., Zabaras, N., Shi, X., & Wu, J. (2019) · Water Resources Research · doi:10.1029/2018wr023528 · Cited by 364
Stock prediction using deep learning
Singh, R., & Srivastava, S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4159-7 · Cited by 339
LaneNet: Real-Time Lane Detection Networks for Autonomous DrivingPreprint
Wang, Z., Ren, W., & Qiu, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01726 · Cited by 304
Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling
Daw, A., Karpatne, A., Watkins, W., Read, J. S., & Kumar, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.11431 · Cited by 300
Mo, S., Zabaras, N., Shi, X., & Wu, J. (2019) · Water Resources Research · doi:10.1029/2018wr024638 · Cited by 288
Deep learning for chemical reaction prediction
Fooshee, D., Mood, A., Gutman, E., Tavakoli, M., Urban, G., Liu, F., Huynh, N., Van Vranken, D., & Baldi, P. (2018) · Molecular Systems Design & Engineering · doi:10.1039/c7me00107j · Cited by 203
Karumuri, S., Tripathy, R., Bilionis, I., & Panchal, J. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109120 · Cited by 159
Shashikumar, S. P., Shah, A. J., Clifford, G. D., & Nemati, S. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219912 · Cited by 106
Discovering State‐Parameter Mappings in Subsurface Models Using Generative Adversarial Networks
Sun, A. Y. (2018) · Geophysical Research Letters · doi:10.1029/2018gl080404 · Cited by 99
A Stock Market Trading System Using Deep Neural Network
Yong, B. X., Rahim, M. R. A., & Abdullah, A. S. (2017) · Communications in computer and information science · doi:10.1007/978-981-10-6463-0_31 · Cited by 58
Deep Neural Networks for Physics Analysis on low-level whole-detector data at the LHC
Bhimji, W., Farrell, S., Kurth, T., Paganini, M., Prabhat, & Racah, E. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1085/4/042034 · Cited by 57
Deep neural network learning of complex binary sorption equilibria from molecular simulation data
Sun, Y., DeJaco, R. F., & Siepmann, J. I. (2019) · Chemical Science · doi:10.1039/c8sc05340e · Cited by 57
DNN-HMM based Automatic Speech Recognition for HRI Scenarios
Nóvoa, J., Wuth, J., Escudero, J. P., Fredes, J., Mahú, R., & Yoma, N. B. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171280 · Cited by 50
Deep Learning Based Automatic Video Annotation Tool for Self-Driving CarPreprint
Manikandan, N. S., & Ganesan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12618 · Cited by 19
A Vision-Based Method for Improving the Safety of Self-Driving
Dong, D., Li, X., & Sun, X. (2018) · International Conference on Reliability, Maintainability and Safety · doi:10.1109/icrms.2018.00040 · Cited by 15
Deep Learning in the Natural Sciences: Applications to Physics
Sadowski, P., & Baldi, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99492-5_12 · Cited by 8
Cited by
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
A comprehensive review of deep learning applications in hydrology and water resources
Sit, M., Demiray, B. Z., Xiang, Z., Ewing, G. J., Sermet, Y., & Demir, I. (2020) · Water Science and Technology · doi:10.2166/wst.2020.369 · Cited by 618
Differentiable modelling to unify machine learning and physical models for geosciences
Shen, C., Appling, A. P., Gentine, P., Bandai, T., Gupta, H., Tartakovsky, A., Baity-Jesi, M., Fenicia, F., Kifer, D., Li, L., et al. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00450-9 · Cited by 468
Jiang, S., Zheng, Y., & Solomatine, D. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088229 · Cited by 365
Tripathy, K. P., & Mishra, A. K. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130458 · Cited by 336
Metadata
- Authors
- Wang, N., Zhang, D., Chang, H., & Li, H.
- Venue
- Journal of Hydrology
- Publisher
- Elsevier BV
- Published
- 2020-05
- Volume
- 584
- Pages
- 124700
- ISSN
- 0022-1694 (ISSN-L)
- OpenAlex
- W3006689658
- Cited by
- 322
- References
- 36
- FWCI
- 16.40
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.