The DOI matches its Crossref record; 285 of the 285 references it cites were found in a registry or an index.
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Open accessAbstract
There is a growing consensus that solutions to complex science and engineering problems require novel methodologies that are able to integrate traditional physics-based modeling approaches with state-of-the-art machine learning (ML) techniques. This article provides a structured overview of such techniques. Application-centric objective areas for which these approaches have been applied are summarized, and then classes of methodologies used to construct physics-guided ML models and hybrid physics-ML frameworks are described. We then provide a taxonomy of these existing techniques, which uncovers knowledge gaps and potential crossovers of methods between disciplines that can serve as ideas for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–285 of 285
Pukrittayakamee, A., Malshe, M., Hagan, M., Raff, L. M., Narulkar, R., Bukkapatnum, S., & Komanduri, R. (2009) · The Journal of Chemical Physics · doi:10.1063/1.3095491 · Cited by 122
Gupta, H. V., & Nearing, G. (2014) · Water Resources Research · doi:10.1002/2013wr015096 · Cited by 121
Solving electrical impedance tomography with deep learning
Fan, Y., & Ying, L. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109119 · Cited by 118
Paolucci, R., Gatti, F., Infantino, M., et al. (2018) · Bulletin of the Seismological Society of America · doi:10.1785/0120170293 · Cited by 116
Rudd, K., & Ferrari, S. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.11.058 · Cited by 113
Physics guided machine learning using simplified theories
Pawar, S. A., San, O., Aksoylu, B., Rasheed, A., & Kvamsdal, T. (2021) · NORA - Norwegian Open Research Archives · Cited by 112
Álvarez, M. A., Luengo, D., & Lawrence, N. D. (2009) · Cited by 110
Holland, J. R., Baeder, J. D., & Duraisamy, K. (2019) · AIAA AVIATION Forum · doi:10.2514/6.2019-3200 · Cited by 108
Physics-Guided Recurrent Graph Model for Predicting Flow and Temperature in River Networks
Jia, X., Zwart, J. A., Sadler, J. M., Appling, A., Oliver, S. K., Markstrom, S. L., Willard, J., Xu, S., Steinbach, M. S., Read, J. S., et al. (2021) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976700.69 · Cited by 108
Self-citationPhysics-aware Gaussian processes in remote sensing
Camps‐Valls, G., Martino, L., Svendsen, D. H., Campos‐Taberner, M., Muñoz-Marı́, J., Laparra, V., Luengo, D., & Garcı́a-Haro, F. J. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.03.021 · Cited by 107
Machine Learning Prediction of Heat Capacity for Solid Inorganics
Kauwe, S. K., Graser, J., Vazquez, A., & Sparks, T. D. (2018) · Integrating materials and manufacturing innovation · doi:10.1007/s40192-018-0108-9 · Cited by 107
Predicting Water Temperature Dynamics of Unmonitored Lakes With Meta‐Transfer Learning
Willard, J., Read, J. S., Appling, A., Oliver, S. K., Jia, X., & Kumar, V. (2021) · Water Resources Research · doi:10.1029/2021wr029579 · Cited by 107
Self-citationGao, P., Honkela, A., Rattray, M., & Lawrence, N. D. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn278 · Cited by 106
Ba, Y., Gilbert, A. R., Wang, F., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58586-0_33 · Cited by 106
Knowledge-Guided Machine Learning
Karpatne, A., Kannan, R., & Kumar, V. (2022) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003143376 · Cited by 106
Self-citationDR-RNN: A deep residual recurrent neural network for model reductionPreprint
Kani, J. N., & Elsheikh, A. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00939 · Cited by 104
Anatomy-aided deep learning for medical image segmentation: a review
Liu, L., Wolterink, J. M., Brüne, C., & Veldhuis, R. N. J. (2021) · Physics in Medicine and Biology · doi:10.1088/1361-6560/abfbf4 · Cited by 102
Uncertainty quantification for porous media flows
Christie, M., Demyanov, V., & Erbas, D. (2006) · Journal of Computational Physics · doi:10.1016/j.jcp.2006.01.026 · Cited by 101
tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid FlowPreprint
Xie, Y. X., Franz, E., Chu, M., & Thuerey, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09710 · Cited by 100
Modelling transcriptional regulation using Gaussian processes
Lawrence, N. D., Sanguinetti, G., & Rattray, M. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0103 · Cited by 99
Estimating uncertainty of streamflow simulation using Bayesian neural networks
Zhang, X., Liang, F., Srinivasan, R., & Liew, M. W. V. (2009) · Water Resources Research · doi:10.1029/2008wr007030 · Cited by 99
Forecasting Sequential Data using Consistent Koopman AutoencodersPreprint
Azencot, O., Erichson, N. B., Lin, V., & Mahoney, M. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02236 · Cited by 98
Nowack, P. J., Braesicke, P., Haigh, J. D., Abraham, N. L., Pyle, J. A., & Voulgarakis, A. (2018) · Environmental Research Letters · doi:10.1088/1748-9326/aae2be · Cited by 95
Rajabi, M. M., & Ketabchi, H. (2017) · Journal of Hydrology · doi:10.1016/j.jhydrol.2017.10.041 · Cited by 91
Kriging Convolutional Networks
Appleby, G., Liu, L., & Liu, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5716 · Cited by 91
Model order reduction assisted by deep neural networks (ROM-net)
Daniel, T., Casenave, F., Akkari, N., & Ryckelynck, D. (2020) · Advanced Modeling and Simulation in Engineering Sciences · doi:10.1186/s40323-020-00153-6 · Cited by 91
Bennett, A. R., & Nijssen, B. (2021) · Water Resources Research · doi:10.1029/2020wr029328 · Cited by 89
Physics-enhanced neural networks learn order and chaos
Choudhary, A., Lindner, J. F., Holliday, E. G., Miller, S. T., Sinha, S., & Ditto, W. L. (2020) · Physical review. E · doi:10.1103/physreve.101.062207 · Cited by 86
Data-driven methods to improve baseflow prediction of a regional groundwater model
Xu, T., & Valocchi, A. J. (2015) · Computers & Geosciences · doi:10.1016/j.cageo.2015.05.016 · Cited by 84
Sharma, A. S., Mezić, I., & McKeon, B. (2016) · Physical Review Fluids · doi:10.1103/physrevfluids.1.032402 · Cited by 84
Physics-informed semantic inpainting: Application to geostatistical modeling
Zheng, Q., Zeng, L., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109676 · Cited by 84
A Multiscale Neural Network Based on Hierarchical Matrices
Fan, Y.-W., Lin, L., Ying, L.-X., & Zepeda-Núñez, L. (2018) · Multiscale Modeling & simulation · doi:10.1137/18m1203602 · Cited by 81
Injecting knowledge in data-driven vehicle trajectory predictors
Bahari, M., Nejjar, I., & Alahi, A. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103010 · Cited by 81
Physics-informed deep generative modelsPreprint
Yang, Y., & Perdikaris, P. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03511 · Cited by 76
Lagergren, J. H., Nardini, J. T., Lavigne, G. M., Rutter, E. M., & Flores, K. (2020) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rspa.2019.0800 · Cited by 75
Quantifying Uncertainty in Discrete-Continuous and Skewed Data with Bayesian Deep Learning
Vandal, T., Kodra, E., Dy, J., Ganguly, S., Nemani, R., & Ganguly, A. R. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219996 · Cited by 74
Combining Semi-Physical and Neural Network Modeling: An Example ofIts Usefulness
Forssell, U., & Lindskog, P. (1997) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)42938-7 · Cited by 73
Process similarity and developing new process models through migration
Lu, J., Yao, K., & Gao, F. (2009) · AIChE Journal · doi:10.1002/aic.11822 · Cited by 72
Hybrid modeling and prediction of dynamical systems
Hamilton, F., Lloyd, A. L., & Flores, K. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005655 · Cited by 72
Dua, V. (2010) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2010.06.005 · Cited by 70
Short-term forecasting of the wave energy flux: Analogues, random forests, and physics-based models
Ibarra‐Berastegi, G., Sáenz, J., Esnaola, G., Ezcurra, A., & Ulazia, A. (2015) · Ocean Engineering · doi:10.1016/j.oceaneng.2015.05.038 · Cited by 70
Synergies Between Quantum Mechanics and Machine Learning in Reaction Prediction
Sadowski, P., Fooshee, D., Subrahmanya, N., & Baldi, P. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00351 · Cited by 65
Ganguly, A. R., Kodra, E., Agrawal, A., Banerjee, A., Boriah, S., Chatterjee, S., Chatterjee, S., Choudhary, A., Das, D., Faghmous, J. H., et al. (2014) · Nonlinear processes in geophysics · doi:10.5194/npg-21-777-2014 · Cited by 63
Self-citationLong, Y., She, X., & Mukhopadhyay, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07439 · Cited by 63
Bayesian migration of Gaussian process regression for rapid process modeling and optimization
Yan, W., Hu, S., Yang, Y., Gao, F., & Chen, T. (2010) · Chemical Engineering Journal · doi:10.1016/j.cej.2010.11.097 · Cited by 60
Physical Symmetries Embedded in Neural NetworksPreprint
Mattheakis, M., Protopapas, P., Sondak, D., Giovanni, M. D., & Kaxiras, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08991 · Cited by 60
Morton, J., Witherden, F., & Kochenderfer, M. J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/440 · Cited by 53
Integrating Knowledge and Reasoning in Image Understanding
Aditya, S., Yang, Y., & Baral, C. R. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/873 · Cited by 52
PGA: Physics Guided and Adaptive Approach for Mobile Fine-Grained Air Pollution Estimation
Chen, X., Xu, X., Liu, X., Pan, S., He, J., Noh, H. Y., Zhang, L., & Zhang, P. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3274179 · Cited by 50
Multiresolution convolutional autoencoders
Liu, Y., Ponce, C., Brunton, S. L., & Kutz, J. N. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111801 · Cited by 48
Metaheuristic-based inverse design of materials – A survey
Liao, T. W., & Li, G. (2020) · Journal of Materiomics · doi:10.1016/j.jmat.2020.02.011 · Cited by 47
Bu, J., & Karpatne, A. (2021) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976700.76 · Cited by 45
Model Migration with Inclusive Similarity for Development of a New Process Model
Lu, J., & Gao, F. (2008) · Industrial & Engineering Chemistry Research · doi:10.1021/ie800595a · Cited by 44
Highly-scalable, Physics-Informed GANs for Learning Solutions of Stochastic PDEs
Yang, L., Treichler, S., Kurth, T., Fischer, K., Barajas‐Solano, D. A., Romero, J., Churavy, V., Tartakovsky, A. M., Houston, M., Prabhat, M., et al. (2019) · IEEE/ACM Workshop on Deep Learning on Supercomputers (DLS) · doi:10.1109/dls49591.2019.00006 · Cited by 44
Physics-Informed Echo State Networks for Chaotic Systems Forecasting
Doan, N. A. K., Polifke, W., & Magri, L. (2019) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.38876 · Cited by 44
Deep Density: Circumventing the Kohn-Sham equations via symmetry preserving neural networks
Zepeda-Núñez, L., Chen, Y., Zhang, J., Jia, W., Zhang, L., & Lin, L. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110523 · Cited by 44
Information processing, data inferences, and scientific generalization
Gerwin, D. (1974) · Systems Research and Behavioral Science · doi:10.1002/bs.3830190504 · Cited by 42
Chen, G., Zuo, Y., Sun, J. Q., & Li, Y. (2012) · Mathematical Problems in Engineering · doi:10.1155/2012/152123 · Cited by 39
Inversion of Surface Parameters Using Fast Learning Neural Networks
Dawson, M. S., Olvera, J. A., Fung, A. K., & MANRY, M. T. (2005) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.1992.578294 · Cited by 39
TDEFSI: Theory-guided Deep Learning-based Epidemic Forecasting with Synthetic Information
Wang, L., Chen, J., & MARATHE, M. V. (2020) · ACM Transactions on Spatial Algorithms and Systems · doi:10.1145/3380971 · Cited by 39
Self-supervised Learning of Inverse Problem Solvers in Medical Imaging
Senouf, O., Vedula, S., Weiss, T., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33391-1_13 · Cited by 37
Blending Diverse Physical Priors with Neural NetworksPreprint
Ba, Y., Zhao, G., & Kadambi, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.00201 · Cited by 32
Deep neural network enabled corrective source term approach to hybrid analysis and modeling
Blakseth, S. S., Rasheed, A., Kvamsdal, T., & San, O. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.11.021 · Cited by 32
Encoding Invariances in Deep Generative ModelsPreprint
Shah, V., Joshi, A., Ghosal, S., Pokuri, B. S. S., Sarkar, S., Ganapathysubramanian, B., & Hegde, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01626 · Cited by 29
Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methods
Fioretto, F., Mak, T. W. K., & Van Hentenryck, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5403 · Cited by 29
Weakly-Supervised Deep Learning of Heat Transport via Physics Informed LossPreprint
Sharma, R., Farimani, A. B., Gomes, J., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11374 · Cited by 28
Bringing automated, remote‐sensed, machine learning methods to monitoring crop landscapes at scale
Jia, X., Khandelwal, A., MULLA, D. J., Pardey, P. G., & Kumar, V. (2019) · Agricultural Economics · doi:10.1111/agec.12531 · Cited by 27
Self-citationObstacle segmentation based on the wave equation and deep learning
Kahana, A., Turkel, E., Dekel, S., et al. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109458 · Cited by 27
Data-driven components in a model of inner-shelf sorted bedforms: a new hybrid model
Goldstein, E. B., Coco, G., Murray, A. B., & Green, M. O. (2014) · Earth Surface Dynamics · doi:10.5194/esurf-2-67-2014 · Cited by 26
Physics-Informed Echo State Networks for Chaotic Systems Forecasting
Doan, N. A. K., Polifke, W., & Magri, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22747-0_15 · Cited by 26
Luo, L., Yao, Y., & Gao, F. (2015) · Chemical Engineering Science · doi:10.1016/j.ces.2015.04.045 · Cited by 24
Feedback Control of Karman Vortex Shedding from a Cylinder using Deep Reinforcement Learning
Koizumi, H., Tsutsumi, S., & Shima, E. (2018) · AIAA Flow Control Conference · doi:10.2514/6.2018-3691 · Cited by 24
First-principles machine learning modelling of COVID-19Preprint
Magri, L., & Doan, N. A. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.09478 · Cited by 23
CIRA Guide to Custom Loss Functions for Neural Networks in Environmental Sciences -- Version 1Preprint
Ebert‐Uphoff, I., Lagerquist, R., Hilburn, K., Lee, Y., Haynes, K., Stock, J., Kumler, C., & Stewart, J. Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09757 · Cited by 22
Physics-Informed Machine Learning for DRAM Error Modeling
Baseman, E., DeBardeleben, N., Blanchard, S. P., Moore, J., Tkachenko, O., Ferreira, K. B., Siddiqua, T., & Sridharan, V. (2018) · Proceedings · doi:10.1109/dft.2018.8602983 · Cited by 19
A Domain Guided CNN Architecture for Predicting Age from Structural Brain ImagesPreprint
Sturmfels, P., Rutherford, S. E., Angstadt, M., Peterson, M., Sripada, C., & Wiens, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04362 · Cited by 18
Physics-Informed Neural Networks for Bias Compensation in Corrosion-Fatigue
Dourado, A. D. P., & Viana, F. A. C. (2020) · AIAA SciTech Forum · doi:10.2514/6.2020-1149 · Cited by 18
Li, H., & Weng, Y. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467448 · Cited by 18
Zeng, Y., Wu, J., & Xiao, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.06671 · Cited by 15
Multi-output Local Gaussian Process Regression: Applications to Uncertainty Quantification
Bilionis, I., & Zabaras, N. J. (2011) · Defense Technical Information Center (DTIC) · doi:10.21236/ada554929 · Cited by 15
Mu, B., Qin, B., Yuan, S., et al. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/7897824 · Cited by 14
Jia, X., Lin, B., Zwart, J. A., Sadler, J. M., Appling, A., Oliver, S. K., & Read, J. S. (2021) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976700.70 · Cited by 11
Self-citationPhysics-based Neural Networks for Shape from Polarization.Preprint
Ba, Y., Chen, R., Wang, Y., et al. (2019) · arXiv (Cornell University) · Cited by 10
Latent force models for earth observation time series prediction
Luengo, D., Campos‐Taberner, M., & Camps‐Valls, G. (2016) · IEEE International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2016.7738844 · Cited by 7
Wang, J.-X., Wu, J.-L., & Xiao, H. (2016) · arXiv · doi:10.48550/arxiv.1606.07987 · Cited by 1
Cited by
Applications of Physics-Informed Neural Networks in Power Systems - A Review
Huang, B., & Wang, J. (2023) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3162473 · Cited by 619
Deep learning for water quality
Zhi, W., Appling, A. P., Golden, H. E., Podgorski, J., & Li, L. (2024) · Nature Water · doi:10.1038/s44221-024-00202-z · Cited by 364
Zhu, L.-T., Chen, X.-Z., Ouyang, B., Yan, W.-C., Lei, H., Chen, Z., & Luo, Z.-H. (2022) · Industrial & Engineering Chemistry Research · doi:10.1021/acs.iecr.2c01036 · Cited by 294
Combustion machine learning: Principles, progress and prospects
Ihme, M., Chung, W. T., & Mishra, A. A. (2022) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2022.101010 · Cited by 265
Assessing the Physical Realism of Deep Learning Hydrologic Model Projections Under Climate Change
Wi, S., & Steinschneider, S. (2022) · Water Resources Research · doi:10.1029/2022wr032123 · Cited by 137
Metadata
- Authors
- Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V.
- Venue
- ACM Computing Surveys
- Published
- 2022-11-21
- Volume
- 55
- Issue
- 4
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3185585276
- Cited by
- 878
- References
- 285
- FWCI
- 50.09
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.