The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Abstract
We present the application of a class of deep learning, known as Physics Informed Neural Networks (PINN), to inversion and surrogate modeling in solid mechanics. We explain how to incorporate the momentum balance and constitutive relations into PINN, and explore in detail the application to linear elasticity, and illustrate its extension to nonlinear problems through an example that showcases von Mises elastoplasticity. While common PINN algorithms are based on training one deep neural network (DNN), we propose a multi-network model that results in more accurate representation of the field variables. To validate the model, we test the framework on synthetic data generated from analytical and numerical reference solutions. We study convergence of the PINN model, and show that Isogeometric Analysis (IGA) results in superior accuracy and convergence characteristics compared with classic low-order Finite Element Method (FEM). We also show the applicability of the framework for transfer learning, and find vastly accelerated convergence during network re-training. Finally, we find that honoring the physics leads to improved robustness: when trained only on a few parameters, we find that the PINN model can accurately predict the solution for a wide range of parameters new to the network—thus pointing to an important application of this framework to sensitivity analysis and surrogate modeling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384 · cited 4×
“In the original work on PINN [22], approach (1) was used to train the model, where datasets are generated n random space discretizations at each epoch.”
BackgroundMethodInfluentialSelf-citationTensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2016) · Cited by 11,679
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
(2010) · Cited by 8,261
Isogeometric analysis: CAD, finite elements, NURBS, exact geometry and mesh refinement
Hughes, T. J. R., Cottrell, J. A., & Bazilevs, Y. (2005) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2004.10.008 · Cited by 6,335
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063 · cited 1×
“In engineering and science, ANNs have been applied to a arge number of areas, including geosciences [4–8], material science [9–12], fluid mechanics [13,14], genetics [15], nd infrastructure health monitoring [16,17], to name a few examples.”
MethodBarto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
Simo, J. C., & Hughes, T. J. R. (1998) · Springer eBooks · doi:10.1007/b98904 · Cited by 2,425
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Machine learning applications in genetics and genomics
Libbrecht, M. W., & Noble, W. S. (2015) · Nature Reviews Genetics · doi:10.1038/nrg3920 · Cited by 2,084
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
On the Spectral Bias of Neural NetworksPreprint
Rahaman, N., Baratin, A., Arpit, D., Draxler, F., Lin, M., Hamprecht, F. A., Bengio, Y., & Courville, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.08734 · Cited by 1,915
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
Transfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,488
Machine learning for data-driven discovery in solid Earth geoscience
Bergen, K. J., Johnson, P. A., de Hoop, M. V., & Beroza, G. C. (2019) · Science · doi:10.1126/science.aau0323 · Cited by 1,249
D. Jagtap, A., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0164 · Cited by 1,130
Theano: A CPU and GPU Math Compiler in Python
Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., & Bengio, Y. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-003 · Cited by 1,052
Zhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,030
Erratum: Competition among memes in a world with limited attention
Weng, L., Flammini, A., Vespignani, A., & Menczer, F. (2013) · Scientific Reports · doi:10.1038/srep02304 · Cited by 1,002
Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Accelerating materials property predictions using machine learning
Pilania, G., Wang, C., Jiang, X., Rajasekaran, S., & Ramprasad, R. (2013) · Scientific Reports · doi:10.1038/srep02810 · Cited by 853
Wang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
Reinforcement Learning: State-of-the-Art
(2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3 · Cited by 691
Deep learning predicts path-dependent plasticity
Mozaffar, M., Bostanabad, R., Chen, W., Ehmann, K., Cao, J., & Bessa, M. A. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911815116 · Cited by 634
Don't Decay the Learning Rate, Increase the Batch Size
Smith, S. L., Kindermans, P.-J., Ying, C., & Le, Q. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00489 · Cited by 559
Learning data-driven discretizations for partial differential equations
Bar-Sinai, Y., Hoyer, S., Hickey, J., & Brenner, M. P. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1814058116 · Cited by 543
Neural-network methods for boundary value problems with irregular boundaries
Lagaris, I. E., Likas, A. C., & Papageorgiou, D. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870037 · Cited by 521
Machine Learning in Seismology: Turning Data into Insights
Kong, Q., Trugman, D. T., Ross, Z. E., Bianco, M. J., Meade, B. J., & Gerstoft, P. (2019) · Seismological Research Letters · doi:10.1785/0220180259 · Cited by 498
Haghighat, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113552 · Cited by 425
Self-citationLange, S., Gabel, T., & Riedmiller, M. (2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3_2 · Cited by 370
Deep learning of aftershock patterns following large earthquakes
DeVries, P. M. R., Viégas, F. B., WATTENBERG, M. P., & Meade, B. J. (2018) · Nature · doi:10.1038/s41586-018-0438-y · Cited by 352
A novel machine learning‐based algorithm to detect damage in high‐rise building structures
Rafiei, M. H., & Adeli, H. (2017) · The Structural Design of Tall and Special Buildings · doi:10.1002/tal.1400 · Cited by 346
Earthquake detection through computationally efficient similarity search
Yoon, C. E., O’Reilly, O., Bergen, K. J., & Beroza, G. C. (2015) · Science Advances · doi:10.1126/sciadv.1501057 · Cited by 342
Data-Driven Identification of Parametric Partial Differential Equations
Rudy, S., Alla, A., Brunton, S. L., & Kutz, J. N. (2019) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/18m1191944 · Cited by 301
Perspective on machine learning for advancing fluid mechanics
Brenner, M. P., Eldredge, J. D., & Freund, J. B. (2019) · Physical Review Fluids · doi:10.1103/physrevfluids.4.100501 · Cited by 292
The numerical solution of linear ordinary differential equations by feedforward neural networks
Meade, A. J., & Fernandez, A. A. (1994) · Mathematical and Computer Modelling · doi:10.1016/0895-7177(94)90095-7 · Cited by 256
Microstructure informatics using higher-order statistics and efficient data-mining protocols
Kalidindi, S. R., Niezgoda, S. R., & Salem, A. A. (2011) · JOM · doi:10.1007/s11837-011-0057-7 · Cited by 178
Understanding and mitigating gradient pathologies in physics-informed neural networks
Wang, S., Teng, Y., & Perdikaris, P. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04536 · Cited by 176
A nonlocal physics-informed deep learning framework using the peridynamic differential operator
Haghighat, E., Bekar, A. C., Madenci, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114012 · Cited by 156
Self-citationDeep elastic strain engineering of bandgap through machine learning
Shi, Z., Tsymbalov, E., Dao, M., Suresh, S., Shapeev, A. V., & Li, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1818555116 · Cited by 134
Methods for data-driven multiscale model discovery for materials
Brunton, S. L., & Kutz, J. N. (2019) · Journal of Physics Materials · doi:10.1088/2515-7639/ab291e · Cited by 91
Cited by
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Self-citationAlzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Physics‐Informed Neural Networks (PINNs) for Wave Propagation and Full Waveform Inversions
Rasht‐Behesht, M., Huber, C., Shukla, K., & Karniadakis, G. E. (2022) · Journal of Geophysical Research: Solid Earth · doi:10.1029/2021jb023120 · Cited by 461
A comprehensive review of digital twin — part 1: modeling and twinning enabling technologies
Thelen, A., Zhang, X., Fink, O., Lu, Y., Ghosh, S., Youn, B. D., Todd, M. D., Mahadevan, S., Hu, C., & Hu, Z. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-022-03425-4 · Cited by 441
A physics-informed variational DeepONet for predicting crack path in quasi-brittle materials
Goswami, S., Yin, M., Yu, Y., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114587 · Cited by 425
Metadata
- Authors
- Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R.
- Venue
- Computer Methods in Applied Mechanics and Engineering
- Publisher
- Elsevier BV
- Published
- 2021-06
- Volume
- 379
- Pages
- 113741
- ISSN
- 0045-7825 (ISSN-L)
- OpenAlex
- W3137392741
- Cited by
- 1,305
- References
- 49
- FWCI
- 59.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.