The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
Open accessAbstract
Recently, a class of machine learning methods called physics-informed neural networks (PINNs) has been proposed and gained prevalence in solving various scientific computing problems. This approach enables the solution of partial differential equations (PDEs) via embedding physical laws into the loss function. Many inverse problems can be tackled by simply combining the data from real life scenarios with existing PINN algorithms. In this paper, we present a multi-task learning method using uncertainty weighting to improve the training efficiency and accuracy of PINNs for inverse problems in linear elasticity and hyperelasticity. Furthermore, we demonstrate an application of PINNs to a practical inverse problem in structural analysis: prediction of external loads of diverse engineering structures based on limited displacement monitoring points. To this end, we first determine a simplified loading scenario at the offline stage. By setting unknown boundary conditions as learnable parameters, PINNs can predict the external loads with the support of measured data. When it comes to the online stage in real engineering projects, transfer learning is employed to fine-tune the pre-trained model from offline stage. Our results show that, even with noisy gappy data, satisfactory results can still be obtained from the PINN model due to the dual regularization of physics laws and prior knowledge, which exhibits better robustness compared to traditional analysis methods. Our approach is capable of bridging the gap between various structures with geometric scaling and under different loading scenarios, and the convergence of training is also greatly accelerated through not only the layer freezing but also the multi-task weight inheritance from pre-trained models, thus making it possible to be applied as surrogate models in actual engineering projects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718 · cited 2×
“It is worth noting that PINNs are capable of dealing with physical systems with data collected from a limited number of sensors [30].”
BackgroundLearning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063 · cited 1×
“…number of applications of machine learning has been witnessed in the field of computational mechanics and engineering, e.g. fluid mechanics [2, 3, 4], molecular dynamics [5, 6, 7, 8], learning constitutive laws [9, 10, 11, 12], solving fracture problems [13, 14], material property prediction…”
BackgroundScientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Deep Potential Molecular Dynamics: A Scalable Model with the Accuracy of Quantum Mechanics
Zhang, L., Han, J., Wang, H., Car, R., & E, W. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.143001 · Cited by 2,258
Samaniego, E., Anitescu, C., Goswami, S., Nguyen-Thanh, V. M., Guo, H., Hamdia, K., Zhuang, X., & Rabczuk, T. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112790 · Cited by 2,104
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
Turbulence Modeling in the Age of Data
Duraisamy, K., Iaccarino, G., & Xiao, H. (2019) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010518-040547 · Cited by 1,508
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Jin, X., Cai, S., Li, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109951 · Cited by 1,210
Jagtap, A. D., Kharazmi, E., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113028 · Cited by 1,208
Yang, L., Meng, X., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109913 · Cited by 1,169
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Jagtap, A. D., Kawaguchi, K., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109136 · Cited by 1,127
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Machine learning–accelerated computational fluid dynamics
Kochkov, D., Smith, J. A., Alieva, A., Wang, Q., Brenner, M. P., & Hoyer, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101784118 · Cited by 1,042
Fourier Neural Operator for Parametric Partial Differential Equations
Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., & Anandkumar, A. (2020) · arXiv · doi:10.48550/arxiv.2010.08895 · Cited by 1,021
Transfer learning enhanced physics informed neural network for phase-field modeling of fracture
Goswami, S., Anitescu, C., Chakraborty, S., & Rabczuk, T. (2020) · Theoretical and Applied Fracture Mechanics · doi:10.1016/j.tafmec.2019.102447 · Cited by 900
hp-VPINNs: Variational physics-informed neural networks with domain decomposition
Kharazmi, E., Zhang, Z., & Karniadakis, G. E. M. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113547 · Cited by 818
Gradient Surgery for Multi-Task Learning
Yu, T., Kumar, S., Gupta, A., Levine, S., Hausman, K., & Finn, C. (2020) · arXiv · doi:10.48550/arxiv.2001.06782 · Cited by 755 · cited 1×
“• Gradient Surgery (PCGrad) [76, 77]: Different loss terms may have conflicting gradient directions, which can lead to destructive interference.”
BackgroundGradient-enhanced physics-informed neural networks for forward and inverse PDE problems
Yu, J., Lu, L., Meng, X., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114823 · Cited by 722
Physics-informed neural networks for inverse problems in nano-optics and metamaterials
Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020) · Optics Express · doi:10.1364/oe.384875 · Cited by 701
Wang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
SUPERB: Speech Processing Universal PERformance Benchmark
Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., et al. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1775 · Cited by 681
PPINN: Parareal physics-informed neural network for time-dependent PDEs
Meng, X., Li, Z., Zhang, D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113250 · Cited by 654
Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112623 · Cited by 647
Deep learning predicts path-dependent plasticity
Mozaffar, M., Bostanabad, R., Chen, W., Ehmann, K., Cao, J., & Bessa, M. A. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911815116 · Cited by 634
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Bessa, M. A., Bostanabad, R., Liu, Z., Hu, A., Apley, D. W., Brinson, C., Chen, W., & Liu, W. K. (2017) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2017.03.037 · Cited by 573
IEEE International Conference on Neural Networks
(1993) · doi:10.1109/icnn.1993 · Cited by 550
PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network
Long, Z., Lu, Y., & Dong, B. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108925 · Cited by 549
Physics-informed multi-LSTM networks for metamodeling of nonlinear structures
Zhang, R., Liu, Y., & Sun, H. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113226 · Cited by 504
Zhu, Q., Liu, Z., & Yan, J. (2021) · Computational Mechanics · doi:10.1007/s00466-020-01952-9 · Cited by 497
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations
Yang, L., Zhang, D., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/18m1225409 · Cited by 482
Liu, Z., Bessa, M. A., & Liu, W. K. (2016) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2016.04.004 · Cited by 463
The Role of Machine Learning in the Understanding and Design of Materials
Moosavi, S. M., Jablonka, K. M., & Smit, B. (2020) · Journal of the American Chemical Society · doi:10.1021/jacs.0c09105 · Cited by 433
Gao, H., Zahr, M. J., & Wang, J. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114502 · Cited by 427
Sukumar, N., & Srivastava, A. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114333 · Cited by 426
Haghighat, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113552 · Cited by 425
Analyses of internal structures and defects in materials using physics-informed neural networks
Zhang, E., Dao, M., Karniadakis, G. E., & Suresh, S. (2022) · Science Advances · doi:10.1126/sciadv.abk0644 · Cited by 393
Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315128 · Cited by 374
Chiu, P.-H., Wong, J. C., Ooi, C., Dao, M. H., & Ong, Y.-S. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114909 · Cited by 366
Moseley, B., Markham, A., & Nissen-Meyer, T. (2023) · Advances in Computational Mathematics · doi:10.1007/s10444-023-10065-9 · Cited by 360
Extraction of mechanical properties of materials through deep learning from instrumented indentation
Lu, L., Dao, M., Kumar, P., Ramamurty, U., Karniadakis, G. E., & Suresh, S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1922210117 · Cited by 352
Wang, K., & Sun, W. (2018) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.01.036 · Cited by 335
A deep energy method for finite deformation hyperelasticity
Nguyen-Thanh, V. M., Zhuang, X., & Rabczuk, T. (2020) · European Journal of Mechanics - A/Solids · doi:10.1016/j.euromechsol.2019.103874 · Cited by 334
Efficient training of physics‐informed neural networks via importance sampling
Nabian, M. A., Gladstone, R. J., & Meidani, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12685 · Cited by 330
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
Liu, A. T., Li, S.-W., & Lee, H.-Y. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3095662 · Cited by 312
Amini Niaki, S., Haghighat, E., Campbell, T., Poursartip, A., & Vaziri, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113959 · Cited by 311
Li, X., Liu, Z., Cui, S., Luo, C., Li, C., & Zhuang, Z. (2019) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.01.005 · Cited by 301
A machine learning approach to fracture mechanics problems
Liu, X., Athanasiou, C. E., Padture, N. P., Sheldon, B. W., & Gao, H. (2020) · Acta Materialia · doi:10.1016/j.actamat.2020.03.016 · Cited by 254
Li, W., Bazant, M. Z., & Zhu, J. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113933 · Cited by 242
Transfer learning based multi-fidelity physics informed deep neural network
Chakraborty, S. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109942 · Cited by 236
Physics informed neural networks for continuum micromechanics
Henkes, A., Wessels, H., & Mahnken, R. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114790 · Cited by 236
Rezaei, S., Harandi, A., Moeineddin, A., Xu, B.-X., & Reese, S. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115616 · Cited by 214
Pang, G., D’Elia, M., Parks, M., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109760 · Cited by 211
Smart constitutive laws: Inelastic homogenization through machine learning
Logarzo, H. J., Capuano, G., & Rimoli, J. J. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113482 · Cited by 192
Bayesian Physics Informed Neural Networks for real-world nonlinear dynamical systems
Linka, K., Schäfer, A., Meng, X., Zou, Z., Karniadakis, G. E., & Kuhl, E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115346 · Cited by 186
Saha, S., Gan, Z., Cheng, L., Gao, J., Kafka, O. L., Xie, X., Li, H., Tajdari, M., Kim, H. A., & Liu, W. K. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113452 · Cited by 182
Learning constitutive relations from indirect observations using deep neural networks
Huang, D. Z., Xu, K., Farhat, C., & Darve, E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109491 · Cited by 178
Using Deep Learning to Predict Fracture Patterns in Crystalline Solids
Hsu, Y.-C., Yu, C.-H., & Buehler, M. J. (2020) · Matter · doi:10.1016/j.matt.2020.04.019 · Cited by 178
Wessels, H., Weißenfels, C., & Wriggers, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113127 · Cited by 171
Haghighat, E., Amini, D., & Juanes, R. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115141 · Cited by 170
Auxiliary Tasks in Multi-task Learning
Liebel, L., & Körner, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06334 · Cited by 169
The mixed Deep Energy Method for resolving concentration features in finite strain hyperelasticity
Fuhg, J. N., & Bouklas, N. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110839 · Cited by 168
Kashefi, A., & Mukerji, T. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111510 · Cited by 162
Chen, Y., Huang, D., Zhang, D., Zeng, J., Wang, N., Zhang, H., & Yan, J. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110624 · Cited by 161
A nonlocal physics-informed deep learning framework using the peridynamic differential operator
Haghighat, E., Bekar, A. C., Madenci, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114012 · Cited by 156
Wang, K., & Sun, W. (2018) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.11.026 · Cited by 136
Self-Adaptive Physics-Informed Neural Networks using a Soft Attention MechanismPreprint
McClenny, L. D., & Braga-Neto, U. (2020) · arXiv (Cornell University) · doi:10.1016/j.jcp.2022.111722 · Cited by 114
Freitag, S., Cao, B. T., Ninić, J., & Meschke, G. (2017) · Computers & Structures · doi:10.1016/j.compstruc.2017.03.020 · Cited by 107
Self-citationWang, N., Chang, H., & Zhang, D. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113492 · Cited by 91
Fernández, M., Rezaei, S., Mianroodi, J. R., Fritzen, F., & Reese, S. (2020) · Advanced Modeling and Simulation in Engineering Sciences · doi:10.1186/s40323-019-0138-7 · Cited by 75
Koeppe, A., Bamer, F., & Markert, B. A. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113088 · Cited by 74
A hybrid RNN-GPOD surrogate model for real-time settlement predictions in mechanised tunnelling
Cao, B. T., Freitag, S., & Meschke, G. (2016) · Advanced Modeling and Simulation in Engineering Sciences · doi:10.1186/s40323-016-0057-9 · Cited by 58
Self-citationBahmani, B., & Sun, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11496 · Cited by 31
Cited by
Hu, H., Qi, L., & Chao, X. (2024) · Thin-Walled Structures · doi:10.1016/j.tws.2024.112495 · Cited by 335
Metadata
- Authors
- Xu, C., Cao, B. T., Yuan, Y., & Meschke, G.
- Venue
- Computer Methods in Applied Mechanics and Engineering
- Publisher
- Elsevier BV
- Published
- 2023-02
- Volume
- 405
- Pages
- 115852
- ISSN
- 0045-7825 (ISSN-L)
- OpenAlex
- W4313531672
- Cited by
- 255
- References
- 86
- FWCI
- 17.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.