The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Self-adaptive loss balanced Physics-informed neural networks
Abstract
There have been several efforts to Physics-informed neural networks (PINNs) in the solution of the incompressible Navier-Stokes fluid. The loss function in PINNs is a weighted sum of multiple terms, including the mismatch in the observed velocity and pressure data, the boundary and initial constraints, as well as the residuals of the Navier-Stokes equations. In this paper, we observe that the weighted combination of competitive multiple loss functions plays a significant role in training PINNs effectively. We establish Gaussian probabilistic models to define the loss terms, where the noise collection describes the weight parameter for each loss term. We propose a self-adaptive loss function method, which automatically assigns the weights of losses by updating the noise parameters in each epoch based on the maximum likelihood estimation. Subsequently, we employ the self-adaptive loss balanced Physics-informed neural networks (lbPINNs) to solve the incompressible Navier-Stokes equations,\hspace{-1pt} including\hspace{-1pt} two-dimensional\hspace{-1pt} steady Kovasznay flow, two-dimensional unsteady cylinder wake, and three-dimensional unsteady Beltrami flow. Our results suggest that the accuracy of PINNs for effectively simulating complex incompressible flows is improved by adaptively appropriate weights in the loss terms. The outstanding adaptability of lbPINNs is not irrelevant to the initialization choice of noise parameters, which illustrates the robustness. The proposed method can also be employed in other problems where PINNs apply besides fluid problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
(2018) · doi:10.1109/cvpr40276.2018 · Cited by 4,737
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
Tancik, M., Srinivasan, P. P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Singhal, U., Ramamoorthi, R., Barron, J. T., & Ng, R. (2020) · arXiv · doi:10.48550/arxiv.2006.10739 · Cited by 1,459
Physics-informed neural networks for high-speed flows
Mao, Z., Jagtap, A. D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112789 · Cited by 1,282
Jin, X., Cai, S., Li, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109951 · Cited by 1,210
Jagtap, A. D., Kharazmi, E., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113028 · Cited by 1,208
D. Jagtap, A., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0164 · Cited by 1,130
fPINNs: Fractional Physics-Informed Neural Networks
Pang, G., Lu, L., & Karniadakis, G. E. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1229845 · Cited by 1,105
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Physics-informed neural networks for inverse problems in nano-optics and metamaterials
Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020) · Optics Express · doi:10.1364/oe.384875 · Cited by 701
Physics-Informed Neural Networks for Cardiac Activation Mapping
Sahli Costabal, F., Yang, Y., Perdikaris, P., Hurtado, D. E., & Kuhl, E. (2020) · Frontiers in Physics · doi:10.3389/fphy.2020.00042 · Cited by 410
Zhang, D., Guo, L., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1260141 · Cited by 308
Solving Allen-Cahn and Cahn-Hilliard Equations Using the Adaptive Physics Informed Neural Networks
L. Wight, C., & Zhao, J. (2021) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0086 · Cited by 294
Predictive large-eddy-simulation wall modeling via physics-informed neural networks
Yang, X. I. A., Zafar, S., Wang, J.-X., & Xiao, H. (2019) · Physical Review Fluids · doi:10.1103/physrevfluids.4.034602 · Cited by 286
Shin, Y., Darbon, J., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0193 · Cited by 284
Physics-constrained bayesian neural network for fluid flow reconstruction with sparse and noisy data
Sun, L., & Wang, J.-X. (2020) · Theoretical and Applied Mechanics Letters · doi:10.1016/j.taml.2020.01.031 · Cited by 223
Schiassi, E., Furfaro, R., Leake, C., De Florio, M., Johnston, H., & Mortari, D. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.06.015 · Cited by 205
Non-invasive inference of thrombus material properties with physics-informed neural networks
Yin, M., Zheng, X., Humphrey, J. D., & Karniadakis, G. E. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113603 · Cited by 186
A Dual-Dimer method for training physics-constrained neural networks with minimax architecture
Liu, D., & Wang, Y. (2021) · Neural Networks · doi:10.1016/j.neunet.2020.12.028 · Cited by 115
Dwivedi, V., Parashar, N., & Srinivasan, B. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.006 · Cited by 115
DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolation
Kim, J.-E., Lee, K., Lee, D., Jhin, S. Y., & Park, N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16992 · Cited by 103
Magnetostatics and micromagnetics with physics informed neural networks
Kovacs, A., Exl, L., Kornell, A., Fischbacher, J., Hovorka, M., Gusenbauer, M., Breth, L., Oezelt, H., Praetorius, D., Suess, D., et al. (2022) · Journal of Magnetism and Magnetic Materials · doi:10.1016/j.jmmm.2021.168951 · Cited by 83
A Physics-Informed Neural Network Framework for PDEs on 3D Surfaces: Time Independent Problems
Fang, Z., & Zhan, J. (2019) · IEEE Access · doi:10.1109/access.2019.2963390 · Cited by 60
Theodoridis, S. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-801522-3.00005-7 · Cited by 47
Self-Adaptive Physics-Informed Neural Networks using a Soft Attention MechanismPreprint
McClenny, L. D., & Braga-Neto, U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04544 · Cited by 42
Elhamod, M., Bu, J., Singh, C. N., Redell, M. D., Ghosh, A., Podolskiy, V. A., Lee, W., & Karpatne, A. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3530911 · Cited by 41
Hu, R., Zhou, S., Liu, Y., & Tang, Z. (2019) · Computational Intelligence and Neuroscience · doi:10.1155/2019/7560872 · Cited by 30
Ensemble echo network with deep architecture for time-series modeling
Hu, R., Tang, Z., Song, X., Luo, J., Wu, E. Q., & Chang, S. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05286-8 · Cited by 24
Optimally weighted loss functions for solving PDEs with Neural Networks
van der Meer, R., Oosterlee, C. W., & Borovykh, A. (2021) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2021.113887 · Cited by 24
DMMAN: A two-stage audio–visual fusion framework for sound separation and event localization
Hu, R., Zhou, S., Tang, Z. R., Chang, S., Huang, Q., Liu, Y., Han, W., & Wu, E. Q. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.10.003 · Cited by 23
Olivares, E., Ye, H., Herrero, A., Nia, B. A., Ren, Y., Donovan, R. P., & Flaviis, F. D. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.021 · Cited by 20
Cited by
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Wu, C., Zhu, M., Tan, Q., Kartha, Y., & Lu, L. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115671 · Cited by 723
Bai, J., Rabczuk, T., Gupta, A., Alzubaidi, L., & Gu, Y. (2023) · Computational Mechanics · doi:10.1007/s00466-022-02252-0 · Cited by 266
Lawal, Z. K., Yassin, H., Lai, D. T. C., & Che Idris, A. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6040140 · Cited by 263
Metadata
- Authors
- Xiang, Z., Peng, W., Liu, X., & Yao, W.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2022-07
- Volume
- 496
- Pages
- 11-34
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W4229015109
- Cited by
- 507
- References
- 37
- FWCI
- 32.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.