The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Machine learning for metal additive manufacturing: predicting temperature and melt pool fluid dynamics using physics-informed neural networks
Open accessAbstract
The recent explosion of machine learning (ML) and artificial intelligence (AI) shows great potential in the breakthrough of metal additive manufacturing (AM) process modeling, which is an indispensable step to derive the process-structure-property relationship. However, the success of conventional machine learning tools in data science is primarily attributed to the unprecedented large amount of labeled data-sets (big data), which can be either obtained by experiments or first-principle simulations. Unfortunately, these labeled data-sets are expensive to obtain in AM due to the high expense of the AM experiments and prohibitive computational cost of high-fidelity simulations, hindering the direct applications of big-data based ML tools to metal AM problems. To fully exploit the power of machine learning for metal AM while alleviating the dependence on “big data”, we put forth a physics-informed neural network (PINN) framework that fuses both data and first physical principles, including conservation laws of momentum, mass, and energy, into the neural network to inform the learning processes. To the best knowledge of the authors, this is the first application of physics-informed deep learning to three dimensional AM processes modeling. Besides, we propose a hard-type approach for Dirichlet boundary conditions (BCs) based on a Heaviside function, which can not only exactly enforce the BCs but also accelerate the learning process. The PINN framework is applied to two representative metal manufacturing problems, including the 2018 NIST AM-Benchmark test series. We carefully assess the performance of the PINN model by comparing the predictions with available experimental data and high-fidelity simulation results, using finite element based variational multi-scale formulation method. The investigations show that the PINN, owed to the additional physical knowledge, can accurately predict the temperature and melt pool dynamics during metal AM processes with only a moderate amount of labeled data-sets. The foray of PINN to metal AM shows the great potential of physics-informed deep learning for broader applications to advanced manufacturing. All the data-sets and the PINN code will be made open-sourced in https://yan.cee.illinois.edu/ once the paper is published.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Ror2 signaling regulates Golgi structure and transport through IFT20 for tumor invasiveness
Nishita, M., Park, S.-Y., Nishio, T., Kamizaki, K., Wang, Z., Tamada, K., Takumi, T., Hashimoto, R., Otani, H., Pazour, G. J., et al. (2017) · Scientific Reports · doi:10.1038/s41598-016-0028-x · Cited by 15,947
GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
Saad, Y., & Schultz, M. H. (1986) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0907058 · Cited by 11,154
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“Some typical neural network architectures are fully connected neural network (FC-NN) [61], convolutional neural network (CNN) [62], and recurrent neural network (RNN) [63], which have been successfully used in a variety of machine learning applications, such as system identification and control, signal classification,…”
MethodAn overview of gradient descent optimization algorithms
Ruder, S. (2016) · arXiv · doi:10.48550/arxiv.1609.04747 · Cited by 4,962
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
Face recognition: a convolutional neural-network approach
Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092
Khairallah, S. A., Anderson, A. T., Rubenchik, A., & King, W. E. (2016) · Acta Materialia · doi:10.1016/j.actamat.2016.02.014 · Cited by 2,766
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction
Choy, C. B., Xu, D., Gwak, J., Chen, K., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_38 · Cited by 1,632
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Cernocky, J., & Khudanpur, S. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947611 · Cited by 1,568
Keyhole threshold and morphology in laser melting revealed by ultrahigh-speed x-ray imaging
Cunningham, R., Zhao, C., Parab, N., Kantzos, C., Pauza, J., Fezzaa, K., Sun, T., & Rollett, A. D. (2019) · Science · doi:10.1126/science.aav4687 · Cited by 1,066
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Theano: new features and speed improvements
Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005 · cited 2×
“Nowadays, these approaches are coined as scientific machine learning (SciML) in the computational mathematics/mechanics communities.”
BackgroundArtificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10561 · Cited by 925
Stabilized Finite Element Formulations for Incompressible Flow Computations
Tezduyar, T. E. (1991) · Advances in Applied Mechanics · doi:10.1016/s0065-2156(08)70153-4 · Cited by 913
Zhao, C., Fezzaa, K., Cunningham, R. W., Wen, H., De Carlo, F., Chen, L., Rollett, A. D., & Sun, T. (2017) · Scientific Reports · doi:10.1038/s41598-017-03761-2 · Cited by 758
Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112623 · Cited by 647
Machine learning of linear differential equations using Gaussian processes
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.07.050 · Cited by 584
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P., Tartakovsky, G. D., & Barajas‐Solano, D. (2020) · Water Resources Research · doi:10.1029/2019wr026731 · Cited by 515
Controlling interdependent meso-nanosecond dynamics and defect generation in metal 3D printing
Khairallah, S. A., Martin, A. A., Lee, J. R. I., Guss, G., Calta, N. P., Hammons, J. A., Nielsen, M. H., Chaput, K., Schwalbach, E., Shah, M. N., et al. (2020) · Science · doi:10.1126/science.aay7830 · Cited by 506
Generalized Mechanism of Field Emission from Nanostructured Semiconductor Film Cathodes
Wang, R.-Z., Zhao, W., & Yan, H. (2017) · Scientific Reports · doi:10.1038/srep43625 · Cited by 489
Liu, Z., Bessa, M. A., & Liu, W. K. (2016) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2016.04.004 · Cited by 463
Self-citationMesoscopic simulation of selective beam melting processes
Körner, C., Attar, E., & Heinl, P. (2011) · Journal of Materials Processing Technology · doi:10.1016/j.jmatprotec.2010.12.016 · Cited by 450
Building blocks for a digital twin of additive manufacturing
Knapp, G. L., Mukherjee, T., Zuback, J. S., Wei, H. L., Palmer, T. A., De, A., & DebRoy, T. (2017) · Acta Materialia · doi:10.1016/j.actamat.2017.06.039 · Cited by 414
He, Q., Barajas-Solano, D., Tartakovsky, G., & Tartakovsky, A. M. (2020) · Advances in Water Resources · doi:10.1016/j.advwatres.2020.103610 · Cited by 385
Extraction of mechanical properties of materials through deep learning from instrumented indentation
Lu, L., Dao, M., Kumar, P., Ramamurty, U., Karniadakis, G. E., & Suresh, S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1922210117 · Cited by 352
Fundamental consolidation mechanisms during selective beam melting of powders
Körner, C., Bauereiß, A., & Attar, E. (2013) · Modelling and Simulation in Materials Science and Engineering · doi:10.1088/0965-0393/21/8/085011 · Cited by 323
Liu, Z., Wu, C. T., & Koishi, M. (2019) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.09.020 · Cited by 319
Self-citationMultiscale space–time fluid–structure interaction techniques
Takizawa, K., & Tezduyar, T. E. (2011) · Computational Mechanics · doi:10.1007/s00466-011-0571-z · Cited by 283
Mukherjee, T., Wei, H. L., De, A., & DebRoy, T. (2018) · Computational Materials Science · doi:10.1016/j.commatsci.2018.04.027 · Cited by 259
Yan, W., Lin, S., Kafka, O. L., Lian, Y., Yu, C., Liu, Z., Yan, J., Wolff, S., Wu, H., Ndip-Agbor, E., et al. (2018) · Computational Mechanics · doi:10.1007/s00466-018-1539-z · Cited by 252
Self-citationFully Connected Deep Structured Networks
Schwing, A. G., & Urtasun, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.02351 · Cited by 230
Spattering and denudation in laser powder bed fusion process: Multiphase flow modelling
Chen, H., & Yan, W. (2020) · Acta Materialia · doi:10.1016/j.actamat.2020.06.033 · Cited by 206
Exploring the 3D architectures of deep material network in data-driven multiscale mechanics
Liu, Z., & Wu, C. T. (2019) · Journal of the Mechanics and Physics of Solids · doi:10.1016/j.jmps.2019.03.004 · Cited by 197
Self-citationTakizawa, K., Bazilevs, Y., & Tezduyar, T. E. (2012) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-012-9071-3 · Cited by 193
Lung sound classification using cepstral-based statistical features
Sengupta, N., Sahidullah, M., & Saha, G. (2016) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2016.05.013 · Cited by 187
Liu, Z., Fleming, M., & Liu, W. K. (2018) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2017.11.005 · Cited by 181
Self-citationMulti-scale modeling of electron beam melting of functionally graded materials
Yan, W., Ge, W., Smith, J. W., Lin, S., Kafka, O. L., Lin, F., & Liu, W. K. (2016) · Acta Materialia · doi:10.1016/j.actamat.2016.06.022 · Cited by 155
Why Deep Neural Networks for Function Approximation
Liang, S., & Srikant, R. (2016) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 144
Mechanism of alloying element vaporization during laser welding
Collur, M. M., Paul, A. J., & DebRoy, T. (1987) · Metallurgical Transactions B · doi:10.1007/bf02672891 · Cited by 127
Is it Time to Swish? Comparing Deep Learning Activation Functions Across NLP tasks
Eger, S., Youssef, P., & Gurevych, I. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1472 · Cited by 121
Measurements of Melt Pool Geometry and Cooling Rates of Individual Laser Traces on IN625 Bare Plates
Lane, B. M., Heigel, J. C., Ricker, R. E., Zhirnov, I. V., Khromschenko, V., Weaver, J. S., Phan, T. Q., Stoudt, M. R., Mekhontsev, S. N., & Levine, L. E. (2020) · Integrating materials and manufacturing innovation · doi:10.1007/s40192-020-00169-1 · Cited by 117
Lattice Boltzmann model for thermal free surface flows with liquid–solid phase transition
Attar, E., & Körner, C. (2010) · International Journal of Heat and Fluid Flow · doi:10.1016/j.ijheatfluidflow.2010.09.006 · Cited by 100
A physics-constrained data-driven approach based on locally convex reconstruction for noisy database
He, Q., & Chen, J. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112791 · Cited by 95
Yang, X., Barajas‐Solano, D. A., Tartakovsky, G., & Tartakovsky, A. M. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.06.041 · Cited by 92
Khan, P. A. A., & DebRoy, T. (1984) · Metallurgical Transactions B · doi:10.1007/bf02657284 · Cited by 86
A cloud based architecture capable of perceiving and predicting multiple vessel behaviour
Zissis, D., Xidias, E. K., & Lekkas, D. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.07.002 · Cited by 79
The actuator line method for wind turbine modelling applied in a variational multiscale framework
Ravensbergen, M., Mohamed, A. B., & Korobenko, A. (2020) · Computers & Fluids · doi:10.1016/j.compfluid.2020.104465 · Cited by 75
A variational multiscale stabilized formulation for the incompressible Navier–Stokes equations
Masud, A., & Calderer, R. (2009) · Computational Mechanics · doi:10.1007/s00466-008-0362-3 · Cited by 63
Ravensbergen, M., Helgedagsrud, T. A., Bazilevs, Y., & Korobenko, A. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113182 · Cited by 54
Performance analysis of two vertical-axis hydrokinetic turbines using variational multiscale method
Mohamed, A. B., Bear, C., Bear, M., & Korobenko, A. (2020) · Computers & Fluids · doi:10.1016/j.compfluid.2020.104432 · Cited by 49
Variational multiscale framework for cavitating flows
Bayram, A., & Korobenko, A. (2020) · Computational Mechanics · doi:10.1007/s00466-020-01840-2 · Cited by 40
Kozak, N., Rajanna, M. R., Wu, M., Murugan, M., Bravo, L. G., Ghoshal, A., Hsu, M., & Bazilevs, Y. (2020) · Energies · doi:10.3390/en13174283 · Cited by 35
Interface-Capturing Method for Free-Surface Plunging and Breaking Waves
Zhu, L., Goraya, S. A., & Masud, A. (2019) · Journal of Engineering Mechanics · doi:10.1061/(asce)em.1943-7889.0001641 · Cited by 23
Cited by
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Yuan, L., Ni, Y.-Q., Deng, X.-Y., & Hao, S. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111260 · Cited by 422
Research and application of machine learning for additive manufacturing
Qin, J., Hu, F., Liu, Y., Witherell, P., Wang, C. C. L., Rosen, D. W., Simpson, T. W., Lu, Y., & Tang, Q. (2022) · Additive Manufacturing · doi:10.1016/j.addma.2022.102691 · Cited by 391
Machine learning for metal additive manufacturing: Towards a physics-informed data-driven paradigm
Guo, S., Agarwal, M., Cooper, C., Tian, Q., Gao, R. X., Guo, W., & Guo, Y. B. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.11.003 · Cited by 309
Understanding Physics-Informed Neural Networks: Techniques, Applications, Trends, and Challenges
Farea, A., Yli-Harja, O., & Emmert-Streib, F. (2024) · AI · doi:10.3390/ai5030074 · Cited by 259
Metadata
- Authors
- Zhu, Q., Liu, Z., & Yan, J.
- Venue
- Computational Mechanics
- Published
- 2021-01-06
- Volume
- 67
- Issue
- 2
- Pages
- 619-635
- ISSN
- 0178-7675 (ISSN-L)
- 1432-0924
- OpenAlex
- W3119602513
- Cited by
- 497
- References
- 64
- FWCI
- 29.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.