Machine-Learning Methods for Computational Science and Engineering
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
The re-kindled fascination in machine learning (ML), observed over the last few decades, has also percolated into natural sciences and engineering. ML algorithms are now used in scientific computing, as well as in data-mining and processing. In this paper, we provide a review of the state-of-the-art in ML for computational science and engineering. We discuss ways of using ML to speed up or improve the quality of simulation techniques such as computational fluid dynamics, molecular dynamics, and structural analysis. We explore the ability of ML to produce computationally efficient surrogate models of physical applications that circumvent the need for the more expensive simulation techniques entirely. We also discuss how ML can be used to process large amounts of data, using as examples many different scientific fields, such as engineering, medicine, astronomy and computing. Finally, we review how ML has been used to create more realistic and responsive virtual reality applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384 · cited 1×
“Automatic differentiation has been used over the last few years to solve supervised learning problems using ANNs that respect the laws of physics, given as partial differential equations [160–162].”
MethodLarge-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354 · cited 1×
“…clusters [232], identify gravitational lenses [233–236] and reconstruction of images [237] Video classification is yet another field that keeps improving along with advances in ML. Karpathy et al. [238] have used CNNs to classify sports-related videos found on YouTube into their corresponding sports.”
BackgroundGeneralized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces
Behler, J., & Parrinello, M. (2007) · Physical Review Letters · doi:10.1103/physrevlett.98.146401 · Cited by 5,010 · cited 1×
“ML algorithms, such as ANNs [22–25], or Gaussian processes (GP) [26,27], have been trained, using DFT simulations, to reconstruct more general and accurate Potential Energy Surfaces (PES).”
MethodDiscovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684 · cited 1×
“Considering the effort, cost, and time required to train ML algorithms such as DNNs, and, additionally, the potential environmental impact [284], we believe that a collective effort should aim at creating a centralized database of trained algorithms that can readily be used for similar problems.”
BackgroundGaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons
Bartók, A. P., Payne, M. C., Kondor, R., & Csányi, G. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.136403 · Cited by 3,242 · cited 1×
“ML algorithms, such as ANNs [22–25], or Gaussian processes (GP) [26,27], have been trained, using DFT simulations, to reconstruct more general and accurate Potential Energy Surfaces (PES).”
MethodPredicting the sequence specificities of DNA- and RNA-binding proteins by deep learning
Alipanahi, B., Delong, A., Weirauch, M. T., & Frey, B. J. (2015) · Nature Biotechnology · doi:10.1038/nbt.3300 · Cited by 2,873
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312 · cited 1×
“[93] predicted the ground state using non-linear ridge regression that takes as its input nuclear charges and atomic positions.”
MethodSolving the quantum many-body problem with artificial neural networks
Carleo, G., & Troyer, M. (2017) · Science · doi:10.1126/science.aag2302 · Cited by 2,215 · cited 1×
“More recently, a paper proposed a novel method for calculating the ground state and evolution of highly entangled, many-body, QM problems using ANNs [95].”
MethodDeep learning for computational biology
Angermueller, C., Pärnamaa, T., Parts, L., & Stegle, O. (2016) · Molecular Systems Biology · doi:10.15252/msb.20156651 · Cited by 1,473 · cited 1×
“While ANNs have been used in biology for many years [175], such techniques have become more prominent over the last decade [176,177].”
MethodLeveraging Digital Twin Technology in Model-Based Systems Engineering
Madni, A. M., Madni, C. C., & Lucero, S. D. (2019) · Systems · doi:10.3390/systems7010007 · Cited by 1,050 · cited 1×
“The virtual representation of identical real-life systems (i.e., oil-rig installations) and the incorporation of ML in such models for simulation and monitoring purposes is presented by Madni et al. [278].”
BackgroundHierarchical Feature Representation and Multimodal Fusion with Deep Learning for AD/MCI Diagnosis
Suk, H.-I., Lee, S.-W., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.077 · Cited by 968
Schneider, G. (2018) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2017.232 · Cited by 910 · cited 1×
“The increasing use of microfluidics in biomedical applications is also now being complemented with data-driven approaches to analyze the produced data [212,213].”
BackgroundWang, J.-X., Wu, J.-L., & Xiao, H. (2017) · Physical Review Fluids · doi:10.1103/physrevfluids.2.034603 · Cited by 737
Hautier, G., Fischer, C. C., Jain, A., Mueller, T., & Ceder, G. (2010) · Chemistry of Materials · doi:10.1021/cm100795d · Cited by 580 · cited 1×
“Hautier et al. [97] used Bayesian inference with a Dirichlet prior to identify new compounds and structures.”
MethodMachine learning molecular dynamics for the simulation of infrared spectra
Gastegger, M., Behler, J., & Marquetand, P. (2017) · Chemical Science · doi:10.1039/c7sc02267k · Cited by 556 · cited 1×
“ANNs have been used to simulate phase-change materials [32–35], make accurate predictions on the many phases of silicon [36] and describe the structural properties of amorphous silicon [37], as well as efficiently and accurately calculate infrared spectra of materials [38].”
MethodRobust Perron cluster analysis in conformation dynamics
Deuflhard, P., & Weber, M. (2005) · Linear Algebra and its Applications · doi:10.1016/j.laa.2004.10.026 · Cited by 506 · cited 1×
“More robust variants of PCCA have also been derived [173] which were subsequently used for clustering gene expression data with application in breast cancer research [174].”
MethodLung Nodule Classification Using Deep Features in CT Images
Kumar, D., Wong, A., & Clausi, D. A. (2015) · 2015 12th Conference on Computer and Robot Vision · doi:10.1109/crv.2015.25 · Cited by 398
Data mining and machine learning in astronomy
BALL, N. M., & BRUNNER, R. J. (2010) · International Journal of Modern Physics D · doi:10.1142/s0218271810017160 · Cited by 383
Visualizing big data with augmented and virtual reality: Challenges and research agenda
Olshannikova, E., Ometov, A., Koucheryavy, Y., & Olsson, T. (2015) · Journal of Big Data · doi:10.1186/s40537-015-0031-2 · Cited by 315 · cited 1×
“To this end, ML is enabling data visualization and simulation of complex systems in an immersive manner with the use of emerging technologies such as virtual reality (VR) and Augmented Reality (AR), as well as virtual and digital prototypes, environments, and models [260].”
MethodSalvatore, C., Cerasa, A., Castiglioni, I., Gallivanone, F., Augimeri, A., Lopez, M., Arabia, G., Morelli, M., Gilardi, M. C., & Quattrone, A. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.11.016 · Cited by 299
Teramoto, A., Tsukamoto, T., Kiriyama, Y., & Fujita, H. (2017) · BioMed Research International · doi:10.1155/2017/4067832 · Cited by 279
Fast automated analysis of strong gravitational lenses with convolutional neural networks
Hezaveh, Y. D., Levasseur, L. P., & Marshall, P. J. (2017) · Nature · doi:10.1038/nature23463 · Cited by 261
Star–galaxy classification using deep convolutional neural networks
Kim, E. J., & Brunner, R. J. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw2672 · Cited by 221
Wang, J.-X., Wu, J.-L., & Xiao, H. (2016) · arXiv · doi:10.48550/arxiv.1606.07987 · Cited by 1
Cited by
Stergiou, K., Ntakolia, C., Varytis, P., Koumoulos, E., Karlsson, P., & Moustakidis, S. (2023) · Computational Materials Science · doi:10.1016/j.commatsci.2023.112031 · Cited by 161
Enhancing Clinical Translation of Cancer Using Nanoinformatics
Soltani, M., Moradi Kashkooli, F., Souri, M., Zare Harofte, S., Harati, T., Khadem, A., Haeri Pour, M., & Raahemifar, K. (2021) · Cancers · doi:10.3390/cancers13102481 · Cited by 82
Reliable plagiarism detection system based on deep learning approaches
El-Rashidy, M. A., Mohamed, R. G., El-Fishawy, N. A., & Shouman, M. A. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07486-w · Cited by 28
“Machine learning algorithms are now used in scientific computing, as well as in data and text mining [13–17].”
Method
Metadata
- Authors
- Frank, M., Drikakis, D., & Charissis, V.
- Venue
- Computation
- Publisher
- MDPI AG
- Published
- 2020-03-03
- Volume
- 8
- Issue
- 1
- Pages
- 15
- ISSN
- 2079-3197 (ISSN-L)
- OpenAlex
- W3009386672
- Cited by
- 223
- References
- 25
- FWCI
- 11.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.