PreprintCited by 8Advanced Graph Neural NetworksGraph Theory and AlgorithmsModel Reduction and Neural Networks

The DOI matches its DataCite record.

Physics-Informed Graph Learning

Open access
Peng, Ciyuan, Xia, Feng, Saikrishna, Vidya, Liu, Huan·2022·arXiv

Abstract

An expeditious development of graph learning in recent years has found innumerable applications in several diversified fields. Of the main associated challenges are the volume and complexity of graph data. The graph learning models suffer from the inability to efficiently learn graph information. In order to indemnify this inefficacy, physics-informed graph learning (PIGL) is emerging. PIGL incorporates physics rules while performing graph learning, which has enormous benefits. This paper presents a systematic review of PIGL methods. We begin with introducing a unified framework of graph learning models followed by examining existing PIGL methods in relation to the unified framework. We also discuss several future challenges for PIGL. This survey paper is expected to stimulate innovative research and development activities pertaining to PIGL.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2202.10679

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 59

  1. F. Xia, K. Sun, S. Yu, A. Aziz, L. Wan, S. Pan, and H. Liu, "Graph learning: A survey," IEEE Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 109-127, 2021.
  2. F. Xia, J. Liu, H. Nie, Y. Fu, L. Wan, and X. Kong, "Random walks: A review of algorithms and applications," IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 4, no. 2, pp. 95-107, 2019.
  3. S. Wang, L. Hu, Y. Wang, X. He, Q. Z. Sheng, M. A. Orgun, L. Cao, F. Ricci, and P. S. Yu, "Graph learning based recommender systems: A review," arXiv preprint arXiv:2105.06339, 2021. · arXiv
  4. M. A. Chao, C. Kulkarni, K. Goebel, and O. Fink, "Fusing physics-based and deep learning models for prognostics," Reliability Engineering & System Safety, vol. 217, p. 107961, 2022.
  5. S. Yu, H. Huang, M. N. Dao, and F. Xia, "Graph augmentation learning," in Companion Proceedings of the Web Conference 2022, ser. WWW '22, 2022, p. 1063-1072.
  6. P. Wang, Y. Fu, Y. Zhou, K. Liu, X. Li, and K. A. Hua, "Exploiting mu- tual information for substructure-aware graph representation learning." in IJCAI, 2020, pp. 3415-3421.
  7. K. Sun, J. Liu, S. Yu, B. Xu, and F. Xia, "Graph force learning," in 2020 IEEE International Conference on Big Data (Big Data). IEEE, 2020, pp. 2987-2994.
  8. A. Grover and J. Leskovec, "node2vec: Scalable feature learning for networks," in Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, 2016, pp. 855- 864.
  9. R. Henderson, D.-A. Clevert, and F. Montanari, "Improving molecular graph neural network explainability with orthonormalization and induced sparsity," in International Conference on Machine Learning. PMLR, 2021, pp. 4203-4213.
  10. K. Yan, X. Chen, X. Zhou, Z. Yan, and J. Ma, "Physical model informed fault detection and diagnosis of air handling units based on transformer generative adversarial network," IEEE Transactions on Industrial Informatics, 2022.
  11. X. Jia, J. Zwart, J. Sadler, A. Appling, S. Oliver, S. Markstrom, J. Willard, S. Xu, M. Steinbach, J. Read et al., "Physics-guided recurrent graph model for predicting flow and temperature in river networks," in Proceedings of the 2021 SIAM International Conference on Data Mining (SDM). SIAM, 2021, pp. 612-620.
  12. W. Li and D. Deka, "Physics-informed graph learning for robust fault location in distribution systems," arXiv e-prints, pp. arXiv-2107, 2021.
  13. A. L. da Silva, F. Kocayusufoglu, S. Jafarpour, F. Bullo, A. Swami, and A. Singh, "Combining physics and machine learning for network flow estimation," in International Conference on Learning Representations, 2020.
  14. Z. Xiang, M. Fan, G. V. Tovar, W. Trehern, B.-J. Yoon, X. Qian, R. Ar- royave, and X. Qian, "Physics-constrained automatic feature engineering for predictive modeling in materials science," in Proc. AAAI Conf. Artif. Intell, vol. 35, no. 12, 2021, pp. 10 414-10 421.
  15. L. Yang, X. Meng, and G. E. Karniadakis, "B-pinns: Bayesian physics- informed neural networks for forward and inverse pde problems with noisy data," Journal of Computational Physics, vol. 425, p. 109913, 2021.
  16. J. Xu, S. Yu, K. Sun, J. Ren, I. Lee, S. Pan, and F. Xia, "Multivariate relations aggregation learning in social networks," in Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, ser. JCDL'20, 2020, p. 77-86.
  17. Z. Wu, S. Pan, G. Long, J. Jiang, and C. Zhang, "Graph wavenet for deep spatial-temporal graph modeling," in Proceedings of the 28th International Joint Conference on Artificial Intelligence, ser. IJCAI'19, 2019, p. 1907-1913.
  18. H. Haleem, Y. Wang, A. Puri, S. Wadhwa, and H. Qu, "Evaluating the readability of force directed graph layouts: A deep learning approach," IEEE computer graphics and applications, vol. 39, no. 4, pp. 40-53, 2019.
  19. S. Yu, F. Xia, and H. Liu, "Academic team formulation based on liebig's barrel: Discovery of anticask effect," IEEE Transactions on Computational Social Systems, vol. 6, no. 5, pp. 1083-1094, 2019.
  20. J. Willard, X. Jia, S. Xu, M. Steinbach, and V. Kumar, "Integrat- ing physics-based modeling with machine learning: A survey," arXiv preprint arXiv:2003.04919, vol. 1, no. 1, pp. 1-34, 2020. · arXiv
  21. M. M. Almajid and M. O. Abu-Al-Saud, "Prediction of porous media fluid flow using physics informed neural networks," Journal of Petroleum Science and Engineering, vol. 208, p. 109205, 2022.
  22. M. Geiger, A. Jacot, S. Spigler, F. Gabriel, L. Sagun, S. d'Ascoli, G. Biroli, C. Hongler, and M. Wyart, "Scaling description of generaliza- tion with number of parameters in deep learning," Journal of Statistical Mechanics: Theory and Experiment, vol. 2020, no. 2, p. 023401, 2020.
  23. C. Cabanes, A. Grouazel, K. von Schuckmann, M. Hamon, V. Turpin, C. Coatanoan, F. Paris, S. Guinehut, C. Boone, N. Ferry et al., "The cora dataset: validation and diagnostics of in-situ ocean temperature and salinity measurements," Ocean Science, vol. 9, no. 1, pp. 1-18, 2013.
  24. Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, and S. Y. Philip, "A comprehensive survey on graph neural networks," IEEE transactions on neural networks and learning systems, vol. 32, no. 1, pp. 4-24, 2020.
  25. K. Sun, L. Wang, B. Xu, W. Zhao, S. W. Teng, and F. Xia, "Network representation learning: From traditional feature learning to deep learn- ing," IEEE Access, vol. 8, pp. 205 600-205 617, 2020.
  26. J. Liu, F. Xia, L. Wang, B. Xu, X. Kong, H. Tong, and I. King, "Shifu2: A network representation learning based model for advisor- advisee relationship mining," IEEE Transactions on Knowledge and Data Engineering, vol. 33, no. 4, pp. 1763-1777, 2021.
  27. F. Xia, J. Wang, X. Kong, D. Zhang, and Z. Wang, "Ranking station im- portance with human mobility patterns using subway network datasets," IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 7, pp. 2840-2852, 2019.
  28. J. Lu, H. Wang, J. Zhou, Y. Chen, Z. Lai, and Q. Hu, "Low-rank adaptive graph embedding for unsupervised feature extraction," Pattern Recognition, vol. 113, p. 107758, 2021.
  29. G. Xue, M. Zhong, J. Li, J. Chen, C. Zhai, and R. Kong, "Dynamic network embedding survey," Neurocomputing, vol. 472, pp. 212-223, 2022.
  30. M. Hou, J. Ren, D. Zhang, X. Kong, D. Zhang, and F. Xia, "Network embedding: Taxonomies, frameworks and applications," Computer Sci- ence Review, vol. 38, p. 100296, 2020.
  31. P. Cui, X. Wang, J. Pei, and W. Zhu, "A survey on network embedding," IEEE Transactions on Knowledge and Data Engineering, vol. 31, no. 5, pp. 833-852, 2018.
  32. S. Seo and Y. Liu, "Differentiable physics-informed graph networks," arXiv preprint arXiv:1902.02950, 2019. · arXiv
  33. Y. Salehi and D. Giannacopoulos, "Physgnn: A physics-driven graph neural network based model for predicting soft tissue deformation in image-guided neurosurgery," arXiv preprint arXiv:2109.04352, 2021. · arXiv
  34. S. Shah, D. Dey, C. Lovett, and A. Kapoor, "Airsim: High-fidelity visual and physical simulation for autonomous vehicles," in Field and service robotics. Springer, 2018, pp. 621-635.
  35. A. Daw, R. Q. Thomas, C. C. Carey, J. S. Read, A. P. Appling, and A. Karpatne, "Physics-guided architecture (pga) of neural networks for quantifying uncertainty in lake temperature modeling," in Proceedings of the 2020 siam international conference on data mining. SIAM, 2020, pp. 532-540.
  36. V. Iakovlev, M. Heinonen, and H. Lähdesmäki, "Learning continuous- time pdes from sparse data with graph neural networks," arXiv preprint arXiv:2006.08956, 2020. · arXiv
  37. F. Sun, Y. Liu, and H. Sun, "Physics-informed spline learning for nonlinear dynamics discovery," arXiv preprint arXiv:2105.02368, 2021. · arXiv
  38. J. Liu, F. Xia, X. Feng, J. Ren, and H. Liu, "Deep graph learning for anomalous citation detection," IEEE Transactions on Neural Networks and Learning Systems, 2022.
  39. M. Majidi, A. Arabali, and M. Etezadi-Amoli, "Fault location in distribution networks by compressive sensing," IEEE Transactions on Power Delivery, vol. 30, no. 4, pp. 1761-1769, 2014.
  40. Z. Zhang, "A physics-informed deep convolutional neural network for simulating and predicting transient darcy flows in heterogeneous reservoirs without labeled data," Journal of Petroleum Science and Engineering, p. 110179, 2022.
  41. W. H. Kersting, "Radial distribution test feeders," IEEE Transactions on Power Systems, vol. 6, no. 3, pp. 975-985, 1991.
  42. J. Liu, T. Tang, W. Wang, B. Xu, X. Kong, and F. Xia, "A survey of scholarly data visualization," Ieee Access, vol. 6, pp. 19 205-19 221, 2018.
  43. A. Arleo, W. Didimo, G. Liotta, and F. Montecchiani, "A distributed multilevel force-directed algorithm," in International Symposium on Graph Drawing and Network Visualization. Springer, 2016, pp. 3- 17.
  44. M. E. Ko, C. M. Williams, K. I. Fread, S. M. Goggin, R. S. Rustagi, G. K. Fragiadakis, G. P. Nolan, and E. R. Zunder, "Flow-map: a graph- based, force-directed layout algorithm for trajectory mapping in single- cell time course datasets," Nature protocols, vol. 15, no. 2, pp. 398-420, 2020.
  45. D. Wang, P. Cui, and W. Zhu, "Structural deep network embedding," in Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, 2016, pp. 1225-1234.
  46. F. Xia, L. Wang, T. Tang, X. Chen, X. Kong, G. Oatley, and I. King, "Cengcn: Centralized convolutional networks with vertex imbalance for scale-free graphs," IEEE Transactions on Knowledge and Data Engineering, 2022.
  47. F. Xia, S. Yu, C. Liu, J. Li, and I. Lee, "Chief: Clustering with higher- order motifs in big networks," IEEE Transactions on Network Science and Engineering, vol. 9, no. 3, pp. 990-1005, 2022.
  48. Y. Alanazi, N. Sato, P. Ambrozewicz, A. N. H. Blin, W. Melnitchouk, M. Battaglieri, T. Liu, and Y. Li, "A survey of machine learning-based physics event generation," arXiv preprint arXiv:2106.00643, 2021. · arXiv
  49. R. Shi, Z. Mo, and X. Di, "Physics-informed deep learning for traffic state estimation: A hybrid paradigm informed by second-order traffic models," in Proceedings of the AAAI Conference on Artificial Intelli- gence, vol. 35, no. 1, 2021, pp. 540-547.
  50. X. Jia, J. Willard, A. Karpatne, J. S. Read, J. A. Zwart, M. Steinbach, and V. Kumar, "Physics-guided machine learning for scientific discovery: An application in simulating lake temperature profiles," ACM/IMS Transactions on Data Science, vol. 2, no. 3, pp. 1-26, 2021.
  51. S. Schoenholz and E. D. Cubuk, "Jax md: a framework for differentiable physics," Advances in Neural Information Processing Systems, vol. 33, pp. 11 428-11 441, 2020.
  52. Y. Li, J. Wang, Z. Huang, and R. X. Gao, "Physics-informed meta learning for machining tool wear prediction," Journal of Manufacturing Systems, vol. 62, pp. 17-27, 2022.
  53. M. J. Schuetz, J. K. Brubaker, and H. G. Katzgraber, "Combinatorial op- timization with physics-inspired graph neural networks," arXiv preprint arXiv:2107.01188, 2021. · arXiv
  54. M. Russell and P. Wang, "Physics-informed deep learning for signal compression and reconstruction of big data in industrial condition monitoring," Mechanical Systems and Signal Processing, vol. 168, p. 108709, 2022.
  55. J. Park and J. Park, "Physics-induced graph neural network: An appli- cation to wind-farm power estimation," Energy, vol. 187, p. 115883, 2019.
  56. X. Zhou, S. Li, Z. Li, and W. Li, "Information diffusion across cyber- physical-social systems in smart city: A survey," Neurocomputing, vol. 444, pp. 203-213, 2021.
  57. T. Matsubara, A. Ishikawa, and T. Yaguchi, "Deep energy-based model- ing of discrete-time physics," Advances in Neural Information Process- ing Systems, vol. 33, pp. 13 100-13 111, 2020.
  58. X. Chen, M. Hou, T. Tang, A. Kaur, and F. Xia, "Digital twin mobility profiling: A spatio-temporal graph learning approach," in 7th Int Conf on Data Science and Systems, 2021, pp. 1178-1187.
  59. G. E. Karniadakis, I. G. Kevrekidis, L. Lu, P. Perdikaris, S. Wang, and L. Yang, "Physics-informed machine learning," Nature Reviews Physics, vol. 3, no. 6, pp. 422-440, 2021.

Cited by

Sorted by citations

Metadata

Authors
Peng, C., Xia, F., Saikrishna, V., & Liu, H.
Affiliations
  • Federation University (AU)
  • Arizona State University (US)
Venue
arXiv
Publisher
arXiv
Published
2022
Pages
732-739
ISSN
2375-9259 (ISSN-L)
OpenAlex
W4319585989
Cited by
8
References
0
Citations by year
2025: 1 · 2024: 6 · 2023: 1
FWCI
1.11
Type
conference paper
Language
en
Open access
Locations
  • IEEE ... International Conference on Data Mining workshops (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • FedUni ResearchOnline (Federation University Australia) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Graph Theory and Algorithms
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
Keywords
graph learning, physics-informed machine learning, graph data, unified framework, graph neural networks, physical constraints

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review