The DOI matches its Crossref record; 161 of the 161 references it cites were found in a registry or an index.
Graph Self-Supervised Learning: A Survey
Open accessAbstract
Deep learning on graphs has attracted significant interests recently. However, most of the works have focused on (semi-) supervised learning, resulting in shortcomings including heavy label reliance, poor generalization, and weak robustness. To address these issues, self-supervised learning (SSL), which extracts informative knowledge through well-designed pretext tasks without relying on manual labels, has become a promising and trending learning paradigm for graph data. Different from SSL on other domains like computer vision and natural language processing, SSL on graphs has an exclusive background, design ideas, and taxonomies. Under the umbrella of graph self-supervised learning, we present a timely and comprehensive review of the existing approaches which employ SSL techniques for graph data. We construct a unified framework that mathematically formalizes the paradigm of graph SSL. According to the objectives of pretext tasks, we divide these approaches into four categories: generation-based, auxiliary property-based, contrast-based, and hybrid approaches. We further describe the applications of graph SSL across various research fields and summarize the commonly used datasets, evaluation benchmark, performance comparison and open-source codes of graph SSL. Finally, we discuss the remaining challenges and potential future directions in this research field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Birds of a Feather: Homophily in Social Networks
McPherson, M., Smith-Lovin, L., & Cook, J. M. (2001) · Annual Review of Sociology · doi:10.1146/annurev.soc.27.1.415 · Cited by 18,567
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Self-citationnode2vec: Scalable Feature Learning for Networks
Grover, A., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939754 · Cited by 10,926
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639
DeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 8,657
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs
Karypis, G., & Kumar, V. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827595287997 · Cited by 5,762
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
LINE: Large-scale Information Network Embedding
Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741093 · Cited by 5,416
Targeted Branching for the Maximum Independent Set Problem Using Graph Neural Networks
Silva, G., Rodrigues, M., Teixeira, A., & Amorim, M. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.sea.2024.20 · Cited by 5,183
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Collective Classification in Network Data
Sen, P., Namata, G., Bilgic, M., Getoor, L., Gallagher, B., & Eliassi‐Rad, T. (2008) · AI Magazine · doi:10.1609/aimag.v29i3.2157 · Cited by 3,293
Formal Semantics for Kolmogorov-Arnold Network Representations of Operational Games
Zhukov, G. A. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15206559 · Cited by 3,212
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174
Self-citationGraph WaveNet for Deep Spatial-Temporal Graph Modeling
Wu, Z., Pan, S., Long, G., Jiang, J., & Zhang, C. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/264 · Cited by 2,948
Self-citationA Survey on Knowledge Graphs: Representation, Acquisition, and Applications
Ji, S., Pan, S., Cambria, E., Marttinen, P., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070843 · Cited by 2,947
Self-citationUnsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
Generative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00577 · Cited by 2,527
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1808.06670 · Cited by 1,991
Schaeffer, S. E. (2007) · Computer Science Review · doi:10.1016/j.cosrev.2007.05.001 · Cited by 1,639
Identifying Resilient Communities in Road Networks: A Path-Based Embedding Approach
Wagner, C., Dodge, S., & Alizadeh, D. (2025) · Leibniz international proceedings in informatics · doi:10.4230/lipics.giscience.2025.9 · Cited by 1,543
The SIDER database of drugs and side effects
Kuhn, M., Letunic, I., Jensen, L. J., & Bork, P. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1075 · Cited by 1,451
Protein function prediction via graph kernels
Borgwardt, K. M., Ong, C. S., Schonauer, S., Vishwanathan, S. V. N., Smola, A. J., & Kriegel, H.-P. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti1007 · Cited by 1,105
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087
Graph Contrastive Learning with Adaptive Augmentation
Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., & Wang, L. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449802 · Cited by 1,066
Yanardag, P., & Vishwanathan, S. V. N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783417 · Cited by 1,021
A simple framework for contrastive learning of visual representations
Chen, T. (2024) · TIB Data Manager · doi:10.57702/iuuvgtaz · Cited by 973
Adversarially Regularized Graph Autoencoder for Graph Embedding
Pan, S., Hu, R., Long, G., Jiang, J., Yao, L., & Zhang, C. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/362 · Cited by 929
Self-citationDebnath, A. K., Lopez de Compadre, R. L., Debnath, G., Shusterman, A. J., & Hansch, C. (1991) · Journal of Medicinal Chemistry · doi:10.1021/jm00106a046 · Cited by 868
Graph Contrastive Learning with Augmentations
You, Y., Chen, T., Sui, Y., Chen, T., Wang, Z., & Shen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13902 · Cited by 824
Hierarchical Graph Representation Learning with Differentiable Pooling
Ying, R., You, J., Morris, C., Ren, X., Hamilton, W. L., & Leskovec, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.08804 · Cited by 798
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training
Qiu, J., Chen, Q., Dong, Y., Zhang, J., Yang, H., Ding, M., Wang, K., & Tang, J. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403168 · Cited by 777
Variational Graph Auto-Encoders
Kipf, T., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07308 · Cited by 772
Barlow Twins: Self-Supervised Learning via Redundancy Reduction
Žbontar, J., Jing, L., Misra, I., LeCun, Y., & Deny, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03230 · Cited by 751
ToxCast Chemical Landscape: Paving the Road to 21st Century Toxicology
Richard, A. M., Judson, R. S., Houck, K. A., Grulke, C. M., Volarath, P., Thillainadarajah, I., Yang, C., Rathman, J., Martin, M. T., Wambaugh, J. F., et al. (2016) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.6b00135 · Cited by 709
DropEdge: Towards Deep Graph Convolutional Networks on Node Classification
Rong, Y., Huang, W., Xu, T., & Huang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10903 · Cited by 607
Shchur, O., Mumme, M., Bojchevski, A., & Günnemann, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05868 · Cited by 588
Distinguishing Enzyme Structures from Non-enzymes Without Alignments
Dobson, P. D., & Doig, A. J. (2003) · Journal of Molecular Biology · doi:10.1016/s0022-2836(03)00628-4 · Cited by 579
Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation
Xia, X., Yin, H., Yu, J., Wang, Q., Cui, L., & Zhang, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16578 · Cited by 570
Deep Anomaly Detection on Attributed Networks
Ding, K., Li, J., Bhanushali, R., & Liu, H. (2019) · Proceedings of the 2019 SIAM International Conference on Data Mining · doi:10.1137/1.9781611975673.67 · Cited by 548
Graph Representation Learning via Graphical Mutual Information Maximization
Peng, Z., Huang, W., Luo, M., Zheng, Q., Rong, Y., Xu, T., & Huang, J. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380112 · Cited by 536
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · arXiv · doi:10.48550/arxiv.1807.05520 · Cited by 533
Predicting multicellular function through multi-layer tissue networks
Zitnik, M., & Leskovec, J. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx252 · Cited by 519
Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation
Yu, J., Yin, H., Li, J., Wang, Q., Hung, N. Q. V., & Zhang, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449844 · Cited by 519
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning
Liu, Y., Li, Z., Pan, S., Gong, C., Zhou, C., & Karypis, G. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3068344 · Cited by 492
Self-citationSelf-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning
Wang, X., Liu, N., Han, H., & Shi, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467415 · Cited by 467
Comparison of descriptor spaces for chemical compound retrieval and classification
Wale, N., Watson, I. A., & Karypis, G. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0103-5 · Cited by 453
GPT-GNN: Generative Pre-Training of Graph Neural Networks
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403237 · Cited by 446
Diffusion Improves Graph LearningPreprint
Klicpera, J., Weißenberger, S., & Günnemann, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.05485 · Cited by 426
Contrastive Multi-View Representation Learning on Graphs
Hassani, K., & Khasahmadi, A. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05582 · Cited by 423
MGAE: Marginalized Graph Autoencoder for Graph Clustering
Wang, C., Pan, S., Long, G., Zhu, X., & Jiang, J. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132967 · Cited by 420
Self-citationWiki-CS: A Wikipedia-Based Benchmark for Graph Neural NetworksPreprint
Mernyei, P., & Cangea, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02901 · Cited by 411
A Survey of Community Detection Approaches: From Statistical Modeling to Deep Learning
Jin, D., Yu, Z., Jiao, P., Pan, S., He, D., Wu, J., Yu, P., & Zhang, W. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3104155 · Cited by 397
Self-citationStructured Graph Learning for Scalable Subspace Clustering: From Single View to Multiview
Kang, Z., Lin, Z., Zhu, X., & Xu, W. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3061660 · Cited by 394
Deep Graph Contrastive Representation Learning
Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., & Wang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04131 · Cited by 389
Self-Supervised Learning of Graph Neural Networks: A Unified Review
Xie, Y., Xu, Z., Zhang, J., Wang, Z., & Ji, S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3170559 · Cited by 389
Self-Supervised Graph Transformer on Large-Scale Molecular Data
Rong, Y., Bian, Y., Xu, T., Xie, W., Wei, Y., Huang, W., & Huang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02835 · Cited by 388
Graph-Bert: Only Attention is Needed for Learning Graph RepresentationsPreprint
Zhang, J., Zhang, H., Xia, C., & Li, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.05140 · Cited by 368
A Bayesian Approach to in Silico Blood-Brain Barrier Penetration Modeling
Martins, I. F., Teixeira, A. L., Pinheiro, L., & Falcao, A. O. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300124c · Cited by 331
Constrained Graph Variational Autoencoders for Molecule Design
Liu, Q., Allamanis, M., Brockschmidt, M., & Gaunt, A. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09076 · Cited by 295
Unsupervised Attributed Multiplex Network Embedding
Park, C., Kim, D., Han, J., & Yu, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5985 · Cited by 286
Computational Modeling of β-Secretase 1 (BACE-1) Inhibitors Using Ligand Based Approaches
Subramanian, G., Ramsundar, B., Pande, V., & Denny, R. A. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00290 · Cited by 285
Veličković, P., Fedus, W., Hamilton, W. L., Lió, P., Bengio, Y., & Hjelm, R. D. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.40744 · Cited by 279
Graph Contrastive Learning AutomatedPreprint
You, Y., Chen, T., Shen, Y., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07594 · Cited by 270
Contrastive Learning with Stronger Augmentations
Wang, X., & Qi, G.-J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3203630 · Cited by 266
Self-supervised Learning on Graphs: Deep Insights and New DirectionPreprint
Jin, W., Derr, T., Liu, H., Wang, Y., Wang, S., Liu, Z., & Tang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10141 · Cited by 261
On Mutual Information Maximization for Representation Learning
Tschannen, M., Djolonga, J., Rubenstein, P. K., Gelly, S., & Lučić, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.13625 · Cited by 253
Node Similarity Preserving Graph Convolutional Networks
Jin, W., Derr, T., Wang, Y., Ma, Y., Liu, Z., & Tang, J. (2021) · Proceedings of the 14th ACM International Conference on Web Search and Data Mining · doi:10.1145/3437963.3441735 · Cited by 238
Sun, K., Lin, Z., & Zhu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6048 · Cited by 237
Comparison of Descriptor Spaces for Chemical Compound Retrieval and Classification
Wale, N., & Karypis, G. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.39 · Cited by 226
Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detection
Zheng, Y., Jin, M., Liu, Y., Chi, L., Phan, K. T., & Chen, Y.-P. P. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3119326 · Cited by 220
Self-citationHow to Find Your Friendly Neighborhood: Graph Attention Design with Self-SupervisionPreprint
Kim, D., & Oh, A. H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.04879 · Cited by 219
The Predictive Toxicology Challenge 2000–2001
Helma, C., King, R. D., Kramer, S., & Srinivasan, A. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.1.107 · Cited by 216
Adversarial Graph Augmentation to Improve Graph Contrastive LearningPreprint
Suresh, S., Pan, L., Hao, C., & Neville, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05819 · Cited by 211
Statistical evaluation of the Predictive Toxicology Challenge 2000–2001
Toivonen, H., Srinivasan, A., King, R. D., Kramer, S., & Helma, C. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg130 · Cited by 196
Contrastive Learning of Structured World ModelsPreprint
Kipf, T., van der Pol, E., & Welling, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.12247 · Cited by 184
Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Prediction
Wang, Y., Min, Y., Chen, X., & Wu, J. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449786 · Cited by 182
HDMI: High-order Deep Multiplex Infomax
Jing, B., Park, C., & Tong, H. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449971 · Cited by 180
Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning
Jin, M., Zheng, Y., Li, Y.-F., Gong, C., Zhou, C. D., & Pan, S. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/204 · Cited by 178
Self-citationSub-Graph Contrast for Scalable Self-Supervised Graph Representation Learning
Jiao, Y., Xiong, Y., Zhang, J., Zhang, Y., Zhang, T., & Zhu, Y. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00031 · Cited by 176
Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning
Wan, S., Pan, S., Yang, J. J., & Gong, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17206 · Cited by 164
Self-citationSun, Q., Li, J., Peng, H., Wu, J., Ning, Y., Yu, P. S., & He, L. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449822 · Cited by 162
Self-citationContrastive Self-supervised Learning for Graph Classification
Zeng, J., & Xie, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17293 · Cited by 160
Graph Barlow Twins: A self-supervised representation learning framework for graphs
Bielak, P., Kajdanowicz, T. J., & Chawla, N. V. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109631 · Cited by 160
Strategies for Pre-training Graph Neural Networks
Hu, W., Liu, B., Gomes, J. S., Žitnik, M., Liang, P., Pande, V. S., & Leskovec, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12265 · Cited by 158
When Does Self-Supervision Help Graph Convolutional Networks?
You, Y., Chen, T., Wang, Z., & Shen, Y. (2020) · PubMed · doi:10.48550/arxiv.2006.09136 · Cited by 155
ANEMONE: Graph Anomaly Detection with Multi-Scale Contrastive Learning
Jin, M., Liu, Y., Zheng, Y., Chi, L., Li, Y.-F., & Pan, S. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482057 · Cited by 149
Self-citationHeterogeneous Deep Graph InfomaxPreprint
Ren, Y., Лю, Б., Huang, C., Dai, P., Bo, L., & Zhang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08538 · Cited by 136
Bipartite Graph Embedding via Mutual Information Maximization
Cao, J., Lin, X., Guo, S., Liu, L., Liu, T., & Wang, B. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441783 · Cited by 133
Novick, P. A., Ortiz, O. F., Poelman, J., Abdulhay, A., & Pande, V. S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079568 · Cited by 130
Bootstrapped Representation Learning on GraphsPreprint
Thakoor, S., Tallec, C., Azar, M. G., Munos, R., Veličković, P., & Valko, M. (2021) · arXiv (Cornell University) · Cited by 118
Hierarchical Bipartite Graph Neural Networks: Towards Large-Scale E-commerce Applications
Li, Z., Shen, X., Jiao, Y., Pan, X., Zou, P., Meng, X., Yao, C., & Bu, J. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00149 · Cited by 112
SpecAE: Spectral AutoEncoder for Anomaly Detection in Attributed Networks
Li, Y., Huang, X., Li, J., Du, M., & Zou, N. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358074 · Cited by 111
Self-supervised Graph-level Representation Learning with Local and Global StructurePreprint
Xu, M., Wang, H., Ni, B., Guo, H., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04113 · Cited by 110
Motif-Driven Contrastive Learning of Graph Representations
Zhang, S., Hu, Z., Subramonian, A., & Sun, Y. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3364059 · Cited by 108
FedGL: Federated graph learning framework with global self-supervision
Chen, C., Xu, Z., Hu, W., Zheng, Z., & Zhang, J. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119976 · Cited by 108
Pre-Training Graph Neural Networks for Cold-Start Users and Items Representation
Hao, B., Zhang, J., Yin, H., Li, C., & Chen, H. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441738 · Cited by 101
Contrastive Learning for Recommender SystemPreprint
Liu, Z., Ma, Y., Ouyang, Y., & Xiong, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01317 · Cited by 96
Self-Supervised Graph Representation Learning via Global Context PredictionPreprint
Peng, Z., Dong, Y., Luo, M., Wu, X.-M., & Zheng, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01604 · Cited by 94
Inductive Anomaly Detection on Attributed Networks
Ding, K., Li, J., Agarwal, N., & Liu, H. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/179 · Cited by 92
SLAPS: Self-Supervision Improves Structure Learning for Graph Neural NetworksPreprint
Fatemi, B., Asri, L. E., & Kazemi, S. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05034 · Cited by 92
Semi-Implicit Graph Variational Auto-EncodersPreprint
Hasanzadeh, A., Hajiramezanali, E., Duffield, N. G., Narayanan, K. R., Zhou, M., & Qian, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07078 · Cited by 89
Pre-training Graph Transformer with Multimodal Side Information for Recommendation
Liu, Y., Yang, S., Lei, C., Wang, G., Tang, H., Zhang, J., Sun, A., & Miao, C. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475709 · Cited by 89
Self-citationGraph InfoClust: Maximizing Coarse-Grain Mutual Information in Graphs
Mavromatis, C., & Karypis, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75762-5_43 · Cited by 86
GPT-GNN: Generative Pre-Training of Graph Neural NetworksPreprint
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15437 · Cited by 84
Graph-based, Self-Supervised Program Repair from Diagnostic Feedback
Yasunaga, M., & Liang, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10636 · Cited by 81
Mavromatis, C., & Karypis, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.06946 · Cited by 77
Adversarial Label-Flipping Attack and Defense for Graph Neural Networks
Zhang, M., Hu, L., Shi, C., & Wang, X. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00088 · Cited by 74
GraphCL: Contrastive Self-Supervised Learning of Graph RepresentationsPreprint
Hafidi, H., Ghogho, M., Ciblat, P., & Swami, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08025 · Cited by 69
Effectiveness of 2D Fingerprints for Scaffold Hopping
Gardiner, E. J., Holliday, J. D., O’Dowd, C., & Willett, P. (2011) · Future Medicinal Chemistry · doi:10.4155/fmc.11.4 · Cited by 66
Transfer Learning of Graph Neural Networks with Ego-graph Information MaximizationPreprint
Zhu, Q., Yang, C., Xu, Y., Wang, H., Zhang, C., & Han, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05204 · Cited by 66
Contrastive Learning of Structured World Models
Kipf, T., van der Pol, E., & Welling, M. (2020) · Data Archiving and Networked Services (DANS) · Cited by 63
Leveraging Meta-path Contexts for Classification in Heterogeneous Information Networks
Li, X., Ding, D., Kao, B., Sun, Y., & Mamoulis, N. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00084 · Cited by 63
Self-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networks
Wang, P., Agarwal, K., Ham, C., Choudhury, S., & Reddy, C. K. A. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450060 · Cited by 61
Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous GraphsPreprint
Hwang, D., Park, J., Kwon, S., Kim, K.-M., Ha, J.-W., & Kim, H. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08294 · Cited by 53
Self-supervised Consensus Representation Learning for Attributed Graph
Liu, C., Wen, L., Kang, Z., Luo, G., & Tian, L. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475416 · Cited by 52
Towards Robust Graph Contrastive LearningPreprint
Jovanović, N., Zhao, M., Faber, L., & Wattenhofer, R. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13085 · Cited by 47
Self-supervised Training of Graph Convolutional NetworksPreprint
Zhu, Q., Du, B., & Yan, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02380 · Cited by 44
Pre-Training Graph Neural Networks for Generic Structural Feature ExtractionPreprint
Hu, Z., Fan, C., Chen, T., Chang, K.-W., & Sun, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13728 · Cited by 43
Hop-Count Based Self-supervised Anomaly Detection on Attributed Networks
Huang, T., Pei, Y., Menkovski, V., & Pechenizkiy, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26387-3_14 · Cited by 43
Contrastive Graph Poisson Networks: Semi-Supervised Learning with Extremely Limited Labels
Wan, S., Zhan, Y., Liu, L., Yu, B., Pan, S., & Gong, C. (2021) · Griffith Research Online · Cited by 39
Self-citationSpatio-Temporal Deep Graph InfomaxPreprint
Opolka, F. L., Solomon, A., Cangea, C., Veličković, P., Liò, P., & Hjelm, R. D. (2019) · arXiv (Cornell University) · doi:10.17863/cam.40745 · Cited by 39
Iterative Graph Self-Distillation
Zhang, H., Lin, S., Liu, W., Zhou, P., Tang, J., Liang, X., & Xing, E. P. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3303885 · Cited by 38
Self-supervised Graph Neural Networks without explicit negative samplingPreprint
Kefato, Z. T., & Girdzijauskas, Š. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14958 · Cited by 37
Graph-based neural network models with multiple self-supervised auxiliary tasks
Manessi, F., & Rozza, A. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.04.021 · Cited by 34
CAGNN: Cluster-Aware Graph Neural Networks for Unsupervised Graph Representation LearningPreprint
Zhu, Y., Xu, Y., Yu, F., Wu, S., & Wang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01674 · Cited by 29
Label Contrastive Coding Based Graph Neural Network for Graph Classification
Ren, Y., Bai, J., & Zhang, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-73194-6_10 · Cited by 29
Toward Graph Self-Supervised Learning With Contrastive Adjusted Zooming
Zheng, Y., Jin, M., Pan, S., Li, Y.-F., Peng, H. M., Li, M., & Li, Z. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3216630 · Cited by 29
Self-citationMolCLR: Molecular Contrastive Learning of Representations via Graph Neural NetworksPreprint
Wang, Y., Wang, J., Cao, Z., & Farimani, A. B. (2021) · arXiv (Cornell University) · doi:10.24433/co.8582800.v1 · Cited by 24
FedProto: Federated Prototype Learning over Heterogeneous Devices.Preprint
Tan, Y., Long, G., Liu, L., Zhou, T., & Jiang, J. B. (2021) · arXiv (Cornell University) · Cited by 22
Learning graph representation by aggregating subgraphs via mutual information maximization
Liu, Z., Wang, C., Han, C., & Guo, T. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126392 · Cited by 22
Context Matters: Graph-based Self-supervised Representation Learning for Medical Images
Sun, L., Yu, K., & Batmanghelich, K. N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16620 · Cited by 21
Self-supervised graph convolutional clustering by preserving latent distribution
Kou, S., Xia, W., Zhang, X., Gao, Q., & Gao, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.082 · Cited by 18
Pre-training on dynamic graph neural networks
Chen, K., Zhang, J., Jiang, L., Wang, Y., & Dai, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.070 · Cited by 16
Calibrating and Improving Graph Contrastive LearningPreprint
Ma, K., Yang, H., Yang, H. Q., Chen, Y., & Cheng, J. S.-C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11525 · Cited by 14
GraphMS: Drug Target Prediction Using Graph Representation Learning with Substructures
Cheng, S., Zhang, L., Jin, B., Zhang, Q., Lu, X., You, M., & Tian, X. (2021) · Applied Sciences · doi:10.3390/app11073239 · Cited by 14
Self-supervised edge features for improved Graph Neural Network trainingPreprint
Sehanobish, A., Ravindra, N. G., & van Dijk, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04777 · Cited by 7
Distance-wise Graph Contrastive Learning.Preprint
Chen, D., Lin, Y., Li, L., et al. (2020) · arXiv (Cornell University) · Cited by 4
COAD: Contrastive Pre-training with Adversarial Fine-tuning for Zero-shot Expert Linking.Preprint
Chen, B., Zhang, J., Zhang, X., Tang, X., Cai, L., Hong, C., Li, C., Zhang, P., & Tang, J. (2020) · arXiv (Cornell University) · Cited by 4
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Research works printed but not linked: 15
- karypis, 1995, Multilevel graph partitioning schemes, Proc Int Conf Parallel Process, 113
- 10.1109/ICCV.2019.00662 · DOI
- xu, 2019, How powerful are graph neural networks?, Proc Int Conf Learn Representations, 1
- 10.1609/aaai.v35i18.17986 · doi:10.1609/aaai.v35i18.17986
- jaiswal, 2021, A survey on contrastive self-supervised learning, Technol, 9
- sun, 2020, InfoGraph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization, Proc Int Conf Learn Representations, 1
- robinson, 2021, Contrastive learning with hard negative samples, Proc Int Conf Learn Representations, 1
- shchur, 2018, Pitfalls of graph neural network evaluation, Proc Int Conf Neural Inf Process Syst Workshop, 1
- wang, 2020, Haar graph pooling, Proc Int Conf Mach Learn, 9952
- verma, 2021, Towards domain-agnostic contrastive learning, Proc Int Conf Mach Learn, 10 530
- hu, 2020, Open Graph Benchmark: Datasets for machine learning on graphs, Proc Int Conf Neural Inf Process, 22 118
- kipf, 2017, Semi-supervised classification with graph convolutional networks, Proc Int Conf Learn Representations, 1
- 10.1109/IJCNN52387.2021.9533715 · doi:10.1109/ijcnn52387.2021.9533715
- ren, 2020, HDGI: An unsupervised graph neural network for representation learning in heterogeneous graph, Proc Conf Assoc Advance Artif Intell Workshop, 1
- 10.1109/TKDE.2021.3101227 · doi:10.1109/tkde.2021.3101227
Cited by
Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning
Lin, Z., Tian, C., Hou, Y., & Zhao, W. X. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3512104 · Cited by 572
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567
Self-citationA Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 552
Self-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413
Self-Supervised Learning of Graph Neural Networks: A Unified Review
Xie, Y., Xu, Z., Zhang, J., Wang, Z., & Ji, S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3170559 · Cited by 389
Metadata
- Authors
- Liu, Y., Jin, M., Pan, S., Zhou, C., Zheng, Y., Xia, F., & Yu, P.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2022
- Pages
- 1-1
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3134210100
- Cited by
- 510
- References
- 161
- FWCI
- 36.84
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Australian Research Council (FT210100097)
- National Science Foundation (III-1763325, III-1909323, III-2106758, SaTC-1930941)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.