The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Self-Supervised Learning of Graph Neural Networks: A Unified Review
Open accessAbstract
Deep models trained in supervised mode have achieved remarkable success on a variety of tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a new paradigm for making use of large amounts of unlabeled samples. SSL has achieved promising performance on natural language and image learning tasks. Recently, there is a trend to extend such success to graph data using graph neural networks (GNNs). In this survey, we provide a unified review of different ways of training GNNs using SSL. Specifically, we categorize SSL methods into contrastive and predictive models. In either category, we provide a unified framework for methods as well as how these methods differ in each component under the framework. Our unified treatment of SSL methods for GNNs sheds light on the similarities and differences of various methods, setting the stage for developing new methods and algorithms. We also summarize different SSL settings and the corresponding datasets used in each setting. To facilitate methodological development and empirical comparison, we develop a standardized testbed for SSL in GNNs, including implementations of common baseline methods, datasets, and evaluation metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639
DeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
BPR: Bayesian Personalized Ranking from Implicit Feedback
Rendle, S., Freudenthaler, C., Gantner, Z., & Schmidt-Thieme, L. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2618 · Cited by 4,242
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · cited 5×
“BGRL and BYOL are commonly acknowledged as variations of contrastive methods.”
BackgroundMethodInfluentialSupervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569
Collective Classification in Network Data
Sen, P., Namata, G., Bilgic, M., Getoor, L., Gallagher, B., & Eliassi‐Rad, T. (2008) · AI Magazine · doi:10.1609/aimag.v29i3.2157 · Cited by 3,293
ZINC 15 – Ligand Discovery for Everyone
Sterling, T., & Irwin, J. J. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00559 · Cited by 3,224
Formal Semantics for Kolmogorov-Arnold Network Representations of Operational Games
Zhukov, G. A. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15206559 · Cited by 3,212
Canonical Correlation Analysis: An Overview with Application to Learning Methods
Hardoon, D. R., Szedmak, S., & Shawe-Taylor, J. (2004) · Neural Computation · doi:10.1162/0899766042321814 · Cited by 3,202
MoleculeNet: a benchmark for molecular machine learning
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., Leswing, K., & Pande, V. (2018) · Chemical Science · doi:10.1039/c7sc02664a · Cited by 3,107
Nonlinear principal component analysis using autoassociative neural networks
Kramer, M. A. (1991) · AIChE Journal · doi:10.1002/aic.690370209 · Cited by 3,037
Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning
Li, Q., Han, Z., & Wu, X.-M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11604 · Cited by 2,872
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Image-Based Recommendations on Styles and Substitutes
McAuley, J., Targett, C., Shi, Q., & van den Hengel, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767755 · Cited by 2,280
Deep Metric Learning Using Triplet Network
Hoffer, E., & Ailon, N. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24261-3_7 · Cited by 2,134
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
Lempitsky, V., Vedaldi, A., & Ulyanov, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00984 · Cited by 1,916
A signal processing approach to fair surface design
Taubin, G. (1995) · Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95 · doi:10.1145/218380.218473 · Cited by 1,855
Identifying Resilient Communities in Road Networks: A Path-Based Embedding Approach
Wagner, C., Dodge, S., & Alizadeh, D. (2025) · Leibniz international proceedings in informatics · doi:10.4230/lipics.giscience.2025.9 · Cited by 1,543
Noise2Void - Learning Denoising From Single Noisy Images
Krull, A., Buchholz, T.-O., & Jug, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00223 · Cited by 1,366
Automating the Construction of Internet Portals with Machine Learning
McCallum, A. K., Nigam, K., Rennie, J., & Seymore, K. (2000) · Information Retrieval · doi:10.1023/a:1009953814988 · Cited by 1,280
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Nowozin, S., Cseke, B., & Tomioka, R. (2016) · arXiv · doi:10.48550/arxiv.1606.00709 · Cited by 1,183
Protein function prediction via graph kernels
Borgwardt, K. M., Ong, C. S., Schonauer, S., Vishwanathan, S. V. N., Smola, A. J., & Kriegel, H.-P. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti1007 · Cited by 1,105
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087
Self-citationGraph Contrastive Learning with Adaptive Augmentation
Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., & Wang, L. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449802 · Cited by 1,066
CiteSeer: an automatic citation indexing system
Giles, C. L., Bollacker, K. D., & Lawrence, S. (1998) · Proceedings of the third ACM conference on Digital libraries - DL '98 · doi:10.1145/276675.276685 · Cited by 1,040
Yanardag, P., & Vishwanathan, S. V. N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783417 · Cited by 1,021
Adversarially Regularized Graph Autoencoder for Graph Embedding
Pan, S., Hu, R., Long, G., Jiang, J., Yao, L., & Zhang, C. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/362 · Cited by 929
Debnath, A. K., Lopez de Compadre, R. L., Debnath, G., Shusterman, A. J., & Hansch, C. (1991) · Journal of Medicinal Chemistry · doi:10.1021/jm00106a046 · Cited by 868
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training
Qiu, J., Chen, Q., Dong, Y., Zhang, J., Yang, H., Ding, M., Wang, K., & Tang, J. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403168 · Cited by 777
Self-citationWhat makes for good views for contrastive learning
Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10243 · Cited by 773
Variational Graph Auto-Encoders
Kipf, T., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07308 · Cited by 772
An Overview of Microsoft Academic Service (MAS) and Applications
Sinha, A., Shen, Z., Song, Y., Ma, H., Eide, D., Hsu, B.-J. (., & Wang, K. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742839 · Cited by 658
Large-Scale Learnable Graph Convolutional Networks
Gao, H., Wang, Z., & Ji, S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219947 · Cited by 638
Self-citationShchur, O., Mumme, M., Bojchevski, A., & Günnemann, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05868 · Cited by 588
Explainability in Graph Neural Networks: A Taxonomic Survey
Yuan, H., Yu, H., Gui, S., & Ji, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204236 · Cited by 583
Self-citationDistinguishing Enzyme Structures from Non-enzymes Without Alignments
Dobson, P. D., & Doig, A. J. (2003) · Journal of Molecular Biology · doi:10.1016/s0022-2836(03)00628-4 · Cited by 579
Relations Between Two Sets of Variates
Hotelling, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_14 · Cited by 548
Graph Representation Learning via Graphical Mutual Information Maximization
Peng, Z., Huang, W., Luo, M., Zheng, Q., Rong, Y., Xu, T., & Huang, J. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380112 · Cited by 536
Predicting multicellular function through multi-layer tissue networks
Zitnik, M., & Leskovec, J. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx252 · Cited by 519
Graph Self-Supervised Learning: A Survey
Liu, Y., Jin, M., Pan, S., Zhou, C., Zheng, Y., Xia, F., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3172903 · Cited by 510
Towards Deeper Graph Neural Networks
Liu, M., Gao, H., & Ji, S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403076 · Cited by 507
Self-citationgraph2vec: Learning Distributed Representations of Graphs
Narayanan, A. S., Chandramohan, M., Venkatesan, R., Chen, L., Liu, Y., & Jaiswal, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05005 · Cited by 494
Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning
Wang, X., Liu, N., Han, H., & Shi, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467415 · Cited by 467
Tian, Y., Krishnan, D., & Isola, P. (2019) · arXiv · doi:10.48550/arxiv.1906.05849 · Cited by 465
GPT-GNN: Generative Pre-Training of Graph Neural Networks
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403237 · Cited by 446
MGAE: Marginalized Graph Autoencoder for Graph Clustering
Wang, C., Pan, S., Long, G., Zhu, X., & Jiang, J. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132967 · Cited by 420
Asymptotic evaluation of certain markov process expectations for large time. IV
Donsker, M. D., & Varadhan, S. R. S. (1983) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160360204 · Cited by 392
Deep Graph Contrastive Representation Learning
Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., & Wang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04131 · Cited by 389
Hamilton, W. L. (2020) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s01045ed1v01y202009aim046 · Cited by 320
Self-supervised Learning on Graphs: Deep Insights and New DirectionPreprint
Jin, W., Derr, T., Liu, H., Wang, Y., Wang, S., Liu, Z., & Tang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10141 · Cited by 299
When Does Self-Supervision Help Graph Convolutional Networks?
You, Y., Chen, T., Wang, Z., & Shen, Y. (2020) · PubMed · doi:10.48550/arxiv.2006.09136 · Cited by 282
Self-citationXGNN: Towards Model-Level Explanations of Graph Neural Networks
Yuan, H., Tang, J., Hu, X., & Ji, S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403085 · Cited by 272
Self-citationGao, H., & Ji, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3081010 · Cited by 259
Self-citationUnsupervised Domain Adaptation through Self-SupervisionPreprint
Sun, Y., Tzeng, E., Darrell, T., & Efros, A. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11825 · Cited by 258
How to Find Your Friendly Neighborhood: Graph Attention Design with Self-SupervisionPreprint
Kim, D., & Oh, A. H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.04879 · Cited by 247
Line Graph Neural Networks for Link Prediction
Cai, L., Li, J., Wang, J., & Ji, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3080635 · Cited by 245
Self-citationTheoretical Analysis of Self-Training with Deep Networks on Unlabeled DataPreprint
Wei, C., Shen, K., Chen, Y., & Ma, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03622 · Cited by 244
Node Similarity Preserving Graph Convolutional Networks
Jin, W., Derr, T., Wang, Y., Ma, Y., Liu, Z., & Tang, J. (2021) · Proceedings of the 14th ACM International Conference on Web Search and Data Mining · doi:10.1145/3437963.3441735 · Cited by 238
Sun, K., Lin, Z., & Zhu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6048 · Cited by 237
Sub-Graph Contrast for Scalable Self-Supervised Graph Representation Learning
Jiao, Y., Xiong, Y., Zhang, J., Zhang, Y., Zhang, T., & Zhu, Y. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00031 · Cited by 230
Self-citationMoFlow: An Invertible Flow Model for Generating Molecular Graphs
Zang, C., & Wang, F. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403104 · Cited by 227
Comparison of Descriptor Spaces for Chemical Compound Retrieval and Classification
Wale, N., & Karypis, G. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.39 · Cited by 226
Ma, Y., & Tang, J. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108924184 · Cited by 222
Non-Local Graph Neural Networks
Liu, M., Wang, Z., & Ji, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3134200 · Cited by 196
Self-citationDecoupling Representation Learning and Classification for GNN-based Anomaly Detection
Wang, Y., Zhang, J., Guo, S., Yin, H., Li, C., & Chen, H. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462944 · Cited by 176
Self-citationAdvanced graph and sequence neural networks for molecular property prediction and drug discovery
Wang, Z., Liu, M., Luo, Y., Zhao, X., Xie, Y., Wang, L., Cai, L., Qi, Q., Yuan, Z., Yang, T., et al. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac112 · Cited by 163
Self-citationDIG: A Turnkey Library for Diving into Graph Deep Learning ResearchPreprint
Liu, M., Luo, Y., Wang, L., Xie, Y., Yuan, H., Gui, S., Yu, H., Zhao, X., Zhang, J., Liu, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.12608 · Cited by 133
Self-citationA Multi-Scale Approach for Graph Link Prediction
Cai, L., & Ji, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5731 · Cited by 132
Self-citationEvolution of resilience in protein interactomes across the tree of life
Zitnik, M., Sosič, R., Feldman, M. W., & Leskovec, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1818013116 · Cited by 130
Second-Order Pooling for Graph Neural Networks
Wang, Z., & Ji, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2999032 · Cited by 123
Self-citationBootstrapped Representation Learning on GraphsPreprint
Thakoor, S., Tallec, C., Azar, M. G., Munos, R., Veličković, P., & Valko, M. (2021) · arXiv (Cornell University) · Cited by 118
Self-Supervised Graph Representation Learning via Global Context PredictionPreprint
Peng, Z., Dong, Y., Luo, M., Wu, X.-M., & Zheng, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01604 · Cited by 101
Topology-Aware Graph Pooling Networks
Gao, H., Liu, Y., & Ji, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3062794 · Cited by 98
Self-citationSelf-supervised Auxiliary Learning with Meta-paths for Heterogeneous GraphsPreprint
Hwang, D., Park, J., Kwon, S., Kim, K.-M., Ha, J.-W., & Kim, H. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08294 · Cited by 89
Self-Supervised Dialogue Learning
Wu, J., Wang, X. E., & Wang, W. Y. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1375 · Cited by 74
Self-Supervised Learning for Contextualized Extractive Summarization
Wang, H., Wang, X. E., Xiong, W., Yu, M., Guo, X., Chang, S., & Wang, W. Y. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1214 · Cited by 64
Graph Representation Learning via Hard and Channel-Wise Attention Networks
Gao, H., & Ji, S. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330897 · Cited by 57
Self-citationDeep Learning of High-Order Interactions for Protein Interface Prediction
Liu, Y., Yuan, H., Cai, L., & Ji, S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403110 · Cited by 48
Self-citationPre-training on Large-Scale Heterogeneous Graph
Jiang, X., Jia, T., Fang, Y., Shi, C., Lin, Z., & Wang, H. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467396 · Cited by 48
Learning Graph Pooling and Hybrid Convolutional Operations for Text Representations
Gao, H., Chen, Y., & Ji, S. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313395 · Cited by 44
Self-citationTask-Agnostic Graph Explanations
Xie, Y., Katariya, S., Tang, X., Huang, E. W., Rao, N., Subbian, K., & Ji, S. (2022) · neural information processing systems · doi:10.52202/068431-0874 · Cited by 12
Self-citationRectifying Pseudo Labels: Iterative Feature Clustering for Graph Representation Learning
Hu, Z., Kou, G., Zhang, H., Li, N., Yang, K., & Liu, L. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482469 · Cited by 11
MoleculeKit: Machine Learning Methods for Molecular Property Prediction and Drug DiscoveryPreprint
Wang, Z., Liu, M., Luo, Y., Zhao, X., Xie, Y., Wang, L., Cai, L., & Ji, S. (2020) · arXiv (Cornell University) · Cited by 7
Self-citationTopology-Aware Graph Pooling NetworksPreprint
Gao, H., Liu, Y., & Ji, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09834 · Cited by 6
Self-citation
Research works printed but not linked: 38
- Yang, Rethinking the value of labels for improving class-imbalanced learning, 19290
- Xie, 2020, Noise2Same: Optimizing a self-supervised bound for image denoising, 20320
- Laine, 2019, High-quality self-supervised deep image denoising, Adv. Neural Inf. Process. Syst., 32, 6970
- Batson, Noise2Self: Blind denoising by self-supervision, 524
- Hassani, Contrastive multi-view representation learning on graphs, 4116
- Chen, A simple framework for contrastive learning of visual representations, 1597
- Kipf, Semi-supervised classification with graph convolutional networks
- Xu, 2019, How powerful are graph neural networks?, Int. Conf. Learn. Representations
- Yuan, StructPool: Structured graph pooling via conditional random fields
- Veličković, 2019, Deep graph infomax, Int. Conf. Learn. Representations
- Sun, Infograph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization
- Hu, Strategies for pre-training graph neural networks
- You, Graph contrastive learning with augmentations, 5812
- 10.1109/ICCV.2019.00662 · DOI
- Hasanzadeh, Semi-implicit graph variational auto-encoders, 10 712
- Rong, Self-supervised graph transformer on large-scale molecular data, 12559
- Zhang, From canonical correlation analysis to self-supervised graph neural networks, 76
- Ganin, Unsupervised domain adaptation by backpropagation, 1180
- Hjelm, Learning deep representations by mutual information estimation and maximization
- Belghazi, Mutual information neural estimation, 531
- Gutmann, Noise-contrastive estimation: A new estimation principle for unnormalized statistical models, 297
- Sohn, 2016, Improved deep metric learning with multi-class n-pair loss objective, 1857
- Suresh, Adversarial graph augmentation to improve graph contrastive learning, 15920
- Xu, InfoGCL: Information-aware graph contrastive learning, 30414
- Jin, Junction tree variational autoencoder for molecular graph generation, 2323
- Li, Dirichlet graph variational autoencoder, 5274
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1
- Zbontar, Barlow twins: Self-supervised learning via redundancy reduction, 12310
- Tishby, The information bottleneck method, 368
- Morris, Tudataset: A collection of benchmark datasets for learning with graphs
- Yang, Revisiting semi-supervised learning with graph embeddings, 40
- Zeng, GraphSAINT: Graph sampling based inductive learning method
- 10.5555/3454287.3455008 · doi:10.5555/3454287.3455008
- Fey, Fast graph representation learning with PyTorch geometric
- You, GraphRNN: Generating realistic graphs with deep auto-regressive models, 5708
- Shi, Graphaf: A flow-based autoregressive model for molecular graph generation
- Luo, Graphdf: A discrete flow model for molecular graph generation, 7192
- 10.24963/ijcai.2021/371 · doi:10.24963/ijcai.2021/371
Cited by
Self-supervised learning in medicine and healthcare
Krishnan, R., Rajpurkar, P., & Topol, E. J. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00914-1 · Cited by 605
“Molecules can also be augmented by randomly removing some bonds, or by removing whole portions of atoms and bonds from parts of the molecule 25 .”
BackgroundGraph Self-Supervised Learning: A Survey
Liu, Y., Jin, M., Pan, S., Zhou, C., Zheng, Y., Xia, F., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3172903 · Cited by 510
Machine Learning Methods for Small Data Challenges in Molecular Science
Dou, B., Zhu, Z., Merkurjev, E., Ke, L., Chen, L., Jiang, J., Zhu, Y., Liu, J., Zhang, B., & Wei, G.-W. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00189 · Cited by 499
Self-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413
“While SSL has been extensively surveyed in the fields of CV, NLP [34], [9] and graph learning [35], [36], [37], there has not been a systematic investigation of research endeavors on SSR despite the growing number of publications.”
BackgroundZhao, Z., Alzubaidi, L., Zhang, J., Duan, Y., & Gu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122807 · Cited by 410
Self-citation
Metadata
- Authors
- Xie, Y., Xu, Z., Zhang, J., Wang, Z., & Ji, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-02-01
- Volume
- 45
- Issue
- 2
- Pages
- 2412-2429
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3129850062
- Cited by
- 389
- References
- 94
- FWCI
- 26.33
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Science Foundation (IIS-2006861, DBI-2028361)
- National Institutes of Health (1R21NS102828)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.