The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.
BertGCN: Transductive Text Classification by Combining GNN and BERT
Open accessAbstract
In this work, we propose BertGCN, a model that combines large scale pretraining and transductive learning for text classification.Bert-GCN constructs a heterogeneous graph over the dataset and represents documents as nodes using BERT representations.By jointly training the BERT and GCN modules within Bert-GCN, the proposed model is able to leverage the advantages of both worlds: large-scale pretraining which takes the advantage of the massive amount of raw data and transductive learning which jointly learns representations for both training data and unlabeled test data by propagating label influence through graph convolution.Experiments show that BertGCN achieves SOTA performances on a wide range of text classification datasets.1
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It also captures semantic relations previously not emphasized by existing sequential models [28], [29].”
From Emotion Classification With Visibility Graphs (2025) · cites this paper as [28]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Wu, Y., & Vapnik, V. N. (1999) · Technometrics · doi:10.2307/1271368 · Cited by 27,236
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Graph Attention NetworksPreprint
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 19,745
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting
Yu, B., Yin, H., & Zhu, Z. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/505 · Cited by 6,054
Formal Semantics for Kolmogorov-Arnold Network Representations of Operational GamesPreprint
Xu, K., Hu, W., Leskovec, J., & Jegelka, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00826 · Cited by 5,932
Variational Graph Auto-EncodersPreprint
Kipf, T., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07308 · Cited by 4,300
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174
Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning
Li, Q., Han, Z., & Wu, X.-M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11604 · Cited by 2,872
Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic ForecastingPreprint
Li, Y., Yu, R., Shahabi, C., & Liu, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01926 · Cited by 2,597
Simplifying Graph Convolutional NetworksPreprint
Wu, F., Zhang, T., Junior, A. H. D. S., Fifty, C., Yu, T., & Weinberger, K. Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07153 · Cited by 2,307
Self-citationGraph Convolutional Networks for Text Classification
Yao, L., Mao, C., & Luo, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017370 · Cited by 2,224
Pang, B., & Lee, L. (2005) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1219840.1219855 · Cited by 2,213
Deep Neural Networks for Learning Graph Representations
Cao, S., Lu, W., & Xu, Q. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10179 · Cited by 1,077
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction
Zhang, Y., Qi, P., & Manning, C. D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1244 · Cited by 931
Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling
Marcheggiani, D., & Titov, I. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1159 · Cited by 907
A C-LSTM Neural Network for Text ClassificationPreprint
Zhou, C., Sun, C., Liu, Z., & Lau, F. C. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08630 · Cited by 882
Tang, J., Qu, M., & Mei, Q. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783307 · Cited by 809
Pang, B., & Lee, L. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0506075 · Cited by 744
Learning Deep Generative Models of GraphsPreprint
Li, Y., Vinyals, O., Dyer, C., Pascanu, R., & Battaglia, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03324 · Cited by 679
GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal GraphsPreprint
Zhang, J., Shi, X., Xie, J., Ma, H., King, I., & Yeung, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07294 · Cited by 636
Geometric Matrix Completion with Recurrent Multi-Graph Neural NetworksPreprint
Monti, F., Bronstein, M., & Bresson, X. (2017) · Neural Information Processing Systems · doi:10.48550/arxiv.1704.06803 · Cited by 558
Joint Embedding of Words and Labels for Text Classification
Wang, G., Li, C., Wang, W., Zhang, Y., Shen, D., Zhang, X., Henao, R., & Carin, L. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1216 · Cited by 483
DON’T FOLLOW ME - Spam Detection in Twitter
Wang, A. H. (2010) · International Conference on Security and Cryptography · doi:10.5220/0002996201420151 · Cited by 469
MolGAN: An implicit generative model for small molecular graphs
De Cao, N., & Kipf, T. (2018) · arXiv · doi:10.48550/arxiv.1805.11973 · Cited by 442
Text Level Graph Neural Network for Text Classification
Huang, L., Ma, D., Li, S., Zhang, X., & Wang, H. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1345 · Cited by 348
Tensor Graph Convolutional Networks for Text Classification
Liu, X., You, X., Zhang, X., Wu, J. Y., & Lv, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6359 · Cited by 308
Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks
Monti, F., Bronstein, M. M., & Bresson, X. (2017) · neural information processing systems · Cited by 232
VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification
Lu, Z., Du, P., & Nie, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45439-5_25 · Cited by 162
Opinion mining and sentiment analysis
Bakshi, R. K., Kaur, N., Kaur, R., & Kaur, G. (2016) · International Conference on Computing for Sustainable Global Development · Cited by 154
Opinion Mining and Sentiment Analysis
Zhai, C., & Massung, S. (2016) · doi:10.1145/2915031.2915050 · Cited by 88
Song, L., Wang, Z., Yu, M., Zhang, Y., Florian, R., & Gildea, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02040 · Cited by 82
GILE: A Generalized Input-Label Embedding for Text Classification
Pappas, N., & Henderson, J. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00259 · Cited by 81
Zero-shot Text Classification via Reinforced Self-training
Ye, Z., Geng, Y., Chen, J., Chen, J., Xu, X., Zheng, S., Wang, F., Zhang, J., & Chen, H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.272 · Cited by 81
Text Graph Transformer for Document Classification
Zhang, H., & Zhang, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.668 · Cited by 70
Uncertainty-aware Self-training for Text Classification with Few LabelsPreprint
Mukherjee, S., & Awadallah, A. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15315 · Cited by 50
Description Based Text Classification with Reinforcement LearningPreprint
Chai, D., Wu, W., Han, Q., Wu, F. Q., & Li, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03067 · Cited by 46
Self-citationComprehensive Information Integration Modeling Framework for Video Titling
Zhang, S., Tan, Z., Zhao, Z., Yu, J., Kuang, K., Jiang, T., Zhou, J., Yang, H., & Wu, F. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403325 · Cited by 36
Self-citationEnhancing Generalization in Natural Language Inference by Syntax
He, Q., Wang, H., & Zhang, Y. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.447 · Cited by 14
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Research works printed but not linked: 6
- PMLR.
- Nicola De Cao, Wilker Aziz, and Ivan Titov. 2018. Question answering by reasoning across documents with graph convolutional networks. arXiv preprint arXiv:1808.09920. · arXiv
- Diego Marcheggiani and Laura Perez-Beltrachini. 2018. Deep graph convolutional encoders for struc- tured data to text generation. In Proceedings of the 11th International Conference on Natural Language Generation, pages 1-9, Tilburg University, The Nether- lands. Association for Computational Linguistics.
- Jian Tang, Meng Qu, and Qiaozhu Mei. 2015. Pte: Pre- dictive text embedding through large-scale heteroge- neous text networks. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Dis- covery and Data Mining, pages 1165-1174.
- Hanna M Wallach. 2006. Topic modeling: beyond bag- of-words. In Proceedings of the 23rd international con- ference on Machine learning, pages 977-984.
- Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2017. Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. arXiv preprint arXiv:1709.04875. · arXiv
Cited by
Sorted by citations
Pre-Trained Language Models and Their Applications
Wang, H., Li, J., Wu, H. R., Hovy, E. H., & Sun, Y. (2022) · Engineering · doi:10.1016/j.eng.2022.04.024 · Cited by 435
Self-citationA Survey on Text Classification Algorithms: From Text to Predictions
Gasparetto, A., Marcuzzo, M., Zangari, A., & Albarelli, A. (2022) · Information · doi:10.3390/info13020083 · Cited by 305
Wang, R., Jiang, Y., Jin, J., Yin, C., Yu, H., Wang, F., Feng, J., Su, R., Nakai, K., Zou, Q., et al. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad055 · Cited by 178
CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendation
Zhang, S., Yao, D., Zhao, Z., Chua, T.-S., & Wu, F. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462908 · Cited by 141
Self-citationOnan, A. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101610 · Cited by 103
Metadata
- Authors
- Lin, Y., Meng, Y., Sun, X., Han, Q., Kuang, K., Li, J., & Wu, F.
- Affiliations
- Zhejiang University (CN)
- Venue
- Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
- Published
- 2021
- Pages
- 1456-1462
- OpenAlex
- W3173753074
- Cited by
- 228
- References
- 52
- Citations by year
- 2026: 20 · 2025: 60 · 2024: 63 · 2023: 50 · 2022: 32 · 2021: 3
- FWCI
- 17.09
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Keywords
- text classification, graph convolutional networks, BERT, transductive learning, heterogeneous graphs, document representation, label propagation, pre-training, unlabeled test data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
