Cited by 230Advanced Graph Neural NetworksTopic ModelingText and Document Classification Technologies

BertGCN: Transductive Text Classification by Combining GNN and BERT

Open access
Lin, Yuxiao, Meng, Yuxian, Sun, Xiaofei, Han, Qinghong, Kuang, Kun, Li, Jiwei, Wu, Fei·2021·Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021

Abstract

In this work, we propose BertGCN, a model that combines large scale pretraining and transductive learning for text classification.Bert-GCN constructs a heterogeneous graph over the dataset and represents documents as nodes using BERT representations.By jointly training the BERT and GCN modules within Bert-GCN, the proposed model is able to leverage the advantages of both worlds: large-scale pretraining which takes the advantage of the massive amount of raw data and transductive learning which jointly learns representations for both training data and unlabeled test data by propagating label influence through graph convolution.Experiments show that BertGCN achieves SOTA performances on a wide range of text classification datasets.1

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/2021.findings-acl.126

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • EmoVis captures semantic relations previously not emphasized by existing sequential models.

    “It also captures semantic relations previously not emphasized by existing sequential models [28], [29].”

    From Emotion Classification With Visibility Graphs (2025) · cites this paper as [28]

    The Introduction says GNNs capture relations between graph nodes, and Section 3.1 describes BertGCN using graph structure to update document representations. The paper does not assess EmoVis or establish that existing sequential models neglect the semantic relations claimed here. (LLM, conf=0.80)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

3 of the 52 references couldn’t be matched to a known paper.

Research works printed but not linked: 6

  1. PMLR.
  2. Nicola De Cao, Wilker Aziz, and Ivan Titov. 2018. Question answering by reasoning across documents with graph convolutional networks. arXiv preprint arXiv:1808.09920. · arXiv
  3. Diego Marcheggiani and Laura Perez-Beltrachini. 2018. Deep graph convolutional encoders for struc- tured data to text generation. In Proceedings of the 11th International Conference on Natural Language Generation, pages 1-9, Tilburg University, The Nether- lands. Association for Computational Linguistics.
  4. Jian Tang, Meng Qu, and Qiaozhu Mei. 2015. Pte: Pre- dictive text embedding through large-scale heteroge- neous text networks. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Dis- covery and Data Mining, pages 1165-1174.
  5. Hanna M Wallach. 2006. Topic modeling: beyond bag- of-words. In Proceedings of the 23rd international con- ference on Machine learning, pages 977-984.
  6. Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2018. Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting. In Proceed- ings of the 27th International Joint Conference on Arti- ficial Intelligence, pages 3634-3640.

Cited by

Sorted by citations

Authors
Lin, Y., Meng, Y., Sun, X., Han, Q., Kuang, K., Li, J., & Wu, F.
Affiliations
Zhejiang University (CN)
Venue
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Published
2021
Pages
1456-1462
OpenAlex
W3173753074
Cited by
228
References
52
Citations by year
2026: 20 · 2025: 60 · 2024: 63 · 2023: 50 · 2022: 32 · 2021: 3
FWCI
17.09
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
Keywords
text classification, graph convolutional networks, BERT, transductive learning, heterogeneous graphs, document representation, label propagation, pre-training, unlabeled test data

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review