Co-embedding of edges and nodes with deep graph convolutional neural networks
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Graph neural networks (GNNs) have significant advantages in dealing with non-Euclidean data and have been widely used in various fields. However, most of the existing GNN models face two main challenges: (1) Most GNN models built upon the message-passing framework exhibit a shallow structure, which hampers their ability to efficiently transmit information between distant nodes. To address this, we aim to propose a novel message-passing framework, enabling the construction of GNN models with deep architectures akin to convolutional neural networks (CNNs), potentially comprising dozens or even hundreds of layers. (2) Existing models often approach the learning of edge and node features as separate tasks. To overcome this limitation, we aspire to develop a deep graph convolutional neural network learning framework capable of simultaneously acquiring edge embeddings and node embeddings. By utilizing the learned multi-dimensional edge feature matrix, we construct multi-channel filters to more effectively capture accurate node features. To address these challenges, we propose the Co-embedding of Edges and Nodes with Deep Graph Convolutional Neural Networks (CEN-DGCNN). In our approach, we propose a novel message-passing framework that can fully integrate and utilize both node features and multi-dimensional edge features. Based on this framework, we develop a deep graph convolutional neural network model that prevents over-smoothing and obtains node non-local structural features and refined high-order node features by extracting long-distance dependencies between nodes and utilizing multi-dimensional edge features. Moreover, we propose a novel graph convolutional layer that can learn node embeddings and multi-dimensional edge embeddings simultaneously. The layer updates multi-dimensional edge embeddings across layers based on node features and an attention mechanism, which enables efficient utilization and fusion of both node and edge features. Additionally, we propose a multi-dimensional edge feature encoding method based on directed edges, and use the resulting multi-dimensional edge feature matrix to construct a multi-channel filter to filter the node information. Lastly, extensive experiments show that CEN-DGCNN outperforms a large number of graph neural network baseline methods, demonstrating the effectiveness of our proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“For architecture modification, most of the existing methods mainly introduce the residual connection 23,24 in convolutional neural network (CNN) into GCN. Li et al. 15 borrowed from the concept of CNN, applied methods such as residual connection, dense connection, and dilated convolution to the GCN…”
MethodDensely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · cited 1×
“…features between nodes, we hope to build a deep GCN model, but when the model is too deep, it usually appears the phenomenon of over-smoothing 7,21,22 and over-squeezing 19 , and the node representation will become indistinguishable or distorted, resulting in a great degradation of network…”
BackgroundDeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
Graph Neural Networks: A Review of Methods and Applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2018) · arXiv · doi:10.48550/arxiv.1812.08434 · Cited by 6,880
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Modeling Relational Data with Graph Convolutional Networks
Schlichtkrull, M., Kipf, T. N., Bloem, P., van den Berg, R., Titov, I., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_38 · Cited by 5,570
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174
Convolutional Networks on Graphs for Learning Molecular Fingerprints
Duvenaud, D., Maclaurin, D., Aguilera-Iparraguirre, J., Gómez-Bombarelli, R., Hirzel, T., Aspuru-Guzik, A., & Adams, R. P. (2015) · arXiv · doi:10.48550/arxiv.1509.09292 · Cited by 2,628
Research works printed but not linked: 26
- Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O. & Dahl, G. E. Neural message passing for quantum chemistry. In Proceedings of the 34th International Conference on Machine Learning (eds. Precup, D. & Teh, Y. W.) vol. 70 1263–1272 (PMLR, 2017).
- Kipf, T. N. & Welling, M. Semi-supervised classification with graph convolutional networks. CoRR abs/1609.0 (2016).
- Veličković, P. et al. Graph attention networks. In 6th International Conference on Learning Representations, {ICLR} 2018, Vancouver, BC, Canada, April 30–May 3, 2018, Conference Track Proceedings (OpenReview.net, 2018).
- Li, Q., Han, Z. & Wu, X.-M. Deeper insights into graph convolutional networks for semi-supervised learning. In Proceedings of the Thirty-Second {AAAI} Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th {AAAI} Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New (eds. McIlraith, S. A. & Weinberger, K. Q.) 3538–3545 ({AAAI} Press, 2018).
- Rusch, T. K., Chamberlain, B., Rowbottom, J., Mishra, S. & Bronstein, M. M. Graph-coupled oscillator networks. In International Conference on Machine Learning, {ICML} 2022, 17–23 July 2022, Baltimore, Maryland, {USA} (eds. Chaudhuri, K. et al.) vol. 162, 18888–18909 (PMLR, 2022).
- Rusch, T. K., Chamberlain, B. P., Mahoney, M. W., Bronstein, M. M. & Mishra, S. Gradient gating for deep multi-rate learning on graphs. In The Eleventh International Conference on Learning Representations, {ICLR} 2023, Kigali, Rwanda, May 1–5, 2023 (OpenReview.net, 2023).
- Bodnar, C., Giovanni, F. Di, Chamberlain, B. P., Lió, P. & Bronstein, M. M. Neural sheaf diffusion: {A} Topological perspective on heterophily and oversmoothing in GNNs. in NeurIPS (2022).
- Giovanni, F., Di Rowbottom, J. & Chamberlain, B. P., Markovich, T. & Bronstein, M. M. Graph neural networks as gradient flows. CoRR abs/2206.1 (2022).
- Oono, K. & Suzuki, T. Graph neural networks exponentially lose expressive power for node classification. In 8th International Conference on Learning Representations, {ICLR} 2020, Addis Ababa, Ethiopia, April 26–30, 2020 (OpenReview.net, 2020).
- Alon, U. & Yahav, E. On the Bottleneck of graph neural networks and its practical implications. In 9th International Conference on Learning Representations, {ICLR} 2021, Virtual Event, Austria, May 3–7, 2021 (OpenReview.net, 2021).
- Chen, M., Wei, Z., Huang, Z., Ding, B. & Li, Y. Simple and deep graph convolutional networks. In Proceedings of the 37th International Conference on Machine Learning, {ICML} 2020, 13–18 July 2020, Virtual Event vol. 119, 1725–1735 (PMLR, 2020).
- Zhao, L. & Akoglu, L., PairNorm: Tackling oversmoothing in GNNs. In 8th International Conference on Learning Representations, {ICLR} 2020, Addis Ababa, Ethiopia, April 26–30, 2020 (OpenReview.net, 2020).
- Li, G., Xiong, C., Thabet, A. K. & Ghanem, B. DeeperGCN: All you need to train deeper GCNs. CoRR abs/2006.0 (2020).
- Srivastava, N., Hinton, G. E., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014).
- Rong, Y., Huang, W., Xu, T. & Huang, J. DropEdge: Towards deep graph convolutional networks on node classification. In 8th International Conference on Learning Representations, {ICLR} 2020, Addis Ababa, Ethiopia, April 26–30, 2020 (OpenReview.net, 2020).
- Huang, W., Rong, Y., Xu, T., Sun, F. & Huang, J. Tackling over-smoothing for general graph convolutional networks. CoRR abs/2008.0, (2020).
- Corso, G., Cavalleri, L., Beaini, D., Liò, P. & Veličković, P. Principal neighbourhood aggregation for graph nets. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6–12, 2020, virtual (eds. Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.-F. & Lin, H.-T.) (2020).
- Bahdanau, D., Cho, K. & Bengio, Y. Neural machine translation by jointly learning to align and translate. In 3rd International Conference on Learning Representations, {ICLR} 2015, San Diego, CA, USA, May 7–9, 2015, Conference Track Proceedings (eds. Bengio, Y. & LeCun, Y.) (2015).
- Yang, Y. & Li, D. {NENN:} Incorporate node and edge features in graph neural networks. In Proceedings of the 12th Asian Conference on Machine Learning, {ACML} 2020, 18–20 November 2020, Bangkok, Thailand (eds. Pan, S. J. & Sugiyama, M.) vol. 129 593–608 (PMLR, 2020).
- Klicpera, J., Bojchevski, A. & Günnemann, S. Predict then propagate: Graph neural networks meet personalized pagerank. In 7th International Conference on Learning Representations, {ICLR} 2019, New Orleans, LA, USA, May 6–9, 2019 (OpenReview.net, 2019).
- Kingma, D. P. & Ba, J. Adam: {A} method for stochastic optimization. In 3rd International Conference on Learning Representations, {ICLR} 2015, San Diego, CA, USA, May 7–9, 2015, Conference Track Proceedings (eds. Bengio, Y. & LeCun, Y.) (2015).
- Klicpera, J., Weißenberger, S. & Günnemann, S. Diffusion improves graph learning. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8–14, 2019, Vancouver, BC, Canada (eds. Wallach, H. M. et al.) 13333–13345 (2019).
- Kipf, T. N. & Welling, M. Variational graph auto-encoders. CoRR abs/1611.0 (2016).
- Hamilton, W., Ying, Z. & Leskovec, J. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems (eds. Guyon, I. et al.) vol. 30 (Curran Associates, Inc., 2017).
- Li, G., Müller, M., Ghanem, B. & Koltun, V. Training graph neural networks with 1000 layers. In Proceedings of the 38th International Conference on Machine Learning, {ICML} 2021, 18–24 July 2021, Virtual Event (eds. Meila, M. & Zhang, T.) vol. 139, 6437–6449 (PMLR, 2021).
- Chen, J., Ma, T. & Xiao, C. FastGCN: Fast learning with graph convolutional networks via importance sampling. In 6th International Conference on Learning Representations, {ICLR} 2018, Vancouver, BC, Canada, April 30–May 3, 2018, Conference Track Proceedings (OpenReview.net, 2018).
Cited by
Simon, B. D., Ozyoruk, K. B., Gelikman, D. G., Harmon, S. A., & Türkbey, B. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.242631 · Cited by 73
“37 They can explicitly model the complex relationships between modalities, rather than attempting to map them in grid-like structures, such as CNNs, which may not fully take the structure into account 38 and could introduce biases related to artificial adjacency in grid formatting.”
BackgroundGoeckner, A., Sui, Y., Martinet, N., Li, X. D., & Zhu, Q. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802510 · Cited by 65
“Zhou et al. proposed a GNN framework [6] that integrates node and edge features to boost long-distance information transmission and enhance node embeddings.”
Rethinking Reconstruction-based Graph-Level Anomaly Detection: Limitations and a Simple Remedy
Kim, S., Lee, S. Y., Bu, F., Kang, S., Kim, K., Yoo, J., & Shin, K. (2024) · neural information processing systems · doi:10.52202/079017-3040 · Cited by 38
Self-citationUsing DeepSignalingFlow to mine signaling flows interpreting mechanism of synergy of cocktails
Zhang, H., Chen, Y., Payne, P., & Li, F. (2024) · npj Systems Biology and Applications · doi:10.1038/s41540-024-00421-w · Cited by 18
Multilayer biological network alignment based on similarity computation via Graph Neural Networks
Cinaglia, P. (2024) · Journal of Computational Science · doi:10.1016/j.jocs.2024.102259 · Cited by 16
Metadata
- Authors
- Zhou, Y., Huo, H., Hou, Z., Bu, L., Mao, J., Wang, Y., Lv, X., & Bu, F.
- Affiliations
- China People's Public Security University (CN)
- China Academy of Railway Sciences (CN)
- Corresponding author
- Bu, Fanliang
- Venue
- Scientific Reports
- Published
- 2023-10-08
- Volume
- 13
- Issue
- 1
- Pages
- 16966-16966
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC10560674
- OpenAlex
- W4387439537
- Cited by
- 33
- References
- 36
- Citations by year
- 2026: 11 · 2025: 13 · 2024: 9
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Natural Science Foundation of China-China State Railway Group Co., Ltd. Railway Basic Research Joint Fund (No.U2268217)
- Scientific Funding for China Academy of Railway Sciences Corporation Limited (No.2021YJ183)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Graph Theory and Algorithms
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Keywords
- graph neural networks, edge embeddings, node embeddings, co-embedding, message passing, attention mechanism, over-smoothing, long-distance dependencies, multichannel filters, directed edges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Co-embedding of edges and nodes with deep graph convolutional neural networks. https://app.cochat.ai/papers/10.1038/s41598-023-44224-1
- The paper
- Zhou, Y., Huo, H., Hou, Z., Bu, L., Mao, J., Wang, Y., Lv, X., & Bu, F. (2023). Co-embedding of edges and nodes with deep graph convolutional neural networks. Scientific Reports. https://doi.org/10.1038/s41598-023-44224-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.