The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing
Open accessAbstract
Deep learning systems have been successfully applied to Euclidean data such as images, video, and audio. In many applications, however, information and their relationships are better expressed with graphs. Graph Convolutional Networks (GCNs) appear to be a promising approach to efficiently learn from graph data structures, having shown advantages in many critical applications. As with other deep learning modalities, hardware acceleration is critical. The challenge is that real-world graphs are often extremely large and unbalanced; this poses significant performance demands and design challenges. In this paper, we propose Autotuning-Workload-Balancing GCN (AWB-GCN) to accelerate GCN inference. To address the issue of workload imbalance in processing real-world graphs, three hardware-based autotuning techniques are proposed: dynamic distribution smoothing, remote switching, and row remapping. In particular, AWB-GCN continuously monitors the sparse graph pattern, dynamically adjusts the workload distribution among a large number of processing elements (up to 4K PEs), and, after converging, reuses the ideal configuration. Evaluation is performed using an Intel D5005 FPGA with five commonly-used datasets. Results show that 4K-PE AWB-GCN can significantly elevate PE utilization by 7.7× on average and demonstrate considerable performance speedups over CPUs (3255×), GPUs (80.3×), and a prior GCN accelerator (5.1×).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“Deep learning paradigms such as Convolutional Neural Networks (CNNs) [1] and Recurrent Neural Networks (RNNs) [2] have been applied to a wide range of applications including image classification, video processing, speech recognition, and natural language processing [3]–[7].”
BackgroundTargeted Branching for the Maximum Independent Set Problem Using Graph Neural Networks
Silva, G., Rodrigues, M., Teixeira, A., & Amorim, M. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.sea.2024.20 · Cited by 5,183
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
Spectral Networks and Locally Connected Networks on Graphs
Bruna, J., Zaremba, W., Szlam, A., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6203 · Cited by 3,983
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Formal Semantics for Kolmogorov-Arnold Network Representations of Operational Games
Zhukov, G. A. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15206559 · Cited by 3,212
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174
Xie, T., & Grossman, J. C. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.145301 · Cited by 2,828
A new model for learning in graph domains
Gori, M., Monfardini, G., & Scarselli, F. (2006) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1555942 · Cited by 2,075
EIE: efficient inference engine on compressed deep neural network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001163 · Cited by 1,937
Modeling polypharmacy side effects with graph convolutional networks
Zitnik, M., Agrawal, M., & Leskovec, J. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty294 · Cited by 1,501
PowerGraph: distributed graph-parallel computation on natural graphs
Gonzalez, J. E., Low, Y., Gu, H., Bickson, D., & Guestrin, C. (2012) · doi:10.5555/2387880.2387883 · Cited by 1,451
Deep Convolutional Networks on Graph-Structured Data
Henaff, M., Bruna, J., & LeCun, Y. (2015) · arXiv · doi:10.48550/arxiv.1506.05163 · Cited by 1,255
Adamic, L. A., Lukose, R. M., Puniyani, A. R., & Huberman, B. A. (2001) · Physical Review E · doi:10.1103/physreve.64.046135 · Cited by 1,203
Fast Graph Representation Learning with PyTorch Geometric
Fey, M., & Lenssen, J. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02428 · Cited by 1,132
EIE: Efficient Inference Engine on Compressed Deep Neural Network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.30 · Cited by 1,077
Measuring the Gap Between FPGAs and ASICs
Kuon, I., & Rose, J. (2007) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2006.884574 · Cited by 1,005
Implementing sparse matrix-vector multiplication on throughput-oriented processors
Bell, N., & Garland, M. (2009) · Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis · doi:10.1145/1654059.1654078 · Cited by 900
SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks
Parashar, A., Rhu, M., Mukkara, A., Puglielli, A., Venkatesan, R., Khailany, B., Emer, J., Keckler, S. W., & Dally, W. J. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080254 · Cited by 896
A graph-convolutional neural network model for the prediction of chemical reactivity
Coley, C. W., Jin, W., Rogers, L., Jamison, T. F., Jaakkola, T. S., Green, W. H., Barzilay, R., & Jensen, K. F. (2019) · Chemical Science · doi:10.1039/c8sc04228d · Cited by 679
Neural Network for Graphs: A Contextual Constructive Approach
Micheli, A. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2010350 · Cited by 639
Large-Scale Learnable Graph Convolutional Networks
Gao, H., Wang, Z., & Ji, S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219947 · Cited by 638
Cnvlutin: ineffectual-neuron-free deep neural network computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001138 · Cited by 614
Cambricon-X: An accelerator for sparse neural networks
Zhang, S., Du, Z., Zhang, L., Lan, H., Liu, S., Li, L., Guo, Q., Chen, T., & Chen, Y. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783723 · Cited by 603
SIGMA: A Sparse and Irregular GEMM Accelerator with Flexible Interconnects for DNN Training
Qin, E., Samajdar, A., Kwon, H., Nadella, V., Srinivasan, S., Das, D., Kaul, B., & Krishna, T. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00015 · Cited by 487
Yun, S., Jeong, M., Kim, R., Kang, J., & Kim, H. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.06455 · Cited by 471
Main-memory triangle computations for very large (sparse (power-law)) graphs
Latapy, M. (2008) · Theoretical Computer Science · doi:10.1016/j.tcs.2008.07.017 · Cited by 458
Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification
Zhuang, C., & Ma, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186116 · Cited by 423
A Random Graph Model for Power Law Graphs
Aiello, W., Chung, F., & Lu, L. (2001) · Experimental Mathematics · doi:10.1080/10586458.2001.10504428 · Cited by 405
HyGCN: A GCN Accelerator with Hybrid Architecture
Yan, M., Deng, L., Hu, X., Liang, L., Feng, Y., Ye, X., Zhang, Z., Fan, D., & Xie, Y. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00012 · Cited by 335
Understanding Reuse, Performance, and Hardware Cost of DNN Dataflow: A Data-Centric Approach
Kwon, H., Chatarasi, P., Pellauer, M., Parashar, A., Sarkar, V., & Krishna, T. (2019) · Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3352460.3358252 · Cited by 301
GraphR: Accelerating Graph Processing Using ReRAM
Song, L., Zhuo, Y., Qian, X., Li, H., & Chen, Y. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00052 · Cited by 295
OuterSPACE: An Outer Product Based Sparse Matrix Multiplication Accelerator
Pal, S., Beaumont, J., Park, D.-H., Amarnath, A., Feng, S., Chakrabarti, C., Kim, H.-S., Blaauw, D., Mudge, T., & Dreslinski, R. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00067 · Cited by 292
Graphicionado: A high-performance and energy-efficient accelerator for graph analytics
Ham, T. J., Wu, L., Sundaram, N., Satish, N., & Martonosi, M. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783759 · Cited by 277
AliGraph: A Comprehensive Graph Neural Network Platform
Yang, H. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3340404 · Cited by 265
Efficient Sparse Matrix-Vector Multiplication on GPUs Using the CSR Storage Format
Greathouse, J. L., & Daga, M. (2014) · SC14: International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2014.68 · Cited by 246
Sparse Matrix-Vector multiplication on FPGAs
Zhuo, L., & Prasanna, V. K. (2005) · Proceedings of the 2005 ACM/SIGDA 13th international symposium on Field-programmable gate arrays · doi:10.1145/1046192.1046202 · Cited by 225
Watch Your Step: Learning Node Embeddings via Graph AttentionPreprint
Abu-El-Haija, S., Perozzi, B., Al‐Rfou, R., & Alemi, A. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09599 · Cited by 219
MAESTRO: A Data-Centric Approach to Understand Reuse, Performance, and Hardware Cost of DNN Mappings
Kwon, H., Chatarasi, P., Sarkar, V., Krishna, T., Pellauer, M., & Parashar, A. (2020) · IEEE Micro · doi:10.1109/mm.2020.2985963 · Cited by 211
The Spectra of Random Graphs with Given Expected Degrees
Chung, F., Lu, L., & Vu, V. (2004) · Internet Mathematics · doi:10.1080/15427951.2004.10129089 · Cited by 207
Distributed Power-law Graph Computing: Theoretical and Empirical Analysis
Xie, C., Yan, L., Li, W.-J., & Zhang, Z. (2014) · neural information processing systems · Cited by 177
C ir CNN: accelerating and compressing deep neural networks using block-circulant weight matrices
Ding, C., Liao, S., Wang, Y., Li, Z., Liu, N., Zhuo, Y., Wang, C., Qian, X., Bai, Y., Yuan, G., et al. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3124552 · Cited by 176
Fast Sparse Matrix-Vector Multiplication on GPUs for Graph Applications
Ashari, A., Sedaghati, N., Eisenlohr, J., Parthasarathy, S., & Sadayappan, P. (2014) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc.2014.69 · Cited by 171
Kung, H. T., McDanel, B., & Zhang, S. Q. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304028 · Cited by 168
Graphicionado: a high-performance and energy-efficient accelerator for graph analytics
Ham, T. J., Wu, L., Sundaram, N., Satish, N., & Martonosi, M. (2016) · doi:10.5555/3195638.3195707 · Cited by 165
Stochastic Training of Graph Convolutional Networks with Variance Reduction
Chen, J., Zhu, J., & Song, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10568 · Cited by 165
Learning Steady-States of Iterative Algorithms over Graphs
Dai, H., Kozareva, Z., Dai, B., Smola, A. J., & Song, L. (2018) · International Conference on Machine Learning · Cited by 151
Stochastic Training of Graph Convolutional Networks with Variance Reduction
Chen, J., Zhu, J., & Song, L. (2018) · International Conference on Machine Learning · Cited by 142
An Efficient GPU General Sparse Matrix-Matrix Multiplication for Irregular Data
Liu, W., & Vinter, B. (2014) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2014.47 · Cited by 134
A Systematic Survey of General Sparse Matrix-matrix Multiplication
Gao, J., Ji, W., Chang, F., Shi-yu, H., Wei, B., Liu, Z., & Wang, Y. (2022) · ACM Computing Surveys · doi:10.1145/3571157 · Cited by 129
IoT Botnet Detection Approach Based on PSI graph and DGCNN classifier
Nguyen, H., Ngo, Q.-D., & Le, V.-H. (2018) · International Conference on Information Communication and Signal Processing (ICICSP) · doi:10.1109/icicsp.2018.8549713 · Cited by 102
FPDeep: Acceleration and Load Balancing of CNN Training on FPGA Clusters
Geng, T., Wang, T., Sanaullah, A., Yang, C., Xu, R., Patel, R., & Herbordt, M. (2018) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2018.00021 · Cited by 81
Self-citationA novel zero weight/activation-aware hardware architecture of convolutional neural network
Kim, D., Ahn, J., & Yoo, S. (2017) · Design, Automation, and Test in Europe · doi:10.23919/date.2017.7927222 · Cited by 61
GraphRNN: A Deep Generative Model for GraphsPreprint
You, J., Ying, R., Ren, X., Hamilton, W. L., & Leskovec, J. (2018) · arXiv (Cornell University) · Cited by 60
O3BNN-R: An Out-of-Order Architecture for High-Performance and Regularized BNN Inference
Geng, T., Li, A., Wang, T., Wu, C., Li, Y., Shi, R., Wu, W., & Herbordt, M. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3013637 · Cited by 50
Self-citationBSTC: a novel binarized-soft-tensor-core design for accelerating bit-based approximated neural nets
Li, A., Geng, T., Wang, T., Herbordt, M., Song, S. L., & BARKER, K. J. (2019) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3295500.3356169 · Cited by 47
Self-citationA More Realistic Thinning Scheme for Call Admission Control in Multimedia Wireless Networks
Xian, W., Fan, P., & Pan, Y. F. (2008) · IEEE Transactions on Computers · doi:10.1109/tc.2008.29 · Cited by 39
Geng, T., Wang, T., Wu, C., Yang, C., Wu, W., Li, A., & Herbordt, M. (2019) · International Conference on Supercomputing · doi:10.1145/3330345.3330386 · Cited by 21
Self-citationGuiding Cascading Failure Search with Interpretable Graph Convolutional NetworkPreprint
Liu, Y.-X., Zhang, N., Wu, D., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.11553 · Cited by 15
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
Computing Graph Neural Networks: A Survey from Algorithms to Accelerators
Abadal, S., Jain, A., Guirado, R., López-Alonso, J., & Alarcón, E. (2022) · ACM Computing Surveys · doi:10.1145/3477141 · Cited by 285
Adaptable butterfly accelerator for attention-based NNs via hardware and algorithm co-design
Fan, H., Chau, T., Venieris, S. I., Lee, R., Kouris, A., Luk, W., Lane, N. D., & Abdelfattah, M. S. (2022) · 2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro56248.2022.00050 · Cited by 66
Metadata
- Authors
- Geng, T., Li, A., Shi, R., Wu, C., Wang, T., Li, Y., Haghi, P., Tumeo, A., Che, S., Reinhardt, S., & Herbordt, M. C.
- Venue
- 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)
- Publisher
- IEEE
- Published
- 2020-10
- Pages
- 922-936
- ISSN
- 1072-4451 (ISSN-L)
- OpenAlex
- W3105753905
- Cited by
- 301
- References
- 65
- FWCI
- 33.45
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.