CoChat

A Customizable Matrix Multiplication Framework for the Intel HARPv2 Xeon+FPGA Platform: A Deep Learning Case Study

Moss, Duncan J.M, Krishnan, Srivatsan, Nurvitadhi, Eriko, Ratuszniak, Piotr, Johnson, Chris, Sim, Jaewoong, Mishra, Asit, Marr, Debbie, Subhaschandra, Suchit, Leong, Philip H.W. · 2018 · Proceedings of the 2018 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays
Cited by 78

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

General Matrix to Matrix multiplication (GEMM) is the cornerstone for a wide gamut of applications in high performance computing (HPC), scientific computing (SC) and more recently, deep learning. In this work, we present a customizable matrix multiplication framework for the Intel HARPv2 CPU+FPGA platform that includes support for both traditional single precision floating point and reduced precision workloads. Our framework supports arbitrary size GEMMs and consists of two parts: (1) a simple application programming interface (API) for easy configuration and integration into existing software and (2) a highly customizable hardware template. The API provides both compile and runtime options for controlling key aspects of the hardware template including dynamic precision switching; interleaving and block size control; and fused deep learning specific operations. The framework currently supports single precision floating point (FP32), 16, 8, 4 and 2 bit Integer and Fixed Point (INT16, INT8, INT4, INT2) and more exotic data types for deep learning workloads: INT16xTernary, INT8xTernary, BinaryxBinary.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3174243.3174258

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 6 references

Research works printed but not linked: 20

  1. 10.1145/567806.567807 · DOI · Paper page
  2. Firas Abuzaid Stefan Hadjis Ce Zhang and Christopher Ré. 2015. Caffe con Troll: Shallow Ideas to Speed Up Deep Learning. CoRR abs/1504.04343 (2015). http://arxiv.org/abs/1504.04343 Firas Abuzaid Stefan Hadjis Ce Zhang and Christopher Ré. 2015. Caffe con Troll: Shallow Ideas to Speed Up Deep Learning. CoRR abs/1504.04343 (2015). http://arxiv.org/abs/1504.04343 · arXiv
  3. 10.1145/3020078.3021738 · DOI · Paper page
  4. Sharan Chetlur Cliff Woolley Philippe Vandermersch Jonathan Cohen John Tran Bryan Catanzaro and Evan Shelhamer. 2014. cuDNN: Efficient Primitives for Deep Learning. CoRR abs/1410.0759 (2014). http://arxiv.org/abs/1410.0759 Sharan Chetlur Cliff Woolley Philippe Vandermersch Jonathan Cohen John Tran Bryan Catanzaro and Evan Shelhamer. 2014. cuDNN: Efficient Primitives for Deep Learning. CoRR abs/1410.0759 (2014). http://arxiv.org/abs/1410.0759 · arXiv
  5. 10.1145/2897937.2897972 · DOI
  6. Matthieu Courbariaux Yoshua Bengio and Jean-Pierre David. 2015. BinaryConnect: Training Deep Neural Networks with Binary Weights During Propagations. In NIPS. Matthieu Courbariaux Yoshua Bengio and Jean-Pierre David. 2015. BinaryConnect: Training Deep Neural Networks with Binary Weights During Propagations. In NIPS.
  7. Matthieu Courbariaux Itay Hubara Daniel Soudry Ran El-Yaniv and Yoshua Bengio. 2016. Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1. arXiv:1602.02830 (2016). Matthieu Courbariaux Itay Hubara Daniel Soudry Ran El-Yaniv and Yoshua Bengio. 2016. Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1. arXiv:1602.02830 (2016). · arXiv
  8. 10.1145/3029580.3029586 · DOI
  9. Yijin Guan Hao Liang Ningyi Xu Wenqiang Wang Shaoshuai Shi Xi Chen Guangyu Sun Wei Zhang and Jason Cong. 2017. FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates. In FCCM. Yijin Guan Hao Liang Ningyi Xu Wenqiang Wang Shaoshuai Shi Xi Chen Guangyu Sun Wei Zhang and Jason Cong. 2017. FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates. In FCCM. · DOI · Paper page
  10. Andrew Lavin. 2015. Fast Algorithms for Convolutional Neural Networks. CoRR abs/1509.09308 (2015). http://arxiv.org/abs/1509.09308 Andrew Lavin. 2015. Fast Algorithms for Convolutional Neural Networks. CoRR abs/1509.09308 (2015). http://arxiv.org/abs/1509.09308 · arXiv
  11. Mishra Asit K., 2017, WRPN: Training and Inference using Wide Reduced-Precision Networks. CoRR abs/1709.01134 · arXiv
  12. Duncan Moss Eriko Nurvitadhi Jaewoong Sim Asit Mishra Suchit Subhaschandra and Debbie Marr. 2017. High Performance Binary Neural Networks on the Xeon+FPGA Platform. In FPL. Duncan Moss Eriko Nurvitadhi Jaewoong Sim Asit Mishra Suchit Subhaschandra and Debbie Marr. 2017. High Performance Binary Neural Networks on the Xeon+FPGA Platform. In FPL. · DOI
  13. Eriko Nurvitadhi David Sheffield Jaewoong Sim Asit Mishra Ganesh Venkatesh and Debbie Marr. 2016. Accelerating Binarized Neural Networks: Comparison of FPGA CPU GPU and ASIC. In FPT. Eriko Nurvitadhi David Sheffield Jaewoong Sim Asit Mishra Ganesh Venkatesh and Debbie Marr. 2016. Accelerating Binarized Neural Networks: Comparison of FPGA CPU GPU and ASIC. In FPT. · DOI · Paper page
  14. 10.1007/s11263-015-0816-y · DOI · Paper page
  15. 10.1145/3035918.3035954 · DOI
  16. Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-scale Image Recognition. arXiv:1409.1556 (2014). Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-scale Image Recognition. arXiv:1409.1556 (2014). · arXiv
  17. Xuechao Wei Yun Liang Tao Wang Songwu Lu and Jason Cong. 2017. Throughput optimization for streaming applications on CPU-FPGA heterogeneous systems. In ASP-DAC. IEEE. Xuechao Wei Yun Liang Tao Wang Songwu Lu and Jason Cong. 2017. Throughput optimization for streaming applications on CPU-FPGA heterogeneous systems. In ASP-DAC. IEEE.
  18. 10.1145/2847263.2847269 · DOI
  19. 10.1145/3020078.3021727 · DOI · Paper page
  20. 10.1145/3020078.3021741 · DOI · Paper page

Cited by

See all 78

Metadata

Authors
Moss, D. J. M., Krishnan, S., Nurvitadhi, E., Ratuszniak, P., Johnson, C., Sim, J., Mishra, A., Marr, D., Subhaschandra, S., & Leong, P. H. W.
Venue
Proceedings of the 2018 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays
Publisher
ACM
Published
2018-02-15
Pages
107-116
OpenAlex
W2788007484
Cited by
78
References
6
FWCI
11.53
Type
conference paper
Language
en
Open access
closed
Funders
Australian Research Councils Linkage Projects (LP130101034)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Customizable Matrix Multiplication Framework for the Intel HARPv2 Xeon+FPGA Platform: A Deep Learning Case Study. https://app.cochat.ai/papers/10.1145/3174243.3174258
The paper
Moss, D. J. M., Krishnan, S., Nurvitadhi, E., Ratuszniak, P., Johnson, C., Sim, J., Mishra, A., Marr, D., Subhaschandra, S., & Leong, P. H. W. (2018). A Customizable Matrix Multiplication Framework for the Intel HARPv2 Xeon+FPGA Platform: A Deep Learning Case Study. Proceedings of the 2018 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. https://doi.org/10.1145/3174243.3174258

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.