Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 159

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU

Tan, Sijun, Knott, Brian, Tian, Yuan, Wu, David J. · 2021 · 2021 IEEE Symposium on Security and Privacy (SP)

Abstract

We introduce CryptGPU, a system for privacy-preserving machine learning that implements all operations on the GPU (graphics processing unit). Just as GPUs played a pivotal role in the success of modern deep learning, they are also essential for realizing scalable privacy-preserving deep learning. In this work, we start by introducing a new interface to losslessly embed cryptographic operations over secret-shared values (in a discrete domain) into floating-point operations that can be processed by highly-optimized CUDA kernels for linear algebra. We then identify a sequence of "GPU-friendly" cryptographic protocols to enable privacy-preserving evaluation of both linear and non-linear operations on the GPU. Our microbenchmarks indicate that our private GPU-based convolution protocol is over 150× faster than the analogous CPU-based protocol; for non-linear operations like the ReLU activation function, our GPU-based protocol is around 10× faster than its CPU analog. With CryptGPU, we support private inference and training on convolutional neural networks with over 60 million parameters as well as handle large datasets like ImageNet. Compared to the previous state-of-the-art, our protocols achieve a 2× to 8× improvement in private inference for large networks and datasets. For private training, we achieve a 6× to 36× improvement over prior state-of-the-art. Our work not only showcases the viability of performing secure multiparty computation (MPC) entirely on the GPU to newly enable fast privacy-preserving machine learning, but also highlights the importance of designing new MPC primitives that can take full advantage of the GPU’s computing capabilities.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/sp40001.2021.00098

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 48

  1. 10.1007/s11263-015-0816-y · DOI · Paper page
  2. 10.1145/2810103.2813677 · DOI · Paper page
  3. 10.1504/IJSN.2015.071829 · DOI · Paper page
  4. 10.1109/DAC.2018.8465894 · DOI · Paper page
  5. 10.14722/ndss.2020.23005 · DOI
  6. 10.2478/popets-2020-0036 · DOI
  7. lecun, 0, The MNIST database
  8. 10.46586/tches.v2018.i2.70-95 · DOI
  9. 10.1145/2976749.2978318 · DOI · Paper page
  10. badawi, 2020, Towards the alexnet moment for homomorphic encryption: HCNN, the first homomorphic cnn on encrypted data with gpus, IEEE Transactions on Emerging Topics in Computing
  11. simonyan, 2015, Very deep convolutional networks for large-scale image recognition, ICLRE
  12. 10.2478/popets-2020-0077 · DOI
  13. riazi, 2019, XONN: xnor-based oblivious deep neural network inference, USENIX Security Symposium, 1501
  14. 10.1145/3133956.3134056 · DOI · Paper page
  15. gilad-bachrach, 2016, Cryptonets: Applying neural networks to encrypted data with high throughput and accuracy, ICML, 201
  16. 10.1145/3196494.3196522 · DOI · Paper page
  17. chandran, 2017, Ezpc: Programmable, efficient, and scalable secure two-party computation for machine learning, Cryptology ePrint Archive Report 2017/1109
  18. 0, PyTorch/CSPRNG
  19. gentry, 2009, A fully homomorphic encryption scheme, PhD thesis
  20. 10.2478/popets-2021-0011 · DOI · Paper page
  21. juvekar, 2018, GAZELLE: A low latency framework for secure neural network inference, USENIX Security Symposium, 1651
  22. ben-or, 1988, Completeness theorems for non-cryptographic fault-tolerant distributed computation (extended abstract), STOC, 1
  23. goldreich, 1987, How to play any mental game or A completeness theorem for protocols with honest majority, STOC, 218
  24. mishra, 2020, Delphi: A cryptographic inference service for neural networks, Usenix Security, 2505
  25. 10.2478/popets-2019-0035 · DOI · Paper page
  26. 10.2478/popets-2021-0011 · DOI · Paper page
  27. nair, 2010, Rectified linear units improve restricted boltzmann machines, ICML, 807
  28. beaver, 1991, Efficient multiparty protocols using circuit randomization, Crypto, 420
  29. 10.14722/ndss.2015.23113 · DOI · Paper page
  30. furukawa, 2017, High-throughput secure three-party computation for malicious adversaries and an honest majority, Eurocrypt, 225
  31. tramèr, 2019, Slalom: Fast, verifiable and private execution of neural networks in trusted hardware, ICLRE
  32. kamara, 2011, Outsourcing multi-party computation, IACR Cryptol ePrint Arch, 2011, 272
  33. 10.14722/ndss.2020.24202 · DOI
  34. 0, Cudnn
  35. 0, Cublas
  36. mohassel, 2018, ABY3: A mixed protocol framework for machine learning, ACM CCSW, 35
  37. goldreich, 2004, The Foundations of Cryptography - Volume 2 Basic Applications
  38. 10.1007/s001459910006 · DOI · Paper page
  39. knott, 2020, CrypTen: Secure multi-party computation meets machine learning, Proceedings of the NeurIPS Workshop on Privacy-Preserving Machine Learning
  40. 0, Cloud tensor processing units (tpus)
  41. 10.1145/2976749.2978331 · DOI · Paper page
  42. 10.1002/ecjc.4430720906 · DOI · Paper page
  43. 10.1162/NECO_a_00052 · DOI · Paper page
  44. paszke, 2019, PyTorch: An imperative style, high-performance deep learning library, NeurIPS, 8024
  45. yao, 1986, How to generate and exchange secrets (extended abstract), FOCS, 162
  46. 10.1145/3338466.3358922 · DOI
  47. jagielski, 2019, High-fidelity extraction of neural network models, CoRR
  48. goodfellow, 2016, Deep Learning

Cited by

See all 159

Metadata

Authors
Tan, S., Knott, B., Tian, Y., & Wu, D. J.
Venue
2021 IEEE Symposium on Security and Privacy (SP)
Publisher
IEEE
Published
2021-05
Pages
1021-1038
ISSN
1081-6011 (ISSN-L)
OpenAlex
W3155184874
Cited by
159
References
10
FWCI
12.09
Type
conference paper
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU. https://app.cochat.ai/papers/10.1109/sp40001.2021.00098
The paper
Tan, S., Knott, B., Tian, Y., & Wu, D. J. (2021). CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU. 2021 IEEE Symposium on Security and Privacy (SP). https://doi.org/10.1109/sp40001.2021.00098

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.