Cited by 115Privacy-Preserving Technologies in DataCloud Data Security SolutionsCryptography and Data Security

A Survey on Differentially Private Machine Learning [Review Article]

Gong, Maoguo, Xie, Yu, Pan, Ke, Feng, Kaiyuan, Qin, A.K.·2020·IEEE Computational Intelligence Magazine

Abstract

Recent years have witnessed remarkable successes of machine learning in various applications. However, machine learning models suffer from a potential risk of leaking private information contained in training data, which have attracted increasing research attention. As one of the mainstream privacy- preserving techniques, differential privacy provides a promising way to prevent the leaking of individual-level privacy in training data while preserving the quality of training data for model building. This work provides a comprehensive survey on the existing works that incorporate differential privacy with machine learning, so- called differentially private machine learning and categorizes them into two broad categories as per different differential privacy mechanisms: the Laplace/ Gaussian/exponential mechanism and the output/objective perturbation mechanism. In the former, a calibrated amount of noise is added to the non-private model and in the latter, the output or the objective function is perturbed by random noise. Particularly, the survey covers the techniques of differentially private deep learning to alleviate the recent concerns about the privacy of big data contributors. In addition, the research challenges in terms of model utility, privacy level and applications are discussed. To tackle these challenges, several potential future research directions for differentially private machine learning are pointed out.

Integrity signals

Registry

Crossref · 10.1109/mci.2020.2976185

Cites

101 of 102 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

5 of the 107 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

  1. 10.5555/2969033.2969153 · DOI
  2. agarwal, 0, The rice of differential privacy for online learning, Proc 34th Int Conf Mach Learn, 32
  3. 10.5555/3241094.3241142 · DOI

Cited by

Sorted by citations

Authors
Gong, M., Xie, Y., Pan, K., Feng, K., & Qin, A. K.
Affiliations
  • Xidian University (CN)
  • Swinburne University of Technology (AU)
Venue
IEEE Computational Intelligence Magazine
Published
2020-05
Volume
15
Issue
2
Pages
49-64
ISSN
  • 1556-603X (ISSN-L)
  • 1556-6048
OpenAlex
W3016000170
Cited by
115
References
107
Citations by year
2026: 6 · 2025: 12 · 2024: 28 · 2023: 27 · 2022: 15 · 2021: 23 · 2020: 4
FWCI
6.78
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Computational Intelligence Magazine (publishedVersion)
  • Swinburne figshare (Swinburne University of Technology) (submittedVersion)
Funders
National Basic Research Program of China (2017YFB0802200)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
  • Physical Sciences › Computer Science › Artificial Intelligence › Cryptography and Data Security
Keywords
differential privacy, privacy-preserving machine learning, Laplace mechanism, Gaussian mechanism, exponential mechanism, output perturbation, data privacy, model utility, privacy-utility trade-off

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review