Cited by 30Privacy-Preserving Technologies in DataAdversarial Robustness in Machine LearningCloud Data Security Solutions

Practical Attribute Reconstruction Attack Against Federated Learning

Chen, Chen, Lyu, Lingjuan, Yu, Han, Chen, Gang·2024·IEEE Transactions on Big Data

Abstract

Existing federated learning (FL) designs have been shown to exhibit vulnerabilities which can be exploited by adversaries to compromise data privacy. However, most current works conduct attacks by leveraging gradients calculated on a small batch of data. This setting is not realistic as gradients are normally shared after at least 1 epoch of local training on each participant's local data in FL for communication efficiency. In this work, we conduct a unique systematic evaluation of attribute reconstruction attack (ARA) launched by the malicious server in the FL system, and empirically demonstrate that the shared local model gradients after 1 epoch of local training can still reveal sensitive attributes of local training data. To demonstrate this leakage, we develop a more effective and efficient gradient matching based method called cos-matching to reconstruct the sensitive attributes of any victim participant's training data. Based on the reconstructed training data attributes, we further show that an attacker can even reconstruct the sensitive attributes of any records that are not included in any participant's training data, thus opening a new attack surface in FL. Extensive experiments show that the proposed method achieves better attribute attack performance than existing state-of-the-art methods.

Integrity signals

Registry

Crossref · 10.1109/tbdata.2022.3159236

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent studies have shown that FL is also vulnerable to well-crafted adversarial examples.

    “In terms of the robustness vulnerability, recent studies [175], [176], [177] have shown that FL is also vulnerable to well-crafted adversarial examples.”
  • The training of all federated adversarial training works is unstable, which potentially hurts convergence and performance.

    “The training of all the above FAT works are unstable, which potentially hurts the convergence and performance.”
  • During inference time, attackers can add a very small perturbation to the test data, making the test data almost indistinguishable from natural data and yet classified incorrectly by the global model.

    “During inference time, the attackers can add a very small perturbation to the test data, making the test data almost indistinguishable from natural data and yet classified incorrectly by the global model.”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Chen, C., Lyu, L., Yu, H., & Chen, G.
Affiliations
  • Zhejiang University (CN)
  • National University of Singapore (SG)
  • Nanyang Technological University (SG)
Venue
IEEE Transactions on Big Data
Published
2024-12
Volume
10
Issue
6
Pages
851-863
ISSN
  • 2332-7790 (ISSN-L)
  • 2372-2096
OpenAlex
W4226036112
Cited by
30
References
38
Citations by year
2026: 3 · 2025: 10 · 2024: 6 · 2023: 10 · 2022: 1
FWCI
2.22
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Big Data (publishedVersion)
  • DR-NTU (Nanyang Technological University) (acceptedVersion)
Funders
  • Key Research and Development Program of Zhejiang Province of China (2020C01024)
  • National Research Foundation Singapore
  • AI Singapore Programme (AISG2-RP-2020-019)
  • Joint NTU-WeBank Research Centre on Fintech (NWJ-2020-008)
  • Nanyang Assistant Professorships
  • RIE 2020 Advanced Manufacturing and Engineering Programmatic Fund (A20G8b0102)
  • SDU-NTU Centre for AI Research
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
Keywords
federated learning, data privacy, malicious server, gradient matching, sensitive attribute inference, data leakage, privacy attacks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review