CoChat

A Systematic Review of Re-Identification Attacks on Health Data

Open access
El Emam, Khaled, Jonker, Elizabeth, Arbuckle, Luk, Malin, Bradley · 2011 · PLoS ONE

The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Privacy legislation in most jurisdictions allows the disclosure of health data for secondary purposes without patient consent if it is de-identified. Some recent articles in the medical, legal, and computer science literature have argued that de-identification methods do not provide sufficient protection because they are easy to reverse. Should this be the case, it would have significant and important implications on how health information is disclosed, including: (a) potentially limiting its availability for secondary purposes such as research, and (b) resulting in more identifiable health information being disclosed. Our objectives in this systematic review were to: (a) characterize known re-identification attacks on health data and contrast that to re-identification attacks on other kinds of data, (b) compute the overall proportion of records that have been correctly re-identified in these attacks, and (c) assess whether these demonstrate weaknesses in current de-identification methods. METHODS AND FINDINGS: Searches were conducted in IEEE Xplore, ACM Digital Library, and PubMed. After screening, fourteen eligible articles representing distinct attacks were identified. On average, approximately a quarter of the records were re-identified across all studies (0.26 with 95% CI 0.046-0.478) and 0.34 for attacks on health data (95% CI 0-0.744). There was considerable uncertainty around the proportions as evidenced by the wide confidence intervals, and the mean proportion of records re-identified was sensitive to unpublished studies. Two of fourteen attacks were performed with data that was de-identified using existing standards. Only one of these attacks was on health data, which resulted in a success rate of 0.00013. CONCLUSIONS: The current evidence shows a high re-identification rate but is dominated by small-scale studies on data that was not de-identified according to existing standards. This evidence is insufficient to draw conclusions about the efficacy of de-identification methods.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0028071

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 PRISMA diagram. PRISMA diagram summarizing the steps involved in the systematic review of the re-identification attack literature.
Figure 1 PRISMA diagram. PRISMA diagram summarizing the steps involved in the systematic review of the re-identification attack literature.CC BY · PubMed Central
Figure 2 Caterpillar plot (all studies). Caterpillar plot of the individual mean and confidence intervals for all studies with overall mean proportion.
Figure 2 Caterpillar plot (all studies). Caterpillar plot of the individual mean and confidence intervals for all studies with overall mean proportion.CC BY · PubMed Central
Figure 3 Caterpillar plot (health studies). Caterpillar plot of the individual mean and confidence intervals for health studies with overall mean proportion.
Figure 3 Caterpillar plot (health studies). Caterpillar plot of the individual mean and confidence intervals for health studies with overall mean proportion.CC BY · PubMed Central
Figure 4 Senstivitiy (all studies). The number of new studies with success rates below/above the current mean that would need to be performed to significantly change the current mean for all studies.
Figure 4 Senstivitiy (all studies). The number of new studies with success rates below/above the current mean that would need to be performed to significantly change the current mean for all studies.CC BY · PubMed Central
Figure 5 Sensitivity (health studies). The number of new studies with success rates below/above the current mean that would need to be performed to significantly change the current mean for health studies.
Figure 5 Sensitivity (health studies). The number of new studies with success rates below/above the current mean that would need to be performed to significantly change the current mean for health studies.CC BY · PubMed Central
Figure 6 Funnel plot (all studies). Funnel plot showing the proportion of records re-identified in all studies against standard error. The points were slightly jittered to reveal overlap.
Figure 6 Funnel plot (all studies). Funnel plot showing the proportion of records re-identified in all studies against standard error. The points were slightly jittered to reveal overlap.CC BY · PubMed Central
Figure 7 Funnel plot (health studies). Funnel plot showing the proportion of records re-identified in health studies against standard error. The points were slightly jittered to reveal overlap.
Figure 7 Funnel plot (health studies). Funnel plot showing the proportion of records re-identified in health studies against standard error. The points were slightly jittered to reveal overlap.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 4

  1. A Robeznieks, 2005, Privacy fear factor arises., Modern Healthcare, 35, 6
  2. E Bartlett, 1993, RMS need to safeguard computerized patient records to protect hospitals., Hospital Risk Management, 15
  3. 2007, Mike Gordon v. the Minister of Health and the Privacy Commissioner of Canada: Memorandum of Fact and Law of the Privacy Commissioner of Canada., Federal Court
  4. L Sweeney, Data sharing under HIPAA: 12 years later. Workshop on the HIPAA Privacy Rule's De-Identification Standard, March 8–9, 2010

Cited by

See all 457

Metadata

Authors
El Emam, K., Jonker, E., Arbuckle, L., & Malin, B.
Affiliations
  • Children's Hospital of Eastern Ontario (CA)
  • Vanderbilt University (US)
Venue
PLoS ONE
Published
2011-12-02
Volume
6
Issue
12
Pages
e28071
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2083384763
Cited by
427
References
64
Citations by year
2026: 36 · 2025: 42 · 2024: 48 · 2023: 34 · 2022: 33 · 2021: 29 · 2020: 46 · 2019: 36 · 2018: 27 · 2017: 19 · 2016: 20 · 2015: 20 · 2014: 15 · 2013: 13 · 2012: 9
FWCI
2.03
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Vanderbilt University
  • Canada Research Chairs
  • National Institutes of Health
  • National Human Genome Research Institute (U01HG00460301, U01HG004603)
  • U.S. National Library of Medicine (R01LM009989)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Health Sciences › Health Professions › Health Information Management › Thoreau and American Literature
  • Physical Sciences › Computer Science › Information Systems › Data Quality and Management
Keywords
re-identification attacks, health data privacy, de-identification, secondary use of health data, privacy law, health information disclosure
MeSH terms
Confidentiality, Humans, Software, United States, Reproducibility of Results, Models, Statistical, Databases, Factual, Medical Records Systems, Computerized, Computer Security, Privacy, Health Insurance Portability and Accountability Act

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.