A Systematic Review of Re-Identification Attacks on Health Data
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Privacy legislation in most jurisdictions allows the disclosure of health data for secondary purposes without patient consent if it is de-identified. Some recent articles in the medical, legal, and computer science literature have argued that de-identification methods do not provide sufficient protection because they are easy to reverse. Should this be the case, it would have significant and important implications on how health information is disclosed, including: (a) potentially limiting its availability for secondary purposes such as research, and (b) resulting in more identifiable health information being disclosed. Our objectives in this systematic review were to: (a) characterize known re-identification attacks on health data and contrast that to re-identification attacks on other kinds of data, (b) compute the overall proportion of records that have been correctly re-identified in these attacks, and (c) assess whether these demonstrate weaknesses in current de-identification methods. METHODS AND FINDINGS: Searches were conducted in IEEE Xplore, ACM Digital Library, and PubMed. After screening, fourteen eligible articles representing distinct attacks were identified. On average, approximately a quarter of the records were re-identified across all studies (0.26 with 95% CI 0.046-0.478) and 0.34 for attacks on health data (95% CI 0-0.744). There was considerable uncertainty around the proportions as evidenced by the wide confidence intervals, and the mean proportion of records re-identified was sensitive to unpublished studies. Two of fourteen attacks were performed with data that was de-identified using existing standards. Only one of these attacks was on health data, which resulted in a success rate of 0.00013. CONCLUSIONS: The current evidence shows a high re-identification rate but is dominated by small-scale studies on data that was not de-identified according to existing standards. This evidence is insufficient to draw conclusions about the efficacy of de-identification methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even if the data collected by ChatGPT are deidentified, there is still the potential for individuals to be reidentified by combining them with other available data sources [31].”
From Ethical Considerations of Using ChatGPT in Health Care (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Such re-identification attacks 39 have been shown to yield high success rates both with tabular data 40,41 (such as patient records) and medical imaging data 42 .”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [39]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 1×
“To evaluate the accuracy of the screening, we performed an inter-rater reliability analysis with two independent raters. After the first rater completed his screening (KEE), a second rater not involved in the study in any way was recruited (KA). We went through the study objectives and screening criteria with the seco…”
MethodPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“Figure 1 depicts a PRISMA diagram (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for this review [50,51], and Checklist S1 contains the completed PRISMA checklist.”
MethodDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“identified to a tolerance value based on the commonly used ruleof-thumb provided in the literature of 5|kz10, where k is the number of studies included in the analysis [46,47].”
Methodk-ANONYMITY: A MODEL FOR PROTECTING PRIVACY
SWEENEY, L. (2002) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488502001648 · Cited by 8,571 · cited 2×
“C [67] 2002 Yes Researcher 1 of 135,000 USA Removal of names and addresses Yes”
Background
Research works printed but not linked: 4
- A Robeznieks, 2005, Privacy fear factor arises., Modern Healthcare, 35, 6
- E Bartlett, 1993, RMS need to safeguard computerized patient records to protect hospitals., Hospital Risk Management, 15
- 2007, Mike Gordon v. the Minister of Health and the Privacy Commissioner of Canada: Memorandum of Fact and Law of the Privacy Commissioner of Canada., Federal Court
- L Sweeney, Data sharing under HIPAA: 12 years later. Workshop on the HIPAA Privacy Rule's De-Identification Standard, March 8–9, 2010
Cited by
Items 401–457 of 457
Shaban, F. A., Khaled, T. A. F. B., Al-Qubilat, A. O. H., Yazjin, N. M. R. A., & Alshoubaki, A. A. (2025) · World Journal of Biology Pharmacy and Health Sciences · doi:10.30574/wjbphs.2025.23.1.0699
Akhi, S. S., Islam, M., Anika, A., & Mim, S. S. (2025) · Frontiers in Health Informatics · doi:10.63682/fhi2696 · Cited by 5
Yang, X., & Wu, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3456-2_9
Udaipurwala, I. H. (2025) · Journal of Bahria University Medical and Dental College · doi:10.51985/jbumdc2025665
Jones, L. A., Barber, C., Clements-Brod, N., Davies, J., DelPozo‐Baños, M., Hughes, A., Iveson, M. H., Jain, D., John, A. M., Maguire, A., et al. (2025) · medRxiv · doi:10.1101/2025.11.05.25339575
Shahid, A. F., Shahid, M., & Sumbul, M. (2025) · Journal of Further and Higher Education · doi:10.1080/0309877x.2025.2583099
“…under strict privacy safeguards and de-identification protocols (Shero et al. 2025), where potential risks were limited to privacy breaches (El Emam et al. 2011) and mitigated through comprehensive data protection measures including removal of all student identifiers (Sweeney 2002), for…”
Harnessing Language Models to Analyze Android App Permission Fidelity
Tamrakar, Y., Banerjee, R., Myers, E., Carli, L. D., & Ray, I. (2025) · Conference on Privacy, Security and Trust · doi:10.1109/pst65910.2025.11268849 · Cited by 1
“The aggregation of such data poses significant privacy risks, as even ostensibly anonymized datasets can often be re-identified through linkage attacks [3], [4].”
An Evaluation of Open Source Data Anonymisation Tools for Medical Data
Pullattukunnel, A., Al-Dhamari, I., & Jürjens, J. (2025) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3743093.3770973
Li, W., Kim, M., Zhang, K., Chen, H., Jiang, X., & Harmanci, A. O. (2024) · Figshare · doi:10.6084/m9.figshare.26616745
Cardinal, R. N., Moore, A., Burchell, M., & Lewis, J. R. (2023) · Figshare · doi:10.6084/m9.figshare.22774184
Al-Ani, A., Rayyan, A., Maswadeh, A., Sultan, H., Alhammouri, A., Asfour, H., Alrawajih, T., Al Sharie, S., Karmi, F. A., Al-Azzam, A. M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26682103
Al-Ani, A., Rayyan, A., Maswadeh, A., Sultan, H., Alhammouri, A., Asfour, H., Alrawajih, T., Al Sharie, S., Karmi, F. A., Al-Azzam, A. M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26682106
Oliveira, F. N. S. C. D. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Automated de-identification and unstructured textual electronic medical record data in Manitoba
McDermott, K. (2022) · Mspace (University of Manitoba)
de Almeida, J. F. C. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/1jjh-x258
AI-Enhanced Anonymization Workflows for Secure Health Data Sharing
Cavalheiro, R. A. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Zhi, Q. (2025) · DiVA (Stockholm University)
Ethical Considerations in AI-Enabled Healthcare
Aldemir, E., Bloom, C., Honeyman, S. I., & Vardanyan, R. (2026) · Biomedical visualization · doi:10.1007/978-3-032-06520-9_5 · Cited by 1
Synthetic Data Generation for Validation of Clinical Research Software
Raja, R. S. (2025) · International Journal of AI BigData Computational and Management Studies · doi:10.63282/3050-9416.ijaibdcms-v6i4p126
Measuring Privacy: Critical Reflections and Directions for a Metrology-Based Approach
Balestrieri, E., Caggiano, I. A., Picariello, F., & Tudosa, I. (2025) · IMEKO TC6 Conference on Digitalization (M4DConf) · doi:10.21014/tc6-2025.019
Imanov, O. Y. L., Yilmaz, T., Tugrul, A. T., Zaman, M. N., Gunalp, O., Erisken, D., Dulger, S. B., Turhan, R. I., Ozdemir, I., Kulali, D. U., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.19191
Lorenzo, G. D., Melluso, M., & Seidita, A. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70382
Data exfiltration and anonymization of medical images based on generative models
Li, H. (2024) · theses.fr (ABES) · doi:10.70675/caf4b176zede1z4065z9416z3543f1650578 · Cited by 3
Données de santé, dynamiques et enjeux de souveraineté
Pinilla, E. (2023) · theses.fr (ABES) · doi:10.70675/267dba09z6c05z4a5dz830ezd278df3e3fa1
Remote Patient Monitoring: Implications for Information Systems Researchers
Kolotylo-Kulkarni, M., Zheng, H., Lucia, R., Borton, R., & Mitchell, A. (2026) · AIS Electronic Library (AISeL)
Lu, X., Hu, D., Nguyen, A. T., Morse, B., Schilling, L. M., Zheng, K., Keller, M. S., Ohno-Machado, L., & Chen, Y. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788079
“However, this approach does not guarantee anonymity, as studies repeatly reporting successful patient re-identifications using datasets deemed de-identified according to HIPAA or institutional standards [24].”
Makki, N., Tundealao, S. T., León‐Novelo, L., Patrounova, V. V., Harrell, M. B., & Tamí‐Maury, I. (2026) · International Journal of Dental Hygiene · doi:10.1111/idh.70096
Elhawary, E. A., Waheeb, H. O., Abdelhafiz, A. H. A., El-Waseif, A. A., & Shehata, A. Z. I. (2026) · Scientific Reports · doi:10.1038/s41598-026-52695-1
“The genus is also rich in saponins, alkaloids, betains, proteins, amino acids, mineral salts and phytoecdysteroids 9–11 .”
Kumar, N., Andreotti, A., Kocaman, V., Gul, Y., Butgul, M., & Talby, D. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-26211-0_12
A Practical Membership Disclosure Assessment Framework for Anonymized Data
Pilgram, L., Gil, V., & Emam, K. E. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37883-5_14 · Cited by 1
Pope, K. S., Vásquez, M. J. T., Chavez‐Dueñas, N. Y., & Adames, H. Y. (2026) · Wiley eBooks · doi:10.1002/9781394461707.refs
Artificial Intelligence in Social Work: Bridging Technology and Humanity
An, R., & Lindsey, M. A. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6 · Cited by 1
AI in Supporting LGBTQIA+ Populations
Downey, D. L., & Jenkins, D. A. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6_7
Dermott, N. A. M. (2026) · DSpace repository (University of Tartu)
Gomes, O. A., & Cavalcanti, C. F. M. D. C. (2026) · doi:10.5753/sbcas.2026.21706
“46), motivando mecanismos de controle ve-rificável de consentimento, rastreabilidade de acessos e revogação operacional, em diá-logo com a literatura sobre privacidade contextual e reidentificação em dados de saúde [Nissenbaum 2010, El Emam et al. 2011].”
Machine Learning-Based Privacy Preserving via CT/MRI and Organ Metadata Prediction
Jin, R., Mohamadi, S., Bramlet, M. T., Anastasio, M. A., & Sutton, B. P. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02117-5
Rahmeh, S., Dias, F. M., Moreno, R. A., Rebelo, M. D. S., Herrmann, D., Krieger, J. E., & Gutierrez, M. A. (2026) · Journal of Medical Internet Research · doi:10.2196/91513
“Anonymization has thus become a vital requirement, enabling secondary uses of health data for research and quality improvement while minimizing the risk of patient reidentification [7,8].”
Guitart, J. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1833779
Nagaraj, S., & Vijayarajan, V. (2026) · Scientific Reports · doi:10.1038/s41598-026-60702-8
“As a result, an adversary may recover clinically meaningful inferences from structural correlations that survive marginal “protection” 12,14 .”
OWL-SDA: A Multi-Agent System for Generating Synthetic Data to Support Ontology Evaluation
de Wynckel, M. V., & Roock, E. D. (2026) · VUBIR (Vrije Universiteit Brussel) · doi:10.48366/r1919188
Semantic computing in healthcare: Bridging the gap between innovation and privacy security measures
Agarwal, N., Aliswag, E. G., & Kumar, P. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-33512-9.00012-3
Komenda, M., Klimeš, D., Tichopád, A., Jarkovský, J., Májek, O., Mužík, J., Táborský, M., Těšitelová, V., Habetinek, J., & Dušek, L. (2026) · JMIR Medical Informatics · doi:10.2196/80683
Araújo, L. F., Almeida, J. M., Gomes, C. S., Bernal, R. T. I., Gonçalves, M. A., Rodrigues, G. V., Faria, T. M. T. R., Franca, C., & Malta, D. C. (2026) · BMC Public Health · doi:10.1186/s12889-026-29377-8
Sokolov, V., & Skladannyi, P. (2026) · Borys Grinchenko Kyiv University Institutional repository (Borys Grinchenko Kyiv University)
Data Privacy and Security in Hospital Administration
al., F. D. M. A. E. (2023) · Letters in High Energy Physics
Zafar, A. (2026) · UTUPub (University of Turku)
Bertgren, A., Öhberg, F., Soda, P., Näslund, U., Wennberg, P., & Grönlund, C. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.01.755916
“The development and research on healthcare digital twins for CVD prevention require access to considerable amounts of data regarding lifestyle, health and surrogate outcomes, raising privacy concerns even after de-identification [12–15].”
Bertgren, A., Öhberg, F., Soda, P., Näslund, U., Wennberg, P., & Grönlund, C. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00036
“Thechallenge of privacy preservation is often addressed by removal of identifiers or data manipulation [6], but these methods do not ensure protection [7], [8].”
Risk-Adaptive Masking for Privacy–Utility Balance in OCR-Based Document De-Identification
Kim, S. (2026) · Electronics · doi:10.3390/electronics15204666
Vu, D.-H., Tran, A.-T., Tu, L. C., Luong, T. D., & Huynh, V. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-5641-9_24
Kim, B., Won, Y. K., Kim, H., Cha, J., Lim, D. H., & Jeon, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-76373-4
Biz, M. M., Nunes, H. C., Lima, B. V., & Cordeiro, W. L. D. C. (2026) · Simpósio Brasileiro de Cibersegurança (SBSeg) · doi:10.5753/sbseg.2026.27022
“Uma revi-são sistemática anterior [El Emam et al. 2011] identificou que estudos raramente avaliam conjuntamente múltiplos vetores, observação que motiva diretamente este trabalho.”
Ducret, M., Cloarec, J., Alrabie, N., & Mouncif-Moungache, M. (2026) · Journal of Medical Internet Research · doi:10.2196/94903
“It is not equivalent to full anonymization [31], however, and AI itself heightens the risk of reidentification.”
Sharing (or Not Sharing) Sensitive Data
Mannheimer, S., & Bayrd, V. (2026) · Montana State University ScholarWorks (Montana State University)
Metadata
- Authors
- El Emam, K., Jonker, E., Arbuckle, L., & Malin, B.
- Affiliations
- Children's Hospital of Eastern Ontario (CA)
- Vanderbilt University (US)
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-12-02
- Volume
- 6
- Issue
- 12
- Pages
- e28071
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3229505
- OpenAlex
- W2083384763
- Semantic Scholar
- 3803595fac5818f0fce6296a6e3afc414c280a5a
- Cited by
- 427
- References
- 64
- Citations by year
- 2026: 36 · 2025: 42 · 2024: 48 · 2023: 34 · 2022: 33 · 2021: 29 · 2020: 46 · 2019: 36 · 2018: 27 · 2017: 19 · 2016: 20 · 2015: 20 · 2014: 15 · 2013: 13 · 2012: 9
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-04-16)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Vanderbilt University
- Canada Research Chairs
- National Institutes of Health
- National Human Genome Research Institute (U01HG00460301, U01HG004603)
- U.S. National Library of Medicine (R01LM009989)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Health Sciences › Health Professions › Health Information Management › Thoreau and American Literature
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Keywords
- re-identification attacks, health data privacy, de-identification, secondary use of health data, privacy law, health information disclosure
- MeSH terms
- Confidentiality, Humans, Software, United States, Reproducibility of Results, Models, Statistical, Databases, Factual, Medical Records Systems, Computerized, Computer Security, Privacy, Health Insurance Portability and Accountability Act
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.