A Systematic Review of Re-Identification Attacks on Health Data
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Privacy legislation in most jurisdictions allows the disclosure of health data for secondary purposes without patient consent if it is de-identified. Some recent articles in the medical, legal, and computer science literature have argued that de-identification methods do not provide sufficient protection because they are easy to reverse. Should this be the case, it would have significant and important implications on how health information is disclosed, including: (a) potentially limiting its availability for secondary purposes such as research, and (b) resulting in more identifiable health information being disclosed. Our objectives in this systematic review were to: (a) characterize known re-identification attacks on health data and contrast that to re-identification attacks on other kinds of data, (b) compute the overall proportion of records that have been correctly re-identified in these attacks, and (c) assess whether these demonstrate weaknesses in current de-identification methods. METHODS AND FINDINGS: Searches were conducted in IEEE Xplore, ACM Digital Library, and PubMed. After screening, fourteen eligible articles representing distinct attacks were identified. On average, approximately a quarter of the records were re-identified across all studies (0.26 with 95% CI 0.046-0.478) and 0.34 for attacks on health data (95% CI 0-0.744). There was considerable uncertainty around the proportions as evidenced by the wide confidence intervals, and the mean proportion of records re-identified was sensitive to unpublished studies. Two of fourteen attacks were performed with data that was de-identified using existing standards. Only one of these attacks was on health data, which resulted in a success rate of 0.00013. CONCLUSIONS: The current evidence shows a high re-identification rate but is dominated by small-scale studies on data that was not de-identified according to existing standards. This evidence is insufficient to draw conclusions about the efficacy of de-identification methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even if the data collected by ChatGPT are deidentified, there is still the potential for individuals to be reidentified by combining them with other available data sources [31].”
From Ethical Considerations of Using ChatGPT in Health Care (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Such re-identification attacks 39 have been shown to yield high success rates both with tabular data 40,41 (such as patient records) and medical imaging data 42 .”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [39]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 1×
“To evaluate the accuracy of the screening, we performed an inter-rater reliability analysis with two independent raters. After the first rater completed his screening (KEE), a second rater not involved in the study in any way was recruited (KA). We went through the study objectives and screening criteria with the seco…”
MethodPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“Figure 1 depicts a PRISMA diagram (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for this review [50,51], and Checklist S1 contains the completed PRISMA checklist.”
MethodDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“identified to a tolerance value based on the commonly used ruleof-thumb provided in the literature of 5|kz10, where k is the number of studies included in the analysis [46,47].”
Methodk-ANONYMITY: A MODEL FOR PROTECTING PRIVACY
SWEENEY, L. (2002) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488502001648 · Cited by 8,571 · cited 2×
“C [67] 2002 Yes Researcher 1 of 135,000 USA Removal of names and addresses Yes”
Background
Research works printed but not linked: 4
- A Robeznieks, 2005, Privacy fear factor arises., Modern Healthcare, 35, 6
- E Bartlett, 1993, RMS need to safeguard computerized patient records to protect hospitals., Hospital Risk Management, 15
- 2007, Mike Gordon v. the Minister of Health and the Privacy Commissioner of Canada: Memorandum of Fact and Law of the Privacy Commissioner of Canada., Federal Court
- L Sweeney, Data sharing under HIPAA: 12 years later. Workshop on the HIPAA Privacy Rule's De-Identification Standard, March 8–9, 2010
Cited by
Items 101–200 of 457
Privacy Law, Data Sharing Policies, and Medical Data: A Comparative Perspective
Dove, E. S., & Phillips, M. (2015) · Springer eBooks · doi:10.1007/978-3-319-23633-9_24 · Cited by 40
Understanding and improving artifact sharing in software engineering research
Timperley, C. S., Herckis, L., Le Goues, C., & Hilton, M. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-09973-5 · Cited by 22
“Indeed, beyond being an error-prone and time-consuming process, studies have shown that sharing qualitative data risks re-identification even when steps are taken to remove personal identifiers from the data (Narayanan and Shmatikov, 2008; El Emam et al., 2011; Ji et al., 2014).”
Economics and Equity of Large Language Models: Health Care Perspective
Nagarajan, R., Kondo, M., Salas, F., Sezgın, E., Yao, Y., Klotzman, V., Godambe, S. A., Khan, N., Limon, A., Stephenson, G. S., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/64226 · Cited by 43
Anonymisation of geographical distance matrices via Lipschitz embedding
Kroll, M., & Schnell, R. (2016) · International Journal of Health Geographics · doi:10.1186/s12942-015-0031-7 · Cited by 39
PromptEHR: Conditional Electronic Healthcare Records Generation with Prompt Learning
Wang, Z., & Sun, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.185 · Cited by 59
Explainable AI in Healthcare Application
Sindiramutty, S. R., Tee, W. J., Balakrishnan, S., Kaur, S., Thangaveloo, R., Jazri, H., Khan, N. A., Gharib, A. H., & Manchuri, A. R. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-6684-6361-1.ch005 · Cited by 45
Synthetic data: revisiting the privacy-utility trade-off
Sarmin, F. J., Sarkar, A. R., Wang, Y., & Mohammed, N. (2025) · International Journal of Information Security · doi:10.1007/s10207-025-01072-6 · Cited by 38
Kohlmayer, F., Praßer, F., & Kuhn, K. A. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.09.007 · Cited by 38
“When selecting quasi-identifiers, we considered lists of attributes that have been associated with high risks of re-identification [5].”
MethodMining the Electronic Health Record for Disease Knowledge
Chen, E. S., & Sarkar, I. N. (2014) · Methods in molecular biology · doi:10.1007/978-1-4939-0709-0_15 · Cited by 40
Collecting, Processing and Secondary Using Personal and (Pseudo)Anonymized Data in Smart Cities
Sampaio, S., Sousa, P. R., Martins, C., Ferreira, A., Antunes, L. F., & Cruz-Correia, R. J. (2023) · Applied Sciences · doi:10.3390/app13063830 · Cited by 49
Schairer, C. E., Mehta, S. R., Vinterbo, S. A., Hoenigl, M., KALICHMAN, M. W., & Little, S. J. (2019) · AJOB Empirical Bioethics · doi:10.1080/23294515.2019.1601648 · Cited by 36
SHARE: system design and case studies for statistical health information release
Gardner, J., Xiong, L., Xiao, Y., Gao, J., Post, A. R., Jiang, X., & Lucila Ohno-machado, A. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001032 · Cited by 36
Data philanthropy and the design of the infraethics for information societies
Taddeo, M. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2016.0113 · Cited by 35
For Your Eyes Only: Privacy-preserving eye-tracking datasets
David-John, B., Butler, K. R. B., & Jain, E. (2022) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3517031.3529618 · Cited by 35
“Re-identification attacks in literature have been extensively explored for social networks [Narayanan and Shmatikov 2009], location data [Primault et al. 2018], and medical data [El Emam et al. 2011].”
BackgroundSelecting Privacy-Enhancing Technologies for Managing Health Data Use
Jordan, S. R., Fontaine, C., & Hendricks‐Sturrup, R. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.814163 · Cited by 46
“With the COVID-19 pandemic, individual health data and public health data can even describe the place of an individual within a state’s description of persons permitted or not permitted to access certain amenities (4–6).”
BackgroundEthical issues in biomedical research using electronic health records: a systematic review
Piasecki, J., Walkiewicz-Żarek, E., Figas-Skrzypulec, J., Kordecka, A., & Dranseika, V. (2021) · Medicine Health Care and Philosophy · doi:10.1007/s11019-021-10031-6 · Cited by 35
Ethical challenges of precision cancer medicine
Winkler, E. C., & Knoppers, B. M. (2020) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2020.09.009 · Cited by 33
Anonymization Techniques for Behavioral Biometric Data: A Survey
Hanisch, S., Arias-Cabarcos, P., Parra‐Arnau, J., & Strufe, T. (2025) · ACM Computing Surveys · doi:10.1145/3729418 · Cited by 40
The Importance of Context: Risk-based De-identification of Biomedical Data
Kuhn, K. A., Praßer, F., & Kohlmayer, F. (2016) · Methods of Information in Medicine · doi:10.3414/me16-01-0012 · Cited by 32
“The risk estimates used in this article are based on worst-case assumptions [10] and there is evidence that re-identification risks are generally overestimated [33].”
MethodAbbott, J., MacLeod, H., Nurain, N., Ekobe, G., & Patil, S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300692 · Cited by 31
Privacy-preserving construction of generalized linear mixed model for biomedical computation
Zhu, R., Jiang, C., Wang, X., Wang, S., Zheng, H., & Tang, H. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa478 · Cited by 38
Assessing Privacy Vulnerabilities in Genetic Data Sets: Scoping Review
Thomas, M., Mackes, N. K., Preuss-Dodhy, A., Wieland, T., & Bundschus, M. (2024) · JMIR Bioinformatics and Biotechnology · doi:10.2196/54332 · Cited by 39
“…to diseases such as Alzheimer disease or cancer) and physical traits (refer to the studies by Erlich and Narayanan [10], El Emam et al [11], and Mohammed Yakubu and Chen [12] for a review) has raised public concern that genetic data that are shared or published in the context of…”
BackgroundEvaluating the risk of patient re-identification from adverse drug event reports
Emam, K. E., Dankar, F. K., Neisa, A., & Jonker, E. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-114 · Cited by 31
Self-citationGuo, Q., Parlar, M. E., Truong, W., Hall, G. B., Thabane, L., McKinnon, M. C., Goeree, R. A., & Pullenayegum, E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094412 · Cited by 34
Gray, E. A., & Thorpe, J. H. (2015) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.14.51 · Cited by 34
Privacy, Ethics, and Data Access: A Case Study of the Fragile Families Challenge
Lundberg, I., Narayanan, A., Levy, K., & Salganik, M. J. (2019) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023118813023 · Cited by 22
The Risks to Patient Privacy from Publishing Data from Clinical Anesthesia Studies
O’Neill, L., Dexter, F., & Zhang, N. (2016) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000001331 · Cited by 30
“Then, from (3) and (4), one can infer there is one non-Medicare patient from Iowa City who had a radical prostatectomy.”
BackgroundMorehouse, K. N., Kurdi, B., & Nosek, B. A. (2024) · American Psychologist · doi:10.1037/amp0001346 · Cited by 29
Haley, D., Matthews, S., Cooper, H., Haardörfer, R., Adimora, A., Wingood, G., & Kramer, M. R. (2016) · Social Science & Medicine (1967) · doi:10.1016/j.socscimed.2016.08.009 · Cited by 31
“…for valid inference depends in part on the nature of the data, acceptable confidentiality risk, and current and future use of the data (Armstrong et al., 1999; A. Curtis et al., 2011; El Emam et al., 2011; El Emam et al., 2015b; Kounadi & Leitner, 2015; Seidl et al., 2015; VanWey et al., 2005).”
A Pragmatic Approach for Reproducible Research With Sensitive Data
Shepherd, B. E., Peratikos, M. B., Rebeiro, P. F., Duda, S. N., & McGowan, C. C. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx066 · Cited by 29
A Review of Evidence on Consent Bias in Research
Emam, K. E., Jonker, E., Moher, E., & Arbuckle, L. (2013) · The American Journal of Bioethics · doi:10.1080/15265161.2013.767958 · Cited by 33
Self-citationGenerating Synthetic Health Sensor Data for Privacy-Preserving Wearable Stress Detection
Lange, L., Wenzlitschke, N., & Rahm, E. (2024) · Sensors · doi:10.3390/s24103052 · Cited by 41
Informed consent for secondary research under the new NIH data sharing policy
Rothstein, M. A. (2021) · Journal of Law, Medicine & Ethics · doi:10.1017/jme.2021.69 · Cited by 27
Clunie, D., Flanders, A. E., Taylor, A. J., Erickson, B., Bialecki, B., Brundage, D., Gutman, D. A., Prior, F., Seibert, J. A., Perry, J. H., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.10473 · Cited by 38
Artificial Intelligence in Perioperative Care: Opportunities and Challenges
Han, L., Char, D. S., Aghaeepour, N., & The Stanford Anesthesia AI Working Group (2024) · Anesthesiology · doi:10.1097/aln.0000000000005013 · Cited by 31
Degeling, C., Carter, S. M., van Oijen, A. M., McAnulty, J., Sintchenko, V., Braunack‐Mayer, A., Yarwood, T., Johnson, J., & Gilbert, G. L. (2020) · BMC Medical Ethics · doi:10.1186/s12910-020-00474-6 · Cited by 26
Evaluation and utilisation of privacy enhancing technologies—A data spaces perspective
Auñón, J. M., Ramírez, D. H., Díaz, L. P., Peña, B. I., Rahmian, S., Al-Khazraji, Y., Soler-Garrido, J., & Kotsev, A. (2024) · Data in Brief · doi:10.1016/j.dib.2024.110560 · Cited by 34
“There is also an ongoing discussion over the sufficiency of data anonymisation techniques to protect data subject’s privacy, and there are multiple real-world examples of successful rei-dentification attacks in healthcare [ 21 ].”
BackgroundMethodGow, J. G., Moffatt, C., & Blackport, J. (2020) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-020-01497-3 · Cited by 25
“This threshold group size of five comes from the frequent use of five-anonymity in Expert Determinations when using k-anonymity to assess re-identification risk of anonymized datasets [14, 15].”
BackgroundKwaśnicka, D., ten Hoor, G. A., van Dongen, A., Gruszczyńska, E., Hagger, M. S., Hamilton, K., Hankonen, N. E., Heino, M. T. J., Kotzur, M., Noone, C., et al. (2020) · Health Psychology Review · doi:10.1080/17437199.2020.1844037 · Cited by 25
Vourganas, I., Attar, H. H., & Michala, A. L. (2022) · Springer eBooks · doi:10.1007/978-981-16-8150-9_5 · Cited by 28
Algorithms to anonymize structured medical and healthcare data: A systematic review
Sepas, A., Bangash, A. H., Alraoui, O., Emam, K. E., & El‐Hussuna, A. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.984807 · Cited by 25
Akiya, I., Ishihara, T., & Yamamoto, K. (2024) · JMIR Medical Informatics · doi:10.2196/55118 · Cited by 34
Research Data Management Principles, Practices, and Prospects
Asher, A., Deards, K. D., Esteva, M., Halbert, M., Jahnke, L., Jordan, C. A., Keralis, S. D. C., Kulasekaran, S., Moen, W. E., Stark, S., et al. (2013) · University of North Texas Digital Library (University of North Texas) · doi:10.5281/zenodo.7802239 · Cited by 25
EVA: Generating Longitudinal Electronic Health Records Using Conditional Variational AutoencodersPreprint
Biswal, S., Ghosh, S., Duke, J. D., Malin, B., Stewart, W. F., & Sun, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10020 · Cited by 25
“Moreover, even carefully de-identified EHRs are still susceptible to re-identification attacks [7, 8].”
BackgroundSelf-citationPatient agency and large language models in worldwide encoding of equity
Armoundas, A. A., & Loscalzo, J. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01598-y · Cited by 27
“Even if the data collectedundergocompletede-identi fi cation,ithasbeenshownthatitisstill possible that individuals can be re-identi fi ed by linking medical with other non-medical available data 27 .”
Scott, P., Rigby, M., Ammenwerth, E., McNair, J., Georgiou, A., Hyppönen, H., de Keizer, N. F., Magrabi, F., Nykänen, P., Gude, W. T., et al. (2017) · Yearbook of Medical Informatics · doi:10.1055/s-0037-1606530 · Cited by 27
Cetinkaya, A. E., Akın, M., & Sağıroğlu, Ş. (2021) · doi:10.1109/iscturkey53027.2021.9654356 · Cited by 29
“Unfortunately, re-identification of anonymized or removed information against such protections is still possible using advanced attacks [2] such as linkage attacks.”
BackgroundCan Physicians Recognize Their Own Patients in De-identified Notes?
Stéphane, M., Shuying, S., Hofmann, D., & Adi, G. (2014) · Studies in health technology and informatics · doi:10.3233/978-1-61499-432-9-778 · Cited by 24
$\mathsf{PrivateLink}$ : Privacy-Preserving Integration and Sharing of Datasets
Lim, H. W., Poh, G. S., Xu, J., & Chittawar, V. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2924201 · Cited by 26
“datasets [24], [25], [36], [55], [56].”
Branson, J., Good, N. A., Chen, J.-W., Monge, W., Probst, C., & Emam, K. E. (2020) · Trials · doi:10.1186/s13063-020-4120-y · Cited by 24
Realistic Data Synthesis Using Enhanced Generative Adversarial Networks
Baowaly, M. K., Liu, C.-L., & Chen, K.-T. (2019) · IEEE International Conference on Artificial Intelligence and Knowledge Engineering (AIKE) · doi:10.1109/aike.2019.00057 · Cited by 23
“Multiple occurrences of reidentification of such anonymized records have already been witnessed and publicized in the past in [3], [5]–[7].”
Brophy, E., Vos, M. D., Boylan, G. B., & Ward, T. E. (2021) · IEEE Access · doi:10.1109/access.2021.3130421 · Cited by 26
“However, it has been shown that the de-identification of medical data does not guarantee privacy protection of all individuals in the dataset, and it is possible to re-identify individuals by linkage of data from other sources or residual information [2].”
BackgroundMazumdar, S., Konings, P., Hewett, M., Bagheri, N., McRae, I., & Fante, P. D. (2014) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12262 · Cited by 22
“8,18 Indeed, there exists a privacy-access continuum with individually identifiable restricted data at one end and aggregated publicly accessible data at another.”
BackgroundPrivacy risk assessment in context: A meta-model based on contextual integrity
Henriksen-Bulmer, J., Faily, S., & Jeary, S. (2019) · Computers & Security · doi:10.1016/j.cose.2019.01.003 · Cited by 29
Protecting Privacy and Transforming COVID-19 Case Surveillance Datasets for Public Use
Lee, B., Dupervil, B., Deputy, N. P., Duck, W. M., Soroka, S. D., Bottichio, L., Silk, B. J., Price, J., Sweeney, P. A., Fuld, J., et al. (2021) · Public Health Reports · doi:10.1177/00333549211026817 · Cited by 22
Al-Ani, A., Rayyan, A., Maswadeh, A., Sultan, H., Alhammouri, A., Asfour, H., Alrawajih, T., Al Sharie, S., Al Karmi, F., Al-Azzam, A. M., et al. (2024) · BMC Medical Ethics · doi:10.1186/s12910-024-01008-0 · Cited by 21
Have the cake and eat it too: Differential Privacy enables privacy and precise analytics
Subramanian, R. (2023) · Journal Of Big Data · doi:10.1186/s40537-023-00712-9 · Cited by 28
State of the Art in Clinical Informatics: Evidence and Examples
McCoy, A. B., Wright, A. T., Eysenbach, G., Malin, B., Patterson, E. S., Xu, H., & Sittig, D. F. (2013) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638827 · Cited by 24
Self-citationAging Well: Using Precision to Drive Down Costs and Increase Health Quality
Au, R., Ritchie, M., Hardy, S., Ang, T. F. A., & Lin, H. (2019) · Advances in Geriatric Medicine and Research · doi:10.20900/agmr20190003 · Cited by 25
The Past, Present and Future of the German Record Linkage Center (GRLC)
Antoni, M., & Schnell, R. (2017) · Jahrbücher für Nationalökonomie und Statistik · doi:10.1515/jbnst-2017-1004 · Cited by 21
“Although not one real-world attack on research data bases has been reported in the scientific literature (Emam et al., 2011), academic research focuses on attacks within the linkage unit.”
BackgroundDe-Health: All Your Online Health Information Are Belong to Us
Ji, S., Gu, Q., Weng, H., Liu, Q., Zhou, P., Chen, J., Li, Z., Beyah, R., & Wang, T. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00143 · Cited by 21
“In [22], Emam et al.”
Privacy in the Cloud: A Survey of Existing Solutions and Research Challenges
Silva, P. V. S., Monteiro, E., & Simões, P. (2021) · IEEE Access · doi:10.1109/access.2021.3049599 · Cited by 24
“A systematic literature review of 14 studies about re-identification attacks on anonymized datasets [63] concluded the following: (1) 26% of all records were re-identified (with a Confidence Interval (CI) of 95%).”
BackgroundData Re-Identification: Societal Safeguards
Altman, R. B., Clayton, E. W., Kohane, I. S., Malin, B., & Roden, D. M. (2013) · Science · doi:10.1126/science.339.6123.1032-c · Cited by 21
Self-citationPrivacy Risks of Sharing Data from Environmental Health Studies
Boronow, K. E., Perovich, L. J., Sweeney, L., Yoo, J. S., Rudel, R. A., Brown, P., & Brody, J. G. (2020) · Environmental Health Perspectives · doi:10.1289/ehp4817 · Cited by 22
“Nine studies collected medical data that may be linked to data disclosed in hospital discharge records, pharmacy sales, local news stories and obituaries, social media, and disease-centered online communities (Culnane et al. 2017; El Emam et al. 2011; Sweeney 2013).”
Power to the People: Data Citizens in the Age of Precision Medicine.
Evans, B. J. (2017) · PubMed · Cited by 21
Wu, X., Zheng, H., Dou, Z., Chen, F., Deng, J., Chen, X., Xu, S., Gao, G., Li, M., Wang, Z., et al. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa090 · Cited by 20
Delivering on NIH data sharing requirements: avoiding Open Data in Appearance Only
Watson, H., Gallifant, J., Lai, Y., Radunsky, A. P., Villanueva, C., Martinez‐Martin, N., Gichoya, J. W., Huynh, U. K., & Celi, L. A. (2023) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100771 · Cited by 26
Ford, E. M., Pillinger, S., Stewart, R. J., Jones, K. H., Roberts, A., Casey, A., Goddard, K., & Nenadić, G. (2025) · AI and Ethics · doi:10.1007/s43681-025-00681-0 · Cited by 26
“They found most re-identified data was not de-identified according to existing standards such as HIPAA [65 ].”
The Costs of Anonymization: Case Study Using Clinical Data
Pilgram, L., Meurers, T., Malin, B., Schäeffner, E., Eckardt, K., Praßer, F., & GCKD Investigators (2024) · Journal of Medical Internet Research · doi:10.2196/49445 · Cited by 19
Self-citationA Survey on Privacy Issues in Mobile Social Networks
Sai, A. M. V. V., & Li, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3009691 · Cited by 23
“Several studies show how public anonymized medical data can be used to uniquely identify patients [77].”
BackgroundQuestioning the Limits of Genomic Privacy
Knoppers, B. M., Dove, E. S., Litton, J., & Nietfeld, J. J. (2012) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2012.05.027 · Cited by 20
“Even when reidentification on the basis of deidentified or anonymized biomedical data would be possible because databases with voter registration data, hospital discharge data, and court proceedings are accessible, a survey showed that reidentification on the basis of properly ‘‘deidentified’’ (to say nothing of anony…”
BackgroundLenicov, F. R., & Fink, N. E. (2023) · Clinica Chimica Acta · doi:10.1016/j.cca.2023.117442 · Cited by 20
Based on Medicine, The Now and Future of Large Language Models
Su, Z., Tang, G., Huang, R., Yang, Q. W., Zhang, Z., & Dai, X. (2024) · Cellular and Molecular Bioengineering · doi:10.1007/s12195-024-00820-3 · Cited by 20
“Another privacy issue involves the risk of data re-identification, even if the data collected by ChatGPT undergoes de-identification, it is still possible to re-identify specific individuals by combining it with other available data sources [123].”
Ogbogu, U., Burningham, S., Ollenberger, A., Calder, K., Du, L., Emam, K. E., Hyde-Lay, R., Isasi, R. M., Joly, Y., Kerr, I., et al. (2014) · BMC Medical Ethics · doi:10.1186/1472-6939-15-7 · Cited by 22
Self-citationA Literature Survey and Classifications on Data Deanonymisation
Al-Azizy, D., Millard, D. E., Symeonidis, I., O’Hara, K., & Shadbolt, N. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31811-0_3 · Cited by 18
“The surveys [1] and [2], although following a systematic process, do not agree over a standard metric that can be used to measure the effectiveness of deanonymisation approaches.”
BackgroundInfluentialRe-Identification Risk in HIPAA De-Identified Datasets: The MVA Attack.
Janmey, V., & Elkin, P. L. (2018) · Europe PMC (PubMed Central) · Cited by 18
Gilbert, J.-P., Ng, V., Niu, J., & Rees, E. E. (2020) · Canada Communicable Disease Report · doi:10.14745/ccdr.v46i06a03 · Cited by 19
Artificial Intelligence‐Based Clinical Decision Support for COVID‐19–Where Art Thou?
Unberath, M., Ghobadi, K., Levin, S., Hinson, J. S., & Hager, G. D. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000104 · Cited by 21
Open tools for quantitative anonymization of tabular phenotype data: literature review
Haber, A. C., Sax, U., & Praßer, F. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac440 · Cited by 18
Li, M., Carrell, D., Aberdeen, J. S., Hirschman, L., Kirby, J., Li, B., Vorobeychik, Y., & Malin, B. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.03.019 · Cited by 19
“There are, however, concerns that the dissemination of such data could infringe upon the privacy rights of the corresponding patients [12, 13].”
BackgroundSelf-citationGANs for Tabular Healthcare Data Generation: A Review on Utility and Privacy
Coutinho‐Almeida, J., Rodrigues, P. P., & Cruz-Correia, R. J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88942-5_22 · Cited by 17
Hallinan, D., Boehm, F., Külpmann, A. I., & Elson, M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231151944 · Cited by 17
A Systematic Review of NLP Applications in Clinical Healthcare: Advancement and Challenges
Garg, R., & Gupta, A. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-99-9521-9_3 · Cited by 23
Anonymization and Pseudonymization of FHIR Resources for Secondary Use of Healthcare Data
Raso, E., Loreti, P., Ravaziol, M., & Bracciale, L. (2024) · IEEE Access · doi:10.1109/access.2024.3381034 · Cited by 17
“By correlating this information with the one coming from external sources, it is possible to link the medical data to the related patient even if the identifiers have been removed [5], [6].”
BackgroundInfluentialThe Data Tags Suite (DATS) model for discovering data access and use requirements
Alter, G. C., Gonzalez-Beltran, A. N., Lucila Ohno-machado, A., & Rocca‐Serra, P. (2020) · GigaScience · doi:10.1093/gigascience/giz165 · Cited by 17
“Human subjects may be exposed to re-identification from their genomes [3], geographic locations [4], or clinical data [5], and pieces of information that may be innocuous in isolation can allow re-identification when combined, particularly when linked to other datasets.”
Pollack, A. H., Simon, T. D., Snyder, J., & Pratt, W. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103201 · Cited by 20
An Overview of De-Identification Techniques and Their Standardization Directions
Youm, H. Y. (2020) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2019ici0002 · Cited by 21
“A study [5] provided a systematic review of four-teen distinct re-identification attacks that found “a high re-identification rate dominated by small-scale studies on data that was not de-identified according to existing standards.”.”
BackgroundCOLLAGENE enables privacy-aware federated and collaborative genomic data analysis
Li, W., Kim, M., Zhang, K., Chen, H., Jiang, X., & Harmanci, A. (2023) · Genome Biology · doi:10.1186/s13059-023-03039-z · Cited by 16
Guidance on the usability-privacy tradeoff for utility customer data aggregation
Ruddell, B. L., Cheng, D., Fournier, E. D., Pincetl, S., Potter, C., & Rushforth, R. R. (2020) · Utilities Policy · doi:10.1016/j.jup.2020.101106 · Cited by 16
Walonoski, J. A., Hall, D., Bates, K. M., Farris, M., Dagher, J. C., Downs, M. E., Sivek, R. T., Wellner, B., Gregorowicz, A., Hadley, M., et al. (2022) · Electronics · doi:10.3390/electronics11081199 · Cited by 20
“De-identification (also called anonymization) has been used to make health data available, but research has shown that de-identification does not guarantee privacy or eliminate risk [6,7].”
Information-Theoretic Approaches to Differential Privacy
Ünsal, A., & Önen, M. (2023) · ACM Computing Surveys · doi:10.1145/3604904 · Cited by 21
Huser, V., & Cimino, J. J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002061 · Cited by 16
Coppieters, Y., & Lévêque, A. (2013) · Archives of Public Health · doi:10.1186/0778-7367-71-15 · Cited by 16
De-identification of Unstructured Clinical Data for Patient Privacy Protection
Meystre, S. M. (2015) · Springer eBooks · doi:10.1007/978-3-319-23633-9_26 · Cited by 21
Mavrogiorgou, A., Kiourtis, A., Touloupou, M., Kapassa, E., Kyriazis, D., & Themistocleous, M. (2019) · Lecture notes in business information processing · doi:10.1007/978-3-030-11395-7_30 · Cited by 16
Correction: A Systematic Review of Re-Identification Attacks on Health Data
Emam, K. E., Jonker, E., Arbuckle, L., & Malin, B. (2015) · PLoS ONE · doi:10.1371/journal.pone.0126772 · Cited by 16
Self-citationEnsuring Patient Privacy in Data Sharing for Postapproval Research
Sarpatwari, A., Kesselheim, A. S., Malin, B., Gagne, J. J., & Schneeweiß, S. (2014) · New England Journal of Medicine · doi:10.1056/nejmsb1405487 · Cited by 16
Self-citationWellness Capitalism: Employee Health, the Benefits Maze, and Worker ControlPreprint
Nopper, T. K., & Zelickson, E. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4444397 · Cited by 16
A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakage
Xin, R., Mireshghallah, N., Li, S. S., Duan, M., Kim, H., Choi, Y., Tsvetkov, Y., Oh, S., & Koh, P. W. (2026) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml68715.2026.00065 · Cited by 15
“The adversary’s goal is to link this auxiliary information to records in the sanitized dataset to infer sensitive attributes about individuals.”
A scalable software solution for anonymizing high-dimensional biomedical data
Meurers, T., Bild, R., Do, K.-M., & Praßer, F. (2021) · GigaScience · doi:10.1093/gigascience/giab068 · Cited by 15
“The complexity of this task is also demonstrated by several re-identification attacks [11, 12].”
Background
Metadata
- Authors
- El Emam, K., Jonker, E., Arbuckle, L., & Malin, B.
- Affiliations
- Children's Hospital of Eastern Ontario (CA)
- Vanderbilt University (US)
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-12-02
- Volume
- 6
- Issue
- 12
- Pages
- e28071
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3229505
- OpenAlex
- W2083384763
- Semantic Scholar
- 3803595fac5818f0fce6296a6e3afc414c280a5a
- Cited by
- 427
- References
- 64
- Citations by year
- 2026: 36 · 2025: 42 · 2024: 48 · 2023: 34 · 2022: 33 · 2021: 29 · 2020: 46 · 2019: 36 · 2018: 27 · 2017: 19 · 2016: 20 · 2015: 20 · 2014: 15 · 2013: 13 · 2012: 9
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-04-16)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Vanderbilt University
- Canada Research Chairs
- National Institutes of Health
- National Human Genome Research Institute (U01HG00460301, U01HG004603)
- U.S. National Library of Medicine (R01LM009989)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Health Sciences › Health Professions › Health Information Management › Thoreau and American Literature
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Keywords
- re-identification attacks, health data privacy, de-identification, secondary use of health data, privacy law, health information disclosure
- MeSH terms
- Confidentiality, Humans, Software, United States, Reproducibility of Results, Models, Statistical, Databases, Factual, Medical Records Systems, Computerized, Computer Security, Privacy, Health Insurance Portability and Accountability Act
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.