A Systematic Review of Re-Identification Attacks on Health Data
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Privacy legislation in most jurisdictions allows the disclosure of health data for secondary purposes without patient consent if it is de-identified. Some recent articles in the medical, legal, and computer science literature have argued that de-identification methods do not provide sufficient protection because they are easy to reverse. Should this be the case, it would have significant and important implications on how health information is disclosed, including: (a) potentially limiting its availability for secondary purposes such as research, and (b) resulting in more identifiable health information being disclosed. Our objectives in this systematic review were to: (a) characterize known re-identification attacks on health data and contrast that to re-identification attacks on other kinds of data, (b) compute the overall proportion of records that have been correctly re-identified in these attacks, and (c) assess whether these demonstrate weaknesses in current de-identification methods. METHODS AND FINDINGS: Searches were conducted in IEEE Xplore, ACM Digital Library, and PubMed. After screening, fourteen eligible articles representing distinct attacks were identified. On average, approximately a quarter of the records were re-identified across all studies (0.26 with 95% CI 0.046-0.478) and 0.34 for attacks on health data (95% CI 0-0.744). There was considerable uncertainty around the proportions as evidenced by the wide confidence intervals, and the mean proportion of records re-identified was sensitive to unpublished studies. Two of fourteen attacks were performed with data that was de-identified using existing standards. Only one of these attacks was on health data, which resulted in a success rate of 0.00013. CONCLUSIONS: The current evidence shows a high re-identification rate but is dominated by small-scale studies on data that was not de-identified according to existing standards. This evidence is insufficient to draw conclusions about the efficacy of de-identification methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even if the data collected by ChatGPT are deidentified, there is still the potential for individuals to be reidentified by combining them with other available data sources [31].”
From Ethical Considerations of Using ChatGPT in Health Care (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Such re-identification attacks 39 have been shown to yield high success rates both with tabular data 40,41 (such as patient records) and medical imaging data 42 .”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [39]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 1×
“To evaluate the accuracy of the screening, we performed an inter-rater reliability analysis with two independent raters. After the first rater completed his screening (KEE), a second rater not involved in the study in any way was recruited (KA). We went through the study objectives and screening criteria with the seco…”
MethodPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“Figure 1 depicts a PRISMA diagram (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for this review [50,51], and Checklist S1 contains the completed PRISMA checklist.”
MethodDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“identified to a tolerance value based on the commonly used ruleof-thumb provided in the literature of 5|kz10, where k is the number of studies included in the analysis [46,47].”
Methodk-ANONYMITY: A MODEL FOR PROTECTING PRIVACY
SWEENEY, L. (2002) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488502001648 · Cited by 8,571 · cited 2×
“C [67] 2002 Yes Researcher 1 of 135,000 USA Removal of names and addresses Yes”
BackgroundThe kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093 · cited 1×
“8 at a power of 80% [26,27].”
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · cited 1×
“This showed the proportion of records correctly re-identified against the standard error [49].”
BackgroundRobust De-anonymization of Large Sparse Datasets
Narayanan, A., & Shmatikov, V. (2008) · 2008 IEEE Symposium on Security and Privacy (sp 2008) · doi:10.1109/sp.2008.33 · Cited by 2,372
Privacy-preserving data publishing: A survey of recent developments
Fung, B. C. M., Wang, K., Chen, R., & Yu, P. S. (2010) · ACM Computing Surveys · doi:10.1145/1749603.1749605 · Cited by 1,704 · cited 1×
“The availability of de-identified data has been critical for population health research, health services research, and public health. De-identification is the act of reducing the information content in data to decrease the probability of discovering an individual's identity. Over the past several decades, a number of…”
MethodDe-anonymizing Social Networks
Narayanan, A., & Shmatikov, V. (2009) · 2009 30th IEEE Symposium on Security and Privacy · doi:10.1109/sp.2009.22 · Cited by 1,301
Homer, N., Szelinger, S., Redman, M., Duggan, D., Tembe, W., Muehling, J., Pearson, J. V., Stephan, D. A., Nelson, S. F., & Craig, D. W. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000167 · Cited by 1,221 · cited 1×
“There is evidence that raw genomic information and summary statistics can distinguish individuals [32,33,34], and existing de-identification methods do not provide strong privacy guarantees [35].”
BackgroundBroken Promises of Privacy: Responding to the Surprising Failure of AnonymizationPreprint
Ohm, P. (2009) · SSRN Electronic Journal · Cited by 997
Some Statistical Methods for Combining Experimental Results
Laird, N. M., & Mosteller, F. (1990) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300008916 · Cited by 568 · cited 3×
“if they were not homogeneous, we would use the random-effects estimator proposed by Laird and Mosteller [42].”
MethodInfluentialStandards for privacy of individually identifiable health information. Final rule.
(2002) · PubMed · Cited by 400
Weaving Technology and Policy Together to Maintain Confidentiality
Sweeney, L. (1997) · Journal of Law, Medicine & Ethics · doi:10.1111/j.1748-720x.1997.tb01885.x · Cited by 375 · cited 1×
“The argument that data is readily susceptible to re-identification is not new. In the 1990's, there was a well-publicized re-identification attack on a claims database containing information on 135,000 patients disseminated by the Group Insurance Commission”
BackgroundMyths and fallacies of personally identifiable information
Narayanan, A., & Shmatikov, V. (2010) · Communications of the ACM · doi:10.1145/1743546.1743558 · Cited by 346 · cited 1×
“This argument has been invoked to substantiate calls for legislative and regulatory changes in court cases [8] and in the peer-reviewed scientific literature [9,10,11,12].”
BackgroundSterne, J. A. C., Becker, B. J., & Egger, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch5 · Cited by 341 · cited 1×
“We also evaluated publication bias using a funnel plot on the proportion of records re-identified [48].”
MethodGenomic Research and Human Subject Privacy
Lin, Z., Owen, A. B., & Altman, R. B. (2004) · Science · doi:10.1126/science.1095019 · Cited by 339
Random-Effects Meta-Analyses Are Not Always Conservative
Poole, C., & Greenland, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010035 · Cited by 338 · cited 1×
“weight to attacks on small databases compared to fixed-effects models [68].”
BackgroundEvaluating re-identification risks with respect to the HIPAA privacy rule
Benitez, K., & Malin, B. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.000026 · Cited by 301 · cited 8×
“Third, the court case between the Southern Illinoisan newspaper and the public health department revolved around a cancer registry that included the patients’ 5-digit ZIP code, which would not pass the Safe Harbor standard [52].”
BackgroundResultInfluentialSelf-citationKho, M. E., Duffett, M., Willison, D. J., Cook, D. J., & Brouwers, M. C. (2009) · BMJ · doi:10.1136/bmj.b866 · Cited by 269 · cited 1×
“These two groups differ in demographic and socioeconomic characteristics, resulting in biased data sets [15,16,17].”
BackgroundRevisiting the uniqueness of simple demographics in the US population
Golle, P. (2006) · Proceedings of the 5th ACM workshop on Privacy in electronic society · doi:10.1145/1179601.1179615 · Cited by 254
Is Deidentification Sufficient to Protect Health Privacy in Research?
Rothstein, M. A. (2010) · The American Journal of Bioethics · doi:10.1080/15265161.2010.494215 · Cited by 253 · cited 1×
“This argument has been invoked to substantiate calls for legislative and regulatory changes in court cases [8] and in the peer-reviewed scientific literature [9,10,11,12].”
BackgroundA Globally Optimal k-Anonymity Method for the De-Identification of Health Data
El Emam, K., Dankar, F. K., Issa, R., Jonker, E., Amyot, D., Cogo, E., Corriveau, J.-P., Walker, M., Chowdhury, S., Vaillancourt, R., et al. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3144 · Cited by 235 · cited 1×
“These two groups differ in demographic and socioeconomic characteristics, resulting in biased data sets [15,16,17].”
BackgroundSelf-citationCumulative Meta-Analysis: A Consideration of Indicators of Sufficiency and Stability
Mullen, B., Muellerleile, P., & Bryant, B. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/01461672012711006 · Cited by 234 · cited 2×
“identified to a tolerance value based on the commonly used ruleof-thumb provided in the literature of 5|kz10, where k is the number of studies included in the analysis [46,47].”
MethodMcGuire, A. L., & Gibbs, R. A. (2006) · Science · doi:10.1126/science.1125339 · Cited by 184 · cited 1×
“Yet, there is a growing view that there has been a failure of de-identification”
Background"I know what you did last summer": query logs and user privacy
Jones, R., Kumar, R., Pang, B., & Tomkins, A. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321573 · Cited by 175 · cited 1×
“vanity queries) and that their locations can be readily determined from the queries themselves [59,60,61,62,63], which makes it somewhat trivial to re-identify individuals from search queries.”
BackgroundSanderson, M., & Köhler, J. (2004) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 169
Sample Size Determinations for the Two Rater Kappa Statistic
Flack, V. F., Afifi, A. A., Lachenbruch, P. A., & Schouten, H. J. A. (1988) · Psychometrika · doi:10.1007/bf02294215 · Cited by 160 · cited 1×
“given an expected effect size of 0.8 at a power of 80%”
BackgroundInfluentialHrynaszkiewicz, I., Norton, M. L., Vickers, A. J., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c181 · Cited by 154
In defense of Pierre Louis who pioneered the epidemiological approach to good medicine
Morabia, A. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.07.007 · Cited by 149
Malin, B. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1603 · Cited by 142
Self-citationAnalysis of geographic queries in a search engine log
Gan, Q., Attenberg, J., Markowetz, A., & Suel, T. (2008) · Location and the Web · doi:10.1145/1367798.1367806 · Cited by 135 · cited 1×
“vanity queries) and that their locations can be readily determined from the queries themselves [59,60,61,62,63], which makes it somewhat trivial to re-identify individuals from search queries.”
BackgroundJacobs, K. B., Yeager, M., Wacholder, S., Craig, D. W., Kraft, P., Hunter, D. J., Paschal, J., Manolio, T. A., Tucker, M. A., Hoover, R. N., et al. (2009) · Nature Genetics · doi:10.1038/ng.455 · Cited by 111
You are what you say: privacy risks of public mentions
Frankowski, D., Cosley, D., Sen, S., Terveen, L., & Riedl, J. (2006) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1148170.1148267 · Cited by 103 · cited 1×
“[73] 2006 No Researchers Of 133 users, 60% of those who mention at least 8 movies USA Direct identifiers removed No”
BackgroundIdentifiability in biobanks: models, measures, and mitigation strategies
Malin, B., Loukides, G., Benitez, K., & Clayton, E. W. (2011) · Human Genetics · doi:10.1007/s00439-011-1042-5 · Cited by 86 · cited 1×
“Therefore, the assessment of re-identification risk from genomic information remains an active area of research [36].”
BackgroundSelf-citationWherefore art thou R3579X? anonymized social networks, hidden patterns, and structural steganography
Bäckström, L., Dwork, C., & Kleinberg, J. M. (2011) · Communications of the ACM · doi:10.1145/2043174.2043199 · Cited by 85
Geographic intention and modification in web search
Jones, R., Zhang, W. V., Rey, B., Jhala, P., & Stipp, E. (2008) · International Journal of Geographical Information Systems · doi:10.1080/13658810701626186 · Cited by 81
No Place to Hide — Reverse Identification of Patients from Published Maps
Brownstein, J. S., Cassa, C. A., & Mandl, K. D. (2006) · New England Journal of Medicine · doi:10.1056/nejmc061891 · Cited by 78 · cited 1×
“E [72] 2006 Yes Researchers 79% of 550 USA No Verified (with original data set)”
BackgroundMethods for the de-identification of electronic health records for genomic research
Emam, K. E. (2011) · Genome Medicine · doi:10.1186/gm239 · Cited by 75
The Case for Samples of Anonymized Records from the 1991 Census
Marsh, C., Skinner, C. J., Arber, S., Penhale, B., Openshaw, S., Hobcraft, J., Lievesley, D., & Walford, N. S. (1991) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2983043 · Cited by 65
Scenarios of attack: the data intruder's perspective on statistical disclosure risk
Elliot, M. J., & Dale, A. (1999) · Research Explorer (The University of Manchester) · Cited by 62
Access to medical records for research purposes: varying perceptions across research ethics boards
Willison, D. J., Emerson, C., Szala‐Meneok, K., Gibson, E., Schwartz, L. J., Weisbaum, K. M., Fournier, F., Brazil, K., & Coughlin, M. D. (2008) · Journal of Medical Ethics · doi:10.1136/jme.2006.020032 · Cited by 59 · cited 1×
“Additionally, in the context of health research, many institutional review boards will waive the consent requirement if the data is de-identified [4,5].”
BackgroundPersonal Privacy and Public Health
Harris, M., Levy, A. R., & Teschke, K. (2008) · Canadian Journal of Public Health · doi:10.1007/bf03403758 · Cited by 33
Betrayed By My Shadow: Learning Data Identity via Trail Matching
Malin, B. (2005) · Cited by 32
Self-citationReidentification of Individuals in Chicago’s Homicide Database: A Technical and Legal Study
Ochoa, S., Rasmussen, J. J., Robson, C., & Salib, M. (2002) · Cited by 31
Safe Data versus Safe Settings: Access to Microdata from the British Census
Marsh, C., Dale, A., & Skinner, C. (1994) · International Statistical Review · doi:10.2307/1403544 · Cited by 26 · cited 1×
“The reidentification risk from the sample census records had been evaluated in detail by a team of statisticians, was known to be very low, and was documented, and therefore meets the definition of standards-based de-identification [43,64].”
BackgroundA Secure Protocol to Distribute Unlinkable Health Data
Malin, B., & Sweeney, L. (2005) · PubMed · doi:10.1184/r1/6620798 · Cited by 23
Self-citationRe-identifying register data by survey data: An empirical study
Bender, S., Brand, R., & Bacher, J. (2001) · Statistical Journal of the United Nations Economic Commission for Europe · doi:10.3233/sju-2001-18412 · Cited by 21 · cited 1×
“A [70] 2001 No Researchers 29 of 273 Germany ‘‘Factually anonymous’’ Yes (records containing insurance numbers only)”
BackgroundPrivacy Interests in Prescription Data, Part 2: Patient Privacy
Emam, K. E., & Kosseim, P. (2009) · IEEE Security & Privacy · doi:10.1109/msp.2009.47 · Cited by 21 · cited 1×
“I [75] 2009 Yes Researcher 1 of 3,510 Canada Direct identifiers removed Yes”
BackgroundA Study on the Re-Identifiability of Dutch Citizens
Koot, M. R., Noordende, G. J. V. T., de Laat, C., Serjantov, A., & Troncoso, C. (2010) · UvA-DARE (University of Amsterdam) · Cited by 17
Geographic features in web search retrieval
Jones, R., Hassan, A., & Díaz, F. (2008) · Workshop on Geographic Information Retrieval (GIR) · doi:10.1145/1460007.1460023 · Cited by 15 · cited 1×
“vanity queries) and that their locations can be readily determined from the queries themselves [59,60,61,62,63], which makes it somewhat trivial to re-identify individuals from search queries.”
BackgroundPrescriptions, Privacy, and the First Amendment
Curfman, G., Morrissey, S., & Drazen, J. M. (2011) · New England Journal of Medicine · doi:10.1056/nejme1104460 · Cited by 14
The Illinois Department of Public Health.
Rr, C. (1955) · PubMed · Cited by 13
The Deidentification Dilemma: A Legislative and Contractual Proposal
Gellman, R. (2010) · FLASH - Fordham Law Archive of Scholarship & History (Fordham University) · Cited by 12
Becker, C. (2006) · PubMed · Cited by 11
Robeznieks, A. (2005) · PubMed · Cited by 10
Becker, C. (2008) · PubMed · Cited by 4
Proceedings of the first international workshop on Location and the web
Boll, S., Jones, C. B., Kansa, E. C., Kishor, P., Naaman, M., Purves, R. S., Scharl, A., & Wilde, E. (2008) · Cited by 3
Research works printed but not linked: 4
- A Robeznieks, 2005, Privacy fear factor arises., Modern Healthcare, 35, 6
- E Bartlett, 1993, RMS need to safeguard computerized patient records to protect hospitals., Hospital Risk Management, 15
- 2007, Mike Gordon v. the Minister of Health and the Privacy Commissioner of Canada: Memorandum of Fact and Law of the Privacy Commissioner of Canada., Federal Court
- L Sweeney, Data sharing under HIPAA: 12 years later. Workshop on the HIPAA Privacy Rule's De-Identification Standard, March 8–9, 2010
Cited by
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
“Such re-identification attacks 39 have been shown to yield high success rates both with tabular data 40,41 (such as patient records) and medical imaging data 42 .”
BackgroundPreparing a collection of radiology examinations for distribution and retrieval
Demner-Fushman, D., Kohli, M. D., Rosenman, M. B., Shooshan, S. E., Rodriguez, L., Antani, S., Thoma, G. R., & McDonald, C. J. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv080 · Cited by 1,164
“Note, however, that even the most accurate automatic de-identification techniques fail on occasion to remove all possible instances of personally identifiable information (PII).(16) Because we planned to make these studies publicly available, we wanted to verify that the automatic de-identification processes removed a…”
BackgroundPrivacy Risk in Machine Learning: Analyzing the Connection to Overfitting
Yeom, S., Giacomelli, I., Fredrikson, M., & Jha, S. (2018) · 2018 IEEE 31st Computer Security Foundations Symposium (CSF) · doi:10.1109/csf.2018.00027 · Cited by 1,001
“A number of previous studies [21], [22], [47], [48], [49], [50] have looked into membership attacks from statistics commonly published in genome-wide association studies (GWAS).”
ResultPrivacy in the Internet of Things: threats and challenges
Ziegeldorf, J. H., Morchon, O. G., & Wehrle, K. (2014) · Security and Communication Networks · doi:10.1002/sec.795 · Cited by 610
“Those approaches are difficult to fit to the IoT: Most data anonymization techniques can be broken using auxiliary data [78, 79, 80], that is likely to become available at some point during the IoT evolution.”
BackgroundTrustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
Metadata
- Authors
- El Emam, K., Jonker, E., Arbuckle, L., & Malin, B.
- Affiliations
- Children's Hospital of Eastern Ontario (CA)
- Vanderbilt University (US)
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-12-02
- Volume
- 6
- Issue
- 12
- Pages
- e28071
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3229505
- OpenAlex
- W2083384763
- Semantic Scholar
- 3803595fac5818f0fce6296a6e3afc414c280a5a
- Cited by
- 427
- References
- 64
- Citations by year
- 2026: 36 · 2025: 42 · 2024: 48 · 2023: 34 · 2022: 33 · 2021: 29 · 2020: 46 · 2019: 36 · 2018: 27 · 2017: 19 · 2016: 20 · 2015: 20 · 2014: 15 · 2013: 13 · 2012: 9
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-04-16)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Vanderbilt University
- Canada Research Chairs
- National Institutes of Health
- National Human Genome Research Institute (U01HG00460301, U01HG004603)
- U.S. National Library of Medicine (R01LM009989)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Health Sciences › Health Professions › Health Information Management › Thoreau and American Literature
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Keywords
- re-identification attacks, health data privacy, de-identification, secondary use of health data, privacy law, health information disclosure
- MeSH terms
- Confidentiality, Humans, Software, United States, Reproducibility of Results, Models, Statistical, Databases, Factual, Medical Records Systems, Computerized, Computer Security, Privacy, Health Insurance Portability and Accountability Act
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.