Privacy-Preserving Techniques in Generative AI and Large Language Models: A Narrative Review
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Generative AI, including large language models (LLMs), has transformed the paradigm of data generation and creative content, but this progress raises critical privacy concerns, especially when models are trained on sensitive data. This review provides a comprehensive overview of privacy-preserving techniques aimed at safeguarding data privacy in generative AI, such as differential privacy (DP), federated learning (FL), homomorphic encryption (HE), and secure multi-party computation (SMPC). These techniques mitigate risks like model inversion, data leakage, and membership inference attacks, which are particularly relevant to LLMs. Additionally, the review explores emerging solutions, including privacy-enhancing technologies and post-quantum cryptography, as future directions for enhancing privacy in generative AI systems. Recognizing that achieving absolute privacy is mathematically impossible, the review emphasizes the necessity of aligning technical safeguards with legal and regulatory frameworks to ensure compliance with data protection laws. By discussing the ethical and legal implications of privacy risks in generative AI, the review underscores the need for a balanced approach that considers performance, scalability, and privacy preservation. The findings highlight the need for ongoing research and innovation to develop privacy-preserving techniques that keep pace with the scaling of generative AI, especially in large language models, while adhering to regulatory and ethical standards.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754 · cited 1×
“In sensitive domains such as healthcare, membership inference attacks could expose patients’ personal health records, violating laws like the GDPR and HIPAA [4,6].”
RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response
Erlingsson, Ú., Pihur, V., & Korolova, A. (2014) · Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2660267.2660348 · Cited by 1,838
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727 · cited 1×
“Various techniques for generating synthetic data involve generative models, which come in forms like GANs or VAEs; they learn a model with the ability to generate data much like the original dataset.”
Machine Learning Models that Remember Too Much
Song, C., Ristenpart, T., & Shmatikov, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134077 · Cited by 526 · cited 3×
“The call for robust ethical frameworks that enhance equity, transparency, and human-rights protection across sectors is a critical interdisciplinary challenge.”
LOGAN: Membership Inference Attacks Against Generative Models
Hayes, J., Melis, L., Danezis, G., & De Cristofaro, E. (2019) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2019-0008 · Cited by 433
Ethical challenges and solutions of generative AI: an interdisciplinary perspective
Al-kfairy, M., Mustafa, D., Kshetri, N., Insiew, M., & Alfandi, O. (2024) · Informatics · doi:10.3390/informatics11030058 · Cited by 328 · cited 3×
“Despite these challenges, the potential benefits of this interdisciplinary approach are immense, with significant implications for the future of digital security and privacy protection [43,44].”
InfluentialMaking AI Forget You: Data Deletion in Machine Learning
Ginart, A., Guan, M. Y., Valiant, G., & Zou, J. (2019) · arXiv · doi:10.48550/arxiv.1907.05012 · Cited by 175 · cited 2×
“These regularization techniques provide a favorable trade-off between utility and privacy while also enabling faster training using existing optimization approaches.”
A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems
Gu, X., Sabrina, F., Fan, Z., & Sohail, S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20156539 · Cited by 139
EW-Tune: A Framework for Privately Fine-Tuning Large Language Models with Differential Privacy
Behnia, R., Ebrahimi, M. R., Pacheco, J., & Padmanabhan, B. (2022) · 2022 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw58026.2022.00078 · Cited by 60 · cited 2×
“This approach has been shown to outperform conventional generative models, particularly in terms of scalability and maintaining inter-column correlations.”
(2023) · doi:10.52202/075280-2687 · Cited by 57
Cited by
Raza, S., Sapkota, R., Karkee, M., & Emmanouilidis, C. (2026) · AI Open · doi:10.1016/j.aiopen.2026.02.006 · Cited by 57
Patel, K., Shah, M., Qureshi, K. M., & Qureshi, M. R. N. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11435-z · Cited by 42
GDPR and Large Language Models: Technical and Legal Obstacles
Feretzakis, G., Vagena, E., Kalodanis, K., Peristera, P., Kalles, D., & Anastasiou, A. (2025) · Future Internet · doi:10.3390/fi17040151 · Cited by 38
Self-citationAlcaraz, J. M. L., Bouma, H., & Strodthoff, N. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110196 · Cited by 13
Joshi, A., & Baidya, S. (2026) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp6020063 · Cited by 4
Metadata
- Authors
- Feretzakis, G., Papaspyridis, K., Gkoulalas-Divanis, A., & Verykios, V. S.
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2024-11-04
- Volume
- 15
- Issue
- 11
- Pages
- 697
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W4404024323
- Cited by
- 145
- References
- 13
- FWCI
- 6.51
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Privacy-Preserving Techniques in Generative AI and Large Language Models: A Narrative Review. https://app.cochat.ai/papers/10.3390/info15110697
- The paper
- Feretzakis, G., Papaspyridis, K., Gkoulalas-Divanis, A., & Verykios, V. S. (2024). Privacy-Preserving Techniques in Generative AI and Large Language Models: A Narrative Review. Information. https://doi.org/10.3390/info15110697
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.