The DOI matches its DataCite record; 28 of the 29 references it cites were found in a registry or an index.
Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption
Open accessAbstract
Consider two data providers, each maintaining private records of different feature sets about common entities. They aim to learn a linear model jointly in a federated setting, namely, data is local and a shared model is trained from locally computed updates. In contrast with most work on distributed learning, in this scenario (i) data is split vertically, i.e. by features, (ii) only one data provider knows the target variable and (iii) entities are not linked across the data providers. Hence, to the challenge of private learning, we add the potentially negative consequences of mistakes in entity resolution. Our contribution is twofold. First, we describe a three-party end-to-end solution in two phases ---privacy-preserving entity resolution and federated logistic regression over messages encrypted with an additively homomorphic scheme---, secure against a honest-but-curious adversary. The system allows learning without either exposing data in the clear or sharing which entities the data providers have in common. Our implementation is as accurate as a naive non-private solution that brings all data in one place, and scales to problems with millions of entities with hundreds of features. Second, we provide what is to our knowledge the first formal analysis of the impact of entity resolution's mistakes on learning, with results on how optimal classifiers, empirical losses, margins and generalisation abilities are affected. Our results bring a clear and strong support for federated learning: under reasonable assumptions on the number and magnitude of entity resolution's mistakes, it can be extremely beneficial to carry out federated learning in the setting where each peer's data provides a significant uplift to the other.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Trusted Distributed AI extends the principles of federated and collaborative learning with trust guarantees, ensuring that distributed models can be trained and deployed without exposing sensitive data or compromising model integrity [235,236].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [236]
Experimental — accuracy not yet measuredIn the citing paper
“Unlike sample-partitioned/horizontal FL, the vertical FL setting requires a more complex mechanism to decompose the loss function at each party [5], [15], [16].”
From SecureBoost: A Lossless Federated Learning Framework (2021) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,190
Public-Key Cryptosystems Based on Composite Degree Residuosity Classes
Paillier, P. (2007) · Lecture Notes in Computer Science · doi:10.1007/3-540-48910-x_16 · Cited by 7,250
Fully homomorphic encryption using ideal lattices
Gentry, C. (2009) · Proceedings of the forty-first annual ACM symposium on Theory of computing · doi:10.1145/1536414.1536440 · Cited by 6,806
Differential Privacy: A Survey of Results
Dwork, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79228-4_1 · Cited by 3,542
Bhatia, R. (1996) · Cited by 2,847
Rademacher and Gaussian Complexities: Risk Bounds and Structural Results
Bartlett, P. L., & Mendelson, S. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44581-1_15 · Cited by 1,989
Christen, P. (2012) · Springer eBooks · doi:10.1007/978-3-642-31164-2 · Cited by 1,176
Local Privacy and Statistical Minimax Rates
Duchi, J. C., Jordan, M. I., & Wainwright, M. J. (2013) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2013.53 · Cited by 1,110
Privacy-preserving logistic regression
Chaudhuri, K., & Monteleoni, C. (2008) · Cited by 526
A taxonomy of privacy-preserving record linkage techniques
Vatsalan, D., Christen, P., & Verykios, V. S. (2013) · Information Systems · doi:10.1016/j.is.2012.11.005 · Cited by 295 · cited 4×
“CLKs, resulting in a number of comparisons equal to the product of the datasets sizes. The most similar pairs are selected as matches, in a greedy fashion. Faster computation is possible by blocking [Vatsalan et al., 2013b]. The outputs of entity matching are two permutations ˙;˝and a mask m: ˙;˝describe how A and B m…”
BackgroundInfluentialOn the Complexity of Linear Prediction: Risk Bounds, Margin Bounds, and Regularization
Kakade, S. M., Sridharan, K., & Tewari, A. (2008) · ScholarlyCommons (University of Pennsylvania) · Cited by 236
Scalable and Secure Logistic Regression via Homomorphic Encryption
Aono, Y., Hayashi, T., Phong, L. T., & Wang, L. (2016) · ACM Conference on Data and Application Security and Privacy (CODASPY) · doi:10.1145/2857705.2857731 · Cited by 183
Privacy-Preserving Record Linkage
Hall, R., & Fienberg, S. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15838-4_24 · Cited by 113
A Constraint Satisfaction Cryptanalysis of Bloom Filters in Private Record Linkage
Kuzu, M., Kantarcıoğlu, M., Durham, E., & Malin, B. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22263-4_13 · Cited by 111
Febrl: a freely available record linkage system with a graphical user interface
Christen, P. (2008) · Cited by 94
Cryptanalysis of Basic Bloom Filters Used for Privacy Preserving Record Linkage
Niedermeyer, F., Steinmetzer, S., Kroll, M., & Schnell, R. (2014) · Journal of Privacy and Confidentiality · doi:10.29012/jpc.v6i2.640 · Cited by 82
Loss factorization, weakly supervised learning and label noise robustnessPreprint
Patrini, G., Nielsen, F., Nock, R., & Carioni, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02450 · Cited by 78
Self-citationPatrini, G., Nock, R., Rivera, P., & Caetano, T. S. (2014) · Cited by 62
Self-citationBregman Divergences and Surrogates for Learning
Nock, R., & Nielsen, F. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.225 · Cited by 55
Self-citationA practical approach to achieve private medical record linkage in light of public resources
Kuzu, M., Kantarcıoğlu, M., Durham, E., Toth, C., & Malin, B. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-000917 · Cited by 50
Efficient two-party private blocking based on sorted nearest neighborhood clustering
Vatsalan, D., Christen, P., & Verykios, V. S. (2013) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2505515.2505757 · Cited by 35
PrivLogit: Efficient Privacy-preserving Logistic Regression by Tailoring Numerical OptimizersPreprint
Xie, W., Wang, Y., Boker, S. M., & Brown, D. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01170 · Cited by 22
Privacy-preservation for Stochastic Gradient Descent Application to Secure Logistic Regression
Wu, S., Teruya, T., & Kawamoto, J. (2013) · 人工知能学会全国大会論文集 · Cited by 19
Privacy-Preserving Statistical Analysis by Exact Logistic Regression
duVerle, D. A., Kawasaki, S., Yamada, Y., Sakuma, J., & Tsuda, K. (2015) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2015.14 · Cited by 18
Efficient private record linkage of very large datasets
Schnell, R. (2013) · City Research Online (City University London) · Cited by 9
Nambwenya, J., Solomon, A., & Le, T. V. (2014) · PDXScholar (Portland State University) · Cited by 8
Fast Learning from Distributed Datasets without Entity MatchingPreprint
Patrini, G., Nock, R., Hardy, S., & Caetano, T. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.04002 · Cited by 5
Self-citationOn Regularizing Rademacher Observation Losses
Nock, R. (2016) · ANU Open Research (Australian National University) · Cited by 1
Self-citation
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
“Independently of the eventual technical levy of carrying out record linkage privately [348], the task itself happens to be substantially noise prone in the real world [347] and only sparse results have addressed its impact on training models [198].”
BackgroundSelf-citationFederated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944481 · Cited by 1,725
A review of applications in federated learning
Li, L., Fan, Y., Tse, M., & Lin, K.-Y. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106854 · Cited by 1,559
Metadata
- Authors
- Hardy, S., Henecka, W., Ivey-Law, H., Nock, R., Patrini, G., Smith, G., & Thorne, B.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1711.10677
- OpenAlex
- W2773194476
- Cited by
- 431
- References
- 29
- Citations by year
- 2026: 4 · 2025: 31 · 2024: 59 · 2023: 70 · 2022: 83 · 2021: 88 · 2020: 69 · 2019: 21 · 2018: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Cryptography and Data Security
- Physical Sciences › Computer Science › Information Systems › Cloud Data Security Solutions
- Keywords
- vertical partitioning, entity resolution, honest-but-curious adversary, generalization, linear models, three-party protocol
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
