Privacy-Preserving Distributed Linear Regression on High-Dimensional Data
Adrià Gascón,Phillipp Schoppmann,Borja Balle,Mariana Raykova,Jack Doerner,Samee Zahur,David Evans +6 more
- Vol. 2017, Iss: 4, pp 345-364
Reads0
Chats0
TLDR
A hybrid multi-party computation protocol that combines Yao’s garbled circuits with tailored protocols for computing inner products is proposed, suitable for secure computation because it uses an efficient fixed-point representation of real numbers while maintaining accuracy and convergence rates comparable to what can be obtained with a classical solution using floating point numbers.Abstract:
We propose privacy-preserving protocols for computing linear regression models, in the setting where the training dataset is vertically distributed among several parties. Our main contribution is a hybrid multi-party computation protocol that combines Yao’s garbled circuits with tailored protocols for computing inner products. Like many machine learning tasks, building a linear regression model involves solving a system of linear equations. We conduct a comprehensive evaluation and comparison of different techniques for securely performing this task, including a new Conjugate Gradient Descent (CGD) algorithm. This algorithm is suitable for secure computation because it uses an efficient fixed-point representation of real numbers while maintaining accuracy and convergence rates comparable to what can be obtained with a classical solution using floating point numbers. Our technique improves on Nikolaenko et al.’s method for privacy-preserving ridge regression (S&P 2013), and can be used as a building block in other analyses. We implement a complete system and demonstrate that our approach is highly scalable, solving data analysis problems with one million records and one hundred features in less than one hour of total running time.read more
Citations
More filters
Posted Content
Vertically Federated Graph Neural Network for Privacy-Preserving Node Classification
Jun Zhou,Chaochao Chen,Zheng Longfei,Huiwen Wu,Jia Wu,Xiaolin Zheng,Bingzhe Wu,Ziqi Liu,Li Wang +8 more
TL;DR: Wang et al. as mentioned in this paper proposed a federated GNN learning paradigm for privacy-preserving node classification task under data vertically partitioned setting, which can be generalized to existing GNN models.
Book ChapterDOI
SecureMCMR: Computation Outsourcing for MapReduce Applications
Lindsey Kennard,Ana Milanova +1 more
TL;DR: SecureMCMR is presented, a system that utilizes two public clouds for privacy preserving computation outsourcing for MapReduce applications and the operations they use, which shows overhead of 160%, 254%, and 380% over plaintext execution.
Dissertation
Vers l'efficacité et la sécurité du chiffrement homomorphe et du cloud computing
TL;DR: Ducas et Micciancio as discussed by the authors proposed a bootstrapping-based schema of chiffrement homomorphe, called TFHE, which is based on the Gentry-Sahai-Waters schema.
Journal ArticleDOI
Developing normalization schemes for data isolated distributed deep learning
TL;DR: S synchronous stochastic gradient descent algorithm is used for data exchange during training, and provides several normalization approaches to the problem of BN failure caused by data imbalance.
Dissertation
Learning latent variable models: efficient algorithms and applications
TL;DR: This thesis extends the existing theory of methods of moments to learn models that are traditionally used to do topic modeling – like the single-topic model and Latent Dirichlet Allocation – providing improved learning techniques and comparing them with existing methods, which prove to outperform in terms of speed and learning accuracy.
References
More filters
Book
Numerical Optimization
Jorge Nocedal,Stephen J. Wright +1 more
TL;DR: Numerical Optimization presents a comprehensive and up-to-date description of the most effective methods in continuous optimization, responding to the growing interest in optimization in engineering, science, and business by focusing on the methods that are best suited to practical problems.
Book
Machine Learning : A Probabilistic Perspective
TL;DR: This textbook offers a comprehensive and self-contained introduction to the field of machine learning, based on a unified, probabilistic approach, and is suitable for upper-level undergraduates with an introductory-level college math background and beginning graduate students.
Book
The algebraic eigenvalue problem
TL;DR: Theoretical background Perturbation theory Error analysis Solution of linear algebraic equations Hermitian matrices Reduction of a general matrix to condensed form Eigenvalues of matrices of condensed forms The LR and QR algorithms Iterative methods Bibliography.
Book
The Algorithmic Foundations of Differential Privacy
Cynthia Dwork,Aaron Roth +1 more
TL;DR: The preponderance of this monograph is devoted to fundamental techniques for achieving differential privacy, and application of these techniques in creative combinations, using the query-release problem as an ongoing example.