Timezone: »
Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The standard DP algorithms require a single trusted party to have access to the entire data, which is a clear weakness, or add prohibitive amounts of noise. We consider DP Bayesian learning in a distributed setting, where each party only holds a single sample or a few samples of the data. We propose a learning strategy based on a secure multi-party sum function for aggregating summaries from data holders and the Gaussian mechanism for DP. Our method builds on an asymptotically optimal and practically efficient DP Bayesian inference with rapidly diminishing extra cost.
Author Information
Mikko Heikkilä (University of Helsinki)
Eemil Lagerspetz (University of Helsinki)
Dr. Eemil Lagerspetz is a postdoctoral researcher at University of Helsinki. His research interests include ubiquitous computing, large-scale data analysis, energy efficiency, and distributed systems.
Samuel Kaski (Aalto University)
Kana Shimizu (Waseda University)
Sasu Tarkoma (University of Helsinki)
Antti Honkela (University of Helsinki)
More from the Same Authors
-
2020 : Differentially private cross-silo federated learning »
Mikko Heikkilä -
2021 : Differentially Private Hamiltonian Monte Carlo »
Ossi Räisä · Antti Koskela · Antti Honkela -
2021 : Tight Accounting in the Shuffle Model of Differential Privacy »
Antti Koskela · Mikko Heikkilä · Antti Honkela -
2022 : Modular Flows: Differential Molecular Generation »
Yogesh Verma · Samuel Kaski · Markus Heinonen · Vikas Garg -
2022 : Individual Privacy Accounting with Gaussian Differential Privacy »
Antti Koskela · Marlon Tobaben · Antti Honkela -
2022 : Targeted Causal Elicitation »
Nazaal Ibrahim · ST John · Zhigao Guo · Samuel Kaski -
2022 : More trustworthy Bayesian optimization of materials properties by adding human into the loop »
Armi Tiihonen · Louis Filstroff · Petrus Mikkola · Emma Lehto · Samuel Kaski · Milica Todorović · Patrick Rinke -
2022 : Provably expressive temporal graph networks »
Amauri Souza · Diego Mesquita · Samuel Kaski · Vikas Garg -
2022 : Modular Flows: Differential Molecular Generation »
Yogesh Verma · Samuel Kaski · Markus Heinonen · Vikas Garg -
2022 : Differentiable User Models »
Alex Hämäläinen · Mustafa Mert Çelikok · Samuel Kaski -
2022 : Panel Discussion »
Cynthia Rudin · Dan Bohus · Brenna Argall · Alison Gopnik · Igor Mordatch · Samuel Kaski -
2022 : Collaborative AI for assisting virtual laboratories »
Samuel Kaski -
2022 : Noise-Aware Statistical Inference with Differentially Private Synthetic Data »
Ossi Räisä · Joonas Jälkö · Antti Honkela · Samuel Kaski -
2022 : HAPNEST: An efficient tool for generating large-scale genetics datasets from limited training data »
Sophie Wharrie · Zhiyu Yang · Vishnu Raj · Remo Monti · Rahul Gupta · Ying Wang · Alicia Martin · Luke O'Connor · Samuel Kaski · Pekka Marttinen · Pier Palamara · Christoph Lippert · Andrea Ganna -
2022 Poster: Modular Flows: Differential Molecular Generation »
Yogesh Verma · Samuel Kaski · Markus Heinonen · Vikas Garg -
2022 Poster: Deconfounded Representation Similarity for Comparison of Neural Networks »
Tianyu Cui · Yogesh Kumar · Pekka Marttinen · Samuel Kaski -
2022 Poster: Provably expressive temporal graph networks »
Amauri Souza · Diego Mesquita · Samuel Kaski · Vikas Garg -
2021 Workshop: Privacy in Machine Learning (PriML) 2021 »
Yu-Xiang Wang · Borja Balle · Giovanni Cherubin · Kamalika Chaudhuri · Antti Honkela · Jonathan Lebensold · Casey Meehan · Mi Jung Park · Adrian Weller · Yuqing Zhu -
2021 Poster: De-randomizing MCMC dynamics with the diffusion Stein operator »
Zheyang Shen · Markus Heinonen · Samuel Kaski -
2020 Workshop: Privacy Preserving Machine Learning - PriML and PPML Joint Edition »
Borja Balle · James Bell · Aurélien Bellet · Kamalika Chaudhuri · Adria Gascon · Antti Honkela · Antti Koskela · Casey Meehan · Olga Ohrimenko · Mi Jung Park · Mariana Raykova · Mary Anne Smart · Yu-Xiang Wang · Adrian Weller -
2020 Poster: Rethinking pooling in graph neural networks »
Diego Mesquita · Amauri Souza · Samuel Kaski -
2019 Workshop: Privacy in Machine Learning (PriML) »
Borja Balle · Kamalika Chaudhuri · Antti Honkela · Antti Koskela · Casey Meehan · Mi Jung Park · Mary Anne Smart · Mary Anne Smart · Adrian Weller -
2019 Poster: Differentially Private Markov Chain Monte Carlo »
Mikko Heikkilä · Joonas Jälkö · Onur Dikmen · Antti Honkela -
2019 Spotlight: Differentially Private Markov Chain Monte Carlo »
Mikko Heikkilä · Joonas Jälkö · Onur Dikmen · Antti Honkela -
2019 Poster: Machine Teaching of Active Sequential Learners »
Tomi Peltola · Mustafa Mert Çelikok · Pedram Daee · Samuel Kaski -
2018 Workshop: Machine Learning Open Source Software 2018: Sustainable communities »
Heiko Strathmann · Viktor Gal · Ryan Curtin · Antti Honkela · Sergey Lisitsyn · Cheng Soon Ong -
2017 : Invited talk: Differential privacy and Bayesian learning »
Antti Honkela -
2017 Poster: Non-Stationary Spectral Kernels »
Sami Remes · Markus Heinonen · Samuel Kaski -
2015 : Genome-wide modelling of transcription kinetics reveals patterns of RNA production delays »
Antti Honkela -
2014 Workshop: Machine Learning in Computational Biology »
Oliver Stegle · Sara Mostafavi · Anna Goldenberg · Su-In Lee · Michael Leung · Anshul Kundaje · Mark B Gerstein · Martin Renqiang Min · Hannes Bretschneider · Francesco Paolo Casale · Loïc Schwaller · Amit G Deshwar · Benjamin A Logsdon · Yuanyang Zhang · Ali Punjani · Derek C Aguiar · Samuel Kaski -
2013 Workshop: Machine Learning Open Source Software: Towards Open Workflows »
Antti Honkela · Cheng Soon Ong