Timezone: »
This paper presents a new mechanism for producing sanitized statistical summaries that achieve {\it differential privacy}, called the {\it K-Norm Gradient} Mechanism, or KNG. This new approach maintains the strong flexibility of the exponential mechanism, while achieving the powerful utility performance of objective perturbation. KNG starts with an inherent objective function (often an empirical risk), and promotes summaries that are close to minimizing the objective by weighting according to how far the gradient of the objective function is from zero. Working with the gradient instead of the original objective function allows for additional flexibility as one can penalize using different norms. We show that, unlike the exponential mechanism, the noise added by KNG is asymptotically negligible compared to the statistical error for many problems. In addition to theoretical guarantees on privacy and utility, we confirm the utility of KNG empirically in the settings of linear and quantile regression through simulations.
Author Information
Matthew Reimherr (Pennsylvania State University)
Jordan Awan (Penn State University)
More from the Same Authors
-
2021 : Canonical Noise Distributions and Private Hypothesis Tests »
Jordan Awan · Salil Vadhan -
2021 : Privacy-Aware Rejection Sampling »
Jordan Awan · Vinayak Rao -
2022 Poster: Shape And Structure Preserving Differential Privacy »
Carlos Soto · Karthik Bharath · Matthew Reimherr · Aleksandra Slavković -
2021 : Canonical Noise Distributions and Private Hypothesis Tests »
Jordan Awan · Salil Vadhan -
2021 : Privacy-Aware Rejection Sampling »
Jordan Awan · Vinayak Rao -
2021 Poster: Differential Privacy Over Riemannian Manifolds »
Matthew Reimherr · Karthik Bharath · Carlos Soto -
2021 Poster: Exact Privacy Guarantees for Markov Chain Implementations of the Exponential Mechanism with Artificial Atoms »
Jeremy Seeman · Matthew Reimherr · Aleksandra Slavković -
2021 Poster: A Highly-Efficient Group Elastic Net Algorithm with an Application to Function-On-Scalar Regression »
Tobia Boschi · Matthew Reimherr · Francesca Chiaromonte -
2019 Poster: Elliptical Perturbations for Differential Privacy »
Matthew Reimherr · Jordan Awan -
2018 Poster: Differentially Private Uniformly Most Powerful Tests for Binomial Data »
Jordan Awan · Aleksandra Slavković