Timezone: »

 
Spotlight
Estimating divergence functionals and the likelihood ratio by penalized convex risk minimization
XuanLong Nguyen · Martin J Wainwright · Michael Jordan

Mon Dec 03 08:10 PM -- 08:25 PM (PST) @
in Spotlights »
We develop and analyze an algorithm for nonparametric estimation of divergence functionals and the density ratio of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which turns the estimation problem into a penalized convex risk minimization problem. We present a derivation of our kernel-based estimation algorithm and an analysis of convergence rates for the estimator. Our simulation results demonstrate the convergence behavior of our method, which compares favorably with existing methods in the literature.

Author Information

XuanLong Nguyen (University of Michigan)
Martin J Wainwright (UC Berkeley)
Michael Jordan (UC Berkeley)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors