Timezone: »
Poster
Empirical Localization of Homogeneous Divergences on Discrete Sample Spaces
Takashi Takenouchi · Takafumi Kanamori
In this paper, we propose a novel parameter estimator for probabilistic models on discrete space. The proposed estimator is derived from minimization of homogeneous divergence and can be constructed without calculation of the normalization constant, which is frequently infeasible for models in the discrete space. We investigate statistical properties of the proposed estimator such as consistency and asymptotic normality, and reveal a relationship with the alpha-divergence. Small experiments show that the proposed estimator attains comparable performance to the MLE with drastically lower computational cost.
Author Information
Takashi Takenouchi (Future University Hakodate)
Takafumi Kanamori (Nagoya University)
More from the Same Authors
-
2015 Spotlight: Empirical Localization of Homogeneous Divergences on Discrete Sample Spaces »
Takashi Takenouchi · Takafumi Kanamori -
2012 Poster: Density-Difference Estimation »
Masashi Sugiyama · Takafumi Kanamori · Taiji Suzuki · Marthinus C du Plessis · Song Liu · Ichiro Takeuchi -
2011 Poster: Relative Density-Ratio Estimation for Robust Distribution Comparison »
Makoto Yamada · Taiji Suzuki · Takafumi Kanamori · Hirotaka Hachiya · Masashi Sugiyama -
2008 Poster: Efficient Direct Density Ratio Estimation for Non-stationarity Adaptation and Outlier Detection »
Takafumi Kanamori · Shohei Hido · Masashi Sugiyama
