Skip to yearly menu bar Skip to main content


Poster

Convergence of Gradient EM on Multi-component Mixture of Gaussians

Bowei Yan · Mingzhang Yin · Purnamrita Sarkar

Pacific Ballroom #219

Keywords: [ Frequentist Statistics ] [ Unsupervised Learning ] [ Clustering ]


Abstract:

In this paper, we study convergence properties of the gradient variant of Expectation-Maximization algorithm~\cite{lange1995gradient} for Gaussian Mixture Models for arbitrary number of clusters and mixing coefficients. We derive the convergence rate depending on the mixing coefficients, minimum and maximum pairwise distances between the true centers, dimensionality and number of components; and obtain a near-optimal local contraction radius. While there have been some recent notable works that derive local convergence rates for EM in the two symmetric mixture of Gaussians, in the more general case, the derivations need structurally different and non-trivial arguments. We use recent tools from learning theory and empirical processes to achieve our theoretical results.

Live content is unavailable. Log in and register to view live content