Skip to yearly menu bar Skip to main content


Poster

Fast Large-scale Mixture Modeling with Component-specific Data Partitions

Bo Thiesson · Chong Wang


Abstract:

Remarkably easy implementation and guaranteed convergence has made the EM algorithm one of the most used algorithms for mixture modeling. On the downside, the E-step is linear in both the sample size and the number of mixture components, making it impractical for large-scale data. Based on the variational EM framework, we propose a fast alternative that uses component-specific data partitions to obtain a sub-linear E-step in sample size, while the algorithm still maintains provable convergence. Our approach builds on previous work, but is significantly faster and scales much better in the number of mixture components. We demonstrate this speedup by experiments on large-scale synthetic and real data.

Live content is unavailable. Log in and register to view live content