Timezone: »

 
Poster
Fast Large-scale Mixture Modeling with Component-specific Data Partitions
Bo Thiesson · Chong Wang

Mon Dec 06 12:00 AM -- 12:00 AM (PST) @ None #None

Remarkably easy implementation and guaranteed convergence has made the EM algorithm one of the most used algorithms for mixture modeling. On the downside, the E-step is linear in both the sample size and the number of mixture components, making it impractical for large-scale data. Based on the variational EM framework, we propose a fast alternative that uses component-specific data partitions to obtain a sub-linear E-step in sample size, while the algorithm still maintains provable convergence. Our approach builds on previous work, but is significantly faster and scales much better in the number of mixture components. We demonstrate this speedup by experiments on large-scale synthetic and real data.

Author Information

Bo Thiesson (Microsoft Research)
Chong Wang (ByteDance Inc.)

More from the Same Authors