Timezone: »
Mixture distributions are often used to model complex data. In this paper, we develop a new method that jointly estimates mixture models over multiple data sets by exploiting the statistical dependencies between them. Specifically, we introduce a set of latent Dirichlet processes as sources of component models (atoms), and for each data set, we construct a nonparametric mixture model by combining sub-sampled versions of the latent DPs. Each mixture model may acquire atoms from different latent DPs, while each atom may be shared by multiple mixtures. This multi-to-multi association distinguishes the proposed method from prior constructions that rely on tree or chain structures, allowing mixture models to be coupled more flexibly. In addition, we derive a sampling algorithm that jointly infers the model parameters and present experiments on both document analysis and image modeling.
Author Information
Dahua Lin (Massachusetts Institute of Technology)
John Fisher III (MIT)
More from the Same Authors
-
2022 : Posterior Consistency for Gaussian Process Surrogate Models with Generalized Observations »
Rujian Chen · John Fisher III -
2020 Poster: Sequential Bayesian Experimental Design with Variable Cost Structure »
Sue Zheng · David Hayden · Jason Pacheco · John Fisher III -
2020 Poster: Belief-Dependent Macro-Action Discovery in POMDPs using the Value of Information »
Genevieve Flaspohler · Nick Roy · John Fisher III -
2015 Poster: Streaming, Distributed Variational Inference for Bayesian Nonparametrics »
Trevor Campbell · Julian Straub · John Fisher III · Jonathan How -
2015 Poster: Probabilistic Variational Bounds for Graphical Models »
Qiang Liu · John Fisher III · Alexander Ihler -
2014 Poster: Coresets for k-Segmentation of Streaming Data »
Guy Rosman · Mikhail Volkov · Dan Feldman · John Fisher III · Daniela Rus -
2014 Poster: Parallel Sampling of HDPs using Sub-Cluster Splits »
Jason Chang · John Fisher III -
2013 Poster: Parallel Sampling of DP Mixture Models using Sub-Cluster Splits »
Jason Chang · John Fisher III -
2012 Workshop: Bayesian Nonparametric Models For Reliable Planning And Decision-Making Under Uncertainty »
Jonathan How · Lawrence Carin · John Fisher III · Michael Jordan · Alborz Geramifard -
2010 Oral: Construction of Dependent Dirichlet Processes based on Poisson Processes »
Dahua Lin · Eric Grimson · John Fisher III -
2010 Poster: Construction of Dependent Dirichlet Processes based on Poisson Processes »
Dahua Lin · Eric Grimson · John Fisher III