Timezone: »
Recent research has established sufficient conditions for finite mixture models to be identifiable from grouped observations. These conditions allow the mixture components to be nonparametric and have substantial (or even total) overlap. This work proposes an algorithm that consistently estimates any identifiable mixture model from grouped observations. Our analysis leverages an oracle inequality for weighted kernel density estimators of the distribution on groups, together with a general result showing that consistent estimation of the distribution on groups implies consistent estimation of mixture components. A practical implementation is provided for paired observations, and the approach is shown to outperform existing methods, especially when mixture components overlap significantly.
Author Information
Alexander Ritchie (University of Michigan)
Robert Vandermeulen (Technische Universität Berlin)
Clayton Scott (University of Michigan)
More from the Same Authors
-
2022 : Human alignment of neural network representations »
Lukas Muttenthaler · Lorenz Linhardt · Jonas Dippel · Robert Vandermeulen · Simon Kornblith -
2022 Poster: VICE: Variational Interpretable Concept Embeddings »
Lukas Muttenthaler · Charles Zheng · Patrick McClure · Robert Vandermeulen · Martin N Hebart · Francisco Pereira -
2022 Poster: Consistent Interpolating Ensembles via the Manifold-Hilbert Kernel »
Yutong Wang · Clay Scott -
2022 Poster: Learning from Label Proportions by Learning with Label Noise »
Jianxin Zhang · Yutong Wang · Clay Scott -
2021 Poster: Beyond Smoothness: Incorporating Low-Rank Analysis into Nonparametric Density Estimation »
Robert Vandermeulen · Antoine Ledent -
2020 Poster: Learning from Label Proportions: A Mutual Contamination Framework »
Clayton Scott · Jianxin Zhang -
2020 Poster: Weston-Watkins Hinge Loss and Ordered Partitions »
Yutong Wang · Clayton Scott -
2017 Poster: Multi-Task Learning for Contextual Bandits »
Aniket Anand Deshmukh · Urun Dogan · Clay Scott -
2014 Poster: Robust Kernel Density Estimation by Scaling and Projection in Hilbert Space »
Robert A Vandermeulen · Clayton Scott -
2011 Poster: Generalizing from Several Related Classification Tasks to a New Unlabeled Sample »
Gilles Blanchard · Gyemin Lee · Clayton Scott -
2010 Poster: Extensions of Generalized Binary Search to Group Identification and Exponential Costs »
Gowtham Bellala · Suresh Bhavnani · Clayton Scott -
2008 Poster: Performance analysis for L_2 kernel classification »
JooSeuk Kim · Clayton Scott -
2008 Spotlight: Performance analysis for L_2 kernel classification »
JooSeuk Kim · Clayton Scott