Timezone: »
Simple Gaussian Mixture Models (GMMs) learned from pixels of natural image patches have been recently shown to be surprisingly strong performers in modeling the statistics of natural images. Here we provide an in depth analysis of this simple yet rich model. We show that such a GMM model is able to compete with even the most successful models of natural images in log likelihood scores, denoising performance and sample quality. We provide an analysis of what such a model learns from natural images as a function of number of mixture components --- including covariance structure, contrast variation and intricate structures such as textures, boundaries and more. Finally, we show that the salient properties of the GMM learned from natural images can be derived from a simplified Dead Leaves model which explicitly models occlusion, explaining its surprising success relative to other models.
Author Information
Daniel Zoran (Hebrew University of Jerusalem)
Yair Weiss (Hebrew University)
Yair Weiss is an Associate Professor at the Hebrew University School of Computer Science and Engineering. He received his Ph.D. from MIT working with Ted Adelson on motion analysis and did postdoctoral work at UC Berkeley. Since 2005 he has been a fellow of the Canadian Institute for Advanced Research. With his students and colleagues he has co-authored award winning papers in NIPS (2002),ECCV (2006), UAI (2008) and CVPR (2009).
More from the Same Authors
-
2021 Poster: When Is Unsupervised Disentanglement Possible? »
Daniella Horan · Eitan Richardson · Yair Weiss -
2018 Poster: On GANs and GMMs »
Eitan Richardson · Yair Weiss -
2018 Spotlight: On GANs and GMMs »
Eitan Richardson · Yair Weiss -
2015 Poster: The Return of the Gating Network: Combining Generative Models and Discriminative Training in Natural Image Priors »
Dan Rosenbaum · Yair Weiss -
2015 Spotlight: The Return of the Gating Network: Combining Generative Models and Discriminative Training in Natural Image Priors »
Dan Rosenbaum · Yair Weiss -
2013 Poster: Learning the Local Statistics of Optical Flow »
Dan Rosenbaum · Daniel Zoran · Yair Weiss -
2012 Poster: Learning about Canonical Views from Internet Image Collections »
Elad Mezuman · Yair Weiss -
2009 Invited Talk: Learning and Inference in Low-Level Vision »
Yair Weiss -
2009 Poster: Semi-Supervised Learning in Gigantic Image Collections »
Rob Fergus · Yair Weiss · Antonio Torralba -
2009 Oral: Semi-Supervised Learning in Gigantic Image Collections »
Rob Fergus · Yair Weiss · Antonio Torralba -
2009 Poster: The "tree-dependent components" of natural scenes are edge filters »
Daniel Zoran · Yair Weiss -
2008 Poster: Spectral Hashing »
Yair Weiss · Antonio Torralba · Rob Fergus