Timezone: »

 
Hierarchical Few-Shot Generative Models
Giorgio Giannone · Ole Winther

@
in 5th Workshop on Meta-Learning »
Event URL: https://openreview.net/forum?id=INSai0E0VXN »

A few-shot generative model should be able to generate data from a distribution by only observing a limited set of examples. In few-shot learning the model is trained on data from many sets from different distributions sharing some underlying properties such as sets of characters from different alphabets or sets of images of different type objects. We study a latent variables approach that extends the Neural Statistician to a fully hierarchical approach with an attention-based point to set-level aggregation. We extend the previous work to iterative data sampling, likelihood-based model comparison, and adaptation-free out of distribution generalization. Our results show that the hierarchical formulation better captures the intrinsic variability within the sets in the small data regime.With this work we generalize deep latent variable approaches to few-shot learning, taking a step towards large-scale few-shot generation with a formulation that readily can work with current state-of-the-art deep generative models.

Author Information

Giorgio Giannone (Technical University of Denmark - DTU)

Science is built up with data, as a house is with stones. But a collection of data is no more a science than a heap of stones is a house. (J.H. Poincaré)

Ole Winther (Technical University of Denmark)

More from the Same Authors