Timezone: »

 
Poster
Adversarial Fisher Vectors for Unsupervised Representation Learning
Shuangfei Zhai · Walter Talbott · Carlos Guestrin · Joshua Susskind

Tue Dec 10 05:30 PM -- 07:30 PM (PST) @ East Exhibition Hall B + C #72
in Deep Learning -- Generative Models »

We examine Generative Adversarial Networks (GANs) through the lens of deep Energy Based Models (EBMs), with the goal of exploiting the density model that follows from this formulation. In contrast to a traditional view where the discriminator learns a constant function when reaching convergence, here we show that it can provide useful information for downstream tasks, e.g., feature extraction for classification. To be concrete, in the EBM formulation, the discriminator learns an unnormalized density function (i.e., the negative energy term) that characterizes the data manifold. We propose to evaluate both the generator and the discriminator by deriving corresponding Fisher Score and Fisher Information from the EBM. We show that by assuming that the generated examples form an estimate of the learned density, both the Fisher Information and the normalized Fisher Vectors are easy to compute. We also show that we are able to derive a distance metric between examples and between sets of examples. We conduct experiments showing that the GAN-induced Fisher Vectors demonstrate competitive performance as unsupervised feature extractors for classification and perceptual similarity tasks. Code is available at \url{https://github.com/apple/ml-afv}.

Keywords: Adversarial Networks · Deep Learning · Algorithms -> Adversarial Learning; Algorithms -> Density Estimation; Algorithms -> Representation Learning; Algorithms · Unsu
[ Paper]  [ Poster] 

Author Information

Shuangfei Zhai (Apple)
Walter Talbott (Apple)
Carlos Guestrin (Apple & University of Washington)

Carlos Guestrin is the Director of Machine Learning at Apple and the Amazon Professor of Machine Learning in Computer Science and Engineering at the University of Washington. Carlos was the cofounder and CEO of Turi (formerly Dato and GraphLab), a startup that developed large-scale machine learning tools. A world-recognized leader in the field of machine learning, Carlos was named one of the 2008 Brilliant 10 by Popular Science. He received the 2009 IJCAI Computers and Thought Award for his contributions to artificial intelligence, and a Presidential Early Career Award for Scientists and Engineers (PECASE).

Joshua Susskind (Apple Inc.)

I was an undergraduate in Cognitive Science at UCSD from 1995-2003 (with some breaks). Then I earned a PhD from UofT in machine learning and cognitive neuroscience, with Dr. Geoff Hinton and Dr. Adam Anderson. Following grad school I moved to UCSD for a post-doctoral position. Before coming to Apple I co-founded Emotient in 2012 and led the deep learning effort for facial expression and demographics recognition. Since joining Apple, I led the Face ID neural network team responsible for face recognition, and then started a machine learning research group within the hardware organization focused on fundamental ML technology.

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors