Timezone: »

 
Poster
Cooperative neural networks (CoNN): Exploiting prior independence structure for improved classification
Harsh Shrivastava · Eugene Bart · Bob Price · Hanjun Dai · Bo Dai · Srinivas Aluru

Thu Dec 06 07:45 AM -- 09:45 AM (PST) @ Room 517 AB #134
in Thu Poster Session A »

We propose a new approach, called cooperative neural networks (CoNN), which use a set of cooperatively trained neural networks to capture latent representations that exploit prior given independence structure. The model is more flexible than traditional graphical models based on exponential family distributions, but incorporates more domain specific prior structure than traditional deep networks or variational autoencoders. The framework is very general and can be used to exploit the independence structure of any graphical model. We illustrate the technique by showing that we can transfer the independence structure of the popular Latent Dirichlet Allocation (LDA) model to a cooperative neural network, CoNN-sLDA. Empirical evaluation of CoNN-sLDA on supervised text classification tasks demonstrate that the theoretical advantages of prior independence structure can be realized in practice - we demonstrate a 23 percent reduction in error on the challenging MultiSent data set compared to state-of-the-art.

Keywords: Supervised Deep Networks · Classification · Text Analysis

Author Information

Harsh Shrivastava (Georgia Institute of Technology)
Eugene Bart (Palo Alto Research Center)
Bob Price (PARC)
Hanjun Dai (Georgia Tech)
Bo Dai (Google Brain)
Srinivas Aluru (Georgia Institute of Technology)

More from the Same Authors