Timezone: »

Unsupervised Bayesian Parameter Estimation for Probabilistic Grammars
Shay Cohen · Kevin Gimpel · Noah A Smith

Mon Dec 08 08:45 PM -- 12:00 AM (PST) @

In this paper we explore Bayesian approaches for the unsupervised estimation of probabilistic grammars, a family of distributions over discrete structures that includes hidden Markov models and probabilistic context-free grammars. We consider the use of Dirichlet priors, and we extend the correlated topic model framework to probabilistic grammars and derive a variational EM algorithm for efficient approximate inference. We experiment with the task of unsupervised grammar induction for natural language dependency parsing, and show that superior results can be achieved when using a logistic normal prior over probabilistic grammars.

Author Information

Shay Cohen (Columbia University)
Kevin Gimpel (Carnegie Mellon University)
Noah A Smith (Carnegie Mellon University)

More from the Same Authors