Timezone: »
Gates are a new notation for representing mixture models and context-sensitive independence in factor graphs. Factor graphs provide a natural representation for message-passing algorithms, such as expectation propagation. However, message passing in mixture models is not well captured by factor graphs unless the entire mixture is represented by one factor, because the message equations have a containment structure. Gates capture this containment structure graphically, allowing both the independences and the message-passing equations for a model to be readily visualized. Different variational approximations for mixture models can be understood as different ways of drawing the gates in a model. We present general equations for expectation propagation and variational message passing in the presence of gates.
Author Information
Tom Minka (MSR)
John Winn (Microsoft Research)
Related Events (a corresponding poster, oral, or spotlight)
-
2008 Spotlight: Gates »
Tue. Dec 9th 04:29 -- 04:30 AM Room
More from the Same Authors
-
2014 Poster: Just-In-Time Learning for Fast and Flexible Inference »
S. M. Ali Eslami · Danny Tarlow · Pushmeet Kohli · John Winn -
2014 Poster: A* Sampling »
Chris Maddison · Danny Tarlow · Tom Minka -
2014 Oral: A* Sampling »
Chris Maddison · Danny Tarlow · Tom Minka -
2013 Poster: Decision Jungles: Compact and Rich Models for Classification »
Jamie Shotton · Toby Sharp · Pushmeet Kohli · Sebastian Nowozin · John Winn · Antonio Criminisi -
2013 Poster: Learning to Pass Expectation Propagation Messages »
Nicolas Heess · Danny Tarlow · John Winn -
2011 Poster: Non-conjugate Variational Message Passing for Multinomial and Binary Regression »
David A Knowles · Tom Minka -
2008 Workshop: Probabilistic Programming: Universal Languages, Systems and Applications »
Daniel Roy · John Winn · David A McAllester · Vikash Mansinghka · Josh Tenenbaum -
2008 Demonstration: Infer.NET: Software for Graphical Models »
Tom Minka · John Winn · John P Guiver · Anitha Kannan -
2007 Poster: TrueSkill Through Time: Revisiting the History of Chess »
Pierre Dangauthier · Ralf Herbrich · Tom Minka · Thore K Graepel -
2007 Spotlight: TrueSkill Through Time: Revisiting the History of Chess »
Pierre Dangauthier · Ralf Herbrich · Tom Minka · Thore K Graepel -
2006 Poster: Clustering appearance and shape by learning jigsaws »
Anitha Kannan · John Winn · Carsten Rother -
2006 Talk: Clustering appearance and shape by learning jigsaws »
Anitha Kannan · John Winn · Carsten Rother -
2006 Poster: TrueSkill: A Bayesian Skill Rating System »
Ralf Herbrich · Tom Minka · Thore K Graepel -
2006 Talk: TrueSkill: A Bayesian Skill Rating System »
Ralf Herbrich · Tom Minka · Thore K Graepel