Timezone: »
Poster
Scaling Factorial Hidden Markov Models: Stochastic Variational Inference without Messages
Yin Cheng Ng · Pawel M Chilinski · Ricardo Silva
Factorial Hidden Markov Models (FHMMs) are powerful models for sequential data but they do not scale well with long sequences. We propose a scalable inference and learning algorithm for FHMMs that draws on ideas from the stochastic variational inference, neural network and copula literatures. Unlike existing approaches, the proposed algorithm requires no message passing procedure among latent variables and can be distributed to a network of computers to speed up learning. Our experiments corroborate that the proposed algorithm does not introduce further approximation bias compared to the proven structured mean-field algorithm, and achieves better performance with long sequences and large FHMMs.
Author Information
Yin Cheng Ng (University College London)
Pawel M Chilinski (University College London)
Ricardo Silva (University College London)
More from the Same Authors
-
2022 : Pragmatic Fairness: Optimizing Policies with Outcome Disparity Control »
Limor Gultchin · Siyuan Guo · Alan Malek · Silvia Chiappa · Ricardo Silva -
2022 : Evaluating the Impact of Geometric and Statistical Skews on Out-Of-Distribution Generalization Performance »
Aengus Lynch · Jean Kaddour · Ricardo Silva -
2022 : Evaluating the Impact of Geometric and Statistical Skews on Out-Of-Distribution Generalization Performance »
Aengus Lynch · Jean Kaddour · Ricardo Silva -
2022 : Partial identification without distributional assumptions »
Kirtan Padh · Jakob Zeitler · David Watson · Matt Kusner · Ricardo Silva · Niki Kilbertus -
2022 Poster: When Do Flat Minima Optimizers Work? »
Jean Kaddour · Linqing Liu · Ricardo Silva · Matt Kusner -
2021 : Ricardo Silva - The Road to Causal Programming »
Ricardo Silva -
2021 Poster: Causal Effect Inference for Structured Treatments »
Jean Kaddour · Yuchen Zhu · Qi Liu · Matt Kusner · Ricardo Silva -
2020 : Invited Talk: On Prediction, Action and Interference »
Ricardo Silva -
2020 Poster: A Class of Algorithms for General Instrumental Variable Models »
Niki Kilbertus · Matt Kusner · Ricardo Silva -
2018 Poster: Bayesian Semi-supervised Learning with Graph Gaussian Processes »
Yin Cheng Ng · Nicolò Colombo · Ricardo Silva -
2017 Workshop: From 'What If?' To 'What Next?' : Causal Inference and Machine Learning for Intelligent Decision Making »
Ricardo Silva · Panagiotis Toulis · John Shawe-Taylor · Alexander Volfovsky · Thorsten Joachims · Lihong Li · Nathan Kallus · Adith Swaminathan -
2017 Poster: Counterfactual Fairness »
Matt Kusner · Joshua Loftus · Chris Russell · Ricardo Silva -
2017 Oral: Counterfactual Fairness »
Matt Kusner · Joshua Loftus · Chris Russell · Ricardo Silva -
2017 Poster: Tomography of the London Underground: a Scalable Model for Origin-Destination Data »
Nicolò Colombo · Ricardo Silva · Soong Moon Kang -
2017 Poster: When Worlds Collide: Integrating Different Counterfactual Assumptions in Fairness »
Chris Russell · Matt Kusner · Joshua Loftus · Ricardo Silva -
2016 Workshop: "What If?" Inference and Learning of Hypothetical and Counterfactual Interventions in Complex Systems »
Ricardo Silva · John Shawe-Taylor · Adith Swaminathan · Thorsten Joachims -
2016 Poster: Observational-Interventional Priors for Dose-Response Learning »
Ricardo Silva -
2014 Poster: Causal Inference through a Witness Protection Program »
Ricardo Silva · Robin Evans -
2013 Poster: Flexible sampling of discrete data correlations without the marginal distributions »
Alfredo Kalaitzis · Ricardo Silva -
2011 Poster: Thinning Measurement Models and Questionnaire Design »
Ricardo Silva -
2007 Poster: Hidden Common Cause Relations in Relational Learning »
Ricardo Silva · Wei Chu · Zoubin Ghahramani -
2007 Spotlight: Hidden Common Cause Relations in Relational Learning »
Ricardo Silva · Wei Chu · Zoubin Ghahramani