Timezone: »
Learning the structure of Bayesian networks and causal relationships from observations is a common goal in several areas
of science and technology.
We show that the prequential minimum description length principle (MDL) can be used to derive a practical scoring function
for Bayesian networks when flexible and overparametrized neural networks are used to model the conditional probability
distributions between observed variables.
MDL represents an embodiment of Occam's Razor and we obtain plausible and parsimonious graph structures
without relying on sparsity inducing priors or other regularizers which must be tuned.
Empirically we demonstrate competitive results on synthetic and real-world data.
The score often recovers the correct structure even in the presence of strongly nonlinear
relationships between variables; a scenario were prior approaches struggle and usually fail.
Furthermore we discuss how the the prequential score relates to
recent work that infers causal structure from the speed of adaptation
when the observations come from a source undergoing distributional
shift.
Author Information
Jorg Bornschein (Deepmind)
Silvia Chiappa (DeepMind)
Alan Malek (DeepMind)
Nan Rosemary Ke (DeepMind)
More from the Same Authors
-
2021 : Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning »
Nan Rosemary Ke · Aniket Didolkar · Sarthak Mittal · Anirudh Goyal · Guillaume Lajoie · Stefan Bauer · Danilo Jimenez Rezende · Yoshua Bengio · Chris Pal · Michael Mozer -
2022 : Pragmatic Fairness: Optimizing Policies with Outcome Disparity Control »
Limor Gultchin · Siyuan Guo · Alan Malek · Silvia Chiappa · Ricardo Silva -
2021 : Invited Talk: Path-specific effects and ML fairness »
Silvia Chiappa -
2021 Poster: Neural Production Systems »
Anirudh Goyal · Aniket Didolkar · Nan Rosemary Ke · Charles Blundell · Philippe Beaudoin · Nicolas Heess · Michael Mozer · Yoshua Bengio -
2019 Workshop: Workshop on Human-Centric Machine Learning »
Plamen P Angelov · Nuria Oliver · Adrian Weller · Manuel Rodriguez · Isabel Valera · Silvia Chiappa · Hoda Heidari · Niki Kilbertus