Timezone: »
We address the problem of Bayesian structure learning for domains with hundreds of variables by employing non-parametric bootstrap, recursively. We propose a method that covers both model averaging and model selection in the same framework. The proposed method deals with the main weakness of constraint-based learning---sensitivity to errors in the independence tests---by a novel way of combining bootstrap with constraint-based learning. Essentially, we provide an algorithm for learning a tree, in which each node represents a scored CPDAG for a subset of variables and the level of the node corresponds to the maximal order of conditional independencies that are encoded in the graph. As higher order independencies are tested in deeper recursive calls, they benefit from more bootstrap samples, and therefore are more resistant to the curse-of-dimensionality. Moreover, the re-use of stable low order independencies allows greater computational efficiency. We also provide an algorithm for sampling CPDAGs efficiently from their posterior given the learned tree. That is, not from the full posterior, but from a reduced space of CPDAGs encoded in the learned tree. We empirically demonstrate that the proposed algorithm scales well to hundreds of variables, and learns better MAP models and more reliable causal relationships between variables, than other state-of-the-art-methods.
Author Information
Raanan Y. Rohekar (Intel Corporation)
Yaniv Gurwicz (Intel AI Lab)
Shami Nisimov (intel)
Guy Koren (Intel)
Gal Novik (Intel AI)
More from the Same Authors
-
2021 : Validate on Sim, Detect on Real - Model Selection for Domain Randomization »
Guy Jacob · Gal Leibovich · Shadi Endrawis · Gal Novik · Aviv Tamar -
2021 : Validate on Sim, Detect on Real - Model Selection for Domain Randomization »
Guy Jacob · Gal Leibovich · Shadi Endrawis · Gal Novik · Aviv Tamar -
2021 Poster: Iterative Causal Discovery in the Possible Presence of Latent Confounders and Selection Bias »
Raanan Rohekar · Shami Nisimov · Yaniv Gurwicz · Gal Novik -
2019 Poster: Modeling Uncertainty by Learning a Hierarchy of Deep Neural Connections »
Raanan Rohekar · Yaniv Gurwicz · Shami Nisimov · Gal Novik -
2018 Poster: Constructing Deep Neural Networks by Bayesian Network Structure Learning »
Raanan Rohekar · Shami Nisimov · Yaniv Gurwicz · Guy Koren · Gal Novik