Timezone: »
Discrete Learning Of DAGs Via Backpropagation
Andrew Wren · Pasquale Minervini · Luca Franceschi · Valentina Zantedeschi
Event URL: https://openreview.net/forum?id=sSI7k-UAW7E »
Recently continuous relaxations have been proposed in order to learn directed acyclic graphs (DAGs) by backpropagation, instead of combinatorial optimization. However, a number of techniques for fully discrete backpropagation could instead be applied. In this paper, we explore this direction and propose DAG-DB, a framework for learning DAGs by Discrete Backpropagation, based on the architecture of Implicit Maximum Likelihood Estimation (I-MLE). DAG-DB performs competitively using either of two fully discrete backpropagation techniques, I-MLE itself, or straight-through estimation.
Author Information
Andrew Wren
Pasquale Minervini (University College London)
Luca Franceschi (Amazon Development Center Germany)
Valentina Zantedeschi (ServiceNow)
More from the Same Authors
-
2022 : Discrete Learning Of DAGs Via Backpropagation »
Andrew Wren · Pasquale Minervini · Luca Franceschi · Valentina Zantedeschi -
2022 : Discrete Learning Of DAGs Via Backpropagation »
Andrew Wren · Pasquale Minervini · Luca Franceschi · Valentina Zantedeschi -
2022 Poster: ReFactor GNNs: Revisiting Factorisation-based Models from a Message-Passing Perspective »
Yihong Chen · Pushkar Mishra · Luca Franceschi · Pasquale Minervini · Pontus Lars Erik Saito Stenetorp · Sebastian Riedel -
2022 Poster: On Margins and Generalisation for Voting Classifiers »
Felix Biggs · Valentina Zantedeschi · Benjamin Guedj -
2021 Poster: Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions »
Mathias Niepert · Pasquale Minervini · Luca Franceschi -
2021 Poster: Learning Stochastic Majority Votes by Minimizing a PAC-Bayes Generalization Bound »
Valentina Zantedeschi · Paul Viallard · Emilie Morvant · RĂ©mi Emonet · Amaury Habrard · Pascal Germain · Benjamin Guedj -
2020 : Towards Data-Driven Physics-Informed Global Precipitation Forecasting from Satellite Imagery »
Valentina Zantedeschi · Valentina Zantedeschi