Timezone: »
Towards Healing the Blindness of Score Matching
Mingtian Zhang · Oscar Key · Peter Hayes · David Barber · Brooks Paige · Francois-Xavier Briol
Event URL: https://openreview.net/forum?id=Ij8G_k0iuL »
Score-based divergences have been widely used in machine learning and statistics applications. Despite their empirical success, a blindness problem has been observed when using these for multi-modal distributions. In this work, we discuss the blindness problem and propose a new family of divergences that can mitigate the blindness problem. We illustrate our proposed divergence in the context of density estimation and report improved performance compared to traditional approaches.
Author Information
Mingtian Zhang (UCL)
Oscar Key (University College London)
Peter Hayes (University College London)
David Barber (University College London)
Brooks Paige (UCL)
Francois-Xavier Briol (University of Cambridge)
More from the Same Authors
-
2021 : MSA-Conditioned Generative Protein Language Models for Fitness Landscape Modelling and Design »
Alex Hawkins-Hooker · David Jones · Brooks Paige -
2021 : Composite Goodness-of-fit Tests with Kernels »
Oscar Key · Tamara Fernandez · Arthur Gretton · Francois-Xavier Briol -
2021 : On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertainty »
Joost van Amersfoort · Lewis Smith · Andrew Jesson · Oscar Key · Yarin Gal -
2021 : Generalization Gap in Amortized Inference »
Mingtian Zhang · Peter Hayes · David Barber -
2022 : Using domain-domain interactions to probe the limitations of MSA pairing strategies »
Alex Hawkins-Hooker · David Jones · Brooks Paige -
2022 : OOD Detection with Class Ratio Estimation »
Mingtian Zhang · Andi Zhang · Tim Xiao · Yitong Sun · Steven McDonagh -
2022 Workshop: NeurIPS 2022 Workshop on Score-Based Methods »
Yingzhen Li · Yang Song · Valentin De Bortoli · Francois-Xavier Briol · Wenbo Gong · Alexia Jolicoeur-Martineau · Arash Vahdat -
2022 Poster: Generalization Gap in Amortized Inference »
Mingtian Zhang · Peter Hayes · David Barber -
2021 Poster: On the Out-of-distribution Generalization of Probabilistic Image Modelling »
Mingtian Zhang · Andi Zhang · Steven McDonagh -
2021 Poster: AFEC: Active Forgetting of Negative Transfer in Continual Learning »
Liyuan Wang · Mingtian Zhang · Zhongfan Jia · Qian Li · Chenglong Bao · Kaisheng Ma · Jun Zhu · Yi Zhong -
2020 Workshop: Machine Learning for Molecules »
José Miguel Hernández-Lobato · Matt Kusner · Brooks Paige · Marwin Segler · Jennifer Wei -
2020 Poster: Bayesian Probabilistic Numerical Integration with Tree-Based Models »
Harrison Zhu · Xing Liu · Ruya Kang · Zhichao Shen · Seth Flaxman · Francois-Xavier Briol -
2019 Poster: Minimum Stein Discrepancy Estimators »
Alessandro Barp · Francois-Xavier Briol · Andrew Duncan · Mark Girolami · Lester Mackey