Timezone: »
Poster
On Scalable Testing of Samplers
Yash Pote · Kuldeep S Meel
In this paper we study the problem of testing of constrained samplers over high-dimensional distributions with $(\varepsilon,\eta,\delta)$ guarantees. Samplers are increasingly used in a wide range of safety-critical ML applications, and hence the testing problem has gained importance. For $n$-dimensional distributions, the existing state-of-the-art algorithm, $\mathsf{Barbarik2}$, has a worst case query complexity of exponential in $n$ and hence is not ideal for use in practice. Our primary contribution is an exponentially faster algorithm, $\mathsf{Barbarik3}$, that has a query complexity linear in $n$ and hence can easily scale to larger instances. We demonstrate our claim by implementing our algorithm and then comparing it against $\mathsf{Barbarik2}$. Our experiments on the samplers $\mathsf{wUnigen3}$ and $\mathsf{wSTS}$, find that $\mathsf{Barbarik3}$ requires $10\times$ fewer samples for $\mathsf{wUnigen3}$ and $450\times$ fewer samples for $\mathsf{wSTS}$ as compared to $\mathsf{Barbarik2}$.
Author Information
Yash Pote (National University of Singapore)
Kuldeep S Meel (National University of Singapore)
More from the Same Authors
-
2021 Poster: Testing Probabilistic Circuits »
Yash Pote · Kuldeep S Meel -
2020 Poster: On Testing of Samplers »
Kuldeep S Meel · Yash Pote · Sourav Chakraborty -
2020 Poster: Taming Discrete Integration via the Boon of Dimensionality »
Jeffrey Dudek · Dror Fried · Kuldeep S Meel -
2020 Poster: Efficient Distance Approximation for Structured High-Dimensional Distributions via Learning »
Arnab Bhattacharyya · Sutanu Gayen · Kuldeep S Meel · N. V. Vinodchandran -
2019 Poster: Embedding Symbolic Knowledge into Deep Networks »
Yaqi Xie · Ziwei Xu · Kuldeep S Meel · Mohan Kankanhalli · Harold Soh