Timezone: »
Poster
PAC-Bayes Tree: weighted subtrees with guarantees
Tin Nguyen · Samory Kpotufe
We present a weighted-majority classification approach over subtrees of a fixed tree, which provably achieves excess-risk of the same order as the best tree-pruning. Furthermore, the computational efficiency of pruning is maintained at both training and testing time despite having to aggregate over an exponential number of subtrees. We believe this is the first subtree aggregation approach with such guarantees.
Author Information
Tin Nguyen (MIT)
Samory Kpotufe (Princeton University)
More from the Same Authors
-
2021 : Measuring the sensitivity of Gaussian processes to kernel choice »
Will Stephenson · Soumya Ghosh · Tin Nguyen · Mikhail Yurochkin · Sameer Deshpande · Tamara Broderick -
2022 : Are you using test log-likelihood correctly? »
Sameer Deshpande · Soumya Ghosh · Tin Nguyen · Tamara Broderick -
2020 : Tin D. Nguyen---Independent versus truncated finite approximations for Bayesian nonparametric inference »
Tin Nguyen -
2020 Poster: Approximate Cross-Validation for Structured Models »
Soumya Ghosh · Will Stephenson · Tin Nguyen · Sameer Deshpande · Tamara Broderick -
2017 : Modal-sets, and density-based Clustering »
Samory Kpotufe -
2016 Workshop: Adaptive and Scalable Nonparametric Methods in Machine Learning »
Aaditya Ramdas · Arthur Gretton · Bharath Sriperumbudur · Han Liu · John Lafferty · Samory Kpotufe · Zoltán Szabó -
2014 Workshop: Modern Nonparametrics 3: Automating the Learning Pipeline »
Eric Xing · Mladen Kolar · Arthur Gretton · Samory Kpotufe · Han Liu · Zoltán Szabó · Alan Yuille · Andrew G Wilson · Ryan Tibshirani · Sasha Rakhlin · Damian Kozbur · Bharath Sriperumbudur · David Lopez-Paz · Kirthevasan Kandasamy · Francesco Orabona · Andreas Damianou · Wacha Bounliphone · Yanshuai Cao · Arijit Das · Yingzhen Yang · Giulia DeSalvo · Dmitry Storcheus · Roberto Valerio -
2014 Poster: Optimal rates for k-NN density and mode estimation »
Sanjoy Dasgupta · Samory Kpotufe -
2013 Workshop: Modern Nonparametric Methods in Machine Learning »
Arthur Gretton · Mladen Kolar · Samory Kpotufe · John Lafferty · Han Liu · Bernhard Schölkopf · Alexander Smola · Rob Nowak · Mikhail Belkin · Lorenzo Rosasco · peter bickel · Yue Zhao -
2013 Poster: Regression-tree Tuning in a Streaming Setting »
Samory Kpotufe · Francesco Orabona -
2013 Poster: Adaptivity to Local Smoothness and Dimension in Kernel Regression »
Samory Kpotufe · Vikas K Garg -
2013 Spotlight: Regression-tree Tuning in a Streaming Setting »
Samory Kpotufe · Francesco Orabona -
2012 Poster: Gradient Weights help Nonparametric Regressors »
Samory Kpotufe · Abdeslam Boularias -
2012 Oral: Gradient Weights help Nonparametric Regressors »
Samory Kpotufe · Abdeslam Boularias -
2011 Poster: k-NN Regression Adapts to Local Intrinsic Dimension »
Samory Kpotufe -
2011 Oral: k-NN Regression Adapts to Local Intrinsic Dimension »
Samory Kpotufe -
2009 Poster: Fast, smooth and adaptive regression in metric spaces »
Samory Kpotufe