Timezone: »
Poster
Gradient Weights help Nonparametric Regressors
Samory Kpotufe · Abdeslam Boularias
Thu Dec 06 02:00 PM -- 12:00 AM (PST) @ Harrah’s Special Events Center 2nd Floor
In regression problems over $\real^d$, the unknown function $f$ often varies more in some coordinates than in others. We show that weighting each coordinate $i$ with the estimated norm of the $i$th derivative of $f$ is an efficient way to significantly improve the performance of distance-based regressors, e.g. kernel and $k$-NN regressors. We propose a simple estimator of these derivative norms and prove its consistency. Moreover, the proposed estimator is efficiently learned online.
Author Information
Samory Kpotufe (Princeton University)
Abdeslam Boularias (Max Planck Institute for Intelligent Systems)
Related Events (a corresponding poster, oral, or spotlight)
-
2012 Oral: Gradient Weights help Nonparametric Regressors »
Thu. Dec 6th 07:40 -- 08:00 PM Room Harveys Convention Center Floor, CC
More from the Same Authors
-
2018 Poster: PAC-Bayes Tree: weighted subtrees with guarantees »
Tin Nguyen · Samory Kpotufe -
2017 : Modal-sets, and density-based Clustering »
Samory Kpotufe -
2016 Workshop: Adaptive and Scalable Nonparametric Methods in Machine Learning »
Aaditya Ramdas · Arthur Gretton · Bharath Sriperumbudur · Han Liu · John Lafferty · Samory Kpotufe · Zoltán Szabó -
2014 Workshop: Modern Nonparametrics 3: Automating the Learning Pipeline »
Eric Xing · Mladen Kolar · Arthur Gretton · Samory Kpotufe · Han Liu · Zoltán Szabó · Alan Yuille · Andrew G Wilson · Ryan Tibshirani · Sasha Rakhlin · Damian Kozbur · Bharath Sriperumbudur · David Lopez-Paz · Kirthevasan Kandasamy · Francesco Orabona · Andreas Damianou · Wacha Bounliphone · Yanshuai Cao · Arijit Das · Yingzhen Yang · Giulia DeSalvo · Dmitry Storcheus · Roberto Valerio -
2014 Poster: Optimal rates for k-NN density and mode estimation »
Sanjoy Dasgupta · Samory Kpotufe -
2013 Workshop: Modern Nonparametric Methods in Machine Learning »
Arthur Gretton · Mladen Kolar · Samory Kpotufe · John Lafferty · Han Liu · Bernhard Schölkopf · Alexander Smola · Rob Nowak · Mikhail Belkin · Lorenzo Rosasco · peter bickel · Yue Zhao -
2013 Poster: Regression-tree Tuning in a Streaming Setting »
Samory Kpotufe · Francesco Orabona -
2013 Poster: Adaptivity to Local Smoothness and Dimension in Kernel Regression »
Samory Kpotufe · Vikas K Garg -
2013 Spotlight: Regression-tree Tuning in a Streaming Setting »
Samory Kpotufe · Francesco Orabona -
2012 Poster: Algorithms for Learning Markov Field Policies »
Abdeslam Boularias · Oliver Kroemer · Jan Peters -
2011 Poster: k-NN Regression Adapts to Local Intrinsic Dimension »
Samory Kpotufe -
2011 Oral: k-NN Regression Adapts to Local Intrinsic Dimension »
Samory Kpotufe -
2010 Poster: Bootstrapping Apprenticeship Learning »
Abdeslam Boularias · Brahim Chaib-draa -
2009 Poster: Fast, smooth and adaptive regression in metric spaces »
Samory Kpotufe