Timezone: »
Poster
Sketching Structured Matrices for Faster Nonlinear Regression
Haim Avron · Vikas Sindhwani · David Woodruff
Sat Dec 07 07:00 PM -- 11:59 PM (PST) @ Harrah's Special Events Center, 2nd Floor
Motivated by the desire to extend fast randomized techniques to nonlinear $l_p$ regression, we consider a class of structured regression problems. These problems involve Vandermonde matrices which arise naturally in various statistical modeling settings, including classical polynomial fitting problems and recently developed randomized techniques for scalable kernel methods. We show that this structure can be exploited to further accelerate the solution of the regression problem, achieving running times that are faster than "input sparsity''. We present empirical results confirming both the practical value of our modeling framework, as well as speedup benefits of randomized regression.
Author Information
Haim Avron (Tel Aviv University)
Vikas Sindhwani (Google)
David Woodruff (IBM Research)
More from the Same Authors
-
2023 Poster: Near Optimal Reconstruction of Spherical Harmonic Expansions »
Amir Zandieh · Insu Han · Haim Avron -
2023 Poster: Mnemosyne: Learning to Train Transformers with Transformers »
Deepali Jain · Krzysztof M Choromanski · Kumar Avinava Dubey · Sumeet Singh · Vikas Sindhwani · Tingnan Zhang · Jie Tan -
2016 Poster: Sublinear Time Orthogonal Tensor Decomposition »
Zhao Song · David Woodruff · Huan Zhang -
2016 Poster: Communication-Optimal Distributed Clustering »
Jiecao Chen · He Sun · David Woodruff · Qin Zhang -
2015 : Sketching as a tool for numerical linear algebra »
David Woodruff -
2015 Poster: Structured Transforms for Small-Footprint Deep Learning »
Vikas Sindhwani · Tara Sainath · Sanjiv Kumar -
2015 Spotlight: Structured Transforms for Small-Footprint Deep Learning »
Vikas Sindhwani · Tara Sainath · Sanjiv Kumar -
2014 Workshop: Riemannian geometry in machine learning, statistics and computer vision »
Minh Ha Quang · Vikas Sindhwani · Vittorio Murino · Michael Betancourt · Tom Fletcher · Richard I Hartley · Anuj Srivastava · Bart Vandereycken -
2014 Poster: Improved Distributed Principal Component Analysis »
Yingyu Liang · Maria-Florina F Balcan · Vandana Kanchanapally · David Woodruff -
2014 Poster: Low Rank Approximation Lower Bounds in Row-Update Streams »
David Woodruff -
2014 Poster: Subspace Embeddings for the Polynomial Kernel »
Haim Avron · Huy Nguyen · David Woodruff -
2013 Workshop: Large Scale Matrix Analysis and Inference »
Reza Zadeh · Gunnar Carlsson · Michael Mahoney · Manfred K. Warmuth · Wouter M Koolen · Nati Srebro · Satyen Kale · Malik Magdon-Ismail · Ashish Goel · Matei A Zaharia · David Woodruff · Ioannis Koutis · Benjamin Recht -
2011 Poster: Non-parametric Group Orthogonal Matching Pursuit for Sparse Learning with Multiple Kernels »
Vikas Sindhwani · Aurelie Lozano -
2010 Poster: Block Variable Selection in Multivariate Regression and High-dimensional Causal Inference »
Aurelie Lozano · Vikas Sindhwani -
2008 Poster: Regularized Co-Clustering with Dual Supervision »
Vikas Sindhwani · Jianying Hu · Aleksandra Mojsilovic -
2006 Poster: Relational Learning with Gaussian Processes »
Wei Chu · Vikas Sindhwani · Zoubin Ghahramani · Sathiya Selvaraj Keerthi -
2006 Poster: An Efficient Method for Gradient-Based Adaptation of Hyperparameters in SVM Models »
Sathiya Selvaraj Keerthi · Vikas Sindhwani · Olivier Chapelle -
2006 Poster: Branch and Bound for Semi-Supervised Support Vector Machines »
Olivier Chapelle · Vikas Sindhwani · Sathiya Selvaraj Keerthi