Timezone: »

 
Poster
Active Labeling: Streaming Stochastic Gradients
Vivien Cabannes · Francis Bach · Vianney Perchet · Alessandro Rudi

Tue Nov 29 09:00 AM -- 11:00 AM (PST) @ Hall J #536
in Poster Session 1 »

The workhorse of machine learning is stochastic gradient descent.To access stochastic gradients, it is common to consider iteratively input/output pairs of a training dataset.Interestingly, it appears that one does not need full supervision to access stochastic gradients, which is the main motivation of this paper.After formalizing the "active labeling" problem, which focuses on active learning with partial supervision, we provide a streaming technique that provably minimizes the ratio of generalization error over the number of samples.We illustrate our technique in depth for robust regression.

Keywords: Active Learning · SGD · Weak Supervision · partial labeling
[ Paper]  [ Poster]  [ OpenReview] 

Author Information

Vivien Cabannes (Meta AI)
Francis Bach (INRIA - Ecole Normale Superieure)

Francis Bach is a researcher at INRIA, leading since 2011 the SIERRA project-team, which is part of the Computer Science Department at Ecole Normale Supérieure in Paris, France. After completing his Ph.D. in Computer Science at U.C. Berkeley, he spent two years at Ecole des Mines, and joined INRIA and Ecole Normale Supérieure in 2007. He is interested in statistical machine learning, and especially in convex optimization, combinatorial optimization, sparse methods, kernel-based learning, vision and signal processing. He gave numerous courses on optimization in the last few years in summer schools. He has been program co-chair for the International Conference on Machine Learning in 2015.

Vianney Perchet (ENSAE & Criteo AI Lab)
Alessandro Rudi (INRIA, Ecole Normale Superieure)

More from the Same Authors