Timezone: »

 
Workshop
Extreme Classification: Multi-class and Multi-label Learning in Extremely Large Label Spaces
Moustapha Cisse · Manik Varma · Samy Bengio

Thu Dec 08 11:00 PM -- 09:30 AM (PST) @ Room 111
in Friday Workshops »
Event URL: http://www.manikvarma.org/events/XC16/schedule.html »

Extreme classification, where one needs to deal with multi-class and multi-label problems involving a very large number of labels, has opened up a new research frontier in machine learning. Many challenging applications, such as photo or video annotation, web page categorization, gene function prediction, language modeling can benefit from being formulated as supervised learning tasks with millions, or even billions, of labels. Extreme classification can also give a fresh perspective on core learning problems such as ranking and recommendation by reformulating them as multi-class/label tasks where each item to be ranked or recommended is a separate label.

Extreme classification raises a number of interesting research questions including those related to:

* Large scale learning and distributed and parallel training
* Log-time and log-space prediction and prediction on a test-time budget
* Label embedding and tree-based approaches
* Crowd sourcing, preference elicitation and other data gathering techniques
* Bandits, semi-supervised learning and other approaches for dealing with training set biases and label noise
* Bandits with an extremely large number of arms
* Fine-grained classification
* Zero shot learning and extensible output spaces
* Tackling label polysemy, synonymy and correlations
* Structured output prediction and multi-task learning
* Learning from highly imbalanced data
* Dealing with tail labels and learning from very few data points per label
* PU learning and learning from missing and incorrect labels
* Feature extraction, feature sharing, lazy feature evaluation, etc.
* Performance evaluation
* Statistical analysis and generalization bounds
* Applications to ranking, recommendation, knowledge graph construction and other domains

The workshop aims to bring together researchers interested in these areas to encourage discussion and improve upon the state-of-the-art in extreme classification. In particular, we aim to bring together researchers from the natural language processing, computer vision and core machine learning communities to foster interaction and collaboration. Several leading researchers will present invited talks detailing the latest advances in the area. We also seek extended abstracts presenting work in progress which will be reviewed for acceptance as spotlight+poster or a talk. The workshop should be of interest to researchers in core supervised learning as well as application domains such as recommender systems, computer vision, computational advertising, information retrieval and natural language processing. We expect a healthy participation from both industry and academia.

http://www.manikvarma.org/events/XC16/schedule.html

Fri 12:00 a.m. - 12:05 a.m.
Opening Remarks by Manik, Moustapha & Samy (Talk)
Fri 12:05 a.m. - 12:35 a.m.
Label Ranking with Biased Partial Feedback (Keynote)
Fri 12:35 a.m. - 12:50 a.m.
Distributed Optimization of Multi-Class SVMs (Spotlight)
Fri 12:50 a.m. - 1:05 a.m.
DiSMEC - Distributed Sparse Machines for Extreme Multi-label Classification (Spotlight)
Fri 1:05 a.m. - 1:35 a.m.
A Primal and Dual Sparse Approach to Extreme Classification (Keynote)
Fri 2:00 a.m. - 2:30 a.m.
Extreme Multi-label Loss Functions for Tagging, Ranking & Recommendation (Keynote)
Fri 2:30 a.m. - 2:45 a.m.
Log-time and Log-space Extreme Classification (Spotlight)
Fri 2:45 a.m. - 3:00 a.m.
Extreme Classification with Label Features (Spotlight)
Fri 3:00 a.m. - 3:15 a.m.
Dual Decomposed Learning with Factorwise Oracles for Structural SVMs of Large Output Domain (Spotlight)
Fri 3:15 a.m. - 4:30 a.m.
Lunch (Break)
Fri 4:30 a.m. - 5:00 a.m.
Semi-supervised dimension reduction for large numbers of classes (Keynote)
Fri 5:00 a.m. - 5:15 a.m.
A Theoretical Framework for Structured Prediction using Factor Graph Complexity (Spotlight)
Fri 5:15 a.m. - 5:45 a.m.
Deep Schatten Networks (Keynote)
Fri 5:45 a.m. - 6:00 a.m.
Regret Bounds for Non-decomposable Metrics with Missing Labels (Spotlight)
Fri 6:30 a.m. - 6:30 a.m.
Coffee Break (Break)
Fri 6:30 a.m. - 7:00 a.m.
Training neural networks in time independent of output layer size (Keynote)
Fri 7:00 a.m. - 7:15 a.m.
Efficient softmax approximation for GPUs (Spotlight)
Fri 7:15 a.m. - 7:30 a.m.
Pointer Sentinel Mixture Models (Spotlight)
Fri 7:30 a.m. - 7:45 a.m.
A Simple but Tough-to-Beat Baseline for Sentence Embeddings (Spotlight)
Fri 7:45 a.m. - 8:00 a.m.
Break
Fri 8:00 a.m. - 8:30 a.m.
iCaRL: incremental classifier and representation learning (Keynote)
Fri 8:30 a.m. - 8:45 a.m.
Is a picture worth a thousand words? a Deep Multi Modal Product Classification Architecture for e-commerce (Spotlight)
Fri 8:45 a.m. - 9:15 a.m.
Learning to Solve Vision without Annotating Millions of Images (Keynote)
[ Video] 

Author Information

Moustapha Cisse (Facebook AI Research)
Manik Varma (Microsoft Research India)
Samy Bengio (Google Brain)

More from the Same Authors