Timezone: »
This workshop aims to bring together researchers and practitioners from machine learning, computer vision, natural language processing and related fields to discuss and document recent advances in transfer and multi-task learning. This includes the main topics of transfer and multi-task learning, together with several related variants as domain adaptation and dataset bias, and new discoveries and directions in deep learning based approaches.
Transfer and multi-task learning methods aim to better exploit the available data during training and adapt previously learned knowledge to new domains or tasks. This mitigates the burden of human labeling for emerging applications and enables learning from very few labeled examples.
In the past years there have been increasing activities in these areas, mainly driven by practical applications (e.g. object recognition, sentiment analysis) as well as state-of-the-art deep learning frameworks (e.g. CNN). Of the recently proposed solutions, most lack joint theoretical justifications, especially those deep learning based approaches. On the other hand, most of the existing theoretically justified approaches are rarely used in practice.
This NIPS 2015 workshop will focus on closing the gap between theory and practice by providing an opportunity for researchers and practitioners to get together, to share ideas and debate current theories and empirical results. The goal is to promote a fruitful exchange of ideas across different communities, leading to global advancement of the field.
Tentative topics:
New perspectives or theories on transfer and multi-task learning
Dataset bias and concept drift
Domain adaptation
Multi-task learning
Zero-shot or one-shot learning
Feature based approaches
Instance based approaches
Deep architectures for transfer and multi-task learning
Transferability of deep representations
Transfer across different architectures, e.g. CNN to RNN
Transfer across different modalities, e.g. image to text
Transfer across different tasks, e.g. recognition and detection
Transfer from weakly labeled or noisy data, e.g. Web data
Transfer in practical settings, e.g. online, active, and large-scale learning
Innovative applications, e.g. machine translation, computational biology
Datasets, benchmarks, and open-source packages
Fri 8:40 a.m. - 9:20 a.m.
|
Learning Representations for Unsupervised and Transfer Learning
(
Talk
)
|
Yoshua Bengio 🔗 |
Sat 5:50 a.m. - 6:30 a.m.
|
Intro and Adapting Deep Networks Across Domains, Modalities, and Tasks
(
Talk
)
|
Trevor Darrell 🔗 |
Sat 6:00 a.m. - 6:25 a.m.
|
Learning Shared Representations in MDPs
(
Talk
)
|
Diana Borsa 🔗 |
Sat 6:05 a.m. - 6:20 a.m.
|
On Weight Ratio Estimation for Covariate Shift
(
Talk
)
|
Ruth Urner 🔗 |
Sat 6:30 a.m. - 7:00 a.m.
|
The Benefit of Multitask Representation Learning
(
Talk
)
|
Massimiliano Pontil 🔗 |
Sat 7:30 a.m. - 8:00 a.m.
|
A Theory of Multiple Source Adaptation
(
Talk
)
|
Mehryar Mohri 🔗 |
Sat 11:30 a.m. - 12:00 p.m.
|
Shai Ben-David
(
Talk
)
|
🔗 |
Sat 11:30 a.m. - 12:00 p.m.
|
Domain Adaptation for Binary Classification
(
Talk
)
|
Shai Ben-David 🔗 |
Sat 12:00 p.m. - 12:30 p.m.
|
Multitask Generalized Eigenvalue Program
(
Talk
)
|
Boyu Wang 🔗 |
Sat 12:30 p.m. - 1:00 p.m.
|
Actor-Mimic
(
Talk
)
|
Emilio Parisotto 🔗 |
Sat 2:00 p.m. - 2:30 p.m.
|
Sharing the "How" (and not the "What")
(
Talk
)
|
Percy Liang 🔗 |
Sat 2:30 p.m. - 3:00 p.m.
|
Transitive Transfer Learning
(
Talk
)
|
Qiang Yang 🔗 |
Author Information
Anastasia Pentina (IST Austria)
Christoph Lampert (IST Austria)
Sinno Jialin Pan (Nanyang Technological University)
Mingsheng Long (Tsinghua University)
Judy Hoffman (UC Berkeley)
Baochen Sun (University of Massachusetts Lowell)
Kate Saenko (UMass Lowell)
More from the Same Authors
-
2021 : SSSE: Efficiently Erasing Samples from Trained Machine Learning Models »
Alexandra Peste · Dan Alistarh · Christoph Lampert -
2021 : Poster: On the Impossibility of Fairness-Aware Learning from Corrupted Data »
Nikola Konstantinov · Christoph Lampert -
2022 : Domain Adaptation: Theory, Algorithms, and Open Library »
Mingsheng Long -
2022 Poster: Fairness-Aware PAC Learning from Corrupted Data »
Nikola Konstantinov · Christoph Lampert -
2021 : On the Impossibility of Fairness-Aware Learning from Corrupted Data »
Nikola Konstantinov · Christoph Lampert -
2020 Poster: Unsupervised object-centric video generation and decomposition in 3D »
Paul Henderson · Christoph Lampert -
2020 Poster: Storage Efficient and Dynamic Flexible Runtime Channel Pruning via Deep Reinforcement Learning »
Jianda Chen · Shangyu Chen · Sinno Jialin Pan -
2019 Poster: MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization »
Shangyu Chen · Wenya Wang · Sinno Jialin Pan -
2018 : Invited Talk 2 »
Judy Hoffman -
2017 Workshop: Learning with Limited Labeled Data: Weak Supervision and Beyond »
Isabelle Augenstein · Stephen Bach · Eugene Belilovsky · Matthew Blaschko · Christoph Lampert · Edouard Oyallon · Emmanouil Antonios Platanios · Alexander Ratner · Christopher Ré -
2017 Poster: Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon »
Xin Dong · Shangyu Chen · Sinno Pan -
2016 Poster: Lifelong Learning with Weighted Majority Votes »
Anastasia Pentina · Ruth Urner -
2015 Poster: Lifelong Learning with Non-i.i.d. Tasks »
Anastasia Pentina · Christoph Lampert -
2014 Poster: LSDA: Large Scale Detection through Adaptation »
Judy Hoffman · Sergio Guadarrama · Eric Tzeng · Ronghang Hu · Jeff Donahue · Ross Girshick · Trevor Darrell · Kate Saenko -
2014 Poster: Mind the Nuisance: Gaussian Process Classification using Privileged Noise »
Daniel Hernández-lobato · Viktoriia Sharmanska · Kristian Kersting · Christoph Lampert · Novi Quadrianto -
2013 Workshop: New Directions in Transfer and Multi-Task: Learning Across Domains and Tasks »
Urun Dogan · Marius Kloft · Tatiana Tommasi · Francesco Orabona · Massimiliano Pontil · Sinno Jialin Pan · Shai Ben-David · Arthur Gretton · Fei Sha · Marco Signoretto · Rajhans Samdani · Yun-Qian Miao · Mohammad Gheshlaghi azar · Ruth Urner · Christoph Lampert · Jonathan How -
2012 Poster: Dynamic Pruning of Factor Graphs for Maximum Marginal Prediction »
Christoph Lampert -
2011 Poster: Maximum Margin Multi-Label Structured Prediction »
Christoph Lampert -
2009 Workshop: Transfer Learning for Structured Data »
Sinno Jialin Pan · Ivor W Tsang · Le Song · Karsten Borgwardt · Qiang Yang