Timezone: »
Self-supervised learning (SSL) is an unsupervised approach for representation learning without relying on human-provided labels. It creates auxiliary tasks on unlabeled input data and learns representations by solving these tasks. SSL has demonstrated great success on images (e.g., MoCo [19], PIRL [9], SimCLR [20]) and texts (e.g., BERT [21]) and has shown promising results in other data modalities, including graphs, time-series, audio, etc. On a wide variety of tasks, SSL without using human-provided labels achieves performance that is close to fully supervised approaches. The existing SSL research mostly focuses on improving the empirical performance without a theoretical foundation. While the proposed SSL approaches are empirically effective, theoretically why they perform well is not clear. For example, why certain auxiliary tasks in SSL perform better than others? How many unlabeled data examples are needed by SSL to learn a good representation? How is the performance of SSL affected by neural architectures? In this workshop, we aim to bridge this gap between theory and practice. We bring together SSL-interested researchers from various domains to discuss the theoretical foundations of empirically well-performing SSL approaches and how the theoretical insights can further improve SSL’s empirical performance. Different from previous SSL-related workshops which focus on empirical effectiveness of SSL approaches without considering their theoretical foundations, our workshop focuses on establishing the theoretical foundation of SSL and providing theoretical insights for developing new SSL approaches.
Tue 7:00 a.m. - 7:10 a.m.
|
Opening remarks
(
Opening
)
SlidesLive Video » |
🔗 |
Tue 7:10 a.m. - 7:40 a.m.
|
Invited talk 1
(
Talk
)
SlidesLive Video » |
Stefanie Jegelka 🔗 |
Tue 7:40 a.m. - 8:10 a.m.
|
Invited talk 2
(
Talk
)
SlidesLive Video » |
Sanjeev Arora 🔗 |
Tue 8:10 a.m. - 8:40 a.m.
|
Invited talk 3
(
Talk
)
SlidesLive Video » |
Jie Tang 🔗 |
Tue 8:40 a.m. - 9:40 a.m.
|
Poster session I
(
Poster Session
)
|
🔗 |
Tue 9:40 a.m. - 9:50 a.m.
|
Contributed talk 1
(
Talk
)
SlidesLive Video » |
Guojun Zhang 🔗 |
Tue 9:50 a.m. - 10:00 a.m.
|
Contributed talk 2
(
Talk
)
SlidesLive Video » |
Ching-Yun Ko 🔗 |
Tue 10:00 a.m. - 10:30 a.m.
|
Invited talk 4
(
Talk
)
SlidesLive Video » |
Tengyu Ma 🔗 |
Tue 10:30 a.m. - 11:00 a.m.
|
Invited talk 5
(
Talk
)
SlidesLive Video » |
Ian Fischer 🔗 |
Tue 11:00 a.m. - 12:00 p.m.
|
Lunch break
|
🔗 |
Tue 12:00 p.m. - 12:30 p.m.
|
Invited talk 6
(
Talk
)
SlidesLive Video » |
Louis-Philippe Morency 🔗 |
Tue 12:30 p.m. - 1:00 p.m.
|
Invited talk 7
(
Talk
)
SlidesLive Video » |
Jason Lee 🔗 |
Tue 1:00 p.m. - 1:30 p.m.
|
Invited talk 8
(
Talk
)
SlidesLive Video » |
Mihaela van der Schaar 🔗 |
Tue 1:30 p.m. - 2:30 p.m.
|
Poster session II
(
Poster Session
)
|
🔗 |
Tue 2:30 p.m. - 2:40 p.m.
|
Contributed talk 3
(
Talk
)
SlidesLive Video » |
Mehdi Azabou 🔗 |
Tue 2:40 p.m. - 2:50 p.m.
|
Contributed talk 4
(
Talk
)
|
Fangyu Liu 🔗 |
Tue 2:50 p.m. - 3:00 p.m.
|
Contributed talk 5
(
Talk
)
SlidesLive Video » |
Menglin YANG 🔗 |
Tue 3:00 p.m. - 3:30 p.m.
|
Invited talk 9
(
Talk
)
SlidesLive Video » |
Samuel Bowman 🔗 |
Tue 3:30 p.m. - 3:35 p.m.
|
Closing remarks
SlidesLive Video » |
🔗 |
Author Information
Pengtao Xie (UC San Diego)
Ishan Misra (Facebook AI Research)
Pulkit Agrawal (MIT)
Abdelrahman Mohamed (Facebook AI Research (FAIR))
Shentong Mo (CMU)
Youwei Liang (UC San Diego)
Jeannette Bohg (Stanford University)
Kristina N Toutanova (Google)
More from the Same Authors
-
2021 : Simulated Annealing for Neural Architecture Search »
Shentong Mo · Jingfei Xia · Pinxu Ren -
2021 : Adaptive Fine-tuning for Vision and Language Pre-trained Models »
Shentong Mo · Jingfei Xia · Ihor Markevych -
2021 : Multi-modal Self-supervised Pre-training for Large-scale Genome Data »
Shentong Mo · Xi Fu · Chenyang Hong · Yizhen Chen · Yuxuan Zheng · Xiangru Tang · Yanyan Lan · Zhiqiang Shen · Eric Xing -
2021 : 3D Neural Scene Representations for Visuomotor Control »
Yunzhu Li · Shuang Li · Vincent Sitzmann · Pulkit Agrawal · Antonio Torralba -
2021 : 3D Neural Scene Representations for Visuomotor Control »
Yunzhu Li · Shuang Li · Vincent Sitzmann · Pulkit Agrawal · Antonio Torralba -
2022 : Is Conditional Generative Modeling all you need for Decision-Making? »
Anurag Ajay · Yilun Du · Abhi Gupta · Josh Tenenbaum · Tommi Jaakkola · Pulkit Agrawal -
2022 : Learning to Extrapolate: A Transductive Approach »
Aviv Netanyahu · Abhishek Gupta · Max Simchowitz · Kaiqing Zhang · Pulkit Agrawal -
2022 : Betty: An Automatic Differentiation Library for Multilevel Optimization »
Sang Keun Choe · Willie Neiswanger · Pengtao Xie · Eric Xing -
2022 : Fast Adaptation via Human Diagnosis of Task Distribution Shift »
Andi Peng · Mark Ho · Aviv Netanyahu · Julie A Shah · Pulkit Agrawal -
2022 : Aligning Robot Representations with Humans »
Andreea Bobu · Andi Peng · Pulkit Agrawal · Julie A Shah · Anca Dragan -
2022 Workshop: Self-Supervised Learning: Theory and Practice »
Ishan Misra · Pengtao Xie · Gul Varol · Yale Song · Yuki Asano · Xiaolong Wang · Pauline Luc -
2022 : Visual Pre-training for Navigation: What Can We Learn from Noise? »
Felix Yanwei Wang · Ching-Yun Ko · Pulkit Agrawal -
2022 Poster: Redeeming intrinsic rewards via constrained optimization »
Eric Chen · Zhang-Wei Hong · Joni Pajarinen · Pulkit Agrawal -
2022 Poster: A Data-Augmentation Is Worth A Thousand Samples: Analytical Moments And Sampling-Free Training »
Randall Balestriero · Ishan Misra · Yann LeCun -
2022 Poster: Distributionally Adaptive Meta Reinforcement Learning »
Anurag Ajay · Abhishek Gupta · Dibya Ghosh · Sergey Levine · Pulkit Agrawal -
2022 Poster: Saliency-Aware Neural Architecture Search »
Ramtin Hosseini · Pengtao Xie -
2022 Poster: Multi-modal Grouping Network for Weakly-Supervised Audio-Visual Video Parsing »
Shentong Mo · Yapeng Tian -
2022 Poster: A Closer Look at Weakly-Supervised Audio-Visual Source Localization »
Shentong Mo · Pedro Morgado -
2021 : 3D Neural Scene Representations for Visuomotor Control »
Yunzhu Li · Shuang Li · Vincent Sitzmann · Pulkit Agrawal · Antonio Torralba -
2021 Workshop: Physical Reasoning and Inductive Biases for the Real World »
Krishna Murthy Jatavallabhula · Rika Antonova · Kevin Smith · Hsiao-Yu Tung · Florian Shkurti · Jeannette Bohg · Josh Tenenbaum -
2021 : Poster Session 2 (gather.town) »
Wenjie Li · Akhilesh Soni · Jinwuk Seok · Jianhao Ma · Jeffery Kline · Mathieu Tuli · Miaolan Xie · Robert Gower · Quanqi Hu · Matteo Cacciola · Yuanlu Bai · Boyue Li · Wenhao Zhan · Shentong Mo · Junhyung Lyle Kim · Sajad Fathi Hafshejani · Chris Junchi Li · Zhishuai Guo · Harshvardhan Harshvardhan · Neha Wadia · Tatjana Chavdarova · Difan Zou · Zixiang Chen · Aman Gupta · Jacques Chen · Betty Shea · Benoit Dherin · Aleksandr Beznosikov -
2021 Poster: Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers »
Mandela Patrick · Dylan Campbell · Yuki Asano · Ishan Misra · Florian Metze · Christoph Feichtenhofer · Andrea Vedaldi · João Henriques -
2021 Oral: Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers »
Mandela Patrick · Dylan Campbell · Yuki Asano · Ishan Misra · Florian Metze · Christoph Feichtenhofer · Andrea Vedaldi · João Henriques -
2021 Poster: Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning »
Chongjian GE · Youwei Liang · YIBING SONG · Jianbo Jiao · Jue Wang · Ping Luo -
2020 : Jeanette Bohg - One the Role of Hierarchies for Learning Manipulation Skills »
Jeannette Bohg -
2020 Workshop: Self-Supervised Learning -- Theory and Practice »
Pengtao Xie · Shanghang Zhang · Pulkit Agrawal · Ishan Misra · Cynthia Rudin · Abdelrahman Mohamed · Wenzhen Yuan · Barret Zoph · Laurens van der Maaten · Xingyi Yang · Eric Xing -
2020 : Closing remark »
Abdelrahman Mohamed -
2020 : Discussion Panel »
Pete Florence · Dorsa Sadigh · Carolina Parada · Jeannette Bohg · Roberto Calandra · Peter Stone · Fabio Ramos -
2020 Workshop: Self-Supervised Learning for Speech and Audio Processing »
Abdelrahman Mohamed · Hung-yi Lee · Shinji Watanabe · Shang-Wen Li · Tara Sainath · Karen Livescu -
2020 Poster: wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations »
Alexei Baevski · Yuhao Zhou · Abdelrahman Mohamed · Michael Auli -
2020 Session: Orals & Spotlights Track 09: Reinforcement Learning »
Pulkit Agrawal · Mohammad Ghavamzadeh -
2019 Poster: Superposition of many models into one »
Brian Cheung · Alexander Terekhov · Yubei Chen · Pulkit Agrawal · Bruno Olshausen -
2018 : Talk 7: Jeannette Bohg - On perceptual representations and how they interact with actions and physical models »
Jeannette Bohg -
2016 : What makes ImageNet good for Transfer Learning? »
Jacob MY Huh · Pulkit Agrawal · Alexei Efros -
2016 : Jitendra Malik and Pulkit Agrawal »
Jitendra Malik · Pulkit Agrawal -
2016 Poster: Learning to Poke by Poking: Experiential Learning of Intuitive Physics »
Pulkit Agrawal · Ashvin Nair · Pieter Abbeel · Jitendra Malik · Sergey Levine -
2016 Oral: Learning to Poke by Poking: Experiential Learning of Intuitive Physics »
Pulkit Agrawal · Ashvin Nair · Pieter Abbeel · Jitendra Malik · Sergey Levine