Workshop
4th Workshop on Self-Supervised Learning: Theory and Practice
Tengda Han · Ishan Misra · Pengtao Xie · Mathilde Caron · Hilde Kuehne · Xingjian Bai · Vadim Tschernezki
Room 217 - 219
Sat 16 Dec, 7 a.m. PST
The 4th Workshop on "Self-Supervised Learning: Theory and Practice" aims to discuss the theory and practice of self-supervised learning across multiple research areas like vision, NLP \& robotics.
Chat is not available.
Timezone: America/Los_Angeles
Schedule
|
Sat 7:00 a.m. - 7:15 a.m.
|
Welcome and introduction
(
Opening
)
>
SlidesLive Video |
🔗 |
|
Sat 7:15 a.m. - 7:45 a.m.
|
Yuki M Asano
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
|
Sat 7:45 a.m. - 8:15 a.m.
|
Diane Larlus
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
|
Sat 8:15 a.m. - 8:45 a.m.
|
Alyosha Efros
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
|
Sat 9:00 a.m. - 9:30 a.m.
|
Abhinav Gupta
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
|
Sat 9:30 a.m. - 10:00 a.m.
|
Chelsea Finn
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
|
Sat 10:00 a.m. - 11:00 a.m.
|
Poster Session I
(
Poster
)
>
|
🔗 |
|
Sat 12:15 p.m. - 12:45 p.m.
|
Xinyun Chen
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
|
Sat 2:10 p.m. - 3:00 p.m.
|
Poster Session II
(
Poster
)
>
|
🔗 |
|
-
|
Improving Domain Generalization in Contrastive Learning Using Adaptive Temperature Control ( Poster ) > link | Katie Matton · Robert Lewis · Rosalind Picard · John Guttag 🔗 |
|
-
|
Visualizing the loss landscape of Self-supervised Vision Transformer ( Poster ) > link | Youngwan Lee · Jeffrey Willette · Jonghee Kim · Sung Ju Hwang 🔗 |
|
-
|
Adversarial perturbation based latent reconstruction for domain-agnostic self-supervised learning ( Poster ) > link | Kuilin Chen · Sijie Tian · Chi-Guhn Lee 🔗 |
|
-
|
Evolving Graph Generalization Estimation via Self-Supervised Learning ( Poster ) > link | Bin Lu · Tingyan Ma · Xiaoying Gan · Luoyi Fu · Xinbing Wang · Chenghu Zhou · Shiyu Liang 🔗 |
|
-
|
Uncertainty Quantification using Deep Ensembles for Safety-Critical Predictive Models ( Poster ) > link | Oishi Deb · Emmanouil Benetos · Philip Torr 🔗 |
|
-
|
WERank: Rank Degradation Prevention for Self-Supervised Learning via Weight Regularization ( Poster ) > link | Ali Saheb Pasand · Reza Moravej · Mahdi Biparva · Ali Ghodsi 🔗 |
|
-
|
Language-Conditioned Semantic Search-Based Policy for Robotic Manipulation Tasks ( Poster ) > link | Jannik Sheikh · Andrew Melnik · Gora Chand Nandi · Robert Haschke 🔗 |
|
-
|
MeSa: Masked, Geometric, and Supervised Pre-training for Monocular Depth Estimation ( Poster ) > link | Muhammad Osama Khan · Junbang Liang · Chun-Kai Wang · Shan Yang · Yu Lou 🔗 |
|
-
|
DAPO: Self-Supervised Domain Adaptation for 6DoF Pose Estimation ( Poster ) > link | Juseong Jin · Eunju Jeong · Joonmyun Cho · JUN HEE PARK · Young-Gon Kim 🔗 |
|
-
|
Leveraging Uniformity of Normalized Embeddings for Sequential Recommendation ( Poster ) > link | Hyunsoo Chung · Jungtaek Kim 🔗 |
|
-
|
Self-Supervised Learning Meets Liver Ultrasound Imaging ( Poster ) > link | Abder-Rahman Ali, PhD · Anthony E Samir 🔗 |
|
-
|
Posterior Sampling on Simsiam: Rethinking Optimization in Siamese Self-Supervised Learning ( Poster ) > link | Daniel De Mello · Ruqi Zhang · Bruno Ribeiro 🔗 |
|
-
|
No Free Lunch in Self Supervised Representation Learning ( Poster ) > link | Ihab Bendidi · Adrien Bardes · ethan cohen · Alexis Lamiable · Guillaume Bollot · Auguste Genovesio 🔗 |
|
-
|
MOFO: MOtion FOcused Self-Supervision for Video Understanding ( Poster ) > link | Mona Ahmadian · Frank Guerin · Andrew Gilbert 🔗 |
|
-
|
Learning to Embed Time Series Patches Independently ( Poster ) > link | Seunghan Lee · Taeyoung Park · Kibok Lee 🔗 |
|
-
|
Unsupervised Segmentation of Colonoscopy Images ( Poster ) > link | Heming Yao · Jérôme Lüscher · Benjamin Gutierrez Becker · Josep Arús-Pous · Tommaso Biancalani · Amelie Bigorgne · David Richmond 🔗 |
|
-
|
A Simple Framework for Self-Supervised Learning of Sample-Efficient World Models ( Poster ) > link | Jan Robine · Marc Höftmann · Stefan Harmeling 🔗 |
|
-
|
Learning Beyond Similarities: Incorporating Dissimilarities between Positive Pairs in Self-Supervised Time Series Learning. ( Poster ) > link | Adrian Atienza · Jakob Bardram · Sadasivan Puthusserypady 🔗 |
|
-
|
Learning Orthonormal Features in Self-Supervised Learning using Functional Maximal Correlation ( Poster ) > link | Bo Hu · Yuheng Bu · Jose C Principe 🔗 |
|
-
|
Enhancing CLIP with a Third Modality ( Poster ) > link | Efthymios Tsaprazlis · Georgios Smyrnis · Alex Dimakis · Petros Maragos 🔗 |
|
-
|
Generalization properties of contrastive world models ( Poster ) > link | Kandan Ramakrishnan · R. James Cotton · Xaq Pitkow · Andreas Tolias 🔗 |
|
-
|
Adaptive Resolution Loss: An Efficient and Effective Loss for Time Series Hierarchical Contrastive Self-Supervised Learning Framework ( Poster ) > link | Kevin Garcia · Juan Manuel Perez Jr · Yifeng Gao 🔗 |
|
-
|
How does semi-supervised learning with pseudo-labelers work? A case study ( Poster ) > link | Yiwen Kou · Zixiang Chen · Yuan Cao · Quanquan Gu 🔗 |
|
-
|
Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation ( Poster ) > link | Kangwook Jang · Sungnyun Kim · Se-Young Yun · HOI RIN KIM 🔗 |
|
-
|
Ring Attention with Blockwise Transformers for Near-Infinite Context ( Poster ) > link | Hao Liu · Matei A Zaharia · Pieter Abbeel 🔗 |
|
-
|
Soft Contrastive Learning for Time Series ( Poster ) > link | Seunghan Lee · Taeyoung Park · Kibok Lee 🔗 |
|
-
|
SAMCLR: Contrastive pre-training on complex scenes using SAM for view sampling ( Poster ) > link | Benjamin Missaoui · Chongbin Yuan 🔗 |
|
-
|
Language Model Training Paradigms for Clinical Feature Embeddings ( Poster ) > link | Yurong Hu · Manuel Burger · Gunnar Rätsch · Rita Kuznetsova 🔗 |
|
-
|
Structuring Representation Geometry with Rotationally Equivariant Contrastive Learning ( Poster ) > link | Sharut Gupta · Joshua Robinson · Derek Lim · Soledad Villar · Stefanie Jegelka 🔗 |
|
-
|
Multimodal Distillation of CLIP Models ( Poster ) > link | Georgios Smyrnis · Sriram Ravula · Sujay Sanghavi · Alex Dimakis 🔗 |
|
-
|
Augmentation matters: Representation learning for Strong Gravitational lensing ( Poster ) > link | Kuan-Wei Huang · Po-Wen Chang · Joshua Fagin · James Chan · Joshua Yao-Yu Lin 🔗 |
|
-
|
Online Feature Updates Improve Online (Generalized) Label Shift Adaptation ( Poster ) > link | Ruihan Wu · Siddhartha Datta · Yi Su · Dheeraj Baby · Yu-Xiang Wang · Kilian Weinberger 🔗 |
|
-
|
FroSSL: Frobenius Norm Minimization for Self-Supervised Learning ( Poster ) > link | Oscar Skean · Aayush Dhakal · Nathan Jacobs · Luis Sanchez Giraldo 🔗 |
|
-
|
Spectral Temporal Contrastive Learning ( Poster ) > link | Sacha Morin · Somjit Nath · Samira Ebrahimi Kahou · Guy Wolf 🔗 |
|
-
|
Self-Supervised Pretraining for Improved Downstream Decoding of Audio-Evoked fMRI Sequences ( Poster ) > link | Sean Paulsen · Mike Casey 🔗 |
|
-
|
Exploring Target Representations for Masked Autoencoders ( Poster ) > link | xingbin liu · Jinghao Zhou · Tao Kong 🔗 |
|
-
|
Non-Vacuous Generalization Bounds for Large Language Models ( Poster ) > link | Sanae Lotfi · Marc Finzi · Yilun Kuang · Tim G. J. Rudner · Micah Goldblum · Andrew Wilson 🔗 |
|
-
|
Bootstrap Your Own Variance ( Poster ) > link | Polina Turishcheva · Jason Ramapuram · Sinead Williamson · Dan Busbridge · Eeshan Gunesh Dhekane · Russell Webb 🔗 |
|
-
|
Self-supervised Representation Learning from Random Data Projectors ( Poster ) > link | Yi Sui · Tongzi Wu · Jesse Cresswell · Ga Wu · George Stein · Xiao Shi Huang · Xiaochen Zhang · Maksims Volkovs 🔗 |
|
-
|
An Information-Theoretic Understanding of Maximum Manifold Capacity Representations ( Poster ) > link | Berivan Isik · Rylan Schaeffer · Victor Lecomte · Mikail Khona · Yann LeCun · Sanmi Koyejo · Andrey Gromov · Ravid Shwartz-Ziv 🔗 |
|
-
|
Self-Distilled Representation Learning for Time Series ( Poster ) > link | Felix Pieper · Konstantin Ditschuneit · Martin Genzel · Alexandra Lindt · Johannes Otterbach 🔗 |
|
-
|
Making Self-supervised Learning Robust to Spurious Correlation via Learning-speed Aware Sampling ( Poster ) > link | Weicheng Zhu · Sheng Liu · Carlos Fernandez-Granda · Narges Razavian 🔗 |
|
-
|
Generalized Category Discovery with Hierarchical Label Smoothing ( Poster ) > link | Sarah Rastegar · Yuki M Asano · Hazel Doughty · Cees Snoek 🔗 |
|
-
|
Benchmarking self-supervised video representation learning ( Poster ) > link | Akash Kumar · Ashlesha Kumar · Vibhav Vineet · Yogesh Rawat 🔗 |
|
-
|
Neurosymbolic Grounding for Compositional Generalization ( Poster ) > link | Atharva Sehgal · Arya Grayeli · Jennifer J Sun · Swarat Chaudhuri 🔗 |
|
-
|
No Representation Rules Them All in Category Discovery ( Poster ) > link | Sagar Vaze · Andrea Vedaldi · Andrew Zisserman 🔗 |
|
-
|
Application of Self Supervised Vision Transformers for Multiplexed Microscopy Images and Its Challenges ( Poster ) > link | Gantugs Atarsaikhan · Isabel Mogollon · Katja Välimäki · Teijo Pellinen · Tuomas Mirtti · Lassi Paavolainen 🔗 |
|
-
|
HyperMAE: Modulating Implicit Neural Representations for MAE Training ( Poster ) > link | Varun Belagali · Lei Zhou · Xiang Li · Dimitris Samaras 🔗 |
|
-
|
The Triad of Failure Modes and a Possible Way Out ( Poster ) > link | Emanuele Sansone 🔗 |
|
-
|
Identifiable attribution maps using regularized contrastive learning ( Poster ) > link | Steffen Schneider · Rodrigo González Laiz · Markus Frey · Mackenzie Mathis 🔗 |
|
-
|
On Improving the Sample Efficiency of Non-Contrastive SSL ( Poster ) > link | Kumar Krishna Agrawal · Arna Ghosh · Adam Oberman · Blake Richards 🔗 |
|
-
|
Perceptual Group Tokenizer: Building Perception with Iterative Grouping ( Poster ) > link | Zhiwei Deng · Ting Chen · Yang Li 🔗 |
|
-
|
On the Varied Faces of Overparameterization in Supervised and Self-Supervised Learning ( Poster ) > link | Matteo Gamba · Arna Ghosh · Kumar Krishna Agrawal · Blake Richards · Hossein Azizpour · Mårten Björkman 🔗 |
|
-
|
Learning Useful Representations of Recurrent Neural Network Weight Matrices ( Poster ) > link | Vincent Herrmann · Francesco Faccio · Jürgen Schmidhuber 🔗 |
|
-
|
MolSiam: Simple Siamese Self-supervised Representation Learning for Small Molecules ( Poster ) > link | Joshua Yao-Yu Lin · Michael Maser · Nathan Frey · Gabriele Scalia · Omar Mahmood · Pedro O. Pinheiro · Ji Won Park · Stephen Ra · Andrew Watkins · Kyunghyun Cho 🔗 |
|
-
|
Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations ( Poster ) > link | Cian Eastwood · Julius von Kügelgen · Linus Ericsson · Diane Bouchacourt · Pascal Vincent · Bernhard Schölkopf · Mark Ibrahim 🔗 |
|
-
|
Does Unconstrained Unlabeled Data Help Semi-Supervised Learning? ( Poster ) > link | Shuvendu Roy · Ali Etemad 🔗 |
|
-
|
Self-supervised Learning for User Sequence Modeling ( Poster ) > link | Yuhan Liu · Lin Ning · Neo Wu · Karan Singhal · Philip Mansfield · Devora Berlowitz · Bradley Green 🔗 |
|
-
|
LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures ( Poster ) > link | Vimal Thilak · Chen Huang · Omid Saremi · Laurent Dinh · Hanlin Goh · Preetum Nakkiran · Joshua Susskind · Etai Littwin 🔗 |
|
-
|
Multi-Task Learning with Self-Supervised Objectives can Improve Worst-Group Outcomes ( Poster ) > link | Atharva Kulkarni · Lucio M Dery · Amrith Setlur · Aditi Raghunathan · Ameet Talwalkar · Graham Neubig 🔗 |
|
-
|
Can semi-supervised learning use all the data effectively? A lower bound perspective ( Poster ) > link | Alexandru Tifrea · Gizem Yüce · Amartya Sanyal · Fanny Yang 🔗 |
|
-
|
Self-Supervised Image Captioning with CLIP ( Poster ) > link | Chuanyang Jin 🔗 |
|
-
|
Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models ( Poster ) > link | Shentong Mo · Zhun Sun · Chao Li 🔗 |
|
-
|
Simple Contrastive Representation Learning for Time Series Forecasting ( Poster ) > link | Xiaochen Zheng · Xingyu Chen · Manuel Schürch · Maolaaisha Aminanmu · Ahmed Allam · Michael Krauthammer 🔗 |
|
-
|
Iterated Piecewise Affine (IPA) Approximation for Language Modeling ( Poster ) > link | Davood Shamsi · Wen-yu Hua · Brian Williams 🔗 |
|
-
|
CCA with Shared Weights for Self-Supervised Learning ( Poster ) > link | James Chapman · Lennie Wells 🔗 |
|
-
|
Understanding Self-Supervised Features for Learning Unsupervised Instance Segmentation ( Poster ) > link | Paul Engstler · Luke Melas-Kyriazi · Christian Rupprecht · Iro Laina 🔗 |
|
-
|
Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discovery ( Poster ) > link | Sarah Rastegar · Hazel Doughty · Cees Snoek 🔗 |
|
-
|
Zero-shot Clustering of Embeddings with Self-Supervised Learnt Encoders ( Poster ) > link | Scott Lowe · Joakim Bruslund Haurum · Sageev Oore · Thomas Moeslund · Graham Taylor 🔗 |
|
-
|
SurgMAE: Masked Autoencoders for Long Surgical Video Analysis ( Poster ) > link | Muhammad Abdullah Jamal · Omid Mohareri 🔗 |
|
-
|
Bridging State and History Representations: Understanding Self-Predictive RL ( Poster ) > link | Tianwei Ni · Benjamin Eysenbach · Erfan Seyedsalehi · Michel Ma · Clement Gehring · Aditya Mahajan · Pierre-Luc Bacon 🔗 |
|
-
|
Scaling may be all you need for achieving human-level object recognition with human-like visual experience ( Poster ) > link | Emin Orhan 🔗 |
|
-
|
Augmentation-aware Self-Supervised Learning with Conditioned Projector ( Poster ) > link | Marcin Przewięźlikowski · Mateusz Pyla · Bartosz Zieliński · Bartłomiej Twardowski · Jacek Tabor · Marek Śmieja 🔗 |
|
-
|
BarcodeBERT: Transformers for Biodiversity Analysis ( Poster ) > link |
12 presentersPablo Millan Arias · Niousha Sadjadi · Monireh Safari · ZeMing Gong · Austin T. Wang · Scott Lowe · Joakim Bruslund Haurum · Iuliia Zarubiieva · Dirk Steinke · Lila Kari · Angel Chang · Graham Taylor |