Timezone: »
The efficient communication of information has enormous societal and environmental impact, and stands to benefit from the machine learning revolution seen in other fields. Through this tutorial, we hope to disseminate the ideas of information theory and compression to a broad audience, overview the core methodologies in learning-based compression (i.e., neural compression), and present the relevant technical challenges and open problems defining a new frontier of probabilistic machine learning. Besides covering the technical grounds, we will also explore the broader underlying themes and future research in our panel discussion, focusing on the interplay between computation and communication, the role of machine learning, and societal considerations such as fairness, privacy, and energy footprint as we strive to make our learning and information processing systems more efficient.
Mon 2:00 p.m. - 3:50 p.m.
|
Tutorial part 1
(tutorial part 1)
SlidesLive Video » |
Yibo Yang · Karen Ullrich · Stephan Mandt 🔗 |
Mon 3:50 p.m. - 4:00 p.m.
|
Q & A
(questions)
|
Karen Ullrich · Yibo Yang · Stephan Mandt 🔗 |
Mon 4:00 p.m. - 4:05 p.m.
|
Break to welcome panellists
(Break)
|
🔗 |
Mon 4:05 p.m. - 4:30 p.m.
|
Panel
SlidesLive Video » |
Virginia Smith · Michele Covell · Daniel Severo · Christopher Schroers 🔗 |
Author Information
Karen Ullrich (Meta AI)
I am a research scientist (s/h) at FAIR NY and am actively collaborating with researchers from the Vector Institute and the UoAmsterdam. My main research focus lies in the intersection of information theory and probabilistic machine learning / deep learning 💜. I previously completed a PhD under the supervision of Prof. Max Welling. Prior to that, I worked at the Austrian Research Institute for AI, Intelligent Music Processing and Machine Learning Group lead by Prof. Gerhard Widmer. I studied Physics and Numerical Simulations in Leipzig and Amsterdam.
Yibo Yang (University of California, Irivine)
Stephan Mandt (University of California, Irvine)
More from the Same Authors
-
2021 Spotlight: Lossy Compression for Lossless Prediction »
Yann Dubois · Benjamin Bloem-Reddy · Karen Ullrich · Chris Maddison -
2021 : Analyzing High-Resolution Clouds and Convection using Multi-Channel VAEs »
Harshini Mangipudi · Griffin Mooers · Mike Pritchard · Tom Beucler · Stephan Mandt -
2021 : Structured Stochastic Gradient MCMC: a hybrid VI and MCMC approach »
Antonios Alexos · Alex Boyd · Stephan Mandt -
2021 : Your Dataset is a Multiset and You Should Compress it Like One »
Daniel Severo · James Townsend · Ashish Khisti · Alireza Makhzani · Karen Ullrich -
2022 : Probabilistic Querying of Continuous-Time Sequential Events »
Alex Boyd · Yuxin Chang · Stephan Mandt · Padhraic Smyth -
2022 : An Unsupervised Learning Perspective on the Dynamic Contribution to Extreme Precipitation Changes »
Griffin Mooers · Tom Beucler · Mike Pritchard · Stephan Mandt -
2022 : An optimal control perspective on diffusion-based generative modeling »
Julius Berner · Lorenz Richter · Karen Ullrich -
2022 : Q & A »
Karen Ullrich · Yibo Yang · Stephan Mandt -
2022 : Tutorial part 1 »
Yibo Yang · Karen Ullrich · Stephan Mandt -
2022 Poster: Predictive Querying for Autoregressive Neural Sequence Models »
Alex Boyd · Samuel Showalter · Stephan Mandt · Padhraic Smyth -
2021 : Your Dataset is a Multiset and You Should Compress it Like One »
Daniel Severo · James Townsend · Ashish Khisti · Alireza Makhzani · Karen Ullrich -
2021 Poster: Detecting and Adapting to Irregular Distribution Shifts in Bayesian Online Learning »
Aodong Li · Alex Boyd · Padhraic Smyth · Stephan Mandt -
2021 Poster: Lossy Compression for Lossless Prediction »
Yann Dubois · Benjamin Bloem-Reddy · Karen Ullrich · Chris Maddison -
2020 : Q/A and Discussion for ML Theory Session »
Karthik Kashinath · Mayur Mudigonda · Stephan Mandt · Rose Yu -
2020 : Stephan Mandt »
Stephan Mandt -
2020 Poster: Improving Inference for Neural Image Compression »
Yibo Yang · Robert Bamler · Stephan Mandt -
2017 Poster: Bayesian Compression for Deep Learning »
Christos Louizos · Karen Ullrich · Max Welling