Skip to yearly menu bar Skip to main content


(23 events)   Timezone: America/Los_Angeles  
Show all
Toggle Poster Visibility
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #165
Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets
In Deep Learning -- Optimization for Deep Networks
Rohith Kuditipudi · Xiang Wang · Holden Lee · Yi Zhang · Zhiyuan Li · Wei Hu · Rong Ge · Sanjeev Arora
[ Paper]  [ Slides] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #166
Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models
In Deep Learning -- Optimization for Deep Networks
Yunfei Teng · Wenbo Gao · François Chalus · Anna Choromanska · Donald Goldfarb · Adrian Weller
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #167
Learning Neural Networks with Adaptive Regularization
In Deep Learning -- Optimization for Deep Networks
Han Zhao · Yao-Hung Hubert Tsai · Russ Salakhutdinov · Geoffrey Gordon
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #168
Memory Efficient Adaptive Optimization
In Deep Learning -- Optimization for Deep Networks
Rohan Anil · Vineet Gupta · Tomer Koren · Yoram Singer
[ Paper]  [ Slides] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #169
On the Convergence Rate of Training Recurrent Neural Networks
In Deep Learning -- Optimization for Deep Networks
Zeyuan Allen-Zhu · Yuanzhi Li · Zhao Song
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #170
SGD on Neural Networks Learns Functions of Increasing Complexity
In Deep Learning -- Optimization for Deep Networks
Dimitris Kalimeris · Gal Kaplun · Preetum Nakkiran · Benjamin Edelman · Tristan Yang · Boaz Barak · Haofeng Zhang
[ Paper]  [ Poster]  [ Slides] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #171
Towards Understanding the Importance of Shortcut Connections in Residual Networks
In Deep Learning -- Optimization for Deep Networks
Tianyi Liu · Minshuo Chen · Mo Zhou · Simon Du · Enlu Zhou · Tuo Zhao
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #172
Trivializations for Gradient-Based Optimization on Manifolds
In Deep Learning -- Optimization for Deep Networks
Mario Lezcano Casado
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #173
Using Statistics to Automate Stochastic Optimization
In Deep Learning -- Optimization for Deep Networks
Hunter Lang · Lin Xiao · Pengchuan Zhang
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #174
Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model
In Deep Learning -- Optimization for Deep Networks
Guodong Zhang · Lala Li · Zachary Nado · James Martens · Sushant Sachdeva · George Dahl · Chris Shallue · Roger Grosse
[ Paper]  [ Poster] 
Poster
Thu Dec 12 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #175
Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent
In Deep Learning -- Optimization for Deep Networks
Jaehoon Lee · Lechao Xiao · Samuel Schoenholz · Yasaman Bahri · Roman Novak · Jascha Sohl-Dickstein · Jeffrey Pennington
[ Paper]  [ Poster] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #195
Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks
In Deep Learning -- Optimization for Deep Networks
Spencer Frei · Yuan Cao · Quanquan Gu
[ Paper]  [ Poster] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #196
Are deep ResNets provably better than linear predictors?
In Deep Learning -- Optimization for Deep Networks
Chulhee Yun · Suvrit Sra · Ali Jadbabaie
[ Paper]  [ Slides] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #197
Efficient Rematerialization for Deep Networks
In Deep Learning -- Optimization for Deep Networks
Ravi Kumar · Manish Purohit · Zoya Svitkina · Erik Vee · Joshua Wang
[ Paper]  [ Poster] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #198
Fast Convergence of Natural Gradient Descent for Over-Parameterized Neural Networks
In Deep Learning -- Optimization for Deep Networks
Guodong Zhang · James Martens · Roger Grosse
[ Paper]  [ Poster] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #199
How to Initialize your Network? Robust Initialization for WeightNorm & ResNets
In Deep Learning -- Optimization for Deep Networks
Devansh Arpit · Víctor Campos · Yoshua Bengio
[ Paper]  [ Poster] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #200
Lookahead Optimizer: k steps forward, 1 step back
In Deep Learning -- Optimization for Deep Networks
Michael Zhang · James Lucas · Jimmy Ba · Geoffrey E Hinton
[ Paper]  [ Slides] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #201
Global Convergence of Gradient Descent for Deep Linear Residual Networks
In Deep Learning -- Optimization for Deep Networks
Lei Wu · Qingcan Wang · Chao Ma
[ Paper]  [ Slides] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #202
Piecewise Strong Convexity of Neural Networks
In Deep Learning -- Optimization for Deep Networks
Tristan Milne
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #203
PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization
In Deep Learning -- Optimization for Deep Networks
Thijs Vogels · Sai Praneeth Karimireddy · Martin Jaggi
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #204
A Primal Dual Formulation For Deep Learning With Constraints
In Deep Learning -- Optimization for Deep Networks
Yatin Nandwani · Abhishek Pathak · Mausam · Parag Singla
[ Paper]  [ Slides] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #205
Surfing: Iterative Optimization Over Incrementally Trained Deep Networks
In Deep Learning -- Optimization for Deep Networks
Ganlin Song · Zhou Fan · John Lafferty
[ Paper]  [ Poster] 
Poster
Thu Dec 12 05:00 PM -- 07:00 PM (PST) @ East Exhibition Hall B + C #206
Theoretical Limits of Pipeline Parallel Optimization and Application to Distributed Deep Learning
In Deep Learning -- Optimization for Deep Networks
Igor Colin · Ludovic DOS SANTOS · Kevin Scaman
[ Paper]  [ Slides]