Timezone: »

 
Contributed talks in Session 2 (Zoom)
Martin Takac · Samuel Horváth · Guan-Horng Liu · Nicolas Loizou · Sharan Vaswani

Fri Dec 11 08:00 AM -- 08:30 AM (PST) @

Join us to hear some new, exciting work at the intersection of optimization and ML. Come and ask questions and join the discussion.

Speakers: Samuel Horvath, "Adaptivity of Stochastic Gradient Methods for Nonconvex Optimization" Guan-Horng Liu, "DDPNOpt: Differential Dynamic Programming Neural Optimizer" Nicolas Loizou, "Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence" Sharan Vaswani, "Adaptive Gradient Methods Converge Faster with Over-Parameterization (and you can do a line-search)" Sharan Vaswani, "How to make your optimizer generalize better"

You can find a video on the NeurIPS website where the speakers discuss in detail their paper.

Author Information

Martin Takac (Lehigh University)
Samuel Horváth (King Abdullah University of Science and Technology)
Guan-Horng Liu (Georgia Institute of Technology)
Nicolas Loizou ( Mila, Université de Montréal )
Sharan Vaswani (University of Alberta)

More from the Same Authors