Program Highlights »
Workshop
Fri Dec 7th 08:00 AM -- 06:30 PM @ Room 220 D
Bayesian Deep Learning
Yarin Gal · José Miguel Hernández-Lobato · Christos Louizos · Andrew Wilson · Zoubin Ghahramani · Kevin P Murphy · Max Welling





Workshop Home Page

While deep learning has been revolutionary for machine learning, most modern deep learning models cannot represent their uncertainty nor take advantage of the well studied tools of probability theory. This has started to change following recent developments of tools and techniques combining Bayesian approaches with deep learning. The intersection of the two fields has received great interest from the community over the past few years, with the introduction of new deep learning models that take advantage of Bayesian techniques, as well as Bayesian models that incorporate deep learning elements [1-11]. In fact, the use of Bayesian techniques in deep learning can be traced back to the 1990s’, in seminal works by Radford Neal [12], David MacKay [13], and Dayan et al. [14]. These gave us tools to reason about deep models’ confidence, and achieved state-of-the-art performance on many tasks. However earlier tools did not adapt when new needs arose (such as scalability to big data), and were consequently forgotten. Such ideas are now being revisited in light of new advances in the field, yielding many exciting new results.

Extending on the workshop’s success from the past couple of years, this workshop will again study the advantages and disadvantages of the ideas above, and will be a platform to host the recent flourish of ideas using Bayesian approaches in deep learning and using deep learning tools in Bayesian modelling. The program includes a mix of invited talks, contributed talks, and contributed posters. The main theme this year will be applications of Bayesian deep learning in the real world, highlighting the requirements of practitioners from the research community. Future directions for the field will be debated in a panel discussion.

The BDL workshop was the second largest workshop at NIPS over the past couple of years, with last year’s workshop seeing an almost 100% increase in the number of submissions (75 submissions in total), attracting sponsorship from Google, Microsoft Ventures, Uber, and Qualcomm in the form of student travel awards.




Topics:
Probabilistic deep models for classification and regression (such as extensions and application of Bayesian neural networks),
Generative deep models (such as variational autoencoders),
Incorporating explicit prior knowledge in deep learning (such as posterior regularization with logic rules),
Approximate inference for Bayesian deep learning (such as variational Bayes / expectation propagation / etc. in Bayesian neural networks),
Scalable MCMC inference in Bayesian deep models,
Deep recognition models for variational inference (amortized inference),
Model uncertainty in deep learning,
Bayesian deep reinforcement learning,
Deep learning with small data,
Deep learning in Bayesian modelling,
Probabilistic semi-supervised learning techniques,
Active learning and Bayesian optimization for experimental design,
Applying non-parametric methods, one-shot learning, and Bayesian deep learning in general,
Implicit inference,
Kernel methods in Bayesian deep learning.


Call for papers:
A submission should take the form of an extended abstract (3 pages long) in PDF format using the NIPS style. Author names do not need to be anonymized and references (as well as appendices) may extend as far as needed beyond the 3 page upper limit. If research has previously appeared in a journal, workshop, or conference (including NIPS 2017 conference), the workshop submission should extend that previous work.
Submissions will be accepted as contributed talks or poster presentations.


Related previous workshops:
Bayesian Deep Learning (NIPS 2017)
Principled Approaches to Deep Learning (ICML 2017)
Bayesian Deep Learning (NIPS 2016)
Data-Efficient Machine Learning (ICML 2016)
Deep Learning Workshop (ICML 2015, 2016)
Deep Learning Symposium (NIPS 2015 symposium)
Advances in Approximate Bayesian Inference (NIPS 2015)
Black box learning and inference (NIPS 2015)
Deep Reinforcement Learning (NIPS 2015)
Deep Learning and Representation Learning (NIPS 2014)
Advances in Variational Inference (NIPS 2014)

08:00 AM Opening Remarks (Talk)
Yarin Gal
08:05 AM TBC 1 (Invited Talk)
Frank Wood
08:25 AM TBC 2 (Invited Talk)
Dmitry Vetrov
08:45 AM TBC 3 (Contributed Talk)
09:00 AM TBC 4 (Invited Talk)
Debora S. Marks
09:20 AM TBC 5 (Invited Talk)
Harri Valpola
09:40 AM Poster Spotlights
09:55 AM Poster Session 1 (Poster Session)
Stefan Gadatsch, Danil Kuzin, Navneet Kumar, Patrick Dallaire, Tom Ryder, Remus-Petru Pop, Nathan Hunt, Adam Kortylewski, Sophie Burkhardt, Mahmoud Elnaggar, Dieterich Lawson, Yifeng Li, J. Jon Ryu, Juhan Bae, Micha Livne, Tim Pearce, Mariia Vladimirova, Jason E. Ramapuram, Jiaming Zeng, Xinyu Hu, Eric He, Danielle Maddix, Arunesh Mittal, Albert Shaw, Tuan Anh Le, Alexander Sagel, Lisha Chen, Victor Gallego, Mahdi Karami, Zihao Zhang, Tal Kachman, Noah Weber, Matt Benatan, Kumar K Sricharan, Vincent Cartillier, Ivan Ovinnikov, Buu Phan, Mahmoud A Hossam, Ziyin Liu, Valery Kharitonov, Eugene Golikov, Qiang Zhang, JaeMyung Kim, Sebastian Farquhar, Jishnu Mukhoti, Xu Hu, Gregory Gundersen, lavanya Tekumalla, Paris Perdikaris, Ershad Banijamali, Siddhartha Jain, Ge Liu, Martin Gottwald, Katy Blumer, Sukmin Yun, Ranganath Krishnan, Roman Novak, Yilun Du, Yu Gong, Beliz Gokkaya, Jessica Ai, Daniel Duckworth, Johannes von Oswald, Christian Henning, LP Morency, Ali Ghodsi, Mahesh Subedar, Jean-Pascal Pfister, Rémi Lebret, Chao Ma, Aleksander Wieczorek, Laurence Perreault Levasseur
10:55 AM TBC 6 (Invited Talk)
Christian Leibig
11:15 AM TBC 7 (Contributed Talk)
11:30 AM TBC 8 (Invited Talk)
Balaji Lakshminarayanan
11:50 AM Lunch
01:20 PM TBC 9 (Invited Talk)
Sergey Levine
01:40 PM TBC 10 (Contributed Talk)
01:55 PM TBC 11 (Invited Talk)
Yashar Hezaveh
02:10 PM TBC 12 (Invited Talk)
Tim Genewein
02:30 PM Poster Session 2 (Poster Session)
03:30 PM TBC 13 (Invited Talk)
David Sontag
03:50 PM TBC 14 (Contributed Talk)
04:05 PM TBC 15 (Invited Talk)
Yarin Gal
04:30 PM Panel Session
05:30 PM Poster Session 3 (Poster Session)