Timezone: »

Bayesian Optimization in Academia and Industry
Zoubin Ghahramani · Ryan Adams · Matthew Hoffman · Kevin Swersky · Jasper Snoek

Fri Dec 12 05:30 AM -- 03:30 PM (PST) @ Level 5; room 512 b, f
Event URL: http://bayesianoptimization.org »

Bayesian optimization has emerged as an exciting subfield of machine learning that is concerned with the global optimization of noisy, black-box functions using probabilistic methods. Systems implementing Bayesian optimization techniques have been successfully used to solve difficult problems in a diverse set of applications. There have been many recent advances in the methodologies and theory underpinning Bayesian optimization that have extended the framework to new applications as well as provided greater insights into the behaviour of these algorithms. Bayesian optimization is now increasingly being used in industrial settings, providing new and interesting challenges that require new algorithms and theoretical insights.

At last year’s NIPS workshop on Bayesian optimization the focus was on the intersection of “Theory and Practice”. The workshop this year will follow this trend by again looking at theoretical contributions, but also by focusing on the practical side of Bayesian optimization in industry. The goal of this workshop is not only to bring together both practical and theoretical research knowledge from academia, but also to facilitate cross-fertilization with industry. Specifically, we would like to carefully examine the types of problems where Bayesian optimization works well in industrial settings, but also the types of situations where additional performance is needed. The key questions we will discuss are: how to scale Bayesian optimization to long time-horizons and many observations? How to tackle high-dimensional data? How to make Bayesian optimization work in massive, distributed systems? What kind of structural assumptions are we able to make? And finally, what can we say about these questions both empirically and theoretically?

The target audience for this workshop consists of both industrial and academic practitioners of Bayesian optimization as well as researchers working on theoretical advances in probabilistic global optimization. To this end we have invited many industrial users of Bayesian optimization to attend and speak at the workshop. We expect this exchange of industrial and academic knowledge will lead to a significant interchange of ideas and a clearer understanding of the challenges and successes of Bayesian optimization as a whole.

A further goal is to encourage collaboration between the diverse set of researchers involved in Bayesian optimization. This includes not only interchange between industrial and academic researchers, but also between the many different sub-fields of machine learning which make use of Bayesian optimization. We are also reaching out to the wider global optimization and Bayesian inference communities for involvement.

Author Information

Zoubin Ghahramani (Uber and University of Cambridge)

Zoubin Ghahramani is Professor of Information Engineering at the University of Cambridge, where he leads the Machine Learning Group. He studied computer science and cognitive science at the University of Pennsylvania, obtained his PhD from MIT in 1995, and was a postdoctoral fellow at the University of Toronto. His academic career includes concurrent appointments as one of the founding members of the Gatsby Computational Neuroscience Unit in London, and as a faculty member of CMU's Machine Learning Department for over 10 years. His current research interests include statistical machine learning, Bayesian nonparametrics, scalable inference, probabilistic programming, and building an automatic statistician. He has held a number of leadership roles as programme and general chair of the leading international conferences in machine learning including: AISTATS (2005), ICML (2007, 2011), and NIPS (2013, 2014). In 2015 he was elected a Fellow of the Royal Society.

Ryan Adams (Google Brain and Princeton University)
Matthew Hoffman (DeepMind)
Kevin Swersky (Google)
Jasper Snoek (Google Brain)

More from the Same Authors