This is the public, feature-limited version of the conference webpage. After Registration and login please visit the full version.

Workshop: The Challenges of Real World Reinforcement Learning

Daniel Mankowitz, Gabriel Dulac-Arnold, Shie Mannor, Omer Gottesman, Anusha Nagabandi, Doina Precup, Timothy A Mann, Gabe Dulac-Arnold

2020-12-12T08:30:00-08:00 - 2020-12-12T19:30:00-08:00
Abstract: Reinforcement Learning (RL) has had numerous successes in recent years in solving complex problem domains. However, this progress has been largely limited to domains where a simulator is available or the real environment is quick and easy to access. This is one of a number of challenges that are bottlenecks to deploying RL agents on real-world systems. Two recent papers identify nine important challenges that, if solved, will take a big step towards enabling RL agents to be deployed to real-world systems (Dulac et. al. 2019, 2020).The goals of this workshop are four-fold: (1) Providing a forum for researchers in academia, industry researchers as well as industry practitioners from diverse backgrounds to discuss the challenges faced in real-world systems; (2) discuss and prioritize the nine research challenges. This includes determining which challenges we should focus on next, whether any new challenges should be added to the list or existing ones removed from this list; (3) Discuss problem formulations for the various challenges and critique these formulations or develop new ones. This is especially important for more abstract challenges such as explainability. We should also be asking ourselves whether the current Markov Decision Process (MDP) formulation is sufficient for solving these problems or whether modifications need to be made. (4) Discuss approaches to solving combinations of these challenges.

Chat

To ask questions please use rocketchat, available only upon registration and login.

Schedule

2020-12-12T08:30:00-08:00 - 2020-12-12T08:40:00-08:00
Introduction and Overview
Daniel Mankowitz, Gabe Dulac-Arnold
2020-12-12T08:40:00-08:00 - 2020-12-12T09:20:00-08:00
Keynote: Aviv Tamar
Aviv Tamar
2020-12-12T09:20:00-08:00 - 2020-12-12T10:00:00-08:00
Keynote: Emma Brunskill
Emma Brunskill
2020-12-12T10:00:00-08:00 - 2020-12-12T10:40:00-08:00
Keynote: Jost Tobias Springenberg
Jost Tobias Springenberg
2020-12-12T10:40:00-08:00 - 2020-12-12T11:20:00-08:00
Mini-panel discussion 1 - Bridging the gap between theory and practice
Aviv Tamar, Emma Brunskill, Jost Tobias Springenberg, Daniel Mankowitz
2020-12-12T11:20:00-08:00 - 2020-12-12T11:50:00-08:00
Poster session 1
2020-12-12T11:50:00-08:00 - 2020-12-12T12:30:00-08:00
Keynote: Franziska Meier
2020-12-12T12:30:00-08:00 - 2020-12-12T13:10:00-08:00
Keynote: Marc Raibert, Scott Kuindersma
2020-12-12T13:10:00-08:00 - 2020-12-12T13:50:00-08:00
Mini-panel discussion 2 - Real World RL: An industry perspective
Timothy A Mann, Franziska Meier
2020-12-12T13:50:00-08:00 - 2020-12-12T15:20:00-08:00
Lunch
2020-12-12T15:20:00-08:00 - 2020-12-12T16:00:00-08:00
Spotlight Talks
2020-12-12T16:00:00-08:00 - 2020-12-12T16:40:00-08:00
Keynote: Tom Diettrich
Tom Dietterich
2020-12-12T16:40:00-08:00 - 2020-12-12T17:20:00-08:00
Keynote: Chelsea Finn
Chelsea Finn
2020-12-12T17:20:00-08:00 - 2020-12-12T18:00:00-08:00
Mini-panel discussion 3 - Prioritizing Real World RL Challenges
Chelsea Finn, Tom Dietterich, Gabriel Dulac-Arnold
2020-12-12T18:00:00-08:00 - 2020-12-12T18:30:00-08:00
Poster session 2
2020-12-12T18:30:00-08:00 - 2020-12-12T19:10:00-08:00
Keynote: Angela Schoellig
Angela Schoellig
2020-12-12T19:10:00-08:00 - 2020-12-12T19:50:00-08:00
Keynote: Anca Dragan
Anca Dragan
2020-12-12T19:50:00-08:00 - 2020-12-12T20:30:00-08:00
Mini-panel discussion 4 - Ethical considerations for Real-World RL
Anca Dragan, Angela Schoellig, Anusha Nagabandi