( events)   Timezone: »  
Tue Dec 14 06:00 AM -- 03:20 PM (PST)
Offline Reinforcement Learning
Rishabh Agarwal · Aviral Kumar · George Tucker · Justin Fu · Nan Jiang · Doina Precup · Aviral Kumar

Workshop Home Page

Offline reinforcement learning (RL) is a re-emerging area of study that aims to learn behaviors using only logged data, such as data from previous experiments or human demonstrations, without further environment interaction. It has the potential to make tremendous progress in a number of real-world decision-making problems where active data collection is expensive (e.g., in robotics, drug discovery, dialogue generation, recommendation systems) or unsafe/dangerous (e.g., healthcare, autonomous driving, or education). Such a paradigm promises to resolve a key challenge to bringing reinforcement learning algorithms out of constrained lab settings to the real world. The first edition of the offline RL workshop, held at NeurIPS 2020, focused on and led to algorithmic development in offline RL. This year we propose to shift the focus from algorithm design to bridging the gap between offline RL research and real-world offline RL. Our aim is to create a space for discussion between researchers and practitioners on topics of importance for enabling offline RL methods in the real world. To that end, we have revised the topics and themes of the workshop, invited new speakers working on application-focused areas, and building on the lively panel discussion last year, we have invited the panelists from last year to participate in a retrospective panel on their changing perspectives.

For details on submission please visit: https://offline-rl-neurips.github.io/2021 (Submission deadline: October 6, Anywhere on Earth)

Aviv Tamar (Technion - Israel Inst. of Technology)
Angela Schoellig (University of Toronto)
Barbara Engelhardt (Princeton University)
Sham Kakade (University of Washington/Microsoft)
Minmin Chen (Google)
Philip S. Thomas (UMass Amherst)

Opening Remarks
Offline Bayesian RL (Talk)
Q&A for Aviv Tamar (Q&A)
Poster Session 1 (Poster Session)
Speaker Intro (Speaker Introduction)
Offline RL for Robotics (Talk)
Q&A for Angela Schoellig (Q&A)
Speaker Intro (Live short intro)
Generalization theory in Offline RL (Talk)
Q&A for Sham Kakade (Q&A)
Retrospective Panel (Discussion Panel)
Invited Speaker Panel (Discussion Panel)
Speaker Intro
Offline RL for recommendation systems (Talk)
Q&A for Minmin Chen (Q&A)
Speaker Intro
Offline RL for Clinical Decision Making (Talk)
Q&A for Barbara Engelhardt (Q&A)
Model selection in offline RL (Talk)
Q&A for Philip Thomas (Q&A)
Closing Remarks & Poster Session (Closing Remarks)
Poster Session 2 (Poster Session)