Timezone: »
Reinforcement learning has gained popularity as a model-free and adaptive controller for the built-environment in demand-response applications. However, a lack of standardization on previous research has made it difficult to compare different RL algorithms with each other. Also, it is unclear how much effort is required in solving each specific problem in the building domain and how well a trained RL agent will scale up to new environments. The CityLearn Challenge 2022 provides an avenue to address these problems by leveraging CityLearn, an OpenAI Gym Environment for the implementation of RL agents for demand response. The challenge utilizes operational electricity demand data to develop an equivalent digital twin model of the 20 buildings. Participants are to develop energy management agents for battery charge and discharge control in each building with a goal of minimizing electricity demand from the grid, electricity bill and greenhouse gas emissions. We provide a baseline RBC agent for the evaluation of the RL agents performance and rank the participants' according to their solution's ability to outperform the baseline.
Wed 5:05 a.m. - 5:15 a.m.
|
Welcome
(
Introduction
)
|
Zoltan Nagy 🔗 |
Wed 5:15 a.m. - 5:30 a.m.
|
Welcome by EPRI
(
Talk
)
|
Siva Sankaranarayanan 🔗 |
Wed 5:30 a.m. - 5:40 a.m.
|
Fifteen-minute Competition Overview Video
(
Overview
)
SlidesLive Video » |
Zoltan Nagy 🔗 |
Wed 5:40 a.m. - 5:55 a.m.
|
Team ambitiousengineers
(
Presentation
)
|
Matthew Motoki 🔗 |
Wed 5:55 a.m. - 6:10 a.m.
|
Team CUFE
(
Presentation
)
|
Michael Ibrahim 🔗 |
Wed 6:10 a.m. - 6:20 a.m.
|
10min Break
|
🔗 |
Wed 6:20 a.m. - 6:35 a.m.
|
Team DivMARL
(
Presentation
)
|
Abilmansur Zhumabekov 🔗 |
Wed 6:35 a.m. - 6:50 a.m.
|
Team Greener
(
Presentation
)
|
Shun Zheng 🔗 |
Wed 6:50 a.m. - 7:05 a.m.
|
Team Together
(
Presentation
)
|
Wei Jiang 🔗 |
Wed 7:05 a.m. - 7:15 a.m.
|
Announcement
(
Winner Announcement
)
|
Zoltan Nagy 🔗 |
Wed 7:15 a.m. - 7:30 a.m.
|
Meet the Teams in Breakout Rooms
(
Social Time
)
|
🔗 |
Author Information
Zoltan Nagy (The University of Texas at Austin)
Kingsley Nweye (The University of Texas at Austin)
Sharada Mohanty (AIcrowd SA)
Siva Sankaranarayanan (EPRI)
Jan Drgona (Pacific Northwest National Laboratory)
I am a data scientist in the Physics and Computational Sciences Division (PCSD) at Pacific Northwest National Laboratory, Richland, WA. My current research interests fall in the intersection of model-based optimal control, constrained optimization, and machine learning.
Tianzhen Hong (LBNL)
Dr. Tianzhen Hong is a Senior Scientist and Deputy Head of the Building Technologies Department of LBNL. He leads the Urban Systems Group and a team with research on data, methods, computing, occupant behavior, and policy for design and operation of low energy buildings and sustainable urban systems. He is an IBPSA Fellow, ASHRAE Fellow, and a Highly Cited Researcher 2021. He received B.Eng. and Ph.D. in HVACR, and B.Sc. in Applied Mathematics from Tsinghua University, China.
Sourav Dey (University of Colorado, Boulder)
Gregor Henze (University of Colorado, Boulder)
More from the Same Authors
-
2020 : Physics-constrained Deep Recurrent Neural Models of Building Thermal Dynamics »
Jan Drgona -
2021 : The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions »
Jennifer J Sun · Tomomi Karigo · Dipam Chakraborty · Sharada Mohanty · Benjamin Wild · Quan Sun · Chen Chen · David Anderson · Pietro Perona · Yisong Yue · Ann Kennedy -
2022 : Fifteen-minute Competition Overview Video »
Byron Galbraith · Anssi Kanervisto · Steven Wang · Stephanie Milani · Sharada Mohanty · Rohin Shah · Karolis Ramanauskas · Brandon Houghton -
2022 Workshop: Tackling Climate Change with Machine Learning »
Peetak Mitra · Maria João Sousa · Mark Roth · Jan Drgona · Emma Strubell · Yoshua Bengio -
2022 : Announcement »
Zoltan Nagy -
2022 : Fifteen-minute Competition Overview Video »
Zoltan Nagy -
2022 : Welcome by EPRI »
Siva Sankaranarayanan -
2022 : Welcome »
Zoltan Nagy -
2022 Competition: The MineRL BASALT Competition on Fine-tuning from Human Feedback »
Anssi Kanervisto · Stephanie Milani · Karolis Ramanauskas · Byron Galbraith · Steven Wang · Brandon Houghton · Sharada Mohanty · Rohin Shah -
2021 : Tianzhen Hong: Machine Learning for Smart Buildings: Applications and Perspectives »
Tianzhen Hong -
2021 Workshop: Tackling Climate Change with Machine Learning »
Maria João Sousa · Hari Prasanna Das · Sally Simone Fobi · Jan Drgona · Tegan Maharaj · Yoshua Bengio -
2021 : NeurIPS RL Competitions Results Presentations »
Rohin Shah · Liam Paull · Tabitha Lee · Tim Rocktäschel · Heinrich Küttler · Sharada Mohanty · Manuel Wuethrich -
2021 : Differentiable Parametric Optimization Approach to Power System Load Modeling »
Jan Drgona · Andrew August · Elliott Skomski -
2021 : Neural Differentiable Predictive Control »
Jan Drgona · Aaron Tuor · Draguna Vrabie -
2021 : AI Driving Olympics + Q&A »
Andrea Censi · Liam Paull · Jacopo Tani · Emilio Frazzoli · Holger Caesar · Matthew Walter · Andrea Daniele · Sahika Genc · Sharada Mohanty -
2021 : BASALT: A MineRL Competition on Solving Human-Judged Task + Q&A »
Rohin Shah · Cody Wild · Steven Wang · Neel Alex · Brandon Houghton · William Guss · Sharada Mohanty · Stephanie Milani · Nicholay Topin · Pieter Abbeel · Stuart Russell · Anca Dragan -
2021 : The NetHack Challenge + Q&A »
Eric Hambro · Sharada Mohanty · Dipam Chakrabroty · Edward Grefenstette · Minqi Jiang · Robert Kirk · Vitaly Kurin · Heinrich Kuttler · Vegard Mella · Nantas Nardelli · Jack Parker-Holder · Roberta Raileanu · Tim Rocktäschel · Danielle Rothermel · Mikayel Samvelyan -
2021 Poster: On the Stochastic Stability of Deep Markov Models »
Jan Drgona · Sayak Mukherjee · Jiaxin Zhang · Frank Liu · Mahantesh Halappanavar -
2021 : Diamond: A MineRL Competition on Training Sample-Efficient Agents + Q&A »
William Guss · Alara Dirik · Byron Galbraith · Brandon Houghton · Anssi Kanervisto · Noboru Kuno · Stephanie Milani · Sharada Mohanty · Karolis Ramanauskas · Ruslan Salakhutdinov · Rohin Shah · Nicholay Topin · Steven Wang · Cody Wild -
2020 : Concluding Remarks »
Sharada Mohanty -
2020 : Sample Efficiency & Generalization in RL : An assortment of tricks (talks by top participants) »
Sharada Mohanty -
2020 : Winner Announcements & Analysis of top submissions »
Sharada Mohanty -
2020 : NeurIPS 2020 Procgen Challenge Design »
Sharada Mohanty -
2020 : Introduction - Procgen »
Sharada Mohanty -
2020 : Concluding Remarks »
Sharada Mohanty -
2020 : "Real world applications of Flatland" : Panel Discussion with SBB, DeutschBahn, SNCF »
Sharada Mohanty -
2020 : Winner Talks : Team ai-team-flatland »
Sharada Mohanty -
2020 : Winner Talks : Team JBR_HSE »
Sharada Mohanty -
2020 : Winner Talks : Team An Old Driver »
Sharada Mohanty -
2020 : Flatland Competition Design & Results »
Sharada Mohanty -
2020 : Introduction - Flatland »
Sharada Mohanty -
2020 : NeurIPS RL Competitions: Procgen challenge »
Sharada Mohanty -
2020 : NeurIPS RL Competitions: Flatland challenge »
Sharada Mohanty -
2019 : Lunch + Poster Session »
Frederik Gerzer · Bill Yang Cai · Pieter-Jan Hoedt · Kelly Kochanski · Soo Kyung Kim · Yunsung Lee · Sunghyun Park · Sharon Zhou · Martin Gauch · Jonathan Wilson · Joyjit Chatterjee · Shamindra Shrotriya · Dimitri Papadimitriou · Christian Schön · Valentina Zantedeschi · Gabriella Baasch · Willem Waegeman · Gautier Cosne · Dara Farrell · Brendan Lucier · Letif Mones · Caleb Robinson · Tafara Chitsiga · Victor Kristof · Hari Prasanna Das · Yimeng Min · Alexandra Puchko · Alexandra Luccioni · Kyle Story · Jason Hickey · Yue Hu · Björn Lütjens · Zhecheng Wang · Renzhi Jing · Genevieve Flaspohler · Jingfan Wang · Saumya Sinha · Qinghu Tang · Armi Tiihonen · Ruben Glatt · Muge Komurcu · Jan Drgona · Juan Gomez-Romero · Ashish Kapoor · Dylan J Fitzpatrick · Alireza Rezvanifar · Adrian Albert · Olya (Olga) Irzak · Kara Lamb · Ankur Mahesh · Kiwan Maeng · Frederik Kratzert · Sorelle Friedler · Niccolo Dalmasso · Alex Robson · Lindiwe Malobola · Lucas Maystre · Yu-wen Lin · Surya Karthik Mukkavili · Brian Hutchinson · Alexandre Lacoste · Yanbing Wang · Zhengcheng Wang · Yinda Zhang · Victoria Preston · Jacob Pettit · Draguna Vrabie · Miguel Molina-Solana · Tonio Buonassisi · Andrew Annex · Tunai P Marques · Catalin Voss · Johannes Rausch · Max Evans