Timezone: »
Uncertainty quantification of weather forecasts is a necessity for reliably planning for and responding to extreme weather events in a warming world. This motivates the need for well-calibrated ensembles in probabilistic weather forecasting. We present initial results for the calibration of large-scale deep neural weather models for data-driven probabilistic weather forecasting. By explicitly accounting for uncertainties about the forecast's initial condition and model parameters, we generate ensemble forecasts that show promising results on standard diagnostics for probabilistic forecasts. Specifically, we are approaching the Integrated Forecasting System (IFS), the gold standard on probabilistic weather forecasting, on: (i) the spread-error agreement; and (ii) the Continuous Ranked Probability Score (CRPS). Our approach scales to state-of-the-art data-driven weather models, enabling cheap post-hoc calibration of pretrained models with tens of millions of parameters and paving the way towards the next generation of well-calibrated data-driven weather models.
Author Information
Andre Graubner (Tsinghua University)
Kamyar Azizzadenesheli (Nvidia)

Kamyar is a Senior Research Scientist at Nvidia since Summer 2022. Prior to his role at Nvidia, he was an assistant professor at Purdue University, department of computer science, from Fall 2020 to Fall 2022. Prior to his faculty position, he was at the California Institute of Technology (Caltech) as a Postdoctoral Scholar in the Department of Computing + Mathematical Sciences. Before his postdoctoral position, he was appointed as a special student researcher at Caltech, working with ML and Control researchers at the CMS department and the Center for Autonomous Systems and Technologies. He is also a former visiting student researcher at Caltech. Kamyar Azizzadenesheli is a former visiting student researcher at Stanford University, and researcher at Simons Institute, UC. Berkeley. In addition, he is a former guest researcher at INRIA France (SequeL team), as well as a visitor at Microsoft Research Lab, New England, and New York. He received his Ph.D. at the University of California, Irvine.
Jaideep Pathak (NVIDIA Corporation)
Morteza Mardani (Nvidia)
Mike Pritchard (Nvidia)
Karthik Kashinath (NVIDIA)
Anima Anandkumar (NVIDIA/Caltech)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 : Calibration of Large Neural Weather Models »
Dates n/a. Room
More from the Same Authors
-
2022 : DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting »
Tao Ge · Jaideep Pathak · Akshay Subramaniam · Karthik Kashinath -
2022 : FourCastNet: A practical introduction to a state-of-the-art deep learning global weather emulator »
Jaideep Pathak · Shashank Subramanian · Peter Harrington · Thorsten Kurth · Andre Graubner · Morteza Mardani · David Hall · Karthik Kashinath · Anima Anandkumar -
2022 : Robust Trajectory Prediction against Adversarial Attacks »
Yulong Cao · Danfei Xu · Xinshuo Weng · Zhuoqing Morley Mao · Anima Anandkumar · Chaowei Xiao · Marco Pavone -
2022 : AdvDO: Realistic Adversarial Attacks for Trajectory Prediction »
Yulong Cao · Chaowei Xiao · Anima Anandkumar · Danfei Xu · Marco Pavone -
2022 : DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting »
Tao Ge · Jaideep Pathak · Akshay Subramaniam · Karthik Kashinath -
2021 Poster: Controllable and Compositional Generation with Latent-Space Energy-Based Models »
Weili Nie · Arash Vahdat · Anima Anandkumar -
2021 Poster: AugMax: Adversarial Composition of Random Augmentations for Robust Training »
Haotao Wang · Chaowei Xiao · Jean Kossaifi · Zhiding Yu · Anima Anandkumar · Zhangyang Wang -
2021 Poster: Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds »
Yujia Huang · Huan Zhang · Yuanyuan Shi · J. Zico Kolter · Anima Anandkumar -
2021 Poster: Coupled Segmentation and Edge Learning via Dynamic Graph Propagation »
Zhiding Yu · Rui Huang · Wonmin Byeon · Sifei Liu · Guilin Liu · Thomas Breuel · Anima Anandkumar · Jan Kautz -
2021 Poster: Long-Short Transformer: Efficient Transformers for Language and Vision »
Chen Zhu · Wei Ping · Chaowei Xiao · Mohammad Shoeybi · Tom Goldstein · Anima Anandkumar · Bryan Catanzaro -
2021 Poster: Adversarially Robust 3D Point Cloud Recognition Using Self-Supervisions »
Jiachen Sun · Yulong Cao · Christopher B Choy · Zhiding Yu · Anima Anandkumar · Zhuoqing Morley Mao · Chaowei Xiao -
2021 Poster: SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers »
Enze Xie · Wenhai Wang · Zhiding Yu · Anima Anandkumar · Jose M. Alvarez · Ping Luo