Timezone: »
The world is not static: This causes real-world time series to change over time because external, and potentially disruptive, events such as macroeconomic cycles or the COVID-19 pandemic change the underlying factors that influence the time series. Once such a data distribution shift happens, it will be part of the time series history and impact future forecasting attempts. We present an adaptive sampling strategy that selects the part of the history that is relevant for the recent data distribution. We achieve this by learning a discrete distribution over relevant time steps by Bayesian optimization. We instantiate this idea with a two-step, model-agnostic method that is pre-trained with uniform sampling and then training a lightweight adaptive architecture with adaptive sampling. We show with synthetic and real-world experiments that this method adapts to distribution shift and reduces the forecasting error of the base model by 8.4%.
Author Information
Luca Masserano (Carnegie Mellon University)

I am a PhD student in the Department of Statistics at Carnegie Mellon University, where I work on Likelihood-Free Inference and Learning under Distribution Shift. I am advised by Ann B. Lee.
Syama Sundar Rangapuram (Amazon Research)
Shubham Kapoor (Amazon)
Rajbir Nirwan (Amazon Development Center Germany)
Youngsuk Park (Amazon, AWS AI Labs)
Michael Bohlke-Schneider (Amazon Development Center Germany)
More from the Same Authors
-
2022 : Likelihood-Free Frequentist Inference for Calorimetric Muon Energy Measurement in High-Energy Physics »
Luca Masserano · Ann Lee · Rafael Izbicki · Mikael Kuusela · tommaso dorigo -
2022 : First De-Trend then Attend: Rethinking Attention for Time-Series Forecasting »
Xiyuan Zhang · Xiaoyong Jin · Karthick Gopalswamy · Gaurav Gupta · Youngsuk Park · Xingjian Shi · Hao Wang · Danielle Maddix · Yuyang (Bernie) Wang -
2022 : Towards Reverse Causal Inference on Panel Data: Precise Formulation and Challenges »
Jiayao Zhang · Youngsuk Park · Danielle Maddix · Dan Roth · Yuyang (Bernie) Wang -
2022 : But Are You Sure? Quantifying Uncertainty in Model Explanations »
Charles Marx · Youngsuk Park · Hilaf Hasson · Yuyang (Bernie) Wang · Stefano Ermon · Chaitanya Baru -
2021 Poster: Neural Flows: Efficient Alternative to Neural ODEs »
Marin Biloš · Johanna Sommer · Syama Sundar Rangapuram · Tim Januschowski · Stephan Günnemann -
2020 Poster: Deep Rao-Blackwellised Particle Filters for Time Series Forecasting »
Richard Kurle · Syama Sundar Rangapuram · Emmanuel de Bézenac · Stephan Günnemann · Jan Gasthaus -
2020 Poster: Normalizing Kalman Filters for Multivariate Time Series Analysis »
Emmanuel de Bézenac · Syama Sundar Rangapuram · Konstantinos Benidis · Michael Bohlke-Schneider · Richard Kurle · Lorenzo Stella · Hilaf Hasson · Patrick Gallinari · Tim Januschowski -
2018 Poster: Deep State Space Models for Time Series Forecasting »
Syama Sundar Rangapuram · Matthias W Seeger · Jan Gasthaus · Lorenzo Stella · Bernie Wang · Tim Januschowski