Timezone: »

Surrogates for Stiff Nonlinear Systems using Continuous Time Echo State Networks
Ranjan Anantharaman · Christopher Rackauckas · Viral Shah

Modern design, control, and optimization often requires simulation of highly nonlinear models, leading to prohibitive computational costs. These costs can be amortized by evaluating a cheap surrogate of the full model. Here we present a general data-driven method, the continuous-time echo state network (CTESN), for generating surrogates of nonlinear ordinary differential equations with dynamics at widely separated timescales. We empirically demonstrate near-constant time performance using our CTESNs on a physically motivated scalable model of a heating system whose full execution time increases exponentially, while maintaining relative error of within 0.2 \%. We also show that our model captures fast transients as well as slow dynamics effectively, while other techniques such as physics informed neural networks have difficulties trying to train and predict the highly nonlinear behavior of these models.

Author Information

Ranjan Anantharaman (MIT)
Christopher Rackauckas (Massachusetts Institute of Technology)

I am a mathematician and pharmacologist at MIT and the University of Maryland, School of Pharmacy. My programming language of choice is Julia. I run a [blog on Julia, mathematics, and stochastic biology](http://www.stochasticlifestyle.com/) and I have developed a few libraries in Julia, including (but not limited to) [DifferentialEquations.jl](https://github.com/JuliaDiffEq/DifferentialEquations.jl) and [Pumas](https://pumas.ai/). For more information, please check out my [Github profile](https://github.com/ChrisRackauckas) or my [personal website](http://chrisrackauckas.com/).

Viral Shah (Julia Computing, Inc.)

More from the Same Authors

  • 2021 : AbstractDifferentiation.jl: Backend-Agnostic Differentiable Programming in Julia »
    Frank Schäfer · Mohamed Tarek · Lyndon White · Christopher Rackauckas
  • 2018 : Posters (all accepted papers) + Break »
    Jianyu Wang · Denis Gudovskiy · Ziheng Jiang · Michael Kaufmann · Andreea Anghel · James Bradbury · Nikolas Ioannou · Nitin Agrawal · Emma Tosch · Gyeongin Yu · Keno Fischer · Jarrett Revels · Giuseppe Siracusano · Yaoqing Yang · Jeff Johnson · Yang You · Hector Yuen · Chris Ying · Honglei Liu · Nikoli Dryden · Xiangxi Mo · Yangzihao Wang · Amit Juneja · Micah Smith · Qian Yu · pramod gupta · Deepak Narayanan · Keshav Santhanam · Tim Capes · Abdul Dakkak · Norman Mu · Ke Deng · Liam Li · Joao Carreira · Luis Remis · Deepti Raghavan · Una-May O'Reilly · Amanpreet Singh · Mahmoud (Mido) Assran · Eugene Wu · Eytan Bakshy · Jinliang Wei · Michael Innes · Viral Shah · Haibin Lin · Conrad Sanderson · Ryan Curtin · Marcus Edel