Timezone: »

 
On Second Order Behaviour in Augmented Neural ODEs: A Short Summary
Alexander Norcliffe · Cristian Bodnar · Ben Day · Nikola Simidjievski · Pietro Lió

Tue Dec 14 06:45 AM -- 07:30 AM (PST) @
in The Symbiosis of Deep Learning and Differential Equations »
Event URL: https://openreview.net/forum?id=XpmaGtI04ki »

In Norcliffe et al.[13], we discussed and systematically analysed how Neural ODEs (NODEs) can learn higher-order order dynamics. In particular, we focused on second-order dynamic behaviour and analysed Augmented NODEs (ANODEs), showing that they can learn second-order dynamics with only a few augmented dimensions, but are unable to correctly model the velocity (first derivative). In response, we proposed Second Order NODEs (SONODEs), that build on top of ANODEs, but explicitly take into account the second-order physics-based inductive biases. These biases, besides making them more efficient and noise-robust when modelling second-order dynamics, make them more interpretable than ANODEs, therefore more suitable in many real-world scientific modelling applications.

Author Information

Alexander Norcliffe (University of Cambridge)

I'm a PhD student in Machine Learning for Medicine. I am co-supervised by Mihaela Van der Schaar and Pietro Lio in the Cambridge Centre for AI in Medicine.

Cristian Bodnar (University of Cambridge)
Ben Day (University of Cambridge)
Nikola Simidjievski (University of Cambridge)
Pietro Lió (University of Cambridge)

More from the Same Authors