Timezone: »
Machine learning has become increasingly popular for efficiently modelling the dynamics of complex physical systems, demonstrating a capability to learn effective models for dynamics which ignore redundant degrees of freedom. Learned simulators typically predict the evolution of the system in a step-by-step manner with numerical integration techniques. However, such models often suffer from instability over long roll-outs due to the accumulation of both estimation and integration error at each prediction step. Here, we propose an alternative construction for learned physical simulators that are inspired by the concept of action-angle coordinates from classical mechanics for describing integrable systems. We propose Action-Angle Networks, which learn a nonlinear transformation from input coordinates to the action-angle space, where evolution of the system is linear. Unlike traditional learned simulators, Action-Angle Networks do not employ any higher-order numerical integration methods, making them extremely efficient at modelling the dynamics of integrable physical systems.
Author Information
Ameya Daigavane (Massachusetts Institute of Technology)
Arthur Kosmala (Ludwig-Maximilians-Universität München)
Miles Cranmer (Princeton University)
Miles Cranmer is an Astro PhD candidate trying to accelerate astrophysics with AI. Miles is from Canada and did his undergraduate in Physics at McGill. He is deeply interested in the automation of science, particularly aspects that are not yet tractable with existing machine learning, such as experiment planning, simulation, and theory. He works on symbolic regression, graph neural networks, normalizing flows, and learned simulation. He is hugely interested in symbolic ML, since, as he argues, symbolic models seem to be a surprisingly efficient basis for describing our universe.
Tess Smidt (Massachusetts Institute of Technology)
Shirley Ho (Flatiron Institute)
Shirley Ho is a group leader and acting director at Flatiron Institute at Simons foundation, a research professor of physics and an affiliated faculty at Center for Data Science at NYU. Ho also holds associate (adjunct) professorship at Carnegie Mellon University and visiting appointment at Princeton University. She was a senior scientist at Berkeley National Lab from 2016-2018 and a Cooper-Siegel Development chair professor at Carnegie Mellon University before that. Ho was a Seaborg and Chamberlain Fellow from 2008-2011 at Berkeley Lab, after receiving her PhD in Astrophysics from Princeton University in 2008 under supervision of David Spergel. Ho graduated summa cum laude with a B.A. in Physics and a B.A. in Computer Science from UC Berkeley. A cited expert in cosmology, machine learning applications in astrophysics and data science,her interests are using deep learning accelerated simulations to understand the Universe, and other astrophysical phenomena. She tries her best to balance her love for the Universe, the machine and life especially during these crazy times.
More from the Same Authors
-
2021 : Searching for the Weirdest Stars: A Convolutional Autoencoder-Based Pipeline For Detecting Anomalous Periodic Variable Stars »
Ho-Sang Chan · Siu Hei Cheung · Victoria Villar · Shirley Ho -
2021 : A Convolutional Autoencoder-Based Pipeline For Anomaly Detection And Classification Of Periodic Variables »
Ho-Sang Chan · Siu Hei Cheung · Shirley Ho -
2021 : Equivariant and Modular DeepSets with Applications in Cluster Cosmology »
Leander Thiele · Miles Cranmer · Shirley Ho · David Spergel -
2021 : Searching for the Weirdest Stars: A Convolutional Autoencoder-Based Pipeline For Detecting Anomalous Periodic Variable Stars »
Ho-Sang Chan · Siu Hei Cheung · Victoria Villar · Shirley Ho -
2022 : A Neural Network Subgrid Model of the Early Stages of Planet Formation »
Thomas Pfeil · Miles Cranmer · Shirley Ho · Philip Armitage · Tilman Birnstiel · Hubert Klahr -
2022 : Recovering Galaxy Cluster Convergence from Lensed CMB with Generative Adversarial Networks »
Liam Parker · Dongwon Han · Shirley Ho · Pablo Lemos -
2022 : Astronomical Image Coaddition with Bundle-Adjusting Radiance Fields »
Harlan Hutton · Harshitha Palegar · Shirley Ho · Miles Cranmer · Peter Melchior · Jenna Eubank -
2022 : Emulating cosmological growth functions with B-Splines »
Ngai Pok Kwan · Chirag Modi · Yin Li · Shirley Ho -
2022 : Adversarial Noise Injection for Learned Turbulence Simulations »
Jingtong Su · Julia Kempe · Drummond Fielding · Nikolaos Tsilivis · Miles Cranmer · Shirley Ho -
2023 Workshop: AI for Science: from Theory to Practice »
Yuanqi Du · Max Welling · Yoshua Bengio · Marinka Zitnik · Carla Gomes · Jure Leskovec · Maria Brbic · Wenhao Gao · Kexin Huang · Ziming Liu · Rocío Mercado · Miles Cranmer · Shengchao Liu · Lijing Wang -
2021 : AI X Cosmology »
Shirley Ho -
2021 : Coding Session 3 »
Shirley Ho · Miles Cranmer -
2021 : The Problem with Deep Learning for Physics (and how to fix it) »
Miles Cranmer · Shirley Ho -
2021 : Accelerating Simulations in Physics with Deep Learning »
Miles Cranmer · Shirley Ho -
2021 : Coding Session »
Shirley Ho · Miles Cranmer -
2021 : Physics-Informed Inductive Biases in Deep Learning »
Miles Cranmer · Shirley Ho -
2021 Tutorial: ML for Physics and Physics for ML »
Shirley Ho · Miles Cranmer -
2021 : The Intersection of ML and Physics »
Shirley Ho · Miles Cranmer -
2020 Workshop: Interpretable Inductive Biases and Physically Structured Learning »
Michael Lutter · Alexander Terenin · Shirley Ho · Lei Wang -
2020 : Contributed talk - Unsupervised Resource Allocation with Graph Neural Networks »
Miles Cranmer -
2020 Workshop: Machine Learning and the Physical Sciences »
Anima Anandkumar · Kyle Cranmer · Shirley Ho · Mr. Prabhat · Lenka Zdeborová · Atilim Gunes Baydin · Juan Carrasquilla · Adji Bousso Dieng · Karthik Kashinath · Gilles Louppe · Brian Nord · Michela Paganini · Savannah Thais -
2020 Poster: Discovering Symbolic Models from Deep Learning with Inductive Biases »
Miles Cranmer · Alvaro Sanchez Gonzalez · Peter Battaglia · Rui Xu · Kyle Cranmer · David Spergel · Shirley Ho -
2019 : Learning Symbolic Physics with Graph Networks »
Miles Cranmer -
2019 : Morning Coffee Break & Poster Session »
Eric Metodiev · Keming Zhang · Markus Stoye · Randy Churchill · Soumalya Sarkar · Miles Cranmer · Johann Brehmer · Danilo Jimenez Rezende · Peter Harrington · AkshatKumar Nigam · Nils Thuerey · Lukasz Maziarka · Alvaro Sanchez Gonzalez · Atakan Okan · James Ritchie · N. Benjamin Erichson · Harvey Cheng · Peihong Jiang · Seong Ho Pahng · Samson Koelle · Sami Khairy · Adrian Pol · Rushil Anirudh · Jannis Born · Benjamin Sanchez-Lengeling · Brian Timar · Rhys Goodall · Tamás Kriváchy · Lu Lu · Thomas Adler · Nathaniel Trask · Noëlie Cherrier · Tomohiko Konno · Muhammad Kasim · Tobias Golling · Zaccary Alperstein · Andrei Ustyuzhanin · James Stokes · Anna Golubeva · Ian Char · Ksenia Korovina · Youngwoo Cho · Chanchal Chatterjee · Tom Westerhout · Gorka Muñoz-Gil · Juan Zamudio-Fernandez · Jennifer Wei · Brian Lee · Johannes Kofler · Bruce Power · Nikita Kazeev · Andrey Ustyuzhanin · Artem Maevskiy · Pascal Friederich · Arash Tavakoli · Willie Neiswanger · Bohdan Kulchytskyy · sindhu hari · Paul Leu · Paul Atzberger -
2019 : Opening Remarks »
Atilim Gunes Baydin · Juan Carrasquilla · Shirley Ho · Karthik Kashinath · Michela Paganini · Savannah Thais · Anima Anandkumar · Kyle Cranmer · Roger Melko · Mr. Prabhat · Frank Wood -
2019 Workshop: Machine Learning and the Physical Sciences »
Atilim Gunes Baydin · Juan Carrasquilla · Shirley Ho · Karthik Kashinath · Michela Paganini · Savannah Thais · Anima Anandkumar · Kyle Cranmer · Roger Melko · Mr. Prabhat · Frank Wood -
2018 : Invited Talk Session 2 »
Debora Marks · Olexandr Isayev · Tess Smidt · Nathaniel Thomas