Workshop: Differential Geometry meets Deep Learning (DiffGeo4DL)
Joey Bose, Emile Mathieu, Charline Le Lan, Ines Chami, Fred Sala, Christopher De Sa, Maximillian Nickel, Chris Ré, Will Hamilton
Fri, Dec 11th, 2020 @ 13:45 – 22:00 GMT
Abstract: Recent years have seen a surge in research at the intersection of differential geometry and deep learning, including techniques for stochastic optimization on curved spaces (e.g., hyperbolic or spherical manifolds), learning embeddings for non-Euclidean data, and generative modeling on Riemannian manifolds. Insights from differential geometry have led to new state of the art approaches to modeling complex real world data, such as graphs with hierarchical structure, 3D medical data, and meshes.
Thus, it is of critical importance to understand, from a geometric lens, the natural invariances, equivariances, and symmetries that reside within data.
In order to support the burgeoning interest of differential geometry in deep learning, the primary goal for this workshop is to facilitate community building and to work towards the identification of key challenges in comparison with regular deep learning, along with techniques to overcome these challenges. With many new researchers beginning projects in this area, we hope to bring them together to consolidate this fast-growing area into a healthy and vibrant subfield. In particular, we aim to strongly promote novel and exciting applications of differential geometry for deep learning with an emphasis on bridging theory to practice which is reflected in our choices of invited speakers, which include both machine learning practitioners and researchers who are primarily geometers.
Thus, it is of critical importance to understand, from a geometric lens, the natural invariances, equivariances, and symmetries that reside within data.
In order to support the burgeoning interest of differential geometry in deep learning, the primary goal for this workshop is to facilitate community building and to work towards the identification of key challenges in comparison with regular deep learning, along with techniques to overcome these challenges. With many new researchers beginning projects in this area, we hope to bring them together to consolidate this fast-growing area into a healthy and vibrant subfield. In particular, we aim to strongly promote novel and exciting applications of differential geometry for deep learning with an emphasis on bridging theory to practice which is reflected in our choices of invited speakers, which include both machine learning practitioners and researchers who are primarily geometers.
Chat
To ask questions please use rocketchat, available only upon registration and login.
Schedule
13:00 – 23:00 GMT
gather.town
13:45 – 14:00 GMT
Opening Remarks
Joey Bose
14:00 – 14:30 GMT
Invited Talk 1: Geometric deep learning for 3D human body synthesis
Michael Bronstein
14:30 – 15:00 GMT
Invited Talk 2: Gauge Theory in Geometric Deep Learning
Taco Cohen
15:00 – 15:05 GMT
Contributed Talk 1: Learning Hyperbolic Representations for Unsupervised 3D Segmentation
Joy Hsu, Jeffrey Gu, Serena Yeung
15:06 – 15:11 GMT
Contributed Talk 2: Witness Autoencoder: Shaping the Latent Space with Witness Complexes
Anastasiia Varava, Danica Kragic, Simon Schönenberger, Vladislav Polianskii , Jen Jen Chung, Vladislav Polianskii
15:12 – 15:17 GMT
Contributed Talk 3: A Riemannian gradient flow perspective on learning deep linear neural networks
Ulrich Terstiege, Holger Rauhut, Bubacarr Bah, Michael Westdickenberg
15:18 – 15:23 GMT
Contributed Talk 4: Directional Graph Networks
Dominique Beaini, Saro Passaro, Vincent Létourneau, Will Hamilton, Gabriele Corso, Pietro Liò
15:24 – 15:29 GMT
Contributed Talk 5: A New Neural Network Architecture Invariant to the Action of Symmetry Subgroups
Mete Ozay, Piotr Kicki, Piotr Skrzypczynski
15:30 – 16:00 GMT
Virtual Coffee Break on Gather.Town
16:00 – 16:30 GMT
Invited Talk 3: Reparametrization invariance in representation learning
Søren Hauberg
16:30 – 17:30 GMT
Graph of Thrones : Adversarial Perturbations dismantle Aristocracy in Graphs
Adarsh Jamadandi, Uma Mudenagudi
16:30 – 17:30 GMT
Hermitian Symmetric Spaces for Graph Embeddings
Federico Lopez, Beatrice Pozzetti, Steve Trettel, Anna Wienhard
16:30 – 17:30 GMT
Quaternion Graph Neural Networks
Dai Quoc Nguyen, Tu Dinh Nguyen, Dinh Phung
16:30 – 17:30 GMT
Grassmann Iterative Linear Discriminant Analysis with Proxy Matrix Optimization
Navya Nagananda, Breton Minnehan, Andreas Savakis
16:30 – 17:30 GMT
A Metric for Linear Symmetry-Based Disentanglement
Luis Armando Pérez Rey, Loek Tonnaer, Vlado Menkovski, Mike Holenderski, Jim Portegies
16:30 – 17:30 GMT
Poster Session 1 on Gather.Town
Joey Bose, Ines Chami
16:30 – 17:30 GMT
Tree Covers: An Alternative to Metric Embeddings
Roshni Sahoo, Ines Chami, Christopher Ré
16:30 – 17:30 GMT
Deep Networks and the Multiple Manifold Problem
Sam Buchanan, Dar Gilboa, John Wright
16:30 – 17:30 GMT
Isometric Gaussian Process Latent Variable Model
Martin Jørgensen, Søren Hauberg
16:30 – 17:30 GMT
Universal Approximation Property of Neural Ordinary Differential Equations
Takeshi Teshima, Koichi Tojo, Masahiro Ikeda, Isao Ishikawa, Kenta Oono
16:30 – 17:30 GMT
GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiability
Arinbjörn Kolbeinsson, Nicholas Jennings, Marc Deisenroth, Daniel Lengyel, Janith Petangoda, Michalis Lazarou, Kate Highnam, John Falk
17:30 – 18:15 GMT
Panel Discussion
Joey Bose, Emile Mathieu, Charline Le Lan, Ines Chami
18:15 – 18:45 GMT
Virtual Coffee Break on Gather.Town
18:45 – 19:30 GMT
Focused Breakout Session
Ines Chami, Joey Bose
19:30 – 20:00 GMT
Invited Talk 4: An introduction to the Calderon and Steklov inverse problems on Riemannian manifolds with boundary
Niky Kamran
20:00 – 21:00 GMT
Poster Session 2 on Gather.Town
Charline Le Lan, Emile Mathieu
20:00 – 21:00 GMT
Towards Geometric Understanding of Low-Rank Approximation
Mahito Sugiyama, Kazu Ghalamkari
20:00 – 21:00 GMT
The Intrinsic Dimension of Images and Its Impact on Learning
Chen Zhu, Micah Goldblum, Ahmed Abdelkader, Tom Goldstein, Phillip Pope
20:00 – 21:00 GMT
Extendable and invertible manifold learning with geometry regularized autoencoders
Andres F Duque, Sacha Morin, Guy Wolf, Kevin Moon
20:00 – 21:00 GMT
Convex Optimization for Blind Source Separation on a Statistical Manifold
Simon Luo, lamiae azizi, Mahito Sugiyama
20:00 – 21:00 GMT
Sparsifying networks by traversing Geodesics
Guruprasad Raghavan, Matt Thomson
20:00 – 21:00 GMT
QuatRE: Relation-Aware Quaternions for Knowledge Graph Embeddings
Dai Quoc Nguyen, Dinh Phung
20:00 – 21:00 GMT
Leveraging Smooth Manifolds for Lexical Semantic Change Detection across Corpora
Anmol Goel, Ponnurangam Kumaraguru
20:00 – 21:00 GMT
Unsupervised Orientation Learning Using Autoencoders
Rembert Daems, Francis Wyffels
20:00 – 21:00 GMT
Deep Riemannian Manifold Learning
Aaron Lou, Maximillian Nickel, Brandon Amos
20:00 – 21:00 GMT
Affinity guided Geometric Semi-Supervised Metric Learning
Ujjal Dutta, Mehrtash Harandi, C Chandra Shekhar
21:00 – 21:30 GMT
Invited Talk 5: Disentangling Orientation and Camera Parameters from Cryo-Electron Microscopy Images Using Differential Geometry and Variational Autoencoders
Nina Miolane
21:30 – 22:00 GMT
Invited Talk 6: Learning a robust classifier in hyperbolic space
Melanie Weber