Timezone: »
We present ShapeFlow, a flow-based model for learning a deformation space for entire classes of 3D shapes with large intra-class variations. ShapeFlow allows learning a multi-template deformation space that is agnostic to shape topology, yet preserves fine geometric details. Different from a generative space where a latent vector is directly decoded into a shape, a deformation space decodes a vector into a continuous flow that can advect a source shape towards a target. Such a space naturally allows the disentanglement of geometric style (coming from the source) and structural pose (conforming to the target). We parametrize the deformation between geometries as a learned continuous flow field via a neural network and show that such deformations can be guaranteed to have desirable properties, such as bijectivity, freedom from self-intersections, or volume preservation. We illustrate the effectiveness of this learned deformation space for various downstream applications, including shape generation via deformation, geometric style transfer, unsupervised learning of a consistent parameterization for entire classes of shapes, and shape interpolation.
Author Information
Chiyu Jiang (Cruise)
Jingwei Huang (Stanford University)
Andrea Tagliasacchi (Google Research, Brain)
Leonidas Guibas (stanford.edu)
Related Events (a corresponding poster, oral, or spotlight)
-
2020 Spotlight: ShapeFlow: Learnable Deformation Flows Among 3D Shapes »
Thu. Dec 10th 03:50 -- 04:00 AM Room Orals & Spotlights: Vision Applications
More from the Same Authors
-
2022 Poster: D^2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video »
Tianhao Wu · Fangcheng Zhong · Andrea Tagliasacchi · Forrester Cole · Cengiz Oztireli -
2022 : Breaking the Symmetry: Resolving Symmetry Ambiguities in Equivariant Neural Networks »
Sidhika Balachandar · Adrien Poulenard · Congyue Deng · Leonidas Guibas -
2023 Poster: Unsupervised Semantic Correspondence Using Stable Diffusion »
Eric Hedlin · Gopal Sharma · Shweta Mahajan · Hossam Isack · Abhishek Kar · Andrea Tagliasacchi · Kwang Moo Yi -
2023 Poster: Neural Fields with Hard Constraints of Arbitrary Differential Order »
Fangcheng Zhong · Kyle Fogarty · Param Hanji · Tianhao Wu · Alejandro Sztrajman · Andrew Spielberg · Andrea Tagliasacchi · Petra Bosilj · Cengiz Oztireli -
2023 Poster: NeRF Revisited: Fixing Quadrature Instability in Volume Rendering »
Mikaela Angelina Uy · Guandao Yang · Kiyohiro Nakayama · Leonidas Guibas · Ke Li -
2023 Poster: NAP: Neural 3D Articulation Prior »
Jiahui Lei · Congyue Deng · William B Shen · Leonidas Guibas · Kostas Daniilidis -
2023 Poster: Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariance »
Congyue Deng · Jiahui Lei · William B Shen · Kostas Daniilidis · Leonidas Guibas -
2022 Poster: NeuForm: Adaptive Overfitting for Neural Shape Editing »
Connor Lin · Niloy Mitra · Gordon Wetzstein · Leonidas Guibas · Paul Guerrero -
2022 Poster: Object Scene Representation Transformer »
Mehdi S. M. Sajjadi · Daniel Duckworth · Aravindh Mahendran · Sjoerd van Steenkiste · Filip Pavetic · Mario Lucic · Leonidas Guibas · Klaus Greff · Thomas Kipf -
2021 Oral: Shape As Points: A Differentiable Poisson Solver »
Songyou Peng · Chiyu Jiang · Yiyi Liao · Michael Niemeyer · Marc Pollefeys · Andreas Geiger -
2021 Poster: Canonical Capsules: Self-Supervised Capsules in Canonical Pose »
Weiwei Sun · Andrea Tagliasacchi · Boyang Deng · Sara Sabour · Soroosh Yazdani · Geoffrey Hinton · Kwang Moo Yi -
2021 Poster: Shape As Points: A Differentiable Poisson Solver »
Songyou Peng · Chiyu Jiang · Yiyi Liao · Michael Niemeyer · Marc Pollefeys · Andreas Geiger -
2021 Poster: Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks »
Tolga Birdal · Aaron Lou · Leonidas Guibas · Umut Simsekli -
2021 Poster: Leveraging SE(3) Equivariance for Self-supervised Category-Level Object Pose Estimation from Point Clouds »
Xiaolong Li · Yijia Weng · Li Yi · Leonidas Guibas · A. Abbott · Shuran Song · He Wang -
2021 Poster: SketchGen: Generating Constrained CAD Sketches »
Wamiq Para · Shariq Bhat · Paul Guerrero · Tom Kelly · Niloy Mitra · Leonidas Guibas · Peter Wonka -
2020 : QA: Leonidas J. Guibas »
Leonidas Guibas -
2020 : Invited Talk: Leonidas J. Guibas »
Leonidas Guibas -
2020 : Andrea Tagliasacchi »
Andrea Tagliasacchi -
2020 Poster: Generative 3D Part Assembly via Dynamic Graph Learning »
jialei huang · Guanqi Zhan · Qingnan Fan · Kaichun Mo · Lin Shao · Baoquan Chen · Leonidas Guibas · Hao Dong -
2020 Poster: CaSPR: Learning Canonical Spatiotemporal Point Cloud Representations »
Davis Rempe · Tolga Birdal · Yongheng Zhao · Zan Gojcic · Srinath Sridhar · Leonidas Guibas -
2020 Spotlight: CaSPR: Learning Canonical Spatiotemporal Point Cloud Representations »
Davis Rempe · Tolga Birdal · Yongheng Zhao · Zan Gojcic · Srinath Sridhar · Leonidas Guibas -
2020 Poster: CoSE: Compositional Stroke Embeddings »
Emre Aksan · Thomas Deselaers · Andrea Tagliasacchi · Otmar Hilliges -
2020 Poster: PIE-NET: Parametric Inference of Point Cloud Edges »
Xiaogang Wang · Yuelang Xu · Kai Xu · Andrea Tagliasacchi · Bin Zhou · Ali Mahdavi-Amiri · Hao Zhang -
2019 Poster: NeurVPS: Neural Vanishing Point Scanning via Conic Convolution »
Yichao Zhou · Haozhi Qi · Jingwei Huang · Yi Ma -
2019 Poster: Multiview Aggregation for Learning Category-Specific Shape Reconstruction »
Srinath Sridhar · Davis Rempe · Julien Valentin · Bouaziz Sofien · Leonidas Guibas -
2019 Poster: A Condition Number for Joint Optimization of Cycle-Consistent Networks »
Leonidas Guibas · Qixing Huang · Zhenxiao Liang -
2019 Spotlight: A Condition Number for Joint Optimization of Cycle-Consistent Networks »
Leonidas Guibas · Qixing Huang · Zhenxiao Liang -
2018 Poster: Deep Functional Dictionaries: Learning Consistent Semantic Structures on 3D Models from Functions »
Minhyuk Sung · Hao Su · Ronald Yu · Leonidas Guibas -
2017 Poster: PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space »
Charles Ruizhongtai Qi · Li Yi · Hao Su · Leonidas Guibas -
2016 Poster: FPNN: Field Probing Neural Networks for 3D Data »
Yangyan Li · Soeren Pirk · Hao Su · Charles R Qi · Leonidas Guibas -
2015 Poster: Deep Knowledge Tracing »
Chris Piech · Jonathan Bassen · Jonathan Huang · Surya Ganguli · Mehran Sahami · Leonidas Guibas · Jascha Sohl-Dickstein -
2013 Poster: Wavelets on Graphs via Deep Learning »
Raif Rustamov · Leonidas Guibas -
2013 Demonstration: Codewebs: a Pedagogical Search Engine for Code Submissions to a MOOC »
Jonathan Huang · Chris Piech · Andy Nguyen · Leonidas Guibas -
2007 Oral: Efficient Inference forDistributions on Permutations »
Jonathan Huang · Carlos Guestrin · Leonidas Guibas -
2007 Poster: Efficient Inference forDistributions on Permutations »
Jonathan Huang · Carlos Guestrin · Leonidas Guibas