Timezone: »
Neural fields have emerged as a new paradigm for representing signals, thanks to their ability to do it compactly while being easy to optimize. In most applications, however, neural fields are treated like a black box, which precludes many signal manipulation tasks. In this paper, we propose a new class of neural fields called basis-encoded polynomial neural fields (PNFs). The key advantage of a PNF is that it can represent a signal as a composition of a number of manipulable and interpretable components without losing the merits of neural fields representation. We develop a general theoretical framework to analyze and design PNFs. We use this framework to design Fourier PNFs, which match state-of-the-art performance in signal representation tasks that use neural fields. In addition, we empirically demonstrate that Fourier PNFs enable signal manipulation applications such as texture transfer and scale-space interpolation. Code is available at https://github.com/stevenygd/PNF.
Author Information
Guandao Yang (Cornell University)
Sagie Benaim (Tel Aviv University)
Varun Jampani (Google Research)
Kyle Genova (Google)
Jonathan Barron (Google Research)
Thomas Funkhouser (Princeton University)
Bharath Hariharan (Cornell University)
Serge Belongie (University of Copenhagen)
Professor, DIKU Director, Pioneer Centre for AI
More from the Same Authors
-
2021 Spotlight: ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction »
Gengshan Yang · Deqing Sun · Varun Jampani · Daniel Vlasic · Forrester Cole · Ce Liu · Deva Ramanan -
2022 Poster: LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery »
Chun-Han Yao · Wei-Chih Hung · Yuanzhen Li · Michael Rubinstein · Ming-Hsuan Yang · Varun Jampani -
2022 Poster: Unsupervised Adaptation from Repeated Traversals for Autonomous Driving »
Yurong You · Cheng Perng Phoo · Katie Luo · Travis Zhang · Wei-Lun Chao · Bharath Hariharan · Mark Campbell · Kilian Weinberger -
2022 Poster: SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections »
Mark Boss · Andreas Engelhardt · Abhishek Kar · Yuanzhen Li · Deqing Sun · Jonathan Barron · Hendrik PA Lensch · Varun Jampani -
2022 Poster: Subsidiary Prototype Alignment for Universal Domain Adaptation »
Jogendra Nath Kundu · Suvaansh Bhambri · Akshay R Kulkarni · Hiran Sarkar · Varun Jampani · Venkatesh Babu R -
2022 Poster: Change Event Dataset for Discovery from Spatio-temporal Remote Sensing Imagery »
Utkarsh Mall · Bharath Hariharan · Kavita Bala -
2022 Poster: Implicit Neural Representations with Levels-of-Experts »
Zekun Hao · Arun Mallya · Serge Belongie · Ming-Yu Liu -
2021 Poster: Geometry Processing with Neural Fields »
Guandao Yang · Serge Belongie · Bharath Hariharan · Vladlen Koltun -
2021 Poster: Robust Visual Reasoning via Language Guided Neural Module Networks »
Arjun Akula · Varun Jampani · Soravit Changpinyo · Song-Chun Zhu -
2021 Poster: Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition »
Mark Boss · Varun Jampani · Raphael Braun · Ce Liu · Jonathan Barron · Hendrik PA Lensch -
2021 Poster: ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction »
Gengshan Yang · Deqing Sun · Varun Jampani · Daniel Vlasic · Forrester Cole · Ce Liu · Deva Ramanan -
2021 Poster: Non-local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation »
Jogendra Nath Kundu · Siddharth Seth · Anirudh Jamkhandi · Pradyumna YM · Varun Jampani · Anirban Chakraborty · Venkatesh Babu R -
2021 Poster: Aligning Silhouette Topology for Self-Adaptive 3D Human Pose Recovery »
Ramesha Rakesh Mugaludi · Jogendra Nath Kundu · Varun Jampani · Venkatesh Babu R -
2020 Poster: Hierarchical Patch VAE-GAN: Generating Diverse Videos from a Single Sample »
Shir Gur · Sagie Benaim · Lior Wolf -
2020 Poster: Generative View Synthesis: From Single-view Semantics to Novel-view Images »
Tewodros Amberbir Habtegebrial · Varun Jampani · Orazio Gallo · Didier Stricker -
2018 Poster: One-Shot Unsupervised Cross Domain Translation »
Sagie Benaim · Lior Wolf -
2017 Poster: One-Sided Unsupervised Domain Mapping »
Sagie Benaim · Lior Wolf -
2017 Spotlight: One-Sided Unsupervised Domain Mapping »
Sagie Benaim · Lior Wolf