Timezone: »
A range of applications require learning image generation models whose latent space effectively captures the high-level factors of variation in the data distribution, which can be judged by its ability to interpolate between images smoothly. However, most generative models mapping a fixed prior to the generated images lead to interpolation trajectories lacking smoothness and images of reduced quality. We propose a novel generative model that learns a flexible non-parametric prior over interpolation trajectories, conditioned on a pair of source and target images. Instead of relying on deterministic interpolation methods like linear or spherical interpolation in latent space, we devise a framework that learns a distribution of trajectories between two given images using Latent Second-Order Neural Ordinary Differential Equations. Through a hybrid combination of reconstruction and adversarial losses, the generator is trained to map the sampled points from these trajectories to sequences of realistic images of improved quality that smoothly transition from the source to the target image.
Author Information
Avinandan Bose (IIT Kanpur)
Aniket Das (Indian Institute of Technology Kanpur)
Yatin Dandi (Swiss Federal Institute of Technology Lausanne)
Piyush Rai (IIT Kanpur)
More from the Same Authors
-
2021 : VAEs meet Diffusion Models: Efficient and High-Fidelity Generation »
Kushagra Pandey · Avideep Mukherjee · Piyush Rai · Abhishek Kumar -
2022 : Data-heterogeneity-aware Mixing for Decentralized Learning »
Yatin Dandi · Anastasiia Koloskova · Martin Jaggi · Sebastian Stich -
2022 : CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks »
Sakshi Varshney · Vinay Verma · Srijith PK · Piyush Rai · Lawrence Carin -
2023 Poster: Universality laws for Gaussian mixtures in generalized linear models »
Yatin Dandi · Ludovic Stephan · Florent Krzakala · Bruno Loureiro · Lenka Zdeborová -
2023 Poster: Provably Fast Finite Particle Variants of SVGD via Virtual Particle Stochastic Approximation »
Dheeraj Nagaraj · Aniket Das -
2022 Poster: Sampling without Replacement Leads to Faster Rates in Finite-Sum Minimax Optimization »
Aniket Das · Bernhard Schölkopf · Michael Muehlebach -
2021 : VAEs meet Diffusion Models: Efficient and High-Fidelity Generation »
Kushagra Pandey · Avideep Mukherjee · Piyush Rai · Abhishek Kumar -
2021 Poster: CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks »
Sakshi Varshney · Vinay Kumar Verma · P. K. Srijith · Lawrence Carin · Piyush Rai -
2020 Poster: Calibrating CNNs for Lifelong Learning »
Pravendra Singh · Vinay Kumar Verma · Pratik Mazumder · Lawrence Carin · Piyush Rai