Timezone: »

 
Poster
Direct Diffusion Bridge using Data Consistency for Inverse Problems
Hyungjin Chung · Jeongsol Kim · Jong Chul Ye

Tue Dec 12 03:15 PM -- 05:15 PM (PST) @ Great Hall & Hall B1+B2 #541
in Poster Session 2 »

Diffusion model-based inverse problem solvers have shown impressive performance, but are limited in speed, mostly as they require reverse diffusion sampling starting from noise. Several recent works have tried to alleviate this problem by building a diffusion process, directly bridging the clean and the corrupted for specific inverse problems. In this paper, we first unify these existing works under the name Direct Diffusion Bridges (DDB), showing that while motivated by different theories, the resulting algorithms only differ in the choice of parameters. Then, we highlight a critical limitation of the current DDB framework, namely that it does not ensure data consistency. To address this problem, we propose a modified inference procedure that imposes data consistency without the need for fine-tuning. We term the resulting method data Consistent DDB (CDDB), which outperforms its inconsistent counterpart in terms of both perception and distortion metrics, thereby effectively pushing the Pareto-frontier toward the optimum. Our proposed method achieves state-of-the-art results on both evaluation criteria, showcasing its superiority over existing methods. Code is open-sourced here.

Author Information

Hyungjin Chung (KAIST)

Research intern @LANL Ph.D. student @KAIST Deep generative models, Diffusion models, Inverse problems

Jeongsol Kim (KAIST)
Jong Chul Ye (KAIST AI)

More from the Same Authors