Skip to yearly menu bar Skip to main content

Workshop: AI for Science: Progress and Promises

Optimizing Intermediate Representations of Generative Models for Phase Retrieval

Tobias Uelwer · Sebastian Konietzny · Stefan Harmeling

Keywords: [ Generative Models ] [ Phase retrieval ] [ Intermediate layer optimization ]


Fourier phase retrieval is the problem of reconstructing images from magnitude-only measurements. It is relevant in many areas of science, e.g., in X-ray crystallography, astronomy, microscopy, array imaging and optics. When training data is available, generative models can be used to constrain the solution set. However, not all possible solutions are within the range of the generator. Instead, they are represented with some error. To reduce this representation error in the context of phase retrieval, we first leverage a novel variation of intermediate layer optimization (ILO) to extend the range of the generator while still producing images consistent with the training data. Second, we introduce new initialization schemes that further improve the quality of the reconstruction. With extensive experiments, we can show the benefits of our modified ILO and the new initialization schemes.

Chat is not available.