Timezone: »

Interferobot: aligning an optical interferometer by a reinforcement learning agent
Dmitry Sorokin · Alexander Ulanov · Ekaterina Sazhina · Alexander Lvovsky

Tue Dec 08 07:00 AM -- 07:10 AM (PST) @ Orals & Spotlights: Reinforcement Learning

Limitations in acquiring training data restrict potential applications of deep reinforcement learning (RL) methods to the training of real-world robots. Here we train an RL agent to align a Mach-Zehnder interferometer, which is an essential part of many optical experiments, based on images of interference fringes acquired by a monocular camera. The agent is trained in a simulated environment, without any hand-coded features or a priori information about the physics, and subsequently transferred to a physical interferometer. Thanks to a set of domain randomizations simulating uncertainties in physical measurements, the agent successfully aligns this interferometer without any fine-tuning, achieving a performance level of a human expert.

Author Information

Dmitry Sorokin (Russian Quantum Center)
Alexander Ulanov (Russian Quantum Center)
Ekaterina Sazhina (Russian Quantum Center)
Alexander Lvovsky (Oxford University)

Related Events (a corresponding poster, oral, or spotlight)