Timezone: »

Learning to Explore and Exploit in POMDPs
Chenghui Cai · Xuejun Liao · Lawrence Carin

Tue Dec 08 07:00 PM -- 11:59 PM (PST) @

A fundamental objective in reinforcement learning is the maintenance of a proper balance between exploration and exploitation. This problem becomes more challenging when the agent can only partially observe the states of its environment. In this paper we propose a dual-policy method for jointly learning the agent behavior and the balance between exploration exploitation, in partially observable environments. The method subsumes traditional exploration, in which the agent takes actions to gather information about the environment, and active learning, in which the agent queries an oracle for optimal actions (with an associated cost for employing the oracle). The form of the employed exploration is dictated by the specific problem. Theoretical guarantees are provided concerning the optimality of the balancing of exploration and exploitation. The effectiveness of the method is demonstrated by experimental results on benchmark problems.

Author Information

Chenghui Cai (Cantor Fitzgerald)
Xuejun Liao (Duke University)
Lawrence Carin (KAUST)

More from the Same Authors