Timezone: »

A Bayesian Approach for Policy Learning from Trajectory Preference Queries
Aaron Wilson · Alan Fern · Prasad Tadepalli

Thu Dec 06 02:00 PM -- 12:00 AM (PST) @ Harrah’s Special Events Center 2nd Floor #None

We consider the problem of learning control policies via trajectory preference queries to an expert. In particular, the learning agent can present an expert with short runs of a pair of policies originating from the same state and the expert then indicates the preferred trajectory. The agent's goal is to elicit a latent target policy from the expert with as few queries as possible. To tackle this problem we propose a novel Bayesian model of the querying process and introduce two methods that exploit this model to actively select expert queries. Experimental results on four benchmark problems indicate that our model can effectively learn policies from trajectory preference queries and that active query selection can be substantially more efficient than random selection.

Author Information

Aaron Wilson (Oregon State University)
Alan Fern (Oregon State University)
Prasad Tadepalli (Oregon State University)

More from the Same Authors