Timezone: »

 
Poster
Human-AI Shared Control via Policy Dissection
Quanyi Li · Zhenghao Peng · Haibin Wu · Lan Feng · Bolei Zhou

Thu Dec 01 02:00 PM -- 04:00 PM (PST) @ Hall J #800
in Poster Session 6 »

Human-AI shared control allows human to interact and collaborate with autonomous agents to accomplish control tasks in complex environments. Previous Reinforcement Learning (RL) methods attempted goal-conditioned designs to achieve human-controllable policies at the cost of redesigning the reward function and training paradigm. Inspired by the neuroscience approach to investigate the motor cortex in primates, we develop a simple yet effective frequency-based approach called Policy Dissection to align the intermediate representation of the learned neural controller with the kinematic attributes of the agent behavior. Without modifying the neural controller or retraining the model, the proposed approach can convert a given RL-trained policy into a human-controllable policy. We evaluate the proposed approach on many RL tasks such as autonomous driving and locomotion. The experiments show that human-AI shared control system achieved by Policy Dissection in driving task can substantially improve the performance and safety in unseen traffic scenes. With human in the inference loop, the locomotion robots also exhibit versatile controllable motion skills even though they are only trained to move forward. Our results suggest the promising direction of implementing human-AI shared autonomy through interpreting the learned representation of the autonomous agents. Code and demo videos are available at https://metadriverse.github.io/policydissect

Keywords: Decision and Control · human-AI interaction · Interpetability

Author Information

Quanyi Li (University of Edinburgh)
Zhenghao Peng (University of California, Los Angeles)
Haibin Wu (National Taiwan University)
Lan Feng (ETH Zurich)
Bolei Zhou (UCLA)
Bolei Zhou

Assistant professor at UCLA's computer science department

More from the Same Authors