Poster

Regret Bounds for Risk-Sensitive Reinforcement Learning

Osbert Bastani · Jason Yecheng Ma · Estelle Shen · Wanqiao Xu

Hall J #720

Keywords: [ CVaR objective ] [ Risk-sensitive reinforcement learning ]

[ Abstract ]
[ Paper [ Poster [ OpenReview
Wed 30 Nov 2 p.m. PST — 4 p.m. PST

Abstract:

In safety-critical applications of reinforcement learning such as healthcare and robotics, it is often desirable to optimize risk-sensitive objectives that account for tail outcomes rather than expected reward. We prove the first regret bounds for reinforcement learning under a general class of risk-sensitive objectives including the popular CVaR objective. Our theory is based on a novel characterization of the CVaR objective as well as a novel optimistic MDP construction.

Chat is not available.