Timezone: »

 
Poster
Policy Evaluation Using the Ω-Return
Philip Thomas · Scott Niekum · Georgios Theocharous · George Konidaris

Tue Dec 08 04:00 PM -- 08:59 PM (PST) @ 210 C #51
in Poster Session »

We propose the Ω-return as an alternative to the λ-return currently used by the TD(λ) family of algorithms. The benefit of the Ω-return is that it accounts for the correlation of different length returns. Because it is difficult to compute exactly, we suggest one way of approximating the Ω-return. We provide empirical studies that suggest that it is superior to the λ-return and γ-return for a variety of problems.

[ PDF] 

Author Information

Philip Thomas (University of Massachusetts Amherst, Carnegie Mellon University)
Scott Niekum (UT Austin)
Georgios Theocharous (Adobe)
George Konidaris (Duke)

More from the Same Authors