Skip to yearly menu bar Skip to main content


Poster

Linear Multi-Resource Allocation with Semi-Bandit Feedback

Tor Lattimore · Yacov Crammer · Csaba Szepesvari

210 C #90

Abstract:

We study an idealised sequential resource allocation problem. In each time step the learner chooses an allocation of several resource types between a number of tasks. Assigning more resources to a task increases the probability that it is completed. The problem is challenging because the alignment of the tasks to the resource types is unknown and the feedback is noisy. Our main contribution is the new setting and an algorithm with nearly-optimal regret analysis. Along the way we draw connections to the problem of minimising regret for stochastic linear bandits with heteroscedastic noise. We also present some new results for stochastic linear bandits on the hypercube that significantly out-performs existing work, especially in the sparse case.

Live content is unavailable. Log in and register to view live content