Timezone: »

Online Learning: Stochastic, Constrained, and Smoothed Adversaries
Sasha Rakhlin · Karthik Sridharan · Ambuj Tewari

Mon Dec 12 10:00 AM -- 02:59 PM (PST) @

Learning theory has largely focused on two main learning scenarios: the classical statistical setting where instances are drawn i.i.d. from a fixed distribution, and the adversarial scenario whereby at every time step the worst instance is revealed to the player. It can be argued that in the real world neither of these assumptions is reasonable. We define the minimax value of a game where the adversary is restricted in his moves, capturing stochastic and non-stochastic assumptions on data. Building on the sequential symmetrization approach, we define a notion of distribution-dependent Rademacher complexity for the spectrum of problems ranging from i.i.d. to worst-case. The bounds let us immediately deduce variation-type bounds. We study a smoothed online learning scenario and show that exponentially small amount of noise can make function classes with infinite Littlestone dimension learnable.

Author Information

Sasha Rakhlin (University of Pennsylvania)
Karthik Sridharan (University of Pennsylvania)
Ambuj Tewari (University of Michigan)

More from the Same Authors