Timezone: »
Efficient Competitions and Online Learning with Strategic Forecasters
Anish Thilagar · Rafael Frongillo · Bo Waggoner · Robert Gomez
Winner-take-all competitions in forecasting and machine-learning suffer from distorted incentives.Witkowski et al. identified this problem and proposed ELF, a truthful mechanism to select a winner.We show that, from a pool of $n$ forecasters, ELF requires $\Theta(n\log n)$ events or test data points to select a near-optimal forecaster with high probability.We then show that standard online learning algorithms select an $\epsilon$-optimal forecaster using only $O(\log(n) / \epsilon^2)$ events, by way of a strong approximate-truthfulness guarantee.This bound matches the best possible even in the nonstrategic setting.We then apply these mechanisms to obtain the first no-regret guarantee for non-myopic strategic experts.
Author Information
Anish Thilagar (University of Colorado, Boulder)
Rafael Frongillo (University of Colorado Boulder)
Bo Waggoner
Robert Gomez (University of Colorado, Boulder)
More from the Same Authors
-
2021 : Learning in Matrix Games can be Arbitrarily Complex »
Gabriel Andrade · Rafael Frongillo · Georgios Piliouras -
2021 : Efficient Competitions and Online Learning with Strategic Forecasters »
Anish Thilagar · Rafael Frongillo · Bo Waggoner · Robert Gomez -
2021 : Learning in Matrix Games can be Arbitrarily Complex »
Gabriel Andrade · Rafael Frongillo · Georgios Piliouras -
2021 : Spotlight 3: Efficient Competitions and Online Learning with Strategic Forecasters »
Anish Thilagar · Rafael Frongillo · Bo Waggoner · Robert Gomez -
2021 Poster: Surrogate Regret Bounds for Polyhedral Losses »
Rafael Frongillo · Bo Waggoner -
2021 Poster: Unifying lower bounds on prediction dimension of convex surrogates »
Jessica Finocchiaro · Rafael Frongillo · Bo Waggoner -
2019 Poster: An Embedding Framework for Consistent Polyhedral Surrogates »
Jessica Finocchiaro · Rafael Frongillo · Bo Waggoner -
2018 Poster: Convex Elicitation of Continuous Properties »
Jessica Finocchiaro · Rafael Frongillo -
2018 Spotlight: Convex Elicitation of Continuous Properties »
Jessica Finocchiaro · Rafael Frongillo -
2018 Poster: Bounded-Loss Private Prediction Markets »
Rafael Frongillo · Bo Waggoner -
2018 Spotlight: Bounded-Loss Private Prediction Markets »
Rafael Frongillo · Bo Waggoner -
2017 Poster: Accuracy First: Selecting a Differential Privacy Level for Accuracy Constrained ERM »
Katrina Ligett · Seth Neel · Aaron Roth · Bo Waggoner · Steven Wu