Skip to yearly menu bar Skip to main content


Poster

Countering Feedback Delays in Multi-Agent Learning

Zhengyuan Zhou · Panayotis Mertikopoulos · Nicholas Bambos · Peter W Glynn · Claire Tomlin

Pacific Ballroom #211

Keywords: [ Learning Theory ] [ Game Theory and Computational Economics ]


Abstract: We consider a model of game-theoretic learning based on \ac{OMD} with asynchronous and delayed feedback information. Instead of focusing on specific games, we consider a broad class of continuous games defined by the general equilibrium stability notion, which we call \emph{$\lambda$-variational stability}. Our first contribution is that, in this class of games, the actual sequence of play induced by \ac{OMD}-based learning converges to Nash equilibria provided that the feedback delays faced by the players are synchronous and bounded. Subsequently, to tackle fully decentralized, asynchronous environments with (possibly) unbounded delays between actions and feedback, we propose a variant of \ac{OMD} which we call \ac{DMD}, and which relies on the repeated leveraging of past information. With this modification, the algorithm converges to Nash equilibria with no feedback synchronicity assumptions and even when the delays grow superlinearly relative to the horizon of play.

Live content is unavailable. Log in and register to view live content