Skip to Main content Skip to Navigation
Conference papers

Equilibrium tracking and convergence in dynamic games

Abstract : In this paper, we examine the equilibrium tracking and convergence properties of no-regret learning algorithms in continuous games that evolve over time. Specifically, we focus on learning via "mirror descent", a widely used class of noregret learning schemes where players take small steps along their individual payoff gradients and then "mirror" the output back to their action sets. In this general context, we show that the induced sequence of play stays asymptotically close to the evolving equilibrium of the sequence of stage games (assuming they are strongly monotone), and converges to it if the game stabilizes to a strictly monotone limit. Our results apply to both gradient-and payoff-based feedback, i.e., the "bandit" case where players only observe the payoffs of their chosen actions.
Document type :
Conference papers
Complete list of metadata

https://hal.inria.fr/hal-03342397
Contributor : Panayotis Mertikopoulos Connect in order to contact the contributor
Submitted on : Monday, September 13, 2021 - 12:23:12 PM
Last modification on : Friday, October 22, 2021 - 4:36:50 AM

File

2021-CDC-EquilibriumTracking.p...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03342397, version 1

Citation

Panayotis Mertikopoulos, Mathias Staudigl. Equilibrium tracking and convergence in dynamic games. CDC 2021 - 60th IEEE Annual Conference on Decision and Control, Dec 2021, Austin, United States. pp.1-8. ⟨hal-03342397⟩

Share

Metrics

Record views

43

Files downloads

78