SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines - Télécom Paris Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines

Résumé

Recent studies suggest that Multi-Agent Reinforcement Learning (MARL) can be a promising approach to tackle wireless telecommunication problems and Multiple Access (MA) in particular. The most relevant MARL algorithms for distributed MA are those with "decentralized execution", where an agent's actions are only functions of their own local observation history and agents cannot exchange any information. Centralized-Training-Decentralized-Execution (CTDE) and Independent Learning (IL) are the two main families in this category. However, while the former suffers from high communication overhead during the centralized training, the latter suffers from various theoretical shortcomings. In this paper, we first study the performance of these two MARL frameworks in the context of Ultra Reliable Low Latency Communication (URLLC), where MA is constrained by strict deadlines. Second, we propose a new distributed MARL framework, namely SeqDQN, leveraging the constraints of our URLLC problem to train agents in a more efficient way. We demonstrate that not only does our solution outperform the traditional random access baselines, but it also outperforms state-of-the-art MARL algorithms in terms of performance and convergence time.
Fichier principal
Vignette du fichier
eucnc23.pdf (1.81 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04082578 , version 1 (26-04-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04082578 , version 1

Citer

Benoît-Marie Robaglia, Marceau Coupechoux, Dimitrios Tsilimantos, Apostolos Destounis. SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines. EuCNC & 6G Summit, Jun 2023, Gothenburg, Sweden. ⟨hal-04082578⟩
133 Consultations
59 Téléchargements

Partager

Gmail Facebook X LinkedIn More