Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines

(1, 2, 3, 4) , (1) , (2, 5, 3, 4) , (1)
1
2
3
4
5

Résumé

This paper considers the Multiple Access problem where N Internet of Things (IoT) devices share a common wireless medium towards a central Base Station (BS). We propose a Reinforcement Learning (RL) method where the BS is the agent and the devices are part of the environment. A device is allowed to transmit only when the BS decides to schedule it. Besides the information packets, devices send additional messages like the delay or the number of discarded packets since their last transmission. This information is used to design the RL reward function and constitutes the next observation that the agent can use to schedule the next device. Leveraging RL allows us to learn the sporadic and heterogeneous traffic patterns of the IoT devices and an optimal scheduling policy that maximizes the channel throughput. We adapt the Proximal Policy Optimization (PPO) algorithm with a Recurrent Neural Network (RNN) to handle the partial observability of our problem and exploit the temporal correlations of the users' traffic. We demonstrate the performance of our model through simulations on different number of heterogeneous devices with periodic traffic and individual latency constraints. We show that our RL algorithm outperforms traditional scheduling schemes and distributed medium access algorithms.
Fichier principal
Vignette du fichier
globecom21.pdf (1.92 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03566861 , version 1 (11-02-2022)

Identifiants

Citer

Benoît-Marie Robaglia, Apostolos Destounis, Marceau Coupechoux, Dimitrios Tsilimantos. Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines. GLOBECOM 2021 - 2021 IEEE Global Communications Conference, Dec 2021, Madrid, France. pp.1-6, ⟨10.1109/GLOBECOM46510.2021.9685561⟩. ⟨hal-03566861⟩
63 Consultations
56 Téléchargements

Altmetric

Partager

Gmail Facebook Twitter LinkedIn More