Gaussian bounds for discrete entropies - Equipe Communications numériques Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Gaussian bounds for discrete entropies

Résumé

It is well known that the Gaussian distribution has the largest differential entropy amongst all distributions of equal variance. In this paper, we derive similar (generalized) Gaussian upper bounds for discrete (Rényi) entropies of integer-valued variables. Using a mixed discrete-continuous bounding technique and the Poisson summation formula from Fourier analysis, it is proved that in many cases, such Gaussian bounds hold with an additive term that vanishes exponentially as the variance increases.
Fichier principal
Vignette du fichier
202205rioul.pdf (752.44 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03718693 , version 1 (12-08-2022)

Identifiants

  • HAL Id : hal-03718693 , version 1

Citer

Olivier Rioul. Gaussian bounds for discrete entropies. IEEE Information Theory and Applications Workshop (ITA 2022), May 2022, San Diego, United States. ⟨hal-03718693⟩
80 Consultations
43 Téléchargements

Partager

Gmail Facebook X LinkedIn More