Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Conference papers

Shannon's formula and Hartley's rule: A mathematical coincidence?

Olivier Rioul 1, 2 José Carlos Magossi 
1 COMNUM - Communications Numériques
LTCI - Laboratoire Traitement et Communication de l'Information
Abstract : Shannon’s formula C=1/2log(1+P/N) is the emblematic expression for the information capacity of a communication channel. Hartley’s name is often associated to it, owing to Hartley’s rule: counting the highest possible number of distinguishable values for a given amplitude A and precision ±∆ yields a similar expression C′ = log(1 + A/∆). In the information theory community, the following “historical” statements are generally well accepted: (1) Hartley did put forth his rule twenty years before Shannon; (2) Shannon’s formula as a fundamental tradeoff between transmis- sion rate, bandwidth, and signal-to-noise ratio came out unexpected in 1948; (3) Hartley’s rule is an imprecise relation while Shannon’s formula is exact; (4) Hartley’s expression is not an appropriate formula for the capacity of a communication channel. We show that all these four statements are questionable, if not wrong.
Document type :
Conference papers
Complete list of metadata
Contributor : TelecomParis HAL Connect in order to contact the contributor
Submitted on : Friday, September 13, 2019 - 4:23:04 PM
Last modification on : Tuesday, October 19, 2021 - 11:14:20 AM


  • HAL Id : hal-02286941, version 1


Olivier Rioul, José Carlos Magossi. Shannon's formula and Hartley's rule: A mathematical coincidence?. 34th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt 2014), Sep 2014, Amboise, France. pp.105-112. ⟨hal-02286941⟩



Record views