Information Theory (ASI)

Informations générales

  • ECTS

    ECTS 1

Goal(s)

Introduction to Information theory to give the bounds in term of source coding and channel capacity.

Content(s)

Information Theory  for source and channel coding (Measure of information, Entropy, first Shannon theorem, Shannon Fano and Huffman coding, channel capacity, second Shannon Theorem, case of AWGN channel)


- General tool for Information Theory : measure of information, entropy, mutual information, information rate, introduction to Markov sources

- Source coding : properties, first Shannon Theorem, Shannon-Fano and  Huffman coding techniques

- Capacity and channel coding : capacity, redondance, second Shannon (fondamental) Theorem,

-  Results for continuous random variables, channel capacity for AWGN channel

Calendar

S2

Additional Information

12 h CM + 1,5 h DS

Bibliography

1) G. Battail, « Théorie de l’information : application aux techniques de communication », collection pédagogique de Télécommunication, MASSON, 1997
2) F. Auger, « Introduction à la théorie du signal et de l’information , cours et exercices », éd. Technip, 1999
3) A. Spataru, « Fondements de la th. de la transmission de l’information », presses polytech. romandes, 1987

French State controlled diploma conferring a Master's degree

diplôme conférant grade de master contrôlé par l'Etat