Informations générales
ECTSECTS
1
Goal(s)
Introduction to Information theory to give the bounds in term of source coding and channel capacity.
Content(s)
Information Theory for source and channel coding (Measure of information, Entropy, first Shannon theorem, Shannon Fano and Huffman coding, channel capacity, second Shannon Theorem, case of AWGN channel)
- General tool for Information Theory : measure of information, entropy, mutual information, information rate, introduction to Markov sources
- Source coding : properties, first Shannon Theorem, Shannon-Fano and Huffman coding techniques
- Capacity and channel coding : capacity, redondance, second Shannon (fondamental) Theorem,
- Results for continuous random variables, channel capacity for AWGN channel
Calendar
S2
Additional Information
12 h CM + 1,5 h DS
Bibliography
1) G. Battail, « Théorie de l’information : application aux techniques de communication », collection pédagogique de Télécommunication, MASSON, 1997
2) F. Auger, « Introduction à la théorie du signal et de l’information , cours et exercices », éd. Technip, 1999
3) A. Spataru, « Fondements de la th. de la transmission de l’information », presses polytech. romandes, 1987