Information Theory

Entropy, mutual information, and Shannon's coding theorems; lossless source coding, Huffman, Shannon-Fano-Elias, and arithmetic codes; Channel capacity; rate-distortion theory, and lossy source coding; source-channel coding; algorithmic complexity and information; applications of information theory in various fields.

 

Units: 

4.0

Internal Course Number: 

225

Course Number: 

CMPSC 225 / ECE 205A