ELEC 515

Information Theory

Units: 1.5

Information theory and its relationship to probability, statistics, and data compression; entropy, relative entropy and mutual information; Huffman coding, arithmetic coding and Lempel-Ziv coding; channel capacity; group codes; generator and parity check matrices; Hamming codes and bound; bounds on the dimension of a linear code; random coding bounds; code construction.

Graduate course in the Electrical Engineering program offered by the Faculty of Graduate Studies.

Summer Fall Spring

Note that not all courses are offered in every term. If a course is not offered, the schedule page will alert you that "No classes were found that meet your search criteria."