Syllabus
Information theory- Information, Entropy, Discrete memoryless source, Source coding – Shannon-Fano coding, Huffman coding, Lempel-Ziv and arithmetic codes, Rate distortion theory, Optimum Quantizer Design. Discrete memoryless channel, Mutual information, Channel capacity, Shannon limit, Error control codes – Linear block codes, Error detection and correction, Hamming codes, Reed Muller codes, Golay codes, Cyclic codes, Binary BCH codes, Reed Solomon codes, Decoding algorithms, Trellis representation of codes, Convolution codes and its applications, Viterbi algorithm and decoding.