Note for Information Theory & Coding - ITC By vtu rangers

Topics ( 11 )

Text from page-1

Information Theory and Coding 10EC55 Information Theory and Coding Subject Code : 10EC55 No. of Lecture Hrs/Week : 04 Total no. of Lecture Hrs. : 52 IA Marks Exam Hours Exam Marks : 25 : 03 : 100 PART - A Unit – 1: Information Theory: Introduction, Measure of information, Average information content of symbols in long independent sequences, Average information content of symbols in long dependent sequences. Mark-off statistical model for information source, Entropy and information rate of mark-off source. 6 Hours Unit – 2: Source Coding: Encoding of the source output, Shannon’s encoding algorithm. Communication Channels, Discrete communication channels, Continuous channels. 6 Hours Unit – 3: Fundamental Limits on Performance: Source coding theorem, Huffman coding, Discrete memory less Channels, Mutual information, Channel Capacity. 6 Hours Unit – 4: Channel coding theorem, Differential entropy and mutual information for continuous ensembles, Channel capacity Theorem. 6 Hours PART - B Unit – 5: Introduction to Error Control Coding: Introduction, Types of errors, examples, Types of codes Linear Block Codes: Matrix description, Error detection and correction, Standard arrays and table look up for decoding. 7 Hours Unit – 6: Binary Cycle Codes, Algebraic structures of cyclic codes, Encoding using an (n-k) bit shift register, Syndrome calculation. BCH codes. 7 Hours Unit – 7: RS codes, Golay codes, Shortened cyclic codes, Burst error correcting codes. Burst and Random Error correcting codes. 7 Hours Unit – 8: Convolution Codes, Time domain approach. Transform domain approach. 7Hours Text Books: Digital and analog communication systems, K. Sam Shanmugam, John Wiley, 1996. Digital communication, Simon Haykin, John Wiley, 2003. Reference Books: ITC and Cryptography, Ranjan Bose, TMH, II edition, 2007 Digital Communications - Glover and Grant; Pearson Ed. 2nd Ed 2008 Page 1

Text from page-2

Information Theory and Coding 10EC55 INDEX SHEET Sl No. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 Unit & Topic of Discussion PAGE NO. PART - A UNIT – 1: INFORMATION THEORY Introduction Measure of information Average information content of symbols in long independent Sequences Average information content of symbols in long dependent Sequences Mark-off statistical model for information source, Entropy and information rate of mark-off source. Review questions UNIT – 2 SOURCE CODING Encoding of the source output Shannon’s encoding algorithm Communication Channels Discrete communication channels Review questions UNIT – 3 FUNDAMENTAL LIMITS ON PERFORMANCE Source coding theorem Huffman coding Discrete memory less Channels Mutual information Channel Capacity Review questions UNIT – 4 Continuous Channel Differential entropy and mutual information for continuous Ensembles Channel capacity Theorem Review questions PART – B UNIT – 5 INTRODUCTION TO ERROR CONTROL CODING Introduction Types of errors Types of codes Linear Block Codes: Matrix description. Error detection and correction Standard arrays and table look up for decoding 4 5 5 8 9 11 19 27 29 30 31 44 45 73 74 75 75 81 88 90 110 111 112 119 121 129 130 131 133 133 136 146 149 Page 2

Text from page-3

Information Theory and Coding 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 10EC55 Hamming codes Review questions 153 155 156 157 167 171 178 181 182 UNIT – 6 Binary Cyclic Codes Algebraic structures of cyclic codes Encoding using an (n-k) bit shift register, Syndrome calculation. BCH codes Review questions UNIT – 7 183 184 188 189 189 191 196 197 198 200 206 216 Introduction Golay codes and Shortened cyclic codes R S codes Burst error correcting codes Burst and Random Error correcting codes Review questions UNIT – 8 Convolution Codes Time domain approach Transform domain approach. Review questions Page 3

Text from page-4

Information Theory and Coding 10EC55 PART A Unit – 1: Information Theory Syllabus: Introduction, Measure of information, Average information content of symbols in long independent sequences, Average information content of symbols in long dependent sequences. Mark-off statistical model for information source, Entropy and information rate of mark-off source. 6 Hours Text Books:  Digital and analog communication systems, K. Sam Shanmugam, John Wiley, 1996.  Reference Books:  Digital Communications - Glover and Grant; Pearson Ed. 2nd Ed 2008 Page 4