×
Stay dedicated because great things takes time.

# Note for Information Theory & Coding - ITC By Sunil S Harakannanavar

• Information Theory & Coding - ITC
• Note
• S G Balekundri Institute of Technology, Belagavi - S.G.B.I.T,Belagavi
• Electronics and Communication Engineering
• 1 Topics
• 30588 Views
0 User(s)

#### Text from page-1

S. S. EDUCATION TRUST (R) S. G. BALEKUNDRI INSTITUTE OF TECHNOLOGY SHIVABASAV NAGAR BELAGAVI-10 INFORMATION THEORY AND CODING [10EC55] Notes as per VTU Syllabus for V Semester Electronics & Communication Engineering Mr. Sunil S Harakannanavar BE, M.Tech (Control Systems) Assistant Professor Department Of Electronics & Communication Engineering S G Balekundri Institute Of Technology, Belagavi-10 Email: sunilsh143@gmail.com Mobile: 7411844948

#### Text from page-3

INFORMATION THEORY AND CODING Subject Code : 10EC55 No. of Lecture Hrs/Week : 04 Total no. of Lecture Hrs. : 52 IA Marks Exam Hours Exam Marks : 25 : 03 : 100 UNIT - 1 INFORMATION THEORY: Introduction, Measure of information, Average information content of symbols in long independent sequences, Average information content of symbols in long dependent sequences. Markoff statistical model for information source, Entropy and information rate of mark-off source. 7 Hrs UNIT - 2 SOURCE CODING: Encoding of the source output, Shannon’s encoding algorithm. Communication Channels, Discrete communication channels, Continuous channels. 6 Hrs UNIT - 3 FUNDAMENTAL LIMITS ON PERFORMANCE: Source coding theorem, Huffman coding, Discrete memory less Channels, Mutual information, Channel Capacity. 7 Hrs UNIT - 4 Channel coding theorem, Differential entropy and mutual information for continuous ensembles, Channel capacity Theorem. 6 Hrs UNIT - 5 INTRODUCTION TO ERROR CONTROL CODING: Introduction, Types of errors, examples, Types of codes Linear Block Codes: Matrix description, Error detection and correction, Standard arrays and table look up for decoding. 7 Hrs UNIT - 6 Binary Cycle Codes, Algebraic structures of cyclic codes, Encoding using an (n-k) bit shift register, Syndrome calculation. BCH codes. 6 Hrs UNIT - 7 RS codes, Golay codes, Shortened cyclic codes, Burst error correcting codes. Burst and Random Error correcting codes. 7 Hrs UNIT - 8 Convolution Codes, Time domain approach. Transform domain approach. 6 Hrs TEXT BOOKS: 1. Digital and analog communication systems, K. Sam Shanmugam, John Wiley India Pvt. Ltd, 1996. 2. Digital communication, Simon Haykin, John Wiley India Pvt. Ltd, 2008. 39

#### Text from page-4

a _1J)EC5L CFIAPTER 1 INFORMATION THEORY * lHrRooLteTtoN: , * o.#t^"ao " ilrMcL e4d^ l^ DL 'p;cL'tsz * -a.r>*s't-a- tsASlcs oF lrn)o, *rl- e,l D 7l*' /wqAADq(0 '""'a'U'L'e' e- ,{'ur)a' DL *d-e^f,ALa,"t, + o " :-n P\ r'{\ o ^AiL **T ' " ;a LilA ^r!rJ,t ?APArfi) WPIL Sy.Srei4 : lNFoRl4ATtON ) ,v\AJh^/'/"\- " a,h-a- )"lrqL tD,tr,t- GX ,. SUNIL S j,,,o #tr ,: B[oo\ Atoy"r^- )ol- A*arc<ru al ,", HARAKANNANAVAR SG I ,ar^- t'-',p"**iro s1sl"'- BALEKUNDRI INSTITUTE OF TECT.INOLOGY, BELAGAVI PAGE 1