SlideShare a Scribd company logo
University of Isfahan - Department of Electrical Engineering
Digital Communications Due: 94/8/19
Problem Set 3: Source and Channel Coding
Instructor: M. F. Sabahi TA: I. Taghavi
Problem 1
Consider the four codes listed below:
Symbol Code I Code II Code III Code IV
s0 0 0 0 00
s1 10 01 01 01
s2 110 001 011 10
s3 1110 0010 110 110
s4 1111 0011 111 111
(a) Two of these four codes are prefix codes1. Identify them, and construct
their individual decision trees.
(b) Apply the Kraft-McMillan inequality to codes I, II, III, and IV. Discuss
your results in light of those obtained in part (a).
Problem 2
A discrete memoryless source and its source code is described in the following
table:
Symbol S0 S1 S2 S3 S4 S5 S6
Probability 1/4 1/4 1/8 1/8 1/8 1/16 1/16
Code word 10 11 001 010 011 0000 0001
Explain why the source code has an efficiency of 100 percent.
1
A prefix code is defined as a code in which no code word is the prefix of any other
code word.
1
University of Isfahan - Department of Electrical Engineering
Problem 3
Consider a (6,3) linear block code defined by the generator matrix
G =


1 0 0 1 1 0
0 1 0 0 1 1
0 0 1 1 0 1


(a) Determine if the code is a Hamming code. Find the parity check matrix
H of the code in systematic form.
(b) Find the encoding table for the linear block code.
(c) What is the minimum distance dmin of the code. How many errors can
the code detect. How many errors can the code correct.
(d) Suppose c = [ 1 1 1 0 0 0 ] is sent and r = [ 1 1 1 0 0 1 ] is received.
Show how the code can correct this error.
Problem 4
Consider the (5, 1) repetition code:
G = 1 1 1 1 1
H =




1 0 0 0 1
0 1 0 0 1
0 0 1 1 1
0 0 0 1 1




Evaluate the syndrome s for the following error patterns:
(a) All possible single-error patterns.
(b) All possible double-error patterns
Explain why syndromes for all single-error and double-error patterns are
distinct.
2

More Related Content

What's hot

PYTHON REVISION TOUR - 1
PYTHON REVISION TOUR - 1PYTHON REVISION TOUR - 1
PYTHON REVISION TOUR - 1
AyushGupta976
 
Bfs present
Bfs presentBfs present
Bfs present
minhaz uddin
 
C Programming
C ProgrammingC Programming
C Programming
amitymbaassignment
 
Cohen and Sutherland Algorithm for 7-8 marks
Cohen and Sutherland Algorithm for 7-8 marksCohen and Sutherland Algorithm for 7-8 marks
Cohen and Sutherland Algorithm for 7-8 marks
Rehan Khan
 
Clipping
ClippingClipping
Clipping
Pooja Dixit
 
Calculating the hamming code
Calculating the hamming codeCalculating the hamming code
Calculating the hamming code
Umesh Gupta
 
C programming Tutorial Session 4
C programming Tutorial Session 4C programming Tutorial Session 4
C programming Tutorial Session 4
Muhammad Ehtisham Siddiqui
 
Greedy Algorithm - Huffman coding
Greedy Algorithm - Huffman codingGreedy Algorithm - Huffman coding
Greedy Algorithm - Huffman coding
Md Monirul Alom
 
exercise-week-2-core-c-progr
exercise-week-2-core-c-progrexercise-week-2-core-c-progr
exercise-week-2-core-c-progr
Chi Lam
 
Fy secondsemester2016
Fy secondsemester2016Fy secondsemester2016
Fy secondsemester2016
Ankit Dubey
 
Fy secondsemester2016
Fy secondsemester2016Fy secondsemester2016
Fy secondsemester2016
Ankit Dubey
 
C programming Tutorial Session 2
C programming Tutorial Session 2C programming Tutorial Session 2
C programming Tutorial Session 2
Muhammad Ehtisham Siddiqui
 
computer operating system:Greedy algorithm
computer operating system:Greedy algorithmcomputer operating system:Greedy algorithm
computer operating system:Greedy algorithm
RitaThakkar1
 
Check the following function headers and locate as many errors you ca
 Check the following function headers and locate as many errors you ca Check the following function headers and locate as many errors you ca
Check the following function headers and locate as many errors you ca
licservernoida
 
Ece175 computer programming for engineering applications homework assignment ...
Ece175 computer programming for engineering applications homework assignment ...Ece175 computer programming for engineering applications homework assignment ...
Ece175 computer programming for engineering applications homework assignment ...
Song Love
 
Pict: A programming language based on the pi-calculus
Pict: A programming language based on the pi-calculusPict: A programming language based on the pi-calculus
Pict: A programming language based on the pi-calculus
IMDS2014
 
Cohen sutherland algorithm
Cohen sutherland algorithmCohen sutherland algorithm
Cohen sutherland algorithm
Farwa Ansari
 
Error Detection N Correction
Error Detection N CorrectionError Detection N Correction
Error Detection N Correction
Ankan Adhikari
 
Clipping ( Cohen-Sutherland Algorithm )
Clipping ( Cohen-Sutherland Algorithm )Clipping ( Cohen-Sutherland Algorithm )
Clipping ( Cohen-Sutherland Algorithm )
Harshana Madusanka Jayamaha
 
C programming Tutorial Session 3
C programming Tutorial Session 3C programming Tutorial Session 3
C programming Tutorial Session 3
Muhammad Ehtisham Siddiqui
 

What's hot (20)

PYTHON REVISION TOUR - 1
PYTHON REVISION TOUR - 1PYTHON REVISION TOUR - 1
PYTHON REVISION TOUR - 1
 
Bfs present
Bfs presentBfs present
Bfs present
 
C Programming
C ProgrammingC Programming
C Programming
 
Cohen and Sutherland Algorithm for 7-8 marks
Cohen and Sutherland Algorithm for 7-8 marksCohen and Sutherland Algorithm for 7-8 marks
Cohen and Sutherland Algorithm for 7-8 marks
 
Clipping
ClippingClipping
Clipping
 
Calculating the hamming code
Calculating the hamming codeCalculating the hamming code
Calculating the hamming code
 
C programming Tutorial Session 4
C programming Tutorial Session 4C programming Tutorial Session 4
C programming Tutorial Session 4
 
Greedy Algorithm - Huffman coding
Greedy Algorithm - Huffman codingGreedy Algorithm - Huffman coding
Greedy Algorithm - Huffman coding
 
exercise-week-2-core-c-progr
exercise-week-2-core-c-progrexercise-week-2-core-c-progr
exercise-week-2-core-c-progr
 
Fy secondsemester2016
Fy secondsemester2016Fy secondsemester2016
Fy secondsemester2016
 
Fy secondsemester2016
Fy secondsemester2016Fy secondsemester2016
Fy secondsemester2016
 
C programming Tutorial Session 2
C programming Tutorial Session 2C programming Tutorial Session 2
C programming Tutorial Session 2
 
computer operating system:Greedy algorithm
computer operating system:Greedy algorithmcomputer operating system:Greedy algorithm
computer operating system:Greedy algorithm
 
Check the following function headers and locate as many errors you ca
 Check the following function headers and locate as many errors you ca Check the following function headers and locate as many errors you ca
Check the following function headers and locate as many errors you ca
 
Ece175 computer programming for engineering applications homework assignment ...
Ece175 computer programming for engineering applications homework assignment ...Ece175 computer programming for engineering applications homework assignment ...
Ece175 computer programming for engineering applications homework assignment ...
 
Pict: A programming language based on the pi-calculus
Pict: A programming language based on the pi-calculusPict: A programming language based on the pi-calculus
Pict: A programming language based on the pi-calculus
 
Cohen sutherland algorithm
Cohen sutherland algorithmCohen sutherland algorithm
Cohen sutherland algorithm
 
Error Detection N Correction
Error Detection N CorrectionError Detection N Correction
Error Detection N Correction
 
Clipping ( Cohen-Sutherland Algorithm )
Clipping ( Cohen-Sutherland Algorithm )Clipping ( Cohen-Sutherland Algorithm )
Clipping ( Cohen-Sutherland Algorithm )
 
C programming Tutorial Session 3
C programming Tutorial Session 3C programming Tutorial Session 3
C programming Tutorial Session 3
 

Similar to PS3

Information Theory and Coding Question Bank
Information Theory and Coding Question BankInformation Theory and Coding Question Bank
Information Theory and Coding Question Bank
miraclebabu
 
D I G I T A L I C A P P L I C A T I O N S J N T U M O D E L P A P E R{Www
D I G I T A L  I C  A P P L I C A T I O N S  J N T U  M O D E L  P A P E R{WwwD I G I T A L  I C  A P P L I C A T I O N S  J N T U  M O D E L  P A P E R{Www
D I G I T A L I C A P P L I C A T I O N S J N T U M O D E L P A P E R{Www
guest3f9c6b
 
Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}
Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}
Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}
guest3f9c6b
 
Ch3 datalink
Ch3 datalinkCh3 datalink
Ch3 datalink
Ramesh Kumar
 
Data linklayer
Data linklayerData linklayer
Data linklayer
sheikhshakir
 
Y03301460154
Y03301460154Y03301460154
Y03301460154
ijceronline
 
A109210503 digitallogicdesign1
A109210503 digitallogicdesign1A109210503 digitallogicdesign1
A109210503 digitallogicdesign1
jntuworld
 
ch10.pdf
ch10.pdfch10.pdf
ch10.pdf
MarckyCaones
 
BCH Codes
BCH CodesBCH Codes
BCH Codes
AakankshaR
 
13-DataLink_02.ppt
13-DataLink_02.ppt13-DataLink_02.ppt
13-DataLink_02.ppt
WinterSnow16
 
Ec2203 digital electronics questions anna university by www.annaunivedu.org
Ec2203 digital electronics questions anna university by www.annaunivedu.orgEc2203 digital electronics questions anna university by www.annaunivedu.org
Ec2203 digital electronics questions anna university by www.annaunivedu.org
annaunivedu
 
Data links
Data links Data links
Data links
EshaAfzal5
 
Channel Coding (Error Control Coding)
Channel Coding (Error Control Coding)Channel Coding (Error Control Coding)
Channel Coding (Error Control Coding)
Ola Mashaqi @ an-najah national university
 
Ssuersh dc
Ssuersh dcSsuersh dc
Ssuersh dc
ramsur
 
MODULE_2_Ch4_01082014.pptx .
MODULE_2_Ch4_01082014.pptx                   .MODULE_2_Ch4_01082014.pptx                   .
MODULE_2_Ch4_01082014.pptx .
happycocoman
 
D I G I T A L C O M M U N I C A T I O N S J N T U M O D E L P A P E R{Www
D I G I T A L  C O M M U N I C A T I O N S  J N T U  M O D E L  P A P E R{WwwD I G I T A L  C O M M U N I C A T I O N S  J N T U  M O D E L  P A P E R{Www
D I G I T A L C O M M U N I C A T I O N S J N T U M O D E L P A P E R{Www
guest3f9c6b
 
Digital Communications Jntu Model Paper{Www.Studentyogi.Com}
Digital Communications Jntu Model Paper{Www.Studentyogi.Com}Digital Communications Jntu Model Paper{Www.Studentyogi.Com}
Digital Communications Jntu Model Paper{Www.Studentyogi.Com}
guest3f9c6b
 
error detection correction
error detection correctionerror detection correction
error detection correction
BishalWosti1
 
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCETDigital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
SeshaVidhyaS
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
Faisal Mehmood
 

Similar to PS3 (20)

Information Theory and Coding Question Bank
Information Theory and Coding Question BankInformation Theory and Coding Question Bank
Information Theory and Coding Question Bank
 
D I G I T A L I C A P P L I C A T I O N S J N T U M O D E L P A P E R{Www
D I G I T A L  I C  A P P L I C A T I O N S  J N T U  M O D E L  P A P E R{WwwD I G I T A L  I C  A P P L I C A T I O N S  J N T U  M O D E L  P A P E R{Www
D I G I T A L I C A P P L I C A T I O N S J N T U M O D E L P A P E R{Www
 
Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}
Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}
Digital Ic Applications Jntu Model Paper{Www.Studentyogi.Com}
 
Ch3 datalink
Ch3 datalinkCh3 datalink
Ch3 datalink
 
Data linklayer
Data linklayerData linklayer
Data linklayer
 
Y03301460154
Y03301460154Y03301460154
Y03301460154
 
A109210503 digitallogicdesign1
A109210503 digitallogicdesign1A109210503 digitallogicdesign1
A109210503 digitallogicdesign1
 
ch10.pdf
ch10.pdfch10.pdf
ch10.pdf
 
BCH Codes
BCH CodesBCH Codes
BCH Codes
 
13-DataLink_02.ppt
13-DataLink_02.ppt13-DataLink_02.ppt
13-DataLink_02.ppt
 
Ec2203 digital electronics questions anna university by www.annaunivedu.org
Ec2203 digital electronics questions anna university by www.annaunivedu.orgEc2203 digital electronics questions anna university by www.annaunivedu.org
Ec2203 digital electronics questions anna university by www.annaunivedu.org
 
Data links
Data links Data links
Data links
 
Channel Coding (Error Control Coding)
Channel Coding (Error Control Coding)Channel Coding (Error Control Coding)
Channel Coding (Error Control Coding)
 
Ssuersh dc
Ssuersh dcSsuersh dc
Ssuersh dc
 
MODULE_2_Ch4_01082014.pptx .
MODULE_2_Ch4_01082014.pptx                   .MODULE_2_Ch4_01082014.pptx                   .
MODULE_2_Ch4_01082014.pptx .
 
D I G I T A L C O M M U N I C A T I O N S J N T U M O D E L P A P E R{Www
D I G I T A L  C O M M U N I C A T I O N S  J N T U  M O D E L  P A P E R{WwwD I G I T A L  C O M M U N I C A T I O N S  J N T U  M O D E L  P A P E R{Www
D I G I T A L C O M M U N I C A T I O N S J N T U M O D E L P A P E R{Www
 
Digital Communications Jntu Model Paper{Www.Studentyogi.Com}
Digital Communications Jntu Model Paper{Www.Studentyogi.Com}Digital Communications Jntu Model Paper{Www.Studentyogi.Com}
Digital Communications Jntu Model Paper{Www.Studentyogi.Com}
 
error detection correction
error detection correctionerror detection correction
error detection correction
 
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCETDigital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
 

PS3

  • 1. University of Isfahan - Department of Electrical Engineering Digital Communications Due: 94/8/19 Problem Set 3: Source and Channel Coding Instructor: M. F. Sabahi TA: I. Taghavi Problem 1 Consider the four codes listed below: Symbol Code I Code II Code III Code IV s0 0 0 0 00 s1 10 01 01 01 s2 110 001 011 10 s3 1110 0010 110 110 s4 1111 0011 111 111 (a) Two of these four codes are prefix codes1. Identify them, and construct their individual decision trees. (b) Apply the Kraft-McMillan inequality to codes I, II, III, and IV. Discuss your results in light of those obtained in part (a). Problem 2 A discrete memoryless source and its source code is described in the following table: Symbol S0 S1 S2 S3 S4 S5 S6 Probability 1/4 1/4 1/8 1/8 1/8 1/16 1/16 Code word 10 11 001 010 011 0000 0001 Explain why the source code has an efficiency of 100 percent. 1 A prefix code is defined as a code in which no code word is the prefix of any other code word. 1
  • 2. University of Isfahan - Department of Electrical Engineering Problem 3 Consider a (6,3) linear block code defined by the generator matrix G =   1 0 0 1 1 0 0 1 0 0 1 1 0 0 1 1 0 1   (a) Determine if the code is a Hamming code. Find the parity check matrix H of the code in systematic form. (b) Find the encoding table for the linear block code. (c) What is the minimum distance dmin of the code. How many errors can the code detect. How many errors can the code correct. (d) Suppose c = [ 1 1 1 0 0 0 ] is sent and r = [ 1 1 1 0 0 1 ] is received. Show how the code can correct this error. Problem 4 Consider the (5, 1) repetition code: G = 1 1 1 1 1 H =     1 0 0 0 1 0 1 0 0 1 0 0 1 1 1 0 0 0 1 1     Evaluate the syndrome s for the following error patterns: (a) All possible single-error patterns. (b) All possible double-error patterns Explain why syndromes for all single-error and double-error patterns are distinct. 2