SlideShare a Scribd company logo
Course Outline
■ Digital Communications Basic Blocks, Introduction
■ Classification of signals ,Deterministic and Random, Periodic
and Non-periodic (Signal, Energy and Power Signals, Analog
and Discrete Signals)
■ Spectral Density, Auto-Correlation,
■ Bandwidth of Digital Signals, Baseband versus Band pass
■ Sampling Theorem, Aliasing, Over Sampling
■ Sampling and Quantizing effects, Channel effects, Signal to
Noise Ratio
■ Pulse Code Modulation, PCM based Time division
multiplexing
Course Outline
■ Uniform and Non Uniform Quantization, Companding
■ Waveform Representation of Binary Digits, M-ary Pulse
Modulation waveforms
■ PCM waveform types, Line Coding
■ Correlative Coding, duo-binary coding and decoding, precoding
■ Error Performance, degradation in Digital Communication
System, Demodulation and detection, SNR parameter in Digital
Communication System
■ Detection of Binary Signals in Gaussian Noise, Matched Filter
Course Outline
■ Inter symbol Interference, Pulse shaping to reduce ISI, Error
Performance
■ Eye Patterns, Digital Demodulation Techniques
■ Spread Spectrum, Frequency Hopping and Direct Sequence
What we discussed in the last
lecture
■ Bandwidth Calculation
■ Inter Symbol Interference
Eye Diagram
How to combat ISI
■ Pulse shaping
By using Nyquist Pulses
■ Using Equalization
Zero Forcing Equalization
Mean Minimum Square Equalizer
Channel Coding in Our Everyday Lives: Examples
185
Channel Coding in Our Everyday Lives: Examples
186
Channel Coding in Our Everyday Lives: Examples
187
188
What is Channel Coding?
Digital Communications over physical channels is prone to errors
Channel Coding means :
Introducing redundancy (i.e., adding extra
bits) to information messages to protect
against channel errors
4
What is Channel Coding?
Channel coding is the art or science in order to protect data symbols
against transmission/storage errors. Channel coding in only possible in digital
transmission/storage systems.
Redundancy is added to the data at the transmitter side, so that
transmission/storage errors can be detected and/or corrected at the receiver.
Main tasks:
• Error detection
• Error correction
• Error concealment.
Without channel coding, robust data transmission via noisy communication channels
as well as reliable storage is not possible. Therefore, channel coding is applied in many
different applications, particularly in digital transmission systems and in digital
storage systems.
5
Applications of Channel Coding
Digital transmission systems
• mobile radio systems
• data modems, internet
• satellite communication systems, deep-space probes
• underwater communication systems
• optical communication systems
Digital storage systems
• compact disc (CD), digital versatile disc (DVD), coin disc
• digital audio tape (DAT)
• hard disc, magnetic storage systems
6
7
Digital Transmission System
Source E Source
encoder
E
Encryption E Channel
encoder
E
Modulator
c
Physical
channel
c
De-
modulator
'Channel
decoder
'De-
cryption
'Source
decoder
'
Sink
u
ˆu
x
y
Transmitter
Receiver
8
8
Shannon’s Information Theory
Claude E. Shannon (1948)
• Source coding: Data compression
• Cryptology: Data encryption
• Channel coding: Error detection/correction/concealment
Separation theorem:
Source coding, encryption, and channel coding may be separated without information
loss (note that the separation theorem holds for very long data sequences only)
11
Tasks of Channel Coding
• Error detection and error correction
⇒ enhancement of error probability (data security) and/or
⇒ reduction of transmit power (enhancement of power efficiency)
• Error concealment
(in conjunction with source coding)
⇒ improvement of subjective performance
• Unequal error protection
(in conjunction with source coding)
⇒ reduction of the number of parity check symbols
12
12
Fundamental Principles of Channel Coding
• Forward error correction (FEC):
In forward error correction schemes there is no feedback from the channel decoder
to the channel encoder.
• Automatic repeat request (ARQ):
In automatic repeat request schemes there is feedback from the channel decoder to
the channel encoder. For example, a code word may be repeated until the channel
decoder does not detect any error. Alternatively, additional parity bits may be
transmitted until the channel decoder does not detect any error. The additional
decoding delay is not tolerable in all transmission schemes, such as in real-time
speech transmission schemes.
Within this lecture our focus is on FEC techniques.
• Cyclic block codes, generator polynomial, parity check polynomial
16
Definition of Block Codes
We denote a sequence u := [u0, u1, . . . , uk−1] of k info symbols as an info word.
The info symbols ui, i = 0, 1, . . . k − 1, are defined over the alphabet {0, 1, . . . , q − 1},
where q is the number of elements (“cardinality”) of the symbol alphabet.
Definition (block code): An (n, k)q block encoder maps an info word
u = [u0, u1, . . . , uk−1] of length k onto a code word x := [x0, x1, . . . , xn−1]
of length n, where n > k.
The code symbols xi, i = 0, 1, . . . , n − 1, are assumed to be within the same alphabet
{0, 1, . . . , q − 1}.
The assignment of code words with respect to the info words is
• unambiguous and reversible: For each code word there is exactly one info word
• time invariant: The mapping rule does not change in time
• memoryless: Each info word effects only one code word
17
Generation of a Block Code
u0 u1
x0 x1 xi ∈ {0, 1, . . . , q − 1}, 0 ≤ i ≤ n − 1
ui ∈ {0, 1, . . . , q − 1}, 0 ≤ i ≤ k − 1
u ∈ {0, 1, . . . , q − 1}k
x ∈ {0, 1, . . . , q − 1}n
xn−1
uk−1
. . .
. . .
Encoder
Code word
Info word
18
18
Redundancy, Error Detection, Error Correction
A code C is the set of all qk
code words.
Since n symbols are needed in order to transmit k info symbols, where n > k, the code
contains redundancy, because only qk
of the qn
possible combinations are allowed.
This redundancy is used for error detection, error correction, or error
concealment by the receiver.
The transmitted (possibly erroneous or noisy) code words are denoted as received
words y. For hard-decision decoding yi ∈ {0, 1, . . . , q − 1}, i = 0, 1, . . . , n − 1,
by definition.
The ratio
R :=
k
n
< 1
is called code rate. The smaller the code rate, the larger is the redundancy given the
same length n of the code word. The bandwidth expansion is R−1
.
⇒ Trade-off between bandwidth efficiency and power efficiency.
19
Systematic Codes
Definition (systematic code): A code is called systematic, if the mapping between
info symbols and code symbols is such that the info symbols are explicitly contained in
the code words.
The n − k remaining symbols are called parity check symbols
(q = 2: parity check bits).
Example 1: (3, 2)2 single parity check (SPC) code:
(q = 2, i.e., one symbol corresponds to one bit)
Info word u = [u0, u1] Code word x = [x0, x1, x2]
[00] [000]
[01] [011]
[10] [101]
[11] [110]
Parity check equation: u0 ⊕ u1 ⊕ x2 = 0 (⊕: modulo-q addition)
Code: C = {[000], [011], [101], [110]}
20
• Catastrophic convolutional encoders
66
Coded Transmission System with Convolutional Codes
s Convolutional
encoder
E Discrete
channel
Convolutional
decoder
E
uk xn yn ˆuk
uk: Info bits, uk ∈ {0, 1}
xn: Code bits, xn ∈ {0, 1}
yn: Received values, hard-decision dec.: yn ∈ {0, 1}, soft-decision dec.: yn ∈ IR
ˆuk: Decoded info bits, ˆuk ∈ {0, 1}
k: Index before encoder
n: Index after encoder
67
Convolutional Codes
Convolutional codes are able to encode the info bits continuously.
We restrict ourselves to binary convolutional codes. The ratio between the number of
info bits and the number of code bits is called coding rate R.
In practice, information is typically transmitted block-wise, rather than continuously.
The number of info bits per block is denoted as K, i.e., the index before the encoder is
0 ≤ k ≤ K − 1.
The number of coded bits per block is denoted as N, i.e., the index after the encoder is
0 ≤ n ≤ N − 1.
68
68
Shift Register Representation of a Binary, Non-Recursive
R = 1/2 Convolutional Encoder with 4 States
u u u
u
u
u uh
E
c c
T
EE
E
D D t
t
t
t
t
t
t
t
&%
'$
&%
'$
&%
'$
+ +
+
uk xnuk−1 uk−2
Memory length: ν = 2
Number of states: S = 2ν
x2,k
x1,k

More Related Content

What's hot

Differential pulse code modulation
Differential pulse code modulationDifferential pulse code modulation
Differential pulse code modulation
Ramraj Bhadu
 
Error control coding techniques
Error control coding techniquesError control coding techniques
Error control coding techniques
DhanashriNandre
 
Companding & Pulse Code Modulation
Companding & Pulse Code ModulationCompanding & Pulse Code Modulation
Companding & Pulse Code Modulation
Yeshudas Muttu
 
Linear block coding
Linear block codingLinear block coding
Linear block coding
jknm
 
Adaptive equalization
Adaptive equalizationAdaptive equalization
Adaptive equalization
Oladapo Abiodun
 
Channel capacity
Channel capacityChannel capacity
Channel capacity
PALLAB DAS
 
Comparsion of M-Ary psk,fsk,qapsk.pptx
Comparsion of M-Ary psk,fsk,qapsk.pptxComparsion of M-Ary psk,fsk,qapsk.pptx
Comparsion of M-Ary psk,fsk,qapsk.pptx
keshav11845
 
3.3 modulation formats msk and gmsk
3.3 modulation formats   msk and gmsk3.3 modulation formats   msk and gmsk
3.3 modulation formats msk and gmsk
JAIGANESH SEKAR
 
Spread-Spectrum Techniques
Spread-Spectrum TechniquesSpread-Spectrum Techniques
Spread-Spectrum Techniques
mohammedalimahdi
 
Line coding
Line codingLine coding
Line coding
Gagan Randhawa
 
Digital communication systems
Digital communication systemsDigital communication systems
Digital communication systemsNisreen Bashar
 
Wavelength division multiplexing
Wavelength division multiplexingWavelength division multiplexing
Wavelength division multiplexing
Nalin Dubey
 
4.5 equalizers and its types
4.5   equalizers and its types4.5   equalizers and its types
4.5 equalizers and its types
JAIGANESH SEKAR
 
Source coding
Source codingSource coding
Source coding
MOHIT KUMAR
 
Ec 2401 wireless communication unit 2
Ec 2401 wireless communication   unit 2Ec 2401 wireless communication   unit 2
Ec 2401 wireless communication unit 2
JAIGANESH SEKAR
 
Convolutional Codes And Their Decoding
Convolutional Codes And Their DecodingConvolutional Codes And Their Decoding
Convolutional Codes And Their Decoding
Kakali Saharia
 
Time Division Multiplexing
Time Division MultiplexingTime Division Multiplexing
Time Division Multiplexing
Spandit Lenka
 
Wireless Channels Capacity
Wireless Channels CapacityWireless Channels Capacity
Wireless Channels Capacity
Oka Danil
 
Digital modulation basics(nnm)
Digital modulation basics(nnm)Digital modulation basics(nnm)
Digital modulation basics(nnm)
nnmaurya
 
Pulse code modulation (PCM)
Pulse code modulation (PCM)Pulse code modulation (PCM)
Pulse code modulation (PCM)
Mahima Shastri
 

What's hot (20)

Differential pulse code modulation
Differential pulse code modulationDifferential pulse code modulation
Differential pulse code modulation
 
Error control coding techniques
Error control coding techniquesError control coding techniques
Error control coding techniques
 
Companding & Pulse Code Modulation
Companding & Pulse Code ModulationCompanding & Pulse Code Modulation
Companding & Pulse Code Modulation
 
Linear block coding
Linear block codingLinear block coding
Linear block coding
 
Adaptive equalization
Adaptive equalizationAdaptive equalization
Adaptive equalization
 
Channel capacity
Channel capacityChannel capacity
Channel capacity
 
Comparsion of M-Ary psk,fsk,qapsk.pptx
Comparsion of M-Ary psk,fsk,qapsk.pptxComparsion of M-Ary psk,fsk,qapsk.pptx
Comparsion of M-Ary psk,fsk,qapsk.pptx
 
3.3 modulation formats msk and gmsk
3.3 modulation formats   msk and gmsk3.3 modulation formats   msk and gmsk
3.3 modulation formats msk and gmsk
 
Spread-Spectrum Techniques
Spread-Spectrum TechniquesSpread-Spectrum Techniques
Spread-Spectrum Techniques
 
Line coding
Line codingLine coding
Line coding
 
Digital communication systems
Digital communication systemsDigital communication systems
Digital communication systems
 
Wavelength division multiplexing
Wavelength division multiplexingWavelength division multiplexing
Wavelength division multiplexing
 
4.5 equalizers and its types
4.5   equalizers and its types4.5   equalizers and its types
4.5 equalizers and its types
 
Source coding
Source codingSource coding
Source coding
 
Ec 2401 wireless communication unit 2
Ec 2401 wireless communication   unit 2Ec 2401 wireless communication   unit 2
Ec 2401 wireless communication unit 2
 
Convolutional Codes And Their Decoding
Convolutional Codes And Their DecodingConvolutional Codes And Their Decoding
Convolutional Codes And Their Decoding
 
Time Division Multiplexing
Time Division MultiplexingTime Division Multiplexing
Time Division Multiplexing
 
Wireless Channels Capacity
Wireless Channels CapacityWireless Channels Capacity
Wireless Channels Capacity
 
Digital modulation basics(nnm)
Digital modulation basics(nnm)Digital modulation basics(nnm)
Digital modulation basics(nnm)
 
Pulse code modulation (PCM)
Pulse code modulation (PCM)Pulse code modulation (PCM)
Pulse code modulation (PCM)
 

Similar to Basics of channel coding

linear codes and cyclic codes
linear codes and cyclic codeslinear codes and cyclic codes
linear codes and cyclic codes
saigopinadh bodigiri
 
Linear Block code.pdf
Linear Block code.pdfLinear Block code.pdf
Linear Block code.pdf
SuryaRamVM
 
3F4ecc.ppt
3F4ecc.ppt3F4ecc.ppt
3F4ecc.ppt
Annymus
 
Unit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdf
Unit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdfUnit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdf
Unit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdf
vani374987
 
Unit 3 ppt
Unit 3 pptUnit 3 ppt
Unit 3 ppt
RemyaRoseS
 
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCETDigital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
SeshaVidhyaS
 
Encoder for (7,3) cyclic code using matlab
Encoder for (7,3) cyclic code using matlabEncoder for (7,3) cyclic code using matlab
Encoder for (7,3) cyclic code using matlab
SneheshDutta
 
Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...
Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...
Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...
IRJET Journal
 
BCH Codes
BCH CodesBCH Codes
BCH Codes
AakankshaR
 
Channel Coding .pptx
Channel Coding .pptxChannel Coding .pptx
Channel Coding .pptx
Mortadha96
 
Turbo Codes
Turbo CodesTurbo Codes
Turbo Codes
vasanth_mtech
 
Digital Communication: Channel Coding
Digital Communication: Channel CodingDigital Communication: Channel Coding
Digital Communication: Channel Coding
Dr. Sanjay M. Gulhane
 
Turbo Code
Turbo Code Turbo Code
Turbo Code
SudhanshuSaini5
 
Defense Senior College on Error Coding presentation 4/22/2010
Defense Senior College on Error Coding presentation 4/22/2010Defense Senior College on Error Coding presentation 4/22/2010
Defense Senior College on Error Coding presentation 4/22/2010
Felicia Fort, MBA
 
Unit-4.pptx
Unit-4.pptxUnit-4.pptx
Presentation ppt 3.pptx
Presentation ppt 3.pptxPresentation ppt 3.pptx
Presentation ppt 3.pptx
temesgen545750
 
Lecture 4 from virtual university of pakistan
Lecture 4 from virtual university of pakistanLecture 4 from virtual university of pakistan
Lecture 4 from virtual university of pakistan
Saba Hanif
 
basicsofcodingtheory-160202182933-converted.pptx
basicsofcodingtheory-160202182933-converted.pptxbasicsofcodingtheory-160202182933-converted.pptx
basicsofcodingtheory-160202182933-converted.pptx
upendrabhatt13
 

Similar to Basics of channel coding (20)

linear codes and cyclic codes
linear codes and cyclic codeslinear codes and cyclic codes
linear codes and cyclic codes
 
Linear Block code.pdf
Linear Block code.pdfLinear Block code.pdf
Linear Block code.pdf
 
3F4ecc.ppt
3F4ecc.ppt3F4ecc.ppt
3F4ecc.ppt
 
Unit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdf
Unit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdfUnit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdf
Unit I DIGITAL COMMUNICATION-INFORMATION THEORY.pdf
 
Unit 3 ppt
Unit 3 pptUnit 3 ppt
Unit 3 ppt
 
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCETDigital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
Digital electronics(EC8392) unit- 1-Sesha Vidhya S/ ASP/ECE/RMKCET
 
Encoder for (7,3) cyclic code using matlab
Encoder for (7,3) cyclic code using matlabEncoder for (7,3) cyclic code using matlab
Encoder for (7,3) cyclic code using matlab
 
Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...
Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...
Review paper on Reed Solomon (204,188) Decoder for Digital Video Broadcasting...
 
BCH Codes
BCH CodesBCH Codes
BCH Codes
 
Channel Coding .pptx
Channel Coding .pptxChannel Coding .pptx
Channel Coding .pptx
 
Turbo Codes
Turbo CodesTurbo Codes
Turbo Codes
 
Digital Communication: Channel Coding
Digital Communication: Channel CodingDigital Communication: Channel Coding
Digital Communication: Channel Coding
 
Turbo Code
Turbo Code Turbo Code
Turbo Code
 
Defense Senior College on Error Coding presentation 4/22/2010
Defense Senior College on Error Coding presentation 4/22/2010Defense Senior College on Error Coding presentation 4/22/2010
Defense Senior College on Error Coding presentation 4/22/2010
 
Presentation
PresentationPresentation
Presentation
 
Unit-4.pptx
Unit-4.pptxUnit-4.pptx
Unit-4.pptx
 
Presentation ppt 3.pptx
Presentation ppt 3.pptxPresentation ppt 3.pptx
Presentation ppt 3.pptx
 
Lecture 4 from virtual university of pakistan
Lecture 4 from virtual university of pakistanLecture 4 from virtual university of pakistan
Lecture 4 from virtual university of pakistan
 
basicsofcodingtheory-160202182933-converted.pptx
basicsofcodingtheory-160202182933-converted.pptxbasicsofcodingtheory-160202182933-converted.pptx
basicsofcodingtheory-160202182933-converted.pptx
 
Digital Communication Techniques
Digital Communication TechniquesDigital Communication Techniques
Digital Communication Techniques
 

More from DrAimalKhan

Detection and Binary Decision in AWGN Channel
Detection and Binary Decision in AWGN ChannelDetection and Binary Decision in AWGN Channel
Detection and Binary Decision in AWGN Channel
DrAimalKhan
 
Lecture psk qam, digital modulation
Lecture psk qam, digital modulation Lecture psk qam, digital modulation
Lecture psk qam, digital modulation
DrAimalKhan
 
ASK amplitude Calculation and Phase Shift Keying
ASK amplitude Calculation and Phase Shift KeyingASK amplitude Calculation and Phase Shift Keying
ASK amplitude Calculation and Phase Shift Keying
DrAimalKhan
 
M-ary Modulation, noise modelling, bandwidth, Bandpass Modulation
M-ary Modulation, noise modelling, bandwidth, Bandpass ModulationM-ary Modulation, noise modelling, bandwidth, Bandpass Modulation
M-ary Modulation, noise modelling, bandwidth, Bandpass Modulation
DrAimalKhan
 
2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan
2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan
2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan
DrAimalKhan
 
Digital Communications Lecture 1
Digital Communications Lecture 1Digital Communications Lecture 1
Digital Communications Lecture 1
DrAimalKhan
 

More from DrAimalKhan (6)

Detection and Binary Decision in AWGN Channel
Detection and Binary Decision in AWGN ChannelDetection and Binary Decision in AWGN Channel
Detection and Binary Decision in AWGN Channel
 
Lecture psk qam, digital modulation
Lecture psk qam, digital modulation Lecture psk qam, digital modulation
Lecture psk qam, digital modulation
 
ASK amplitude Calculation and Phase Shift Keying
ASK amplitude Calculation and Phase Shift KeyingASK amplitude Calculation and Phase Shift Keying
ASK amplitude Calculation and Phase Shift Keying
 
M-ary Modulation, noise modelling, bandwidth, Bandpass Modulation
M-ary Modulation, noise modelling, bandwidth, Bandpass ModulationM-ary Modulation, noise modelling, bandwidth, Bandpass Modulation
M-ary Modulation, noise modelling, bandwidth, Bandpass Modulation
 
2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan
2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan
2nd Lecture Digital Communications BE Computer Engg. NUST, Pakistan
 
Digital Communications Lecture 1
Digital Communications Lecture 1Digital Communications Lecture 1
Digital Communications Lecture 1
 

Recently uploaded

Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
ViniHema
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
bakpo1
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Teleport Manpower Consultant
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
Jayaprasanna4
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
zwunae
 
space technology lecture notes on satellite
space technology lecture notes on satellitespace technology lecture notes on satellite
space technology lecture notes on satellite
ongomchris
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
ydteq
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
Vijay Dialani, PhD
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
fxintegritypublishin
 
AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
BrazilAccount1
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
obonagu
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
gdsczhcet
 

Recently uploaded (20)

Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
 
space technology lecture notes on satellite
space technology lecture notes on satellitespace technology lecture notes on satellite
space technology lecture notes on satellite
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
 
AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
 

Basics of channel coding

  • 1. Course Outline ■ Digital Communications Basic Blocks, Introduction ■ Classification of signals ,Deterministic and Random, Periodic and Non-periodic (Signal, Energy and Power Signals, Analog and Discrete Signals) ■ Spectral Density, Auto-Correlation, ■ Bandwidth of Digital Signals, Baseband versus Band pass ■ Sampling Theorem, Aliasing, Over Sampling ■ Sampling and Quantizing effects, Channel effects, Signal to Noise Ratio ■ Pulse Code Modulation, PCM based Time division multiplexing
  • 2. Course Outline ■ Uniform and Non Uniform Quantization, Companding ■ Waveform Representation of Binary Digits, M-ary Pulse Modulation waveforms ■ PCM waveform types, Line Coding ■ Correlative Coding, duo-binary coding and decoding, precoding ■ Error Performance, degradation in Digital Communication System, Demodulation and detection, SNR parameter in Digital Communication System ■ Detection of Binary Signals in Gaussian Noise, Matched Filter
  • 3. Course Outline ■ Inter symbol Interference, Pulse shaping to reduce ISI, Error Performance ■ Eye Patterns, Digital Demodulation Techniques ■ Spread Spectrum, Frequency Hopping and Direct Sequence
  • 4. What we discussed in the last lecture ■ Bandwidth Calculation ■ Inter Symbol Interference
  • 6. How to combat ISI ■ Pulse shaping By using Nyquist Pulses ■ Using Equalization Zero Forcing Equalization Mean Minimum Square Equalizer
  • 7. Channel Coding in Our Everyday Lives: Examples 185
  • 8. Channel Coding in Our Everyday Lives: Examples 186
  • 9. Channel Coding in Our Everyday Lives: Examples 187
  • 10. 188 What is Channel Coding? Digital Communications over physical channels is prone to errors Channel Coding means : Introducing redundancy (i.e., adding extra bits) to information messages to protect against channel errors
  • 11. 4 What is Channel Coding? Channel coding is the art or science in order to protect data symbols against transmission/storage errors. Channel coding in only possible in digital transmission/storage systems. Redundancy is added to the data at the transmitter side, so that transmission/storage errors can be detected and/or corrected at the receiver. Main tasks: • Error detection • Error correction • Error concealment. Without channel coding, robust data transmission via noisy communication channels as well as reliable storage is not possible. Therefore, channel coding is applied in many different applications, particularly in digital transmission systems and in digital storage systems.
  • 12. 5 Applications of Channel Coding Digital transmission systems • mobile radio systems • data modems, internet • satellite communication systems, deep-space probes • underwater communication systems • optical communication systems Digital storage systems • compact disc (CD), digital versatile disc (DVD), coin disc • digital audio tape (DAT) • hard disc, magnetic storage systems 6
  • 13. 7 Digital Transmission System Source E Source encoder E Encryption E Channel encoder E Modulator c Physical channel c De- modulator 'Channel decoder 'De- cryption 'Source decoder ' Sink u ˆu x y Transmitter Receiver 8
  • 14. 8 Shannon’s Information Theory Claude E. Shannon (1948) • Source coding: Data compression • Cryptology: Data encryption • Channel coding: Error detection/correction/concealment Separation theorem: Source coding, encryption, and channel coding may be separated without information loss (note that the separation theorem holds for very long data sequences only)
  • 15. 11 Tasks of Channel Coding • Error detection and error correction ⇒ enhancement of error probability (data security) and/or ⇒ reduction of transmit power (enhancement of power efficiency) • Error concealment (in conjunction with source coding) ⇒ improvement of subjective performance • Unequal error protection (in conjunction with source coding) ⇒ reduction of the number of parity check symbols 12
  • 16. 12 Fundamental Principles of Channel Coding • Forward error correction (FEC): In forward error correction schemes there is no feedback from the channel decoder to the channel encoder. • Automatic repeat request (ARQ): In automatic repeat request schemes there is feedback from the channel decoder to the channel encoder. For example, a code word may be repeated until the channel decoder does not detect any error. Alternatively, additional parity bits may be transmitted until the channel decoder does not detect any error. The additional decoding delay is not tolerable in all transmission schemes, such as in real-time speech transmission schemes. Within this lecture our focus is on FEC techniques.
  • 17. • Cyclic block codes, generator polynomial, parity check polynomial 16 Definition of Block Codes We denote a sequence u := [u0, u1, . . . , uk−1] of k info symbols as an info word. The info symbols ui, i = 0, 1, . . . k − 1, are defined over the alphabet {0, 1, . . . , q − 1}, where q is the number of elements (“cardinality”) of the symbol alphabet. Definition (block code): An (n, k)q block encoder maps an info word u = [u0, u1, . . . , uk−1] of length k onto a code word x := [x0, x1, . . . , xn−1] of length n, where n > k. The code symbols xi, i = 0, 1, . . . , n − 1, are assumed to be within the same alphabet {0, 1, . . . , q − 1}. The assignment of code words with respect to the info words is • unambiguous and reversible: For each code word there is exactly one info word • time invariant: The mapping rule does not change in time • memoryless: Each info word effects only one code word
  • 18. 17 Generation of a Block Code u0 u1 x0 x1 xi ∈ {0, 1, . . . , q − 1}, 0 ≤ i ≤ n − 1 ui ∈ {0, 1, . . . , q − 1}, 0 ≤ i ≤ k − 1 u ∈ {0, 1, . . . , q − 1}k x ∈ {0, 1, . . . , q − 1}n xn−1 uk−1 . . . . . . Encoder Code word Info word 18
  • 19. 18 Redundancy, Error Detection, Error Correction A code C is the set of all qk code words. Since n symbols are needed in order to transmit k info symbols, where n > k, the code contains redundancy, because only qk of the qn possible combinations are allowed. This redundancy is used for error detection, error correction, or error concealment by the receiver. The transmitted (possibly erroneous or noisy) code words are denoted as received words y. For hard-decision decoding yi ∈ {0, 1, . . . , q − 1}, i = 0, 1, . . . , n − 1, by definition. The ratio R := k n < 1 is called code rate. The smaller the code rate, the larger is the redundancy given the same length n of the code word. The bandwidth expansion is R−1 . ⇒ Trade-off between bandwidth efficiency and power efficiency.
  • 20. 19 Systematic Codes Definition (systematic code): A code is called systematic, if the mapping between info symbols and code symbols is such that the info symbols are explicitly contained in the code words. The n − k remaining symbols are called parity check symbols (q = 2: parity check bits). Example 1: (3, 2)2 single parity check (SPC) code: (q = 2, i.e., one symbol corresponds to one bit) Info word u = [u0, u1] Code word x = [x0, x1, x2] [00] [000] [01] [011] [10] [101] [11] [110] Parity check equation: u0 ⊕ u1 ⊕ x2 = 0 (⊕: modulo-q addition) Code: C = {[000], [011], [101], [110]} 20
  • 21. • Catastrophic convolutional encoders 66 Coded Transmission System with Convolutional Codes s Convolutional encoder E Discrete channel Convolutional decoder E uk xn yn ˆuk uk: Info bits, uk ∈ {0, 1} xn: Code bits, xn ∈ {0, 1} yn: Received values, hard-decision dec.: yn ∈ {0, 1}, soft-decision dec.: yn ∈ IR ˆuk: Decoded info bits, ˆuk ∈ {0, 1} k: Index before encoder n: Index after encoder
  • 22. 67 Convolutional Codes Convolutional codes are able to encode the info bits continuously. We restrict ourselves to binary convolutional codes. The ratio between the number of info bits and the number of code bits is called coding rate R. In practice, information is typically transmitted block-wise, rather than continuously. The number of info bits per block is denoted as K, i.e., the index before the encoder is 0 ≤ k ≤ K − 1. The number of coded bits per block is denoted as N, i.e., the index after the encoder is 0 ≤ n ≤ N − 1. 68
  • 23. 68 Shift Register Representation of a Binary, Non-Recursive R = 1/2 Convolutional Encoder with 4 States u u u u u u uh E c c T EE E D D t t t t t t t t &% '$ &% '$ &% '$ + + + uk xnuk−1 uk−2 Memory length: ν = 2 Number of states: S = 2ν x2,k x1,k