SlideShare a Scribd company logo
1 of 13
INTRODUCTION TO INFORMATION THEORY
AND APPLICATIONS
2014
LOVELY
PROFESSIONAL
UNIVERSITY
SUBMITTED BY SUBMITTED TO
NAME :- BIKASH THAPA
ROLL NO :- A55
SECTION :- 1407
GROUP :- 1
COURSE :- BSC.IT
REG NO :- 11413230
“TRANSFORMING EDUCATION TRASNSFORMING INDIA”
Cap 125 Introduction to information theory and applications
2
Acknowledgement
It was really an awesome experience to be a participant in writing term
paper. I really enjoyed using my own earned skilled and experience in
the class as well as book study to accomplish the term paper topic. As
can as I can do I have done my all the best and I am hoping it will bring
satisfactory result.
In the course of being involved in writing term
paper, I got lots of help and support from my teachers, colleagues and all
my friends. So I can’t remain without thanking them for their seen and
unseen help so I would like to thanks all of them. I also owe to those
authors whose books proved to be a milestone to me to accomplish the
term paper.
At last I like to thanks my parents for their great support to
complete my term paper and let me to study BSc.IT (information
technology) in Lovely Professional University.
Bikash Thapa
Cap 125 Introduction to information theory and applications
3
Table of Contents
1.1 Analog signal ...........................................................................................5
1.2 Digital signal............................................................................................9
1.3 Difference between digital and analog signal.....................................12
Abstract
Cap 125 Introduction to information theory and applications
4
ANALOG AND DIGITAL SIGNAL
Cap 125 Introduction to information theory and applications
5
Signal:
A signal is defined as a function of one or more variables
which conveys information on the nature of a physical phenomenon. The
value of the function can be a real valued scalar quantity, a complex
valued quantity, or perhaps a vector.
System:
A system is defined as an entity that manipulates one or
more signals to accomplish a function, thereby yielding new signals.
Continuous-time signal:
A signal x (t) is said to be a continuous time
signal if it is defined for all time t.
Discrete-time signal:
A discrete time signal x [nT] has values
specified only at discrete points in time.
Signal processing:
A system characterized by the type of
operation that it performs on the signal. For example, if the operation is
linear, the system is called linear. If the operation is non-linear, the
system is said to be non-linear, and so forth. Such operations are usually
referred to as “Signal Processing”
1.1 Analog signal
An analog or analogue signal is any continuous signal for
Cap 125 Introduction to information theory and applications
6
which the time varying feature (variable) of the signal is a representation
of some other time varying quantity, i.e., analog to another time varying
signal. For example, in an analog audio signal, the
instantaneous voltage of the signal varies continuously with
the pressure of the sound waves. It differs from a digital signal, in which
a continuous quantity is represented by a discrete function which can
only take on one of a finite number of values. The term analog signal
usually refers to electrical signals; however, mechanical, hydraulic, and
other systems may also convey analog signals.
An analog signal uses some property of the medium to convey the
signal's information. For example, an aneroid barometer uses rotary
position as the signal to convey pressure information. In an electrical
signal, the voltage, current, or frequency of the signal may be varied to
represent the information.
Any information may be conveyed by an analog signal; often such a
signal is a measured response to changes in physical phenomena, such
as sound, light, temperature, position, or pressure. The physical variable
is converted to an analog signal by a transducer. For example, in sound
recording, fluctuations in air pressure (that is to say, sound) strike the
diaphragm of a microphone which induces corresponding fluctuations in
the current produced by a coil in an electromagnetic microphone, or the
voltage produced by a condenser microphone. The voltage or the current
is said to be an "analog" of the sound.
An analog signal has a theoretically infinite resolution. In practice an
analog signal is subject to electronic noise and distortion introduced
by communication channels and signal processing operations, which can
progressively degrade the signal-to-noise ratio. In contrast, digital
signals have a finite resolution. Converting an analog signal to digital
form introduces a constant low-level noise called quantization noise into
the signal which determines the noise floor, but once in digital form the
signal can in general be processed or transmitted without introducing
additional noise or distortion. Therefore as analog signal processing
systems become more complex, they may ultimately degrade signal
Cap 125 Introduction to information theory and applications
7
resolution to such an extent that their performance is surpassed by digital
systems. This explains the widespread use of digital signals in
preference to analog in modern technology. In analog systems, it is
difficult to detect when such degradation occurs. However, in digital
systems, degradation can not only be detected but can be corrected as
well.
Example of Analog Signals:
 An analog signal can be any time-varying signal.
 Minimum and maximum values can be either positive or negative.
 They can be periodic (repeating) or non-periodic.
 Sine waves and square waves are two common analog signals.
 Note that this square wave is not a digital signal because its
minimum value is negative.
 Video and Audio
Fig: analog signal
Analog transmission:
Cap 125 Introduction to information theory and applications
8
 Transmit analog signals without regard to content.
 Attenuation limits length of transmission link
 Cascaded amplifiers boost signals energy for longer distances but
cause distortion
 Analog data can tolerate distortion.
 Introduces errors in digital data.
Pros and Cons of Analog Signals:
Advantages:
 Major advantages of the analog signal is infinite amount of data.
 Density is much higher.
 Easy processing.
Disadvantages:
 Unwanted noise in recording.
 If we transmit data at long distance then unwanted disturbance is
there.
 Generation loss is also a big cons of analog signals.
Applications of analog signal are:
Cap 125 Introduction to information theory and applications
9
 Thermometer
 Photocopiers
Old land-line telephones
Audio tapes
VCRs (same as TV)
1.2 Digital signal
A digital signal is a physical signal that is a representation of a
sequence of discrete values. The term digital signal can refer to either of
the following:
1. any continuous-time waveform signal used in digital
communication, representing a bit stream or other sequence
of discrete values
2. a pulse train signal that switches between a discrete number of
voltage levels or levels of light intensity, also known as a line
coded signal or baseband transmission, for example a signal found
in digital electronics or in serial communications, or a pulse code
modulation (PCM) representation of a digitized analog signal.
A signal that is generated by means of a digital modulation method
(digital pass band transmission), to be transferred between modems, is in
the first case considered as a digital signal, and in the second case as
converted to an analog signal. In computer architecture and
other digital systems, a waveform that switches between two voltage
levels representing the two states of a Boolean value (0 and 1) is referred
to as a digital signal, even though it is an analog voltage waveform,
since it is interpreted in terms of only two levels.
Cap 125 Introduction to information theory and applications
10
Example of Digital signal:
 Digital signal are commonly referred to as square waves or clock
signals.
 Their minimum value must be 0 volts, and their maximum value
must be 5 volts.
 They can be periodic (repeating) or non-periodic.
 The time the signal is high (tH) can vary anywhere from 1% of the
period to 99% of the period.
 Text and Integers.
Digital Signal Transmission:
 Concerned with the content of the signal.
 Attenuation endangers integrity of data.
 Digital signal
Repeaters achieve greater distance.
Repeaters recover the signal and retransmit.
Pros and Cons of Digital Signal
Cap 125 Introduction to information theory and applications
11
Advantages:
 Because of their digital nature they can travel faster in over digital
lines.
 Ability to transfer more data as compared to analog.
Disadvantages:
 Greater bandwidth is essential.
 Systems and processing is more complex.
Applications of Digital Signal are:
 PCs, PDAs
 Mobile Phones.
Difference in working:
 The working of the digital signals are more reliable and accurate
because they use the digital media or the numeric method where as
analog signals are based on the small fluctuations.
 Digital signals are used to play that information which is came
from re-sampling, whereas analog are known for playing recorded
data.
 Digital signals have priority over analog signals because with the
help of digital signals users have ability to change the visual and
the audio or re-record it but with analog signals you can do such
parameters.
Cap 125 Introduction to information theory and applications
12
1.3 Difference between digital and analog signal
Analog signal
1. It produces a continuous signal.
2. Signal that is continuous in a time
and can assume an infinite number
of values in a given range.
3. It is denoted by sine wave.
4. Analog hardware is not flexible.
5. It Store data in the form of wave
signal.
6. Analog instrument consume more
power.
7. It is of low cost and portable.
For e.g.:- thermometer.
Wave form in analog signal
Digital signal
1. It produce a discrete signal
2. Signal that is continuous in a
time and assumes only a
limited number of values.
3. It is denoted by square wave.
4. Digital hardware is flexible in
implementation
5. It store data in the form of
binary bit.
6. Digital instrument consume
less power.
7. It is expensive and not easily
portable.
For e.g.: computers.
Wave form in digital
signal
Cap 125 Introduction to information theory and applications
13
Reference books
1. Digital Signal Processing By.
Sen M. Kuo & Woon-Seng Gan
2. Digital Signal Processing a Practical Approach. By
Emmanuel C. Ifeachor & Barrie W. Jervis
3. Digital Signal Processing Principles, Algorithms and Applications
By:
John G.Proakis & Dimitris G.Manolakis

More Related Content

What's hot

Digital communications
Digital communicationsDigital communications
Digital communicationsAllanki Rao
 
Encoding and Decoding
Encoding and DecodingEncoding and Decoding
Encoding and Decodingmrhaken
 
Analogue to digital conversion
Analogue to digital conversionAnalogue to digital conversion
Analogue to digital conversionsimonandisa
 
Introduction of digital communication
Introduction of digital communicationIntroduction of digital communication
Introduction of digital communicationasodariyabhavesh
 
Sensor technology module-3-interface electronic circuits
Sensor technology module-3-interface electronic circuitsSensor technology module-3-interface electronic circuits
Sensor technology module-3-interface electronic circuitsSweta Kumari Barnwal
 
Introduction to dsp by bibhu prasad ganthia
Introduction to dsp by bibhu prasad ganthiaIntroduction to dsp by bibhu prasad ganthia
Introduction to dsp by bibhu prasad ganthiaDr. Bibhu Prasad Ganthia
 
Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...
Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...
Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...www. mientayvn.com
 
Discrete-Time Signal Processing
Discrete-Time Signal ProcessingDiscrete-Time Signal Processing
Discrete-Time Signal Processinglancer350
 
Lecture7 encodingmodulation
Lecture7 encodingmodulationLecture7 encodingmodulation
Lecture7 encodingmodulationH K
 
The analog to digital conversion process
The analog to digital conversion processThe analog to digital conversion process
The analog to digital conversion processDJNila
 
An Overview of Digital Communication and Transmission
An Overview of Digital Communication and TransmissionAn Overview of Digital Communication and Transmission
An Overview of Digital Communication and TransmissionDon Norwood
 
Digital Communications Midterm :D
Digital Communications Midterm :DDigital Communications Midterm :D
Digital Communications Midterm :DChoi Kyung Hyo
 
Digital signal processing
Digital signal processingDigital signal processing
Digital signal processingVedavyas PBurli
 

What's hot (20)

Chapter 2
Chapter 2Chapter 2
Chapter 2
 
Digital communications
Digital communicationsDigital communications
Digital communications
 
Encoding and Decoding
Encoding and DecodingEncoding and Decoding
Encoding and Decoding
 
Analogue to digital conversion
Analogue to digital conversionAnalogue to digital conversion
Analogue to digital conversion
 
Fit l03 information_communication
Fit l03 information_communicationFit l03 information_communication
Fit l03 information_communication
 
Introduction of digital communication
Introduction of digital communicationIntroduction of digital communication
Introduction of digital communication
 
Lec2
Lec2Lec2
Lec2
 
Sensor technology module-3-interface electronic circuits
Sensor technology module-3-interface electronic circuitsSensor technology module-3-interface electronic circuits
Sensor technology module-3-interface electronic circuits
 
Digital communication unit 1
Digital communication unit 1Digital communication unit 1
Digital communication unit 1
 
Introduction to dsp by bibhu prasad ganthia
Introduction to dsp by bibhu prasad ganthiaIntroduction to dsp by bibhu prasad ganthia
Introduction to dsp by bibhu prasad ganthia
 
Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...
Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...
Ee341 dsp1 1_sv_chapter1_hay truy cap vao trang www.mientayvn.com de tai them...
 
Discrete-Time Signal Processing
Discrete-Time Signal ProcessingDiscrete-Time Signal Processing
Discrete-Time Signal Processing
 
Lecture7 encodingmodulation
Lecture7 encodingmodulationLecture7 encodingmodulation
Lecture7 encodingmodulation
 
The analog to digital conversion process
The analog to digital conversion processThe analog to digital conversion process
The analog to digital conversion process
 
Class notes2
Class notes2Class notes2
Class notes2
 
An Overview of Digital Communication and Transmission
An Overview of Digital Communication and TransmissionAn Overview of Digital Communication and Transmission
An Overview of Digital Communication and Transmission
 
Lecture 18 (5)
Lecture 18 (5)Lecture 18 (5)
Lecture 18 (5)
 
Digital Communications Midterm :D
Digital Communications Midterm :DDigital Communications Midterm :D
Digital Communications Midterm :D
 
Digital signal processing
Digital signal processingDigital signal processing
Digital signal processing
 
Digital Communication Techniques
Digital Communication TechniquesDigital Communication Techniques
Digital Communication Techniques
 

Viewers also liked

Applications of Information Theory
Applications of Information TheoryApplications of Information Theory
Applications of Information TheoryDarshan Bhatt
 
Information Theory and Coding Notes - Akshansh
Information Theory and Coding Notes - AkshanshInformation Theory and Coding Notes - Akshansh
Information Theory and Coding Notes - AkshanshAkshansh Chaudhary
 
Information theory & coding (ECE)
Information theory & coding (ECE)Information theory & coding (ECE)
Information theory & coding (ECE)nitmittal
 
Data communication and network Chapter -1
Data communication and network Chapter -1Data communication and network Chapter -1
Data communication and network Chapter -1Zafar Ayub
 
Information Theory and Coding Question Bank
Information Theory and Coding Question BankInformation Theory and Coding Question Bank
Information Theory and Coding Question Bankmiraclebabu
 
2. analog and digital priniting
2.   analog and digital priniting2.   analog and digital priniting
2. analog and digital prinitingAdane Nega
 
Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...
Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...
Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...marsaee
 
Probabilistic Methods Of Signal And System Analysis, 3rd Edition
Probabilistic Methods Of Signal And System Analysis, 3rd EditionProbabilistic Methods Of Signal And System Analysis, 3rd Edition
Probabilistic Methods Of Signal And System Analysis, 3rd EditionPreston King
 
Steganography Tool & Steganography Detection Tool - Presentation
Steganography Tool & Steganography Detection Tool - PresentationSteganography Tool & Steganography Detection Tool - Presentation
Steganography Tool & Steganography Detection Tool - PresentationLaili Aidi
 
YOGA ASANA by Geetanjali
YOGA ASANA by GeetanjaliYOGA ASANA by Geetanjali
YOGA ASANA by GeetanjaliAjit Kumar
 
Information theory
Information theoryInformation theory
Information theoryroger Pitiot
 
Steganography and Steganalysis
Steganography and Steganalysis Steganography and Steganalysis
Steganography and Steganalysis zaidsalfawzan
 
Steganalysis ppt
Steganalysis pptSteganalysis ppt
Steganalysis pptOm Vishnoi
 
Introduction to random variables
Introduction to random variablesIntroduction to random variables
Introduction to random variablesHadley Wickham
 
Discrete and continuous probability distributions ppt @ bec doms
Discrete and continuous probability distributions ppt @ bec domsDiscrete and continuous probability distributions ppt @ bec doms
Discrete and continuous probability distributions ppt @ bec domsBabasab Patil
 

Viewers also liked (20)

Applications of Information Theory
Applications of Information TheoryApplications of Information Theory
Applications of Information Theory
 
Information theory
Information theoryInformation theory
Information theory
 
Information Theory and Coding Notes - Akshansh
Information Theory and Coding Notes - AkshanshInformation Theory and Coding Notes - Akshansh
Information Theory and Coding Notes - Akshansh
 
Information theory & coding (ECE)
Information theory & coding (ECE)Information theory & coding (ECE)
Information theory & coding (ECE)
 
Data communication and network Chapter -1
Data communication and network Chapter -1Data communication and network Chapter -1
Data communication and network Chapter -1
 
Soa 2013
Soa 2013Soa 2013
Soa 2013
 
Open Power Monitor
Open Power Monitor Open Power Monitor
Open Power Monitor
 
Information Theory and Coding Question Bank
Information Theory and Coding Question BankInformation Theory and Coding Question Bank
Information Theory and Coding Question Bank
 
2. analog and digital priniting
2.   analog and digital priniting2.   analog and digital priniting
2. analog and digital priniting
 
Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...
Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...
Fundamentals of information_theory_and_coding_design__discrete_mathematics_an...
 
Probabilistic Methods Of Signal And System Analysis, 3rd Edition
Probabilistic Methods Of Signal And System Analysis, 3rd EditionProbabilistic Methods Of Signal And System Analysis, 3rd Edition
Probabilistic Methods Of Signal And System Analysis, 3rd Edition
 
Steganography Tool & Steganography Detection Tool - Presentation
Steganography Tool & Steganography Detection Tool - PresentationSteganography Tool & Steganography Detection Tool - Presentation
Steganography Tool & Steganography Detection Tool - Presentation
 
YOGA ASANA by Geetanjali
YOGA ASANA by GeetanjaliYOGA ASANA by Geetanjali
YOGA ASANA by Geetanjali
 
Information theory
Information theoryInformation theory
Information theory
 
Applications of random variable
Applications of random variableApplications of random variable
Applications of random variable
 
Steganography and Steganalysis
Steganography and Steganalysis Steganography and Steganalysis
Steganography and Steganalysis
 
Steganalysis ppt
Steganalysis pptSteganalysis ppt
Steganalysis ppt
 
Introduction to random variables
Introduction to random variablesIntroduction to random variables
Introduction to random variables
 
Discrete and continuous probability distributions ppt @ bec doms
Discrete and continuous probability distributions ppt @ bec domsDiscrete and continuous probability distributions ppt @ bec doms
Discrete and continuous probability distributions ppt @ bec doms
 
Random variables
Random variablesRandom variables
Random variables
 

Similar to Intorduction to information theory and applications copy

Computer Communication & Computer Networking Module 1 , 2 Notes.pdf
Computer Communication & Computer Networking Module 1 , 2 Notes.pdfComputer Communication & Computer Networking Module 1 , 2 Notes.pdf
Computer Communication & Computer Networking Module 1 , 2 Notes.pdfnavikvel
 
86919253 data-acquisition-system-ppt
86919253 data-acquisition-system-ppt86919253 data-acquisition-system-ppt
86919253 data-acquisition-system-pptGovindaChandraBehera1
 
Ch 04 analog and digital communications
Ch 04 analog and digital communicationsCh 04 analog and digital communications
Ch 04 analog and digital communicationssakariachromabook
 
Analog and Digital Signals and how to convert between them..pptx
Analog and Digital Signals and how to convert between them..pptxAnalog and Digital Signals and how to convert between them..pptx
Analog and Digital Signals and how to convert between them..pptxMohamedHussain648450
 
A presentation about Analog and Digital Signals and how to convert between them.
A presentation about Analog and Digital Signals and how to convert between them.A presentation about Analog and Digital Signals and how to convert between them.
A presentation about Analog and Digital Signals and how to convert between them.MohamedHussain648450
 
Communication System (3).ppt
Communication System (3).pptCommunication System (3).ppt
Communication System (3).pptPrathamesh508521
 
Classification of Signal.pdf
Classification of Signal.pdfClassification of Signal.pdf
Classification of Signal.pdfShivarkarSandip
 
24071 digitalcommunication
24071 digitalcommunication24071 digitalcommunication
24071 digitalcommunicationsharma ellappan
 
OSI Model - Analog and digital signal conversion and processing
OSI Model - Analog and digital signal conversion and processingOSI Model - Analog and digital signal conversion and processing
OSI Model - Analog and digital signal conversion and processingRolando Ramos III
 
data-acquisition-system-ppt
data-acquisition-system-pptdata-acquisition-system-ppt
data-acquisition-system-pptRavi Anand
 
53C H A P T E R 3Introduction toPhysical Layern.docx
53C H A P T E R  3Introduction toPhysical Layern.docx53C H A P T E R  3Introduction toPhysical Layern.docx
53C H A P T E R 3Introduction toPhysical Layern.docxevonnehoggarth79783
 
Networking notes part2 final
Networking notes part2 finalNetworking notes part2 final
Networking notes part2 finalSHARVAN PRAJAPATI
 
Class note 4...nazmun nahar 1834902176
Class note 4...nazmun nahar 1834902176Class note 4...nazmun nahar 1834902176
Class note 4...nazmun nahar 1834902176Nazmun Nahar
 
Write one page essay to explain how you relate signals and systems t.pdf
Write one page essay to explain how you relate signals and systems t.pdfWrite one page essay to explain how you relate signals and systems t.pdf
Write one page essay to explain how you relate signals and systems t.pdfezzi97
 

Similar to Intorduction to information theory and applications copy (20)

Assignment 4
Assignment 4 Assignment 4
Assignment 4
 
Computer Communication & Computer Networking Module 1 , 2 Notes.pdf
Computer Communication & Computer Networking Module 1 , 2 Notes.pdfComputer Communication & Computer Networking Module 1 , 2 Notes.pdf
Computer Communication & Computer Networking Module 1 , 2 Notes.pdf
 
86919253 data-acquisition-system-ppt
86919253 data-acquisition-system-ppt86919253 data-acquisition-system-ppt
86919253 data-acquisition-system-ppt
 
Ch 04 analog and digital communications
Ch 04 analog and digital communicationsCh 04 analog and digital communications
Ch 04 analog and digital communications
 
W02 l03 information-communication (1)
W02 l03 information-communication (1)W02 l03 information-communication (1)
W02 l03 information-communication (1)
 
Analog and Digital Signals and how to convert between them..pptx
Analog and Digital Signals and how to convert between them..pptxAnalog and Digital Signals and how to convert between them..pptx
Analog and Digital Signals and how to convert between them..pptx
 
A presentation about Analog and Digital Signals and how to convert between them.
A presentation about Analog and Digital Signals and how to convert between them.A presentation about Analog and Digital Signals and how to convert between them.
A presentation about Analog and Digital Signals and how to convert between them.
 
Communication System (3).ppt
Communication System (3).pptCommunication System (3).ppt
Communication System (3).ppt
 
Classification of Signal.pdf
Classification of Signal.pdfClassification of Signal.pdf
Classification of Signal.pdf
 
24071 digitalcommunication
24071 digitalcommunication24071 digitalcommunication
24071 digitalcommunication
 
Dsp class 1
Dsp class 1Dsp class 1
Dsp class 1
 
OSI Model - Analog and digital signal conversion and processing
OSI Model - Analog and digital signal conversion and processingOSI Model - Analog and digital signal conversion and processing
OSI Model - Analog and digital signal conversion and processing
 
data-acquisition-system-ppt
data-acquisition-system-pptdata-acquisition-system-ppt
data-acquisition-system-ppt
 
dc1.pdf
dc1.pdfdc1.pdf
dc1.pdf
 
Source coding systems
Source coding systemsSource coding systems
Source coding systems
 
53C H A P T E R 3Introduction toPhysical Layern.docx
53C H A P T E R  3Introduction toPhysical Layern.docx53C H A P T E R  3Introduction toPhysical Layern.docx
53C H A P T E R 3Introduction toPhysical Layern.docx
 
Networking notes part2 final
Networking notes part2 finalNetworking notes part2 final
Networking notes part2 final
 
Class note 4...nazmun nahar 1834902176
Class note 4...nazmun nahar 1834902176Class note 4...nazmun nahar 1834902176
Class note 4...nazmun nahar 1834902176
 
Write one page essay to explain how you relate signals and systems t.pdf
Write one page essay to explain how you relate signals and systems t.pdfWrite one page essay to explain how you relate signals and systems t.pdf
Write one page essay to explain how you relate signals and systems t.pdf
 
ADC & DAC
ADC & DACADC & DAC
ADC & DAC
 

Recently uploaded

Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...M56BOOKSTORE PRODUCT/SERVICE
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 

Recently uploaded (20)

Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 

Intorduction to information theory and applications copy

  • 1. INTRODUCTION TO INFORMATION THEORY AND APPLICATIONS 2014 LOVELY PROFESSIONAL UNIVERSITY SUBMITTED BY SUBMITTED TO NAME :- BIKASH THAPA ROLL NO :- A55 SECTION :- 1407 GROUP :- 1 COURSE :- BSC.IT REG NO :- 11413230 “TRANSFORMING EDUCATION TRASNSFORMING INDIA”
  • 2. Cap 125 Introduction to information theory and applications 2 Acknowledgement It was really an awesome experience to be a participant in writing term paper. I really enjoyed using my own earned skilled and experience in the class as well as book study to accomplish the term paper topic. As can as I can do I have done my all the best and I am hoping it will bring satisfactory result. In the course of being involved in writing term paper, I got lots of help and support from my teachers, colleagues and all my friends. So I can’t remain without thanking them for their seen and unseen help so I would like to thanks all of them. I also owe to those authors whose books proved to be a milestone to me to accomplish the term paper. At last I like to thanks my parents for their great support to complete my term paper and let me to study BSc.IT (information technology) in Lovely Professional University. Bikash Thapa
  • 3. Cap 125 Introduction to information theory and applications 3 Table of Contents 1.1 Analog signal ...........................................................................................5 1.2 Digital signal............................................................................................9 1.3 Difference between digital and analog signal.....................................12 Abstract
  • 4. Cap 125 Introduction to information theory and applications 4 ANALOG AND DIGITAL SIGNAL
  • 5. Cap 125 Introduction to information theory and applications 5 Signal: A signal is defined as a function of one or more variables which conveys information on the nature of a physical phenomenon. The value of the function can be a real valued scalar quantity, a complex valued quantity, or perhaps a vector. System: A system is defined as an entity that manipulates one or more signals to accomplish a function, thereby yielding new signals. Continuous-time signal: A signal x (t) is said to be a continuous time signal if it is defined for all time t. Discrete-time signal: A discrete time signal x [nT] has values specified only at discrete points in time. Signal processing: A system characterized by the type of operation that it performs on the signal. For example, if the operation is linear, the system is called linear. If the operation is non-linear, the system is said to be non-linear, and so forth. Such operations are usually referred to as “Signal Processing” 1.1 Analog signal An analog or analogue signal is any continuous signal for
  • 6. Cap 125 Introduction to information theory and applications 6 which the time varying feature (variable) of the signal is a representation of some other time varying quantity, i.e., analog to another time varying signal. For example, in an analog audio signal, the instantaneous voltage of the signal varies continuously with the pressure of the sound waves. It differs from a digital signal, in which a continuous quantity is represented by a discrete function which can only take on one of a finite number of values. The term analog signal usually refers to electrical signals; however, mechanical, hydraulic, and other systems may also convey analog signals. An analog signal uses some property of the medium to convey the signal's information. For example, an aneroid barometer uses rotary position as the signal to convey pressure information. In an electrical signal, the voltage, current, or frequency of the signal may be varied to represent the information. Any information may be conveyed by an analog signal; often such a signal is a measured response to changes in physical phenomena, such as sound, light, temperature, position, or pressure. The physical variable is converted to an analog signal by a transducer. For example, in sound recording, fluctuations in air pressure (that is to say, sound) strike the diaphragm of a microphone which induces corresponding fluctuations in the current produced by a coil in an electromagnetic microphone, or the voltage produced by a condenser microphone. The voltage or the current is said to be an "analog" of the sound. An analog signal has a theoretically infinite resolution. In practice an analog signal is subject to electronic noise and distortion introduced by communication channels and signal processing operations, which can progressively degrade the signal-to-noise ratio. In contrast, digital signals have a finite resolution. Converting an analog signal to digital form introduces a constant low-level noise called quantization noise into the signal which determines the noise floor, but once in digital form the signal can in general be processed or transmitted without introducing additional noise or distortion. Therefore as analog signal processing systems become more complex, they may ultimately degrade signal
  • 7. Cap 125 Introduction to information theory and applications 7 resolution to such an extent that their performance is surpassed by digital systems. This explains the widespread use of digital signals in preference to analog in modern technology. In analog systems, it is difficult to detect when such degradation occurs. However, in digital systems, degradation can not only be detected but can be corrected as well. Example of Analog Signals:  An analog signal can be any time-varying signal.  Minimum and maximum values can be either positive or negative.  They can be periodic (repeating) or non-periodic.  Sine waves and square waves are two common analog signals.  Note that this square wave is not a digital signal because its minimum value is negative.  Video and Audio Fig: analog signal Analog transmission:
  • 8. Cap 125 Introduction to information theory and applications 8  Transmit analog signals without regard to content.  Attenuation limits length of transmission link  Cascaded amplifiers boost signals energy for longer distances but cause distortion  Analog data can tolerate distortion.  Introduces errors in digital data. Pros and Cons of Analog Signals: Advantages:  Major advantages of the analog signal is infinite amount of data.  Density is much higher.  Easy processing. Disadvantages:  Unwanted noise in recording.  If we transmit data at long distance then unwanted disturbance is there.  Generation loss is also a big cons of analog signals. Applications of analog signal are:
  • 9. Cap 125 Introduction to information theory and applications 9  Thermometer  Photocopiers Old land-line telephones Audio tapes VCRs (same as TV) 1.2 Digital signal A digital signal is a physical signal that is a representation of a sequence of discrete values. The term digital signal can refer to either of the following: 1. any continuous-time waveform signal used in digital communication, representing a bit stream or other sequence of discrete values 2. a pulse train signal that switches between a discrete number of voltage levels or levels of light intensity, also known as a line coded signal or baseband transmission, for example a signal found in digital electronics or in serial communications, or a pulse code modulation (PCM) representation of a digitized analog signal. A signal that is generated by means of a digital modulation method (digital pass band transmission), to be transferred between modems, is in the first case considered as a digital signal, and in the second case as converted to an analog signal. In computer architecture and other digital systems, a waveform that switches between two voltage levels representing the two states of a Boolean value (0 and 1) is referred to as a digital signal, even though it is an analog voltage waveform, since it is interpreted in terms of only two levels.
  • 10. Cap 125 Introduction to information theory and applications 10 Example of Digital signal:  Digital signal are commonly referred to as square waves or clock signals.  Their minimum value must be 0 volts, and their maximum value must be 5 volts.  They can be periodic (repeating) or non-periodic.  The time the signal is high (tH) can vary anywhere from 1% of the period to 99% of the period.  Text and Integers. Digital Signal Transmission:  Concerned with the content of the signal.  Attenuation endangers integrity of data.  Digital signal Repeaters achieve greater distance. Repeaters recover the signal and retransmit. Pros and Cons of Digital Signal
  • 11. Cap 125 Introduction to information theory and applications 11 Advantages:  Because of their digital nature they can travel faster in over digital lines.  Ability to transfer more data as compared to analog. Disadvantages:  Greater bandwidth is essential.  Systems and processing is more complex. Applications of Digital Signal are:  PCs, PDAs  Mobile Phones. Difference in working:  The working of the digital signals are more reliable and accurate because they use the digital media or the numeric method where as analog signals are based on the small fluctuations.  Digital signals are used to play that information which is came from re-sampling, whereas analog are known for playing recorded data.  Digital signals have priority over analog signals because with the help of digital signals users have ability to change the visual and the audio or re-record it but with analog signals you can do such parameters.
  • 12. Cap 125 Introduction to information theory and applications 12 1.3 Difference between digital and analog signal Analog signal 1. It produces a continuous signal. 2. Signal that is continuous in a time and can assume an infinite number of values in a given range. 3. It is denoted by sine wave. 4. Analog hardware is not flexible. 5. It Store data in the form of wave signal. 6. Analog instrument consume more power. 7. It is of low cost and portable. For e.g.:- thermometer. Wave form in analog signal Digital signal 1. It produce a discrete signal 2. Signal that is continuous in a time and assumes only a limited number of values. 3. It is denoted by square wave. 4. Digital hardware is flexible in implementation 5. It store data in the form of binary bit. 6. Digital instrument consume less power. 7. It is expensive and not easily portable. For e.g.: computers. Wave form in digital signal
  • 13. Cap 125 Introduction to information theory and applications 13 Reference books 1. Digital Signal Processing By. Sen M. Kuo & Woon-Seng Gan 2. Digital Signal Processing a Practical Approach. By Emmanuel C. Ifeachor & Barrie W. Jervis 3. Digital Signal Processing Principles, Algorithms and Applications By: John G.Proakis & Dimitris G.Manolakis