SlideShare a Scribd company logo
1 of 16
Wiener Filtering &
Basis Functions
Nov 4th 2004
Jukka Parviainen
parvi@hut.fi
T-61.181 Biomedical Signal Processing
Sections 4.4 - 4.5.2
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
2
Outline
• a posteriori Wiener filter (Sec 4.4)
– removing noise by linear filtering in
optimal (mean-square error) way
– improving ensemble averaging
• single-trial analysis using basis
functions (Sec 4.5)
– only one or few evoked potentials
– e.g. Fourier analysis
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
3
Wiener - example in 2D
• model x = f(s)+v, where f(.) is a
linear blurring effect (in the
example)
• target: find an estimate s’ = g(x)
• an inverse filter to blurring
• value of SNR can be controlled
• Matlab example: ipexdeconvwnr
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
4
Part I - Wiener in EEG
• improving ensemble averages by
incorporating correlation
information, similar to weights
earlier in Sec. 4.3
• model: x_i(n) = s(n) + v_i(n)
• ensemble average of M records
• target: good s’(n) from x_i(n)
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
5
Wiener filter in EEG
• a priori Wiener filter:
)
(
)
/
1
(
)
(
)
(
)
( 



j
v
j
s
j
s
j
e
S
M
e
S
e
S
e
H


• power spectra of signal (s) and
noise (v) are F-transforms of
correlation functions r(k)
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
6
Interpretation of Wiener
• if ”no noise”, then H=1
• if ”no signal”, then H=0
• for stationary processes
always 0 < H < 1
• see Fig 4.22
)
(
)
/
1
(
)
(
)
(
)
( 



j
v
j
s
j
s
j
e
S
M
e
S
e
S
e
H


Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
7
Wiener in theory
• design H(z), so that mean-square
error E[(s(n)-s’(n))^2] minimized
• Wiener-Hopf equations of
noncausal IIR filter lead to H(ej )
• filter gain 0 < H < 1 implies
underestimation (bias)
• bias/variance dilemma
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
8
A posteriori Wiener filters
• time-invariant a posteriori filtering
• estimates for signal and noise
spectra from data afterwards
• two estimates in the book:
• improvements: clipping & spectral
smoothing, see Fig 4.23
)
)
(
)
(
1
(
1
1 

j
sa
j
xa
e
MS
e
S
M
M
H 


)
(
)
(
1
2 

j
sa
j
vs
e
S
e
S
H 

Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
9
Limitations of APWFs
• contradictionary results due to
modalities: BAEP+VEP ok, SEP not
• bad results with low SNRs, see Fig
4.24
• APWF supposes stationary signals
• if/when not, time-varying Wiener
filters developed
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
10
APWF - What was learnt?
• authors: ”serious limitations”,
”important to be aware of possible
pitfalls”, especially when ”the
assumpition of stationarity is
incorporated into a signal model”
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
11
Part II - Basis functions
• often no repititions of EPs available
or possible
• therefore no averaging etc.
• prior information incorporated in
the model
• mutually orthonormal basis func.:






l
k
l
k
l
T
k
,
0
,
1


Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
12
Orthonormal basis func.
• data is modelled using a set of
weight vectors and orthonormal
basic functions
• example: Fourier-series/transform
...
)
2
cos(
)
cos(
)
( 2
1
0 


 t
a
t
a
a
t
x 

i
N
k
k
k
i
i w w
x 

 
1
, 
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
13
Lowpass modelling
• basis functions divided to two sets,
”truncating” the model
• s are to be saved, size N x K
• v are to be ignored (regarded as
high-freq. noise), size N x (N-K)
i
T
s
s
i
s
i x
w
s 




^
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
14
Demo: Fourier-series
http://www.jhu.edu/~signals/
• rapid changes - high frequency
• value K?
• transients cannot be modelled
nicely using cosines/sines
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
15
Summary I: Wiener
• originally by Wiener in 40’s
• with evoked potentials in 60’s and
70’s by Walker and Doyle
• lots of research in 70’s and 80’s
(time-varying filtering by de
Weerd)
• probably a baseline technique?
Nov 4th 2004 T-61.181 - Biomedical Signal
Processing - Jukka Parviainen
16
Summary II: Basis f.
• signal can be modelled using as a
sum of products of weight vectors
and basis functions
• high-frequency components
considered as noise
• to be continued in the following
presentation

More Related Content

Similar to WEINER FILTERING AND BASIS FUNCTIONS.ppt

Slide Handouts with Notes
Slide Handouts with NotesSlide Handouts with Notes
Slide Handouts with Notes
Leon Nguyen
 
Design and Analysis of Active Bandpass Filter
Design and Analysis of Active Bandpass FilterDesign and Analysis of Active Bandpass Filter
Design and Analysis of Active Bandpass Filter
Kyla Marino
 
FourierTransform detailed power point presentation
FourierTransform detailed power point presentationFourierTransform detailed power point presentation
FourierTransform detailed power point presentation
ssuseracb8ba
 
Signals and systems( chapter 1)
Signals and systems( chapter 1)Signals and systems( chapter 1)
Signals and systems( chapter 1)
Fariza Zahari
 

Similar to WEINER FILTERING AND BASIS FUNCTIONS.ppt (20)

Lecture 9
Lecture 9Lecture 9
Lecture 9
 
I027050057
I027050057I027050057
I027050057
 
Slide Handouts with Notes
Slide Handouts with NotesSlide Handouts with Notes
Slide Handouts with Notes
 
Course-Notes__Advanced-DSP.pdf
Course-Notes__Advanced-DSP.pdfCourse-Notes__Advanced-DSP.pdf
Course-Notes__Advanced-DSP.pdf
 
Advanced_DSP_J_G_Proakis.pdf
Advanced_DSP_J_G_Proakis.pdfAdvanced_DSP_J_G_Proakis.pdf
Advanced_DSP_J_G_Proakis.pdf
 
SignalDecompositionTheory.pptx
SignalDecompositionTheory.pptxSignalDecompositionTheory.pptx
SignalDecompositionTheory.pptx
 
IARE_DSP_PPT.pptx
IARE_DSP_PPT.pptxIARE_DSP_PPT.pptx
IARE_DSP_PPT.pptx
 
Design and Analysis of Active Bandpass Filter
Design and Analysis of Active Bandpass FilterDesign and Analysis of Active Bandpass Filter
Design and Analysis of Active Bandpass Filter
 
Lecture 1 - Introduction to Signals.pdf
Lecture 1 - Introduction to Signals.pdfLecture 1 - Introduction to Signals.pdf
Lecture 1 - Introduction to Signals.pdf
 
DSP (T)_Important Topics.pdf
DSP (T)_Important Topics.pdfDSP (T)_Important Topics.pdf
DSP (T)_Important Topics.pdf
 
Development of a low cost pc-based single-channel eeg monitoring system
Development of a low cost pc-based single-channel eeg monitoring systemDevelopment of a low cost pc-based single-channel eeg monitoring system
Development of a low cost pc-based single-channel eeg monitoring system
 
Presentation on fourier transformation
Presentation on fourier transformationPresentation on fourier transformation
Presentation on fourier transformation
 
FourierTransform detailed power point presentation
FourierTransform detailed power point presentationFourierTransform detailed power point presentation
FourierTransform detailed power point presentation
 
Chapter-I Classification of Signals and Systems.pptx
Chapter-I Classification of Signals and Systems.pptxChapter-I Classification of Signals and Systems.pptx
Chapter-I Classification of Signals and Systems.pptx
 
es240_fourierseries introduction to Fourier
es240_fourierseries introduction to Fourieres240_fourierseries introduction to Fourier
es240_fourierseries introduction to Fourier
 
Fourier slide
Fourier slideFourier slide
Fourier slide
 
⭐⭐⭐⭐⭐ EMG Signal Processing with Clustering Algorithms for Motor Gesture Tasks
⭐⭐⭐⭐⭐ EMG Signal Processing with Clustering Algorithms for Motor Gesture Tasks⭐⭐⭐⭐⭐ EMG Signal Processing with Clustering Algorithms for Motor Gesture Tasks
⭐⭐⭐⭐⭐ EMG Signal Processing with Clustering Algorithms for Motor Gesture Tasks
 
EE448_Slides_Video_1.pptx
EE448_Slides_Video_1.pptxEE448_Slides_Video_1.pptx
EE448_Slides_Video_1.pptx
 
Signals and system
Signals and systemSignals and system
Signals and system
 
Signals and systems( chapter 1)
Signals and systems( chapter 1)Signals and systems( chapter 1)
Signals and systems( chapter 1)
 

More from debeshidutta2

More from debeshidutta2 (10)

Nanosensor-basics, application and future.pptx
Nanosensor-basics, application and future.pptxNanosensor-basics, application and future.pptx
Nanosensor-basics, application and future.pptx
 
FUNDAMENTALS OF MECHATRONICS AND APPLICATIONS.pptx
FUNDAMENTALS OF MECHATRONICS AND APPLICATIONS.pptxFUNDAMENTALS OF MECHATRONICS AND APPLICATIONS.pptx
FUNDAMENTALS OF MECHATRONICS AND APPLICATIONS.pptx
 
Radiation Detectors-operation and applications.pptx
Radiation Detectors-operation and applications.pptxRadiation Detectors-operation and applications.pptx
Radiation Detectors-operation and applications.pptx
 
Thermoluminiscent Dosimetry-Principle, Charateristics, and Applications.pptx
Thermoluminiscent Dosimetry-Principle, Charateristics, and Applications.pptxThermoluminiscent Dosimetry-Principle, Charateristics, and Applications.pptx
Thermoluminiscent Dosimetry-Principle, Charateristics, and Applications.pptx
 
Introduction to adaptive filtering and its applications.ppt
Introduction to adaptive filtering and its applications.pptIntroduction to adaptive filtering and its applications.ppt
Introduction to adaptive filtering and its applications.ppt
 
Introduction, concepts, and mathematics of IIR filters.ppt
Introduction, concepts, and mathematics of IIR filters.pptIntroduction, concepts, and mathematics of IIR filters.ppt
Introduction, concepts, and mathematics of IIR filters.ppt
 
DIGITAL FILTER SPECIFICATIONS AND MATHEMATICS.ppt
DIGITAL FILTER SPECIFICATIONS AND MATHEMATICS.pptDIGITAL FILTER SPECIFICATIONS AND MATHEMATICS.ppt
DIGITAL FILTER SPECIFICATIONS AND MATHEMATICS.ppt
 
BIOMEDICAL SENSORS AND MEASUREMENT SYSTEMS.ppt
BIOMEDICAL SENSORS AND MEASUREMENT SYSTEMS.pptBIOMEDICAL SENSORS AND MEASUREMENT SYSTEMS.ppt
BIOMEDICAL SENSORS AND MEASUREMENT SYSTEMS.ppt
 
Basic programming in Python Environment.pptx
Basic programming in Python Environment.pptxBasic programming in Python Environment.pptx
Basic programming in Python Environment.pptx
 
Transducers in healthcare applications.pptx
Transducers in healthcare applications.pptxTransducers in healthcare applications.pptx
Transducers in healthcare applications.pptx
 

Recently uploaded

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
ssuser89054b
 
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
Kamal Acharya
 

Recently uploaded (20)

Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptxOrlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
AIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech studentsAIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech students
 
Employee leave management system project.
Employee leave management system project.Employee leave management system project.
Employee leave management system project.
 
School management system project Report.pdf
School management system project Report.pdfSchool management system project Report.pdf
School management system project Report.pdf
 
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
 
PE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and propertiesPE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and properties
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to Computers
 
Engineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planesEngineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planes
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best ServiceTamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
 
Introduction to Serverless with AWS Lambda
Introduction to Serverless with AWS LambdaIntroduction to Serverless with AWS Lambda
Introduction to Serverless with AWS Lambda
 
Block diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.pptBlock diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.ppt
 
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptxA CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
 
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 

WEINER FILTERING AND BASIS FUNCTIONS.ppt

  • 1. Wiener Filtering & Basis Functions Nov 4th 2004 Jukka Parviainen parvi@hut.fi T-61.181 Biomedical Signal Processing Sections 4.4 - 4.5.2
  • 2. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 2 Outline • a posteriori Wiener filter (Sec 4.4) – removing noise by linear filtering in optimal (mean-square error) way – improving ensemble averaging • single-trial analysis using basis functions (Sec 4.5) – only one or few evoked potentials – e.g. Fourier analysis
  • 3. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 3 Wiener - example in 2D • model x = f(s)+v, where f(.) is a linear blurring effect (in the example) • target: find an estimate s’ = g(x) • an inverse filter to blurring • value of SNR can be controlled • Matlab example: ipexdeconvwnr
  • 4. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 4 Part I - Wiener in EEG • improving ensemble averages by incorporating correlation information, similar to weights earlier in Sec. 4.3 • model: x_i(n) = s(n) + v_i(n) • ensemble average of M records • target: good s’(n) from x_i(n)
  • 5. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 5 Wiener filter in EEG • a priori Wiener filter: ) ( ) / 1 ( ) ( ) ( ) (     j v j s j s j e S M e S e S e H   • power spectra of signal (s) and noise (v) are F-transforms of correlation functions r(k)
  • 6. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 6 Interpretation of Wiener • if ”no noise”, then H=1 • if ”no signal”, then H=0 • for stationary processes always 0 < H < 1 • see Fig 4.22 ) ( ) / 1 ( ) ( ) ( ) (     j v j s j s j e S M e S e S e H  
  • 7. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 7 Wiener in theory • design H(z), so that mean-square error E[(s(n)-s’(n))^2] minimized • Wiener-Hopf equations of noncausal IIR filter lead to H(ej ) • filter gain 0 < H < 1 implies underestimation (bias) • bias/variance dilemma
  • 8. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 8 A posteriori Wiener filters • time-invariant a posteriori filtering • estimates for signal and noise spectra from data afterwards • two estimates in the book: • improvements: clipping & spectral smoothing, see Fig 4.23 ) ) ( ) ( 1 ( 1 1   j sa j xa e MS e S M M H    ) ( ) ( 1 2   j sa j vs e S e S H  
  • 9. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 9 Limitations of APWFs • contradictionary results due to modalities: BAEP+VEP ok, SEP not • bad results with low SNRs, see Fig 4.24 • APWF supposes stationary signals • if/when not, time-varying Wiener filters developed
  • 10. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 10 APWF - What was learnt? • authors: ”serious limitations”, ”important to be aware of possible pitfalls”, especially when ”the assumpition of stationarity is incorporated into a signal model”
  • 11. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 11 Part II - Basis functions • often no repititions of EPs available or possible • therefore no averaging etc. • prior information incorporated in the model • mutually orthonormal basis func.:       l k l k l T k , 0 , 1  
  • 12. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 12 Orthonormal basis func. • data is modelled using a set of weight vectors and orthonormal basic functions • example: Fourier-series/transform ... ) 2 cos( ) cos( ) ( 2 1 0     t a t a a t x   i N k k k i i w w x     1 , 
  • 13. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 13 Lowpass modelling • basis functions divided to two sets, ”truncating” the model • s are to be saved, size N x K • v are to be ignored (regarded as high-freq. noise), size N x (N-K) i T s s i s i x w s      ^
  • 14. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 14 Demo: Fourier-series http://www.jhu.edu/~signals/ • rapid changes - high frequency • value K? • transients cannot be modelled nicely using cosines/sines
  • 15. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 15 Summary I: Wiener • originally by Wiener in 40’s • with evoked potentials in 60’s and 70’s by Walker and Doyle • lots of research in 70’s and 80’s (time-varying filtering by de Weerd) • probably a baseline technique?
  • 16. Nov 4th 2004 T-61.181 - Biomedical Signal Processing - Jukka Parviainen 16 Summary II: Basis f. • signal can be modelled using as a sum of products of weight vectors and basis functions • high-frequency components considered as noise • to be continued in the following presentation