SlideShare a Scribd company logo
1 of 25
Download to read offline
HOW DOES A BCI WORK?




Monday, March 19, 2012
MOTOR IMAGERY

                   Sensorimotor rhythms (SMR)

                         Detected in the sensorimotor area

                           Somatosensory cortex

                           Motor cortex

                         Mu rhythms: 8-12 Hz

                         Beta rhythms: 12-30Hz

                         ECoG can also use gamma rhythms (30-80Hz)


Monday, March 19, 2012
MOTOR IMAGERY

                   ERD (Event Related Desynchronization)

                         Planning and execution of hand/finger movements
                         block (desynchronize) mu rhythms

                   ERS (Event Related Synchronization)

                         Inhibition of movements synchronizes mu rhythms

                         Foot and tongue movements enhance mu rhythms

                   ERD/ERS is generally observed for the contralateral
                   movements


Monday, March 19, 2012
MOTOR IMAGERY


                   Does not need external stimuli

                   Does need long training

                   Users learn the best imagery

                   Closed-loop feedback plays an important role in
                   learning




Monday, March 19, 2012
SIGNAL PROCESSING

                               - Simplifies signals: e.g. filtering
             Preprocessing     - Improves the signal-to-noise ratio (SNR)



                               - Extract features relevant to control parameters using
                   Feature
                               mathematical methods
                  Extraction   - e.g. Amplitudes, Frequencies, Firing rates, ...


                               - Detection: detects specific patterns from ordinary
              Detection/       patterns
             Classification     - Classification: classifies a given pattern to one of many
                               variables




Monday, March 19, 2012
SIGNAL PROCESSING

                   Synchronous BCIs

                         Cue-paced

                         Operates a BCI with a fixed time frame

                   Asynchronous BCIs

                         Self-paced

                         Operates a BCI whenever the user wants


Monday, March 19, 2012
BCI PERFORMANCE




Monday, March 19, 2012
PERFORMANCE
                                  MEASURES
                   Classification Rate (= 1 - Error Rate)

                         # correct / total attempts

                   Letters / minute for a speller

                   Information transfer rate (ITR)

                         Depends on classification accuracy, performance time, and
                         # classes

                         Bits / minute

                   Ball park: 30 bits/min ~ 90 bits/min (?)


Monday, March 19, 2012
CONFUSION MATRIX


                                 Estimated As       Estimated As
                                   Positives         Negatives

                                 True Positives    False Negatives  Sensitivity =
                     Positives
                                     (TP)                (FN)      TP / (TP + FN)

                                 False Positives   True Negatives  Specificity =
                    Negatives
                                      (FP)              (TN)      TN / (TN + FP)




Monday, March 19, 2012
BCI APPLICATIONS




Monday, March 19, 2012
BCI OUTPUT

                   Discrete output (Discrete State Variables)

                         Output = one of N possible values

                         e.g. “go” / “stop”

                   Continuous output (Continuous State Variables)

                         Output = continuous values, probably within a
                         finite or infinite range

                         e.g. position on a 2D space


Monday, March 19, 2012
Fig. 7 Examples of BCI applications. (a) Environmental control with a P300 BCI (see chapter
                         “The First Commercial Brain–Computer Interface Environment”), (b) P300 Speller (see chapter
Monday, March 19, 2012
SMART HOME CONTROL




Monday, March 19, 2012
NAVIGATION IN VR




Monday, March 19, 2012
2D CURSOR CONTROL




Monday, March 19, 2012
CONTROL LEVEL

                   Low-level                       High-level

                         Process-oriented            Goal-oriented control
                         control
                                                     e.g. move a cursor to a
                         e.g. move a cursor in       target #4
                         45 degree with a
                         speed of 2cm/s at this      All the details are
                         time instant (for 50ms)     managed by an
                                                     actuator
                         More specific
                                                     More general


Monday, March 19, 2012
It is system based on a conventional wheelchair equipped with a stereo camera sys-
            tem, a robot arm with 7 degrees-of-freedom, a gripper with force/torque sensor, a
            smart tray with tactile surface and weight sensors, and a computing unit consist-
            ing of three independent industrial PCs. FRIEND II can perform certain operations
                             Rolland III                                          FRIEND II




            Fig. 8 Semi-autonomous assistive devices developed at the University of Bremen that include
            high level control: Intelligent wheelchair Rolland III, and rehabilitation robot FRIEND II (modified
            from [35])
Monday, March 19, 2012
Monday, March 19, 2012
Monday, March 19, 2012
Monday, March 19, 2012
Monday, March 19, 2012
CURRENT LIMITS OF
                               BCIS
                   Reliability

                         Nonstationary brain signals

                         Sensitive to noise

                   Bandwidth

                         Low information transfer per second

                   Less competitive than conventional techniques

                         Healthy subjects: keyboards, mouse, speech, ...

                         Disabled subjects: eye-tracker, head mouse, ...



Monday, March 19, 2012
WILL NORMAL PEOPLE
                          USE BCIS?

                   Yes if,

                         combined with intelligent systems

                         bandwidth continues to improve

                         used as an augmented interface

                         more accessible by general researchers (e.g. HCI
                         fields, robotics fields, ...)



Monday, March 19, 2012
APPLICATION IN
                            NEUROFEEDBACK
                   A BCI can be thought as the most advanced neurofeedback
                   system

                   A BCI can be applied to neurorehabilitation fields where
                   neurofeedback is necessary

                         ADHD

                         Autism

                         Epilepsy

                         Stroke


Monday, March 19, 2012
Monday, March 19, 2012

More Related Content

Similar to Bri503 lecture05

BRAIN COMPUTER INTERFACE
BRAIN COMPUTER INTERFACEBRAIN COMPUTER INTERFACE
BRAIN COMPUTER INTERFACE
Rushi Prajapati
 

Similar to Bri503 lecture05 (16)

3F3 – Digital Signal Processing (DSP) - Part1
3F3 – Digital Signal Processing (DSP) - Part13F3 – Digital Signal Processing (DSP) - Part1
3F3 – Digital Signal Processing (DSP) - Part1
 
project_final
project_finalproject_final
project_final
 
Introduction to Digital Signal Processing
Introduction to Digital Signal ProcessingIntroduction to Digital Signal Processing
Introduction to Digital Signal Processing
 
553844 634216100295120000(1)
553844 634216100295120000(1)553844 634216100295120000(1)
553844 634216100295120000(1)
 
Where is Wally - user study af Bettina Ridler og Helle Mortensen, GN Netcom
Where is Wally - user study af Bettina Ridler og Helle Mortensen, GN NetcomWhere is Wally - user study af Bettina Ridler og Helle Mortensen, GN Netcom
Where is Wally - user study af Bettina Ridler og Helle Mortensen, GN Netcom
 
IntelliGO semantic similarity measure for Gene Ontology annotations
IntelliGO semantic similarity measure for Gene Ontology annotationsIntelliGO semantic similarity measure for Gene Ontology annotations
IntelliGO semantic similarity measure for Gene Ontology annotations
 
Touchless Fingerprint Recognition
Touchless Fingerprint RecognitionTouchless Fingerprint Recognition
Touchless Fingerprint Recognition
 
COSC 426 Lect. 8: AR Research Directions
COSC 426 Lect. 8: AR Research DirectionsCOSC 426 Lect. 8: AR Research Directions
COSC 426 Lect. 8: AR Research Directions
 
Image processing
Image processingImage processing
Image processing
 
Brainy Computing
Brainy ComputingBrainy Computing
Brainy Computing
 
BRAIN COMPUTER INTERFACE
BRAIN COMPUTER INTERFACEBRAIN COMPUTER INTERFACE
BRAIN COMPUTER INTERFACE
 
dWatch: a Personal Wrist Watch for Smart Environments
dWatch: a Personal Wrist Watch for Smart EnvironmentsdWatch: a Personal Wrist Watch for Smart Environments
dWatch: a Personal Wrist Watch for Smart Environments
 
Seminar
SeminarSeminar
Seminar
 
Direct Writing
Direct WritingDirect Writing
Direct Writing
 
Introduction to Digital Signal Processing (DSP)
Introduction  to  Digital Signal Processing (DSP)Introduction  to  Digital Signal Processing (DSP)
Introduction to Digital Signal Processing (DSP)
 
Application of image processing
Application of image processingApplication of image processing
Application of image processing
 

Recently uploaded

Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
SanaAli374401
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 

Recently uploaded (20)

Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 

Bri503 lecture05

  • 1. HOW DOES A BCI WORK? Monday, March 19, 2012
  • 2. MOTOR IMAGERY Sensorimotor rhythms (SMR) Detected in the sensorimotor area Somatosensory cortex Motor cortex Mu rhythms: 8-12 Hz Beta rhythms: 12-30Hz ECoG can also use gamma rhythms (30-80Hz) Monday, March 19, 2012
  • 3. MOTOR IMAGERY ERD (Event Related Desynchronization) Planning and execution of hand/finger movements block (desynchronize) mu rhythms ERS (Event Related Synchronization) Inhibition of movements synchronizes mu rhythms Foot and tongue movements enhance mu rhythms ERD/ERS is generally observed for the contralateral movements Monday, March 19, 2012
  • 4. MOTOR IMAGERY Does not need external stimuli Does need long training Users learn the best imagery Closed-loop feedback plays an important role in learning Monday, March 19, 2012
  • 5. SIGNAL PROCESSING - Simplifies signals: e.g. filtering Preprocessing - Improves the signal-to-noise ratio (SNR) - Extract features relevant to control parameters using Feature mathematical methods Extraction - e.g. Amplitudes, Frequencies, Firing rates, ... - Detection: detects specific patterns from ordinary Detection/ patterns Classification - Classification: classifies a given pattern to one of many variables Monday, March 19, 2012
  • 6. SIGNAL PROCESSING Synchronous BCIs Cue-paced Operates a BCI with a fixed time frame Asynchronous BCIs Self-paced Operates a BCI whenever the user wants Monday, March 19, 2012
  • 8. PERFORMANCE MEASURES Classification Rate (= 1 - Error Rate) # correct / total attempts Letters / minute for a speller Information transfer rate (ITR) Depends on classification accuracy, performance time, and # classes Bits / minute Ball park: 30 bits/min ~ 90 bits/min (?) Monday, March 19, 2012
  • 9. CONFUSION MATRIX Estimated As Estimated As Positives Negatives True Positives False Negatives Sensitivity = Positives (TP) (FN) TP / (TP + FN) False Positives True Negatives Specificity = Negatives (FP) (TN) TN / (TN + FP) Monday, March 19, 2012
  • 11. BCI OUTPUT Discrete output (Discrete State Variables) Output = one of N possible values e.g. “go” / “stop” Continuous output (Continuous State Variables) Output = continuous values, probably within a finite or infinite range e.g. position on a 2D space Monday, March 19, 2012
  • 12. Fig. 7 Examples of BCI applications. (a) Environmental control with a P300 BCI (see chapter “The First Commercial Brain–Computer Interface Environment”), (b) P300 Speller (see chapter Monday, March 19, 2012
  • 13. SMART HOME CONTROL Monday, March 19, 2012
  • 14. NAVIGATION IN VR Monday, March 19, 2012
  • 15. 2D CURSOR CONTROL Monday, March 19, 2012
  • 16. CONTROL LEVEL Low-level High-level Process-oriented Goal-oriented control control e.g. move a cursor to a e.g. move a cursor in target #4 45 degree with a speed of 2cm/s at this All the details are time instant (for 50ms) managed by an actuator More specific More general Monday, March 19, 2012
  • 17. It is system based on a conventional wheelchair equipped with a stereo camera sys- tem, a robot arm with 7 degrees-of-freedom, a gripper with force/torque sensor, a smart tray with tactile surface and weight sensors, and a computing unit consist- ing of three independent industrial PCs. FRIEND II can perform certain operations Rolland III FRIEND II Fig. 8 Semi-autonomous assistive devices developed at the University of Bremen that include high level control: Intelligent wheelchair Rolland III, and rehabilitation robot FRIEND II (modified from [35]) Monday, March 19, 2012
  • 22. CURRENT LIMITS OF BCIS Reliability Nonstationary brain signals Sensitive to noise Bandwidth Low information transfer per second Less competitive than conventional techniques Healthy subjects: keyboards, mouse, speech, ... Disabled subjects: eye-tracker, head mouse, ... Monday, March 19, 2012
  • 23. WILL NORMAL PEOPLE USE BCIS? Yes if, combined with intelligent systems bandwidth continues to improve used as an augmented interface more accessible by general researchers (e.g. HCI fields, robotics fields, ...) Monday, March 19, 2012
  • 24. APPLICATION IN NEUROFEEDBACK A BCI can be thought as the most advanced neurofeedback system A BCI can be applied to neurorehabilitation fields where neurofeedback is necessary ADHD Autism Epilepsy Stroke Monday, March 19, 2012