SlideShare a Scribd company logo
1 of 28
{
BRAIN-COMPUTER
INTERFACING TO DETECT
STRESS DURING MOTOR
IMAGERY TASKS
ABHISEK SENGUPTA Roll No.-02 WBUT Roll No.-10905514002
ARNAB BAIN Roll No.-11 WBUT Roll No.-10905514011
DEBOSHRUTI BANERJI Roll No.-15 WBUT Roll No.-10905514015
MAHIM MALLICK Roll No.-21 WBUT Roll No.-10905514021
PARAMITA DEY Roll No.-27 WBUT Roll No.-10905514027
TETASH BASU Roll No.-48 WBUT Roll No.-10905514048
 An Introduction to Brain-Computer
Interfacing
 Stress Detection during Motor-Imagery
Tasks
 Stress Detection of Vehicle Drivers during
Driving-A Case Study
 Conclusions and Future Scope
List Of Contents
Introduction to Brain
Computer Interface
Brain Map
Brain Imaging Techniques
Electroencephalography
Electroencephalogra
phy (EEG) is an
electrophysiological
monitoring method
to record the
spontaneous
electrical activity of
the brain over a
period of time. EEG
measures voltage
fluctuations resulting
from ionic
current within the
neurons of the brain.
Components of a BCI System
Stress and Motor Imaging
o Stress is primarily a
physical response, which
releases a complex mix of
hormones and chemicals
such as adrenaline,
cortisol and
norepinephrine to
prepare the body for
physical action.
o Motor imagery is a
cognitive process in
which a subject imagines
that he or she performs a
movement without
actually performing the
movement and without
even tensing the
muscles. It is a dynamic
state during which the
representation of a
specific motor action is
internally activated
without any motor
output
Decoding Stress and MI
Stress is detected
using eye blinks
and brain
activities from
EEG signals
The development of BCI
systems that can
effectively analyze
brain signals and
discriminate between
different MI tasks to
control neural
prostheses devices has
the potential to enhance
the quality of life for
people with severe
motor disabilities.
Features Used For Decoding MI
• Power Spectral Density : It
is a useful concept that
allows us to determine the
bandwidth of the system.
• The Fast Fourier
Transform (FFT) : It is a
useful scheme for
extracting frequency-
domain signal features.
• Wavelet transform (WT) : .
Its basic use includes time-
scale signal analysis, signal
decomposition and signal
compression. Other than
these Hjorth Parameters
and Kalman filter is also
used.
Classifiers Used For Decoding
Motor Imagery
 Generative or Informative
classifier - Discriminative classifier
 Static classifier - Dynamic
classifier
 Stable classifier - Unstable classifier
 Regularized classifier
Performance Analysis In MI Based
BCI Research
Fuzzy inference is a method that
interprets the values in the input
vector and, based on some set of
rules, assigns values to the
output vector, hence providing a
number of convenient ways to
create fuzzy sets.
A Membership function is a
curve that defines how each
point in the input space is
mapped to a membership value
or degree of membership
between 0 and 1. Here we are
using a Gaussian membership
function (gaussmf)
Gaussian membership curve
o An electrode placement
EEG system
o a 15 channels recording unit
(15 EEG electrodes are used )
o a video camera synchronized
with EEG recording
o a PC running a car racing
game for visual and
acoustic stimulation
o a steering, brake and
accelerator for the car
stimulator
Stress Detection Of Vehicle Drivers
During Driving-a Case Study
EEG recording of brain
activity
Car Simulation in PC
EEG signal acquisition during
the experiment
Screenshot of EEG signal showing mild stress
levels
Feature Extraction And Selection
Extracting Power
Spectral Density
Features
Extracting Fourier
Transform
Features
Extracting
Wavelet
Coefficient
Extracting
Hjorth
Parameters
Extracting
Kalman Filter
Coefficients
Power spectral density plots of 0.2 seconds EEG data
Fourier Transformed Signal
Raw EEG signal
0 0.5 1 1.5 2 2.5 3 3.5 4
0
200
400
600
800
1000
1200
1400
1600
1800
2000
0 0.5 1 1.5 2 2.5 3 3.5 4
0
200
400
600
800
1000
1200
1400
1600
1800
2000
4 4.5 5 5.5 6 6.5 7 7.5 8
20
30
40
50
60
70
80
90
100
110
4 4.5 5 5.5 6 6.5 7 7.5 8
20
30
40
50
60
70
80
90
100
110
8 9 10 11 12 13 14 15 16
0
10
20
30
40
50
60
70
80
90
8 9 10 11 12 13 14 15 16
0
10
20
30
40
50
60
70
80
90
16 18 20 22 24 26 28 30 32
0
10
20
30
40
50
60
16 18 20 22 24 26 28 30 32
0
10
20
30
40
50
60
4 wavelets obtained for 1000x15 raw EEG data
Kalman filter analysis of EEG data
Classifier Validation And
Performance
0 0.5 1 1.5
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Hjorth Complexity Gaussian plot during alarmingly stressed video
Wavelet Coefficient Gaussian plot during alarmingly stressed video
0 100 200 300 400 500 600 700 800 900 1000
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Kalman filter Gaussian plot during alarmingly stressed video
-4 -3 -2 -1 0 1 2 3 4
x 10
6
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Recognizing Stress Level
In the experiment, we collect and analyze EEG data during real-world driving
tasks to determine a driver's relative stress level among the 5 stress anchors.
EEG data were recorded continuously while drivers followed a set route
through open roads in the emulated driving scenario.
Minimum and Maximum Values of Features for Relaxed Video
1 2 3 4 5 6
Power Spectral Density 0.5313 0.4636 0.00239 0.39025 0.268 0.4901
Fourier Transform 0.7999 0.7556 0.6806 0.9688 0.7332 0.7336
Wavelet Coefficient 0.4931 0.4538 0.01 0.3166 0.3077 0.4642
Hjorth Complexity 0.9565 0.515 0.5379 0.7387 0.9328 0.97655
Hjorth Mobility 0.9498 0.9649 0.2703 0.9566 0.899 0.9957
Kalman 0.3657 0.3117 0.00001 0.7834 0.2716 0.8538
Similarly, minimum and maximum values are obtained for moderately
stressed and alarming stressed videos.
The triangular norm (tnorm) is used to calculate the membership values of
intersection of the fuzzy sets.
Stress Level Relax Situational Stress Alarming
Stress
tnorm
0.246555 0.49265 0.4141
tnorm for different stress levels
Since the maximum value of tnorm is in alarming stress set, hence the
subject is highly stressed and the car needs to be stopped for safety.
Future Research Directions
Experiments in this area have gradually shown promise. Scientists at Swiss
University are working with a car manufacturer Nissan to find out if they could
use brain signals to improve driving experience. The idea is that a computer on-
board the car could detect a driver’s intentions split seconds before they act by
reading their brain signals. The computer could then opt to intervene or assist
the driver, depending on external detection of other cars and objects around the
car. Brain measurements are used trying to understand what the driver is trying
to do. The brain signals are very good at detecting the whole environment
around the car and making the decisions themselves but the muscles react to
situations much slower as when we are driving we use both our hands and feet
making it complicated. So we are bad executors having response time slower.
The body controlling signals in our brain are still there and these brain signals
are utilized to make an automated car making response time faster and safer
than the driver would have made himself. But this doesn’t mean that the driver
is half-asleep and the computer does everything for him/her. The driver is still
kept active and the driving experience is improved.
BRAIN-COMPUTER INTERFACING TO DETECT STRESS DURING MOTOR IMAGERY TASKS

More Related Content

Similar to BRAIN-COMPUTER INTERFACING TO DETECT STRESS DURING MOTOR IMAGERY TASKS

IRJET- Classification of Arrhythmic ECG Data using Artificial Neural Network
IRJET- Classification of Arrhythmic ECG Data using Artificial Neural NetworkIRJET- Classification of Arrhythmic ECG Data using Artificial Neural Network
IRJET- Classification of Arrhythmic ECG Data using Artificial Neural NetworkIRJET Journal
 
Matthew Gray Summer 2015 Presentation
Matthew Gray Summer 2015 PresentationMatthew Gray Summer 2015 Presentation
Matthew Gray Summer 2015 PresentationMatthew Gray
 
Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...
Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...
Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...IRJET Journal
 
Fault detection of motorcycles using the Slopes of the estimated pseudospectr...
Fault detection of motorcycles using the Slopes of the estimated pseudospectr...Fault detection of motorcycles using the Slopes of the estimated pseudospectr...
Fault detection of motorcycles using the Slopes of the estimated pseudospectr...ijcsa
 
IRJET- Analysis of Electroencephalogram (EEG) Signals
IRJET- Analysis of Electroencephalogram (EEG) SignalsIRJET- Analysis of Electroencephalogram (EEG) Signals
IRJET- Analysis of Electroencephalogram (EEG) SignalsIRJET Journal
 
IRJET- Microcontroller Based EOG and Accelerometer Guide Wheelchair
IRJET-  	  Microcontroller Based EOG and Accelerometer Guide WheelchairIRJET-  	  Microcontroller Based EOG and Accelerometer Guide Wheelchair
IRJET- Microcontroller Based EOG and Accelerometer Guide WheelchairIRJET Journal
 
IRJET- Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...
IRJET-  Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...IRJET-  Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...
IRJET- Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...IRJET Journal
 
Development of an intelligent steering system for reducing accidents due to d...
Development of an intelligent steering system for reducing accidents due to d...Development of an intelligent steering system for reducing accidents due to d...
Development of an intelligent steering system for reducing accidents due to d...IRJET Journal
 
Driver Drowsiness Detection Review
Driver Drowsiness Detection ReviewDriver Drowsiness Detection Review
Driver Drowsiness Detection ReviewAsaad Waqar
 
IRJET- Arrhythmia Detection using One Dimensional Convolutional Neural Network
IRJET- Arrhythmia Detection using One Dimensional Convolutional Neural NetworkIRJET- Arrhythmia Detection using One Dimensional Convolutional Neural Network
IRJET- Arrhythmia Detection using One Dimensional Convolutional Neural NetworkIRJET Journal
 
Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...
Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...
Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...Md Kafiul Islam
 
IRJET- Smart Wearable Helmet with EEG
IRJET- Smart Wearable Helmet with EEGIRJET- Smart Wearable Helmet with EEG
IRJET- Smart Wearable Helmet with EEGIRJET Journal
 
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...IRJET Journal
 
Hand movements based control of an intelligent wheelchair Using Accelerometer...
Hand movements based control of an intelligent wheelchair Using Accelerometer...Hand movements based control of an intelligent wheelchair Using Accelerometer...
Hand movements based control of an intelligent wheelchair Using Accelerometer...IJERD Editor
 
Multiple Sensors Soft-Failure Diagnosis Based on Kalman Filter
Multiple Sensors Soft-Failure Diagnosis Based on Kalman FilterMultiple Sensors Soft-Failure Diagnosis Based on Kalman Filter
Multiple Sensors Soft-Failure Diagnosis Based on Kalman Filtersipij
 
IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...
IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...
IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...IRJET Journal
 
IRJET- Survey on EEG Based Brainwave Controlled Home Automation
IRJET-  	  Survey on EEG Based Brainwave Controlled Home AutomationIRJET-  	  Survey on EEG Based Brainwave Controlled Home Automation
IRJET- Survey on EEG Based Brainwave Controlled Home AutomationIRJET Journal
 
Vision based system for monitoring the loss of attention in automotive driver
Vision based system for monitoring the loss of attention in automotive driverVision based system for monitoring the loss of attention in automotive driver
Vision based system for monitoring the loss of attention in automotive driverVinay Diddi
 
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End KitStudy and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End KitIRJET Journal
 

Similar to BRAIN-COMPUTER INTERFACING TO DETECT STRESS DURING MOTOR IMAGERY TASKS (20)

IRJET- Classification of Arrhythmic ECG Data using Artificial Neural Network
IRJET- Classification of Arrhythmic ECG Data using Artificial Neural NetworkIRJET- Classification of Arrhythmic ECG Data using Artificial Neural Network
IRJET- Classification of Arrhythmic ECG Data using Artificial Neural Network
 
Matthew Gray Summer 2015 Presentation
Matthew Gray Summer 2015 PresentationMatthew Gray Summer 2015 Presentation
Matthew Gray Summer 2015 Presentation
 
Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...
Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...
Stay Awake Alert: A Driver Drowsiness Detection System with Location Tracking...
 
Fault detection of motorcycles using the Slopes of the estimated pseudospectr...
Fault detection of motorcycles using the Slopes of the estimated pseudospectr...Fault detection of motorcycles using the Slopes of the estimated pseudospectr...
Fault detection of motorcycles using the Slopes of the estimated pseudospectr...
 
IRJET- Analysis of Electroencephalogram (EEG) Signals
IRJET- Analysis of Electroencephalogram (EEG) SignalsIRJET- Analysis of Electroencephalogram (EEG) Signals
IRJET- Analysis of Electroencephalogram (EEG) Signals
 
IRJET- Microcontroller Based EOG and Accelerometer Guide Wheelchair
IRJET-  	  Microcontroller Based EOG and Accelerometer Guide WheelchairIRJET-  	  Microcontroller Based EOG and Accelerometer Guide Wheelchair
IRJET- Microcontroller Based EOG and Accelerometer Guide Wheelchair
 
IRJET- Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...
IRJET-  Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...IRJET-  Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...
IRJET- Congestive Heart Failure Recognition by Analyzing The ECG Signals usi...
 
Development of an intelligent steering system for reducing accidents due to d...
Development of an intelligent steering system for reducing accidents due to d...Development of an intelligent steering system for reducing accidents due to d...
Development of an intelligent steering system for reducing accidents due to d...
 
Driver Drowsiness Detection Review
Driver Drowsiness Detection ReviewDriver Drowsiness Detection Review
Driver Drowsiness Detection Review
 
IRJET- Arrhythmia Detection using One Dimensional Convolutional Neural Network
IRJET- Arrhythmia Detection using One Dimensional Convolutional Neural NetworkIRJET- Arrhythmia Detection using One Dimensional Convolutional Neural Network
IRJET- Arrhythmia Detection using One Dimensional Convolutional Neural Network
 
Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...
Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...
Poster Presentation on "Artifact Characterization and Removal for In-Vivo Neu...
 
IRJET- Smart Wearable Helmet with EEG
IRJET- Smart Wearable Helmet with EEGIRJET- Smart Wearable Helmet with EEG
IRJET- Smart Wearable Helmet with EEG
 
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
 
Hand movements based control of an intelligent wheelchair Using Accelerometer...
Hand movements based control of an intelligent wheelchair Using Accelerometer...Hand movements based control of an intelligent wheelchair Using Accelerometer...
Hand movements based control of an intelligent wheelchair Using Accelerometer...
 
Ni tutorial-6349-en
Ni tutorial-6349-enNi tutorial-6349-en
Ni tutorial-6349-en
 
Multiple Sensors Soft-Failure Diagnosis Based on Kalman Filter
Multiple Sensors Soft-Failure Diagnosis Based on Kalman FilterMultiple Sensors Soft-Failure Diagnosis Based on Kalman Filter
Multiple Sensors Soft-Failure Diagnosis Based on Kalman Filter
 
IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...
IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...
IRJET- Driver Drowsiness Detection & Identification of Alcoholic System using...
 
IRJET- Survey on EEG Based Brainwave Controlled Home Automation
IRJET-  	  Survey on EEG Based Brainwave Controlled Home AutomationIRJET-  	  Survey on EEG Based Brainwave Controlled Home Automation
IRJET- Survey on EEG Based Brainwave Controlled Home Automation
 
Vision based system for monitoring the loss of attention in automotive driver
Vision based system for monitoring the loss of attention in automotive driverVision based system for monitoring the loss of attention in automotive driver
Vision based system for monitoring the loss of attention in automotive driver
 
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End KitStudy and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
 

Recently uploaded

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 

Recently uploaded (20)

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 

BRAIN-COMPUTER INTERFACING TO DETECT STRESS DURING MOTOR IMAGERY TASKS

  • 1. { BRAIN-COMPUTER INTERFACING TO DETECT STRESS DURING MOTOR IMAGERY TASKS ABHISEK SENGUPTA Roll No.-02 WBUT Roll No.-10905514002 ARNAB BAIN Roll No.-11 WBUT Roll No.-10905514011 DEBOSHRUTI BANERJI Roll No.-15 WBUT Roll No.-10905514015 MAHIM MALLICK Roll No.-21 WBUT Roll No.-10905514021 PARAMITA DEY Roll No.-27 WBUT Roll No.-10905514027 TETASH BASU Roll No.-48 WBUT Roll No.-10905514048
  • 2.  An Introduction to Brain-Computer Interfacing  Stress Detection during Motor-Imagery Tasks  Stress Detection of Vehicle Drivers during Driving-A Case Study  Conclusions and Future Scope List Of Contents
  • 4.
  • 7. Electroencephalography Electroencephalogra phy (EEG) is an electrophysiological monitoring method to record the spontaneous electrical activity of the brain over a period of time. EEG measures voltage fluctuations resulting from ionic current within the neurons of the brain.
  • 8. Components of a BCI System
  • 9. Stress and Motor Imaging o Stress is primarily a physical response, which releases a complex mix of hormones and chemicals such as adrenaline, cortisol and norepinephrine to prepare the body for physical action. o Motor imagery is a cognitive process in which a subject imagines that he or she performs a movement without actually performing the movement and without even tensing the muscles. It is a dynamic state during which the representation of a specific motor action is internally activated without any motor output
  • 10. Decoding Stress and MI Stress is detected using eye blinks and brain activities from EEG signals The development of BCI systems that can effectively analyze brain signals and discriminate between different MI tasks to control neural prostheses devices has the potential to enhance the quality of life for people with severe motor disabilities.
  • 11. Features Used For Decoding MI • Power Spectral Density : It is a useful concept that allows us to determine the bandwidth of the system. • The Fast Fourier Transform (FFT) : It is a useful scheme for extracting frequency- domain signal features. • Wavelet transform (WT) : . Its basic use includes time- scale signal analysis, signal decomposition and signal compression. Other than these Hjorth Parameters and Kalman filter is also used.
  • 12. Classifiers Used For Decoding Motor Imagery  Generative or Informative classifier - Discriminative classifier  Static classifier - Dynamic classifier  Stable classifier - Unstable classifier  Regularized classifier
  • 13. Performance Analysis In MI Based BCI Research Fuzzy inference is a method that interprets the values in the input vector and, based on some set of rules, assigns values to the output vector, hence providing a number of convenient ways to create fuzzy sets. A Membership function is a curve that defines how each point in the input space is mapped to a membership value or degree of membership between 0 and 1. Here we are using a Gaussian membership function (gaussmf) Gaussian membership curve
  • 14. o An electrode placement EEG system o a 15 channels recording unit (15 EEG electrodes are used ) o a video camera synchronized with EEG recording o a PC running a car racing game for visual and acoustic stimulation o a steering, brake and accelerator for the car stimulator Stress Detection Of Vehicle Drivers During Driving-a Case Study EEG recording of brain activity Car Simulation in PC
  • 15. EEG signal acquisition during the experiment
  • 16. Screenshot of EEG signal showing mild stress levels
  • 17. Feature Extraction And Selection Extracting Power Spectral Density Features Extracting Fourier Transform Features Extracting Wavelet Coefficient Extracting Hjorth Parameters Extracting Kalman Filter Coefficients
  • 18. Power spectral density plots of 0.2 seconds EEG data
  • 20. 0 0.5 1 1.5 2 2.5 3 3.5 4 0 200 400 600 800 1000 1200 1400 1600 1800 2000 0 0.5 1 1.5 2 2.5 3 3.5 4 0 200 400 600 800 1000 1200 1400 1600 1800 2000 4 4.5 5 5.5 6 6.5 7 7.5 8 20 30 40 50 60 70 80 90 100 110 4 4.5 5 5.5 6 6.5 7 7.5 8 20 30 40 50 60 70 80 90 100 110 8 9 10 11 12 13 14 15 16 0 10 20 30 40 50 60 70 80 90 8 9 10 11 12 13 14 15 16 0 10 20 30 40 50 60 70 80 90 16 18 20 22 24 26 28 30 32 0 10 20 30 40 50 60 16 18 20 22 24 26 28 30 32 0 10 20 30 40 50 60 4 wavelets obtained for 1000x15 raw EEG data
  • 21. Kalman filter analysis of EEG data
  • 22. Classifier Validation And Performance 0 0.5 1 1.5 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 Hjorth Complexity Gaussian plot during alarmingly stressed video
  • 23. Wavelet Coefficient Gaussian plot during alarmingly stressed video 0 100 200 300 400 500 600 700 800 900 1000 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
  • 24. Kalman filter Gaussian plot during alarmingly stressed video -4 -3 -2 -1 0 1 2 3 4 x 10 6 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
  • 25. Recognizing Stress Level In the experiment, we collect and analyze EEG data during real-world driving tasks to determine a driver's relative stress level among the 5 stress anchors. EEG data were recorded continuously while drivers followed a set route through open roads in the emulated driving scenario. Minimum and Maximum Values of Features for Relaxed Video 1 2 3 4 5 6 Power Spectral Density 0.5313 0.4636 0.00239 0.39025 0.268 0.4901 Fourier Transform 0.7999 0.7556 0.6806 0.9688 0.7332 0.7336 Wavelet Coefficient 0.4931 0.4538 0.01 0.3166 0.3077 0.4642 Hjorth Complexity 0.9565 0.515 0.5379 0.7387 0.9328 0.97655 Hjorth Mobility 0.9498 0.9649 0.2703 0.9566 0.899 0.9957 Kalman 0.3657 0.3117 0.00001 0.7834 0.2716 0.8538
  • 26. Similarly, minimum and maximum values are obtained for moderately stressed and alarming stressed videos. The triangular norm (tnorm) is used to calculate the membership values of intersection of the fuzzy sets. Stress Level Relax Situational Stress Alarming Stress tnorm 0.246555 0.49265 0.4141 tnorm for different stress levels Since the maximum value of tnorm is in alarming stress set, hence the subject is highly stressed and the car needs to be stopped for safety.
  • 27. Future Research Directions Experiments in this area have gradually shown promise. Scientists at Swiss University are working with a car manufacturer Nissan to find out if they could use brain signals to improve driving experience. The idea is that a computer on- board the car could detect a driver’s intentions split seconds before they act by reading their brain signals. The computer could then opt to intervene or assist the driver, depending on external detection of other cars and objects around the car. Brain measurements are used trying to understand what the driver is trying to do. The brain signals are very good at detecting the whole environment around the car and making the decisions themselves but the muscles react to situations much slower as when we are driving we use both our hands and feet making it complicated. So we are bad executors having response time slower. The body controlling signals in our brain are still there and these brain signals are utilized to make an automated car making response time faster and safer than the driver would have made himself. But this doesn’t mean that the driver is half-asleep and the computer does everything for him/her. The driver is still kept active and the driving experience is improved.