SlideShare a Scribd company logo
1 of 54
Download to read offline
Machine Learning Methods to Learn
Improved EEG Biomarkers in Clinical Trials
David Carlson
Assistant Professor
Dept. of Civil & Environmental Engineering
Dept. of Biostatistics and Bioinformatics
Duke Clinical Research Institute
Learning Interpretable Neural Biomarkers for
Clinical Conditions or Outcomes
• Neural activity is frequently used to try to understand the basis of
neuropsychiatric disorders and effects of treatment
• Neural activity is complex
• Can we use machine learning to break the complex signals into interpretable
patterns?
• Are these signals related to susceptibility or treatment outcomes?
• Can they be used to develop novel treatments?
h), it is easier to classify the subject ID than the stage. This
se us two problems:
Does the learned model overfit the data?
Can the learned model be generalized to new patients?
EEG
EEG
EEG
EEG
Train
Test
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
BLA
10
20
30
40
50
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
2 to 8Hz
Non-Stressed Resilient Susceptible
HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1
0
0.05
0.1
0.15
0.2
0.25
NetworkScore
Pre-Chronic Stress Post-Chronic Stress
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
BLA
10
20
30
40
50
CeA10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
8-20Hz
0
0.01
0.02
0.03
0.04
Non-Stressed Resilient Susceptible
HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1
NetworkScore
Pre-Chronic Stress Post-Chronic Stress
0.05
RegionsRegionsRegionsRegions
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
2-6Hz
0
0.24
0.48
0.72
HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1
NetworkScore
Pre-Chronic Stress Post-Chronic Stress
Network
RegionsRegions
Network3Network4
12 to 20Hz
0
0.3
10 15 20 25 30 35 40 45 500 5
0
0.3
10 15 20 25 30 35 40 45 500 5
VSub
VSub
Frequency
Frequency
SpectralDensity
Frequency
SpectralDensity
Animal Studies Clinical Trials
Can machine learning help understand neural
circuits?
• Ongoing collaborations with Laboratory for
Psychiatric Neuroengineering led by Kafui
Dzirasa
• Trying to understand how the brain acts and
changes in animal models of neuropsychiatric
disorders
• Especially interested in early biomarkers:
• E.G., susceptibility for depression prior to any
behavioral signs
• Can we find these types of information on
neural signals alone?
Kafui Dzirasa
Depression (MDD)
(1) depressed mood
(2) diminished interest
(3) increase or decrease in appetite
(4) hypersomnia or insomnia
(5) psychomotor agitation or retardation
(6) fatigue or loss of energy
(7) feelings of worthlessness or excessive or inappropriate guilt
(8) diminished ability to think or concentrate
(9) recurrent thoughts of death
Most debilitating illness in the world (WHO, 2017)
Normal Function
Is MDD prevention a viable therapeutic
strategy??
AGING
Digoxin
Pacemaker
Heart Attack/Heart Failure
Blood Pressure/Cholesterol
Normal Function (Resilience)
Is MDD prevention a viable therapeutic
strategy??
Severe Stress
Antidepressants
MDD (Susceptibility)
Vulnerability
Can neural biomarkers signal vulnerability?
A Problem
From Kragel et. al. Plos Biology 2016
Emotions as latent networks
Dzirasa et. al -J. Neurosci Methods, 2011
Schaich Borg et. al eNeuro, 2015
Local Field Potentials (LFPs)
Describing neural activity as an electrical
connectome (Electome)
Interpretable patterns of neural activity
Break observed signals into electomes
• Each latent function is represented by one of our networks,
and the scores change how much each network is expressed.
Gallagher et al. NIPS 2017
Case Study: Mouse Model of Depression
• 44 mice used in a behavior study LFPs recorded during:
• Home cage
• Novel environment (FIT-Empty)
• Forced interaction test (FIT-CD1)
• Non-control mice go through a chronic stress paradigm
• Learn 20 features (electomes)
• Use features to predict:
• Behavioral condition
• Pre- and post-stress conditions
• Stress resiliency (i.e. is mouse depressed after chronic stress)
Latent networks in a Stress model?
Predictive Electome
• The most predictive factor is correlated with increased stress-
susceptibility (p-value of 9.7 ×10'(
using two-tailed Wilcoxon Rank-
Sum test). Left shows power coherence, middle shows directionality,
and the right shows inferred scores during experiments.
BLA
10
20
30
40
50
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
2 to 8Hz
Non-Stressed Resilient Susceptible
HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1
0
0.05
0.1
0.15
0.2
0.25
NetworkScore
Pre-Chronic Stress Post-Chronic Stress
0.1
0.12
Non-Stressed Resilient Susceptible
BLA
10
20
30
40
5050
VTA
10
20
30
40
50
BLA CeA IL_Cx NAc PrL_Cx VSub VTA
0
6
IL_Cx
0
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
0
HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1
Pre-Chronic Stress Post-Chronic Stress
RegionsRegionsRegions
Network4
12 to 20Hz
0
0.3
10 15 20 25 30 35 40 45 500 5
0
0.3
10 15 20 25 30 35 40 45 500 5
VSub
VSub
Frequency
SpectralDensity
Frequency
SpectralDensity
Hultman et al. Cell 2018
Is this REAL????
Does this pattern hold up?
• Molecular model of vulnerability
• Sidekick 1
• Physiological model of vulnerability
• Interferon alpha
• Behavioral model of vulnerability
• Childhood Trauma
• Genetic Risk Factor
• The learned electomes repeatedly hold up across many different type
of vulnerability signals
Hultman et al. Cell 2018
Can we adapt to clinical trials and
studies on humans?
Large-Scale Studies and Trials
• Can we talk these same ideas and make
them work on human data?
• Can we help improve understanding of
the brain and responses in clinical
interventions?
• Large scale data is being built: NIH
recently awarded a Autism Center of
Excellence to support large scale studies
and clinical trials in Autism Spectrum
Disorder (ASD) and Attention Deficit
Hyperactivity Disorder (ADHD)
Geri Dawson
Machine-learning approaches to EEG-based
biomarkers in ASD clinical trials
• Utilized data from an open label trial of 25 2-7 year old children who received a
single infusion of autologous umbilical cord blood. Behavioral, EEG, and MRI data
collected at baseline, 6 months, and 12 months post infusion.
• Analyzed this initial cohort of 25 children to try to answer two questions:
• Can we track EEG changes that happen after treatment?
• Can we predict who will/will not show changes after treatment?
• First developed an interpretable machine learning framework
• Then built a computational framework to address “little big data”
• All developed frameworks are going to be used to help analyze much larger
closed-label trials that just finished or are underway (Duke Autism Center of
Excellence)
EEG vs LFP
Transparent Machine Learning for EEG
• We have developed a custom
Convolutional Neural Network (CNN)
approach for electroencephalography
(EEG) data, SyncNet
• Learns a mapping to a pseudo-input
space; able to incorporate studies with
differing electrode layouts into the
same analysis (GP Adapter)
• Is this CNN interpretable?
Li et al, NeurIPS 2017
Shallow Convolutional Neural Network
1st Filter Bank
1D Convolutional Filters
2nd Filter Bank
…
Max Pooling
1st Feature
Extracted (Scalar) Features
2nd Feature
3rd Filter Bank 3rd Feature
𝑠* ∈ ℝ-
K different filter banks
…
…
Only a single convolutional layer
Can view this as a nonlinear feature extraction step.
Viewing our CNN as a
Nonlinear Feature Extraction
Nonlinear
Feature
Extraction
Logistic
Regression
Low-Dimensional
Extracted Feature
Can interpret logistic
regression weights.
Can we understand and interpret the
extracted features?
Parameterized Convolutional Filters
• SyncNet uses parameterized convolutional filters based on Morlet
wavelets
𝑓/
(1)
𝜏 = 𝑏/
1
𝑐𝑜𝑠 𝜔 1
𝜏 + 𝜙/
1
𝑒'< = >?
• 𝑐, 𝑘 are channel (which electrode) and filter index, respectively
• 𝜔 1 and 𝛽 1 control frequency properties
• 𝑏/
1
and 𝜙/
1
are channel-specific amplitudes and phase shifts
• Frequency properties are well-understood from wavelets, so we can
borrow that knowledge
Extracting Features
• Can extract the output of the convolutional
filters:
𝒉*1 = F
/
𝑥*/ ∗ 𝑓/
(1)
𝜏
Iℎ*1 = max(𝒉*1)
• This is a max pooling over the complete
time window
• Each convolutional filter bank is reduced to a
single output
• K distinct filter banks will convert an EEG
window into K features.
• Can view this as a nonlinear feature
extractor
Learning Treatment Biomarkers
• Want to learn neural dynamics that change post-treatment
• To evaluate this, we attempt to classify the treatment stage of the autologous
umbilical cord blood clinical trial (0 months/baseline, 6 months post-treatment,
and 12-months post-treatment) using EEG alone
• Proof-of-concept for applying to methodology to larger datasets and also learning
diagnostic classification and treatment efficacy biomarkers from EEG signals
• No controls yet
• Closed-label clinical trial (N=180) (placebo vs. treatment) just finished and will be analyzed
soon.
Convolutional Filter Visualization
Figure: One of the ten features learned in the neural network. (Left) This figure shows relative power in
arbitrary units (a.u.) defined by the learned variables in the network. (Middle) This figure shows the frequency
range used by the learned filter defined by the learned variables. (Right) To demonstrate the effect of the
learned feature, one can visualize its value from each data sample.
Does this learn better biomarkers?
• Evaluated by leave-one-
participant out cross-validation,
average over windows
• Predict one of (baseline, 6
months post-treatment, 12
months post-treatment)
• Most common analysis is based
on Power Spectral Density
features
Accuracy
Random Guessing 33.3
Dominant Class 41.1
Diff. Ent. + SVM 50.4
Power Spec.
Density+SVM
49.9
MC-DCNN* 58.4
SyncNet* 60.1
*Custom CNN-based approaches
Windowing data makes it seem much bigger
than it really is
• Standard practice is to predict over sub-segments of EEG data, which
makes N seem large (540 labeled “samples” per patient without
missing data)
• Only have 25 participants (22 with usable data)
“Little Big Data”
One primary goal was to
set up and address the
structure of data collection
Many repeats and labels
(e.g high N), especially
true when looking at
instantaneous EEG
Only a few participants
to represent the entire
population
propose us two problems:
Does the learned model overfit the data?
Can the learned model be generalized to new patient
EEG
EEG
EEG
EEG
EEG
Train
Test
Figure: Example of Domain Adaptation.
Biological and Medical
Measurements are
Heterogenous
Often measurements have more differences
between individuals than between
outcomes/labels.
On the right is a TSNE representation of a
behavioral test of a mouse model of ASD.
Separate mice are coded by a different color.
Each point is one observation from a single
mouse.
Do we learn participant-specific features?
• If we learn SyncNet to predict
class, learns participant-specific
patterns
• The confusion matrix on the right
takes the extracted features from
SyncNet and predicts participant
ID
• High accuracy despite not being
trained for this task
• Can we tell the network it
shouldn’t do this?
An Existing Approach: Domain Adversarial
Neural Networks
Nonlinear
Feature
Extraction
Logistic
Regression
Low-Dimensional
Extracted Feature
Label
Classifier Domain
While the network is being learned:
• One classifier to predict label
• One classifier to predict domain
• The features should work well to predict
the label but trick the domain classifier
Ganin et al, 2016
Removes participant-specific information in the feature
space!
Problem solved?
• Removes participant-specific
information
• Learned features much less predictive of
identity
• Makes the network perform worse
• The assumption requires that all
participants are the same in the feature
space
• Works well in images and text data
• Bad assumption in medical data—every
child is unique!
Accuracy
Random Guessing 33.3
Dominant Class 41.1
Diff. Ent. + SVM 50.4
Power Spec.
Density+SVM
49.9
MC-DCNN 58.4
SyncNet 60.1
SyncNet+DANN 58.7
A less stringent assumption
• Instead we want require:
• Every participants feature space is similar to a weighted superposition of the
other participants
• Succinctly, you need to be similar to at least one other person, but not
everyone!
• This can also be trained in an adversarial framework
• The network has the following properties:
• The label prediction tries to predict well on the labels/outcomes
• The domain classifier tries to predict which individual, but the loss is modified
to only penalize if you can differentiate between similar individuals
• The learned features try to do well on label prediction and trick the domain
classifier
Li et al, NeurIPS 2018, AISTATS 2019
Accomplished by Adversarial Learning
Celebrity Face Generation
Karras et al. 2018 Text-to-bird generation.
Zhang et. al. 2016
Adversarial learning is more commonly associated with generating fake images…
Learning Participant Relationships
subjects?
Similar subject should be similar in the feature
The feature should be good at predict treatm
Once we have these features, we can calculate dist
any two subjects.
Figure: The relationship learned by the propose
• Instead, we want to learn relationships between
participants
• Should have similar features to a few similar
participants
• As data size increases, we want to find cliques of
similar individuals
• Large practically important gains on the Autism
Center data
Li et. al., NeurIPS 2018, Li et. Al., AISTATS 2019
Does Multiple Domain Adaptation Help Us?
• Combining our previous interpretable neural
network approach (SyncNet) with our
Multiple Domain Matching Network (MDMN)
yields significant gains
• Statistically significant improvement (p=.002,
Wilcoxon Paired-Rank Test)
• This types of biomarkers can be used to
explore how the brain is changing post-
treatment
Accuracy
Random Guessing 33.3
Dominant Class 41.1
Diff. Ent. + SVM 50.4
Power Spec.
Density+SVM
49.9
MC-DCNN 58.4
SyncNet 60.1
SyncNet+DANN 58.7
SyncNet+MDMN 67.8
Universal Device Mapping
• A real issue in using neural
derived biomarkers is that
different research groups and
different hospitals use distinct
recording devices and electrode
layouts
• Can we learn a universal
mapping to a pseudo-input
space?
𝒑 𝒑∗
Gaussian Process Adapter
• A Gaussian process is a non-parametric
method where every finite set of points is
defined by a multivariate normal
• We define a set of pseudo-inputs 𝑝∗
• Can infer these the EEG signal at the
pseudo-input locations by using a
conditional Gaussian distribution with
𝑐𝑜𝑣 𝑝/, 𝑝/Q = 𝑘R 𝑝/, 𝑝/Q
• Really just a probabilistic interpolation
• Can learn the pseudo-input locations
• Can learn the covariance kernel parameters Li & Marlin, 2016
Li et al., 2017
𝒑 𝒑∗
SyncNet GP-SyncNet Joint
DEAP 0.52±.03 0.56±.02 0.60±.02
SEED 0.77±.01 0.76±.01 0.78±.01
Proof-of-concept on emotion recognition.
Moving to Large-Scale Trials
• A recently completed Stage 2 trial (DukeACT) of the same treatment
was just completed (N=180)
• Two groups in this study:
• Treatment at 0 months, placebo at 6 months
• Placebo at 0 months, treatment at 6 months
• Can ask multiple questions:
• What is the treatment effect?
• Can we do predictive medicine and predict treatment response?
• Analysis on studies and trials from the NIH
Autism Center of excellence in ASD+ADHD will
begin in the near future
Incorporating Behavior Information
• Large computer vision effort to
automatically derive behavioral features
(led by Guillermo Sapiro’s group)
• Autism and Beyond App
• Modified all future data collection to
simultaneously collect synchronized EEG +
video
• Can we combined EEG + automatically
derived features to create stronger
digital phenotypes
• ASD vs. Typically Developing:
• EEG alone: .75 AUC
• Behavior alone: .68 AUC
• EEG+Behavior: .88 AUC
Visualization of our features
extraction from our computer vision
system currently in use in data
collection.
Guillermo Sapiro
Isaev, under review.
Dmitry Isaev
Incorporating into Clinical
Practice
Inclusion in ASD practice is still a long way off, but many other uses exist for this
type of technology in clinical practice.
Many Other Uses in Clinical Settings
• Neonatal hypoxic injury and seizures
• Can these types of algorithms improve early
detection and allow faster treatment?
Dmitry Tchapyjnikov, MD
Accuracy of diagnosing a seizure
based on clinical signs in infants
Number of infants who develop
seizures when undergoing
hypothermia therapy after
traumatic birth
EEG is Necessary to Diagnose Seizures in Neonates
Doctors can only read EEGS once every several
hours
Delays to seizure diagnosis and treatment
Want to adapt the developed methodology
for seizure detection
Currently underway with ~=.9 AUC inter-patient.
Tchapyjnikov, in prep.
Seizure Occurs
Seizure
Detected
Nurse Alerted
Seizure confirmed
Begin treatment
Implement via a bedside alarm if concern for
seizure
Automation will decrease time to treatment.
Are we learning patterns of
neural control?
Can actually test in animal models.
Interpretable networks create testable
hypotheses
a -DIO-ChETA -EYFP
-50
0
50
edpotential(V)
Data Acquisition System
30kHz
Waveform
Generator
Real time
LFP Phase Analysis
60ms TTL
Signal
Blue
Yellow
Phase Triggered
Pulse
Thal
Stimulating
Fiber
Light Stimulus
IL LFP
Phase Trigger
Laser TTL
200ms
3-7Hz
b
40
50
60
edpotential(V)
**
neural Closed Loop Actuator for Synchronizing Phase (nCLASP) system
Thal
Optogenetic Validation of Learned Features
Hultman et al. Neuron 2016
Real-Time Mapping and Control
BLA
10
20
30
40
50
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
BLA
10
20
30
40
50
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
2 to 8Hz
Non-Stressed Resilient
HC FIT-Empty FIT-CD1 HC F
0
0.05
0.1
0.15
0.2
0.25
NetworkScore
Pre-Chronic Stress Post-C
0
0.02
0.04
0.06
0.08
0.1
0.12
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
Non-Stressed Resilient
BLA
10
20
30
40
50
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
HC FIT-Empty FIT-CD1 HC F
NetworkScore
Pre-Chronic Stress Post-C
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
BLA
10
20
30
40
50
CeA
10
20
30
40
50
IL_Cx
10
20
30
40
50
PrL_Cx
10
20
30
40
50
NAc
10
20
30
40
50
VSub
10
20
30
40
50
VTA
10
20
30
40
50
8-20Hz
0
0.01
0.02
0.03
0.04
Non-Stressed Resilient
HC FIT-Empty FIT-CD1 HC F
NetworkScore
Pre-Chronic Stress Post-C
0.05
RegionsRegionsRegionsRegionsRegionsRegions
BLA
BLA
CeA
CeA
IL_Cx
IL_Cx
NAc
NAc
PrL_Cx
PrL_Cx
VSub
VSub
VTA
VTA
0
6
6
0
2-6Hz
0
0.24
0.48
0.72
0.96
Non-Stressed Resilient
HC FIT-Empty FIT-CD1 HC FI
NetworkScore
Pre-Chronic Stress Post-C
1.20
Network2
RegionsRegions
Network3Network4Network6
12 to 20Hz
10 15 20 25 30 35 40 45 50
0
0.3
0 5
0
0.3
10 15 20 25 30 35 40 45 500 5
0
0.3
10 15 20 25 30 35 40 45 500 5
0
0.3
10 15 20 25 30 35 40 45 500 5
VSub
VSub
VSub
VSub
Frequency
SpectralDensity
Frequency
SpectralDensity
Frequency
SpectralDensity
Frequency
SpectralDensity
!"
!#
!$
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
Yw1
Yw
Yw+1
Yw+2
BLA
Ce
IL
NAc
PrL
VSub
VTA
zw
sw1sw2...swL
yw
1yw
2
...yw
N
✓
W
Figure1:Left:Examplelocalfieldpotentialdatafromsevendistinctbrainregions,segmented
5secondtimewindows.Right:Graphicalmodelforthejointgenerative/discriminativedCSFA
where,foranylocationxintheinputspace,theprocessisdefinedbythemeanfunc
m(x)2RR
,whichisoftensettoequal0withoutlossofgenerality,andthecovariancef
tion(K(x,x0
;✓))r,r0=kr,r0
(x,x0
;✓),cov(fr(x),fr0(x0
)),whichdefineshowinputlocati
inregionrcovarieswithinputlocationx0
inregionr0
.
AnyfinitesetofobservationsY=[y1,...,yN]atinputlocationsx=[x1,...,xN]T
are
resentedbyamultivariatenormaldistribution,andtheparameters✓maybeoptimizedtofitt
observationsbymaximizingthemarginallikelihood
✓⇤
=argmax
✓
logp(Y|X,✓),p(Y|X,✓)=N
⇣
vec(YT
);0,K+⌘1
INR
⌘
,
wherevec(·)isacolumn-wisevectorizationofitsmatrix-valuedargumentandK2RNR⇥NR
i
Grammatrixdefinedbythecovariancekernelevaluatedatinputandoutputlocationsassociated
vec(YT
).Theformofthecovariancekernelconstrainsthetypesofposteriorfunctionsthatma
representedbytheGaussianprocess.Recently,expressivecovariancekernelshavebeenexpl
[31,32,28]thatarecapableofrepresentinganystationarykernelwhiletreating✓asexpres
featuresofinterestextractedfromthemodel.
2.2Thecross-spectralmixture(CSM)kernel
Themulti-regionelectrophysiologicalrecordingsarequasi-periodicsignalswithquasi-statio
cross-spectraldensities[28].Weassumethatwithinasingletask(i.e.,slidingwindowofdata)
observationsmayberepresentedbyastationaryGaussianprocess.Withinthistask,thedatacon
frequency-dependentpowerandphasesynchronybetweenbrainregions.Thiscross-couplin
believedtofacilitatecommunicationofinformationbetweenconnectedbrainregions.
Designedtocapturetheseexpressivefeatures,thecross-spectralmixture(CSM)kernel[28]isg
%&"
%&#
%&$
-50
0
50
0Hz)Evokedpotential(V)
Max
se(count)
Z = 256
P = 9x10-144
50
Data Acquisition System
30kHz
Waveform
Generator
Real time
LFP Phase Analysis
60ms TTL
Signal
Blue
Yellow
Phase Triggered
Pulse
Light Stimulus
IL LFP
Phase Trigger
Laser TTL
200ms
3-7Hz
b
20
30
40
50
60
0Hz)Evokedpotential(V)
Thal
**
neural Closed Loop Actuator for Synchronizing Phase (nCLASP) system
Can map in real time by approximating with
neural networks.
Bidirectional Neural Interface
Currently underway to evaluate treatment in an aggressive mouse model.
Conclusions
• Clinical trial data is an exciting route to develop and apply machine
learning tools
• Our focus on neural signals has strong evidence on a small cohort in
an early-stage clinical trial to relate neural measurements to clinically
relevant variables.
• Large-scale trials and observational studies are currently underway.
Acknowledgements & Funding
• PhD Students:
• Yitong Li
• William Carson
• Neil Gallagher
• Austin Talbot
• Laboratory for Psychiatric
Neuroengineering
• Kafui Dzirasa
• Rainbo Hultman
• Steven Mague
• Duke Center for Autism and Brain
Development
• Geri Dawson
• Michael Murias
• Sam Major
• National Institutes of Health
• W.M. Keck Foundation
• Stylli Foundation

More Related Content

Similar to PMED Transition Workshop - Machine Learning Methods to Learn Improved Electrophysiological Biomarkers in Clinical Trials - David Carlson, May 21, 2019

Epileptic Seizure Detection using An EEG Sensor
Epileptic Seizure Detection using An EEG SensorEpileptic Seizure Detection using An EEG Sensor
Epileptic Seizure Detection using An EEG SensorIRJET Journal
 
Biomedical Signals Classification With Transformer Based Model.pptx
Biomedical Signals Classification With Transformer Based Model.pptxBiomedical Signals Classification With Transformer Based Model.pptx
Biomedical Signals Classification With Transformer Based Model.pptxSandeep Kumar
 
Improved feature exctraction process to detect seizure using CHBMIT-dataset ...
Improved feature exctraction process to detect seizure  using CHBMIT-dataset ...Improved feature exctraction process to detect seizure  using CHBMIT-dataset ...
Improved feature exctraction process to detect seizure using CHBMIT-dataset ...IJECEIAES
 
Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...
Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...
Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...HayleyBoyd5
 
Smart Home for Paralyzed Aid
Smart Home for Paralyzed AidSmart Home for Paralyzed Aid
Smart Home for Paralyzed AidIRJET Journal
 
Automatic Sleep Staging Using State Machine-controlled Decision Trees
Automatic Sleep Staging Using State Machine-controlled Decision TreesAutomatic Sleep Staging Using State Machine-controlled Decision Trees
Automatic Sleep Staging Using State Machine-controlled Decision TreesAnas Imtiaz
 
EEG based Motor Imagery Classification using SVM and MLP
EEG based Motor Imagery Classification using SVM and MLPEEG based Motor Imagery Classification using SVM and MLP
EEG based Motor Imagery Classification using SVM and MLPDr. Rajdeep Chatterjee
 
[Research] Detection of MCI using EEG Relative Power + DNN
[Research] Detection of MCI using EEG Relative Power + DNN[Research] Detection of MCI using EEG Relative Power + DNN
[Research] Detection of MCI using EEG Relative Power + DNNDonghyeon Kim
 
Deep learning for_ecg_classification
Deep learning for_ecg_classificationDeep learning for_ecg_classification
Deep learning for_ecg_classificationtriwiyantotriwiyanto
 
EEG Signal Classification using Deep Neural Network
EEG Signal Classification using Deep Neural NetworkEEG Signal Classification using Deep Neural Network
EEG Signal Classification using Deep Neural NetworkIRJET Journal
 
Ecg beat classification and feature extraction using artificial neural networ...
Ecg beat classification and feature extraction using artificial neural networ...Ecg beat classification and feature extraction using artificial neural networ...
Ecg beat classification and feature extraction using artificial neural networ...priyanka leenakhabiya
 
How to mea­sure and improve brain-based out­comes that mat­ter in health care
How to mea­sure and improve brain-based out­comes that mat­ter in health careHow to mea­sure and improve brain-based out­comes that mat­ter in health care
How to mea­sure and improve brain-based out­comes that mat­ter in health careSharpBrains
 
IRJET-A Survey on Effect of Meditation on Attention Level Using EEG
IRJET-A Survey on Effect of Meditation on Attention Level Using EEGIRJET-A Survey on Effect of Meditation on Attention Level Using EEG
IRJET-A Survey on Effect of Meditation on Attention Level Using EEGIRJET Journal
 
Presentation of master thesis
Presentation of master thesisPresentation of master thesis
Presentation of master thesisSalim Rukhsar
 
Navigating through disease maps
Navigating through disease mapsNavigating through disease maps
Navigating through disease mapsJoaquin Dopazo
 
Electrophysiological imaging for advanced pharmacological screening
Electrophysiological imaging for advanced pharmacological screeningElectrophysiological imaging for advanced pharmacological screening
Electrophysiological imaging for advanced pharmacological screening3Brain AG
 
Icasert 2019 pid_230_revised
Icasert 2019 pid_230_revisedIcasert 2019 pid_230_revised
Icasert 2019 pid_230_revisedMd Kafiul Islam
 
台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)
台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)
台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)AI.academy
 
Automated_EEG_artifact_elimination_by_applying_mac.pdf
Automated_EEG_artifact_elimination_by_applying_mac.pdfAutomated_EEG_artifact_elimination_by_applying_mac.pdf
Automated_EEG_artifact_elimination_by_applying_mac.pdfmurali926139
 

Similar to PMED Transition Workshop - Machine Learning Methods to Learn Improved Electrophysiological Biomarkers in Clinical Trials - David Carlson, May 21, 2019 (20)

Epileptic Seizure Detection using An EEG Sensor
Epileptic Seizure Detection using An EEG SensorEpileptic Seizure Detection using An EEG Sensor
Epileptic Seizure Detection using An EEG Sensor
 
Biomedical Signals Classification With Transformer Based Model.pptx
Biomedical Signals Classification With Transformer Based Model.pptxBiomedical Signals Classification With Transformer Based Model.pptx
Biomedical Signals Classification With Transformer Based Model.pptx
 
Improved feature exctraction process to detect seizure using CHBMIT-dataset ...
Improved feature exctraction process to detect seizure  using CHBMIT-dataset ...Improved feature exctraction process to detect seizure  using CHBMIT-dataset ...
Improved feature exctraction process to detect seizure using CHBMIT-dataset ...
 
Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...
Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...
Improvement of a Bidirectional Brain-Computer Interface for Neural Engineerin...
 
Smart Home for Paralyzed Aid
Smart Home for Paralyzed AidSmart Home for Paralyzed Aid
Smart Home for Paralyzed Aid
 
Automatic Sleep Staging Using State Machine-controlled Decision Trees
Automatic Sleep Staging Using State Machine-controlled Decision TreesAutomatic Sleep Staging Using State Machine-controlled Decision Trees
Automatic Sleep Staging Using State Machine-controlled Decision Trees
 
EEG based Motor Imagery Classification using SVM and MLP
EEG based Motor Imagery Classification using SVM and MLPEEG based Motor Imagery Classification using SVM and MLP
EEG based Motor Imagery Classification using SVM and MLP
 
[Research] Detection of MCI using EEG Relative Power + DNN
[Research] Detection of MCI using EEG Relative Power + DNN[Research] Detection of MCI using EEG Relative Power + DNN
[Research] Detection of MCI using EEG Relative Power + DNN
 
Deep learning for_ecg_classification
Deep learning for_ecg_classificationDeep learning for_ecg_classification
Deep learning for_ecg_classification
 
EEG Signal Classification using Deep Neural Network
EEG Signal Classification using Deep Neural NetworkEEG Signal Classification using Deep Neural Network
EEG Signal Classification using Deep Neural Network
 
Ecg beat classification and feature extraction using artificial neural networ...
Ecg beat classification and feature extraction using artificial neural networ...Ecg beat classification and feature extraction using artificial neural networ...
Ecg beat classification and feature extraction using artificial neural networ...
 
How to mea­sure and improve brain-based out­comes that mat­ter in health care
How to mea­sure and improve brain-based out­comes that mat­ter in health careHow to mea­sure and improve brain-based out­comes that mat­ter in health care
How to mea­sure and improve brain-based out­comes that mat­ter in health care
 
IRJET-A Survey on Effect of Meditation on Attention Level Using EEG
IRJET-A Survey on Effect of Meditation on Attention Level Using EEGIRJET-A Survey on Effect of Meditation on Attention Level Using EEG
IRJET-A Survey on Effect of Meditation on Attention Level Using EEG
 
Presentation of master thesis
Presentation of master thesisPresentation of master thesis
Presentation of master thesis
 
Dsp review
Dsp reviewDsp review
Dsp review
 
Navigating through disease maps
Navigating through disease mapsNavigating through disease maps
Navigating through disease maps
 
Electrophysiological imaging for advanced pharmacological screening
Electrophysiological imaging for advanced pharmacological screeningElectrophysiological imaging for advanced pharmacological screening
Electrophysiological imaging for advanced pharmacological screening
 
Icasert 2019 pid_230_revised
Icasert 2019 pid_230_revisedIcasert 2019 pid_230_revised
Icasert 2019 pid_230_revised
 
台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)
台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)
台灣人工智慧學校北部智慧醫療專班開學典禮 - 主題演講:邁向智慧醫療新時代(陳昇瑋執行長)
 
Automated_EEG_artifact_elimination_by_applying_mac.pdf
Automated_EEG_artifact_elimination_by_applying_mac.pdfAutomated_EEG_artifact_elimination_by_applying_mac.pdf
Automated_EEG_artifact_elimination_by_applying_mac.pdf
 

More from The Statistical and Applied Mathematical Sciences Institute

More from The Statistical and Applied Mathematical Sciences Institute (20)

Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
 
2019 Fall Series: Special Guest Lecture - 0-1 Phase Transitions in High Dimen...
2019 Fall Series: Special Guest Lecture - 0-1 Phase Transitions in High Dimen...2019 Fall Series: Special Guest Lecture - 0-1 Phase Transitions in High Dimen...
2019 Fall Series: Special Guest Lecture - 0-1 Phase Transitions in High Dimen...
 
Causal Inference Opening Workshop - Causal Discovery in Neuroimaging Data - F...
Causal Inference Opening Workshop - Causal Discovery in Neuroimaging Data - F...Causal Inference Opening Workshop - Causal Discovery in Neuroimaging Data - F...
Causal Inference Opening Workshop - Causal Discovery in Neuroimaging Data - F...
 
Causal Inference Opening Workshop - Smooth Extensions to BART for Heterogeneo...
Causal Inference Opening Workshop - Smooth Extensions to BART for Heterogeneo...Causal Inference Opening Workshop - Smooth Extensions to BART for Heterogeneo...
Causal Inference Opening Workshop - Smooth Extensions to BART for Heterogeneo...
 
Causal Inference Opening Workshop - A Bracketing Relationship between Differe...
Causal Inference Opening Workshop - A Bracketing Relationship between Differe...Causal Inference Opening Workshop - A Bracketing Relationship between Differe...
Causal Inference Opening Workshop - A Bracketing Relationship between Differe...
 
Causal Inference Opening Workshop - Testing Weak Nulls in Matched Observation...
Causal Inference Opening Workshop - Testing Weak Nulls in Matched Observation...Causal Inference Opening Workshop - Testing Weak Nulls in Matched Observation...
Causal Inference Opening Workshop - Testing Weak Nulls in Matched Observation...
 
Causal Inference Opening Workshop - Difference-in-differences: more than meet...
Causal Inference Opening Workshop - Difference-in-differences: more than meet...Causal Inference Opening Workshop - Difference-in-differences: more than meet...
Causal Inference Opening Workshop - Difference-in-differences: more than meet...
 
Causal Inference Opening Workshop - New Statistical Learning Methods for Esti...
Causal Inference Opening Workshop - New Statistical Learning Methods for Esti...Causal Inference Opening Workshop - New Statistical Learning Methods for Esti...
Causal Inference Opening Workshop - New Statistical Learning Methods for Esti...
 
Causal Inference Opening Workshop - Bipartite Causal Inference with Interfere...
Causal Inference Opening Workshop - Bipartite Causal Inference with Interfere...Causal Inference Opening Workshop - Bipartite Causal Inference with Interfere...
Causal Inference Opening Workshop - Bipartite Causal Inference with Interfere...
 
Causal Inference Opening Workshop - Bridging the Gap Between Causal Literatur...
Causal Inference Opening Workshop - Bridging the Gap Between Causal Literatur...Causal Inference Opening Workshop - Bridging the Gap Between Causal Literatur...
Causal Inference Opening Workshop - Bridging the Gap Between Causal Literatur...
 
Causal Inference Opening Workshop - Some Applications of Reinforcement Learni...
Causal Inference Opening Workshop - Some Applications of Reinforcement Learni...Causal Inference Opening Workshop - Some Applications of Reinforcement Learni...
Causal Inference Opening Workshop - Some Applications of Reinforcement Learni...
 
Causal Inference Opening Workshop - Bracketing Bounds for Differences-in-Diff...
Causal Inference Opening Workshop - Bracketing Bounds for Differences-in-Diff...Causal Inference Opening Workshop - Bracketing Bounds for Differences-in-Diff...
Causal Inference Opening Workshop - Bracketing Bounds for Differences-in-Diff...
 
Causal Inference Opening Workshop - Assisting the Impact of State Polcies: Br...
Causal Inference Opening Workshop - Assisting the Impact of State Polcies: Br...Causal Inference Opening Workshop - Assisting the Impact of State Polcies: Br...
Causal Inference Opening Workshop - Assisting the Impact of State Polcies: Br...
 
Causal Inference Opening Workshop - Experimenting in Equilibrium - Stefan Wag...
Causal Inference Opening Workshop - Experimenting in Equilibrium - Stefan Wag...Causal Inference Opening Workshop - Experimenting in Equilibrium - Stefan Wag...
Causal Inference Opening Workshop - Experimenting in Equilibrium - Stefan Wag...
 
Causal Inference Opening Workshop - Targeted Learning for Causal Inference Ba...
Causal Inference Opening Workshop - Targeted Learning for Causal Inference Ba...Causal Inference Opening Workshop - Targeted Learning for Causal Inference Ba...
Causal Inference Opening Workshop - Targeted Learning for Causal Inference Ba...
 
Causal Inference Opening Workshop - Bayesian Nonparametric Models for Treatme...
Causal Inference Opening Workshop - Bayesian Nonparametric Models for Treatme...Causal Inference Opening Workshop - Bayesian Nonparametric Models for Treatme...
Causal Inference Opening Workshop - Bayesian Nonparametric Models for Treatme...
 
2019 Fall Series: Special Guest Lecture - Adversarial Risk Analysis of the Ge...
2019 Fall Series: Special Guest Lecture - Adversarial Risk Analysis of the Ge...2019 Fall Series: Special Guest Lecture - Adversarial Risk Analysis of the Ge...
2019 Fall Series: Special Guest Lecture - Adversarial Risk Analysis of the Ge...
 
2019 Fall Series: Professional Development, Writing Academic Papers…What Work...
2019 Fall Series: Professional Development, Writing Academic Papers…What Work...2019 Fall Series: Professional Development, Writing Academic Papers…What Work...
2019 Fall Series: Professional Development, Writing Academic Papers…What Work...
 
2019 GDRR: Blockchain Data Analytics - Machine Learning in/for Blockchain: Fu...
2019 GDRR: Blockchain Data Analytics - Machine Learning in/for Blockchain: Fu...2019 GDRR: Blockchain Data Analytics - Machine Learning in/for Blockchain: Fu...
2019 GDRR: Blockchain Data Analytics - Machine Learning in/for Blockchain: Fu...
 
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...
2019 GDRR: Blockchain Data Analytics - QuTrack: Model Life Cycle Management f...
 

Recently uploaded

_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptxPoojaSen20
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfUmakantAnnand
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 

Recently uploaded (20)

Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptx
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.Compdf
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 

PMED Transition Workshop - Machine Learning Methods to Learn Improved Electrophysiological Biomarkers in Clinical Trials - David Carlson, May 21, 2019

  • 1. Machine Learning Methods to Learn Improved EEG Biomarkers in Clinical Trials David Carlson Assistant Professor Dept. of Civil & Environmental Engineering Dept. of Biostatistics and Bioinformatics Duke Clinical Research Institute
  • 2. Learning Interpretable Neural Biomarkers for Clinical Conditions or Outcomes • Neural activity is frequently used to try to understand the basis of neuropsychiatric disorders and effects of treatment • Neural activity is complex • Can we use machine learning to break the complex signals into interpretable patterns? • Are these signals related to susceptibility or treatment outcomes? • Can they be used to develop novel treatments? h), it is easier to classify the subject ID than the stage. This se us two problems: Does the learned model overfit the data? Can the learned model be generalized to new patients? EEG EEG EEG EEG Train Test CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 BLA 10 20 30 40 50 CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 2 to 8Hz Non-Stressed Resilient Susceptible HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1 0 0.05 0.1 0.15 0.2 0.25 NetworkScore Pre-Chronic Stress Post-Chronic Stress BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 BLA 10 20 30 40 50 CeA10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 8-20Hz 0 0.01 0.02 0.03 0.04 Non-Stressed Resilient Susceptible HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1 NetworkScore Pre-Chronic Stress Post-Chronic Stress 0.05 RegionsRegionsRegionsRegions BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 2-6Hz 0 0.24 0.48 0.72 HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1 NetworkScore Pre-Chronic Stress Post-Chronic Stress Network RegionsRegions Network3Network4 12 to 20Hz 0 0.3 10 15 20 25 30 35 40 45 500 5 0 0.3 10 15 20 25 30 35 40 45 500 5 VSub VSub Frequency Frequency SpectralDensity Frequency SpectralDensity Animal Studies Clinical Trials
  • 3. Can machine learning help understand neural circuits? • Ongoing collaborations with Laboratory for Psychiatric Neuroengineering led by Kafui Dzirasa • Trying to understand how the brain acts and changes in animal models of neuropsychiatric disorders • Especially interested in early biomarkers: • E.G., susceptibility for depression prior to any behavioral signs • Can we find these types of information on neural signals alone? Kafui Dzirasa
  • 4. Depression (MDD) (1) depressed mood (2) diminished interest (3) increase or decrease in appetite (4) hypersomnia or insomnia (5) psychomotor agitation or retardation (6) fatigue or loss of energy (7) feelings of worthlessness or excessive or inappropriate guilt (8) diminished ability to think or concentrate (9) recurrent thoughts of death Most debilitating illness in the world (WHO, 2017)
  • 5. Normal Function Is MDD prevention a viable therapeutic strategy?? AGING Digoxin Pacemaker Heart Attack/Heart Failure Blood Pressure/Cholesterol
  • 6. Normal Function (Resilience) Is MDD prevention a viable therapeutic strategy?? Severe Stress Antidepressants MDD (Susceptibility) Vulnerability Can neural biomarkers signal vulnerability?
  • 8. From Kragel et. al. Plos Biology 2016 Emotions as latent networks
  • 9. Dzirasa et. al -J. Neurosci Methods, 2011 Schaich Borg et. al eNeuro, 2015
  • 11. Describing neural activity as an electrical connectome (Electome) Interpretable patterns of neural activity
  • 12. Break observed signals into electomes • Each latent function is represented by one of our networks, and the scores change how much each network is expressed. Gallagher et al. NIPS 2017
  • 13. Case Study: Mouse Model of Depression • 44 mice used in a behavior study LFPs recorded during: • Home cage • Novel environment (FIT-Empty) • Forced interaction test (FIT-CD1) • Non-control mice go through a chronic stress paradigm • Learn 20 features (electomes) • Use features to predict: • Behavioral condition • Pre- and post-stress conditions • Stress resiliency (i.e. is mouse depressed after chronic stress)
  • 14. Latent networks in a Stress model?
  • 15. Predictive Electome • The most predictive factor is correlated with increased stress- susceptibility (p-value of 9.7 ×10'( using two-tailed Wilcoxon Rank- Sum test). Left shows power coherence, middle shows directionality, and the right shows inferred scores during experiments. BLA 10 20 30 40 50 CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 2 to 8Hz Non-Stressed Resilient Susceptible HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1 0 0.05 0.1 0.15 0.2 0.25 NetworkScore Pre-Chronic Stress Post-Chronic Stress 0.1 0.12 Non-Stressed Resilient Susceptible BLA 10 20 30 40 5050 VTA 10 20 30 40 50 BLA CeA IL_Cx NAc PrL_Cx VSub VTA 0 6 IL_Cx 0 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 0 HC FIT-Empty FIT-CD1 HC FIT-Empty FIT-CD1 Pre-Chronic Stress Post-Chronic Stress RegionsRegionsRegions Network4 12 to 20Hz 0 0.3 10 15 20 25 30 35 40 45 500 5 0 0.3 10 15 20 25 30 35 40 45 500 5 VSub VSub Frequency SpectralDensity Frequency SpectralDensity Hultman et al. Cell 2018
  • 17. Does this pattern hold up? • Molecular model of vulnerability • Sidekick 1 • Physiological model of vulnerability • Interferon alpha • Behavioral model of vulnerability • Childhood Trauma • Genetic Risk Factor • The learned electomes repeatedly hold up across many different type of vulnerability signals Hultman et al. Cell 2018
  • 18. Can we adapt to clinical trials and studies on humans?
  • 19. Large-Scale Studies and Trials • Can we talk these same ideas and make them work on human data? • Can we help improve understanding of the brain and responses in clinical interventions? • Large scale data is being built: NIH recently awarded a Autism Center of Excellence to support large scale studies and clinical trials in Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD) Geri Dawson
  • 20. Machine-learning approaches to EEG-based biomarkers in ASD clinical trials • Utilized data from an open label trial of 25 2-7 year old children who received a single infusion of autologous umbilical cord blood. Behavioral, EEG, and MRI data collected at baseline, 6 months, and 12 months post infusion. • Analyzed this initial cohort of 25 children to try to answer two questions: • Can we track EEG changes that happen after treatment? • Can we predict who will/will not show changes after treatment? • First developed an interpretable machine learning framework • Then built a computational framework to address “little big data” • All developed frameworks are going to be used to help analyze much larger closed-label trials that just finished or are underway (Duke Autism Center of Excellence)
  • 22. Transparent Machine Learning for EEG • We have developed a custom Convolutional Neural Network (CNN) approach for electroencephalography (EEG) data, SyncNet • Learns a mapping to a pseudo-input space; able to incorporate studies with differing electrode layouts into the same analysis (GP Adapter) • Is this CNN interpretable? Li et al, NeurIPS 2017
  • 23. Shallow Convolutional Neural Network 1st Filter Bank 1D Convolutional Filters 2nd Filter Bank … Max Pooling 1st Feature Extracted (Scalar) Features 2nd Feature 3rd Filter Bank 3rd Feature 𝑠* ∈ ℝ- K different filter banks … … Only a single convolutional layer Can view this as a nonlinear feature extraction step.
  • 24. Viewing our CNN as a Nonlinear Feature Extraction Nonlinear Feature Extraction Logistic Regression Low-Dimensional Extracted Feature Can interpret logistic regression weights. Can we understand and interpret the extracted features?
  • 25. Parameterized Convolutional Filters • SyncNet uses parameterized convolutional filters based on Morlet wavelets 𝑓/ (1) 𝜏 = 𝑏/ 1 𝑐𝑜𝑠 𝜔 1 𝜏 + 𝜙/ 1 𝑒'< = >? • 𝑐, 𝑘 are channel (which electrode) and filter index, respectively • 𝜔 1 and 𝛽 1 control frequency properties • 𝑏/ 1 and 𝜙/ 1 are channel-specific amplitudes and phase shifts • Frequency properties are well-understood from wavelets, so we can borrow that knowledge
  • 26. Extracting Features • Can extract the output of the convolutional filters: 𝒉*1 = F / 𝑥*/ ∗ 𝑓/ (1) 𝜏 Iℎ*1 = max(𝒉*1) • This is a max pooling over the complete time window • Each convolutional filter bank is reduced to a single output • K distinct filter banks will convert an EEG window into K features. • Can view this as a nonlinear feature extractor
  • 27. Learning Treatment Biomarkers • Want to learn neural dynamics that change post-treatment • To evaluate this, we attempt to classify the treatment stage of the autologous umbilical cord blood clinical trial (0 months/baseline, 6 months post-treatment, and 12-months post-treatment) using EEG alone • Proof-of-concept for applying to methodology to larger datasets and also learning diagnostic classification and treatment efficacy biomarkers from EEG signals • No controls yet • Closed-label clinical trial (N=180) (placebo vs. treatment) just finished and will be analyzed soon.
  • 28. Convolutional Filter Visualization Figure: One of the ten features learned in the neural network. (Left) This figure shows relative power in arbitrary units (a.u.) defined by the learned variables in the network. (Middle) This figure shows the frequency range used by the learned filter defined by the learned variables. (Right) To demonstrate the effect of the learned feature, one can visualize its value from each data sample.
  • 29. Does this learn better biomarkers? • Evaluated by leave-one- participant out cross-validation, average over windows • Predict one of (baseline, 6 months post-treatment, 12 months post-treatment) • Most common analysis is based on Power Spectral Density features Accuracy Random Guessing 33.3 Dominant Class 41.1 Diff. Ent. + SVM 50.4 Power Spec. Density+SVM 49.9 MC-DCNN* 58.4 SyncNet* 60.1 *Custom CNN-based approaches
  • 30. Windowing data makes it seem much bigger than it really is • Standard practice is to predict over sub-segments of EEG data, which makes N seem large (540 labeled “samples” per patient without missing data) • Only have 25 participants (22 with usable data)
  • 31. “Little Big Data” One primary goal was to set up and address the structure of data collection Many repeats and labels (e.g high N), especially true when looking at instantaneous EEG Only a few participants to represent the entire population propose us two problems: Does the learned model overfit the data? Can the learned model be generalized to new patient EEG EEG EEG EEG EEG Train Test Figure: Example of Domain Adaptation.
  • 32. Biological and Medical Measurements are Heterogenous Often measurements have more differences between individuals than between outcomes/labels. On the right is a TSNE representation of a behavioral test of a mouse model of ASD. Separate mice are coded by a different color. Each point is one observation from a single mouse.
  • 33. Do we learn participant-specific features? • If we learn SyncNet to predict class, learns participant-specific patterns • The confusion matrix on the right takes the extracted features from SyncNet and predicts participant ID • High accuracy despite not being trained for this task • Can we tell the network it shouldn’t do this?
  • 34. An Existing Approach: Domain Adversarial Neural Networks Nonlinear Feature Extraction Logistic Regression Low-Dimensional Extracted Feature Label Classifier Domain While the network is being learned: • One classifier to predict label • One classifier to predict domain • The features should work well to predict the label but trick the domain classifier Ganin et al, 2016 Removes participant-specific information in the feature space!
  • 35. Problem solved? • Removes participant-specific information • Learned features much less predictive of identity • Makes the network perform worse • The assumption requires that all participants are the same in the feature space • Works well in images and text data • Bad assumption in medical data—every child is unique! Accuracy Random Guessing 33.3 Dominant Class 41.1 Diff. Ent. + SVM 50.4 Power Spec. Density+SVM 49.9 MC-DCNN 58.4 SyncNet 60.1 SyncNet+DANN 58.7
  • 36. A less stringent assumption • Instead we want require: • Every participants feature space is similar to a weighted superposition of the other participants • Succinctly, you need to be similar to at least one other person, but not everyone! • This can also be trained in an adversarial framework • The network has the following properties: • The label prediction tries to predict well on the labels/outcomes • The domain classifier tries to predict which individual, but the loss is modified to only penalize if you can differentiate between similar individuals • The learned features try to do well on label prediction and trick the domain classifier Li et al, NeurIPS 2018, AISTATS 2019
  • 37. Accomplished by Adversarial Learning Celebrity Face Generation Karras et al. 2018 Text-to-bird generation. Zhang et. al. 2016 Adversarial learning is more commonly associated with generating fake images…
  • 38. Learning Participant Relationships subjects? Similar subject should be similar in the feature The feature should be good at predict treatm Once we have these features, we can calculate dist any two subjects. Figure: The relationship learned by the propose • Instead, we want to learn relationships between participants • Should have similar features to a few similar participants • As data size increases, we want to find cliques of similar individuals • Large practically important gains on the Autism Center data Li et. al., NeurIPS 2018, Li et. Al., AISTATS 2019
  • 39. Does Multiple Domain Adaptation Help Us? • Combining our previous interpretable neural network approach (SyncNet) with our Multiple Domain Matching Network (MDMN) yields significant gains • Statistically significant improvement (p=.002, Wilcoxon Paired-Rank Test) • This types of biomarkers can be used to explore how the brain is changing post- treatment Accuracy Random Guessing 33.3 Dominant Class 41.1 Diff. Ent. + SVM 50.4 Power Spec. Density+SVM 49.9 MC-DCNN 58.4 SyncNet 60.1 SyncNet+DANN 58.7 SyncNet+MDMN 67.8
  • 40. Universal Device Mapping • A real issue in using neural derived biomarkers is that different research groups and different hospitals use distinct recording devices and electrode layouts • Can we learn a universal mapping to a pseudo-input space? 𝒑 𝒑∗
  • 41. Gaussian Process Adapter • A Gaussian process is a non-parametric method where every finite set of points is defined by a multivariate normal • We define a set of pseudo-inputs 𝑝∗ • Can infer these the EEG signal at the pseudo-input locations by using a conditional Gaussian distribution with 𝑐𝑜𝑣 𝑝/, 𝑝/Q = 𝑘R 𝑝/, 𝑝/Q • Really just a probabilistic interpolation • Can learn the pseudo-input locations • Can learn the covariance kernel parameters Li & Marlin, 2016 Li et al., 2017 𝒑 𝒑∗ SyncNet GP-SyncNet Joint DEAP 0.52±.03 0.56±.02 0.60±.02 SEED 0.77±.01 0.76±.01 0.78±.01 Proof-of-concept on emotion recognition.
  • 42. Moving to Large-Scale Trials • A recently completed Stage 2 trial (DukeACT) of the same treatment was just completed (N=180) • Two groups in this study: • Treatment at 0 months, placebo at 6 months • Placebo at 0 months, treatment at 6 months • Can ask multiple questions: • What is the treatment effect? • Can we do predictive medicine and predict treatment response? • Analysis on studies and trials from the NIH Autism Center of excellence in ASD+ADHD will begin in the near future
  • 43. Incorporating Behavior Information • Large computer vision effort to automatically derive behavioral features (led by Guillermo Sapiro’s group) • Autism and Beyond App • Modified all future data collection to simultaneously collect synchronized EEG + video • Can we combined EEG + automatically derived features to create stronger digital phenotypes • ASD vs. Typically Developing: • EEG alone: .75 AUC • Behavior alone: .68 AUC • EEG+Behavior: .88 AUC Visualization of our features extraction from our computer vision system currently in use in data collection. Guillermo Sapiro Isaev, under review. Dmitry Isaev
  • 44. Incorporating into Clinical Practice Inclusion in ASD practice is still a long way off, but many other uses exist for this type of technology in clinical practice.
  • 45. Many Other Uses in Clinical Settings • Neonatal hypoxic injury and seizures • Can these types of algorithms improve early detection and allow faster treatment? Dmitry Tchapyjnikov, MD Accuracy of diagnosing a seizure based on clinical signs in infants Number of infants who develop seizures when undergoing hypothermia therapy after traumatic birth
  • 46. EEG is Necessary to Diagnose Seizures in Neonates
  • 47. Doctors can only read EEGS once every several hours Delays to seizure diagnosis and treatment
  • 48. Want to adapt the developed methodology for seizure detection Currently underway with ~=.9 AUC inter-patient. Tchapyjnikov, in prep.
  • 49. Seizure Occurs Seizure Detected Nurse Alerted Seizure confirmed Begin treatment Implement via a bedside alarm if concern for seizure Automation will decrease time to treatment.
  • 50. Are we learning patterns of neural control? Can actually test in animal models.
  • 51. Interpretable networks create testable hypotheses a -DIO-ChETA -EYFP -50 0 50 edpotential(V) Data Acquisition System 30kHz Waveform Generator Real time LFP Phase Analysis 60ms TTL Signal Blue Yellow Phase Triggered Pulse Thal Stimulating Fiber Light Stimulus IL LFP Phase Trigger Laser TTL 200ms 3-7Hz b 40 50 60 edpotential(V) ** neural Closed Loop Actuator for Synchronizing Phase (nCLASP) system Thal Optogenetic Validation of Learned Features Hultman et al. Neuron 2016
  • 52. Real-Time Mapping and Control BLA 10 20 30 40 50 CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 BLA 10 20 30 40 50 CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 2 to 8Hz Non-Stressed Resilient HC FIT-Empty FIT-CD1 HC F 0 0.05 0.1 0.15 0.2 0.25 NetworkScore Pre-Chronic Stress Post-C 0 0.02 0.04 0.06 0.08 0.1 0.12 BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 Non-Stressed Resilient BLA 10 20 30 40 50 CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 HC FIT-Empty FIT-CD1 HC F NetworkScore Pre-Chronic Stress Post-C BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 BLA 10 20 30 40 50 CeA 10 20 30 40 50 IL_Cx 10 20 30 40 50 PrL_Cx 10 20 30 40 50 NAc 10 20 30 40 50 VSub 10 20 30 40 50 VTA 10 20 30 40 50 8-20Hz 0 0.01 0.02 0.03 0.04 Non-Stressed Resilient HC FIT-Empty FIT-CD1 HC F NetworkScore Pre-Chronic Stress Post-C 0.05 RegionsRegionsRegionsRegionsRegionsRegions BLA BLA CeA CeA IL_Cx IL_Cx NAc NAc PrL_Cx PrL_Cx VSub VSub VTA VTA 0 6 6 0 2-6Hz 0 0.24 0.48 0.72 0.96 Non-Stressed Resilient HC FIT-Empty FIT-CD1 HC FI NetworkScore Pre-Chronic Stress Post-C 1.20 Network2 RegionsRegions Network3Network4Network6 12 to 20Hz 10 15 20 25 30 35 40 45 50 0 0.3 0 5 0 0.3 10 15 20 25 30 35 40 45 500 5 0 0.3 10 15 20 25 30 35 40 45 500 5 0 0.3 10 15 20 25 30 35 40 45 500 5 VSub VSub VSub VSub Frequency SpectralDensity Frequency SpectralDensity Frequency SpectralDensity Frequency SpectralDensity !" !# !$ 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 Yw1 Yw Yw+1 Yw+2 BLA Ce IL NAc PrL VSub VTA zw sw1sw2...swL yw 1yw 2 ...yw N ✓ W Figure1:Left:Examplelocalfieldpotentialdatafromsevendistinctbrainregions,segmented 5secondtimewindows.Right:Graphicalmodelforthejointgenerative/discriminativedCSFA where,foranylocationxintheinputspace,theprocessisdefinedbythemeanfunc m(x)2RR ,whichisoftensettoequal0withoutlossofgenerality,andthecovariancef tion(K(x,x0 ;✓))r,r0=kr,r0 (x,x0 ;✓),cov(fr(x),fr0(x0 )),whichdefineshowinputlocati inregionrcovarieswithinputlocationx0 inregionr0 . AnyfinitesetofobservationsY=[y1,...,yN]atinputlocationsx=[x1,...,xN]T are resentedbyamultivariatenormaldistribution,andtheparameters✓maybeoptimizedtofitt observationsbymaximizingthemarginallikelihood ✓⇤ =argmax ✓ logp(Y|X,✓),p(Y|X,✓)=N ⇣ vec(YT );0,K+⌘1 INR ⌘ , wherevec(·)isacolumn-wisevectorizationofitsmatrix-valuedargumentandK2RNR⇥NR i Grammatrixdefinedbythecovariancekernelevaluatedatinputandoutputlocationsassociated vec(YT ).Theformofthecovariancekernelconstrainsthetypesofposteriorfunctionsthatma representedbytheGaussianprocess.Recently,expressivecovariancekernelshavebeenexpl [31,32,28]thatarecapableofrepresentinganystationarykernelwhiletreating✓asexpres featuresofinterestextractedfromthemodel. 2.2Thecross-spectralmixture(CSM)kernel Themulti-regionelectrophysiologicalrecordingsarequasi-periodicsignalswithquasi-statio cross-spectraldensities[28].Weassumethatwithinasingletask(i.e.,slidingwindowofdata) observationsmayberepresentedbyastationaryGaussianprocess.Withinthistask,thedatacon frequency-dependentpowerandphasesynchronybetweenbrainregions.Thiscross-couplin believedtofacilitatecommunicationofinformationbetweenconnectedbrainregions. Designedtocapturetheseexpressivefeatures,thecross-spectralmixture(CSM)kernel[28]isg %&" %&# %&$ -50 0 50 0Hz)Evokedpotential(V) Max se(count) Z = 256 P = 9x10-144 50 Data Acquisition System 30kHz Waveform Generator Real time LFP Phase Analysis 60ms TTL Signal Blue Yellow Phase Triggered Pulse Light Stimulus IL LFP Phase Trigger Laser TTL 200ms 3-7Hz b 20 30 40 50 60 0Hz)Evokedpotential(V) Thal ** neural Closed Loop Actuator for Synchronizing Phase (nCLASP) system Can map in real time by approximating with neural networks. Bidirectional Neural Interface Currently underway to evaluate treatment in an aggressive mouse model.
  • 53. Conclusions • Clinical trial data is an exciting route to develop and apply machine learning tools • Our focus on neural signals has strong evidence on a small cohort in an early-stage clinical trial to relate neural measurements to clinically relevant variables. • Large-scale trials and observational studies are currently underway.
  • 54. Acknowledgements & Funding • PhD Students: • Yitong Li • William Carson • Neil Gallagher • Austin Talbot • Laboratory for Psychiatric Neuroengineering • Kafui Dzirasa • Rainbo Hultman • Steven Mague • Duke Center for Autism and Brain Development • Geri Dawson • Michael Murias • Sam Major • National Institutes of Health • W.M. Keck Foundation • Stylli Foundation