SlideShare a Scribd company logo
1 of 33
MM-KBAC: Using mixed 
models to adjust for 
population structure in a 
rare-variant burden test 
Tuesday, June 10, 2014 
Greta Linse Peterson 
Director of Product Management and Quality
Questions during 
the presentation 
Use the Questions pane in 
your GoToWebinar window
Golden Helix Offerings 
Software 
๏‚ง SNP & Variation 
Suite (SVS) for 
NGS, SNP, & CNV 
data 
๏‚ง GenomeBrowse 
๏‚ง New products in 
development 
Support 
๏‚ง Support comes 
standard with 
software 
๏‚ง Customers rave 
about our support 
๏‚ง Extensive online 
materials including 
tutorials and more 
Services 
๏‚ง Genomic Analytics 
๏‚ง Genotype 
Imputation 
๏‚ง Workflow 
Automation 
๏‚ง SVS Certification & 
Training
Core 
Features 
Packages 
Core Features 
๏‚ง Powerful Data Management 
๏‚ง Rich Visualizations 
๏‚ง Robust Statistics 
๏‚ง Flexible 
๏‚ง Easy-to-use 
Applications 
๏‚ง Genotype Analysis 
๏‚ง DNA sequence analysis 
๏‚ง CNV Analysis 
๏‚ง RNA-seq differential 
expression 
๏‚ง Family Based Association 
SNP & Variation Suite (SVS)
Timeline 
Complex Disease 
GWAS 
Rare Variant 
Methods 
Mixed Model 
Methods 
MMKBAC 
Technology
Study Design 
๏‚ง Large cohort population based design (cases with matched controls 
or quantitative phenotypes and complex traits) 
- Assumes: independent and well matched samples 
- Can interrogate complex traits 
๏‚ง Small families (trios, quads, small extended pedigrees) 
- Can only analyze a single family at a time, looking for de Novo, recessive or 
compound het variants unique to an affected sample in a single family 
- Looking for highly penetrant variants
What If???? 
๏‚ง What if we have: 
- Known population structure 
- Cannot guarantee independence between samples 
- Controls were borrowed from a different study 
- Multiple families with affected offspring all exhibiting the same phenotype 
- Multiple large extended pedigrees of unknown structure
Just Add Random Effects! 
๏‚ง Why canโ€™t we just add random effects to our regression models for 
our rare-variant burden testing algorithms? 
๏‚ง Existing mixed model algorithms assume a linear model 
๏‚ง Kernel-based adaptive clustering (KBAC) uses a logistic regression 
model 
๏‚ง Hmm what to doโ€ฆ.?
WARNING! 
What is about to follow are formulas and statistics, specifically matrix 
algebraโ€ฆ 
But donโ€™t worry weโ€™ll end the webcast with a presentation of some 
preliminary results! So hang in there!
But firstโ€ฆ. 
The dataset we have chosen for today is the 1000 Genomes Pilot 3 
Exons dataset with a simulated phenotype.
Relatedness of samples
Why Mixed Models + KBAC? 
๏‚ง OK Mixed Models makes sense, but why KBAC? 
๏‚ง KBAC was chosen as our proof of concept rare-variant burden test 
for complex traits 
๏‚ง KBAC uses a score test which is trivial to calculate once you 
compute the reduced model 
๏‚ง Mixed models can be added to other burden and kernel tests using 
the same principles
What is KBAC? 
๏‚ง KBAC = Kernel-based Adaptive 
Clustering 
๏‚ง Catalogs and counts multi-marker 
genotypes based on variant data 
๏‚ง Assumes the data has been filtered to 
only rare variants 
๏‚ง Performs a special case/control test 
based on the counts of variants per 
region (aka gene) 
๏‚ง Test is weighted based on how often each 
genotype is expected to occur according 
to the null hypothesis 
๏‚ง Genotypes with higher sample risks are 
given higher weights 
๏‚ง One-sided test primarily, which means it 
detects higher sample risks
Pictorial Overview of Theory
Filter Common/Known SNPs
Filter by Gene Membership
Rare Sequence Variants
KBAC Statistic 
ํ‘˜ ํ‘ํ‘– 
๏‚ง ํพํตํดํถ1 = ํ‘–=1 
ํด 
ํ‘ํด โˆ’ 
ํ‘ํ‘ˆ 
ํ‘– 
ํพํ‘ํ‘ˆ ํ‘– 
0 ํ‘… ํ‘– 
๏‚ง Where the weight is defined as: 
0 ํ‘… ํ‘– = 
ํ‘คํ‘– = ํพํ‘– 
ํ‘… ํ‘– 
ํ‘˜ํ‘– 
0 
0 ํ‘Ÿ ํ‘‘ํ‘Ÿ 
The weight can be calculated as a: 
- Hyper-geometric kernel 
- Marginal binomial kernel 
- Asymptotic normal kernel
Determining the KBAC p-value 
๏‚ง Monte-Carlo Method is used as an approximation for finding the p-value 
ํดfor each genotype ํบํ‘– approximates a 
๏‚ง The number of cases ํ‘›ํ‘– 
ํด~ ํตํ‘–ํ‘›ํ‘œํ‘š ํ‘›ํ‘– , 
binomial distribution ํ‘›ํ‘– 
ํ‘›ํด 
ํ‘› 
๏‚ง The case status is permuted among all samples. The covariates and 
genotypes are held fixed.
Logistic Mixed Model Equation 
log 
ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘— , ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— 
1 โˆ’ ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘— , ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— 
= ํ›ฝ0 + ํ›ฝ1ํ‘‹ํ‘— + 
ํ‘™ 
ํ›ฝํ‘“ํ‘™ํ‘‹ํ‘“ํ‘—ํ‘™ + ํ‘ขํ‘— 
Null hypothesis: ํป0: ํ›ฝ1 = 0 
The score statistic to test the null of the independence of the model 
from ํ‘‹ํ‘— is: 
ํ‘ˆ = ํ‘— ํ‘‹ํ‘— ํ‘Œํ‘— โˆ’ ํœ‡ํ‘— , where 
ํœ‡ํ‘— = โ„Ž ํœ‚ํ‘— = 
ํ‘’ 
ํœ‚ํ‘— 
1+ํ‘’ 
ํœ‚ํ‘—, and 
ํœ‚ํ‘— = ํ›ฝ0 + ํ‘™ ํ›ฝํ‘“ํ‘™ํ‘‹ํ‘“ํ‘—ํ‘™ + ํ‘ขํ‘—, and 
ํ‘ขํ‘— is the random effect for the ํ‘—^(ํ‘กโ„Ž) sample.
Logistic (Reduced) Mixed Model Equation 
log 
ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— 
1 โˆ’ ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— 
= ํ›ฝ0 + 
ํ‘™ 
ํ›ฝํ‘“ํ‘™ํ‘‹ํ‘“ํ‘—ํ‘™ + ํ‘ขํ‘— 
Which can be rewritten as: 
ํธ ํ‘Œ ํ‘ข = โ„Ž ํ‘‹ํ‘“ํ›ฝ + ํ‘ข = โ„Ž ํœ‚ = ํœ‡ 
And 
ํ‘‰ํ‘Žํ‘Ÿ ํ‘Œ ํ‘ข = ํด = ํด1 
2ํด 1 
2 
Where ํด is the variance of the binomial distribution itself, where 
ํดํ‘—ํ‘— = ํœ‡ํ‘— 1 โˆ’ ํœ‡ํ‘— ํ‘“ํ‘œํ‘Ÿ ํ‘— = 1. . ํ‘› 
ํดํ‘–ํ‘— = 0 ํ‘“ํ‘œํ‘Ÿ ํ‘– โ‰  ํ‘— 
And the linear predictor for the model is ํœ‚ = ํ‘‹ํ›ฝ + ํ‘ข 
While โ„Ž โˆŽ is the inverse link function for the model
Solving the Logistic Mixed Model 
Iterate between creating a linear pseudo-model and solving for the 
pseudo-modelโ€™s coefficients 
โ„Ž ํœ‚ = โ„Ž ํœ‚ + ฮ” ํ‘‹ ํ›ฝ โˆ’ ํ›ฝ + ฮ” (ํ‘ข โˆ’ ํ‘ข ) 
Where 
ฮ” = 
ํœ•โ„Ž ํœ‚ 
ํœ•ํœ‚ ํ›ฝ, ํ‘ข 
Rearranging yields 
ฮ” โˆ’1 ํœ‡ โˆ’ โ„Ž ํœ‚ + ํ‘‹ํ›ฝ + ํ‘ข = ํ‘‹ํ›ฝ + ํ‘ข 
The left side is the expected value, conditional on ํ‘ข, of 
ํ‘ƒ โ‰ก ฮ” โˆ’1 ํ‘Œ โˆ’ โ„Ž ํœ‚ + ํ‘‹ํ›ฝ + ํ‘ข 
The variance of ํ‘ƒ given ํ‘ข is 
ํ‘‰ํ‘Žํ‘Ÿ ํ‘ƒ ํ‘ข = ฮ” โˆ’1ํด 1 
2ํด 1 
2 ฮ”โˆ’1 
Where 
ํด ํ‘—ํ‘— = ํœ‡ ํ‘— 1 โˆ’ ํœ‡ ํ‘— , ํด ํ‘–ํ‘— = 0 (ํ‘“ํ‘œํ‘Ÿ ํ‘– โ‰  ํ‘—)
Transform Pseudo-Model to use EMMA 
Pseudo-model: ํ‘ƒ = ํ‘‹ํ›ฝ + ํ‘ข + ํœ– and ํ‘‰ํ‘Žํ‘Ÿ ํœ– = ํ‘‰ํ‘Žํ‘Ÿ ํ‘ƒ ํ‘ข 
NOTE: As an alternative, rather than using the prediction of ํ‘ข from the pseudo-model, 
we can use the expected value of ํ‘ข, which is zero 
Want to solve using EMMA (Kang 2008) 
Find ํ‘‡ such that ํ‘‰ํ‘Žํ‘Ÿ ํ‘‡ํœ– = ํผ 
So that we can write 
ํ‘‡ํ‘ƒ = ํ‘‡ํ‘‹ํ›ฝ + ํ‘‡ํ‘ข + ํ‘‡ํœ– 
And use EMMA to solve the mixed model 
ํ‘‡ํ‘ƒ = ํ‘‡ํ‘‹ํ›ฝ + ํ‘‡ํ‘ข + ํœ–โˆ— 
Where the variance of ํœ–โˆ—is proportional to ํผ 
It can be shown that this is solved by letting 
ํ‘‡ = ํด โˆ’ 1 
2 ฮ”
Summary of the Algorithm 
First pick starting values of ํ›ฝ and ํ‘ข , such as all zeros. Repeat the following 
steps until the changes in ํ›ฝ and ํ‘ข are sufficiently small: 
1. Find ํœ‚ and ํœ‡ from the original linear predictor equation and the definition 
of โ„Ž โˆŽ 
2. Find the (diagonal) ฮ” matrix 
3. Find the pseudo-model ํ‘ƒ 
4. Find the (diagonal) matrix ํ‘‡ 
5. Solve the following for new values of ํ›ฝ and ํ‘ข using EMMA: 
ํ‘‡ํ‘ƒ = ํ‘‡ํ‘‹ํ›ฝ + ํ‘‡ํ‘ข 
NOTE: The alternative method modifies Step 5 to use EMMA to determine the variance 
components and to find a new value for ํ›ฝ , while leaving the value of ํ‘ข at its expected 
value of zero. 
After convergence, the alternative method predicts the values of ํ‘ข, and 
computes the final values of ํœ‚ and ํœ‡ from this prediction
Computing the Kinship Matrix
KBAC and MM-KBAC SVS Interface
Applying MMKBAC to a real study
KBAC vs MM-KBAC QQ Plots 
ํœ† = 0.757 ํœ† = 1.018 
KBAC w Pop. Covariates: ํœ† = 0.902
Signal at PSRC1
Signal at HIRA
Conclusion 
๏‚ง This will method will be added into SVS in the near futureโ€ฆ 
In the meantimeโ€ฆ 
๏‚ง Like to try it out on your dataset โ€“ ask us to be part of our early-access 
program! 
๏‚ง We have submitted an abstract to ASHG, hope to see you there!
Announcements 
๏‚ง Webcast recording and slides will be up on our website tomorrow. 
๏‚ง T-shirt Design Contest! Details at www.goldenhelix.com/events/t-shirtcontest. 
html 
๏‚ง Next scheduled webcast is July 22nd, but Heather Huson of Cornell 
University.
Questions? 
Use the Questions pane in 
your GoToWebinar window

More Related Content

Viewers also liked

Press
PressPress
Press
venussss
ย 
ะัƒะดะธั‚
ะัƒะดะธั‚ะัƒะดะธั‚
ะัƒะดะธั‚
yakovlevaolvo
ย 
Albun de fotos carlos chaparro
Albun de fotos carlos chaparroAlbun de fotos carlos chaparro
Albun de fotos carlos chaparro
Chino Chaparro
ย 
เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡
เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡ เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡
เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡
Pimpaka Khampin
ย 
B2e11e1b9030c180a860a8450d5eceff
B2e11e1b9030c180a860a8450d5eceffB2e11e1b9030c180a860a8450d5eceff
B2e11e1b9030c180a860a8450d5eceff
Pimpaka Khampin
ย 

Viewers also liked (20)

Press
PressPress
Press
ย 
The Molecular Sciences Made Personal
The Molecular Sciences Made PersonalThe Molecular Sciences Made Personal
The Molecular Sciences Made Personal
ย 
Disabilities in Israel - Facts and Figures 2013
Disabilities in Israel - Facts and Figures 2013Disabilities in Israel - Facts and Figures 2013
Disabilities in Israel - Facts and Figures 2013
ย 
ะัƒะดะธั‚
ะัƒะดะธั‚ะัƒะดะธั‚
ะัƒะดะธั‚
ย 
ฯ„ฮฑ ฮดฮนฮบฮฑฮนฯŽฮผฮฑฯ„ฮฑ ฯ„ฮฟฯ… ฯ€ฮฑฮนฮดฮนฮฟฯ
ฯ„ฮฑ ฮดฮนฮบฮฑฮนฯŽฮผฮฑฯ„ฮฑ ฯ„ฮฟฯ… ฯ€ฮฑฮนฮดฮนฮฟฯฯ„ฮฑ ฮดฮนฮบฮฑฮนฯŽฮผฮฑฯ„ฮฑ ฯ„ฮฟฯ… ฯ€ฮฑฮนฮดฮนฮฟฯ
ฯ„ฮฑ ฮดฮนฮบฮฑฮนฯŽฮผฮฑฯ„ฮฑ ฯ„ฮฟฯ… ฯ€ฮฑฮนฮดฮนฮฟฯ
ย 
Swdm15
Swdm15Swdm15
Swdm15
ย 
ฯƒฯ…ฮฝฮฟฮผฮนฮปฮฏฮฑ ฯ„ฮทฮปฮญฮผฮฑฯ‡ฮฟฯ… ฮฑฮธฮทฮฝฮฌฯ‚
ฯƒฯ…ฮฝฮฟฮผฮนฮปฮฏฮฑ ฯ„ฮทฮปฮญฮผฮฑฯ‡ฮฟฯ…  ฮฑฮธฮทฮฝฮฌฯ‚ฯƒฯ…ฮฝฮฟฮผฮนฮปฮฏฮฑ ฯ„ฮทฮปฮญฮผฮฑฯ‡ฮฟฯ…  ฮฑฮธฮทฮฝฮฌฯ‚
ฯƒฯ…ฮฝฮฟฮผฮนฮปฮฏฮฑ ฯ„ฮทฮปฮญฮผฮฑฯ‡ฮฟฯ… ฮฑฮธฮทฮฝฮฌฯ‚
ย 
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
ย 
Restaurant casual
Restaurant casualRestaurant casual
Restaurant casual
ย 
Albun de fotos carlos chaparro
Albun de fotos carlos chaparroAlbun de fotos carlos chaparro
Albun de fotos carlos chaparro
ย 
ฮ‘ฮฝฮดฯฮฟฮผฮฌฯ‡ฮท
ฮ‘ฮฝฮดฯฮฟฮผฮฌฯ‡ฮท  ฮ‘ฮฝฮดฯฮฟฮผฮฌฯ‡ฮท
ฮ‘ฮฝฮดฯฮฟฮผฮฌฯ‡ฮท
ย 
Personalized Medicine through Tumor Sequencing
Personalized Medicine through Tumor SequencingPersonalized Medicine through Tumor Sequencing
Personalized Medicine through Tumor Sequencing
ย 
ฮ‘ฯฯฮฑฮฒฯŽฮฝฮฑฯ‚- ฮ“ฮฌฮผฮฟฯ‚ ฯƒฯ„ฮฟ ฮฃฮบฮฟฯ€ฯŒ ฮ‘ฮฝฮฑฯ„ฮฟฮปฮนฮบฮฎฯ‚ ฮ˜ฯฮฌฮบฮทฯ‚
ฮ‘ฯฯฮฑฮฒฯŽฮฝฮฑฯ‚- ฮ“ฮฌฮผฮฟฯ‚ ฯƒฯ„ฮฟ ฮฃฮบฮฟฯ€ฯŒ ฮ‘ฮฝฮฑฯ„ฮฟฮปฮนฮบฮฎฯ‚ ฮ˜ฯฮฌฮบฮทฯ‚ฮ‘ฯฯฮฑฮฒฯŽฮฝฮฑฯ‚- ฮ“ฮฌฮผฮฟฯ‚ ฯƒฯ„ฮฟ ฮฃฮบฮฟฯ€ฯŒ ฮ‘ฮฝฮฑฯ„ฮฟฮปฮนฮบฮฎฯ‚ ฮ˜ฯฮฌฮบฮทฯ‚
ฮ‘ฯฯฮฑฮฒฯŽฮฝฮฑฯ‚- ฮ“ฮฌฮผฮฟฯ‚ ฯƒฯ„ฮฟ ฮฃฮบฮฟฯ€ฯŒ ฮ‘ฮฝฮฑฯ„ฮฟฮปฮนฮบฮฎฯ‚ ฮ˜ฯฮฌฮบฮทฯ‚
ย 
Radyr art class 2013 14
Radyr art class 2013 14Radyr art class 2013 14
Radyr art class 2013 14
ย 
Pentyrch bowling club annual tour 2014 Tour Programme
Pentyrch bowling club annual tour 2014 Tour ProgrammePentyrch bowling club annual tour 2014 Tour Programme
Pentyrch bowling club annual tour 2014 Tour Programme
ย 
Ict trends in onderwijs voor slideshare
Ict trends in onderwijs voor slideshareIct trends in onderwijs voor slideshare
Ict trends in onderwijs voor slideshare
ย 
เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡
เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡ เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡
เนƒเธšเธ‡เธฒเธ™เธชเธณเธฃเธงเธˆเธ•เธ™เน€เธญเธ‡
ย 
B2e11e1b9030c180a860a8450d5eceff
B2e11e1b9030c180a860a8450d5eceffB2e11e1b9030c180a860a8450d5eceff
B2e11e1b9030c180a860a8450d5eceff
ย 
Using Clinical Reports as a part of a Gene Panel Pipeline
Using Clinical Reports as a part of a Gene Panel PipelineUsing Clinical Reports as a part of a Gene Panel Pipeline
Using Clinical Reports as a part of a Gene Panel Pipeline
ย 
Biology
BiologyBiology
Biology
ย 

Similar to MM - KBAC: Using mixed models to adjust for population structure in a rare-variant burden test

Monte Carlo Berkeley.pptx
Monte Carlo Berkeley.pptxMonte Carlo Berkeley.pptx
Monte Carlo Berkeley.pptx
HaibinSu2
ย 

Similar to MM - KBAC: Using mixed models to adjust for population structure in a rare-variant burden test (20)

Monte Carlo Berkeley.pptx
Monte Carlo Berkeley.pptxMonte Carlo Berkeley.pptx
Monte Carlo Berkeley.pptx
ย 
Fa18_P1.pptx
Fa18_P1.pptxFa18_P1.pptx
Fa18_P1.pptx
ย 
Evaluation of a hybrid method for constructing multiple SVM kernels
Evaluation of a hybrid method for constructing multiple SVM kernelsEvaluation of a hybrid method for constructing multiple SVM kernels
Evaluation of a hybrid method for constructing multiple SVM kernels
ย 
03 Data Mining Techniques
03 Data Mining Techniques03 Data Mining Techniques
03 Data Mining Techniques
ย 
Artificial Neural Network
Artificial Neural NetworkArtificial Neural Network
Artificial Neural Network
ย 
Genetic algorithm
Genetic algorithmGenetic algorithm
Genetic algorithm
ย 
Enm fy17nano qsar
Enm fy17nano qsarEnm fy17nano qsar
Enm fy17nano qsar
ย 
Intro to Quant Trading Strategies (Lecture 2 of 10)
Intro to Quant Trading Strategies (Lecture 2 of 10)Intro to Quant Trading Strategies (Lecture 2 of 10)
Intro to Quant Trading Strategies (Lecture 2 of 10)
ย 
Mncs 16-10-1์ฃผ-๋ณ€์Šน๊ทœ-introduction to the machine learning #2
Mncs 16-10-1์ฃผ-๋ณ€์Šน๊ทœ-introduction to the machine learning #2Mncs 16-10-1์ฃผ-๋ณ€์Šน๊ทœ-introduction to the machine learning #2
Mncs 16-10-1์ฃผ-๋ณ€์Šน๊ทœ-introduction to the machine learning #2
ย 
AI Algorithms
AI AlgorithmsAI Algorithms
AI Algorithms
ย 
Machine Learning.pdf
Machine Learning.pdfMachine Learning.pdf
Machine Learning.pdf
ย 
Py data19 final
Py data19   finalPy data19   final
Py data19 final
ย 
Supervised and unsupervised learning
Supervised and unsupervised learningSupervised and unsupervised learning
Supervised and unsupervised learning
ย 
Supervised algorithms
Supervised algorithmsSupervised algorithms
Supervised algorithms
ย 
SVM - Functional Verification
SVM - Functional VerificationSVM - Functional Verification
SVM - Functional Verification
ย 
An Improved Iterative Method for Solving General System of Equations via Gene...
An Improved Iterative Method for Solving General System of Equations via Gene...An Improved Iterative Method for Solving General System of Equations via Gene...
An Improved Iterative Method for Solving General System of Equations via Gene...
ย 
An Improved Iterative Method for Solving General System of Equations via Gene...
An Improved Iterative Method for Solving General System of Equations via Gene...An Improved Iterative Method for Solving General System of Equations via Gene...
An Improved Iterative Method for Solving General System of Equations via Gene...
ย 
Ijetr042111
Ijetr042111Ijetr042111
Ijetr042111
ย 
Anomaly detection Full Article
Anomaly detection Full ArticleAnomaly detection Full Article
Anomaly detection Full Article
ย 
sequence alignment
sequence alignmentsequence alignment
sequence alignment
ย 

More from Golden Helix Inc

More from Golden Helix Inc (20)

Pharmacological Induction of FoxO3 is a Potential Treatment for Sickle Cell D...
Pharmacological Induction of FoxO3 is a Potential Treatment for Sickle Cell D...Pharmacological Induction of FoxO3 is a Potential Treatment for Sickle Cell D...
Pharmacological Induction of FoxO3 is a Potential Treatment for Sickle Cell D...
ย 
Uncovering novel candidate genes for pyridoxine-responsive epilepsy in a cons...
Uncovering novel candidate genes for pyridoxine-responsive epilepsy in a cons...Uncovering novel candidate genes for pyridoxine-responsive epilepsy in a cons...
Uncovering novel candidate genes for pyridoxine-responsive epilepsy in a cons...
ย 
Authoring Clinical Reports in VarSeq
Authoring Clinical Reports in VarSeqAuthoring Clinical Reports in VarSeq
Authoring Clinical Reports in VarSeq
ย 
Two Clinical Workflows - From Unfiltered Variants to a Clinical Report
Two Clinical Workflows - From Unfiltered Variants to a Clinical ReportTwo Clinical Workflows - From Unfiltered Variants to a Clinical Report
Two Clinical Workflows - From Unfiltered Variants to a Clinical Report
ย 
Prediction and Meta-Analysis
Prediction and Meta-AnalysisPrediction and Meta-Analysis
Prediction and Meta-Analysis
ย 
Using VarSeq to Improve Variant Analysis Research Workflows
Using VarSeq to Improve Variant Analysis Research WorkflowsUsing VarSeq to Improve Variant Analysis Research Workflows
Using VarSeq to Improve Variant Analysis Research Workflows
ย 
A Walk Through GWAS
A Walk Through GWASA Walk Through GWAS
A Walk Through GWAS
ย 
Introducing VSWarehouse - A Scalable Genetic Data Warehouse for VarSeq
Introducing VSWarehouse - A Scalable Genetic Data Warehouse for VarSeqIntroducing VSWarehouse - A Scalable Genetic Data Warehouse for VarSeq
Introducing VSWarehouse - A Scalable Genetic Data Warehouse for VarSeq
ย 
Cancer Workflows in VarSeq
Cancer Workflows in VarSeqCancer Workflows in VarSeq
Cancer Workflows in VarSeq
ย 
Getting Started with VSWarehouse - The User Experience
Getting Started with VSWarehouse - The User ExperienceGetting Started with VSWarehouse - The User Experience
Getting Started with VSWarehouse - The User Experience
ย 
Pharmacogenomic Prediction of Antracycline-induced Cardiotoxicity
Pharmacogenomic Prediction of Antracycline-induced CardiotoxicityPharmacogenomic Prediction of Antracycline-induced Cardiotoxicity
Pharmacogenomic Prediction of Antracycline-induced Cardiotoxicity
ย 
Custom Family Workflows
Custom Family WorkflowsCustom Family Workflows
Custom Family Workflows
ย 
Using WES in Distant Relationships to Identify Cardiomyopathy Genes
Using WES in Distant Relationships to Identify Cardiomyopathy GenesUsing WES in Distant Relationships to Identify Cardiomyopathy Genes
Using WES in Distant Relationships to Identify Cardiomyopathy Genes
ย 
Investigating Shared Additive Genetic Variation for Alcohol Dependence
Investigating Shared Additive Genetic Variation for Alcohol DependenceInvestigating Shared Additive Genetic Variation for Alcohol Dependence
Investigating Shared Additive Genetic Variation for Alcohol Dependence
ย 
Big Data at Golden Helix: Scaling to Meet the Demand of Clinical and Research...
Big Data at Golden Helix: Scaling to Meet the Demand of Clinical and Research...Big Data at Golden Helix: Scaling to Meet the Demand of Clinical and Research...
Big Data at Golden Helix: Scaling to Meet the Demand of Clinical and Research...
ย 
CNV Analysis in VarSeq
CNV Analysis in VarSeqCNV Analysis in VarSeq
CNV Analysis in VarSeq
ย 
Beagle Imputation in SVS
Beagle Imputation in SVSBeagle Imputation in SVS
Beagle Imputation in SVS
ย 
Clinical Reporting Made Easy
Clinical Reporting Made EasyClinical Reporting Made Easy
Clinical Reporting Made Easy
ย 
Population Structure & Genetic Improvement in Livestock
Population Structure & Genetic Improvement in LivestockPopulation Structure & Genetic Improvement in Livestock
Population Structure & Genetic Improvement in Livestock
ย 
GWAS in a model organism: Arabidopsis thaliana
GWAS in a model organism: Arabidopsis thalianaGWAS in a model organism: Arabidopsis thaliana
GWAS in a model organism: Arabidopsis thaliana
ย 

Recently uploaded

Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service ๐Ÿชก
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service  ๐ŸชกCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service  ๐Ÿชก
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service ๐Ÿชก
anilsa9823
ย 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Sรฉrgio Sacani
ย 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Lokesh Kothari
ย 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sรฉrgio Sacani
ย 

Recently uploaded (20)

Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
ย 
Hire ๐Ÿ’• 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire ๐Ÿ’• 9907093804 Hooghly Call Girls Service Call Girls AgencyHire ๐Ÿ’• 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire ๐Ÿ’• 9907093804 Hooghly Call Girls Service Call Girls Agency
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service ๐Ÿชก
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service  ๐ŸชกCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service  ๐Ÿชก
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kesar Bagh Lucknow best Night Fun service ๐Ÿชก
ย 
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxPhysiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
ย 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
ย 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
ย 
fundamental of entomology all in one topics of entomology
fundamental of entomology all in one topics of entomologyfundamental of entomology all in one topics of entomology
fundamental of entomology all in one topics of entomology
ย 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
ย 
โคJammu Kashmir Call Girls 8617697112 Personal Whatsapp Number ๐Ÿ’ฆโœ….
โคJammu Kashmir Call Girls 8617697112 Personal Whatsapp Number ๐Ÿ’ฆโœ….โคJammu Kashmir Call Girls 8617697112 Personal Whatsapp Number ๐Ÿ’ฆโœ….
โคJammu Kashmir Call Girls 8617697112 Personal Whatsapp Number ๐Ÿ’ฆโœ….
ย 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: โ€œEg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: โ€œEg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: โ€œEg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: โ€œEg...
ย 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
ย 
Stunning โžฅ8448380779โ–ป Call Girls In Panchshil Enclave Delhi NCR
Stunning โžฅ8448380779โ–ป Call Girls In Panchshil Enclave Delhi NCRStunning โžฅ8448380779โ–ป Call Girls In Panchshil Enclave Delhi NCR
Stunning โžฅ8448380779โ–ป Call Girls In Panchshil Enclave Delhi NCR
ย 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
ย 
Nanoparticles synthesis and characterizationโ€‹ โ€‹
Nanoparticles synthesis and characterizationโ€‹  โ€‹Nanoparticles synthesis and characterizationโ€‹  โ€‹
Nanoparticles synthesis and characterizationโ€‹ โ€‹
ย 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
ย 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
ย 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
ย 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
ย 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
ย 
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral AnalysisRaman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
ย 

MM - KBAC: Using mixed models to adjust for population structure in a rare-variant burden test

  • 1. MM-KBAC: Using mixed models to adjust for population structure in a rare-variant burden test Tuesday, June 10, 2014 Greta Linse Peterson Director of Product Management and Quality
  • 2. Questions during the presentation Use the Questions pane in your GoToWebinar window
  • 3. Golden Helix Offerings Software ๏‚ง SNP & Variation Suite (SVS) for NGS, SNP, & CNV data ๏‚ง GenomeBrowse ๏‚ง New products in development Support ๏‚ง Support comes standard with software ๏‚ง Customers rave about our support ๏‚ง Extensive online materials including tutorials and more Services ๏‚ง Genomic Analytics ๏‚ง Genotype Imputation ๏‚ง Workflow Automation ๏‚ง SVS Certification & Training
  • 4. Core Features Packages Core Features ๏‚ง Powerful Data Management ๏‚ง Rich Visualizations ๏‚ง Robust Statistics ๏‚ง Flexible ๏‚ง Easy-to-use Applications ๏‚ง Genotype Analysis ๏‚ง DNA sequence analysis ๏‚ง CNV Analysis ๏‚ง RNA-seq differential expression ๏‚ง Family Based Association SNP & Variation Suite (SVS)
  • 5. Timeline Complex Disease GWAS Rare Variant Methods Mixed Model Methods MMKBAC Technology
  • 6. Study Design ๏‚ง Large cohort population based design (cases with matched controls or quantitative phenotypes and complex traits) - Assumes: independent and well matched samples - Can interrogate complex traits ๏‚ง Small families (trios, quads, small extended pedigrees) - Can only analyze a single family at a time, looking for de Novo, recessive or compound het variants unique to an affected sample in a single family - Looking for highly penetrant variants
  • 7. What If???? ๏‚ง What if we have: - Known population structure - Cannot guarantee independence between samples - Controls were borrowed from a different study - Multiple families with affected offspring all exhibiting the same phenotype - Multiple large extended pedigrees of unknown structure
  • 8. Just Add Random Effects! ๏‚ง Why canโ€™t we just add random effects to our regression models for our rare-variant burden testing algorithms? ๏‚ง Existing mixed model algorithms assume a linear model ๏‚ง Kernel-based adaptive clustering (KBAC) uses a logistic regression model ๏‚ง Hmm what to doโ€ฆ.?
  • 9. WARNING! What is about to follow are formulas and statistics, specifically matrix algebraโ€ฆ But donโ€™t worry weโ€™ll end the webcast with a presentation of some preliminary results! So hang in there!
  • 10. But firstโ€ฆ. The dataset we have chosen for today is the 1000 Genomes Pilot 3 Exons dataset with a simulated phenotype.
  • 12. Why Mixed Models + KBAC? ๏‚ง OK Mixed Models makes sense, but why KBAC? ๏‚ง KBAC was chosen as our proof of concept rare-variant burden test for complex traits ๏‚ง KBAC uses a score test which is trivial to calculate once you compute the reduced model ๏‚ง Mixed models can be added to other burden and kernel tests using the same principles
  • 13. What is KBAC? ๏‚ง KBAC = Kernel-based Adaptive Clustering ๏‚ง Catalogs and counts multi-marker genotypes based on variant data ๏‚ง Assumes the data has been filtered to only rare variants ๏‚ง Performs a special case/control test based on the counts of variants per region (aka gene) ๏‚ง Test is weighted based on how often each genotype is expected to occur according to the null hypothesis ๏‚ง Genotypes with higher sample risks are given higher weights ๏‚ง One-sided test primarily, which means it detects higher sample risks
  • 16. Filter by Gene Membership
  • 18. KBAC Statistic ํ‘˜ ํ‘ํ‘– ๏‚ง ํพํตํดํถ1 = ํ‘–=1 ํด ํ‘ํด โˆ’ ํ‘ํ‘ˆ ํ‘– ํพํ‘ํ‘ˆ ํ‘– 0 ํ‘… ํ‘– ๏‚ง Where the weight is defined as: 0 ํ‘… ํ‘– = ํ‘คํ‘– = ํพํ‘– ํ‘… ํ‘– ํ‘˜ํ‘– 0 0 ํ‘Ÿ ํ‘‘ํ‘Ÿ The weight can be calculated as a: - Hyper-geometric kernel - Marginal binomial kernel - Asymptotic normal kernel
  • 19. Determining the KBAC p-value ๏‚ง Monte-Carlo Method is used as an approximation for finding the p-value ํดfor each genotype ํบํ‘– approximates a ๏‚ง The number of cases ํ‘›ํ‘– ํด~ ํตํ‘–ํ‘›ํ‘œํ‘š ํ‘›ํ‘– , binomial distribution ํ‘›ํ‘– ํ‘›ํด ํ‘› ๏‚ง The case status is permuted among all samples. The covariates and genotypes are held fixed.
  • 20. Logistic Mixed Model Equation log ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘— , ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— 1 โˆ’ ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘— , ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— = ํ›ฝ0 + ํ›ฝ1ํ‘‹ํ‘— + ํ‘™ ํ›ฝํ‘“ํ‘™ํ‘‹ํ‘“ํ‘—ํ‘™ + ํ‘ขํ‘— Null hypothesis: ํป0: ํ›ฝ1 = 0 The score statistic to test the null of the independence of the model from ํ‘‹ํ‘— is: ํ‘ˆ = ํ‘— ํ‘‹ํ‘— ํ‘Œํ‘— โˆ’ ํœ‡ํ‘— , where ํœ‡ํ‘— = โ„Ž ํœ‚ํ‘— = ํ‘’ ํœ‚ํ‘— 1+ํ‘’ ํœ‚ํ‘—, and ํœ‚ํ‘— = ํ›ฝ0 + ํ‘™ ํ›ฝํ‘“ํ‘™ํ‘‹ํ‘“ํ‘—ํ‘™ + ํ‘ขํ‘—, and ํ‘ขํ‘— is the random effect for the ํ‘—^(ํ‘กโ„Ž) sample.
  • 21. Logistic (Reduced) Mixed Model Equation log ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— 1 โˆ’ ํ‘ƒ ํ‘Œํ‘— = 1 | ํ‘‹ํ‘“ํ‘—ํ‘™ , ํ‘ขํ‘— = ํ›ฝ0 + ํ‘™ ํ›ฝํ‘“ํ‘™ํ‘‹ํ‘“ํ‘—ํ‘™ + ํ‘ขํ‘— Which can be rewritten as: ํธ ํ‘Œ ํ‘ข = โ„Ž ํ‘‹ํ‘“ํ›ฝ + ํ‘ข = โ„Ž ํœ‚ = ํœ‡ And ํ‘‰ํ‘Žํ‘Ÿ ํ‘Œ ํ‘ข = ํด = ํด1 2ํด 1 2 Where ํด is the variance of the binomial distribution itself, where ํดํ‘—ํ‘— = ํœ‡ํ‘— 1 โˆ’ ํœ‡ํ‘— ํ‘“ํ‘œํ‘Ÿ ํ‘— = 1. . ํ‘› ํดํ‘–ํ‘— = 0 ํ‘“ํ‘œํ‘Ÿ ํ‘– โ‰  ํ‘— And the linear predictor for the model is ํœ‚ = ํ‘‹ํ›ฝ + ํ‘ข While โ„Ž โˆŽ is the inverse link function for the model
  • 22. Solving the Logistic Mixed Model Iterate between creating a linear pseudo-model and solving for the pseudo-modelโ€™s coefficients โ„Ž ํœ‚ = โ„Ž ํœ‚ + ฮ” ํ‘‹ ํ›ฝ โˆ’ ํ›ฝ + ฮ” (ํ‘ข โˆ’ ํ‘ข ) Where ฮ” = ํœ•โ„Ž ํœ‚ ํœ•ํœ‚ ํ›ฝ, ํ‘ข Rearranging yields ฮ” โˆ’1 ํœ‡ โˆ’ โ„Ž ํœ‚ + ํ‘‹ํ›ฝ + ํ‘ข = ํ‘‹ํ›ฝ + ํ‘ข The left side is the expected value, conditional on ํ‘ข, of ํ‘ƒ โ‰ก ฮ” โˆ’1 ํ‘Œ โˆ’ โ„Ž ํœ‚ + ํ‘‹ํ›ฝ + ํ‘ข The variance of ํ‘ƒ given ํ‘ข is ํ‘‰ํ‘Žํ‘Ÿ ํ‘ƒ ํ‘ข = ฮ” โˆ’1ํด 1 2ํด 1 2 ฮ”โˆ’1 Where ํด ํ‘—ํ‘— = ํœ‡ ํ‘— 1 โˆ’ ํœ‡ ํ‘— , ํด ํ‘–ํ‘— = 0 (ํ‘“ํ‘œํ‘Ÿ ํ‘– โ‰  ํ‘—)
  • 23. Transform Pseudo-Model to use EMMA Pseudo-model: ํ‘ƒ = ํ‘‹ํ›ฝ + ํ‘ข + ํœ– and ํ‘‰ํ‘Žํ‘Ÿ ํœ– = ํ‘‰ํ‘Žํ‘Ÿ ํ‘ƒ ํ‘ข NOTE: As an alternative, rather than using the prediction of ํ‘ข from the pseudo-model, we can use the expected value of ํ‘ข, which is zero Want to solve using EMMA (Kang 2008) Find ํ‘‡ such that ํ‘‰ํ‘Žํ‘Ÿ ํ‘‡ํœ– = ํผ So that we can write ํ‘‡ํ‘ƒ = ํ‘‡ํ‘‹ํ›ฝ + ํ‘‡ํ‘ข + ํ‘‡ํœ– And use EMMA to solve the mixed model ํ‘‡ํ‘ƒ = ํ‘‡ํ‘‹ํ›ฝ + ํ‘‡ํ‘ข + ํœ–โˆ— Where the variance of ํœ–โˆ—is proportional to ํผ It can be shown that this is solved by letting ํ‘‡ = ํด โˆ’ 1 2 ฮ”
  • 24. Summary of the Algorithm First pick starting values of ํ›ฝ and ํ‘ข , such as all zeros. Repeat the following steps until the changes in ํ›ฝ and ํ‘ข are sufficiently small: 1. Find ํœ‚ and ํœ‡ from the original linear predictor equation and the definition of โ„Ž โˆŽ 2. Find the (diagonal) ฮ” matrix 3. Find the pseudo-model ํ‘ƒ 4. Find the (diagonal) matrix ํ‘‡ 5. Solve the following for new values of ํ›ฝ and ํ‘ข using EMMA: ํ‘‡ํ‘ƒ = ํ‘‡ํ‘‹ํ›ฝ + ํ‘‡ํ‘ข NOTE: The alternative method modifies Step 5 to use EMMA to determine the variance components and to find a new value for ํ›ฝ , while leaving the value of ํ‘ข at its expected value of zero. After convergence, the alternative method predicts the values of ํ‘ข, and computes the final values of ํœ‚ and ํœ‡ from this prediction
  • 26. KBAC and MM-KBAC SVS Interface
  • 27. Applying MMKBAC to a real study
  • 28. KBAC vs MM-KBAC QQ Plots ํœ† = 0.757 ํœ† = 1.018 KBAC w Pop. Covariates: ํœ† = 0.902
  • 31. Conclusion ๏‚ง This will method will be added into SVS in the near futureโ€ฆ In the meantimeโ€ฆ ๏‚ง Like to try it out on your dataset โ€“ ask us to be part of our early-access program! ๏‚ง We have submitted an abstract to ASHG, hope to see you there!
  • 32. Announcements ๏‚ง Webcast recording and slides will be up on our website tomorrow. ๏‚ง T-shirt Design Contest! Details at www.goldenhelix.com/events/t-shirtcontest. html ๏‚ง Next scheduled webcast is July 22nd, but Heather Huson of Cornell University.
  • 33. Questions? Use the Questions pane in your GoToWebinar window