SlideShare a Scribd company logo
DISCRIMINANT
ANALYSIS
Wei-Jiun, Shen Ph. D.
Purpose
 To predict group membership from a set of
predictors
 Level of DV > 2
 What analytic strategy will you use?
Kinds of research questions
 Goals of discriminant analysis are to find the
dimension or dimensions along which groups differ,
and to find classification function to predict group
membership.
 Significance of prediction
 Number of significant discriminant functions
 Dimensions of discrimination
 Classification functions
 Adequacy of classification
 Effect size
 Importance of predictor variables
 Significance of prediction with covariates
 Estimation of group means
Limitations to discriminant analysis
 Theoretical issues
 Random assignment
 Generalizability
 Practical issues
 Unequal sample size, missing data, and power
 Multivariate normality
 Absence of outliers
 Homogeneity of variance-covariance matrices
 Linearity
 Absence of multicollinearity and singularity
Fundamental equation for discriminant analysis
 Derivation and test of discriminant functions
𝑆𝑡𝑜𝑡𝑎𝑙 = 𝑆 𝑏𝑔 + 𝑆 𝑤𝑔
Λ =
𝑆 𝑤𝑔
𝑆 𝑏𝑔 + 𝑆 𝑤𝑔
Approximate F = 𝑑𝑓1, 𝑑𝑓2 =
1−𝑦
𝑦
𝑑𝑓2
𝑑𝑓1
Λ
1
2 = 𝑦;
Fundamental equation for discriminant analysis
 Classification
 Equal group size
 Unequal group size
𝐶𝑗 = 𝑐𝑗0 +𝑐𝑗1 𝑋1 + 𝑐𝑗2 𝑋2 + ⋯ + 𝑐𝑖𝑝 𝑋 𝑝
𝐂𝑗 = 𝐖−1
𝐌𝑗 𝑐𝑗0 = −
1
2
𝐂𝑗
′
𝐌𝑗
𝐂𝑗 = 𝑐𝑗0 +
𝑖=1
𝑝
𝑐𝑗𝑖 𝑋𝑖 + 𝑙𝑛
𝑛𝑗
𝑁
Fundamental equation for discriminant analysis
 Projection
𝐶𝑗 = 𝑐𝑗0 +𝑐𝑗1 𝑋1 + 𝑐𝑗2 𝑋2 + ⋯ + 𝑐𝑖𝑝 𝑋 𝑝
Xp
Cj
θ
Fundamental equation for discriminant analysis
 Solution
B − ΛW K = 0
𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 = Λ =
𝑟𝑐1
2
⋯ ⋯
⋮ ⋱ ⋮
⋮ ⋯ 𝑟𝑐𝑖
2
𝑒𝑖𝑔𝑒𝑛𝑣𝑒𝑐𝑡𝑜𝑟 = K = 𝑘1 ⋯ 𝑘 𝑞
Do you smell
something?
Discriminant analysis
 Prediction
1
1
N
P
N*P
X
1
2
3
2
1
3
2
1
N*1
Y
Discriminant function
 Special case of canonical analysis
1
1
N
P
N*P
X
1
2
3
1
2
3
1
2
N*1
Y
Discriminant function
 Special case of canonical analysis
1
1
N
P
N*P
X
1
N
N*(L-1)
…D1 D2 D3 DL-1
1 0 0 … 0
0 1 0 … 0
0 0 1 … 0
0 0 0 … 1
Discriminant function
 Special case of canonical analysis
χ1
χ2
X1
X2
X3
X4
X5
η1
η2
D1
D2
𝑟𝑐2
𝑟𝑐3
0
0
Example: 1 predictor
 DV
Y=0
Y=1
0 1 2 3 4 5 6 7 8 9 10
X
1 27
4
9
31013 5 6 12
11
3
14
15
Example: 2 predictors
 DV
Y=0
Y=1
Y=2
0 1 2 3 4 5 6 7
X1
12
4
3
5
6
7
8
9
10
12
11
13
14
15
0 1 2 3 4 5 6 7
X2
14
2
5
3
6
78
9
10
12
11
13
14
15
Example: 2 predictors
 DV
Y=0
Y=1
Y=2
0 1 2 3 4 5 6 7
1
2 4 3
5
6
7
8
9
10
1211 13 14
15
Discriminant function 2
= 0*X1+1*X2
Discriminant function 1
= 1*X1+0*X2
1
2
3
4
5
6
7
Number
Min (N of IV, df for DV)
Principle of discriminant function
 Various linear combination (projection)
Principle of discriminant analysis
 Maximize difference among levels
 Minimize variance within level
X1
X2
C1
Types of discriminant analysis
 Direct(standard) discriminant analysis
 Test for the significance
 Sequential discriminant analysis
 Mathematical resolution of combining variables
 Stepwise(statistical) discriminant analysis
 Mathematical resolution of combining variables
Criteria for overall statistical significance
 General
 Wilk’s lamda
 Hotelling’s trace
 Roy’s gcr
 Pillai’s criterion
 Distance-based (usually for stepwise)
 Mahalanobis’D2
 Rao’s V
Interpreting discriminant functions
 Discriminant function plots (F1 & F2; F2 & F3;…)
0 1 2 3 4 5 6 7
G1
Discriminant function 2
= 0*X1+1*X2
Discriminant function 1
= 1*X1+0*X2
1
2
3
4
5
6
7
G2
G3
Interpreting discriminant functions
 Discriminant weight (coefficient)
 Beta in regression analysis
 Discriminant loading
 Simple linear correlation between IV and discriminant
function
 >.33 (Tabachnick & Fidell, 2009)
 >.40 (Hair et al., 2010)
Evaluating predictor variables
 Classification function coefficient / loading
 Magnitude
 Mean difference
 Compare MGi and Mpooled(Gn-i)
 Inflation of type 1 error
 Adjusted alpha
 Potency index
Potency index
χn
X1
X2
X3
X4
X5
ηn
D1
D2
D3
D4
𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 𝑐𝑛λ 𝑥𝑛1
λ 𝑥𝑛2
λ 𝑥𝑛3
λ 𝑥𝑛4
λ 𝑥𝑛5
λ 𝑦𝑛1
λ 𝑦𝑛2
λ 𝑦𝑛3
λ 𝑦𝑛4
Square
d
𝑃𝑜𝑡𝑒𝑛𝑐𝑦 𝑖𝑛𝑑𝑒𝑥 𝑥𝑛𝑖→y = λ 𝑥𝑛𝑖
2
×
𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 𝑐𝑛
𝑡𝑜𝑡𝑎𝑙 𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒
2
Effect size
 Total
 Partial η2
 Specific
 Eigenvalue (each discriminant function)
 Squared structure matric loading (each predictor)
𝑝𝑎𝑟𝑡𝑖𝑎𝑙 η2
= 1 − Λ
1
3
Use of classification procedure
 Generalization (hit ratio)
 Cross-validation and new case
 Jackknified classification
 Leave one out classification
 Evaluating improvement in classification
 Sequential
Early step
classification
Correct Incorrect
Later step
classification
Correct A B
Incorrect C D
χ2 1 =
𝐵 − 𝐶 − 1
𝐵 + 𝐶
Standards of hit ratio
 Proportion chance criterion
 Press’s Q
𝑃𝑟𝑒𝑠𝑠′ 𝑠 𝑄 =
𝑁 − 𝑛𝐾 2
𝑁(𝐾 − 1)
𝐶 𝑝𝑟𝑜 = 𝑝2 + (1 − 𝑝)2
ℎ𝑖𝑡 𝑟𝑎𝑡𝑖𝑜 > 1.25 × 𝐶 𝑝𝑟𝑜 𝑝2
χ2 > 3.84 (𝛼 = .05)
χ2 > 6.63 (𝛼 = .01)
Procedure
1. Research question
2. Designing a canonical analysis
3. Check the assumptions
4. Derive canonical analysis and assess overall fit
5. Interpret the canonical variate
6. Validation and diagnosis
PRACTICE
過去學業表現與現在學業表現
 研究生倪之道想瞭解運動團隊默契對團隊表現的
影響。他的研究問題是,個體認為團隊有正確的
任務知識、能力評價與情緒覺察等三個運動團隊
默契的向度是否能預測比賽名次?其中,比賽名
次為類別變項。請以區別分析解答此問題。

More Related Content

What's hot

Multiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IMultiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA I
James Neill
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
Murali Raj
 
Multivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan Yavar
Multivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan YavarMultivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan Yavar
Multivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan YavarBijan Yavar
 
Linear regression analysis
Linear regression analysisLinear regression analysis
Linear regression analysis
Nimrita Koul
 
Cannonical correlation
Cannonical correlationCannonical correlation
Cannonical correlationdomsr
 
Regression analysis
Regression analysisRegression analysis
Regression analysissaba khan
 
Machine Learning lecture2(linear regression)
Machine Learning lecture2(linear regression)Machine Learning lecture2(linear regression)
Machine Learning lecture2(linear regression)
cairo university
 
Factor analysis ppt
Factor analysis pptFactor analysis ppt
Factor analysis ppt
Mukesh Bisht
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression Analysis
Shiela Vinarao
 
Effect size presentation
Effect size presentationEffect size presentation
Effect size presentationCarlo Magno
 
ANOVA in R by Aman Chauhan
ANOVA in R by Aman ChauhanANOVA in R by Aman Chauhan
ANOVA in R by Aman Chauhan
Aman Chauhan
 
Lect5 principal component analysis
Lect5 principal component analysisLect5 principal component analysis
Lect5 principal component analysis
hktripathy
 
Regression analysis
Regression analysisRegression analysis
Regression analysis
Shameer P Hamsa
 
Simple linear regression
Simple linear regressionSimple linear regression
Simple linear regression
Avjinder (Avi) Kaler
 
multiple regression
multiple regressionmultiple regression
multiple regression
Priya Sharma
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
Wansuklangk
 
Logistical Regression.pptx
Logistical Regression.pptxLogistical Regression.pptx
Logistical Regression.pptx
Ramakrishna Reddy Bijjam
 
Manova ppt
Manova pptManova ppt
Manova ppt
AnupVs2
 

What's hot (20)

Multiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IMultiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA I
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
 
Multivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan Yavar
Multivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan YavarMultivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan Yavar
Multivariate Analaysis of Variance (MANOVA): Sharma, Chapter 11 - Bijan Yavar
 
Linear regression analysis
Linear regression analysisLinear regression analysis
Linear regression analysis
 
Cannonical correlation
Cannonical correlationCannonical correlation
Cannonical correlation
 
Regression analysis
Regression analysisRegression analysis
Regression analysis
 
Machine Learning lecture2(linear regression)
Machine Learning lecture2(linear regression)Machine Learning lecture2(linear regression)
Machine Learning lecture2(linear regression)
 
Factor analysis ppt
Factor analysis pptFactor analysis ppt
Factor analysis ppt
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression Analysis
 
Regression analysis
Regression analysisRegression analysis
Regression analysis
 
Effect size presentation
Effect size presentationEffect size presentation
Effect size presentation
 
Canonical correlation
Canonical correlationCanonical correlation
Canonical correlation
 
ANOVA in R by Aman Chauhan
ANOVA in R by Aman ChauhanANOVA in R by Aman Chauhan
ANOVA in R by Aman Chauhan
 
Lect5 principal component analysis
Lect5 principal component analysisLect5 principal component analysis
Lect5 principal component analysis
 
Regression analysis
Regression analysisRegression analysis
Regression analysis
 
Simple linear regression
Simple linear regressionSimple linear regression
Simple linear regression
 
multiple regression
multiple regressionmultiple regression
multiple regression
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
 
Logistical Regression.pptx
Logistical Regression.pptxLogistical Regression.pptx
Logistical Regression.pptx
 
Manova ppt
Manova pptManova ppt
Manova ppt
 

Viewers also liked

Discriminant analysis group no. 4
Discriminant analysis  group no. 4Discriminant analysis  group no. 4
Discriminant analysis group no. 4Advait Bhobe
 
discriminant analysis
discriminant analysisdiscriminant analysis
discriminant analysis
krishnadk
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
Sandeep Soni Kanpur
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
Amritashish Bagchi
 
T18 discriminant analysis
T18 discriminant analysisT18 discriminant analysis
T18 discriminant analysiskompellark
 
Discriminant Analysis-lecture 8
Discriminant Analysis-lecture 8Discriminant Analysis-lecture 8
Discriminant Analysis-lecture 8Laila Fatehy
 
Mba-project-reports-systems-technology-management-titles
Mba-project-reports-systems-technology-management-titlesMba-project-reports-systems-technology-management-titles
Mba-project-reports-systems-technology-management-titles
mba project reports
 
Market Research Project Report
Market Research Project ReportMarket Research Project Report
Market Research Project ReportAnkit Sinha
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
ANOVA in Marketing Research
ANOVA  in Marketing ResearchANOVA  in Marketing Research
ANOVA in Marketing Research
vivek_goyal87
 
Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...
Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...
Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...
Arun Kasani
 
Consumer behaviour
Consumer behaviourConsumer behaviour
Consumer behaviour
Abhijith R
 
Factor analysis
Factor analysisFactor analysis
Factor analysissaba khan
 
FiscalAndSocialEffectsOfStateAlcoholControlSystems
FiscalAndSocialEffectsOfStateAlcoholControlSystemsFiscalAndSocialEffectsOfStateAlcoholControlSystems
FiscalAndSocialEffectsOfStateAlcoholControlSystemsSean Yu
 
A szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségei
A szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségeiA szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségei
A szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségei
magyariskola
 
life processes #aanchal
life processes #aanchallife processes #aanchal
life processes #aanchal
aanchal tomar
 
Pan pel bem 2015
Pan pel bem 2015Pan pel bem 2015
Pan pel bem 2015
Unipdu
 

Viewers also liked (20)

Discriminant analysis group no. 4
Discriminant analysis  group no. 4Discriminant analysis  group no. 4
Discriminant analysis group no. 4
 
discriminant analysis
discriminant analysisdiscriminant analysis
discriminant analysis
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
 
T18 discriminant analysis
T18 discriminant analysisT18 discriminant analysis
T18 discriminant analysis
 
Discriment analysis
Discriment analysisDiscriment analysis
Discriment analysis
 
Discriminant Analysis-lecture 8
Discriminant Analysis-lecture 8Discriminant Analysis-lecture 8
Discriminant Analysis-lecture 8
 
Mba-project-reports-systems-technology-management-titles
Mba-project-reports-systems-technology-management-titlesMba-project-reports-systems-technology-management-titles
Mba-project-reports-systems-technology-management-titles
 
Market Research Project Report
Market Research Project ReportMarket Research Project Report
Market Research Project Report
 
Report on Celebrity Endorsement
Report on Celebrity EndorsementReport on Celebrity Endorsement
Report on Celebrity Endorsement
 
Discriminant analysis
Discriminant analysisDiscriminant analysis
Discriminant analysis
 
ANOVA in Marketing Research
ANOVA  in Marketing ResearchANOVA  in Marketing Research
ANOVA in Marketing Research
 
Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...
Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...
Marketing research-project-report-on-customer-satisfaction-regarding-manhindr...
 
Consumer behaviour
Consumer behaviourConsumer behaviour
Consumer behaviour
 
Factor analysis
Factor analysisFactor analysis
Factor analysis
 
FiscalAndSocialEffectsOfStateAlcoholControlSystems
FiscalAndSocialEffectsOfStateAlcoholControlSystemsFiscalAndSocialEffectsOfStateAlcoholControlSystems
FiscalAndSocialEffectsOfStateAlcoholControlSystems
 
A szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségei
A szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségeiA szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségei
A szlovákiai magyar iskolahálózat állapota és fejlesztésének lehetőségei
 
MANUEL R
MANUEL RMANUEL R
MANUEL R
 
life processes #aanchal
life processes #aanchallife processes #aanchal
life processes #aanchal
 
Pan pel bem 2015
Pan pel bem 2015Pan pel bem 2015
Pan pel bem 2015
 

Similar to Discriminant analysis

Basic Concepts of Standard Experimental Designs ( Statistics )
Basic Concepts of Standard Experimental Designs ( Statistics )Basic Concepts of Standard Experimental Designs ( Statistics )
Basic Concepts of Standard Experimental Designs ( Statistics )
Hasnat Israq
 
Basic Concepts of Experimental Design & Standard Design ( Statistics )
Basic Concepts of Experimental Design & Standard Design ( Statistics )Basic Concepts of Experimental Design & Standard Design ( Statistics )
Basic Concepts of Experimental Design & Standard Design ( Statistics )
Hasnat Israq
 
Malhotra18
Malhotra18Malhotra18
การสุ่มตัวอย่างในงานวิจัยสาธารณสุข
การสุ่มตัวอย่างในงานวิจัยสาธารณสุขการสุ่มตัวอย่างในงานวิจัยสาธารณสุข
การสุ่มตัวอย่างในงานวิจัยสาธารณสุขUltraman Taro
 
Random Matrix Theory and Machine Learning - Part 4
Random Matrix Theory and Machine Learning - Part 4Random Matrix Theory and Machine Learning - Part 4
Random Matrix Theory and Machine Learning - Part 4
Fabian Pedregosa
 
Bayes ML.ppt
Bayes ML.pptBayes ML.ppt
Bayes ML.ppt
Deepa Rahul
 
Quantitative Analysis for Emperical Research
Quantitative Analysis for Emperical ResearchQuantitative Analysis for Emperical Research
Quantitative Analysis for Emperical Research
Amit Kamble
 
Paper Summary of Disentangling by Factorising (Factor-VAE)
Paper Summary of Disentangling by Factorising (Factor-VAE)Paper Summary of Disentangling by Factorising (Factor-VAE)
Paper Summary of Disentangling by Factorising (Factor-VAE)
준식 최
 
Dr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdf
Dr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdfDr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdf
Dr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdf
HassanMohyUdDin2
 
Factor analysis in R with Five Personality Survey Mini Sample
Factor analysis in R with Five Personality Survey Mini SampleFactor analysis in R with Five Personality Survey Mini Sample
Factor analysis in R with Five Personality Survey Mini Sample
FangyaTan
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
arkian3
 
ESRA2015 course: Latent Class Analysis for Survey Research
ESRA2015 course: Latent Class Analysis for Survey ResearchESRA2015 course: Latent Class Analysis for Survey Research
ESRA2015 course: Latent Class Analysis for Survey Research
Daniel Oberski
 
SimpleLinearRegressionAnalysisWithExamples.ppt
SimpleLinearRegressionAnalysisWithExamples.pptSimpleLinearRegressionAnalysisWithExamples.ppt
SimpleLinearRegressionAnalysisWithExamples.ppt
AdnanAli861711
 
Linear regression.ppt
Linear regression.pptLinear regression.ppt
Linear regression.ppt
branlymbunga1
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
MoinPasha12
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
Bhavik2002
 
Slideset Simple Linear Regression models.ppt
Slideset Simple Linear Regression models.pptSlideset Simple Linear Regression models.ppt
Slideset Simple Linear Regression models.ppt
rahulrkmgb09
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
WaqarTariq18
 

Similar to Discriminant analysis (20)

Basic Concepts of Standard Experimental Designs ( Statistics )
Basic Concepts of Standard Experimental Designs ( Statistics )Basic Concepts of Standard Experimental Designs ( Statistics )
Basic Concepts of Standard Experimental Designs ( Statistics )
 
Basic Concepts of Experimental Design & Standard Design ( Statistics )
Basic Concepts of Experimental Design & Standard Design ( Statistics )Basic Concepts of Experimental Design & Standard Design ( Statistics )
Basic Concepts of Experimental Design & Standard Design ( Statistics )
 
ppt0320defenseday
ppt0320defensedayppt0320defenseday
ppt0320defenseday
 
Malhotra18
Malhotra18Malhotra18
Malhotra18
 
Student t t est
Student t t estStudent t t est
Student t t est
 
การสุ่มตัวอย่างในงานวิจัยสาธารณสุข
การสุ่มตัวอย่างในงานวิจัยสาธารณสุขการสุ่มตัวอย่างในงานวิจัยสาธารณสุข
การสุ่มตัวอย่างในงานวิจัยสาธารณสุข
 
Random Matrix Theory and Machine Learning - Part 4
Random Matrix Theory and Machine Learning - Part 4Random Matrix Theory and Machine Learning - Part 4
Random Matrix Theory and Machine Learning - Part 4
 
Bayes ML.ppt
Bayes ML.pptBayes ML.ppt
Bayes ML.ppt
 
Quantitative Analysis for Emperical Research
Quantitative Analysis for Emperical ResearchQuantitative Analysis for Emperical Research
Quantitative Analysis for Emperical Research
 
Paper Summary of Disentangling by Factorising (Factor-VAE)
Paper Summary of Disentangling by Factorising (Factor-VAE)Paper Summary of Disentangling by Factorising (Factor-VAE)
Paper Summary of Disentangling by Factorising (Factor-VAE)
 
Dr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdf
Dr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdfDr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdf
Dr.Dinesh-BIOSTAT-Tests-of-significance-1-min.pdf
 
Factor analysis in R with Five Personality Survey Mini Sample
Factor analysis in R with Five Personality Survey Mini SampleFactor analysis in R with Five Personality Survey Mini Sample
Factor analysis in R with Five Personality Survey Mini Sample
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
 
ESRA2015 course: Latent Class Analysis for Survey Research
ESRA2015 course: Latent Class Analysis for Survey ResearchESRA2015 course: Latent Class Analysis for Survey Research
ESRA2015 course: Latent Class Analysis for Survey Research
 
SimpleLinearRegressionAnalysisWithExamples.ppt
SimpleLinearRegressionAnalysisWithExamples.pptSimpleLinearRegressionAnalysisWithExamples.ppt
SimpleLinearRegressionAnalysisWithExamples.ppt
 
Linear regression.ppt
Linear regression.pptLinear regression.ppt
Linear regression.ppt
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
 
Slideset Simple Linear Regression models.ppt
Slideset Simple Linear Regression models.pptSlideset Simple Linear Regression models.ppt
Slideset Simple Linear Regression models.ppt
 
lecture13.ppt
lecture13.pptlecture13.ppt
lecture13.ppt
 

More from 緯鈞 沈

SEM model examination
SEM model examinationSEM model examination
SEM model examination
緯鈞 沈
 
SEM
SEMSEM
Manova
ManovaManova
Manova
緯鈞 沈
 
Cluster analysis
Cluster analysisCluster analysis
Cluster analysis
緯鈞 沈
 
Factor analysis
Factor analysisFactor analysis
Factor analysis
緯鈞 沈
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
緯鈞 沈
 
Multiple regression
Multiple regressionMultiple regression
Multiple regression
緯鈞 沈
 
Data screening
Data screeningData screening
Data screening
緯鈞 沈
 

More from 緯鈞 沈 (8)

SEM model examination
SEM model examinationSEM model examination
SEM model examination
 
SEM
SEMSEM
SEM
 
Manova
ManovaManova
Manova
 
Cluster analysis
Cluster analysisCluster analysis
Cluster analysis
 
Factor analysis
Factor analysisFactor analysis
Factor analysis
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Multiple regression
Multiple regressionMultiple regression
Multiple regression
 
Data screening
Data screeningData screening
Data screening
 

Recently uploaded

Influence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business PlanInfluence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business Plan
jerlynmaetalle
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
Subhajit Sahu
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
slg6lamcq
 
一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单
enxupq
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
dwreak4tg
 
一比一原版(CBU毕业证)卡普顿大学毕业证成绩单
一比一原版(CBU毕业证)卡普顿大学毕业证成绩单一比一原版(CBU毕业证)卡普顿大学毕业证成绩单
一比一原版(CBU毕业证)卡普顿大学毕业证成绩单
nscud
 
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
2023240532
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
ewymefz
 
Empowering Data Analytics Ecosystem.pptx
Empowering Data Analytics Ecosystem.pptxEmpowering Data Analytics Ecosystem.pptx
Empowering Data Analytics Ecosystem.pptx
benishzehra469
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
ewymefz
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
u86oixdj
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
ewymefz
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
ArpitMalhotra16
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
ocavb
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单
一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单
一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单
vcaxypu
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
AbhimanyuSinha9
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
nscud
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
slg6lamcq
 

Recently uploaded (20)

Influence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business PlanInfluence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business Plan
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
 
一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单一比一原版(YU毕业证)约克大学毕业证成绩单
一比一原版(YU毕业证)约克大学毕业证成绩单
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
 
一比一原版(CBU毕业证)卡普顿大学毕业证成绩单
一比一原版(CBU毕业证)卡普顿大学毕业证成绩单一比一原版(CBU毕业证)卡普顿大学毕业证成绩单
一比一原版(CBU毕业证)卡普顿大学毕业证成绩单
 
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单
 
Empowering Data Analytics Ecosystem.pptx
Empowering Data Analytics Ecosystem.pptxEmpowering Data Analytics Ecosystem.pptx
Empowering Data Analytics Ecosystem.pptx
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单
一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单
一比一原版(ArtEZ毕业证)ArtEZ艺术学院毕业证成绩单
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
 

Discriminant analysis

  • 2. Purpose  To predict group membership from a set of predictors  Level of DV > 2  What analytic strategy will you use?
  • 3. Kinds of research questions  Goals of discriminant analysis are to find the dimension or dimensions along which groups differ, and to find classification function to predict group membership.  Significance of prediction  Number of significant discriminant functions  Dimensions of discrimination  Classification functions  Adequacy of classification  Effect size  Importance of predictor variables  Significance of prediction with covariates  Estimation of group means
  • 4. Limitations to discriminant analysis  Theoretical issues  Random assignment  Generalizability  Practical issues  Unequal sample size, missing data, and power  Multivariate normality  Absence of outliers  Homogeneity of variance-covariance matrices  Linearity  Absence of multicollinearity and singularity
  • 5. Fundamental equation for discriminant analysis  Derivation and test of discriminant functions 𝑆𝑡𝑜𝑡𝑎𝑙 = 𝑆 𝑏𝑔 + 𝑆 𝑤𝑔 Λ = 𝑆 𝑤𝑔 𝑆 𝑏𝑔 + 𝑆 𝑤𝑔 Approximate F = 𝑑𝑓1, 𝑑𝑓2 = 1−𝑦 𝑦 𝑑𝑓2 𝑑𝑓1 Λ 1 2 = 𝑦;
  • 6. Fundamental equation for discriminant analysis  Classification  Equal group size  Unequal group size 𝐶𝑗 = 𝑐𝑗0 +𝑐𝑗1 𝑋1 + 𝑐𝑗2 𝑋2 + ⋯ + 𝑐𝑖𝑝 𝑋 𝑝 𝐂𝑗 = 𝐖−1 𝐌𝑗 𝑐𝑗0 = − 1 2 𝐂𝑗 ′ 𝐌𝑗 𝐂𝑗 = 𝑐𝑗0 + 𝑖=1 𝑝 𝑐𝑗𝑖 𝑋𝑖 + 𝑙𝑛 𝑛𝑗 𝑁
  • 7. Fundamental equation for discriminant analysis  Projection 𝐶𝑗 = 𝑐𝑗0 +𝑐𝑗1 𝑋1 + 𝑐𝑗2 𝑋2 + ⋯ + 𝑐𝑖𝑝 𝑋 𝑝 Xp Cj θ
  • 8. Fundamental equation for discriminant analysis  Solution B − ΛW K = 0 𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 = Λ = 𝑟𝑐1 2 ⋯ ⋯ ⋮ ⋱ ⋮ ⋮ ⋯ 𝑟𝑐𝑖 2 𝑒𝑖𝑔𝑒𝑛𝑣𝑒𝑐𝑡𝑜𝑟 = K = 𝑘1 ⋯ 𝑘 𝑞 Do you smell something?
  • 10. Discriminant function  Special case of canonical analysis 1 1 N P N*P X 1 2 3 1 2 3 1 2 N*1 Y
  • 11. Discriminant function  Special case of canonical analysis 1 1 N P N*P X 1 N N*(L-1) …D1 D2 D3 DL-1 1 0 0 … 0 0 1 0 … 0 0 0 1 … 0 0 0 0 … 1
  • 12. Discriminant function  Special case of canonical analysis χ1 χ2 X1 X2 X3 X4 X5 η1 η2 D1 D2 𝑟𝑐2 𝑟𝑐3 0 0
  • 13. Example: 1 predictor  DV Y=0 Y=1 0 1 2 3 4 5 6 7 8 9 10 X 1 27 4 9 31013 5 6 12 11 3 14 15
  • 14. Example: 2 predictors  DV Y=0 Y=1 Y=2 0 1 2 3 4 5 6 7 X1 12 4 3 5 6 7 8 9 10 12 11 13 14 15 0 1 2 3 4 5 6 7 X2 14 2 5 3 6 78 9 10 12 11 13 14 15
  • 15. Example: 2 predictors  DV Y=0 Y=1 Y=2 0 1 2 3 4 5 6 7 1 2 4 3 5 6 7 8 9 10 1211 13 14 15 Discriminant function 2 = 0*X1+1*X2 Discriminant function 1 = 1*X1+0*X2 1 2 3 4 5 6 7 Number Min (N of IV, df for DV)
  • 16. Principle of discriminant function  Various linear combination (projection)
  • 17. Principle of discriminant analysis  Maximize difference among levels  Minimize variance within level X1 X2 C1
  • 18. Types of discriminant analysis  Direct(standard) discriminant analysis  Test for the significance  Sequential discriminant analysis  Mathematical resolution of combining variables  Stepwise(statistical) discriminant analysis  Mathematical resolution of combining variables
  • 19. Criteria for overall statistical significance  General  Wilk’s lamda  Hotelling’s trace  Roy’s gcr  Pillai’s criterion  Distance-based (usually for stepwise)  Mahalanobis’D2  Rao’s V
  • 20. Interpreting discriminant functions  Discriminant function plots (F1 & F2; F2 & F3;…) 0 1 2 3 4 5 6 7 G1 Discriminant function 2 = 0*X1+1*X2 Discriminant function 1 = 1*X1+0*X2 1 2 3 4 5 6 7 G2 G3
  • 21. Interpreting discriminant functions  Discriminant weight (coefficient)  Beta in regression analysis  Discriminant loading  Simple linear correlation between IV and discriminant function  >.33 (Tabachnick & Fidell, 2009)  >.40 (Hair et al., 2010)
  • 22. Evaluating predictor variables  Classification function coefficient / loading  Magnitude  Mean difference  Compare MGi and Mpooled(Gn-i)  Inflation of type 1 error  Adjusted alpha  Potency index
  • 23. Potency index χn X1 X2 X3 X4 X5 ηn D1 D2 D3 D4 𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 𝑐𝑛λ 𝑥𝑛1 λ 𝑥𝑛2 λ 𝑥𝑛3 λ 𝑥𝑛4 λ 𝑥𝑛5 λ 𝑦𝑛1 λ 𝑦𝑛2 λ 𝑦𝑛3 λ 𝑦𝑛4 Square d 𝑃𝑜𝑡𝑒𝑛𝑐𝑦 𝑖𝑛𝑑𝑒𝑥 𝑥𝑛𝑖→y = λ 𝑥𝑛𝑖 2 × 𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 𝑐𝑛 𝑡𝑜𝑡𝑎𝑙 𝑒𝑖𝑔𝑒𝑛𝑣𝑎𝑙𝑢𝑒 2
  • 24. Effect size  Total  Partial η2  Specific  Eigenvalue (each discriminant function)  Squared structure matric loading (each predictor) 𝑝𝑎𝑟𝑡𝑖𝑎𝑙 η2 = 1 − Λ 1 3
  • 25. Use of classification procedure  Generalization (hit ratio)  Cross-validation and new case  Jackknified classification  Leave one out classification  Evaluating improvement in classification  Sequential Early step classification Correct Incorrect Later step classification Correct A B Incorrect C D χ2 1 = 𝐵 − 𝐶 − 1 𝐵 + 𝐶
  • 26. Standards of hit ratio  Proportion chance criterion  Press’s Q 𝑃𝑟𝑒𝑠𝑠′ 𝑠 𝑄 = 𝑁 − 𝑛𝐾 2 𝑁(𝐾 − 1) 𝐶 𝑝𝑟𝑜 = 𝑝2 + (1 − 𝑝)2 ℎ𝑖𝑡 𝑟𝑎𝑡𝑖𝑜 > 1.25 × 𝐶 𝑝𝑟𝑜 𝑝2 χ2 > 3.84 (𝛼 = .05) χ2 > 6.63 (𝛼 = .01)
  • 27. Procedure 1. Research question 2. Designing a canonical analysis 3. Check the assumptions 4. Derive canonical analysis and assess overall fit 5. Interpret the canonical variate 6. Validation and diagnosis