Upcoming SlideShare
×

Factor Analysis in Research

4,582 views
4,191 views

Published on

1 Comment
28 Likes
Statistics
Notes
• Full Name
Comment goes here.

Are you sure you want to Yes No
• sir / madam please send this knowledgeable ppt. to me on my email :- sunil23121984@gmail.com

Are you sure you want to  Yes  No
Views
Total views
4,582
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
1
1
Likes
28
Embeds 0
No embeds

No notes for slide
• n
• Factor Analysis in Research

1. 1. Presented By: Rabia Umer Noor Fatima 1
2. 2.  Factor Analysis  Procedure used to reduce a large amount of questions into few variables (Factors) according to their relevance.  Used to know how many dimensions a variable has  E.g. Organizational Support and Supervisory Support  Interdependence technique 2
3. 3. definition  Provides a tool for analyzing the structure of interrelationships (Correlations) among variables by defining a set of variables which are highly correlated known as Factors.  Factors are assumed to represent dimensions within data. 3
4. 4. Factor analysis is commonly used in: Data reduction Scale development The evaluation of the psychometric quality of a measure, and The assessment of the dimensionality of a set of variables. 4
5. 5. types  Exploratory  When the dimensions/factors are theoretically unknown  Exploratory Factor Analysis (EFA) is a statistical approach to determining the correlation among the variables in a dataset. This type of analysis provides a factor structure (a grouping of variables based on strong correlations). 5
6. 6.  Confirmatory  When researcher has preconcieved thoughts about the actual structure of data based on theoretical support or prior research.  Researcher may wish to test hypothesis involving issues as which variables should be grouped together on a factor. 6
7. 7. Example  Retail firm identified 80 characteristics of retail stores and their services that consumers mentioned as affecting their patronage choice among stores.  Retailer want to find the broader dimensions on which he can conduct a survey  Factor analysis will be used here 7
8. 8. 8
9. 9. Factor analysis decision process  Objectives of factor analysis  Designing a factor analysis  Assumptions in factor analysis  Deriving factors and assessing overall fit  Interpreting the factors  Validation of factor analysis  Additional use of factor analysis research 9
10. 10. 10
11. 11. Objective  Data summarization  Definition of structure  Data reduction  Purpose is to retain the nature and character of original variables but reduce their numbers to simplify the subsequent multivariate analysis 11
12. 12. 12
13. 13.  Both type of factor analysis use correlation matrix as an input data.  With R type we use traditional correlation matrix  In Q type factor analysis there would be a factor matrix that would identify similar individuals 13
14. 14. Difference between Q analysis and cluster analysis  Q type factor analysis is based on the intercorrelations between respondents while cluster analysis forms grouping based on distance based similarity measure between repondant’s scores on variables being analyzed.  Variable selection and measurement issues  Metric variables should be there  If non metric then use dummy variables to represent catagories of non metric variables  ]=If all non metric then use boolean factor ana 14
15. 15. 15
16. 16. assumptions  Basic asumption: some underlying structure does exist in set of selected variables (ensure that observed patterns are conceptually valid).  Sample is homogenous with respect to underlying factor structure.  Departure from normality, homoscedasticity and linearity can apply to extent that they diminish observed correlation  Some degree of multicollinearity is desirable 16
17. 17.  Researcher must ensure that data matrix has sufficient correlations to justify application of factor analysis(No equal or low correlations).  Correlation among variables can be analyzed by partial correlation (Correlation which is unexplained when effect of other variables taken into account). High partial correlation means factor analysis is inappropriate.Rule of thumb is to consider correlation above 0.7 as high. 17
18. 18.  Another method of determining appropriateness of factor analysis is Bartlett test of sphericity which provide statistical significance that correlation matrix has significant correlation among at least some variables  Bartlett test should be significant i.e. less than 0.05 this means that the variables are correlated highly enough to provide a reasonable basis for factor analysis. This indicate that correlation matrix is significantly different from an identity matrix in which correlations between variables are all zero. 18
19. 19. 19
20. 20.  Another measure is measure of sampling adequacy. This index ranges from 0 to 1 reaching 1 when each variable is perfectly correlated. This must exceed 0.5 for both the overall test and individual value 20
21. 21. 4 stage: deriving factors and assessing overall fit  Method of extraction of factors is decided here  Common factor analysis  Component factor analysis  Number of factors selected to represent underlying structure in data  Factor extraction method  Decision depend on objective of factor analysis and concept of partioning the variance of variable 21
22. 22.  Variance is value that represent the total amount of dispersion of values about its mean.  When variable is correlated it shares variance with other variables and amount of sharing is the squared correlation.e.g 2 variables having .5 correlation will have .25 shared variance  Total variance of variable can be divided in 3 types of variances  Common variance variance in variable which is shared with all other variables in analysis. Variable’s communality is estimat of shared variance 22
23. 23.  Specific variance  Variance associated with only specific variable. This variance cant be explained by correlation  Error variance  Unexplained variance  Common analysis consider only the common or shared variance  Component analysis consider the full variance. It is more appropriate when data reduction is a primary concern.Also when prior reserrch shows that specific and error variance reprresent a relatively small proportion of total variance .  Common analysis is mostly used when primary objective is to identify the latent dimensions and researchers have little knowledge abtout number of specific and error variance.  In most applications both common and component analysis arrive at essentially identical results if number of variables exceed 30.or communlaities exceed .6 for most variables. 23
24. 24. Criteria for number of variables to extraxt  An exact quantitative base for deciding number of factors to extract has not been developed. Different stopping criteria's are as follow:  Latent root criteria  With component analysis each variable contributes a value of 1 to the total Eigen values. Thus only the factors having the latent roots or Eigen values greater than 1 are considered significant.  This method is suitable when number of variables is between 20 and 50. 24
25. 25.  A priori criterion  Researcher already knows how many factors to extract. Thus researcher instruct the computer to stop analysis when specified number of factors have been extracted.  Percentage of variance criterion  Approach based on achieving a specified cumulative percentage of total variance extracted by successive factors.  In natural sciences factor analysis can’t be stopped until the extracted factors account for 95% of variance  In social sciences criteria can be 60% variance  Scree test criterion  Proportion of unique variance is substantially higher in the later variables. The scree test is used to identify the optimum number of factors to be extracted before the amount of unique variance begins to dominate the common variance structure. 25
26. 26.  Scree test is derived by plotting the latent roots against the number of factors in their order of extraction. The shape of resulting curve is used as a criteria for cutting off point.  The point at which the curve first begin to straighten out is considered to indicate the maximum number of factors to be extracted.  As a general rule scree test results in at least 1 and sometimes 2 or 3 more factors being extracted than does latent root criteria. 26
27. 27. 27
28. 28. Stage 5: Interpretting the factors  Three process of factor interpretation includes:  Estimate the factor matrix  Initial un rotated factor matrix is computed containing factor loading for each variables.  Factor loadings are correlation of each variable and factor  They indicate the degree of correspondence between the variable and factor  Higher loading indicates that variable is representative of factor  They achieve objective of only data reduction. 28
29. 29. 29
30. 30.  Factor rotation  As un rotated factor don’t provide the required information that provide adequate interpretation of data. Thus we need the rotational method to achieve simpler factor solutions.  Factor rotation improves interpretation of data by reducing ambiguities  Rotation means that reference axes of factors are turned about the origin until some position has been achieved.  Un rotated factor solution extract factors in order of their variances extracted (i.e first factors that accounts for the largest variance and then so on)  Ultimate effect of rotation is to redistribute the variance from earlier factors to later ones 30
31. 31.  Two methods of factor rotation includes  Orthogonal factor rotation  Axes are maintained at 90 degree.  Mostly used as almost all software include it  More suitable when research goal is data reduction  Oblique factor rotation  Axes are rotated but they don’t retain the 90 degree angle between reference axes.  Oblique is more flexible  Best suited to the goal of obtaining several theoretically meaningful factors In factor matrix column represent factor with each row corresponding to variable loading across factor 31
32. 32.  Major orthogonal factor rotation approaches include:  Quartimax  Goal is to simplify the rows of factor matrix i.e. it focus on rotating the intial factor so that variable loads high on one factor and as low as possible on other factors.  Varimax  Goal is to simplify the columns of factor matrix. It maximizes the sum of variance of required loading of factor matrix  With this some high loadings (close to +1 or -1 are likely as are some loadings near zero.  Equimax  Compromise between quartimax and varimax. It hasn’t gain wider acceptance 32