SlideShare a Scribd company logo
MULTIPLE REGRESSION
Dr. Vipul Patel
2
 Multiple regression is used to explore the
relationship between one continuous dependent
variable and a number of independent variables or
predictors (usually continuous)
 Some of the main types of research questions that
multiple regression can be used to address are:
 How well a set of variables is able to predict a
particular outcome?
 Which variable in a set of variable is best predictor of
an outcome?
 Whether a particular predictor variable is still able to
predict an outcome when the effects of another
variable is controlled for.
3
 The three types of multiple regression analysis
are
 Standard or simultaneous
 Hierarchical or sequential
 stepwise
Standard Multiple Regression
4
 This is the most commonly used multiple
regression analysis.
 In this all independent (or predictor) variables
are entered into the equation.
 This method tells you how much of the
variance in your dependent variable can be
explained by your independent variables. It
also gives you an indication of the relative
contribution of each independent variable.
Case: Standard Multiple
Regression5
 Research Questions:
 How well do the two measures of control
(mastery, PCOISS) predict perceived stress?
 Which is the best predictor of perceived stress:
Control of external events (Mastery scale) or
control of Internal States (PCOISS)?
6
 Data requirement
 One continuous dependent variable (i.e., Total
perceived stress)
 Two or more continuous independent variables
(i.e, mastery, PCOISS).
Interpretation of Output
7
 Multicollinearity
 Check that your independent variables show at least some
relationship with your dependent variable (above 0.3 preferably).
 Also check that the correlation between each of your independent
variable is not too high (above 0.9).
 In this case both of the scale (Total Mastery and Total PCOISS)
correlates substantially with Total Perceived Stress (-0.611 and -
0.581).
 Look at the Collinearity Statistics, if the value of Tolerance is very
low (near to 0), then we can say that multicollinearity is present.
Tolerance below 0.1 indicates a serious problem and Tolerance
below 0.2 indicates a potential problem (Menard, 1995). In this
case, the value of tolerance for two independent variables is 0.722
in each case.
 If the largest VIF is larger than 10 then there is cause for concern
(Myers, 1990).
8
 Outliers
 Scatterplot
 Mahalanobis distance
Chi Square Table
 Normality
 Homoscedasticity
 Scatterplot
9
 Look at the Model Summary output table and
check the R Square value.
 This value will tell you how much variance in
the dependent variable is explained by
independent variables.
 In this case, the value of R Square is 0.466
(i.e., 46.6%). This means that our two
independent variables (i.e, Mastery and
PCOISS) explain 46.8% variance in perceived
stress.
10
 Look at the ANOVA output table. This will tell
you the statistical significance of the model.
 The significance value (i.e., 0.000) is less than
0.05. it indicates that the model is statistically
significant.
 We can conclude that our regression model
predicts perceived stress significantly well.
11
 Next thing we want to know the relative
contribution of each independent variables in
the prediction of dependent variable.
 Look at the “Coefficients output table.” The
standardize Beta Coefficient for Total Mastery
and Total PCOISS are -0.422 and -0.358
respectively.
 For these values, check the significance value,
too!!!
12
Thank you!!!
Dr. Vipul Patel
vipulpat@gmail.com

More Related Content

What's hot

Multiple Regression and Logistic Regression
Multiple Regression and Logistic RegressionMultiple Regression and Logistic Regression
Multiple Regression and Logistic Regression
Kaushik Rajan
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
Pawan Kawan
 
Multicollinearity
MulticollinearityMulticollinearity
Multicollinearity
Bernard Asia
 
Multicollinearity1
Multicollinearity1Multicollinearity1
Multicollinearity1
Muhammad Ali
 
Multinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationshipsMultinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationships
Anirudha si
 
Binary Logistic Regression
Binary Logistic RegressionBinary Logistic Regression
Binary Logistic Regression
Seth Anandaram Jaipuria College
 
Multiple Linear Regression
Multiple Linear RegressionMultiple Linear Regression
Multiple Linear Regression
Indus University
 
Factor analysis in Spss
Factor analysis in SpssFactor analysis in Spss
Factor analysis in Spss
Fayaz Ahmad
 
Regression
RegressionRegression
Regression
Rohit Sharma
 
QUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSS
QUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSSQUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSS
QUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSS
ICFAI Business School
 
Statistics Chapter 01[1]
Statistics  Chapter 01[1]Statistics  Chapter 01[1]
Statistics Chapter 01[1]
plisasm
 
Stats test
Stats testStats test
Stats test
Sharmila Christy
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
saba khan
 
Statistice Chapter 02[1]
Statistice  Chapter 02[1]Statistice  Chapter 02[1]
Statistice Chapter 02[1]
plisasm
 
1. complete stats notes
1. complete stats notes1. complete stats notes
1. complete stats notes
Bob Smullen
 
Econometrics chapter 8
Econometrics chapter 8Econometrics chapter 8
Econometrics chapter 8
Sehrish Chaudary
 
R - Multiple Regression
R - Multiple RegressionR - Multiple Regression
R - Multiple Regression
Learnbay Datascience
 
Manova
ManovaManova
EFA
EFAEFA

What's hot (19)

Multiple Regression and Logistic Regression
Multiple Regression and Logistic RegressionMultiple Regression and Logistic Regression
Multiple Regression and Logistic Regression
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
 
Multicollinearity
MulticollinearityMulticollinearity
Multicollinearity
 
Multicollinearity1
Multicollinearity1Multicollinearity1
Multicollinearity1
 
Multinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationshipsMultinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationships
 
Binary Logistic Regression
Binary Logistic RegressionBinary Logistic Regression
Binary Logistic Regression
 
Multiple Linear Regression
Multiple Linear RegressionMultiple Linear Regression
Multiple Linear Regression
 
Factor analysis in Spss
Factor analysis in SpssFactor analysis in Spss
Factor analysis in Spss
 
Regression
RegressionRegression
Regression
 
QUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSS
QUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSSQUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSS
QUANTITATIVE DATA ANALYSIS HOW TO DO A T-TEST ON MS-EXCEL AND SPSS
 
Statistics Chapter 01[1]
Statistics  Chapter 01[1]Statistics  Chapter 01[1]
Statistics Chapter 01[1]
 
Stats test
Stats testStats test
Stats test
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Statistice Chapter 02[1]
Statistice  Chapter 02[1]Statistice  Chapter 02[1]
Statistice Chapter 02[1]
 
1. complete stats notes
1. complete stats notes1. complete stats notes
1. complete stats notes
 
Econometrics chapter 8
Econometrics chapter 8Econometrics chapter 8
Econometrics chapter 8
 
R - Multiple Regression
R - Multiple RegressionR - Multiple Regression
R - Multiple Regression
 
Manova
ManovaManova
Manova
 
EFA
EFAEFA
EFA
 

Similar to Spss6 multiple regression

linear model multiple predictors.pdf
linear model multiple predictors.pdflinear model multiple predictors.pdf
linear model multiple predictors.pdf
ssuser7d5314
 
Inferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing ResearchInferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing Research
LaticiaGrissomzz
 
Inferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing ResearchInferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing Research
LizbethQuinonez813
 
A researcher in attempting to run a regression model noticed a neg.docx
A researcher in attempting to run a regression model noticed a neg.docxA researcher in attempting to run a regression model noticed a neg.docx
A researcher in attempting to run a regression model noticed a neg.docx
evonnehoggarth79783
 
Anova single factor
Anova single factorAnova single factor
Anova single factor
Dhruv Patel
 
Analytic Methods and Issues in CER from Observational Data
Analytic Methods and Issues in CER from Observational DataAnalytic Methods and Issues in CER from Observational Data
Analytic Methods and Issues in CER from Observational Data
CTSI at UCSF
 
Multinomial Logistic Regression.pdf
Multinomial Logistic Regression.pdfMultinomial Logistic Regression.pdf
Multinomial Logistic Regression.pdf
AlemAyahu
 
Anova single factor
Anova single factorAnova single factor
Anova single factor
Dhruv Patel
 
Statistics in meta analysis
Statistics in meta analysisStatistics in meta analysis
Statistics in meta analysis
Dr Shri Sangle
 
Chapter 12Choosing an Appropriate Statistical TestiStockph.docx
Chapter 12Choosing an Appropriate Statistical TestiStockph.docxChapter 12Choosing an Appropriate Statistical TestiStockph.docx
Chapter 12Choosing an Appropriate Statistical TestiStockph.docx
mccormicknadine86
 
Quantitative_analysis.ppt
Quantitative_analysis.pptQuantitative_analysis.ppt
Quantitative_analysis.ppt
mousaderhem1
 
Binary OR Binomial logistic regression
Binary OR Binomial logistic regression Binary OR Binomial logistic regression
Binary OR Binomial logistic regression
Dr Athar Khan
 
What do youwant to doHow manyvariablesWhat level.docx
What do youwant to doHow manyvariablesWhat level.docxWhat do youwant to doHow manyvariablesWhat level.docx
What do youwant to doHow manyvariablesWhat level.docx
philipnelson29183
 
Research methodology
Research methodology Research methodology
Research methodology
ANCYBS
 
Commonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research HandoutCommonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research Handout
Pat Barlow
 
Advice On Statistical Analysis For Circulation Research
Advice On Statistical Analysis For Circulation ResearchAdvice On Statistical Analysis For Circulation Research
Advice On Statistical Analysis For Circulation Research
Nancy Ideker
 
STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...
STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...
STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...
Musfera Nara Vadia
 
Multiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IMultiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA I
James Neill
 
stats notes.doc
stats notes.docstats notes.doc
stats notes.doc
AshaChikkaputtegowda1
 
Eviews forecasting
Eviews forecastingEviews forecasting
Eviews forecasting
Rafael Bustamante Romaní
 

Similar to Spss6 multiple regression (20)

linear model multiple predictors.pdf
linear model multiple predictors.pdflinear model multiple predictors.pdf
linear model multiple predictors.pdf
 
Inferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing ResearchInferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing Research
 
Inferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing ResearchInferential AnalysisChapter 20NUR 6812Nursing Research
Inferential AnalysisChapter 20NUR 6812Nursing Research
 
A researcher in attempting to run a regression model noticed a neg.docx
A researcher in attempting to run a regression model noticed a neg.docxA researcher in attempting to run a regression model noticed a neg.docx
A researcher in attempting to run a regression model noticed a neg.docx
 
Anova single factor
Anova single factorAnova single factor
Anova single factor
 
Analytic Methods and Issues in CER from Observational Data
Analytic Methods and Issues in CER from Observational DataAnalytic Methods and Issues in CER from Observational Data
Analytic Methods and Issues in CER from Observational Data
 
Multinomial Logistic Regression.pdf
Multinomial Logistic Regression.pdfMultinomial Logistic Regression.pdf
Multinomial Logistic Regression.pdf
 
Anova single factor
Anova single factorAnova single factor
Anova single factor
 
Statistics in meta analysis
Statistics in meta analysisStatistics in meta analysis
Statistics in meta analysis
 
Chapter 12Choosing an Appropriate Statistical TestiStockph.docx
Chapter 12Choosing an Appropriate Statistical TestiStockph.docxChapter 12Choosing an Appropriate Statistical TestiStockph.docx
Chapter 12Choosing an Appropriate Statistical TestiStockph.docx
 
Quantitative_analysis.ppt
Quantitative_analysis.pptQuantitative_analysis.ppt
Quantitative_analysis.ppt
 
Binary OR Binomial logistic regression
Binary OR Binomial logistic regression Binary OR Binomial logistic regression
Binary OR Binomial logistic regression
 
What do youwant to doHow manyvariablesWhat level.docx
What do youwant to doHow manyvariablesWhat level.docxWhat do youwant to doHow manyvariablesWhat level.docx
What do youwant to doHow manyvariablesWhat level.docx
 
Research methodology
Research methodology Research methodology
Research methodology
 
Commonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research HandoutCommonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research Handout
 
Advice On Statistical Analysis For Circulation Research
Advice On Statistical Analysis For Circulation ResearchAdvice On Statistical Analysis For Circulation Research
Advice On Statistical Analysis For Circulation Research
 
STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...
STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...
STATISTICS : Changing the way we do: Hypothesis testing, effect size, power, ...
 
Multiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IMultiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA I
 
stats notes.doc
stats notes.docstats notes.doc
stats notes.doc
 
Eviews forecasting
Eviews forecastingEviews forecasting
Eviews forecasting
 

Spss6 multiple regression

  • 2. 2  Multiple regression is used to explore the relationship between one continuous dependent variable and a number of independent variables or predictors (usually continuous)  Some of the main types of research questions that multiple regression can be used to address are:  How well a set of variables is able to predict a particular outcome?  Which variable in a set of variable is best predictor of an outcome?  Whether a particular predictor variable is still able to predict an outcome when the effects of another variable is controlled for.
  • 3. 3  The three types of multiple regression analysis are  Standard or simultaneous  Hierarchical or sequential  stepwise
  • 4. Standard Multiple Regression 4  This is the most commonly used multiple regression analysis.  In this all independent (or predictor) variables are entered into the equation.  This method tells you how much of the variance in your dependent variable can be explained by your independent variables. It also gives you an indication of the relative contribution of each independent variable.
  • 5. Case: Standard Multiple Regression5  Research Questions:  How well do the two measures of control (mastery, PCOISS) predict perceived stress?  Which is the best predictor of perceived stress: Control of external events (Mastery scale) or control of Internal States (PCOISS)?
  • 6. 6  Data requirement  One continuous dependent variable (i.e., Total perceived stress)  Two or more continuous independent variables (i.e, mastery, PCOISS).
  • 7. Interpretation of Output 7  Multicollinearity  Check that your independent variables show at least some relationship with your dependent variable (above 0.3 preferably).  Also check that the correlation between each of your independent variable is not too high (above 0.9).  In this case both of the scale (Total Mastery and Total PCOISS) correlates substantially with Total Perceived Stress (-0.611 and - 0.581).  Look at the Collinearity Statistics, if the value of Tolerance is very low (near to 0), then we can say that multicollinearity is present. Tolerance below 0.1 indicates a serious problem and Tolerance below 0.2 indicates a potential problem (Menard, 1995). In this case, the value of tolerance for two independent variables is 0.722 in each case.  If the largest VIF is larger than 10 then there is cause for concern (Myers, 1990).
  • 8. 8  Outliers  Scatterplot  Mahalanobis distance Chi Square Table  Normality  Homoscedasticity  Scatterplot
  • 9. 9  Look at the Model Summary output table and check the R Square value.  This value will tell you how much variance in the dependent variable is explained by independent variables.  In this case, the value of R Square is 0.466 (i.e., 46.6%). This means that our two independent variables (i.e, Mastery and PCOISS) explain 46.8% variance in perceived stress.
  • 10. 10  Look at the ANOVA output table. This will tell you the statistical significance of the model.  The significance value (i.e., 0.000) is less than 0.05. it indicates that the model is statistically significant.  We can conclude that our regression model predicts perceived stress significantly well.
  • 11. 11  Next thing we want to know the relative contribution of each independent variables in the prediction of dependent variable.  Look at the “Coefficients output table.” The standardize Beta Coefficient for Total Mastery and Total PCOISS are -0.422 and -0.358 respectively.  For these values, check the significance value, too!!!
  • 12. 12 Thank you!!! Dr. Vipul Patel vipulpat@gmail.com