SlideShare a Scribd company logo
1 of 19
CHAPTER 8:
MULTIPLE REGRESSION ANALYSIS: THE
PROBLEM OF INFERENCE
Course:
ADVANCED QUANTITATIVE TECHNIQUES
Instructor:
DR. REHANA KOUSER
DEPARTMENT OF COMMERCE, B. Z. UNIVERSITY, MULTAN-PAKISTAN
CALCULATING T-STAT
CHAPTER OUTLINE
1. Testing hypotheses about an individual partial regression coefficient
2. Testing the overall significance of the estimated multiple regression model, that is, finding out if all
the partial slope coefficients are simultaneously equal to zero
3. Testing that two or more coefficients are equal to one another
4. Testing that the partial regression coefficients satisfy certain restrictions
5. Testing the stability of the estimated regression model over time or in different crosssectional units
6. 6. Testing the functional form of regression models
HYPOTHESIS TESTING ABOUT INDIVIDUAL REGRESSION
COEFFICIENTS
The null hypothesis states that, with X3 held constant, X2
has no influence on Y.
We follow same two approaches to test these hypotheses:
• First: Confidence Interval Approach
• Second: Test of Significance Approach
TESTING THE OVERALL SIGNIFICANCE OF THE SAMPLE
REGRESSION
This null hypothesis is a joint hypothesis that β2 and β3 are jointly or simultaneously equal
to zero. A test of such a hypothesis is called a test of the overall significance of the observed or
estimated regression line, that is, whether Yis linearly related to both X2 and X3.
There are two approaches to test this kind of situation:
• ANOVA Approach
• Using R square Approach
ANOVA APPROACH
R SQUARE APPROACH
RELATIONSHIP BETWEEN F AND R SQUARE
THE “INCREMENTAL” OR “MARGINAL” CONTRIBUTION
OF AN EXPLANATORY VARIABLE
• By contribution we mean whether the addition of the variable to the model increases
ESS (and hence R2) “significantly” in relation to the RSS. This contribution may appropriately be
called the incremental, or marginal, contribution of an explanatory variable.
WHEN TO ADD NEW VARIABLE(S)?
When to add new variable?
• A formal method of deciding whether a variable should be added to a regression model. Often
researchers are faced with the task of choosing from several competing models involving the same
dependent variable but with different explanatory variables.
• Therefore, if the inclusion of a variable increases R¯ 2, it is retained in the model although it does
not reduce RSS significantly in the statistical sense.
When to Add a Group of Variables?
• If adding (dropping) a group of variables to the model gives an F value greater (less) than 1, R2 will
increase (decrease). One can easily find out whether the addition (subtraction) of a group of
variables significantly increases (decreases) the explanatory
power of a regression model.
TESTING THE EQUALITY OF TWO REGRESSION
COEFFICIENTS
TESTING RESTRICTIONS
TESTING RESTRICTIONS: T-STAT APPROACH
TESTING RESTRICTIONS: T-STAT APPROACH
TESTING FOR STRUCTURAL OR PARAMETER STABILITY OF
REGRESSION MODELS: THE CHOW TEST
• When we use a regression model involving time series data, it may happen that there is a
structural change in the relationship between the regressand Y and the regressors.
CHOW TEST
TESTING THE FUNCTIONAL FORM OF REGRESSION: CHOOSING
BETWEEN LINEAR AND LOG–LINEAR REGRESSION MODELS
• The choice between a linear regression model (the regressand is a linear function of the
regressors) or a log–linear regression model (the log of the regressand is a function of the
logs of the regressors) is a perennial question in empirical analysis. We can use a test proposed by
MacKinnon, White, and Davidson, which for brevity we call the MWD test, to
choose between the two models.
TESTING THE FUNCTIONAL FORM OF REGRESSION: CHOOSING
BETWEEN LINEAR AND LOG–LINEAR REGRESSION MODELS
TESTING THE FUNCTIONAL FORM OF REGRESSION: CHOOSING
BETWEEN LINEAR AND LOG–LINEAR REGRESSION MODELS
• If the linear model is in fact the correct model, the constructed variable Z1 should not be
statistically significant in Step IV, for in that case the estimated Y values from the linear model and
those estimated from the log–linear model (after taking their antilog values for comparative
purposes) should not be different. The same comment applies to the alternative hypothesis H1.

More Related Content

What's hot

Heteroskedasticity
HeteroskedasticityHeteroskedasticity
Heteroskedasticityhalimuth
 
Econometrics lecture 1st
Econometrics lecture 1stEconometrics lecture 1st
Econometrics lecture 1stIshaq Ahmad
 
Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-Alamin Milton
 
Logit and Probit and Tobit model: Basic Introduction
Logit and Probit  and Tobit model: Basic IntroductionLogit and Probit  and Tobit model: Basic Introduction
Logit and Probit and Tobit model: Basic IntroductionRabeesh Verma
 
ders 6 Panel data analysis.pptx
ders 6 Panel data analysis.pptxders 6 Panel data analysis.pptx
ders 6 Panel data analysis.pptxErgin Akalpler
 
Autocorrelation- Concept, Causes and Consequences
Autocorrelation- Concept, Causes and ConsequencesAutocorrelation- Concept, Causes and Consequences
Autocorrelation- Concept, Causes and ConsequencesShilpa Chaudhary
 
Functional Forms of Regression Models | Eonomics
Functional Forms of Regression Models | EonomicsFunctional Forms of Regression Models | Eonomics
Functional Forms of Regression Models | EonomicsTransweb Global Inc
 
Multicolinearity
MulticolinearityMulticolinearity
MulticolinearityPawan Kawan
 
MUNDELL FLEMING MODEL
MUNDELL FLEMING MODELMUNDELL FLEMING MODEL
MUNDELL FLEMING MODELnosscire.3299
 
Basic concepts of_econometrics
Basic concepts of_econometricsBasic concepts of_econometrics
Basic concepts of_econometricsSwapnaJahan
 
Heteroscedasticity
HeteroscedasticityHeteroscedasticity
HeteroscedasticityMuhammad Ali
 
Stolper samuelson theorem
Stolper samuelson theorem Stolper samuelson theorem
Stolper samuelson theorem Ashiq Pm
 
MACROECONOMICS-CH8
MACROECONOMICS-CH8MACROECONOMICS-CH8
MACROECONOMICS-CH8kkjjkevin03
 

What's hot (20)

Heteroskedasticity
HeteroskedasticityHeteroskedasticity
Heteroskedasticity
 
Econometrics lecture 1st
Econometrics lecture 1stEconometrics lecture 1st
Econometrics lecture 1st
 
Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-
 
Logit and Probit and Tobit model: Basic Introduction
Logit and Probit  and Tobit model: Basic IntroductionLogit and Probit  and Tobit model: Basic Introduction
Logit and Probit and Tobit model: Basic Introduction
 
ders 6 Panel data analysis.pptx
ders 6 Panel data analysis.pptxders 6 Panel data analysis.pptx
ders 6 Panel data analysis.pptx
 
Autocorrelation- Concept, Causes and Consequences
Autocorrelation- Concept, Causes and ConsequencesAutocorrelation- Concept, Causes and Consequences
Autocorrelation- Concept, Causes and Consequences
 
Functional Forms of Regression Models | Eonomics
Functional Forms of Regression Models | EonomicsFunctional Forms of Regression Models | Eonomics
Functional Forms of Regression Models | Eonomics
 
Autocorrelation
AutocorrelationAutocorrelation
Autocorrelation
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
 
Harrod domer model PPT
Harrod domer model PPTHarrod domer model PPT
Harrod domer model PPT
 
MUNDELL FLEMING MODEL
MUNDELL FLEMING MODELMUNDELL FLEMING MODEL
MUNDELL FLEMING MODEL
 
Panel Data Models
Panel Data ModelsPanel Data Models
Panel Data Models
 
Econometrics ch3
Econometrics ch3Econometrics ch3
Econometrics ch3
 
Econometrics
EconometricsEconometrics
Econometrics
 
Basic concepts of_econometrics
Basic concepts of_econometricsBasic concepts of_econometrics
Basic concepts of_econometrics
 
Heteroscedasticity
HeteroscedasticityHeteroscedasticity
Heteroscedasticity
 
Regression models for panel data
Regression models for panel dataRegression models for panel data
Regression models for panel data
 
Stolper samuelson theorem
Stolper samuelson theorem Stolper samuelson theorem
Stolper samuelson theorem
 
Multicollinearity PPT
Multicollinearity PPTMulticollinearity PPT
Multicollinearity PPT
 
MACROECONOMICS-CH8
MACROECONOMICS-CH8MACROECONOMICS-CH8
MACROECONOMICS-CH8
 

Similar to Econometrics chapter 8

A presentation for Multiple linear regression.ppt
A presentation for Multiple linear regression.pptA presentation for Multiple linear regression.ppt
A presentation for Multiple linear regression.pptvigia41
 
A Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptxA Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptxzeusrex4815162342
 
7. logistics regression using spss
7. logistics regression using spss7. logistics regression using spss
7. logistics regression using spssDr Nisha Arora
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression AnalysisSalim Azad
 
Artifical Intelligence And Machine Learning Algorithum.pptx
Artifical Intelligence And Machine Learning Algorithum.pptxArtifical Intelligence And Machine Learning Algorithum.pptx
Artifical Intelligence And Machine Learning Algorithum.pptxAishwarya SenthilNathan
 
Applications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationshipApplications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationshipRithish Kumar
 
Regression analysis ppt
Regression analysis pptRegression analysis ppt
Regression analysis pptElkana Rorio
 
Logistic regression
Logistic regressionLogistic regression
Logistic regressionDrZahid Khan
 
Machine Learning Unit 3 Semester 3 MSc IT Part 2 Mumbai University
Machine Learning Unit 3 Semester 3  MSc IT Part 2 Mumbai UniversityMachine Learning Unit 3 Semester 3  MSc IT Part 2 Mumbai University
Machine Learning Unit 3 Semester 3 MSc IT Part 2 Mumbai UniversityMadhav Mishra
 
Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...
Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...
Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...Professional Training Academy
 
604_multiplee.ppt
604_multiplee.ppt604_multiplee.ppt
604_multiplee.pptRufesh
 
journal in research
journal in research journal in research
journal in research rikaseorika
 
research journal
research journalresearch journal
research journalrikaseorika
 

Similar to Econometrics chapter 8 (20)

Linear regression
Linear regressionLinear regression
Linear regression
 
Data-Analysis.pptx
Data-Analysis.pptxData-Analysis.pptx
Data-Analysis.pptx
 
A presentation for Multiple linear regression.ppt
A presentation for Multiple linear regression.pptA presentation for Multiple linear regression.ppt
A presentation for Multiple linear regression.ppt
 
A Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptxA Topic on REGRESSION Analysis conducted pptx
A Topic on REGRESSION Analysis conducted pptx
 
7. logistics regression using spss
7. logistics regression using spss7. logistics regression using spss
7. logistics regression using spss
 
Regression Analysis
Regression AnalysisRegression Analysis
Regression Analysis
 
Artifical Intelligence And Machine Learning Algorithum.pptx
Artifical Intelligence And Machine Learning Algorithum.pptxArtifical Intelligence And Machine Learning Algorithum.pptx
Artifical Intelligence And Machine Learning Algorithum.pptx
 
Applications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationshipApplications of regression analysis - Measurement of validity of relationship
Applications of regression analysis - Measurement of validity of relationship
 
Regression analysis ppt
Regression analysis pptRegression analysis ppt
Regression analysis ppt
 
12
1212
12
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
regression.ppt
regression.pptregression.ppt
regression.ppt
 
Machine Learning Unit 3 Semester 3 MSc IT Part 2 Mumbai University
Machine Learning Unit 3 Semester 3  MSc IT Part 2 Mumbai UniversityMachine Learning Unit 3 Semester 3  MSc IT Part 2 Mumbai University
Machine Learning Unit 3 Semester 3 MSc IT Part 2 Mumbai University
 
Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...
Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...
Asset Relationship - CH 8 - Regression | CMT Level 3 | Chartered Market Techn...
 
604_multiplee.ppt
604_multiplee.ppt604_multiplee.ppt
604_multiplee.ppt
 
MF Presentation.pptx
MF Presentation.pptxMF Presentation.pptx
MF Presentation.pptx
 
Log reg pdf.pdf
Log reg pdf.pdfLog reg pdf.pdf
Log reg pdf.pdf
 
journals public
journals publicjournals public
journals public
 
journal in research
journal in research journal in research
journal in research
 
research journal
research journalresearch journal
research journal
 

Recently uploaded

Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfUmakantAnnand
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 

Recently uploaded (20)

Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.Compdf
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini  Delhi NCR9953330565 Low Rate Call Girls In Rohini  Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
 

Econometrics chapter 8

  • 1. CHAPTER 8: MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF INFERENCE Course: ADVANCED QUANTITATIVE TECHNIQUES Instructor: DR. REHANA KOUSER DEPARTMENT OF COMMERCE, B. Z. UNIVERSITY, MULTAN-PAKISTAN
  • 3. CHAPTER OUTLINE 1. Testing hypotheses about an individual partial regression coefficient 2. Testing the overall significance of the estimated multiple regression model, that is, finding out if all the partial slope coefficients are simultaneously equal to zero 3. Testing that two or more coefficients are equal to one another 4. Testing that the partial regression coefficients satisfy certain restrictions 5. Testing the stability of the estimated regression model over time or in different crosssectional units 6. 6. Testing the functional form of regression models
  • 4. HYPOTHESIS TESTING ABOUT INDIVIDUAL REGRESSION COEFFICIENTS The null hypothesis states that, with X3 held constant, X2 has no influence on Y. We follow same two approaches to test these hypotheses: • First: Confidence Interval Approach • Second: Test of Significance Approach
  • 5. TESTING THE OVERALL SIGNIFICANCE OF THE SAMPLE REGRESSION This null hypothesis is a joint hypothesis that β2 and β3 are jointly or simultaneously equal to zero. A test of such a hypothesis is called a test of the overall significance of the observed or estimated regression line, that is, whether Yis linearly related to both X2 and X3. There are two approaches to test this kind of situation: • ANOVA Approach • Using R square Approach
  • 8. RELATIONSHIP BETWEEN F AND R SQUARE
  • 9. THE “INCREMENTAL” OR “MARGINAL” CONTRIBUTION OF AN EXPLANATORY VARIABLE • By contribution we mean whether the addition of the variable to the model increases ESS (and hence R2) “significantly” in relation to the RSS. This contribution may appropriately be called the incremental, or marginal, contribution of an explanatory variable.
  • 10. WHEN TO ADD NEW VARIABLE(S)? When to add new variable? • A formal method of deciding whether a variable should be added to a regression model. Often researchers are faced with the task of choosing from several competing models involving the same dependent variable but with different explanatory variables. • Therefore, if the inclusion of a variable increases R¯ 2, it is retained in the model although it does not reduce RSS significantly in the statistical sense. When to Add a Group of Variables? • If adding (dropping) a group of variables to the model gives an F value greater (less) than 1, R2 will increase (decrease). One can easily find out whether the addition (subtraction) of a group of variables significantly increases (decreases) the explanatory power of a regression model.
  • 11. TESTING THE EQUALITY OF TWO REGRESSION COEFFICIENTS
  • 15. TESTING FOR STRUCTURAL OR PARAMETER STABILITY OF REGRESSION MODELS: THE CHOW TEST • When we use a regression model involving time series data, it may happen that there is a structural change in the relationship between the regressand Y and the regressors.
  • 17. TESTING THE FUNCTIONAL FORM OF REGRESSION: CHOOSING BETWEEN LINEAR AND LOG–LINEAR REGRESSION MODELS • The choice between a linear regression model (the regressand is a linear function of the regressors) or a log–linear regression model (the log of the regressand is a function of the logs of the regressors) is a perennial question in empirical analysis. We can use a test proposed by MacKinnon, White, and Davidson, which for brevity we call the MWD test, to choose between the two models.
  • 18. TESTING THE FUNCTIONAL FORM OF REGRESSION: CHOOSING BETWEEN LINEAR AND LOG–LINEAR REGRESSION MODELS
  • 19. TESTING THE FUNCTIONAL FORM OF REGRESSION: CHOOSING BETWEEN LINEAR AND LOG–LINEAR REGRESSION MODELS • If the linear model is in fact the correct model, the constructed variable Z1 should not be statistically significant in Step IV, for in that case the estimated Y values from the linear model and those estimated from the log–linear model (after taking their antilog values for comparative purposes) should not be different. The same comment applies to the alternative hypothesis H1.