SlideShare a Scribd company logo
Muhammad Ali
Lecturer in Statistics
GPGC Mardan.
1
Autocorrelation
Definition
The classical assumptions in the linear regression are that the errors terms i have zero mean and
constant variance and are uncorrelated [E( i) = 0, Var( i) = δ2
, and E( i 	j ) = 0 ]. For the
construction of Confidence Interval, and Testing of hypothesis about the regression coefficients
we add the assumption of normality. so that i are NID(0, δ2
). Some applications of regression
involve regressor and response variables that have a natural sequential order over time. Such data
are called time series data. Regression models using time series data occur relatively often in
economics, business, and some fields of engineering. The assumption of uncorrelated or
independent errors for time series data is often not appropriate. Usually the errors in time series
data exhibit serial correlation, that is, E( i 	j ) ≠ 0. Such error terms are said to be
autocorrelated. Autocorrelation sometimes called "lagged correlation or "serial correlation".
Causes of Autocorrelation
Specification Bias:
a) Excluded Variables Case
There are several causes of autocorrelation. Perhaps the primary cause of
autocorrelation in regression problems involving time series data is failure to include one
or more important regressors in the model. For example suppose that we wish to regress
Muhammad Ali
Lecturer in Statistics
GPGC Mardan.
2
annual sales of a soft drink company against the annual advertising expenditure for that
product. Now the growth in population over the period of time used in the study will also
influence the product sales. If population size is not included in the model, this may cause
the errors in the model to be positively autocorrelated, because population size is
positively correlated with product sales.
Consider the true model:
Sale (Yt) = β0 + β1X1t + β2X2t + εt ---------------------- ( I )
Where Y is the sale, X1 is the advertising expenditure, X2 is the population size.
However for some reason we run the following regression:
Sale (Yt) = β0 + β1X1t + υt ---------------------- ( II )
As model ( I ) is a true model and we run model ( II ), and hence the error or disturbance
term υ will be autocorrelated.
b) Incorrect Functional Form:
Consider the following cost and output model:
Yt = β1 + β2 X1 + β3 X2
2
+ υt
Muhammad Ali
Lecturer in Statistics
GPGC Mardan.
3
Instead of using the above form which is considered to be correct, if we fit the
following model:
Yt = β1 + β2 X1 + β3 X2 + υt
In this case, υ will reflect autocorrelation because of the use of an incorrect
functional form.
Theoretical consequences of autocorrelation
The presence of autocorrelation in the errors has several effects on the ordinary least-squares
regression procedures. These are summarized as follows:
1. Ordinary least-squares regression coefficients are still unbiased.
2. OLS regression coefficients are no longer efficient i..e. they are no longer minimum
variance estimates. We say that these estimates are inefficient.
3. The residual mean square MSres may seriously underestimate δ2
. Consequently, the
standard errors of the regression coefficients may be too small. Thus, confidence intervals
are shorter than they really should be, and tests of hypothesis on individual regression
coefficients may indicate that one or more regression contribute significantly to the
model when they really do not. Generally, underestimating δ2
gives the researcher a false
impression of accuracy.
4. The confidence intervals and tests of hypothesis based on the t and F distributions are no
longer appropriate.
Muhammad Ali
Lecturer in Statistics
GPGC Mardan.
4
OLS estimates in presence of autocorrelation
There are three main consequences of autocorrelation on the ordinary least squares estimates.
1. Ordinary least squares regression coefficients are still unbiased even if the disturbance
term is autocorrelated. i.e.
We know that
( )
( ) ( )
( )
εβ
εβ
εβ
εβεβ
β
XXX
XXXI
XXXXXXX
XYXXXX
YXXX
′′+=
′′+=
′′+′′=
+=∴+′′=
′′=
−
−
−−
−
−
1
1
11
1
1
)(
)(
)()(
ˆ
Taking expectation on both sides of the above equation #1, assuming that E(ε) = 0 i.e.
β
β
εββ
=
+=
′+= −
0
)()()ˆ( 1
XEXXE
Hence in the presence of autocorrelation the OLS estimates are still unbiased.

More Related Content

What's hot

Heteroscedasticity
HeteroscedasticityHeteroscedasticity
Heteroscedasticity
Muhammad Ali
 
Heteroscedasticity | Eonomics
Heteroscedasticity | EonomicsHeteroscedasticity | Eonomics
Heteroscedasticity | Eonomics
Transweb Global Inc
 
Heteroskedasticity
HeteroskedasticityHeteroskedasticity
Heteroskedasticityhalimuth
 
Autocorrelation
AutocorrelationAutocorrelation
Autocorrelation
ADITHYAT1
 
Basic concepts of_econometrics
Basic concepts of_econometricsBasic concepts of_econometrics
Basic concepts of_econometrics
SwapnaJahan
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
Pawan Kawan
 
Autocorrelation- Detection- part 1- Durbin-Watson d test
Autocorrelation- Detection- part 1- Durbin-Watson d testAutocorrelation- Detection- part 1- Durbin-Watson d test
Autocorrelation- Detection- part 1- Durbin-Watson d test
Shilpa Chaudhary
 
Auto Correlation Presentation
Auto Correlation PresentationAuto Correlation Presentation
Auto Correlation Presentation
Irfan Hussain
 
Dummy variable
Dummy variableDummy variable
Dummy variableAkram Ali
 
Econometrics lecture 1st
Econometrics lecture 1stEconometrics lecture 1st
Econometrics lecture 1stIshaq Ahmad
 
Econometrics ch2
Econometrics ch2Econometrics ch2
Econometrics ch2
Baterdene Batchuluun
 
Heteroscedasticity Remedial Measures.pptx
Heteroscedasticity Remedial Measures.pptxHeteroscedasticity Remedial Measures.pptx
Heteroscedasticity Remedial Measures.pptx
PatilDevendra5
 
Heteroscedasticity
HeteroscedasticityHeteroscedasticity
Heteroscedasticity
Madurai Kamaraj University
 
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
Sajid Ali Khan
 
Econometrics
EconometricsEconometrics
Econometrics
GarimaGupta229
 
Ols
OlsOls
Basic econometrics lectues_1
Basic econometrics lectues_1Basic econometrics lectues_1
Basic econometrics lectues_1
Nivedita Sharma
 
Overview of econometrics 1
Overview of econometrics 1Overview of econometrics 1
Overview of econometrics 1
Emeni Joshua
 
Multicollinearity
MulticollinearityMulticollinearity
Multicollinearity
Bernard Asia
 
Eco Basic 1 8
Eco Basic 1 8Eco Basic 1 8
Eco Basic 1 8kit11229
 

What's hot (20)

Heteroscedasticity
HeteroscedasticityHeteroscedasticity
Heteroscedasticity
 
Heteroscedasticity | Eonomics
Heteroscedasticity | EonomicsHeteroscedasticity | Eonomics
Heteroscedasticity | Eonomics
 
Heteroskedasticity
HeteroskedasticityHeteroskedasticity
Heteroskedasticity
 
Autocorrelation
AutocorrelationAutocorrelation
Autocorrelation
 
Basic concepts of_econometrics
Basic concepts of_econometricsBasic concepts of_econometrics
Basic concepts of_econometrics
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
 
Autocorrelation- Detection- part 1- Durbin-Watson d test
Autocorrelation- Detection- part 1- Durbin-Watson d testAutocorrelation- Detection- part 1- Durbin-Watson d test
Autocorrelation- Detection- part 1- Durbin-Watson d test
 
Auto Correlation Presentation
Auto Correlation PresentationAuto Correlation Presentation
Auto Correlation Presentation
 
Dummy variable
Dummy variableDummy variable
Dummy variable
 
Econometrics lecture 1st
Econometrics lecture 1stEconometrics lecture 1st
Econometrics lecture 1st
 
Econometrics ch2
Econometrics ch2Econometrics ch2
Econometrics ch2
 
Heteroscedasticity Remedial Measures.pptx
Heteroscedasticity Remedial Measures.pptxHeteroscedasticity Remedial Measures.pptx
Heteroscedasticity Remedial Measures.pptx
 
Heteroscedasticity
HeteroscedasticityHeteroscedasticity
Heteroscedasticity
 
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
 
Econometrics
EconometricsEconometrics
Econometrics
 
Ols
OlsOls
Ols
 
Basic econometrics lectues_1
Basic econometrics lectues_1Basic econometrics lectues_1
Basic econometrics lectues_1
 
Overview of econometrics 1
Overview of econometrics 1Overview of econometrics 1
Overview of econometrics 1
 
Multicollinearity
MulticollinearityMulticollinearity
Multicollinearity
 
Eco Basic 1 8
Eco Basic 1 8Eco Basic 1 8
Eco Basic 1 8
 

Similar to Autocorrelation

Ali, Redescending M-estimator
Ali, Redescending M-estimator Ali, Redescending M-estimator
Ali, Redescending M-estimator
Muhammad Ali
 
Econometrics
EconometricsEconometrics
Econometrics
Stephanie King
 
Multiple Regression.ppt
Multiple Regression.pptMultiple Regression.ppt
Multiple Regression.ppt
TanyaWadhwani4
 
Degree exam 2019 q & a (1) (1)
Degree exam 2019 q & a (1) (1)Degree exam 2019 q & a (1) (1)
Degree exam 2019 q & a (1) (1)
OsamaKhan404075
 
Classification methods and assessment
Classification methods and assessmentClassification methods and assessment
Classification methods and assessment
Leonardo Auslender
 
Econometrics_ch13.ppt
Econometrics_ch13.pptEconometrics_ch13.ppt
Econometrics_ch13.ppt
ABDULAI3
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
Shiraz316
 
Distribution of EstimatesLinear Regression ModelAssume (yt,.docx
Distribution of EstimatesLinear Regression ModelAssume (yt,.docxDistribution of EstimatesLinear Regression ModelAssume (yt,.docx
Distribution of EstimatesLinear Regression ModelAssume (yt,.docx
madlynplamondon
 
Classification methods and assessment.pdf
Classification methods and assessment.pdfClassification methods and assessment.pdf
Classification methods and assessment.pdf
Leonardo Auslender
 
Chapter 07 - Autocorrelation.pptx
Chapter 07 - Autocorrelation.pptxChapter 07 - Autocorrelation.pptx
Chapter 07 - Autocorrelation.pptx
Farah Amir
 
Classification methods and assessment
Classification methods and assessmentClassification methods and assessment
Classification methods and assessment
Leonardo Auslender
 
Graphical Analysis of Simulated Financial Data Using R
Graphical Analysis of Simulated Financial Data Using RGraphical Analysis of Simulated Financial Data Using R
Graphical Analysis of Simulated Financial Data Using R
IRJET Journal
 
Supervised learning - Linear and Logistic Regression( AI, ML)
Supervised learning - Linear and Logistic Regression( AI, ML)Supervised learning - Linear and Logistic Regression( AI, ML)
Supervised learning - Linear and Logistic Regression( AI, ML)
Rahul Pal
 
Operations Management VTU BE Mechanical 2015 Solved paper
Operations Management VTU BE Mechanical 2015 Solved paperOperations Management VTU BE Mechanical 2015 Solved paper
Operations Management VTU BE Mechanical 2015 Solved paper
Somashekar S.M
 
Findings, Conclusions, & RecommendationsReport Writing
Findings, Conclusions, & RecommendationsReport WritingFindings, Conclusions, & RecommendationsReport Writing
Findings, Conclusions, & RecommendationsReport Writing
ShainaBoling829
 
Modelling the expected loss of bodily injury claims using gradient boosting
Modelling the expected loss of bodily injury claims using gradient boostingModelling the expected loss of bodily injury claims using gradient boosting
Modelling the expected loss of bodily injury claims using gradient boosting
Gregg Barrett
 
Chap011
Chap011Chap011
Demand estimation and forecasting
Demand estimation and forecastingDemand estimation and forecasting
Demand estimation and forecasting
shivraj negi
 
Sarcia idoese08
Sarcia idoese08Sarcia idoese08
Sarcia idoese08asarcia
 
Using Binary Logistic Analysis for Analyzing Bankruptcy
Using Binary Logistic Analysis for Analyzing BankruptcyUsing Binary Logistic Analysis for Analyzing Bankruptcy
Using Binary Logistic Analysis for Analyzing Bankruptcy
International Journal of Business Marketing and Management (IJBMM)
 

Similar to Autocorrelation (20)

Ali, Redescending M-estimator
Ali, Redescending M-estimator Ali, Redescending M-estimator
Ali, Redescending M-estimator
 
Econometrics
EconometricsEconometrics
Econometrics
 
Multiple Regression.ppt
Multiple Regression.pptMultiple Regression.ppt
Multiple Regression.ppt
 
Degree exam 2019 q & a (1) (1)
Degree exam 2019 q & a (1) (1)Degree exam 2019 q & a (1) (1)
Degree exam 2019 q & a (1) (1)
 
Classification methods and assessment
Classification methods and assessmentClassification methods and assessment
Classification methods and assessment
 
Econometrics_ch13.ppt
Econometrics_ch13.pptEconometrics_ch13.ppt
Econometrics_ch13.ppt
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Distribution of EstimatesLinear Regression ModelAssume (yt,.docx
Distribution of EstimatesLinear Regression ModelAssume (yt,.docxDistribution of EstimatesLinear Regression ModelAssume (yt,.docx
Distribution of EstimatesLinear Regression ModelAssume (yt,.docx
 
Classification methods and assessment.pdf
Classification methods and assessment.pdfClassification methods and assessment.pdf
Classification methods and assessment.pdf
 
Chapter 07 - Autocorrelation.pptx
Chapter 07 - Autocorrelation.pptxChapter 07 - Autocorrelation.pptx
Chapter 07 - Autocorrelation.pptx
 
Classification methods and assessment
Classification methods and assessmentClassification methods and assessment
Classification methods and assessment
 
Graphical Analysis of Simulated Financial Data Using R
Graphical Analysis of Simulated Financial Data Using RGraphical Analysis of Simulated Financial Data Using R
Graphical Analysis of Simulated Financial Data Using R
 
Supervised learning - Linear and Logistic Regression( AI, ML)
Supervised learning - Linear and Logistic Regression( AI, ML)Supervised learning - Linear and Logistic Regression( AI, ML)
Supervised learning - Linear and Logistic Regression( AI, ML)
 
Operations Management VTU BE Mechanical 2015 Solved paper
Operations Management VTU BE Mechanical 2015 Solved paperOperations Management VTU BE Mechanical 2015 Solved paper
Operations Management VTU BE Mechanical 2015 Solved paper
 
Findings, Conclusions, & RecommendationsReport Writing
Findings, Conclusions, & RecommendationsReport WritingFindings, Conclusions, & RecommendationsReport Writing
Findings, Conclusions, & RecommendationsReport Writing
 
Modelling the expected loss of bodily injury claims using gradient boosting
Modelling the expected loss of bodily injury claims using gradient boostingModelling the expected loss of bodily injury claims using gradient boosting
Modelling the expected loss of bodily injury claims using gradient boosting
 
Chap011
Chap011Chap011
Chap011
 
Demand estimation and forecasting
Demand estimation and forecastingDemand estimation and forecasting
Demand estimation and forecasting
 
Sarcia idoese08
Sarcia idoese08Sarcia idoese08
Sarcia idoese08
 
Using Binary Logistic Analysis for Analyzing Bankruptcy
Using Binary Logistic Analysis for Analyzing BankruptcyUsing Binary Logistic Analysis for Analyzing Bankruptcy
Using Binary Logistic Analysis for Analyzing Bankruptcy
 

Recently uploaded

Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
PedroFerreira53928
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
Vivekanand Anglo Vedic Academy
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
Vikramjit Singh
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
Celine George
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
GeoBlogs
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 

Recently uploaded (20)

Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17How to Make a Field invisible in Odoo 17
How to Make a Field invisible in Odoo 17
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 

Autocorrelation

  • 1. Muhammad Ali Lecturer in Statistics GPGC Mardan. 1 Autocorrelation Definition The classical assumptions in the linear regression are that the errors terms i have zero mean and constant variance and are uncorrelated [E( i) = 0, Var( i) = δ2 , and E( i j ) = 0 ]. For the construction of Confidence Interval, and Testing of hypothesis about the regression coefficients we add the assumption of normality. so that i are NID(0, δ2 ). Some applications of regression involve regressor and response variables that have a natural sequential order over time. Such data are called time series data. Regression models using time series data occur relatively often in economics, business, and some fields of engineering. The assumption of uncorrelated or independent errors for time series data is often not appropriate. Usually the errors in time series data exhibit serial correlation, that is, E( i j ) ≠ 0. Such error terms are said to be autocorrelated. Autocorrelation sometimes called "lagged correlation or "serial correlation". Causes of Autocorrelation Specification Bias: a) Excluded Variables Case There are several causes of autocorrelation. Perhaps the primary cause of autocorrelation in regression problems involving time series data is failure to include one or more important regressors in the model. For example suppose that we wish to regress
  • 2. Muhammad Ali Lecturer in Statistics GPGC Mardan. 2 annual sales of a soft drink company against the annual advertising expenditure for that product. Now the growth in population over the period of time used in the study will also influence the product sales. If population size is not included in the model, this may cause the errors in the model to be positively autocorrelated, because population size is positively correlated with product sales. Consider the true model: Sale (Yt) = β0 + β1X1t + β2X2t + εt ---------------------- ( I ) Where Y is the sale, X1 is the advertising expenditure, X2 is the population size. However for some reason we run the following regression: Sale (Yt) = β0 + β1X1t + υt ---------------------- ( II ) As model ( I ) is a true model and we run model ( II ), and hence the error or disturbance term υ will be autocorrelated. b) Incorrect Functional Form: Consider the following cost and output model: Yt = β1 + β2 X1 + β3 X2 2 + υt
  • 3. Muhammad Ali Lecturer in Statistics GPGC Mardan. 3 Instead of using the above form which is considered to be correct, if we fit the following model: Yt = β1 + β2 X1 + β3 X2 + υt In this case, υ will reflect autocorrelation because of the use of an incorrect functional form. Theoretical consequences of autocorrelation The presence of autocorrelation in the errors has several effects on the ordinary least-squares regression procedures. These are summarized as follows: 1. Ordinary least-squares regression coefficients are still unbiased. 2. OLS regression coefficients are no longer efficient i..e. they are no longer minimum variance estimates. We say that these estimates are inefficient. 3. The residual mean square MSres may seriously underestimate δ2 . Consequently, the standard errors of the regression coefficients may be too small. Thus, confidence intervals are shorter than they really should be, and tests of hypothesis on individual regression coefficients may indicate that one or more regression contribute significantly to the model when they really do not. Generally, underestimating δ2 gives the researcher a false impression of accuracy. 4. The confidence intervals and tests of hypothesis based on the t and F distributions are no longer appropriate.
  • 4. Muhammad Ali Lecturer in Statistics GPGC Mardan. 4 OLS estimates in presence of autocorrelation There are three main consequences of autocorrelation on the ordinary least squares estimates. 1. Ordinary least squares regression coefficients are still unbiased even if the disturbance term is autocorrelated. i.e. We know that ( ) ( ) ( ) ( ) εβ εβ εβ εβεβ β XXX XXXI XXXXXXX XYXXXX YXXX ′′+= ′′+= ′′+′′= +=∴+′′= ′′= − − −− − − 1 1 11 1 1 )( )( )()( ˆ Taking expectation on both sides of the above equation #1, assuming that E(ε) = 0 i.e. β β εββ = += ′+= − 0 )()()ˆ( 1 XEXXE Hence in the presence of autocorrelation the OLS estimates are still unbiased.