SlideShare a Scribd company logo
1 of 11
Introductionto
Regression
Copyright © Cognitior www.cognitior.com
Copyright © Cognitior www.cognitior.com
Regression–AnIntuition
Experience
Salary
𝑦 = 𝛽0 + 𝛽1 𝑋1 + 𝜀
Difference
Copyright © Cognitior www.cognitior.com
Regression–AnIntuition
Experience
Salary
𝑦
𝑦
Experience
Salary
Copyright © Cognitior www.cognitior.com
Regression–AnIntuition
𝑬𝒙𝒑𝒆𝒓𝒊𝒆𝒏𝒄𝒆
2
3
4
𝑺𝒂𝒍𝒂𝒓𝒚 (𝒚)
10000
13000
14500
𝑨𝒗𝒈 𝑺𝒂𝒍𝒂𝒓𝒚
12500
12500
12500
𝑺 − 𝑺𝑨𝒗𝒈
-2500
500
2000
(𝑺 − 𝑺𝑨𝒗𝒈) 𝟐
SST – Sum Squared Total
6250000
250000
4000000
𝒚 = 𝟐𝟐𝟓𝟎 ∗ 𝑬𝒙𝒑𝒆𝒓𝒊𝒆𝒏𝒄𝒆 + 𝟓𝟕𝟓𝟎
10250
12500
14750
𝒚 − 𝒚
-250
500
250
(𝒚 − 𝒚) 𝟐
SSE - Sum Squared errors
62500
250000
62500
𝑅2
= 1 −
𝑆𝑆𝐸
𝑆𝑆𝑇
1,05,00,000 3,75,000
𝑅2
= 1 −
375000
10500000
= 96.42
Copyright © Cognitior www.cognitior.com
Assumptions–Linear
Experience
Salary
Experience
Salary
Copyright © Cognitior www.cognitior.com
Assumptions–NoHeteroscedasticity
Experience
Salary
Experience
Salary
Copyright © Cognitior www.cognitior.com
NoHeteroscedasticity-Solution
• Remove the outliers
• Transform the data
• Square root transformation
• Cube root transformation
• Log transformation
Copyright © Cognitior www.cognitior.com
Assumptions–NoAutocorrelation
Experience
Salary
Experience
Salary
Copyright © Cognitior www.cognitior.com
Assumptions–NoMulticollinearity
Age
Salary
Experience
Salary
Experience
Age
Copyright © Cognitior www.cognitior.com
NoMulticollinearity-Solution
• Remove one of the correlated variable
• Variance inflation factor
• Any variable with VIF more than 5
ThankYou!!!
AnyQuestions?
support@cognitior.com
Copyright © Cognitior www.cognitior.com

More Related Content

Similar to Regression intuition

Project green buildings (be)
Project green buildings (be)Project green buildings (be)
Project green buildings (be)husein
 
Discovering Branching Conditions from Business Process Execution Logs
Discovering Branching Conditions from Business Process Execution LogsDiscovering Branching Conditions from Business Process Execution Logs
Discovering Branching Conditions from Business Process Execution LogsMarlon Dumas
 
170902 entrepreneurial economics1
170902 entrepreneurial economics1170902 entrepreneurial economics1
170902 entrepreneurial economics1Ryosuke Ishii
 
CVPR2016 Fitting Surface Models to Data 抜粋
CVPR2016 Fitting Surface Models to Data 抜粋CVPR2016 Fitting Surface Models to Data 抜粋
CVPR2016 Fitting Surface Models to Data 抜粋sumisumith
 
lecture 5 courseII (6).pptx
lecture 5 courseII (6).pptxlecture 5 courseII (6).pptx
lecture 5 courseII (6).pptxAYMENGOODKid
 
Estimation, Approximation and Standard form
Estimation, Approximation and Standard formEstimation, Approximation and Standard form
Estimation, Approximation and Standard formNsomp
 
Scaling and Units of Measurement
Scaling and Units of MeasurementScaling and Units of Measurement
Scaling and Units of MeasurementBharathiviji
 
Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...
Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...
Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...IJRES Journal
 
Home Work; Chapter 9; Inventory Policy Decisions
Home Work; Chapter 9; Inventory Policy DecisionsHome Work; Chapter 9; Inventory Policy Decisions
Home Work; Chapter 9; Inventory Policy DecisionsShaheen Sardar
 
PO_groupVI_Term assignment.pptx
PO_groupVI_Term assignment.pptxPO_groupVI_Term assignment.pptx
PO_groupVI_Term assignment.pptxPATELPUNIT2
 
COAT3 Endterm SW1 Solns1
COAT3 Endterm SW1 Solns1COAT3 Endterm SW1 Solns1
COAT3 Endterm SW1 Solns1Mikee Bylss
 
Hai Le book for anoher kjajkkjafakaklalao
Hai Le book for anoher kjajkkjafakaklalaoHai Le book for anoher kjajkkjafakaklalao
Hai Le book for anoher kjajkkjafakaklalaossusercb1db2
 
Fixed Asset Expenditure PowerPoint Presentation Slides
Fixed Asset Expenditure PowerPoint Presentation Slides Fixed Asset Expenditure PowerPoint Presentation Slides
Fixed Asset Expenditure PowerPoint Presentation Slides SlideTeam
 

Similar to Regression intuition (18)

Project green buildings (be)
Project green buildings (be)Project green buildings (be)
Project green buildings (be)
 
Discovering Branching Conditions from Business Process Execution Logs
Discovering Branching Conditions from Business Process Execution LogsDiscovering Branching Conditions from Business Process Execution Logs
Discovering Branching Conditions from Business Process Execution Logs
 
Lecture 04 som 26.02.2021
Lecture 04 som 26.02.2021Lecture 04 som 26.02.2021
Lecture 04 som 26.02.2021
 
170902 entrepreneurial economics1
170902 entrepreneurial economics1170902 entrepreneurial economics1
170902 entrepreneurial economics1
 
CVPR2016 Fitting Surface Models to Data 抜粋
CVPR2016 Fitting Surface Models to Data 抜粋CVPR2016 Fitting Surface Models to Data 抜粋
CVPR2016 Fitting Surface Models to Data 抜粋
 
lecture 5 courseII (6).pptx
lecture 5 courseII (6).pptxlecture 5 courseII (6).pptx
lecture 5 courseII (6).pptx
 
Estimation, Approximation and Standard form
Estimation, Approximation and Standard formEstimation, Approximation and Standard form
Estimation, Approximation and Standard form
 
XVA
XVAXVA
XVA
 
Chapter002math
Chapter002mathChapter002math
Chapter002math
 
Scaling and Units of Measurement
Scaling and Units of MeasurementScaling and Units of Measurement
Scaling and Units of Measurement
 
Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...
Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...
Mx/G(a,b)/1 With Modified Vacation, Variant Arrival Rate With Restricted Admi...
 
LectureSlides3.pdf
LectureSlides3.pdfLectureSlides3.pdf
LectureSlides3.pdf
 
Home Work; Chapter 9; Inventory Policy Decisions
Home Work; Chapter 9; Inventory Policy DecisionsHome Work; Chapter 9; Inventory Policy Decisions
Home Work; Chapter 9; Inventory Policy Decisions
 
PO_groupVI_Term assignment.pptx
PO_groupVI_Term assignment.pptxPO_groupVI_Term assignment.pptx
PO_groupVI_Term assignment.pptx
 
COAT3 Endterm SW1 Solns1
COAT3 Endterm SW1 Solns1COAT3 Endterm SW1 Solns1
COAT3 Endterm SW1 Solns1
 
Hai Le book for anoher kjajkkjafakaklalao
Hai Le book for anoher kjajkkjafakaklalaoHai Le book for anoher kjajkkjafakaklalao
Hai Le book for anoher kjajkkjafakaklalao
 
Fixed Asset Expenditure PowerPoint Presentation Slides
Fixed Asset Expenditure PowerPoint Presentation Slides Fixed Asset Expenditure PowerPoint Presentation Slides
Fixed Asset Expenditure PowerPoint Presentation Slides
 
Mit2 72s09 lec02 (1)
Mit2 72s09 lec02 (1)Mit2 72s09 lec02 (1)
Mit2 72s09 lec02 (1)
 

More from Rahul Tiwari

Association rule Intuition
Association rule  IntuitionAssociation rule  Intuition
Association rule IntuitionRahul Tiwari
 
Data Science and Basics of Python
Data Science and Basics of PythonData Science and Basics of Python
Data Science and Basics of PythonRahul Tiwari
 
Missing value treatment
Missing value treatmentMissing value treatment
Missing value treatmentRahul Tiwari
 
Clustering intuition
Clustering intuitionClustering intuition
Clustering intuitionRahul Tiwari
 
Why Data visualization and types of charts
Why Data visualization and types of chartsWhy Data visualization and types of charts
Why Data visualization and types of chartsRahul Tiwari
 

More from Rahul Tiwari (8)

Association rule Intuition
Association rule  IntuitionAssociation rule  Intuition
Association rule Intuition
 
Data Science and Basics of Python
Data Science and Basics of PythonData Science and Basics of Python
Data Science and Basics of Python
 
Outlier treatment
Outlier treatmentOutlier treatment
Outlier treatment
 
Missing value treatment
Missing value treatmentMissing value treatment
Missing value treatment
 
Feature scaling
Feature scalingFeature scaling
Feature scaling
 
Encoding
EncodingEncoding
Encoding
 
Clustering intuition
Clustering intuitionClustering intuition
Clustering intuition
 
Why Data visualization and types of charts
Why Data visualization and types of chartsWhy Data visualization and types of charts
Why Data visualization and types of charts
 

Recently uploaded

HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxEsquimalt MFRC
 
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUMDEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUMELOISARIVERA8
 
Diuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdf
Diuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdfDiuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdf
Diuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdfKartik Tiwari
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxDr. Ravikiran H M Gowda
 
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lessonQUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lessonhttgc7rh9c
 
How to Add a Tool Tip to a Field in Odoo 17
How to Add a Tool Tip to a Field in Odoo 17How to Add a Tool Tip to a Field in Odoo 17
How to Add a Tool Tip to a Field in Odoo 17Celine George
 
Ernest Hemingway's For Whom the Bell Tolls
Ernest Hemingway's For Whom the Bell TollsErnest Hemingway's For Whom the Bell Tolls
Ernest Hemingway's For Whom the Bell TollsPallavi Parmar
 
UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024Borja Sotomayor
 
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaPersonalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaEADTU
 
How to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptxHow to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptxCeline George
 
Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...
Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...
Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...EADTU
 
8 Tips for Effective Working Capital Management
8 Tips for Effective Working Capital Management8 Tips for Effective Working Capital Management
8 Tips for Effective Working Capital ManagementMBA Assignment Experts
 
Play hard learn harder: The Serious Business of Play
Play hard learn harder:  The Serious Business of PlayPlay hard learn harder:  The Serious Business of Play
Play hard learn harder: The Serious Business of PlayPooky Knightsmith
 
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdfContoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdfcupulin
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsSandeep D Chaudhary
 
Andreas Schleicher presents at the launch of What does child empowerment mean...
Andreas Schleicher presents at the launch of What does child empowerment mean...Andreas Schleicher presents at the launch of What does child empowerment mean...
Andreas Schleicher presents at the launch of What does child empowerment mean...EduSkills OECD
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxannathomasp01
 
Michaelis Menten Equation and Estimation Of Vmax and Tmax.pptx
Michaelis Menten Equation and Estimation Of Vmax and Tmax.pptxMichaelis Menten Equation and Estimation Of Vmax and Tmax.pptx
Michaelis Menten Equation and Estimation Of Vmax and Tmax.pptxRugvedSathawane
 
Details on CBSE Compartment Exam.pptx1111
Details on CBSE Compartment Exam.pptx1111Details on CBSE Compartment Exam.pptx1111
Details on CBSE Compartment Exam.pptx1111GangaMaiya1
 
How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17Celine George
 

Recently uploaded (20)

HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUMDEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
 
Diuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdf
Diuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdfDiuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdf
Diuretic, Hypoglycemic and Limit test of Heavy metals and Arsenic.-1.pdf
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lessonQUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
QUATER-1-PE-HEALTH-LC2- this is just a sample of unpacked lesson
 
How to Add a Tool Tip to a Field in Odoo 17
How to Add a Tool Tip to a Field in Odoo 17How to Add a Tool Tip to a Field in Odoo 17
How to Add a Tool Tip to a Field in Odoo 17
 
Ernest Hemingway's For Whom the Bell Tolls
Ernest Hemingway's For Whom the Bell TollsErnest Hemingway's For Whom the Bell Tolls
Ernest Hemingway's For Whom the Bell Tolls
 
UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024
 
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaPersonalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
 
How to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptxHow to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptx
 
Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...
Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...
Transparency, Recognition and the role of eSealing - Ildiko Mazar and Koen No...
 
8 Tips for Effective Working Capital Management
8 Tips for Effective Working Capital Management8 Tips for Effective Working Capital Management
8 Tips for Effective Working Capital Management
 
Play hard learn harder: The Serious Business of Play
Play hard learn harder:  The Serious Business of PlayPlay hard learn harder:  The Serious Business of Play
Play hard learn harder: The Serious Business of Play
 
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdfContoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Andreas Schleicher presents at the launch of What does child empowerment mean...
Andreas Schleicher presents at the launch of What does child empowerment mean...Andreas Schleicher presents at the launch of What does child empowerment mean...
Andreas Schleicher presents at the launch of What does child empowerment mean...
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 
Michaelis Menten Equation and Estimation Of Vmax and Tmax.pptx
Michaelis Menten Equation and Estimation Of Vmax and Tmax.pptxMichaelis Menten Equation and Estimation Of Vmax and Tmax.pptx
Michaelis Menten Equation and Estimation Of Vmax and Tmax.pptx
 
Details on CBSE Compartment Exam.pptx1111
Details on CBSE Compartment Exam.pptx1111Details on CBSE Compartment Exam.pptx1111
Details on CBSE Compartment Exam.pptx1111
 
How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17
 

Regression intuition

  • 2. Copyright © Cognitior www.cognitior.com Regression–AnIntuition Experience Salary 𝑦 = 𝛽0 + 𝛽1 𝑋1 + 𝜀 Difference
  • 3. Copyright © Cognitior www.cognitior.com Regression–AnIntuition Experience Salary 𝑦 𝑦 Experience Salary
  • 4. Copyright © Cognitior www.cognitior.com Regression–AnIntuition 𝑬𝒙𝒑𝒆𝒓𝒊𝒆𝒏𝒄𝒆 2 3 4 𝑺𝒂𝒍𝒂𝒓𝒚 (𝒚) 10000 13000 14500 𝑨𝒗𝒈 𝑺𝒂𝒍𝒂𝒓𝒚 12500 12500 12500 𝑺 − 𝑺𝑨𝒗𝒈 -2500 500 2000 (𝑺 − 𝑺𝑨𝒗𝒈) 𝟐 SST – Sum Squared Total 6250000 250000 4000000 𝒚 = 𝟐𝟐𝟓𝟎 ∗ 𝑬𝒙𝒑𝒆𝒓𝒊𝒆𝒏𝒄𝒆 + 𝟓𝟕𝟓𝟎 10250 12500 14750 𝒚 − 𝒚 -250 500 250 (𝒚 − 𝒚) 𝟐 SSE - Sum Squared errors 62500 250000 62500 𝑅2 = 1 − 𝑆𝑆𝐸 𝑆𝑆𝑇 1,05,00,000 3,75,000 𝑅2 = 1 − 375000 10500000 = 96.42
  • 5. Copyright © Cognitior www.cognitior.com Assumptions–Linear Experience Salary Experience Salary
  • 6. Copyright © Cognitior www.cognitior.com Assumptions–NoHeteroscedasticity Experience Salary Experience Salary
  • 7. Copyright © Cognitior www.cognitior.com NoHeteroscedasticity-Solution • Remove the outliers • Transform the data • Square root transformation • Cube root transformation • Log transformation
  • 8. Copyright © Cognitior www.cognitior.com Assumptions–NoAutocorrelation Experience Salary Experience Salary
  • 9. Copyright © Cognitior www.cognitior.com Assumptions–NoMulticollinearity Age Salary Experience Salary Experience Age
  • 10. Copyright © Cognitior www.cognitior.com NoMulticollinearity-Solution • Remove one of the correlated variable • Variance inflation factor • Any variable with VIF more than 5