SlideShare a Scribd company logo
Polynomial Regression
GROUP MEMBERS
Naveed Irshad (042)
Waleed Ishaq (007)
Ali Khan (039)
Abid Shehzad (041)
Rubab Rafique ()
Asma Kishwar ()
Contents
• Definition
• Why we use polynomial Regression
• History
• Regression Model
• Matrix Form
• Matlab Code
• Advantages
• Disadvantages
• Conclusion
Polynomial Regression
Defination:
Polynomial regression is a form of linear regression in which the relationship
between the independent variable x and the dependent variable y is modelled
as an nth degree polynomial.
Why we use polynomial regression
• There are three main situations that indicate a linear relationship may not
be a good model.
• 1. Most important is the theoretical one. There are some relationships that
a researcher will hypothesize is curvilinear. Clearly, if this is the case, include
a polynomial term.
Why we use polynomial regression
• 2.The second chance is during visual inspection of your variables. This is
one of those reasons for always doing univariate and bivariate inspections of
your data before you begin your regression analyses. A simple scatter plot
can reveal a curvilinear relationship.
Why we use polynomial regression
•3. Inspection of residuals. If you try to fit a linear model
to curved data, a scatterplot of residuals (Y axis) on the
predictor (X axis) will have patches of many positive
residuals in the middle. This is a good sign that a linear
model is not appropriate, and a polynomial may do
better.
History
• The first design of an experiment for polynomial regression appeared in an
1815 paper of Gergonne.
• In the twentieth century, polynomial regression played an important role in
the development of regression analysis, with a greater emphasis on issues
of design and inference.
• More recently, the use of polynomial models has been complemented by
other methods, with non-polynomial models having advantages for some
classes of problems.
A cubic polynomial regression fit to a simulated data set.The confidence
band is a 95% simultaneous confidence band constructed using
the Scheffé approach.
Regression Model
linear regression
Model
Quadratic model
General polynomial
Regression Model
Matrix form
• Polynomial regression model
• Matrix
Objective Of Polynomial regression:
•How matlabs handle Polynomial.
•POLVAL to evaluate Polynomial.
•POLFIT to generate Polynomial trendline.
•Plotting Polynomial trendline with data using
commands.
Q:How we implement Polynomial regression
(Linear) Functions in Matlab?
• Matlab code:
• In matlab code where m is Nth order of polynomial i.e 2,3,4……..n
• P=[1 5 10 20 40 60 100 200 400 700];
• T=[-36.7 19.6 -11.5 -2.6 7.6 15.4 26.1 42.2 60.6 80.1];
• m=3;
• E=polyfit(T,P,m);
• Z=polyval(E,T);
• norm(P-Z);
• n=length(P);
• rms=norm(P-Z)/sqrt(n)
• E
• plot(T,Z,'o',T,P,'K')
Polynomial Regression in Matlab
Now when we will change the value of ‘m’ i.e m=7
then rms is decrease and give us Polynomial badly condition….we can see in
below command window…..
Advantages
• The biggest advantage of nonlinear regression over many other
techniques is the broad range of functions that can be fit.
• Polynomials very flexible, and useful where a model must be developed
empirically.
• Polynomial fit a wide range of curvature.
• Polynomial provide a good approximation of the relationship.
• Transformations generally more interpretable, often more easily
interpreted in terms of a possible functional relationship.
Disadvantages
• Disadvantages include a strong sensitivity to outliers.The presence of one
or two outliers in the data can seriously affect the results of a nonlinear
analysis.
• In addition there are unfortunately fewer model validation tools for the
detection of outliers in nonlinear regression than there are for linear
regression.
Conclusion
• Method of Polynomial Regression tell us about ill condion and Well
condition.
• Evaluate the coefficient constants then we have used different
techniques like LU decomposition methon,Guass Elimination method
etc
Polynomial regression

More Related Content

What's hot

Logistic regression
Logistic regressionLogistic regression
Logistic regression
saba khan
 
Linear regression
Linear regressionLinear regression
Linear regression
Tech_MX
 

What's hot (20)

ARIMA
ARIMA ARIMA
ARIMA
 
Linear regression
Linear regressionLinear regression
Linear regression
 
Machine learning session4(linear regression)
Machine learning   session4(linear regression)Machine learning   session4(linear regression)
Machine learning session4(linear regression)
 
Linear regression
Linear regressionLinear regression
Linear regression
 
Pca ppt
Pca pptPca ppt
Pca ppt
 
Linear models for data science
Linear models for data scienceLinear models for data science
Linear models for data science
 
Arima model
Arima modelArima model
Arima model
 
Ridge regression
Ridge regressionRidge regression
Ridge regression
 
Lasso and ridge regression
Lasso and ridge regressionLasso and ridge regression
Lasso and ridge regression
 
Timeseries forecasting
Timeseries forecastingTimeseries forecasting
Timeseries forecasting
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Multiple linear regression
Multiple linear regressionMultiple linear regression
Multiple linear regression
 
What is the Expectation Maximization (EM) Algorithm?
What is the Expectation Maximization (EM) Algorithm?What is the Expectation Maximization (EM) Algorithm?
What is the Expectation Maximization (EM) Algorithm?
 
Simple linear regression and correlation
Simple linear regression and correlationSimple linear regression and correlation
Simple linear regression and correlation
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Logistic regression in Machine Learning
Logistic regression in Machine LearningLogistic regression in Machine Learning
Logistic regression in Machine Learning
 
decision tree regression
decision tree regressiondecision tree regression
decision tree regression
 
Linear regression
Linear regressionLinear regression
Linear regression
 
Reinforcement learning
Reinforcement learning Reinforcement learning
Reinforcement learning
 
Least Squares Regression Method | Edureka
Least Squares Regression Method | EdurekaLeast Squares Regression Method | Edureka
Least Squares Regression Method | Edureka
 

Viewers also liked

Regression analysis ppt
Regression analysis pptRegression analysis ppt
Regression analysis ppt
Elkana Rorio
 
Least square method
Least square methodLeast square method
Least square method
Somya Bagai
 
Machine learning
Machine learningMachine learning
Machine learning
hplap
 
Student engagement as a dynamic and multidimensional concept. Data analysis: ...
Student engagement as a dynamic and multidimensional concept. Data analysis: ...Student engagement as a dynamic and multidimensional concept. Data analysis: ...
Student engagement as a dynamic and multidimensional concept. Data analysis: ...
Aleksandra Lazareva
 
Polynomial identities division
Polynomial identities divisionPolynomial identities division
Polynomial identities division
Ang Choon Cheng
 
Chapt 11 & 12 linear & multiple regression minitab
Chapt 11 & 12 linear &  multiple regression minitabChapt 11 & 12 linear &  multiple regression minitab
Chapt 11 & 12 linear & multiple regression minitab
Boyu Deng
 
The least square method
The least square methodThe least square method
The least square method
kevinlefol
 
09 numerical integration
09 numerical integration09 numerical integration
09 numerical integration
Mohammad Tawfik
 
Probability mass functions and probability density functions
Probability mass functions and probability density functionsProbability mass functions and probability density functions
Probability mass functions and probability density functions
Ankit Katiyar
 
Math1003 1.13 - Significant Digits, Accuracy, Precision
Math1003 1.13 - Significant Digits, Accuracy, PrecisionMath1003 1.13 - Significant Digits, Accuracy, Precision
Math1003 1.13 - Significant Digits, Accuracy, Precision
gcmath1003
 

Viewers also liked (20)

Presentation On Regression
Presentation On RegressionPresentation On Regression
Presentation On Regression
 
Regression analysis ppt
Regression analysis pptRegression analysis ppt
Regression analysis ppt
 
Least square method
Least square methodLeast square method
Least square method
 
Machine learning
Machine learningMachine learning
Machine learning
 
Mathematical modeling
Mathematical modelingMathematical modeling
Mathematical modeling
 
Chapter 14 Part I
Chapter 14 Part IChapter 14 Part I
Chapter 14 Part I
 
Student engagement as a dynamic and multidimensional concept. Data analysis: ...
Student engagement as a dynamic and multidimensional concept. Data analysis: ...Student engagement as a dynamic and multidimensional concept. Data analysis: ...
Student engagement as a dynamic and multidimensional concept. Data analysis: ...
 
Polynomial identities division
Polynomial identities divisionPolynomial identities division
Polynomial identities division
 
Es272 ch5a
Es272 ch5aEs272 ch5a
Es272 ch5a
 
Chapt 11 & 12 linear & multiple regression minitab
Chapt 11 & 12 linear &  multiple regression minitabChapt 11 & 12 linear &  multiple regression minitab
Chapt 11 & 12 linear & multiple regression minitab
 
Polynomial -ppt
Polynomial -pptPolynomial -ppt
Polynomial -ppt
 
Cross-Validation
Cross-ValidationCross-Validation
Cross-Validation
 
The least square method
The least square methodThe least square method
The least square method
 
5 random variables
5 random variables5 random variables
5 random variables
 
Arrays & functions in php
Arrays & functions in phpArrays & functions in php
Arrays & functions in php
 
09 numerical integration
09 numerical integration09 numerical integration
09 numerical integration
 
Probability mass functions and probability density functions
Probability mass functions and probability density functionsProbability mass functions and probability density functions
Probability mass functions and probability density functions
 
07 interpolation
07 interpolation07 interpolation
07 interpolation
 
Gauss jordan
Gauss jordanGauss jordan
Gauss jordan
 
Math1003 1.13 - Significant Digits, Accuracy, Precision
Math1003 1.13 - Significant Digits, Accuracy, PrecisionMath1003 1.13 - Significant Digits, Accuracy, Precision
Math1003 1.13 - Significant Digits, Accuracy, Precision
 

Similar to Polynomial regression

Applied Mathematical Modeling with Apache Solr - Joel Bernstein, Lucidworks
Applied Mathematical Modeling with Apache Solr - Joel Bernstein, LucidworksApplied Mathematical Modeling with Apache Solr - Joel Bernstein, Lucidworks
Applied Mathematical Modeling with Apache Solr - Joel Bernstein, Lucidworks
Lucidworks
 

Similar to Polynomial regression (20)

Two strategies for large-scale multi-label classification on the YouTube-8M d...
Two strategies for large-scale multi-label classification on the YouTube-8M d...Two strategies for large-scale multi-label classification on the YouTube-8M d...
Two strategies for large-scale multi-label classification on the YouTube-8M d...
 
Like-for-Like Comparisons of Machine Learning Algorithms - Dominik Dahlem, Bo...
Like-for-Like Comparisons of Machine Learning Algorithms - Dominik Dahlem, Bo...Like-for-Like Comparisons of Machine Learning Algorithms - Dominik Dahlem, Bo...
Like-for-Like Comparisons of Machine Learning Algorithms - Dominik Dahlem, Bo...
 
CHAPTER 4.1.pdf
CHAPTER 4.1.pdfCHAPTER 4.1.pdf
CHAPTER 4.1.pdf
 
Module-2_ML.pdf
Module-2_ML.pdfModule-2_ML.pdf
Module-2_ML.pdf
 
3. Regression.pdf
3. Regression.pdf3. Regression.pdf
3. Regression.pdf
 
Logistical Regression.pptx
Logistical Regression.pptxLogistical Regression.pptx
Logistical Regression.pptx
 
Matlab
Matlab Matlab
Matlab
 
R meetup lm
R meetup lmR meetup lm
R meetup lm
 
Engineering Numerical Analysis-Introduction.pdf
Engineering Numerical Analysis-Introduction.pdfEngineering Numerical Analysis-Introduction.pdf
Engineering Numerical Analysis-Introduction.pdf
 
General Tips for participating Kaggle Competitions
General Tips for participating Kaggle CompetitionsGeneral Tips for participating Kaggle Competitions
General Tips for participating Kaggle Competitions
 
Applied Mathematical Modeling with Apache Solr - Joel Bernstein, Lucidworks
Applied Mathematical Modeling with Apache Solr - Joel Bernstein, LucidworksApplied Mathematical Modeling with Apache Solr - Joel Bernstein, Lucidworks
Applied Mathematical Modeling with Apache Solr - Joel Bernstein, Lucidworks
 
Regression Analysis.pptx
Regression Analysis.pptxRegression Analysis.pptx
Regression Analysis.pptx
 
Regression Analysis Techniques.pptx
Regression Analysis Techniques.pptxRegression Analysis Techniques.pptx
Regression Analysis Techniques.pptx
 
crossvalidation.pptx
crossvalidation.pptxcrossvalidation.pptx
crossvalidation.pptx
 
QMVC.pptx
QMVC.pptxQMVC.pptx
QMVC.pptx
 
StackNet Meta-Modelling framework
StackNet Meta-Modelling frameworkStackNet Meta-Modelling framework
StackNet Meta-Modelling framework
 
5954987.ppt
5954987.ppt5954987.ppt
5954987.ppt
 
Unit III_Ch 17_Probablistic Methods.pptx
Unit III_Ch 17_Probablistic Methods.pptxUnit III_Ch 17_Probablistic Methods.pptx
Unit III_Ch 17_Probablistic Methods.pptx
 
FE3.ppt
FE3.pptFE3.ppt
FE3.ppt
 
Model Selection and Validation
Model Selection and ValidationModel Selection and Validation
Model Selection and Validation
 

Recently uploaded

LIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.pptLIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.ppt
ssuser9bd3ba
 
Digital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfDigital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdf
AbrahamGadissa
 
Hall booking system project report .pdf
Hall booking system project report  .pdfHall booking system project report  .pdf
Hall booking system project report .pdf
Kamal Acharya
 
Fruit shop management system project report.pdf
Fruit shop management system project report.pdfFruit shop management system project report.pdf
Fruit shop management system project report.pdf
Kamal Acharya
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Online blood donation management system project.pdf
Online blood donation management system project.pdfOnline blood donation management system project.pdf
Online blood donation management system project.pdf
Kamal Acharya
 

Recently uploaded (20)

HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.
 
A case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfA case study of cinema management system project report..pdf
A case study of cinema management system project report..pdf
 
LIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.pptLIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.ppt
 
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
 
Digital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfDigital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdf
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
 
Hall booking system project report .pdf
Hall booking system project report  .pdfHall booking system project report  .pdf
Hall booking system project report .pdf
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering Workshop
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
shape functions of 1D and 2 D rectangular elements.pptx
shape functions of 1D and 2 D rectangular elements.pptxshape functions of 1D and 2 D rectangular elements.pptx
shape functions of 1D and 2 D rectangular elements.pptx
 
Fruit shop management system project report.pdf
Fruit shop management system project report.pdfFruit shop management system project report.pdf
Fruit shop management system project report.pdf
 
Explosives Industry manufacturing process.pdf
Explosives Industry manufacturing process.pdfExplosives Industry manufacturing process.pdf
Explosives Industry manufacturing process.pdf
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptxCloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
 
Online blood donation management system project.pdf
Online blood donation management system project.pdfOnline blood donation management system project.pdf
Online blood donation management system project.pdf
 
2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge
 
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
 
Online resume builder management system project report.pdf
Online resume builder management system project report.pdfOnline resume builder management system project report.pdf
Online resume builder management system project report.pdf
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 

Polynomial regression

  • 1.
  • 2. Polynomial Regression GROUP MEMBERS Naveed Irshad (042) Waleed Ishaq (007) Ali Khan (039) Abid Shehzad (041) Rubab Rafique () Asma Kishwar ()
  • 3. Contents • Definition • Why we use polynomial Regression • History • Regression Model • Matrix Form • Matlab Code • Advantages • Disadvantages • Conclusion
  • 4. Polynomial Regression Defination: Polynomial regression is a form of linear regression in which the relationship between the independent variable x and the dependent variable y is modelled as an nth degree polynomial.
  • 5. Why we use polynomial regression • There are three main situations that indicate a linear relationship may not be a good model. • 1. Most important is the theoretical one. There are some relationships that a researcher will hypothesize is curvilinear. Clearly, if this is the case, include a polynomial term.
  • 6. Why we use polynomial regression • 2.The second chance is during visual inspection of your variables. This is one of those reasons for always doing univariate and bivariate inspections of your data before you begin your regression analyses. A simple scatter plot can reveal a curvilinear relationship.
  • 7. Why we use polynomial regression •3. Inspection of residuals. If you try to fit a linear model to curved data, a scatterplot of residuals (Y axis) on the predictor (X axis) will have patches of many positive residuals in the middle. This is a good sign that a linear model is not appropriate, and a polynomial may do better.
  • 8. History • The first design of an experiment for polynomial regression appeared in an 1815 paper of Gergonne. • In the twentieth century, polynomial regression played an important role in the development of regression analysis, with a greater emphasis on issues of design and inference. • More recently, the use of polynomial models has been complemented by other methods, with non-polynomial models having advantages for some classes of problems.
  • 9. A cubic polynomial regression fit to a simulated data set.The confidence band is a 95% simultaneous confidence band constructed using the Scheffé approach.
  • 10. Regression Model linear regression Model Quadratic model General polynomial Regression Model
  • 11. Matrix form • Polynomial regression model • Matrix
  • 12. Objective Of Polynomial regression: •How matlabs handle Polynomial. •POLVAL to evaluate Polynomial. •POLFIT to generate Polynomial trendline. •Plotting Polynomial trendline with data using commands.
  • 13. Q:How we implement Polynomial regression (Linear) Functions in Matlab? • Matlab code: • In matlab code where m is Nth order of polynomial i.e 2,3,4……..n • P=[1 5 10 20 40 60 100 200 400 700]; • T=[-36.7 19.6 -11.5 -2.6 7.6 15.4 26.1 42.2 60.6 80.1]; • m=3; • E=polyfit(T,P,m); • Z=polyval(E,T); • norm(P-Z); • n=length(P); • rms=norm(P-Z)/sqrt(n) • E • plot(T,Z,'o',T,P,'K')
  • 15. Now when we will change the value of ‘m’ i.e m=7 then rms is decrease and give us Polynomial badly condition….we can see in below command window…..
  • 16. Advantages • The biggest advantage of nonlinear regression over many other techniques is the broad range of functions that can be fit. • Polynomials very flexible, and useful where a model must be developed empirically. • Polynomial fit a wide range of curvature. • Polynomial provide a good approximation of the relationship. • Transformations generally more interpretable, often more easily interpreted in terms of a possible functional relationship.
  • 17. Disadvantages • Disadvantages include a strong sensitivity to outliers.The presence of one or two outliers in the data can seriously affect the results of a nonlinear analysis. • In addition there are unfortunately fewer model validation tools for the detection of outliers in nonlinear regression than there are for linear regression.
  • 18. Conclusion • Method of Polynomial Regression tell us about ill condion and Well condition. • Evaluate the coefficient constants then we have used different techniques like LU decomposition methon,Guass Elimination method etc