SlideShare a Scribd company logo
1 of 28
Download to read offline
MCS 7103: Machine Learning
Simon Alex and Nambaale
Support Vector Machines
Simon Alex and Nambaale MCS 7101 October 8, 2019 1 / 28
Overview
1 Support Vector Machines
Applications of SVM
What is Machine Learning?
What Is SVM?
Features of SVM
How Does SVM Work?
Non-Linear SVM
SVM Use Case
Simon Alex and Nambaale MCS 7101 October 8, 2019 2 / 28
Applications of Support Vector Machines
Text Categorization Bioinformatics Face Recognition Image Classification
Simon Alex and Nambaale MCS 7101 October 8, 2019 3 / 28
What is Machine Learning?
Simon Alex and Nambaale MCS 7101 October 8, 2019 4 / 28
Supervised Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 5 / 28
Unsupervised Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 6 / 28
Type of Problems in Machine Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 7 / 28
Where are Support Vector Machines?
Simon Alex and Nambaale MCS 7101 October 8, 2019 8 / 28
What is Support Vector Machine?
Support Vector Machine (SVM) is a supervised learning method used
for classification and regression.
SVM separates data using a hyperplane which acts like a decision
boundary between the various classes.
SVM works well for classifying higher-dimensional data (lots of fea-
tures).
Simon Alex and Nambaale MCS 7101 October 8, 2019 9 / 28
Features of Support Vector Machine
SVM is a supervised learning algorithm.
It can be used for both classification and regression problems.
SVM can be used for classifying non-linear data using the kernel trick.
Simon Alex and Nambaale MCS 7101 October 8, 2019 10 / 28
How Does SVM Work?
Simon Alex and Nambaale MCS 7101 October 8, 2019 11 / 28
How Does SVM Work?
Simon Alex and Nambaale MCS 7101 October 8, 2019 12 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 13 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 14 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 15 / 28
Non-Linear Support Vector Machine
Simon Alex and Nambaale MCS 7101 October 8, 2019 16 / 28
Non-Linear Support Vector Machine
Simon Alex and Nambaale MCS 7101 October 8, 2019 17 / 28
Defining the Separating Hyperplane
Form of equation defining the decision surface separating the classes is
a hyperplane of the form:
wT
x + b = 0
Where:
w is a weight vector
x is an input vector
b is bias
Simon Alex and Nambaale MCS 7101 October 8, 2019 18 / 28
Defining the Separating Hyperplane
Simon Alex and Nambaale MCS 7101 October 8, 2019 19 / 28
Support Vector Classification
In practice, SVM uses SVC to classify data.
Different kernels can be used with SVC.
These kernels include: linear, RBF and polynomial.
Some kernels work better than others for a given dataset.
Simon Alex and Nambaale MCS 7101 October 8, 2019 20 / 28
Gamma and C
Gamma controls the shape of the ’peaks’ where the points are raised.
The gamma parameter defines the degree of non-linearity, with low val-
ues tending high linearity and high values leading to high non-linearity.
Simon Alex and Nambaale MCS 7101 October 8, 2019 21 / 28
Influence of Gamma on Training Data
Simon Alex and Nambaale MCS 7101 October 8, 2019 22 / 28
Gamma and C
C controls the cost of misclassification on the training data.
A high C tries to minimize the misclassification of training data leading
to overfitting∗ and a low value tries to maintain a smooth classifica-
tion.
∗
Underfitting is where the model neither performs well in training nor testing.
Simon Alex and Nambaale MCS 7101 October 8, 2019 23 / 28
Influence of C on Training Data
Simon Alex and Nambaale MCS 7101 October 8, 2019 24 / 28
Cross-Validation
Cross-Validation is a statistical method of evaluating and comparing
learning algorithms by dividing data into two segments: one used to
learn or train a model and the other used to validate the model.
The basic form of cross-validation is k-fold cross-validation.
Simon Alex and Nambaale MCS 7101 October 8, 2019 25 / 28
K-Fold Cross Validation
Simon Alex and Nambaale MCS 7101 October 8, 2019 26 / 28
Questions?
Simon Alex and Nambaale MCS 7101 October 8, 2019 27 / 28
SVM Use Case
Simon Alex and Nambaale MCS 7101 October 8, 2019 28 / 28

More Related Content

What's hot

Lecture 18: Gaussian Mixture Models and Expectation Maximization
Lecture 18: Gaussian Mixture Models and Expectation MaximizationLecture 18: Gaussian Mixture Models and Expectation Maximization
Lecture 18: Gaussian Mixture Models and Expectation Maximizationbutest
 
Decision Tree - C4.5&CART
Decision Tree - C4.5&CARTDecision Tree - C4.5&CART
Decision Tree - C4.5&CARTXueping Peng
 
Random forest
Random forestRandom forest
Random forestUjjawal
 
Random forest algorithm
Random forest algorithmRandom forest algorithm
Random forest algorithmRashid Ansari
 
Methods of Optimization in Machine Learning
Methods of Optimization in Machine LearningMethods of Optimization in Machine Learning
Methods of Optimization in Machine LearningKnoldus Inc.
 
Unsupervised learning
Unsupervised learningUnsupervised learning
Unsupervised learningamalalhait
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machinesnextlib
 
KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...
KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...
KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...Simplilearn
 
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...Simplilearn
 
Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...
Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...
Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...Simplilearn
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Simplilearn
 
Ensemble learning
Ensemble learningEnsemble learning
Ensemble learningHaris Jamil
 
K means clustering
K means clusteringK means clustering
K means clusteringkeshav goyal
 

What's hot (20)

Support vector machine-SVM's
Support vector machine-SVM'sSupport vector machine-SVM's
Support vector machine-SVM's
 
Lecture 18: Gaussian Mixture Models and Expectation Maximization
Lecture 18: Gaussian Mixture Models and Expectation MaximizationLecture 18: Gaussian Mixture Models and Expectation Maximization
Lecture 18: Gaussian Mixture Models and Expectation Maximization
 
Support Vector Machines ( SVM )
Support Vector Machines ( SVM ) Support Vector Machines ( SVM )
Support Vector Machines ( SVM )
 
Svm
SvmSvm
Svm
 
Decision Tree - C4.5&CART
Decision Tree - C4.5&CARTDecision Tree - C4.5&CART
Decision Tree - C4.5&CART
 
Random forest
Random forestRandom forest
Random forest
 
Random forest algorithm
Random forest algorithmRandom forest algorithm
Random forest algorithm
 
Methods of Optimization in Machine Learning
Methods of Optimization in Machine LearningMethods of Optimization in Machine Learning
Methods of Optimization in Machine Learning
 
Unsupervised learning
Unsupervised learningUnsupervised learning
Unsupervised learning
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machines
 
Support vector machine
Support vector machineSupport vector machine
Support vector machine
 
KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...
KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...
KNN Algorithm - How KNN Algorithm Works With Example | Data Science For Begin...
 
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
 
Hierarchical Clustering
Hierarchical ClusteringHierarchical Clustering
Hierarchical Clustering
 
Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...
Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...
Decision Tree In R | Decision Tree Algorithm | Data Science Tutorial | Machin...
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
 
Ensemble learning
Ensemble learningEnsemble learning
Ensemble learning
 
Random forest
Random forestRandom forest
Random forest
 
Knn
KnnKnn
Knn
 
K means clustering
K means clusteringK means clustering
K means clustering
 

Recently uploaded

Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Fact vs. Fiction: Autodetecting Hallucinations in LLMs
Fact vs. Fiction: Autodetecting Hallucinations in LLMsFact vs. Fiction: Autodetecting Hallucinations in LLMs
Fact vs. Fiction: Autodetecting Hallucinations in LLMsZilliz
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 

Recently uploaded (20)

Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Fact vs. Fiction: Autodetecting Hallucinations in LLMs
Fact vs. Fiction: Autodetecting Hallucinations in LLMsFact vs. Fiction: Autodetecting Hallucinations in LLMs
Fact vs. Fiction: Autodetecting Hallucinations in LLMs
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 

Support vector-machines-presentation

  • 1. MCS 7103: Machine Learning Simon Alex and Nambaale Support Vector Machines Simon Alex and Nambaale MCS 7101 October 8, 2019 1 / 28
  • 2. Overview 1 Support Vector Machines Applications of SVM What is Machine Learning? What Is SVM? Features of SVM How Does SVM Work? Non-Linear SVM SVM Use Case Simon Alex and Nambaale MCS 7101 October 8, 2019 2 / 28
  • 3. Applications of Support Vector Machines Text Categorization Bioinformatics Face Recognition Image Classification Simon Alex and Nambaale MCS 7101 October 8, 2019 3 / 28
  • 4. What is Machine Learning? Simon Alex and Nambaale MCS 7101 October 8, 2019 4 / 28
  • 5. Supervised Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 5 / 28
  • 6. Unsupervised Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 6 / 28
  • 7. Type of Problems in Machine Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 7 / 28
  • 8. Where are Support Vector Machines? Simon Alex and Nambaale MCS 7101 October 8, 2019 8 / 28
  • 9. What is Support Vector Machine? Support Vector Machine (SVM) is a supervised learning method used for classification and regression. SVM separates data using a hyperplane which acts like a decision boundary between the various classes. SVM works well for classifying higher-dimensional data (lots of fea- tures). Simon Alex and Nambaale MCS 7101 October 8, 2019 9 / 28
  • 10. Features of Support Vector Machine SVM is a supervised learning algorithm. It can be used for both classification and regression problems. SVM can be used for classifying non-linear data using the kernel trick. Simon Alex and Nambaale MCS 7101 October 8, 2019 10 / 28
  • 11. How Does SVM Work? Simon Alex and Nambaale MCS 7101 October 8, 2019 11 / 28
  • 12. How Does SVM Work? Simon Alex and Nambaale MCS 7101 October 8, 2019 12 / 28
  • 13. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 13 / 28
  • 14. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 14 / 28
  • 15. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 15 / 28
  • 16. Non-Linear Support Vector Machine Simon Alex and Nambaale MCS 7101 October 8, 2019 16 / 28
  • 17. Non-Linear Support Vector Machine Simon Alex and Nambaale MCS 7101 October 8, 2019 17 / 28
  • 18. Defining the Separating Hyperplane Form of equation defining the decision surface separating the classes is a hyperplane of the form: wT x + b = 0 Where: w is a weight vector x is an input vector b is bias Simon Alex and Nambaale MCS 7101 October 8, 2019 18 / 28
  • 19. Defining the Separating Hyperplane Simon Alex and Nambaale MCS 7101 October 8, 2019 19 / 28
  • 20. Support Vector Classification In practice, SVM uses SVC to classify data. Different kernels can be used with SVC. These kernels include: linear, RBF and polynomial. Some kernels work better than others for a given dataset. Simon Alex and Nambaale MCS 7101 October 8, 2019 20 / 28
  • 21. Gamma and C Gamma controls the shape of the ’peaks’ where the points are raised. The gamma parameter defines the degree of non-linearity, with low val- ues tending high linearity and high values leading to high non-linearity. Simon Alex and Nambaale MCS 7101 October 8, 2019 21 / 28
  • 22. Influence of Gamma on Training Data Simon Alex and Nambaale MCS 7101 October 8, 2019 22 / 28
  • 23. Gamma and C C controls the cost of misclassification on the training data. A high C tries to minimize the misclassification of training data leading to overfitting∗ and a low value tries to maintain a smooth classifica- tion. ∗ Underfitting is where the model neither performs well in training nor testing. Simon Alex and Nambaale MCS 7101 October 8, 2019 23 / 28
  • 24. Influence of C on Training Data Simon Alex and Nambaale MCS 7101 October 8, 2019 24 / 28
  • 25. Cross-Validation Cross-Validation is a statistical method of evaluating and comparing learning algorithms by dividing data into two segments: one used to learn or train a model and the other used to validate the model. The basic form of cross-validation is k-fold cross-validation. Simon Alex and Nambaale MCS 7101 October 8, 2019 25 / 28
  • 26. K-Fold Cross Validation Simon Alex and Nambaale MCS 7101 October 8, 2019 26 / 28
  • 27. Questions? Simon Alex and Nambaale MCS 7101 October 8, 2019 27 / 28
  • 28. SVM Use Case Simon Alex and Nambaale MCS 7101 October 8, 2019 28 / 28