SlideShare a Scribd company logo
MCS 7103: Machine Learning
Simon Alex and Nambaale
Support Vector Machines
Simon Alex and Nambaale MCS 7101 October 8, 2019 1 / 28
Overview
1 Support Vector Machines
Applications of SVM
What is Machine Learning?
What Is SVM?
Features of SVM
How Does SVM Work?
Non-Linear SVM
SVM Use Case
Simon Alex and Nambaale MCS 7101 October 8, 2019 2 / 28
Applications of Support Vector Machines
Text Categorization Bioinformatics Face Recognition Image Classification
Simon Alex and Nambaale MCS 7101 October 8, 2019 3 / 28
What is Machine Learning?
Simon Alex and Nambaale MCS 7101 October 8, 2019 4 / 28
Supervised Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 5 / 28
Unsupervised Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 6 / 28
Type of Problems in Machine Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 7 / 28
Where are Support Vector Machines?
Simon Alex and Nambaale MCS 7101 October 8, 2019 8 / 28
What is Support Vector Machine?
Support Vector Machine (SVM) is a supervised learning method used
for classification and regression.
SVM separates data using a hyperplane which acts like a decision
boundary between the various classes.
SVM works well for classifying higher-dimensional data (lots of fea-
tures).
Simon Alex and Nambaale MCS 7101 October 8, 2019 9 / 28
Features of Support Vector Machine
SVM is a supervised learning algorithm.
It can be used for both classification and regression problems.
SVM can be used for classifying non-linear data using the kernel trick.
Simon Alex and Nambaale MCS 7101 October 8, 2019 10 / 28
How Does SVM Work?
Simon Alex and Nambaale MCS 7101 October 8, 2019 11 / 28
How Does SVM Work?
Simon Alex and Nambaale MCS 7101 October 8, 2019 12 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 13 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 14 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 15 / 28
Non-Linear Support Vector Machine
Simon Alex and Nambaale MCS 7101 October 8, 2019 16 / 28
Non-Linear Support Vector Machine
Simon Alex and Nambaale MCS 7101 October 8, 2019 17 / 28
Defining the Separating Hyperplane
Form of equation defining the decision surface separating the classes is
a hyperplane of the form:
wT
x + b = 0
Where:
w is a weight vector
x is an input vector
b is bias
Simon Alex and Nambaale MCS 7101 October 8, 2019 18 / 28
Defining the Separating Hyperplane
Simon Alex and Nambaale MCS 7101 October 8, 2019 19 / 28
Support Vector Classification
In practice, SVM uses SVC to classify data.
Different kernels can be used with SVC.
These kernels include: linear, RBF and polynomial.
Some kernels work better than others for a given dataset.
Simon Alex and Nambaale MCS 7101 October 8, 2019 20 / 28
Gamma and C
Gamma controls the shape of the ’peaks’ where the points are raised.
The gamma parameter defines the degree of non-linearity, with low val-
ues tending high linearity and high values leading to high non-linearity.
Simon Alex and Nambaale MCS 7101 October 8, 2019 21 / 28
Influence of Gamma on Training Data
Simon Alex and Nambaale MCS 7101 October 8, 2019 22 / 28
Gamma and C
C controls the cost of misclassification on the training data.
A high C tries to minimize the misclassification of training data leading
to overfitting∗ and a low value tries to maintain a smooth classifica-
tion.
∗
Underfitting is where the model neither performs well in training nor testing.
Simon Alex and Nambaale MCS 7101 October 8, 2019 23 / 28
Influence of C on Training Data
Simon Alex and Nambaale MCS 7101 October 8, 2019 24 / 28
Cross-Validation
Cross-Validation is a statistical method of evaluating and comparing
learning algorithms by dividing data into two segments: one used to
learn or train a model and the other used to validate the model.
The basic form of cross-validation is k-fold cross-validation.
Simon Alex and Nambaale MCS 7101 October 8, 2019 25 / 28
K-Fold Cross Validation
Simon Alex and Nambaale MCS 7101 October 8, 2019 26 / 28
Questions?
Simon Alex and Nambaale MCS 7101 October 8, 2019 27 / 28
SVM Use Case
Simon Alex and Nambaale MCS 7101 October 8, 2019 28 / 28

More Related Content

What's hot

Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...
Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...
Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...
Simplilearn
 
Vanishing & Exploding Gradients
Vanishing & Exploding GradientsVanishing & Exploding Gradients
Vanishing & Exploding Gradients
Siddharth Vij
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machinesnextlib
 
Transfer learning-presentation
Transfer learning-presentationTransfer learning-presentation
Transfer learning-presentation
Bushra Jbawi
 
Support Vector machine
Support Vector machineSupport Vector machine
Support Vector machine
Anandha L Ranganathan
 
Convolutional neural network
Convolutional neural network Convolutional neural network
Convolutional neural network
Yan Xu
 
Deep Learning Tutorial
Deep Learning TutorialDeep Learning Tutorial
Deep Learning Tutorial
Amr Rashed
 
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Simplilearn
 
Unit 2 unsupervised learning.pptx
Unit 2 unsupervised learning.pptxUnit 2 unsupervised learning.pptx
Unit 2 unsupervised learning.pptx
Dr.Shweta
 
Support Vector Machines ( SVM )
Support Vector Machines ( SVM ) Support Vector Machines ( SVM )
Support Vector Machines ( SVM )
Mohammad Junaid Khan
 
An introduction to Machine Learning
An introduction to Machine LearningAn introduction to Machine Learning
An introduction to Machine Learningbutest
 
Recurrent Neural Networks, LSTM and GRU
Recurrent Neural Networks, LSTM and GRURecurrent Neural Networks, LSTM and GRU
Recurrent Neural Networks, LSTM and GRU
ananth
 
Regression and Classification: An Artificial Neural Network Approach
Regression and Classification: An Artificial Neural Network ApproachRegression and Classification: An Artificial Neural Network Approach
Regression and Classification: An Artificial Neural Network Approach
Khulna University
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
Devashish Shanker
 
Support Vector Machine (SVM)
Support Vector Machine (SVM)Support Vector Machine (SVM)
Support Vector Machine (SVM)
Sana Rahim
 
Dimensionality Reduction | Machine Learning | CloudxLab
Dimensionality Reduction | Machine Learning | CloudxLabDimensionality Reduction | Machine Learning | CloudxLab
Dimensionality Reduction | Machine Learning | CloudxLab
CloudxLab
 
Machine learning ppt.
Machine learning ppt.Machine learning ppt.
Machine learning ppt.
ASHOK KUMAR
 
Ensemble learning
Ensemble learningEnsemble learning
Ensemble learning
Haris Jamil
 
Training Neural Networks
Training Neural NetworksTraining Neural Networks
Training Neural Networks
Databricks
 
Principal Component Analysis (PCA) and LDA PPT Slides
Principal Component Analysis (PCA) and LDA PPT SlidesPrincipal Component Analysis (PCA) and LDA PPT Slides
Principal Component Analysis (PCA) and LDA PPT Slides
AbhishekKumar4995
 

What's hot (20)

Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...
Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...
Support Vector Machine - How Support Vector Machine works | SVM in Machine Le...
 
Vanishing & Exploding Gradients
Vanishing & Exploding GradientsVanishing & Exploding Gradients
Vanishing & Exploding Gradients
 
Support Vector Machines
Support Vector MachinesSupport Vector Machines
Support Vector Machines
 
Transfer learning-presentation
Transfer learning-presentationTransfer learning-presentation
Transfer learning-presentation
 
Support Vector machine
Support Vector machineSupport Vector machine
Support Vector machine
 
Convolutional neural network
Convolutional neural network Convolutional neural network
Convolutional neural network
 
Deep Learning Tutorial
Deep Learning TutorialDeep Learning Tutorial
Deep Learning Tutorial
 
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
Convolutional Neural Network - CNN | How CNN Works | Deep Learning Course | S...
 
Unit 2 unsupervised learning.pptx
Unit 2 unsupervised learning.pptxUnit 2 unsupervised learning.pptx
Unit 2 unsupervised learning.pptx
 
Support Vector Machines ( SVM )
Support Vector Machines ( SVM ) Support Vector Machines ( SVM )
Support Vector Machines ( SVM )
 
An introduction to Machine Learning
An introduction to Machine LearningAn introduction to Machine Learning
An introduction to Machine Learning
 
Recurrent Neural Networks, LSTM and GRU
Recurrent Neural Networks, LSTM and GRURecurrent Neural Networks, LSTM and GRU
Recurrent Neural Networks, LSTM and GRU
 
Regression and Classification: An Artificial Neural Network Approach
Regression and Classification: An Artificial Neural Network ApproachRegression and Classification: An Artificial Neural Network Approach
Regression and Classification: An Artificial Neural Network Approach
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
 
Support Vector Machine (SVM)
Support Vector Machine (SVM)Support Vector Machine (SVM)
Support Vector Machine (SVM)
 
Dimensionality Reduction | Machine Learning | CloudxLab
Dimensionality Reduction | Machine Learning | CloudxLabDimensionality Reduction | Machine Learning | CloudxLab
Dimensionality Reduction | Machine Learning | CloudxLab
 
Machine learning ppt.
Machine learning ppt.Machine learning ppt.
Machine learning ppt.
 
Ensemble learning
Ensemble learningEnsemble learning
Ensemble learning
 
Training Neural Networks
Training Neural NetworksTraining Neural Networks
Training Neural Networks
 
Principal Component Analysis (PCA) and LDA PPT Slides
Principal Component Analysis (PCA) and LDA PPT SlidesPrincipal Component Analysis (PCA) and LDA PPT Slides
Principal Component Analysis (PCA) and LDA PPT Slides
 

Recently uploaded

How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
Vlad Stirbu
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 

Recently uploaded (20)

How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 

Support vector-machines-presentation

  • 1. MCS 7103: Machine Learning Simon Alex and Nambaale Support Vector Machines Simon Alex and Nambaale MCS 7101 October 8, 2019 1 / 28
  • 2. Overview 1 Support Vector Machines Applications of SVM What is Machine Learning? What Is SVM? Features of SVM How Does SVM Work? Non-Linear SVM SVM Use Case Simon Alex and Nambaale MCS 7101 October 8, 2019 2 / 28
  • 3. Applications of Support Vector Machines Text Categorization Bioinformatics Face Recognition Image Classification Simon Alex and Nambaale MCS 7101 October 8, 2019 3 / 28
  • 4. What is Machine Learning? Simon Alex and Nambaale MCS 7101 October 8, 2019 4 / 28
  • 5. Supervised Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 5 / 28
  • 6. Unsupervised Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 6 / 28
  • 7. Type of Problems in Machine Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 7 / 28
  • 8. Where are Support Vector Machines? Simon Alex and Nambaale MCS 7101 October 8, 2019 8 / 28
  • 9. What is Support Vector Machine? Support Vector Machine (SVM) is a supervised learning method used for classification and regression. SVM separates data using a hyperplane which acts like a decision boundary between the various classes. SVM works well for classifying higher-dimensional data (lots of fea- tures). Simon Alex and Nambaale MCS 7101 October 8, 2019 9 / 28
  • 10. Features of Support Vector Machine SVM is a supervised learning algorithm. It can be used for both classification and regression problems. SVM can be used for classifying non-linear data using the kernel trick. Simon Alex and Nambaale MCS 7101 October 8, 2019 10 / 28
  • 11. How Does SVM Work? Simon Alex and Nambaale MCS 7101 October 8, 2019 11 / 28
  • 12. How Does SVM Work? Simon Alex and Nambaale MCS 7101 October 8, 2019 12 / 28
  • 13. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 13 / 28
  • 14. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 14 / 28
  • 15. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 15 / 28
  • 16. Non-Linear Support Vector Machine Simon Alex and Nambaale MCS 7101 October 8, 2019 16 / 28
  • 17. Non-Linear Support Vector Machine Simon Alex and Nambaale MCS 7101 October 8, 2019 17 / 28
  • 18. Defining the Separating Hyperplane Form of equation defining the decision surface separating the classes is a hyperplane of the form: wT x + b = 0 Where: w is a weight vector x is an input vector b is bias Simon Alex and Nambaale MCS 7101 October 8, 2019 18 / 28
  • 19. Defining the Separating Hyperplane Simon Alex and Nambaale MCS 7101 October 8, 2019 19 / 28
  • 20. Support Vector Classification In practice, SVM uses SVC to classify data. Different kernels can be used with SVC. These kernels include: linear, RBF and polynomial. Some kernels work better than others for a given dataset. Simon Alex and Nambaale MCS 7101 October 8, 2019 20 / 28
  • 21. Gamma and C Gamma controls the shape of the ’peaks’ where the points are raised. The gamma parameter defines the degree of non-linearity, with low val- ues tending high linearity and high values leading to high non-linearity. Simon Alex and Nambaale MCS 7101 October 8, 2019 21 / 28
  • 22. Influence of Gamma on Training Data Simon Alex and Nambaale MCS 7101 October 8, 2019 22 / 28
  • 23. Gamma and C C controls the cost of misclassification on the training data. A high C tries to minimize the misclassification of training data leading to overfitting∗ and a low value tries to maintain a smooth classifica- tion. ∗ Underfitting is where the model neither performs well in training nor testing. Simon Alex and Nambaale MCS 7101 October 8, 2019 23 / 28
  • 24. Influence of C on Training Data Simon Alex and Nambaale MCS 7101 October 8, 2019 24 / 28
  • 25. Cross-Validation Cross-Validation is a statistical method of evaluating and comparing learning algorithms by dividing data into two segments: one used to learn or train a model and the other used to validate the model. The basic form of cross-validation is k-fold cross-validation. Simon Alex and Nambaale MCS 7101 October 8, 2019 25 / 28
  • 26. K-Fold Cross Validation Simon Alex and Nambaale MCS 7101 October 8, 2019 26 / 28
  • 27. Questions? Simon Alex and Nambaale MCS 7101 October 8, 2019 27 / 28
  • 28. SVM Use Case Simon Alex and Nambaale MCS 7101 October 8, 2019 28 / 28